marola.llm

package marola.llm

Members list

Type members

Classlikes

final case class ChatMessage(role: String, content: String)

Attributes

Supertypes
trait Serializable
trait Product
trait Equals
class Object
trait Matchable
class Any
Show all
final case class CompiledPrompt(instructions: String, demos: List[Map[String, String]], outputField: String)

Loads a DSPy-compiled prompt artifact (dspy/compile_recommendation_prompt.py produces two: recommendation_prompt.json for the summarizer, review_prompt.json for Reviewer — see ARCHITECTURE.md §5a) and turns it into a plain chat message list any LlmClient can replay.

Loads a DSPy-compiled prompt artifact (dspy/compile_recommendation_prompt.py produces two: recommendation_prompt.json for the summarizer, review_prompt.json for Reviewer — see ARCHITECTURE.md §5a) and turns it into a plain chat message list any LlmClient can replay.

Attributes

Companion
object
Supertypes
trait Serializable
trait Product
trait Equals
class Object
trait Matchable
class Any
Show all

Attributes

Companion
class
Supertypes
trait Product
trait Mirror
class Object
trait Matchable
class Any
Self type
trait LlmClient

One backend for "turn a BestHour into a natural-language summary" (see Recommender's query synthesis step, ARCHITECTURE.md §5).

One backend for "turn a BestHour into a natural-language summary" (see Recommender's query synthesis step, ARCHITECTURE.md §5).

Attributes

Companion
object
Supertypes
class Object
trait Matchable
class Any
Known subtypes
object LlmClient

Attributes

Companion
trait
Supertypes
class Object
trait Matchable
class Any
Self type
LlmClient.type
object Reviewer

The reviewer/critic pass (FUTURE-WORK.md §4.2, now built rather than just proposed): replays a second DSPy-compiled artifact (review_prompt.json, compiled from dspy/compile_recommendation_prompt.py's ReviewSwimSummary signature) against the summarizer's own draft output, before either reaches a user.

The reviewer/critic pass (FUTURE-WORK.md §4.2, now built rather than just proposed): replays a second DSPy-compiled artifact (review_prompt.json, compiled from dspy/compile_recommendation_prompt.py's ReviewSwimSummary signature) against the summarizer's own draft output, before either reaches a user.

Attributes

Supertypes
class Object
trait Matchable
class Any
Self type
Reviewer.type

Attributes

Companion
class
Supertypes
class Object
trait Matchable
class Any
Self type
final class TracedLlmClient(inner: LlmClient, model: String, tracing: Tracing, traceContent: Boolean) extends LlmClient

MIP-0010 task 6: the decorator that gives every LlmClient.complete one span — llm. with the GenAI semantic-convention attributes MLflow ingests (gen_ai.operation.name, gen_ai.request.model) plus marola's own sizes (message count, prompt/completion characters).

MIP-0010 task 6: the decorator that gives every LlmClient.complete one span — llm. with the GenAI semantic-convention attributes MLflow ingests (gen_ai.operation.name, gen_ai.request.model) plus marola's own sizes (message count, prompt/completion characters).

Attributes

Companion
object
Supertypes
trait LlmClient
class Object
trait Matchable
class Any