Skip to main content

Module client

Module client 

Source
Expand description

The routed-call server trait and the routing decision it carries.

RoutedLlmClient is the one piece of I/O the protocol does not own: a host implements it to actually perform a model call. Decision is the routing decision that produced the call, carried alongside so the client and any observer can see which model was chosen and why. Both live here — rather than in libsy’s orchestration crate — so a client crate that depends only on the protocol can serve routed calls without pulling in the orchestrator.

Structs§

SimpleDecision
A minimal Decision implementation for one-off calls that don’t belong to a named algorithm step — judge side calls, classifier side calls, etc.

Enums§

LlmClientError
Failures a routed LLM client can surface to its caller.

Traits§

Decision
A decision/trace object produced by an algorithm.
RoutedLlmClient
Performs the actual model call for a target. This is the one piece of I/O the library does not own — a host implements it over its own transport (HTTP SDK, in-process model, mock). It serves a call the stream consumer chose not to override, reached as a routed request’s default_client.

Type Aliases§

BoxError
A boxed client-specific error preserved as the source of a routed call failure.