Expand description
The routed-call server trait and the routing decision it carries.
RoutedLlmClient is the one piece of I/O the protocol does not own: a host
implements it to actually perform a model call. Decision is the routing
decision that produced the call, carried alongside so the client and any
observer can see which model was chosen and why. Both live here — rather than
in libsy’s orchestration crate — so a client crate that depends only on the
protocol can serve routed calls without pulling in the orchestrator.
Structs§
- Simple
Decision - A minimal
Decisionimplementation for one-off calls that don’t belong to a named algorithm step — judge side calls, classifier side calls, etc.
Enums§
- LlmClient
Error - Failures a routed LLM client can surface to its caller.
Traits§
- Decision
- A decision/trace object produced by an algorithm.
- Routed
LlmClient - Performs the actual model call for a target. This is the one piece of I/O the
library does not own — a host implements it over its own transport (HTTP SDK,
in-process model, mock). It serves a call the stream consumer chose not to
override, reached as a routed request’s
default_client.
Type Aliases§
- BoxError
- A boxed client-specific error preserved as the source of a routed call failure.