Expand description
The routed-call server trait and its shared error types.
RoutedLlmClient is the one piece of I/O the protocol does not own: a host
implements it to actually perform a model call. It lives here — rather than in
libsy’s orchestration crate — so a client crate that depends only on the protocol
can serve routed calls without pulling in the orchestrator.
Enums§
- LlmClient
Error - Failures a routed LLM client can surface to its caller.
- Routing
Fallback Reason - Why routing replaced a selected target with another eligible target.
Traits§
- Routed
LlmClient - Performs the actual model call for a target. This is the one piece of I/O the
library does not own — a host implements it over its own transport (HTTP SDK,
in-process model, mock). It serves a call the stream consumer chose not to
override, reached as a routed request’s
default_client.
Type Aliases§
- BoxError
- A boxed client-specific error preserved as the source of a routed call failure.