Expand description
Routed-call client contracts and shared error types.
Hosts implement these traits to perform model calls. Keeping the contracts here lets clients depend on the protocol without pulling in libsy’s orchestration.
Enums§
- LlmClient
Error - Failures a routed LLM client can surface to its caller.
- Routing
Fallback Reason - Why routing replaced a selected target with another eligible target.
Traits§
- Routed
Decision Client - Serves typed decision calls over a host-owned transport. Implementations may be shared across targets and called concurrently.
- Routed
LlmClient - Performs the actual model call for a target. This is the one piece of I/O the
library does not own — a host implements it over its own transport (HTTP SDK,
in-process model, mock). It serves a call the stream consumer chose not to
override, reached as a routed request’s
default_client.
Type Aliases§
- BoxError
- A boxed client-specific error preserved as the source of a routed call failure.