Skip to main content

Module client

Module client 

Source
Expand description

The routed-call server trait and the routing decision it carries.

RoutedLlmClient is the one piece of I/O the protocol does not own: a host implements it to actually perform a model call. Decision is the routing decision that produced the call, carried alongside so the client and any observer can see which model was chosen and why. Both live here — rather than in libsy’s orchestration crate — so a client crate that depends only on the protocol can serve routed calls without pulling in the orchestrator.

Structs§

Decision
A routing choice produced by an algorithm.

Enums§

LlmClientError
Failures a routed LLM client can surface to its caller.
RoutingFallbackReason
Why routing replaced a selected target with another eligible target.

Traits§

RoutedLlmClient
Performs the actual model call for a target. This is the one piece of I/O the library does not own — a host implements it over its own transport (HTTP SDK, in-process model, mock). It serves a call the stream consumer chose not to override, reached as a routed request’s default_client.

Type Aliases§

BoxError
A boxed client-specific error preserved as the source of a routed call failure.