Skip to main content

Module client

Module client 

Source
Expand description

Routed-call client contracts and shared error types.

Hosts implement these traits to perform model calls. Keeping the contracts here lets clients depend on the protocol without pulling in libsy’s orchestration.

Enums§

LlmClientError
Failures a routed LLM client can surface to its caller.
RoutingFallbackReason
Why routing replaced a selected target with another eligible target.

Traits§

RoutedDecisionClient
Serves typed decision calls over a host-owned transport. Implementations may be shared across targets and called concurrently.
RoutedLlmClient
Performs the actual model call for a target. This is the one piece of I/O the library does not own — a host implements it over its own transport (HTTP SDK, in-process model, mock). It serves a call the stream consumer chose not to override, reached as a routed request’s default_client.

Type Aliases§

BoxError
A boxed client-specific error preserved as the source of a routed call failure.