Skip to main content

Module client

Module client 

Source
Expand description

TranslatingLlmClient: encode a neutral request, call the configured backend over HTTP, decode the neutral response.

Structs§

ModelConfig
A named target’s provider model and backends.
TranslatingLlmClient
A client that dispatches neutral-IR requests to named targets.

Enums§

AuxiliaryOperation
A model-bearing provider operation outside the normal completion endpoint.