Expand description
TranslatingLlmClient: encode a neutral
request, call the configured backend over HTTP, decode the neutral response.
Structs§
- Model
Config - A named target’s provider model and backends.
- Translating
LlmClient - A client that dispatches neutral-IR requests to named targets.
Enums§
- Auxiliary
Operation - A model-bearing provider operation outside the normal completion endpoint.