Expand description
Provider-neutral conversation types shared by routing, clients, and translation.
Debug output redacts MCP URLs and authorization tokens and hides raw provider tool definitions, extensions, and preserved bodies. Conversation content, including unknown provider blocks, remains visible and may contain secrets. Serialization retains the stored values.
Structs§
- AggLlm
Response - Normalized, fully-buffered response — the aggregate of a completed generation.
This is the terminal form of a streamed
LlmResponse. - Input
Cache Usage - Optional cache-token detail kept out of the common, cache-free usage allocation.
- Instruction
Block - Instruction content separated from normal conversation messages.
- LlmRequest
- Normalized request representation shared by Switchyard components.
- McpListed
Tool - A tool discovered on an MCP server.
- McpTool
Config - Settings for an individual MCP tool or the defaults for a toolset.
- McpToolset
- Configuration for a URL-based remote MCP toolset.
- Message
- One normalized conversation message.
- Output
Params - Output budget and structured-output options.
- Preservation
Metadata - Exact source payloads retained for lossless same-format round trips.
- Provider
Extensions - Provider-specific fields that do not have first-class conversation fields.
- Reasoning
Params - Provider reasoning controls preserved by translation.
- Response
Output - One assistant output item in a normalized response.
- Sampling
Params - Provider sampling parameters with common cross-provider names.
- Tool
Call - Normalized assistant tool call.
- Tool
Definition - Normalized tool definition.
- Tool
Result - Normalized tool result message content.
- UrlCitation
- A source URL cited by generated text.
- Usage
- Normalized token usage counts.
Enums§
- Content
Block - Normalized content block variants carried by messages and tool results.
- File
Source - File payload forms supported by the conversation model.
- Image
Source - Image payload forms supported by the conversation model.
- McpContent
- MCP discovery and execution history. Results reference the matching call’s server identity.
- Media
Source - Audio and video payload forms supported by the conversation model.
- Role
- Actor role normalized across provider APIs.
- Stop
Reason - Normalized reason a model stopped producing output.
- Tool
- A tool available to the model, in catalog order.
- Tool
Choice - Normalized tool choice policy.