Expand description
Streaming half of the neutral IR: incremental response chunks (LlmResponseChunk),
their stream envelope (LlmResponseStreamEvent), and the streamed response
(LlmResponse) that carries either a live stream or the terminal AggLlmResponse.
Structs§
- LlmResponse
Stream Event - One streaming item crossing the host/algorithm boundary.
- Provider
Stream Event - Parsed provider event retained for same-format replay.
- Response
Accumulator - Folds a sequence of
LlmResponseChunks into the terminalAggLlmResponse.
Enums§
- LlmResponse
- A model response: either a live
Streamof events or a terminal bufferedLlmResponse::Aggresponse. - LlmResponse
Chunk - One provider-neutral streaming response chunk.
Type Aliases§
- LlmResponse
Stream - A boxed,
Sendstream of response events. Each item may fail independently mid-stream.