Skip to main content

Module stream

Module stream 

Source
Expand description

Streaming half of the neutral IR: incremental response chunks (LlmResponseChunk), their stream envelope (LlmResponseStreamEvent), and the streamed response (LlmResponse) that carries either a live stream or the terminal AggLlmResponse.

Structs§

LlmResponseStreamEvent
One streaming item crossing the host/algorithm boundary.
ProviderStreamEvent
Parsed provider event retained for same-format replay.
ResponseAccumulator
Folds a sequence of LlmResponseChunks into the terminal AggLlmResponse.

Enums§

LlmResponse
A model response: either a live Stream of events or a terminal buffered LlmResponse::Agg response.
LlmResponseChunk
One provider-neutral streaming response chunk.

Type Aliases§

LlmResponseStream
A boxed, Send stream of response events. Each item may fail independently mid-stream.