Enum Step 

pub enum Step {
    CallLlm(Box<CallLlmRequest>),
    Decision(Arc<dyn Decision>),
    ReturnToAgent(Box<Response>),
}

One item in the stream returned by Driver::stream / Algorithm::run_stream.

Variants

CallLlm(Box<CallLlmRequest>)

The algorithm needs this model call performed. The host serves it (optionally via RoutedRequest::default_client) and fulfills it with CallLlmRequest::respond. Boxed: it is by far the largest variant.

Decision(Arc<dyn Decision>)

A routing decision the algorithm made, published via Driver::info as it happens (rather than collected into a trace returned at the end).

ReturnToAgent(Box<Response>)

The algorithm finished with its final response — the last step of a run.