Struct Driver 

pub struct Driver { /* private fields */ }

The offload channel handed to an algorithm’s create_run_task. The algorithm makes model calls with call_llm and publishes its Decisions with info; each call is offloaded to the request’s Step stream and awaits the consumer’s response. The step channel is bounded, so the consumer paces the algorithm one step at a time.

Implementations

impl Driver

pub async fn call_llm(&self, routed: RoutedRequest) -> Result<Response>

Offload a model call: publish routed as a Step::CallLlm and await the consumer’s Response. The call’s context travels inside routed.ctx. Errors if the stream is closed or the call failed. The await is wrapped in a libsy.llm_call span measuring fulfillment as the algorithm observes it (host queueing/serving included; a streamed response resolves when its stream handle arrives); latency, outcome, and token usage are recorded when it resolves. The provider call itself is the host’s, and is instrumented by whoever makes it.

pub async fn info( &self, ctx: Context, decision: Arc<dyn Decision>, ) -> Result<()>

Publish a routing Decision as a Step::Decision on the stream. Each successfully published decision is counted and logged with its reasoning; a decision the stream never accepted is not recorded.

Trait Implementations

impl Clone for Driver

fn clone(&self) -> Driver

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Default for Driver

fn default() -> Self

Returns the “default value” for a type.