Struct PlanExecute 

pub struct PlanExecute { /* private fields */ }

Routes planning turns to the runtime capable model, then latches execution to the runtime efficient model after the first recorded mutation.

Implementations

impl PlanExecute

pub fn new(config: PlanExecuteConfig) -> Result<Self>

Creates a plan/execute router.

Returns an error when either configured prompt is blank.

Trait Implementations

impl Algorithm for PlanExecute

fn name(&self) -> &str

Stable, low-cardinality name identifying this algorithm — the algorithm attribute on every span, metric, and log line the crate emits for its runs.

fn route<'async_trait>( self: Arc<Self>, driver: Driver, request: Request, ) -> Pin<Box<dyn Future<Output = Result<RoutingOutcome>> + Send + 'async_trait>>

where Self: 'async_trait,

Run one request to completion: make routing-time model calls with Driver::call_model and return the terminal RoutingOutcome. The method an algorithm implements; run_stream drives it.

fn run_stream( self: Arc<Self>, request: Request, models: Arc<RuntimeModels>, ) -> StepStream

Process a request to completion, returning a stream of Steps.