Struct RoutingOutcome 

pub struct RoutingOutcome {
    pub selected_model_id: ModelId,
    pub fallback_models: Vec<ModelId>,
    pub request: Request,
    pub response: Option<Response>,
}

The terminal result of routing.

Fields

selected_model_id: ModelId

The model selected by the algorithm and tried first by the client.

fallback_models: Vec<ModelId>

Additional models the client may try in order after an eligible failure.

request: Request

The request after all routing-time rewrites, stamped with the selected model.

response: Option<Response>

A response produced while routing, or None when the client must make the answer call.

Implementations

impl RoutingOutcome

pub fn route_to( selected_model_id: ModelId, fallback_models: Vec<ModelId>, request: Request, ) -> Self

The decision is that client should send this request. The selected_model_id will be written into it by this function. If that fails client should try the fallback_models in order.

pub fn answered( selected_model_id: ModelId, request: Request, response: Response, ) -> Self

Algorithm generated the response as part of the routing decision. Here it is. The request will have the selected_model_id written into it by this function.