Struct Runner 

pub struct Runner { /* private fields */ }

Immutable named route table.

Implementations

impl Runner

pub fn load(path: impl AsRef<Path>) -> Result<Self, RunnerError>

Loads and validates a version-1 deployment TOML file.

pub fn from_toml(source: &str) -> Result<Self, RunnerError>

Loads and validates a version-1 deployment TOML document.

Use Self::load when the deployment is stored in a file.

pub fn new(routes: Vec<(ModelId, Route)>) -> Self

Builds a runner from named routes in caller-provided order. Pre-condition: There must be at least one route.

pub fn with_provider_api_keys(self, keys: Vec<String>) -> Self

Registers deployment-owned API keys for serving-surface output redaction. TOML loading registers these automatically; programmatic hosts must supply them.

pub fn provider_api_keys(&self) -> &[String]

Returns deployment-owned secrets for serving-surface output redactors.

pub fn route(&self, model: &str) -> Option<&Route>

Returns the route registered for a model.

pub fn models(&self) -> impl Iterator<Item = ModelInfo<'_>>

Iterates over configured routes in caller-provided order.

pub async fn model_properties( &self, model: &str, timeout: Duration, ) -> Option<Value>

Reads one route’s configured local backend properties without exposing its credentials.

pub fn fallback_base_url(&self) -> Option<&str>

Returns the validated API root used for unmatched HTTP requests.

pub fn describe_decision( &self, model: &ModelId, outcome: &RoutingOutcome, ) -> Option<DecisionDescription>

Resolves an outcome to configured target names and non-secret client settings.