pub struct LlmCapabilityConfig {
pub base_threshold: f64,
pub threshold_step: f64,
pub unmatched_steps: u8,
pub contract: ClassifierContractConfig,
pub max_output_tokens: u64,
pub judge_deadline_ms: Option<u64>,
}Expand description
Prompt, output, and solve-probability settings for an LLM capability judge.
Fields§
§base_threshold: f64Lowest solve probability that routes a supported task to the efficient target.
threshold_step: f64Amount added per capability-boundary step: zero for supported, one for
uncertain, unmatched_steps for unmatched, and two for unsupported.
unmatched_steps: u8Threshold steps applied to an unmatched verdict (no capability rule applies).
Defaults to 1, the same as an uncertain verdict. 2 treats it like unsupported.
contract: ClassifierContractConfigPrompt and verdict contract settings for the classifier judge.
max_output_tokens: u64Maximum completion tokens available to the classifier verdict.
judge_deadline_ms: Option<u64>Whole-consultation bound on the judge call, in milliseconds. Covers the model
call and the response drain; on expiry the judge is treated as unavailable and
follows the route’s fail_open setting. None is unbounded.
Trait Implementations§
Source§impl Clone for LlmCapabilityConfig
impl Clone for LlmCapabilityConfig
Source§fn clone(&self) -> LlmCapabilityConfig
fn clone(&self) -> LlmCapabilityConfig
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
source. Read more