pub struct DecisionJudgeConfig {
pub cutoff: f64,
pub instructions: Option<Value>,
pub criteria: Option<BTreeMap<String, Value>>,
pub candidates: BTreeMap<String, ModelId>,
pub evidence: Value,
}Expand description
Instructions, evidence, and cutoff policy for a decision judge.
Candidate labels keep model names out of the generated context. Evidence must use the same labels, with unknown outcomes left unknown. Only the first runtime capable and efficient targets are compared; extra candidates do not add routes.
Fields§
§cutoff: f64Route capable only when its choice score is strictly above this cutoff. This score is not a calibrated solve probability. Choose a cutoff from evaluations.
instructions: Option<Value>Replaces the packaged instructions. Without custom criteria, preserve
the meaning of advantage and no_advantage.
criteria: Option<BTreeMap<String, Value>>Two choice descriptions keyed by candidate label. Requires custom instructions.
candidates: BTreeMap<String, ModelId>Maps anonymous labels used in evidence (e.g. "a") to runtime model IDs.
Every compared target needs a unique label; extra candidates provide context.
evidence: ValueJSON passed unchanged to the judge, such as candidate descriptions, reference cases, outcome/cost summaries, and selection notes. The judge interprets it using the instructions; the router neither reads its fields nor derives statistics.
Trait Implementations§
Source§impl Clone for DecisionJudgeConfig
impl Clone for DecisionJudgeConfig
Source§fn clone(&self) -> DecisionJudgeConfig
fn clone(&self) -> DecisionJudgeConfig
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
source. Read more