Verification-Gated Routing

Verification-Gated Routing (VGR) generates a candidate on a local tier. For a final answer, it gathers bounded evidence about that exact candidate and serves it only when the policy allows it. All other final-answer outcomes use the cloud tier. Missing context, unavailable verifiers, malformed verdicts, and expired decision deadlines fail closed to cloud for final answers.

Tool-calling turns continue on the local tier unless the turn judge provides evidence to escalate. An unavailable or inconclusive turn judge leaves the tool turn on the local tier. A local endpoint failure triggers cloud fallback.

Configure a route

Declare local, cloud, and optional verifier targets using the normal deployment schema, then reference their target names:

[routes.assistant]
id = "assistant"
type = "vgr"
local_target = "local"
cloud_target = "cloud"
judge_target = "local"
cloud_judge_target = "cloud"
mode = "shadow"
deadline_seconds = 30
task_typing = true
breaker_threshold = 5
breaker_cooldown_seconds = 30
confirmed_recovery_min_clean_tail = 1

judge_target defaults to local_target. cloud_judge_target is optional. The local and cloud targets must resolve to distinct model IDs. When the route sets context_window, /v1/models advertises that configured limit. confirmed_recovery_min_clean_tail, when set, lets an agentic run that recovered from tool errors commit locally once that many trailing tool results are clean and the cloud judge confirms the evidence.

Agentic handoff

These settings are off by default:

agentic_handoff = true
local_turn_budget_seconds = 600

agentic_handoff tells the cloud tier when it takes over tool-using work that the local tier previously served. The notice can include the local tier's unchecked final message. It is sent at most once per user turn, and only after new local work has been served since the previous handoff. The handoff preserves the conversation's existing messages and content. local_turn_budget_seconds escalates a user turn once the local tier has spent that much wall-clock time on it.

Serving modes

• off skips candidate generation and serves cloud. This is the default.
• shadow computes a decision but serves cloud.
• evaluate serves the policy decision for isolated evaluation.
• active serves the policy decision in production and requires active_approval = "prospective-validation-and-canary-approved".

VGR buffers a local candidate before releasing it. A streamed candidate that is licensed is replayed as a stream; a rejected candidate is not sent to the client.

x-model-router-selected-model on each response names the tier that served it.