Guardrails Concepts

NeMo Guardrails provides configurable safety checks that evaluate user inputs and model outputs before responses are returned to your application. Guardrails runs as an Inference Gateway (IGW) middleware plugin, integrated into the inference pipeline through VirtualModels.

---

• Architecture — How guardrails runs as IGW middleware, VirtualModel wiring, and model routing.
• Configurations — Define rails, models, and prompts that make up a guardrail policy.
• Inference — Run inference through a guarded VirtualModel and configure request options.
• Checks — Evaluate messages against rails without running inference.