Skip to main content

Ctrl+K

NVIDIA NeMo Guardrails Toolkit Developer Guide

NVIDIA NeMo Guardrails Toolkit Developer Guide

Table of Contents

About NeMo Guardrails Toolkit

Overview
How It Works
Use Cases
Supported LLMs
Release Notes

Get Started

Installation Guide
Tutorials

Configure Rails

Before Configuring Rails
Configuration Overview
Core Configuration
Custom Actions
Custom Initialization
Colang
Other Configurations
- Knowledge Base
- Exceptions and Error Handling

Run Rails

Run Rails
Core Classes
Generation Options
Streaming
Event-based API
Tools Integration

Evaluation

Guardrails Evaluation
LLM Vulnerability Scanning

Observability

Logging
Tracing

Deployment Guides

Deployment Options
Local Server Setup
- Guardrails Server
- Actions Server
Using Docker
Using NeMo Guardrails Microservice

Integration with Third-Party Libraries

LangChain
Vertex AI
AlignScore
Llama Guard

Security

Security Guidelines

Reference

Python API
CLI
Glossary
Frequently Asked Questions (FAQ)

Colang Guide
Colang Usage Examples

Colang Usage Examples#

This section provides examples of how to use Colang flows to create guardrails.

previous

Retrieval-Augmented Generation

next

Bot Message Instructions

Privacy Policy | Manage My Privacy | Do Not Sell or Share My Data | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2023-2025, NVIDIA Corporation.