NVIDIA NeMo Guardrails Toolkit Developer Guide#
The NeMo Guardrails toolkit is an open-source Python package for adding programmable guardrails to LLM-based applications. It intercepts inputs and outputs, applies configurable safety checks, and blocks or modifies content based on defined policies.
About the NeMo Guardrails Toolkit#
Learn about the toolkit and its capabilities in the following sections.
Learn about the NeMo Guardrails toolkit and its capabilities.
Browse the different use cases of the NeMo Guardrails toolkit.
Learn how the NeMo Guardrails toolkit works.
Browse the LLMs and their providers supported by the toolkit.
Get Started#
Follow these steps to start using the NeMo Guardrails toolkit.
Install the toolkit with pip and set up your environment.
Follow hands-on tutorials to build your first guardrails configuration.
Next Steps#
Once you’ve completed the get-started tutorials, explore the following areas to deepen your understanding.
Learn to write config.yml, Colang flows, and custom actions.
Use the Python SDK and understand core classes like RailsConfig and LLMRails.
Evaluate the performance of the rails.
Monitor and troubleshoot your guardrails applications.
Deploy your guardrails using the toolkit’s local server, Docker, or as a production microservice.
Connect with LangChain, LangGraph, and other frameworks.