Deployment Options#

You can deploy the NeMo Guardrails toolkit in the following ways.

Local Server Setup

The NeMo Guardrails toolkit enables you to create a guardrails local server and deploy it using a guardrails server and an actions server.

Local Server Setup
NeMo Guardrails with Docker

This guide provides step-by-step instructions for running NeMo Guardrails using Docker. Docker offers a seamless and rapid deployment method for getting started with NeMo Guardrails.

NeMo Guardrails with Docker
Using NeMo Guardrails Microservice for Production Deployment

You can also deploy the Guardrails server as a microservice. For more information, refer to the NeMo Microservices Documentation.

Using NeMo Guardrails Microservice for Production Deployment