Local Server Setup#

The NeMo Guardrails library enables you to create a guardrails local server and deploy it using a guardrails server and an actions server.

Overview#

Server

Purpose

Default Port

Guardrails Server

Loads guardrails configurations and exposes HTTP API for chat completions

8000

Actions Server

Runs custom actions securely in a separate environment

8001

Sections#

Guardrails Server

Configure and run the guardrails server with HTTP API endpoints and Chat UI.

Guardrails Server
Actions Server

Deploy actions in a secure, isolated environment separate from the guardrails server.

Actions Server