Skip to content

Hardware and Software Requirements for NeMo Platform

This page lists the requirements for the OSS local-install path for NeMo Platform 0.1.0. For the full compatibility table, see the Support Matrix.

The OSS 0.1.0 documentation is scoped to local setup with the Python package and nemo setup. Docker Compose, Helm, Kubernetes, and OpenShift deployment guides are not part of this release scope.

Local Setup Requirements

Component Requirement Notes
Python 3.11, 3.12, or 3.13 (>=3.11,<3.14) Use an isolated virtual environment. Python 3.14 and later are not part of the OSS local-install support range.
Package installer uv recommended; pip supported The one-line installer sets up uv automatically when needed.
Operating system Recent Linux or macOS release See the Support Matrix for the supported OS list.
Memory 8 GB RAM minimum 16 GB or more is recommended for larger local workflows.
Disk space 16 GB free disk space minimum Additional space is needed for datasets, job outputs, and local model artifacts.
Network Outbound HTTPS access Required for package installation and hosted model-provider APIs.
Model provider NVIDIA Build, OpenAI, Anthropic, Google Gemini, Ollama, or a custom OpenAI-compatible endpoint nemo setup configures one provider as part of the setup flow.
Browser Current Chrome, Edge, Firefox, or Safari Required for the Studio UI.

GPU Requirements

Local provider workflows do not require a local GPU. GPU requirements apply only when you run local model or GPU-accelerated workloads.

Component Requirement Notes
GPU NVIDIA data center GPU with 40 GB VRAM minimum; 80 GB recommended A100 80GB, H100 80GB, and B200 180GB meet the recommended profile.
CUDA CUDA 12.8 or later GPU Python dependencies are built for CUDA 12.8.
NVIDIA driver CUDA 12.8-capable driver, R570 branch or later See the CUDA 12.8 release notes for exact driver minimums by operating system.
Platform Linux x86_64 Local NVIDIA GPU workloads are not supported on macOS or Windows.

Verify Your Environment

python --version
nemo --help
curl -s http://localhost:8080/health/ready

For setup instructions, see Setup.