Switchyard

Switchyard routes and translates LLM traffic for coding agents and API clients. It supports OpenAI Chat Completions, OpenAI Responses, and Anthropic Messages.

Choose a Path

Goal	Path	Start here
Run Switchyard as a standalone proxy for API clients	Server Path	Build and run the Rust server
Add Switchyard routing to a Rust application	Library Path	switchyard-libsy
Add Switchyard routing to NeMo Relay	Native Plugin Path	Use Switchyard with NeMo Relay
Point the pi coding agent at the standalone proxy	Server Path	Use Switchyard with pi
Point Oh My Pi at the standalone proxy	Server Path	Use Switchyard with Oh My Pi

The Server Path builds and runs the standalone switchyard-server binary.

Explore

• Core Concepts: learn the LLM client, target, and route layers
• Routing Algorithms: choose how requests select a model
• Architecture: understand the proxy and library components
• Server CLI Reference: inspect switchyard-server commands and options
• Rust API: browse libsy and protocol crate documentation
• Context-Window Handling: configure eviction and retry behavior

Reference

• switchyard-server: server configuration, endpoints, and metrics
• switchyard-libsy: embeddable routing algorithms
• switchyard-protocol: provider-neutral API types
• switchyard-translation: protocol translation
• switchyard-nemo-relay-plugin: native plugin build and configuration