Skip to content

Server CLI Reference

switchyard-server runs the standalone Rust proxy for API clients and custom deployments.

Install the standalone binary with cargo install --locked switchyard-server. It reads a native TOML deployment.

Usage

switchyard-server --config <deployment.toml> [options]
Option Default Purpose
--config PATH Required TOML file defining LLM clients, targets, and algorithm routes.
--host HOST 0.0.0.0 Address on which the server listens.
-p, --port PORT 4000 Port on which the server listens.
--backlog BACKLOG 65535 TCP listen backlog configured before accepting traffic.
--shutdown-timeout SHUTDOWN_TIMEOUT 30s Maximum time active requests may drain during shutdown.
--dry-run Off Validate the deployment without binding a socket.
--routing-log-file PATH None Append durable per-request routing records to this JSONL file.
--tls-cert PATH None PEM certificate path; requires --tls-key.
--tls-key PATH None PEM private-key path; requires --tls-cert.
-h, --help — Print command help.
-V, --version — Print the server version.

Validate a deployment, then start the proxy:

switchyard-server --config routes.toml --dry-run
switchyard-server --config routes.toml \
  --host 127.0.0.1 --port 4000