Expand description
Serving observations supplied by the host for infrastructure-aware routing.
Structs§
- Model
Infra Signals - Backend worker gauges and requests still in flight through this host.
- Worker
Load - Running and waiting gauges from one worker scrape.
Type Aliases§
- Infra
Signals - Model observations. Missing models or workers mean unknown, never idle.