Expand description
Model-pool observations supplied by the serving integration.
Structs§
- Model
Infra Signals - Pool observations and local request accounting.
- Pool
Load - Aggregated scheduler counts. The host is responsible for pool coverage.
Type Aliases§
- Infra
Signals - Observations keyed by model, without worker identities.