pub struct CompositeRouter { /* private fields */ }Expand description
Runs a stage router with a tier the judge picks.
Implementations§
Source§impl CompositeRouter
impl CompositeRouter
Sourcepub fn new(
judge: CompositeJudgeConfig,
profile_0: StageRouterConfig,
profile_1: StageRouterConfig,
) -> Result<Self>
pub fn new( judge: CompositeJudgeConfig, profile_0: StageRouterConfig, profile_1: StageRouterConfig, ) -> Result<Self>
Builds two independent stage profiles selected by the judge.
The judge’s efficient tier selects profile_0 and its capable tier profile_1.
Errors on a configuration either algorithm rejects and on every_request.
Trait Implementations§
Source§impl Algorithm for CompositeRouter
impl Algorithm for CompositeRouter
Source§fn name(&self) -> &str
fn name(&self) -> &str
Stable, low-cardinality name identifying this algorithm — the
algorithm attribute on every span, metric, and log line the crate
emits for its runs.Source§fn route<'async_trait>(
self: Arc<Self>,
driver: Driver,
request: Request,
) -> Pin<Box<dyn Future<Output = Result<RoutingOutcome>> + Send + 'async_trait>>where
Self: 'async_trait,
fn route<'async_trait>(
self: Arc<Self>,
driver: Driver,
request: Request,
) -> Pin<Box<dyn Future<Output = Result<RoutingOutcome>> + Send + 'async_trait>>where
Self: 'async_trait,
Select a route, requesting external work through
Driver as needed.
run_stream runs this method and exposes its work to the host.Source§fn tracks_answers(&self) -> bool
fn tracks_answers(&self) -> bool
Whether the host should summarize served answers for
Self::observe_answer.Source§fn observe_answer<'life0, 'life1, 'async_trait>(
&'life0 self,
_session_id: &'life1 str,
_answer: AnswerSummary,
) -> Pin<Box<dyn Future<Output = ()> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
'life1: 'async_trait,
fn observe_answer<'life0, 'life1, 'async_trait>(
&'life0 self,
_session_id: &'life1 str,
_answer: AnswerSummary,
) -> Pin<Box<dyn Future<Output = ()> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
'life1: 'async_trait,
Records the answer the host served for a request in
session_id. Read moreSource§fn run_stream(
self: Arc<Self>,
request: Request,
models: Arc<RuntimeModels>,
state: State,
) -> StepStream
fn run_stream( self: Arc<Self>, request: Request, models: Arc<RuntimeModels>, state: State, ) -> StepStream
Expose work requests and the final outcome so the host can control execution. Read more
Auto Trait Implementations§
impl !Freeze for CompositeRouter
impl !RefUnwindSafe for CompositeRouter
impl !UnwindSafe for CompositeRouter
impl Send for CompositeRouter
impl Sync for CompositeRouter
impl Unpin for CompositeRouter
impl UnsafeUnpin for CompositeRouter
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more