pub struct LlmTarget {
pub semantic_name: String,
pub llm_client: Option<Arc<dyn RoutedLlmClient>>,
}Expand description
A named routing target: a semantic_name an algorithm routes by, and an optional
RoutedLlmClient to serve its calls. An algorithm hands a target to
Driver::call_llm_target; the client rides along as
RoutedRequest::default_client for the stream consumer to serve or override.
Fields§
§semantic_name: StringThe routing label an algorithm selects this target by — a logical tier like
"strong", or the model id when they coincide. Mapping it to a provider model
id is the client’s concern, never the algorithm’s.
llm_client: Option<Arc<dyn RoutedLlmClient>>The client that serves this target’s calls by default, or None (then the
stream consumer must serve them).
Trait Implementations§
Auto Trait Implementations§
impl Freeze for LlmTarget
impl !RefUnwindSafe for LlmTarget
impl Send for LlmTarget
impl Sync for LlmTarget
impl Unpin for LlmTarget
impl UnsafeUnpin for LlmTarget
impl !UnwindSafe for LlmTarget
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more