pub struct LlmTarget {
pub semantic_name: String,
}Expand description
A named routing target an algorithm routes by. Serving its calls is the stream
consumer’s concern: the target’s name reaches the consumer as
decision.selected_model() on the offloaded RoutedRequest.
Fields§
§semantic_name: StringThe routing label an algorithm selects this target by — a logical tier like
"strong", or the model id when they coincide. Mapping it to a provider model
id is the consumer’s concern, never the algorithm’s.
Trait Implementations§
Auto Trait Implementations§
impl Freeze for LlmTarget
impl RefUnwindSafe for LlmTarget
impl Send for LlmTarget
impl Sync for LlmTarget
impl Unpin for LlmTarget
impl UnsafeUnpin for LlmTarget
impl UnwindSafe for LlmTarget
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more