Struct Request 

pub struct Request {
    pub llm_request: LlmRequest,
    pub raw_request: Option<Value>,
    pub metadata: Option<Metadata>,
}

A request an algorithm routes: the normalized LlmRequest plus optional host-owned raw data and correlation Metadata.

Fields

llm_request: LlmRequest

The normalized request an algorithm routes.

raw_request: Option<Value>

An optional whole request body retained by the host. libsy and the translation codecs do not read it. Exact same-format codec replay instead uses LlmRequest::preservation.

metadata: Option<Metadata>

Correlation metadata carried through the request.

Implementations

impl Request

pub fn model_id(&self) -> Option<ModelId>

Returns the model currently carried by the request, when present.

On ingress this is the name supplied by the client. Before an offloaded model call, the routing driver replaces it with the selected target.

Trait Implementations

impl Clone for Request

fn clone(&self) -> Request

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Default for Request

fn default() -> Request

Returns the “default value” for a type.