Skip to main content

LlmClientError

Enum LlmClientError 

Source
#[non_exhaustive]
pub enum LlmClientError { InvalidRequest { message: String, }, RequestTranslation(String), RequestEncoding(String), ResponseTranslation(String), Configuration { message: String, }, Transport { source: BoxError, }, Timeout { source: BoxError, }, ContextWindowExceeded { model: String, message: String, }, UpstreamHttp { status: u16, body: String, }, InvalidResponse { source: BoxError, }, Ffi { source: BoxError, }, General(String), }
Expand description

Failures a routed LLM client can surface to its caller.

The variants classify failures that routing hosts commonly need to handle, while boxed sources preserve implementation-specific detail. General is the escape hatch for failures that do not fit a shared category.

Variants (Non-exhaustive)§

This enum is marked as non-exhaustive
Non-exhaustive enums could have additional variants added in future. Therefore, when matching against variants of non-exhaustive enums, an extra wildcard arm must be added to account for any future variants.
§

InvalidRequest

The request cannot be served as supplied.

Fields

§message: String

Human-readable request validation failure.

§

RequestTranslation(String)

Decoding the inbound request failed in the translation engine.

§

RequestEncoding(String)

Encoding the request for the upstream failed in the translation engine.

§

ResponseTranslation(String)

Decoding or encoding the response failed in the translation engine.

§

Configuration

The client is not configured to serve the selected target.

Fields

§message: String

Human-readable configuration failure.

§

Transport

The upstream could not be reached or the request could not be sent.

Fields

§source: BoxError

Client-specific transport failure.

§

Timeout

The upstream request exceeded its timeout.

Fields

§source: BoxError

Client-specific timeout failure.

§

ContextWindowExceeded

The upstream rejected the request because it exceeds the model’s context window.

Fields

§model: String

Model whose context window was exceeded.

§message: String

Upstream error message.

§

UpstreamHttp

The upstream returned a non-success HTTP response.

Fields

§status: u16

Upstream HTTP status code.

§body: String

Raw upstream error body.

§

InvalidResponse

The upstream returned a response the client could not decode.

Fields

§source: BoxError

Client-specific decoding or validation failure.

§

Ffi

A call across a foreign-function boundary (e.g. a Python-implemented client) failed. The boxed source is the foreign error itself.

Fields

§source: BoxError

Foreign-language failure, preserved verbatim.

§

General(String)

A string message. Useful in testing, but prefer adding variants over using this.

Trait Implementations§

Source§

impl Debug for LlmClientError

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl Display for LlmClientError

Source§

fn fmt(&self, __formatter: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl Error for LlmClientError

Source§

fn source(&self) -> Option<&(dyn Error + 'static)>

Returns the lower-level source of this error, if any. Read more
1.0.0 · Source§

fn description(&self) -> &str

👎Deprecated since 1.42.0:

use the Display impl or to_string()

1.0.0 · Source§

fn cause(&self) -> Option<&dyn Error>

👎Deprecated since 1.33.0:

replaced by Error::source, which can support downcasting

Source§

fn provide<'a>(&'a self, request: &mut Request<'a>)

🔬This is a nightly-only experimental API. (error_generic_member_access)
Provides type-based access to context intended for error reports. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> ToString for T
where T: Display + ?Sized,

Source§

fn to_string(&self) -> String

Converts the given value to a String. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.