Skip to main content

HttpBackendConfig

Struct HttpBackendConfig 

Source
pub struct HttpBackendConfig {
    pub base_url: String,
    pub api_key: Option<String>,
    pub forward_auth: bool,
    pub extra_headers: BTreeMap<String, String>,
    pub extra_body: BTreeMap<String, Value>,
    pub omit_body_fields: BTreeSet<String>,
    pub reasoning_effort: Option<String>,
    pub max_retries: u32,
    pub failure_cooldown: Duration,
    pub timeout: Option<Duration>,
}
Expand description

Shared HTTP configuration for one upstream backend.

Fields§

§base_url: String

Base URL of the provider API (e.g. https://api.openai.com/v1).

§api_key: Option<String>

API key for the provider, loaded by the caller. None sends no configured auth. Client construction rejects active values that cannot form the provider’s auth header.

§forward_auth: bool

Whether this backend forwards the caller’s provider credential and application headers.

The forwarding backends in one route must use one credential family (OpenAI or Anthropic) unless they all use the same scheme, host, and port, such as one LLM gateway. Backends that send a configured key are not restricted.

§extra_headers: BTreeMap<String, String>

Custom headers added to every outbound call to this backend.

Provider-owned headers are rejected so a static value cannot replace configured or forwarded auth. Names and values must be valid HTTP header bytes; header names are case-insensitive.

§extra_body: BTreeMap<String, Value>

Default top-level request fields, applied only when the request omits the key.

§omit_body_fields: BTreeSet<String>

Top-level request fields dropped from the outbound body before extra_body is merged, so a target can reinstate one deliberately. For providers that reject an otherwise standard field (e.g. an internal API that 400s on max_output_tokens).

§reasoning_effort: Option<String>

Reasoning effort forced on every request to this backend, replacing whatever the caller sent. Responses carries it as reasoning.effort, Chat Completions as reasoning_effort; Anthropic has no equivalent and rejects the setting at configuration time.

§max_retries: u32

Additional attempts after the initial upstream request.

§failure_cooldown: Duration

Cooldown after an exhausted transient completion failure. Zero disables it.

§timeout: Option<Duration>

Deadline for one complete response, including retries, retry delays, and stream reads. None leaves the wait unbounded.

Trait Implementations§

Source§

impl Clone for HttpBackendConfig

Source§

fn clone(&self) -> HttpBackendConfig

Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl Debug for HttpBackendConfig

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
§

impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
where ST: ?Sized, DT: ?Sized,

§

impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
where ST: ?Sized, DT: ?Sized,

Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

§

impl<T> FutureExt for T

§

fn with_context(self, otel_cx: Context) -> WithContext<Self> ⓘ

Attaches the provided Context to this type, returning a WithContext wrapper. Read more
§

fn with_current_context(self) -> WithContext<Self> ⓘ

Attaches the current Context to this type, returning a WithContext wrapper. Read more
§

impl<T> Instrument for T

§

fn instrument(self, span: Span) -> Instrumented<Self> ⓘ

Instruments this type with the provided [Span], returning an Instrumented wrapper. Read more
§

fn in_current_span(self) -> Instrumented<Self> ⓘ

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

§

impl<T> PolicyExt for T
where T: ?Sized,

§

fn and<P, B, E>(self, other: P) -> And<T, P>
where T: Sized + Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns [Action::Follow] only if self and other return Action::Follow. Read more
§

fn or<P, B, E>(self, other: P) -> Or<T, P>
where T: Sized + Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns [Action::Follow] if either self or other returns Action::Follow. Read more
§

impl<T> Read<Exclusive, BecauseExclusive> for T
where T: ?Sized,

Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
§

impl<T> WithSubscriber for T

§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self> ⓘ
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a [WithDispatch] wrapper. Read more
§

fn with_current_subscriber(self) -> WithDispatch<Self> ⓘ

Attaches the current default Subscriber to this type, returning a [WithDispatch] wrapper. Read more