pub struct Provider {
pub api: Api,
pub url: String,
pub key: String,
pub model: String,
pub capability: Capability,
pub temperature: f64,
pub max_tokens: u32,
pub context_length: u32,
pub connection_timeout_ms: u64,
pub request_timeout_ms: u64,
}Expand description
Configuration for an AI inference provider used by AIMX.
Fields§
§api: ApiAPI implementation.
url: StringBase URL for the API.
key: StringAPI key or token (empty if not required).
model: StringModel identifier for the provider.
capability: CapabilityAbstract capability class of the model.
temperature: f64Sampling temperature.
max_tokens: u32Maximum tokens to generate.
context_length: u32Context window size in tokens.
connection_timeout_ms: u64Connection timeout in milliseconds.
request_timeout_ms: u64Request timeout in milliseconds.
Trait Implementations§
Source§impl<'de> Deserialize<'de> for Provider
impl<'de> Deserialize<'de> for Provider
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl StructuralPartialEq for Provider
Auto Trait Implementations§
impl Freeze for Provider
impl RefUnwindSafe for Provider
impl Send for Provider
impl Sync for Provider
impl Unpin for Provider
impl UnwindSafe for Provider
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more