Struct InferenceResponse 

pub struct InferenceResponse { /* private fields */ }

Unified response for a single provider request, including text and token usage.

Implementations

impl InferenceResponse

pub fn text(&self) -> Arc<str>

pub fn input_tokens(&self) -> u32

pub fn output_tokens(&self) -> u32

pub fn total_tokens(&self) -> u32

pub fn response_time_ms(&self) -> u128

pub fn new_for_tests( text: Arc<str>, input_tokens: u32, output_tokens: u32, total_tokens: u32, response_time_ms: u128, ) -> Self

Public helper primarily intended for tests and examples.

Trait Implementations

impl Debug for InferenceResponse

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for InferenceResponse

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for InferenceResponse

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.