nemoguardrails.rails.llm.options.GenerationStats#
- class nemoguardrails.rails.llm.options.GenerationStats[source]#
Bases:
BaseModelGeneral stats about the generation.
-
input_rails_duration:
Optional[float]#
-
dialog_rails_duration:
Optional[float]#
-
generation_rails_duration:
Optional[float]#
-
output_rails_duration:
Optional[float]#
-
total_duration:
Optional[float]#
-
llm_calls_duration:
Optional[float]#
-
llm_calls_count:
Optional[int]#
-
llm_calls_total_prompt_tokens:
Optional[int]#
-
llm_calls_total_completion_tokens:
Optional[int]#
-
llm_calls_total_tokens:
Optional[int]#
- model_config: ClassVar[ConfigDict] = {}#
Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].
-
input_rails_duration: