How to see usage statistics for the completion response? #112

Unanswered

Jonseed asked this question in Q&A

Jonseed
Oct 14, 2024

OpenAI API returns a usage object with each chat completion response that includes usage information:

completion_tokens
prompt_tokens
total_tokens
completion_tokens_details (audio_tokens, reasoning_tokens)
prompt_tokens_details (audio_tokens, cached_tokens)

How do I see this information in LLM Party? It is output anywhere?

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment