Open
Description
Streamed responses don't include usage info in the response. Would have to calculate this via [tiktoken])(https://github.com/dqbd/tiktoken) e.g., but that would be a big dependency for the project.
Alternatively, count chunks manually for rough estimate (more info).
- estimate usage
- mark usage as estimated in usage history (assumes Feature: More detailed usage tracking #20)
- update Readme section when implemented
Metadata
Metadata
Assignees
Projects
Status
Next