Skip to content

Check for cached tokens returned by API #380

@ppinchuk

Description

@ppinchuk

OpenAI now returns information about cached tokens, which can help make our cost estimates more accurate. Implement a check for this output and have it influence the cost computation.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions