Cache hit rate is low / zero

[surapuramakhil]

Description

I am not sure if this is openCode issues or Open work

deep infra dashboard report - you can see hit rate is zero.
Dashboard - DeepInfra.pdf

Plugins

No response

OpenCode version

No response

Steps to reproduce

1. create a worker - have few chat conversations
2. see metrics

Screenshot and/or share link

No response

Operating System

macOS

Terminal

via OpenWork

[github-actions]

This issue doesn't fully meet our contributing guidelines.

What needs to be fixed:

• Steps to reproduce: Please provide detailed steps showing how to reproduce the cache hit rate issue
• System information: Please fill in your Operating System and Terminal environment
• Additional context: Explain what cache hit rate you're expecting vs what you're seeing, and any relevant configuration details

Please edit this issue to address the above within 2 hours, or it will be automatically closed.

---

This issue might be a duplicate of existing issues. Please check:

• Due to the lack of userId and sessionId, some models will not hit the cache. #8623: Due to the lack of userId and sessionId, some models will not hit the cache (directly related to cache hit problems)
• /compact doesn't utilize prompt caching #10342: /compact doesn't utilize prompt caching (related cache utilization issue)
• applyCaching called too freely, causes LiteLLM to fail #6473: applyCaching called too freely, causes LiteLLM to fail (related caching issue)

If you believe this was flagged incorrectly, please let a maintainer know.