Tag: prompt-caching

All the articles with the tag "prompt-caching".

• Your Cache Hit Rate Is Not Your Token Savings

  Published:Sep 17, 2026 |  at 06:00 AM

  Measure uncached input, cache writes, cache reads and output separately. Request hit rate cannot tell you what a long-context workload costs.