Anthropic Prompt Caching Saves 90% — Here's the One Caveat Nobody Mentions
📰 Dev.to · Gabriel Anhaia
Cache hits cost 10% of input. Writes cost 25% more. The catch: one timestamp in the system prompt invalidates the whole prefix on every call.
Cache hits cost 10% of input. Writes cost 25% more. The catch: one timestamp in the system prompt invalidates the whole prefix on every call.