1 article tagged Costs.
Agents resend the same long prefix on every step. Prompt caching lets the provider reuse that work at a fraction of the price and with lower latency. Here's how it works, how to set it up, and what quietly breaks it.