Provider prompt caching
A discount providers apply when a request repeats a prefix they have already processed.
By Lattice editorial · Entry last reviewed · method
What it implies
Completely separate from prefix caching in your own runtime: this is a billing discount, that is a computation saving. The practical consequence is that a large, stable system prompt is far cheaper than one rebuilt per request — which makes prompt structure a cost decision, not just a readability one.