#prompt-caching
1 paper
-
inspiration
Prompt Caching Is Free Money
Prompt caching is a server-side optimization that reuses the computed KV state of a repeated prefix. You do not implement it — you structure your prompts to activate it.
1 paper
Prompt caching is a server-side optimization that reuses the computed KV state of a repeated prefix. You do not implement it — you structure your prompts to activate it.