#caching
1 paper
-
inspiration
Prompt Caching Is the Cheapest Speedup
The fastest token is the one you never recompute. Stop paying twice for a stable prefix.
1 paper
The fastest token is the one you never recompute. Stop paying twice for a stable prefix.