Skip to content

Commit 25232bb

Browse files
ericharmelingericharmeling
committed
Speculative prompt caching
This commit introduces a new cookbook demonstrating how to use the speculative prompt caching pattern to reduce time-to-first-token (TTFT).
1 parent eaacd9c commit 25232bb

File tree

1 file changed

+485
-0
lines changed

1 file changed

+485
-0
lines changed

0 commit comments

Comments
 (0)