File tree Expand file tree Collapse file tree 1 file changed +3
-2
lines changed
content/operate/rc/langcache Expand file tree Collapse file tree 1 file changed +3
-2
lines changed Original file line number Diff line number Diff line change @@ -39,7 +39,8 @@ LangCache reduces your LLM costs by caching responses and avoiding repeated API
3939For every cached response, you'll save the output token cost. To calculate your monthly savings with LangCache, you can use the following formula:
4040
4141``` bash
42- Estimated monthly savings with LangCache = (Monthly output token costs) × (Cache hit rate)
42+ Est. monthly savings with LangCache =
43+ (Monthly output token costs) × (Cache hit rate)
4344```
4445
4546The more requests you serve from LangCache, the more you save, because you’re not paying to regenerate the output.
@@ -52,7 +53,7 @@ Here’s an example:
5253- Estimated savings: $120 × 50% = $60/month
5354
5455{{<note >}}
55- The forumla and numbers above will provide a rough estimate of your monthly savings. Actual savings will vary depending on your usage.
56+ The formula and numbers above provide a rough estimate of your monthly savings. Actual savings will vary depending on your usage.
5657{{</note >}}
5758
5859## LangCache architecture
You can’t perform that action at this time.
0 commit comments