Replies: 2 comments
-
|
如果你只是一个deepseek的key接到你的渠道,那么是可以正常触发缓存的,和直接使用deepseek的key没有区别,如果多个deepseek的key轮询,很难触发缓存 |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
多谢回答, 回头我们试试 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
研发内部搭建了一个New API平台,要对接Deepseek 官方模型(使用一个deepseek 官方 key)
请问,研发内部基于New API平台的分发的多个key,提交的大模型请求是否能够支持官方的输入token 缓存机制,从而减低费用?
如果默认不支持,该如何配置才能让不同的开发采用New API 接入并转发给 deepseek 官方的请求,支持输入缓存,来减低总费用。
Beta Was this translation helpful? Give feedback.
All reactions