大模型的 2k和8k是哪个参数决定的？
#468
Replies: 1 comment
-
|
如果是用 lmdeploy的话，转完模型之后, workspace/triton_models/weights/config.ini中的session_len可以调节 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
如果是用 lmdeploy的话，转完模型之后, workspace/triton_models/weights/config.ini中的session_len可以调节
Beta Was this translation helpful? Give feedback.
All reactions