离线推理 pipeline 模式支持连续批处理吗？ #1394

Closed Unanswered

shell-nlp asked this question in Q&A

shell-nlp
Apr 4, 2024

我计划在lmdeply基础上进行额外的封装开发，请问离线推理 pipeline 模式支持连续批处理吗？

Replies: 1 comment

zhyncs
Jul 6, 2024
Collaborator

I think yes

0 replies

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment