Replies: 2 comments
-
识别1000张图片时,进程数由3增加5,识别时间由171s变成了190s,识别速度反而降低了 |
Beta Was this translation helpful? Give feedback.
0 replies
-
如果是希望本地推理的话,可以参考这个文档,如果是服务化部署的话,建议使用高稳定服务化部署方案,支持单卡部署多个实例。 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
在windows上进行测试时,发现多线程速度提升不明显,而使用多进程worker增加也不能大幅提升速度,而在linux上使用多进程经常抛出cuda相关异常,想问问如何解决这种问题。已经将其用fastapi部署在生产环境,想提升识别速度。
Beta Was this translation helpful? Give feedback.
All reactions