You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
下面是我的运行命令。我绑定的是四个卡 , 但是实际解析的时候只有0卡的gpu利用率在飙升 ,而且解析一个772kb的文档要153s时间是不是太长了。如何设置命令行参数,让解析任务时分摊到多卡解析加快解析速度呢 。

docker run -d --name mineru
--privileged --ipc=host --network=host
--device=/dev/davinci0 --device=/dev/davinci1 --device=/dev/davinci2 --device=/dev/davinci3
--device=/dev/davinci_manager --device=/dev/devmm_svm --device=/dev/hisi_hdc
-v /var/log/npu/:/usr/slog
-v /usr/local/dcmi:/usr/local/dcmi
-v /usr/local/bin/npu-smi:/usr/local/bin/npu-smi
-v /usr/local/Ascend/driver:/usr/local/Ascend/driver
-v /newcache/modelscope:/root/.cache/modelscope
-v /newcache/hf:/root/.cache/huggingface
-v /newcache/mineru.json:/etc/trae-mineru.json:ro
-e ASCEND_RT_VISIBLE_DEVICES=0,1,2,3
-e MINERU_MODEL_SOURCE=local
-e MINERU_LMDEPLOY_DEVICE=ascend
-e MINERU_TOOLS_CONFIG_JSON=/etc/trae-mineru.json
-e VLLM_WORKER_MULTIPROC_METHOD=spawn
mineru:npu-vllm-a2
mineru-gradio --server-name 0.0.0.0 --server-port 7860
Beta Was this translation helpful? Give feedback.
All reactions