pdserving并发问题
#15093
Replies: 1 comment
-
Duplicate #15094 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
web_service.py的DetOp中self.raw_im在并发是会出现变量冲突,两个不同图片后面out_dict中的image为同一个内容返回,RecOp的raw_im = input_dict["image"]并发时也会偶尔出现不同图片读取到是同一个内容(DetOp返回的out_dict不同时),不知道什么问题?难道必须加锁才行!配置如下:
build_dag_each_worker: false
dag:
is_thread_op: true
retry: 10
tracer:
interval_s: 10
use_profile: false
......
op:
det:
concurrency: 20
local_service_conf:
client_type: local_predictor
devices: '0'
fetch_list:
- save_infer_model/scale_0.tmp_1
ir_optim: true
model_config: ./inference/ppocr_det_server_2.0_serving
rec:
concurrency: 10
local_service_conf:
client_type: local_predictor
devices: '0'
fetch_list:
- softmax_0.tmp_0
ir_optim: true
model_config: ./inference/rec_serving
retry: 1
timeout: -1
......
worker_num: 10
Beta Was this translation helpful? Give feedback.
All reactions