How to inference with multiple GPUs?

[jiamying]

I tried using --device, but it seems that it can only be deployed on a single GPU. Is there a way to run inference on multiple GPUs?

[gaotongxiao]

Currently not - a workaround is to use multi-gpu test and set the --save-preds flag, which allows you to access the prediction results later.