ValueError: The current device_map had weights offloaded to the disk. #49
Description
When I run the command bash scripts/streaming/eval.sh full, it shows "Loading model from lmsys/vicuna-13b-v1.3 ...". After a while, an error is reported: ValueError: The current 'device_map' had weights offloaded to the disk. I would like to know why this is the case and how to solve this problem. I guarantee that I have already installed safetensors.
Thank you very much.