Add instruction to set export HF_HUB_DISABLE_XET=1 when running vllm app. #109
+1
−1
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
$Title. Otherwise following errors happen.
0] [0] return hf_hub_download(
[0] [0] File "/home/pradeepfdo/.conda/envs/forge/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
[0] [0] return fn(*args, **kwargs)
[0] [0] File "/home/pradeepfdo/.conda/envs/forge/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1010, in hf_hub_download
[0] [0] return _hf_hub_download_to_cache_dir(
[0] [0] File "/home/pradeepfdo/.conda/envs/forge/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1171, in _hf_hub_download_to_cache_dir
[0] [0] _download_to_tmp_and_move(
[0] [0] File "/home/pradeepfdo/.conda/envs/forge/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1723, in _download_to_tmp_and_move
[0] [0] xet_get(
[0] [0] File "/home/pradeepfdo/.conda/envs/forge/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 629, in xet_get
[0] [0] download_files(
[0] [0] RuntimeError: Data processing error: CAS service error : ReqwestMiddleware Error: Request failed after 5 retries
[0] [0] Traceback (most recent call last):
[0] [0] File "/home/pradeepfdo/.conda/envs/forge/lib/python3.10/site-packages/monarch/_src/actor/actor_mesh.py", line 837, in handle
[0] [0] result = await instrumented()
[0] [0] File "/home/pradeepfdo/.conda/envs/forge/lib/python3.10/site-packages/monarch/_src/actor/actor_mesh.py", line 834, in instrumented
[0] [0] raise e
[0] [0] File "/home/pradeepfdo/.conda/envs/forge/lib/python3.10/site-packages/monarch/_src/actor/actor_mesh.py", line 827, in instrumented
[0] [0] result = await the_method(*args, **kwargs)
[0] [0] File "/home/pradeepfdo/forge_fork/src/forge/actors/policy.py", line 380, in setup
[0] [0] self.worker = self.setup_worker()
[0] [0] File "/home/pradeepfdo/f