Unable to dowload nf4 mode - cannot connect to huggingface #21
Description
huggingface.co is reachable.
...
Starting server
To see the GUI go to: http://0.0.0.0:8188
FETCH ComfyRegistry Data: 10/82
FETCH ComfyRegistry Data: 15/82
FETCH ComfyRegistry Data: 20/82
FETCH ComfyRegistry Data: 25/82
FETCH ComfyRegistry Data: 30/82
FETCH ComfyRegistry Data: 35/82
FETCH ComfyRegistry Data: 40/82
FETCH ComfyRegistry Data: 45/82
FETCH ComfyRegistry Data: 50/82
FETCH ComfyRegistry Data: 55/82
FETCH ComfyRegistry Data: 60/82
FETCH ComfyRegistry Data: 65/82
FETCH ComfyRegistry Data: 70/82
FETCH ComfyRegistry Data: 75/82
FETCH ComfyRegistry Data: 80/82
FETCH ComfyRegistry Data [DONE]
[ComfyUI-Manager] default cache updated: https://api.comfy.org/nodes
FETCH DATA from: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/custom-node-list.json [DONE]
[ComfyUI-Manager] All startup tasks have been completed.
got prompt
Using resolution: 1024×1024 from aspect ratio: 1:1 (1024×1024)
HiDream: Initial VRAM usage: 0.00 MB
Loading model for fast-nf4...
--- Loading Model Type: fast-nf4 ---
Model Path: azaneko/HiDream-I1-Fast-nf4
NF4: True, Requires BNB: False, Requires GPTQ deps: True
Using alternate LLM: False
(Start VRAM: 0.00 MB)
Cache check for key: fast-nf4_standard
Cache contains: []
[1a] Preparing LLM (GPTQ): hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4
Setting max memory limit: 4GiB of 12.0GiB
Using device_map='auto'.
[1b] Loading Tokenizer: hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4...
!!! ERROR loading fast-nf4: We couldn't connect to 'https://huggingface.co' to load the files, and couldn't find them in the cached files.
Checkout your internet connection or see how to run the library in offline mode at 'https://huggingface.co/docs/transformers/installation#offline-mode'.
Traceback (most recent call last):
File "F:\stability\Data\Packages\ComfyUI\venv\lib\site-packages\urllib3\connectionpool.py", line 468, in _make_request
six.raise_from(e, None)
File "<string>", line 3, in raise_from
File "F:\stability\Data\Packages\ComfyUI\venv\lib\site-packages\urllib3\connectionpool.py", line 463, in _make_request
httplib_response = conn.getresponse()
File "http\client.py", line 1375, in getresponse
File "http\client.py", line 318, in begin
File "http\client.py", line 279, in _read_status
File "socket.py", line 705, in readinto
File "ssl.py", line 1274, in recv_into
File "ssl.py", line 1130, in read
TimeoutError: The read operation timed out
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "F:\stability\Data\Packages\ComfyUI\venv\lib\site-packages\requests\adapters.py", line 667, in send
resp = conn.urlopen(
File "F:\stability\Data\Packages\ComfyUI\venv\lib\site-packages\urllib3\connectionpool.py", line 802, in urlopen
retries = retries.increment(
File "F:\stability\Data\Packages\ComfyUI\venv\lib\site-packages\urllib3\util\retry.py", line 552, in increment
raise six.reraise(type(error), error, _stacktrace)
File "F:\stability\Data\Packages\ComfyUI\venv\lib\site-packages\urllib3\packages\six.py", line 770, in reraise
raise value
File "F:\stability\Data\Packages\ComfyUI\venv\lib\site-packages\urllib3\connectionpool.py", line 716, in urlopen
httplib_response = self._make_request(
File "F:\stability\Data\Packages\ComfyUI\venv\lib\site-packages\urllib3\connectionpool.py", line 470, in _make_request
self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
File "F:\stability\Data\Packages\ComfyUI\venv\lib\site-packages\urllib3\connectionpool.py", line 358, in _raise_timeout
raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='huggingface.co', port=443): Read timed out. (read timeout=10)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "F:\stability\Data\Packages\ComfyUI\venv\lib\site-packages\huggingface_hub\file_download.py", line 1484, in _get_metadata_or_catch_error
metadata = get_hf_file_metadata(
File "F:\stability\Data\Packages\ComfyUI\venv\lib\site-packages\huggingface_hub\utils\_validators.py", line 114, in _inner_fn
return fn(*args, **kwargs)
File "F:\stability\Data\Packages\ComfyUI\venv\lib\site-packages\huggingface_hub\file_download.py", line 1401, in get_hf_file_metadata
r = _request_wrapper(
File "F:\stability\Data\Packages\ComfyUI\venv\lib\site-packages\huggingface_hub\file_download.py", line 285, in _request_wrapper
response = _request_wrapper(
File "F:\stability\Data\Packages\ComfyUI\venv\lib\site-packages\huggingface_hub\file_download.py", line 308, in _request_wrapper
response = get_session().request(method=method, url=url, **params)
File "F:\stability\Data\Packages\ComfyUI\venv\lib\site-packages\requests\sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
File "F:\stability\Data\Packages\ComfyUI\venv\lib\site-packages\requests\sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
File "F:\stability\Data\Packages\ComfyUI\venv\lib\site-packages\huggingface_hub\utils\_http.py", line 96, in send
return super().send(request, *args, **kwargs)
File "F:\stability\Data\Packages\ComfyUI\venv\lib\site-packages\requests\adapters.py", line 713, in send
raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: (ReadTimeoutError("HTTPSConnectionPool(host='huggingface.co', port=443): Read timed out. (read timeout=10)"), '(Request ID: 92ca5dea-9400-4928-984a-d99036f7ae84)')
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "F:\stability\Data\Packages\ComfyUI\venv\lib\site-packages\transformers\utils\hub.py", line 424, in cached_files
hf_hub_download(
File "F:\stability\Data\Packages\ComfyUI\venv\lib\site-packages\huggingface_hub\utils\_validators.py", line 114, in _inner_fn
return fn(*args, **kwargs)
File "F:\stability\Data\Packages\ComfyUI\venv\lib\site-packages\huggingface_hub\file_download.py", line 961, in hf_hub_download
return _hf_hub_download_to_cache_dir(
File "F:\stability\Data\Packages\ComfyUI\venv\lib\site-packages\huggingface_hub\file_download.py", line 1068, in _hf_hub_download_to_cache_dir
_raise_on_head_call_error(head_call_error, force_download, local_files_only)
File "F:\stability\Data\Packages\ComfyUI\venv\lib\site-packages\huggingface_hub\file_download.py", line 1599, in _raise_on_head_call_error
raise LocalEntryNotFoundError(
huggingface_hub.errors.LocalEntryNotFoundError: An error happened while trying to locate the file on the Hub and we cannot find the requested files in the local cache. Please check your connection and try again or make sure your Internet connection is on.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "F:\stability\Data\Packages\ComfyUI\custom_nodes\ComfyUI-HiDream-Sampler\hidreamsampler.py", line 659, in generate
pipe, config = load_models(model_type, use_alternate_llm)
File "F:\stability\Data\Packages\ComfyUI\custom_nodes\ComfyUI-HiDream-Sampler\hidreamsampler.py", line 330, in load_models
tokenizer = AutoTokenizer.from_pretrained(llama_model_name, use_fast=False)
File "F:\stability\Data\Packages\ComfyUI\venv\lib\site-packages\transformers\models\auto\tokenization_auto.py", line 966, in from_pretrained
config = AutoConfig.from_pretrained(
File "F:\stability\Data\Packages\ComfyUI\venv\lib\site-packages\transformers\models\auto\configuration_auto.py", line 1114, in from_pretrained
config_dict, unused_kwargs = PretrainedConfig.get_config_dict(pretrained_model_name_or_path, **kwargs)
File "F:\stability\Data\Packages\ComfyUI\venv\lib\site-packages\transformers\configuration_utils.py", line 590, in get_config_dict
config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs)
File "F:\stability\Data\Packages\ComfyUI\venv\lib\site-packages\transformers\configuration_utils.py", line 649, in _get_config_dict
resolved_config_file = cached_file(
File "F:\stability\Data\Packages\ComfyUI\venv\lib\site-packages\transformers\utils\hub.py", line 266, in cached_file
file = cached_files(path_or_repo_id=path_or_repo_id, filenames=[filename], **kwargs)
File "F:\stability\Data\Packages\ComfyUI\venv\lib\site-packages\transformers\utils\hub.py", line 491, in cached_files
raise OSError(
OSError: We couldn't connect to 'https://huggingface.co' to load the files, and couldn't find them in the cached files.
Checkout your internet connection or see how to run the library in offline mode at 'https://huggingface.co/docs/transformers/installation#offline-mode'.
Prompt executed in 20.17 seconds