Can't load MistoLine rank_256 ControlNet with from_single_file

[oxysoft]

Describe the bug

Incomprehensible error when attempting to load the MistoLine rank256 ControlNet model. There are already numerous issues documenting the same bug, and it was apparently fixed, but still occurs for me here.

Reproduction

from diffusers.models.controlnet import ControlNetModel
import torch

url = "https://huggingface.co/TheMistoAI/MistoLine/blob/main/mistoLine_rank256.safetensors"
ControlNetModel.from_single_file(url)

Logs

Traceback (most recent call last):
  File "/home/nuck/Projects/discore/.venv/lib/python3.12/site-packages/huggingface_hub/utils/_http.py", line 406, in hf_raise_for_status
    response.raise_for_status()
  File "/home/nuck/Projects/discore/.venv/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://huggingface.co/stable-diffusion-v1-5/stable-diffusion-v1-5/resolve/main/config.json
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/home/nuck/Projects/discore/.venv/lib/python3.12/site-packages/diffusers/configuration_utils.py", line 379, in load_config
    config_file = hf_hub_download(
                  ^^^^^^^^^^^^^^^^
  File "/home/nuck/Projects/discore/.venv/lib/python3.12/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
    return fn(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^
  File "/home/nuck/Projects/discore/.venv/lib/python3.12/site-packages/huggingface_hub/file_download.py", line 860, in hf_hub_download
    return _hf_hub_download_to_cache_dir(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/nuck/Projects/discore/.venv/lib/python3.12/site-packages/huggingface_hub/file_download.py", line 923, in _hf_hub_download_to_cache_dir
    (url_to_download, etag, commit_hash, expected_size, head_call_error) = _get_metadata_or_catch_error(
                                                                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/nuck/Projects/discore/.venv/lib/python3.12/site-packages/huggingface_hub/file_download.py", line 1374, in _get_metadata_or_catch_error
    metadata = get_hf_file_metadata(
               ^^^^^^^^^^^^^^^^^^^^^
  File "/home/nuck/Projects/discore/.venv/lib/python3.12/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
    return fn(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^
  File "/home/nuck/Projects/discore/.venv/lib/python3.12/site-packages/huggingface_hub/file_download.py", line 1294, in get_hf_file_metadata
    r = _request_wrapper(
        ^^^^^^^^^^^^^^^^^
  File "/home/nuck/Projects/discore/.venv/lib/python3.12/site-packages/huggingface_hub/file_download.py", line 278, in _request_wrapper
    response = _request_wrapper(
               ^^^^^^^^^^^^^^^^^
  File "/home/nuck/Projects/discore/.venv/lib/python3.12/site-packages/huggingface_hub/file_download.py", line 302, in _request_wrapper
    hf_raise_for_status(response)
  File "/home/nuck/Projects/discore/.venv/lib/python3.12/site-packages/huggingface_hub/utils/_http.py", line 417, in hf_raise_for_status
    raise _format(EntryNotFoundError, message, response) from e
huggingface_hub.errors.EntryNotFoundError: 404 Client Error. (Request ID: Root=1-67e97ab4-6c76d31d60bbeb186b670971;1b99b0c7-0161-4747-8b1f-422e8bc8c7ff)
Entry Not Found for url: https://huggingface.co/stable-diffusion-v1-5/stable-diffusion-v1-5/resolve/main/config.json.
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/home/nuck/Projects/discore/wat.py", line 5, in <module>
    ControlNetModel.from_single_file(url, resume_download=True)
  File "/home/nuck/Projects/discore/.venv/lib/python3.12/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
    return fn(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^
  File "/home/nuck/Projects/discore/.venv/lib/python3.12/site-packages/diffusers/loaders/single_file_model.py", line 301, in from_single_file
    diffusers_model_config = cls.load_config(
                             ^^^^^^^^^^^^^^^^
  File "/home/nuck/Projects/discore/.venv/lib/python3.12/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
    return fn(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^
  File "/home/nuck/Projects/discore/.venv/lib/python3.12/site-packages/diffusers/configuration_utils.py", line 406, in load_config
    raise EnvironmentError(
OSError: stable-diffusion-v1-5/stable-diffusion-v1-5 does not appear to have a file named config.json.

System Info

It's installed through venv so there is no diffusers-cli to run. It's diffusers 0.32.2

Who can help?

@sayakpaul @yiyixuxu @DN6

[tolgacangoz]

Hi @oxysoft! In its model card, this is said: "mistoLine_rank256.safetensors : General usage version, for ComfyUI and AUTOMATIC1111-WebUI."
Wouldn't diffusers style usage example help: https://huggingface.co/TheMistoAI/MistoLine#diffusers-pipeline

[oxysoft]

That will load the FP16 variant which is 2.5GB of weights. I want rank256 which I assume is a distillation and is lighter to run.

[asomoza]

from the name and the size it's probably a control lora, diffusers does not support control loras at the moment, there's some PRs open though but probably it's going to take a while to finish it.

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

[asomoza]

closing this since there's no more feedback from the user and currently we don't support control loras.