Cannot load SD3 models, everything else is fine (docker)

[zefie]

I am running my webui in a docker instance and everything is working great, including all SD1/SD2/SDXL models and webui extensions. However, I cannot load any SD3 models.

I have the following versions:
A1111 version: v1.10.1  •  python: 3.11.9  •  torch: 2.4.0  •  xformers: 0.0.27.post2  •  gradio: 3.41.2  •  transformers: 4.30.2

Docker base image: pytorch/pytorch:2.4.0-cuda12.4-cudnn9-runtime

Any ideas what I am doing wrong or where I should look?

This is the A1111 log when the error occurs.

2024-07-28 09:47:17 Reusing loaded model aamXLAnimeMix_v10.safetensors [d48c2391e0] to load sd3_medium.safetensors
2024-07-28 09:47:19 Calculating sha256 for /stable-diffusion-webui/models/Stable-diffusion/sd3_medium.safetensors: cc236278d28c8c3eccb8e21ee0a67ebed7dd6e9ce40aa9de914fa34e8282f191
2024-07-28 09:47:19 Loading weights [cc236278d2] from /stable-diffusion-webui/models/Stable-diffusion/sd3_medium.safetensors
2024-07-28 09:47:19 Creating model from config: /stable-diffusion-webui/configs/sd3-inference.yaml
2024-07-28 09:47:19 WARNING:py.warnings:/opt/conda/lib/python3.11/site-packages/huggingface_hub/file_download.py:1150: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2024-07-28 09:47:19   warnings.warn(
2024-07-28 09:47:19 
2024-07-28 09:47:20 creating model quickly: TypeError
2024-07-28 09:47:20 Traceback (most recent call last):
2024-07-28 09:47:20   File "/opt/conda/lib/python3.11/threading.py", line 1002, in _bootstrap
2024-07-28 09:47:20     self._bootstrap_inner()
2024-07-28 09:47:20   File "/opt/conda/lib/python3.11/threading.py", line 1045, in _bootstrap_inner
2024-07-28 09:47:20     self.run()
2024-07-28 09:47:20   File "/opt/conda/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 807, in run
2024-07-28 09:47:20     result = context.run(func, *args)
2024-07-28 09:47:20   File "/opt/conda/lib/python3.11/site-packages/gradio/utils.py", line 707, in wrapper
2024-07-28 09:47:20     response = f(*args, **kwargs)
2024-07-28 09:47:20   File "/stable-diffusion-webui/modules/ui_settings.py", line 316, in <lambda>
2024-07-28 09:47:20     fn=lambda value, k=k: self.run_settings_single(value, key=k),
2024-07-28 09:47:20   File "/stable-diffusion-webui/modules/ui_settings.py", line 95, in run_settings_single
2024-07-28 09:47:20     if value is None or not opts.set(key, value):
2024-07-28 09:47:20   File "/stable-diffusion-webui/modules/options.py", line 165, in set
2024-07-28 09:47:20     option.onchange()
2024-07-28 09:47:20   File "/stable-diffusion-webui/modules/call_queue.py", line 14, in f
2024-07-28 09:47:20     res = func(*args, **kwargs)
2024-07-28 09:47:20   File "/stable-diffusion-webui/modules/initialize_util.py", line 181, in <lambda>
2024-07-28 09:47:20     shared.opts.onchange("sd_model_checkpoint", wrap_queued_call(lambda: sd_models.reload_model_weights()), call=False)
2024-07-28 09:47:20   File "/stable-diffusion-webui/modules/sd_models.py", line 977, in reload_model_weights
2024-07-28 09:47:20     load_model(checkpoint_info, already_loaded_state_dict=state_dict)
2024-07-28 09:47:20   File "/stable-diffusion-webui/modules/sd_models.py", line 820, in load_model
2024-07-28 09:47:20     sd_model = instantiate_from_config(sd_config.model, state_dict)
2024-07-28 09:47:20                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-07-28 09:47:20   File "/stable-diffusion-webui/modules/sd_models.py", line 775, in instantiate_from_config
2024-07-28 09:47:20     return constructor(**params)
2024-07-28 09:47:20            ^^^^^^^^^^^^^^^^^^^^^
2024-07-28 09:47:20   File "/stable-diffusion-webui/modules/models/sd3/sd3_model.py", line 34, in __init__
2024-07-28 09:47:20     self.text_encoders = SD3Cond()
2024-07-28 09:47:20                          ^^^^^^^^^
2024-07-28 09:47:20   File "/stable-diffusion-webui/modules/models/sd3/sd3_cond.py", line 164, in __init__
2024-07-28 09:47:20     self.tokenizer = SD3Tokenizer()
2024-07-28 09:47:20                      ^^^^^^^^^^^^^^
2024-07-28 09:47:20   File "/stable-diffusion-webui/modules/models/sd3/other_impls.py", line 221, in __init__
2024-07-28 09:47:20     self.t5xxl = T5XXLTokenizer()
2024-07-28 09:47:20                  ^^^^^^^^^^^^^^^^
2024-07-28 09:47:20   File "/stable-diffusion-webui/modules/models/sd3/other_impls.py", line 317, in __init__
2024-07-28 09:47:20     super().__init__(pad_with_end=False, tokenizer=T5TokenizerFast.from_pretrained("google/t5-v1_1-xxl"), has_start_token=False, pad_to_max_length=False, max_length=99999999, min_length=77)
2024-07-28 09:47:20                                                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-07-28 09:47:20   File "/opt/conda/lib/python3.11/site-packages/transformers/tokenization_utils_base.py", line 1825, in from_pretrained
2024-07-28 09:47:20     return cls._from_pretrained(
2024-07-28 09:47:20            ^^^^^^^^^^^^^^^^^^^^^
2024-07-28 09:47:20   File "/opt/conda/lib/python3.11/site-packages/transformers/tokenization_utils_base.py", line 1988, in _from_pretrained
2024-07-28 09:47:20     tokenizer = cls(*init_inputs, **init_kwargs)
2024-07-28 09:47:20                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-07-28 09:47:20   File "/opt/conda/lib/python3.11/site-packages/transformers/models/t5/tokenization_t5_fast.py", line 133, in __init__
2024-07-28 09:47:20     super().__init__(
2024-07-28 09:47:20   File "/opt/conda/lib/python3.11/site-packages/transformers/tokenization_utils_fast.py", line 114, in __init__
2024-07-28 09:47:20     fast_tokenizer = convert_slow_tokenizer(slow_tokenizer)
2024-07-28 09:47:20                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-07-28 09:47:20   File "/opt/conda/lib/python3.11/site-packages/transformers/convert_slow_tokenizer.py", line 1307, in convert_slow_tokenizer
2024-07-28 09:47:20     return converter_class(transformer_tokenizer).converted()
2024-07-28 09:47:20            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-07-28 09:47:20   File "/opt/conda/lib/python3.11/site-packages/transformers/convert_slow_tokenizer.py", line 445, in __init__
2024-07-28 09:47:20     from .utils import sentencepiece_model_pb2 as model_pb2
2024-07-28 09:47:20   File "/opt/conda/lib/python3.11/site-packages/transformers/utils/sentencepiece_model_pb2.py", line 91, in <module>
2024-07-28 09:47:20     _descriptor.EnumValueDescriptor(
2024-07-28 09:47:20   File "/opt/conda/lib/python3.11/site-packages/google/protobuf/descriptor.py", line 789, in __new__
2024-07-28 09:47:20     _message.Message._CheckCalledFromGeneratedFile()
2024-07-28 09:47:20 TypeError: Descriptors cannot be created directly.
2024-07-28 09:47:20 If this call came from a _pb2.py file, your generated code is out of date and must be regenerated with protoc >= 3.19.0.
2024-07-28 09:47:20 If you cannot immediately regenerate your protos, some other possible workarounds are:
2024-07-28 09:47:20  1. Downgrade the protobuf package to 3.20.x or lower.
2024-07-28 09:47:20  2. Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION=python (but this will use pure-Python parsing and will be much slower).
2024-07-28 09:47:20 
2024-07-28 09:47:20 More information: https://developers.google.com/protocol-buffers/docs/news/2022-05-06#python-updates
2024-07-28 09:47:20 
2024-07-28 09:47:20 Failed to create model quickly; will retry using slow method.
2024-07-28 09:47:20 changing setting sd_model_checkpoint to sd3_medium.safetensors: TypeError
2024-07-28 09:47:20 Traceback (most recent call last):
2024-07-28 09:47:20   File "/stable-diffusion-webui/modules/options.py", line 165, in set
2024-07-28 09:47:20     option.onchange()
2024-07-28 09:47:20   File "/stable-diffusion-webui/modules/call_queue.py", line 14, in f
2024-07-28 09:47:20     res = func(*args, **kwargs)
2024-07-28 09:47:20           ^^^^^^^^^^^^^^^^^^^^^
2024-07-28 09:47:20   File "/stable-diffusion-webui/modules/initialize_util.py", line 181, in <lambda>
2024-07-28 09:47:20     shared.opts.onchange("sd_model_checkpoint", wrap_queued_call(lambda: sd_models.reload_model_weights()), call=False)
2024-07-28 09:47:20                                                                          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-07-28 09:47:20   File "/stable-diffusion-webui/modules/sd_models.py", line 977, in reload_model_weights
2024-07-28 09:47:20     load_model(checkpoint_info, already_loaded_state_dict=state_dict)
2024-07-28 09:47:20   File "/stable-diffusion-webui/modules/sd_models.py", line 829, in load_model
2024-07-28 09:47:20     sd_model = instantiate_from_config(sd_config.model, state_dict)
2024-07-28 09:47:20                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-07-28 09:47:20   File "/stable-diffusion-webui/modules/sd_models.py", line 775, in instantiate_from_config
2024-07-28 09:47:20     return constructor(**params)
2024-07-28 09:47:20            ^^^^^^^^^^^^^^^^^^^^^
2024-07-28 09:47:20   File "/stable-diffusion-webui/modules/models/sd3/sd3_model.py", line 34, in __init__
2024-07-28 09:47:20     self.text_encoders = SD3Cond()
2024-07-28 09:47:20                          ^^^^^^^^^
2024-07-28 09:47:20   File "/stable-diffusion-webui/modules/models/sd3/sd3_cond.py", line 164, in __init__
2024-07-28 09:47:20     self.tokenizer = SD3Tokenizer()
2024-07-28 09:47:20                      ^^^^^^^^^^^^^^
2024-07-28 09:47:20   File "/stable-diffusion-webui/modules/models/sd3/other_impls.py", line 221, in __init__
2024-07-28 09:47:20     self.t5xxl = T5XXLTokenizer()
2024-07-28 09:47:20                  ^^^^^^^^^^^^^^^^
2024-07-28 09:47:20   File "/stable-diffusion-webui/modules/models/sd3/other_impls.py", line 317, in __init__
2024-07-28 09:47:20     super().__init__(pad_with_end=False, tokenizer=T5TokenizerFast.from_pretrained("google/t5-v1_1-xxl"), has_start_token=False, pad_to_max_length=False, max_length=99999999, min_length=77)
2024-07-28 09:47:20                                                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-07-28 09:47:20   File "/opt/conda/lib/python3.11/site-packages/transformers/tokenization_utils_base.py", line 1825, in from_pretrained
2024-07-28 09:47:20     return cls._from_pretrained(
2024-07-28 09:47:20            ^^^^^^^^^^^^^^^^^^^^^
2024-07-28 09:47:20   File "/opt/conda/lib/python3.11/site-packages/transformers/tokenization_utils_base.py", line 1988, in _from_pretrained
2024-07-28 09:47:20     tokenizer = cls(*init_inputs, **init_kwargs)
2024-07-28 09:47:20                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-07-28 09:47:20   File "/opt/conda/lib/python3.11/site-packages/transformers/models/t5/tokenization_t5_fast.py", line 133, in __init__
2024-07-28 09:47:20     super().__init__(
2024-07-28 09:47:20   File "/opt/conda/lib/python3.11/site-packages/transformers/tokenization_utils_fast.py", line 114, in __init__
2024-07-28 09:47:20     fast_tokenizer = convert_slow_tokenizer(slow_tokenizer)
2024-07-28 09:47:20                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-07-28 09:47:20   File "/opt/conda/lib/python3.11/site-packages/transformers/convert_slow_tokenizer.py", line 1307, in convert_slow_tokenizer
2024-07-28 09:47:20     return converter_class(transformer_tokenizer).converted()
2024-07-28 09:47:20            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-07-28 09:47:20   File "/opt/conda/lib/python3.11/site-packages/transformers/convert_slow_tokenizer.py", line 445, in __init__
2024-07-28 09:47:20     from .utils import sentencepiece_model_pb2 as model_pb2
2024-07-28 09:47:20   File "/opt/conda/lib/python3.11/site-packages/transformers/utils/sentencepiece_model_pb2.py", line 28, in <module>
2024-07-28 09:47:20     DESCRIPTOR = _descriptor.FileDescriptor(
2024-07-28 09:47:20                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-07-28 09:47:20   File "/opt/conda/lib/python3.11/site-packages/google/protobuf/descriptor.py", line 1072, in __new__
2024-07-28 09:47:20     return _message.default_pool.AddSerializedFile(serialized_pb)
2024-07-28 09:47:20            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-07-28 09:47:20 TypeError: Couldn't build proto file into descriptor pool: duplicate file name sentencepiece_model.proto

[zadokov]

I have the same issue... Cannot use SD3 model

[AMDITAR]

I also have this issue trying to load SD3. Similar file errors when trying to load an SD3 model but everything else works fine.