--sd-webui-ar-plus no longer works since the last update of FORGE

[StudioDUzes]

Already up to date.

venv "E:\0-FORGE\venv\Scripts\Python.exe"
Python 3.10.6 (tags/v3.10.6:9c7b4bd, Aug  1 2022, 21:53:49) [MSC v.1932 64 bit (AMD64)]
Version: f1.0.1v1.10.1rc-previous-22-g6eb23c6d
Commit hash: 6eb23c6d09b2f494bac443e85a3c7c7fd5833023
CUDA 12.1
Launching Web UI with arguments: --device-id 1 --port 7861 --cuda-stream --api --ckpt-dir 'E:\CHECKPOINTS' --lora-dir 'J:\Stable-Diffusion\MODELS\Lora' --vae-dir 'J:\Stable-Diffusion\MODELS\VAE' --esrgan-models-path 'J:\Stable-Diffusion\MODELS\ESRGAN' --embeddings-dir 'J:\Stable-Diffusion\MODELS\embeddings'
Total VRAM 12288 MB, total RAM 65447 MB
Set vram state to: NORMAL_VRAM
Device: cuda:0 NVIDIA GeForce RTX 3060 : native
Hint: your device supports --pin-shared-memory for potential speed improvements.
Hint: your device supports --cuda-malloc for potential speed improvements.
VAE dtype: torch.bfloat16
CUDA Stream Activated:  True
Using pytorch cross attention
ControlNet preprocessor location: E:\0-FORGE\models\ControlNetPreprocessor
CHv1.8.10: Get Custom Model Folder
[-] ADetailer initialized. version: 24.6.0, num models: 12
17:37:11 - ReActor - STATUS - Running v0.7.1-a1 on Device: CUDA
CHv1.8.10: Set Proxy:
Loading weights [0b76532e03] from E:\CHECKPOINTS\SDXL\crystalClearXL_ccxl.safetensors
*** Error calling: E:\0-FORGE\extensions\--sd-webui-ar-plus\scripts\sd-webui-ar.py/ui
    Traceback (most recent call last):
      File "E:\0-FORGE\modules\scripts.py", line 545, in wrap_call
        return func(*args, **kwargs)
      File "E:\0-FORGE\extensions\--sd-webui-ar-plus\scripts\sd-webui-ar.py", line 261, in ui
        ar_btns = [
      File "E:\0-FORGE\extensions\--sd-webui-ar-plus\scripts\sd-webui-ar.py", line 262, in <listcomp>
        ARButton(ar=ar, value=label)
      File "E:\0-FORGE\extensions\--sd-webui-ar-plus\scripts\sd-webui-ar.py", line 35, in __init__
        super().__init__(**kwargs)
      File "E:\0-FORGE\modules\ui_components.py", line 23, in __init__
        super().__init__(*args, elem_classes=["tool", *elem_classes], value=value, **kwargs)
      File "E:\0-FORGE\modules\gradio_extensions.py", line 126, in __repaired_init__
        original(self, *args, **fixed_kwargs)
      File "E:\0-FORGE\venv\lib\site-packages\gradio\component_meta.py", line 163, in wrapper
        return fn(self, **kwargs)
      File "E:\0-FORGE\venv\lib\site-packages\gradio\components\button.py", line 61, in __init__
        super().__init__(
      File "E:\0-FORGE\modules\gradio_extensions.py", line 35, in IOComponent_init
        res = original_IOComponent_init(self, *args, **kwargs)
      File "E:\0-FORGE\venv\lib\site-packages\gradio\component_meta.py", line 163, in wrapper
        return fn(self, **kwargs)
      File "E:\0-FORGE\venv\lib\site-packages\gradio\components\base.py", line 224, in __init__
        self.component_class_id = self.__class__.get_component_class_id()
      File "E:\0-FORGE\venv\lib\site-packages\gradio\components\base.py", line 118, in get_component_class_id
        module_path = sys.modules[module_name].__file__
    KeyError: 'sd-webui-ar.py'

---
model_type EPS
UNet ADM Dimension 2816
*** Error calling: E:\0-FORGE\extensions\--sd-webui-ar-plus\scripts\sd-webui-ar.py/ui
    Traceback (most recent call last):
      File "E:\0-FORGE\modules\scripts.py", line 545, in wrap_call
        return func(*args, **kwargs)
      File "E:\0-FORGE\extensions\--sd-webui-ar-plus\scripts\sd-webui-ar.py", line 261, in ui
        ar_btns = [
      File "E:\0-FORGE\extensions\--sd-webui-ar-plus\scripts\sd-webui-ar.py", line 262, in <listcomp>
        ARButton(ar=ar, value=label)
      File "E:\0-FORGE\extensions\--sd-webui-ar-plus\scripts\sd-webui-ar.py", line 35, in __init__
        super().__init__(**kwargs)
      File "E:\0-FORGE\modules\ui_components.py", line 23, in __init__
        super().__init__(*args, elem_classes=["tool", *elem_classes], value=value, **kwargs)
      File "E:\0-FORGE\modules\gradio_extensions.py", line 126, in __repaired_init__
        original(self, *args, **fixed_kwargs)
      File "E:\0-FORGE\venv\lib\site-packages\gradio\component_meta.py", line 163, in wrapper
        return fn(self, **kwargs)
      File "E:\0-FORGE\venv\lib\site-packages\gradio\components\button.py", line 61, in __init__
        super().__init__(
      File "E:\0-FORGE\modules\gradio_extensions.py", line 35, in IOComponent_init
        res = original_IOComponent_init(self, *args, **kwargs)
      File "E:\0-FORGE\venv\lib\site-packages\gradio\component_meta.py", line 163, in wrapper
        return fn(self, **kwargs)
      File "E:\0-FORGE\venv\lib\site-packages\gradio\components\base.py", line 224, in __init__
        self.component_class_id = self.__class__.get_component_class_id()
      File "E:\0-FORGE\venv\lib\site-packages\gradio\components\base.py", line 118, in get_component_class_id
        module_path = sys.modules[module_name].__file__
    KeyError: 'sd-webui-ar.py'

---
2024-07-27 17:37:13,861 - ControlNet - INFO - ControlNet UI callback registered.
Using pytorch attention in VAE
Working with z of shape (1, 4, 32, 32) = 4096 dimensions.
Using pytorch attention in VAE
Running on local URL:  http://127.0.0.1:7861

To create a public link, set `share=True` in `launch()`.
Exception in thread Thread-26 (webui_worker):
Traceback (most recent call last):
  File "C:\Users\StudioD\AppData\Local\Programs\Python\Python310\lib\threading.py", line 1016, in _bootstrap_inner
    self.run()
  File "C:\Users\StudioD\AppData\Local\Programs\Python\Python310\lib\threading.py", line 953, in run
    self._target(*self._args, **self._kwargs)
  File "E:\0-FORGE\webui.py", line 119, in webui_worker
    create_api(app)
  File "E:\0-FORGE\webui.py", line 32, in create_api
    api = Api(app, queue_lock)
  File "E:\0-FORGE\modules\api\api.py", line 265, in __init__
    self.default_script_arg_txt2img = self.init_default_script_args(txt2img_script_runner)
  File "E:\0-FORGE\modules\api\api.py", line 328, in init_default_script_args
    if script.ui(script.is_img2img):
  File "E:\0-FORGE\extensions\--sd-webui-ar-plus\scripts\sd-webui-ar.py", line 261, in ui
    ar_btns = [
  File "E:\0-FORGE\extensions\--sd-webui-ar-plus\scripts\sd-webui-ar.py", line 262, in <listcomp>
    ARButton(ar=ar, value=label)
  File "E:\0-FORGE\extensions\--sd-webui-ar-plus\scripts\sd-webui-ar.py", line 35, in __init__
    super().__init__(**kwargs)
  File "E:\0-FORGE\modules\ui_components.py", line 23, in __init__
    super().__init__(*args, elem_classes=["tool", *elem_classes], value=value, **kwargs)
  File "E:\0-FORGE\modules\gradio_extensions.py", line 126, in __repaired_init__
    original(self, *args, **fixed_kwargs)
  File "E:\0-FORGE\venv\lib\site-packages\gradio\component_meta.py", line 163, in wrapper
    return fn(self, **kwargs)
  File "E:\0-FORGE\venv\lib\site-packages\gradio\components\button.py", line 61, in __init__
    super().__init__(
  File "E:\0-FORGE\modules\gradio_extensions.py", line 35, in IOComponent_init
    res = original_IOComponent_init(self, *args, **kwargs)
  File "E:\0-FORGE\venv\lib\site-packages\gradio\component_meta.py", line 163, in wrapper
    return fn(self, **kwargs)
  File "E:\0-FORGE\venv\lib\site-packages\gradio\components\base.py", line 224, in __init__
    self.component_class_id = self.__class__.get_component_class_id()
  File "E:\0-FORGE\venv\lib\site-packages\gradio\components\base.py", line 118, in get_component_class_id
    module_path = sys.modules[module_name].__file__
KeyError: 'sd-webui-ar.py'
extra {'cond_stage_model.clip_l.logit_scale', 'cond_stage_model.clip_g.transformer.text_model.embeddings.position_ids', 'cond_stage_model.clip_l.text_projection'}
To load target model SDXLClipModel
Begin to load 1 model
[Memory Management] Current Free GPU Memory (MB) =  11234.99609375
[Memory Management] Model Memory (MB) =  2144.3546981811523
[Memory Management] Minimal Inference Memory (MB) =  1024.0
[Memory Management] Estimated Remaining GPU Memory (MB) =  8066.641395568848
Moving model(s) has taken 0.72 seconds
Model loaded in 11.7s (load weights from disk: 0.4s, forge load real models: 10.2s, calculate empty prompt: 1.0s).

[githabtane]

I want it to be compatible with Gradio 4. forge

[LEv145]

Error is: KeyError: 'sd-webui-ar.py'
I think this is a Forge problem, not an extension.

[altoiddealer]

Hello, I also have my own fork here, with the same issue.

I noticed that there are no issues with the buttons which are explicitly initialized from ToolButton - rather than the AR and Static Res buttons which are subclassed and inherit from ToolButton.

For reasons beyond my comprehension, these buttons in particular are not inheriting properly (or something), because later on the 'module_name' value is the name of the extension instead of the name of the ui_components module.

If I just brute force it, the script works (note in my case the error is sd-webui-ar-plusplus.py).

  File "E:\0-FORGE\venv\lib\site-packages\gradio\components\base.py", line 118, in get_component_class_id
    module_path = sys.modules[module_name].__file__
KeyError: 'sd-webui-ar-plus-plus.py'

So if I open up base.py and edit it like this, the script works fine.

    @classmethod
    def get_component_class_id(cls) -> str:
        module_name = cls.__module__
        if module_name == 'sd-webui-ar-plusplus.py':
            module_name = 'modules.ui_components'

        module_path = sys.modules[module_name].__file__
        module_hash = hashlib.md5(f"{cls.__name__}_{module_path}".encode()).hexdigest()
        return module_hash

I've been at this for hours but am making basically zero progress beyond this here.

[DraconicDragon]

Not sure if this is correct but with my limited Python knowledge it seems that the classes like txt2imgARButtons that inherit ToolButton causes the issue?

[altoiddealer]

Indeed, they don’t seem to properly inherit from ToolButton anymore… via super init. idk if this is a consequence of Gradio 4, or how Illyasviel implemented gradio in Forge. I couldn’t finagle it.

[Technologicat]

@altoiddealer: Python programmer here.

For reasons beyond my comprehension, these buttons in particular are not inheriting properly (or something), because later on the 'module_name' value is the name of the extension instead of the name of the ui_components module.

This is because the custom button class is defined in sd-webui-ar-plusplus.py, hence it gets this as its __module__. See e.g. here and here.

Thus, seems a Gradio problem, but since Python goes to superhuman lengths to expose its moving parts [as put by Evelyn Woods, 2017], one possible hacky fix is to just manually override the __module__ attribute on each affected class.

So, after your last class definition, let's inject the value Gradio expects to see:

# Hack for Gradio 4.0; see `get_component_class_id` in `venv/lib/site-packages/gradio/components/base.py`
txt2imgARButtons.__module__ = "modules.ui_components"
img2imgARButtons.__module__ = "modules.ui_components"
txt2imgResButtons.__module__ = "modules.ui_components"
img2imgResButtons.__module__ = "modules.ui_components"

The result works with unmodified base.py. The extension loads and the buttons work fine.

This shouldn't have any ill effects, since the __module__ attribute is (AFAIK) only used as debug info.

But now, I'm seeing a second issue. The resolution buttons have neither a label nor a tooltip, they look completely blank. Running a fresh copy of your extension on Forge f2.0.1v1.10.1-previous-317-g4bb56139 (4bb5613916604196b7a33b3e2e2072d0c2408e63), pulled just a few hours ago. Have you encountered this?

Note that the AR buttons show their labels and tooltips correctly, so it can't be related to the hacky fix.

[altoiddealer]

@altoiddealer: Python programmer here.

Heya, first of all thank you so much for checking this out. I am a persistent bastard, and can usually solve things on my own once I try every possible solution, but this is one that eluded me.

So, after your last class definition, let's inject the value Gradio expects to see:

This worked! I was very close to this solution... what I had tried previously was within each Class, just before the super().__init__(**kwargs), I had tried self.__module__ = "modules.ui_components". I'm unsure exactly why your solution works while this did not, but no matter! You've saved me!

But now, I'm seeing a second issue. The resolution buttons have neither a label nor a tooltip, they look completely blank. Running a fresh copy of your extension on Forge f2.0.1v1.10.1-previous-317-g4bb56139 (4bb5613916604196b7a33b3e2e2072d0c2408e63), pulled just a few hours ago. Have you encountered this?

I had noticed this issue too (on "new forge", with my base.py hack).
I think there were 2 "previous" release packages to choose from, which just recently has been consolidated to just one "previous" release package. I had only tried the "older previous" without seeing the issue.

Regardless! This is something I am confident I can work out, I was ignoring this completely in lieu of the larger issue.

I'll have time tomorrow to check compatibility of this fix with all the WebUIs, and resolve the static res buttons, as well as hopefully figure out a cleaner solution to the button layout... the buttons scaled nicely on previous versions, now they are spilling into additional rows.

[altoiddealer]

@LEv145

See 2 comments up #24 (comment)

You should just need to add that after the img2imgResButtons() block

[LEv145]

Thank you all for your help!

[LEv145]

I hope I understood everything correctly)
Test if the problem is fixed now on dev branch: https://github.com/LEv145/--sd-webui-ar-plus/tree/dev

[Technologicat]

@altoiddealer, @LEv145: I'm happy to help with small things like this. :)

Both your extensions are great. In my opinion, having quick buttons for AR and resolution are essential for the UX of A1111 and Forge. (Especially when you can easily pick the most appropriate AR and resolution for your inpaint region.)

@altoiddealer:

This worked! I was very close to this solution... what I had tried previously was within each Class, just before the super().__init__(**kwargs), I had tried self.__module__ = "modules.ui_components". I'm unsure exactly why your solution works while this did not, but no matter! You've saved me!

This is because __init__ is an instance method, so self points to the object instance being constructed.

EDIT: Hence, self.__module__ = ... writes to the __module__ attribute in the object instance namespace.

However, looking at get_component_class_id in venv/lib/site-packages/gradio/components/base.py:

    @classmethod
    def get_component_class_id(cls) -> str:
        module_name = cls.__module__
        module_path = sys.modules[module_name].__file__
        module_hash = hashlib.md5(f"{cls.__name__}_{module_path}".encode()).hexdigest()
        return module_hash

This is a class method, so it doesn't see the object instance namespace at all. The expression cls.__module__ begins looking up the __module__ attribute directly in the class namespace.

(If it wasn't found immediately, then the lookup would bubble up the MRO, which follows the C3 ordering. But in the case discussed here, Python populates the __module__ attribute by default, so it's present by default on each class.)

(EDIT: On the other hand, when you have an object instance obj, the expression obj.x begins looking up the attribute x in the object instance namespace. If not found there, then it looks for it in the class namespace, and then follows the MRO.)

In common wisdom, in Python, __init__ is the object constructor, but that's only almost correct.

When a new object instance is being constructed, Python first calls __new__, which is a class method. That __new__ is the actual constructor that allocates memory for the new object instance, typically by calling super().__new__(...), which bottoms out into some magic in the Python interpreter itself. Then (now be very careful!) Python takes whatever object instance was returned by __new__, and hands it over to __init__, as the self argument, for initialization.

The __new__ class method is another customizable part of Python. You can e.g. implement the singleton pattern (from the C++ world) by implementing a custom __new__ that only ever allocates one instance (per process) of your class.

For a concrete example, see here how to use this to make a Lisp-like symbol type in Python. :)

Also, keep in mind that in Python, classes themselves are just objects. The class statement effectively instantiates such an object when it runs. Also keep in mind that in Python, definitions have no special role. They run when encountered, just like any other statement. A definition typically, as an important side effect, saves the instantiated thing (class, method or function) into the namespace in which the definition appeared.

Ask me if there's anything else. I can't guarantee that I'll have the answer, but I've done some Python metaprogramming (e.g. [1], [2]), where one tends to need to consider details like this.

I had noticed this issue too (on "new forge", with my base.py hack). I think there were 2 "previous" release packages to choose from, which just recently has been consolidated to just one "previous" release package. I had only tried the "older previous" without seeing the issue.

Regardless! This is something I am confident I can work out, I was ignoring this completely in lieu of the larger issue.

I'll have time tomorrow to check compatibility of this fix with all the WebUIs, and resolve the static res buttons, as well as hopefully figure out a cleaner solution to the button layout... the buttons scaled nicely on previous versions, now they are spilling into additional rows.

Thanks. I'll wait for your update, then :)

[derpina-ai]

I hope I understood everything correctly) Test if the problem is fixed now on dev branch: https://github.com/LEv145/--sd-webui-ar-plus/tree/dev

Hi and thanks for the quick commit! My first test looks like this, default resolutions/aspect fresh install

Edit: I forgot to mention, the buttons all work, it's just the text is not displayed on any of them.

CHv1.8.11: Set Proxy:
 Error calling: I:\SD\forge\webui\extensions\--sd-webui-ar-plus\scripts\sd-webui-ar.py/ui
    Traceback (most recent call last):
      File "I:\SD\forge\webui\modules\scripts.py", line 545, in wrap_call
        return func(*args, **kwargs)
      File "I:\SD\forge\webui\extensions\--sd-webui-ar-plus\scripts\sd-webui-ar.py", line 455, in ui
        arc_calc_height = gr.Button(value="Calculate Height").style(
    AttributeError: 'Button' object has no attribute 'style'


Error calling: I:\SD\forge\webui\extensions\--sd-webui-ar-plus\scripts\sd-webui-ar.py/ui
    Traceback (most recent call last):
      File "I:\SD\forge\webui\modules\scripts.py", line 545, in wrap_call
        return func(*args, **kwargs)
      File "I:\SD\forge\webui\extensions\--sd-webui-ar-plus\scripts\sd-webui-ar.py", line 455, in ui
        arc_calc_height = gr.Button(value="Calculate Height").style(
    AttributeError: 'Button' object has no attribute 'style' 

[LEv145]

@derpina-ai I updated the code in the dev branch a bit, the problem should be solved

https://github.com/LEv145/--sd-webui-ar-plus/tree/7b501bf5ac09905d8105ec34f7dbb922f3c287e8

[derpina-ai]

@derpina-ai I updated the code in the dev branch a bit, the problem should be solved

https://github.com/LEv145/--sd-webui-ar-plus/tree/7b501bf5ac09905d8105ec34f7dbb922f3c287e8

Hi, latest made the extension load without error but disappear completely in the UI.

maybe unrelated getting weird errors like : RuntimeError: stack expects each tensor to be equal size, but got [256, 4096] at entry 0 and [257, 4096] at entry 1, where 256 is the length of my prompt in tokens