You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Stable Diffusion V3 is next generation of latent diffusion image Stable Diffusion models family that outperforms state-of-the-art text-to-image generation systems in typography and prompt adherence, based on human preference evaluations.
4
+
5
+
In comparison with previous versions, it based on Multimodal Diffusion Transformer (MMDiT) text-to-image model that features greatly improved performance in image quality, typography, complex prompt understanding, and resource-efficiency.
6
+
7
+
More details about model can be found in [model card](https://huggingface.co/stabilityai/stable-diffusion-3-medium), [research paper](https://stability.ai/news/stable-diffusion-3-research-paper) and [Stability.AI blog post](https://stability.ai/news/stable-diffusion-3-medium).
8
+
9
+
## Enabling SD3 in GIMP
10
+
### Converting the Models
11
+
The supported version of SD3 in GIMP is the flash_sd3 LoRA. In order to use with GIMP, you first need to download and convert the model into OpenVINO format. This can be done by following the instructions in the [OpenVINO Stable Diffusion v3 Notebook](https://github.com/openvinotoolkit/openvino_notebooks/tree/latest/notebooks/stable-diffusion-v3).
12
+
>**Note**: Ensure you use the instructions for flash_sd3.
13
+
14
+
### Model Installation
15
+
After completing the steps in the notebook, you will have the models located in `openvino_notebooks\notebooks\stable-diffusion-v3\stable-diffusion-3`. Copy these models to `openvino-ai-plugins-gimp\weights\stable-diffusion-ov\stable-diffusion-3.0`
16
+
17
+
For example, using robocopy to copy the files on the command line:
After copying, create a file called `install_info.json` inside the stable-diffusion-3.0 directory. This will ensure that the GIMP plugin will recognize this as a valid model. It should contain the following text:
22
+
```
23
+
{
24
+
"hf_repo_id": "none",
25
+
"hf_commit_id": "none"
26
+
}
27
+
```
28
+
29
+
Verify that the copied files and directory structure looks as follows:
After completing model installation steps, SD3 will now be available in the Stable Diffusion UI. Note that SD3 can generate valid images in as few as 4 iterations. Also, the guidance scale needed is normally much lower. See the screenshot below:
> This is an example that will create a `GIMP` folder in`C:\Users\Public\`, and then download the package to `C:\Users\Public\GIMP`, you still can define where to place this package by yourself.
This step will take timefor downloading necessary packages.
121
120
122
-
123
-
- After creating python environment, gimpenv3, and downloaded necessary packages, you will be prompted to download models
124
-
- Enter __\<number\>__ for downloading models you want to run. You can specify multiple models separated by spaces:
125
-
126
-
127
-
128
-
- Download "__1__", SD-1.5 Square (512x512) as an instance. Once installation process is completed when you see the messages below.
129
-
130
-
131
-
132
-
>**Notes:**
133
-
> - The downloaded models include FP16 and INT8 precision, and INT8 precision can be executed on MTL NPU.
134
-
> - Weights is saved at `C:\Users\<user_name>\openvino-ai-plugins-gimp\weights`.
121
+
- After creating python environment, gimpenv3, and downloaded necessary packages, you can now start GIMP application from Start Menu.
135
122
136
123
# Execute Stable-Diffusion in GIMP
137
124
@@ -143,18 +130,36 @@ With previous section, the GIMP AI plugins with OpenVINO™ Backend is installed
143
130
144
131
You can now simply open Gimp from the start menu as you would any normal Windows application.
145
132
146
-
## Execute Stable-Diffusion – SD1.5_square_int8
133
+
## Download & Install Stable Diffusion Models
134
+
- Once GIMP application is started, Click "__Layer__"\>"__OpenVINO-AI-Plugins__"\>"__Stable diffusion__".
135
+
- Once Stable Diffusion Plugin UI opens up, click on Model Button on the top left corner as show in the below picture:
147
136
148
-
Please follow below steps to execute Stable-Diffusion - SD1.5_square_int8. For other features, please refer to [OpenVINO™ Image Generator Plugin with Stable Diffusion](https://github.com/intel/openvino-ai-plugins-gimp/tree/main?tab=readme-ov-file#openvino-image-generator-plugin-with-stable-diffusion) section.
137
+
138
+
- This now opens the Stable Diffusion Model Management window from where you can install the required models by clicking on "Install" button next to the model name.
149
139
150
-
- Following previous section to launch GIMP
140
+
151
141
152
-
142
+
- Download Stable Diffusion 1.5 Square as an instance.
153
143
154
-
- Click "__File__"\>"__New__"\>"__OK__" to new a layer in GIMP
144
+
145
+
146
+
- Once installation process is completed, you will see the "Install" button is updated to "Installed" and you will find the models in the drop-down list
155
147
156
-
157
-
148
+
149
+
150
+
>**Notes:**
151
+
> - The downloaded models include FP16 and INT8 precision
152
+
> - Weights is saved at `C:\Users\<user_name>\openvino-ai-plugins-gimp\weights`.
0 commit comments