Inpaint Anything for Stable Diffusion Web UI

Inpaint Anything extension performs stable diffusion inpainting on a browser UI using any mask selected from the output of Segment Anything.

Using Segment Anything enables users to specify masks by simply pointing to the desired areas, instead of manually filling them in. This can increase the efficiency and accuracy of the mask creation process, leading to potentially higher-quality inpainting results while saving time and effort.

Standalone version

Installation

To install the software, please follow these steps:

• Open the "Extensions" tab on the AUTOMATIC1111's Stable Diffusion Web UI.
• Select the "Install from URL" option.
• Enter https://github.com/Uminosachi/sd-webui-inpaint-anything.git in the "URL for extension's git repository" field.
• Click the "Install" button.
• Once installation is complete, restart the Web UI.

Running the application

• To use xFormers for inference, please add the --xformers argument to the startup command. For example, run ./webui.sh --xformers or webui.bat --xformers
• Note: If you have a privacy protection extension enabled in your web browser, such as DuckDuckGo, you may not be able to retrieve the mask from your sketch.
• Note: In Gradio version 3.23.0 or older, the segmentation image may appear small on the Web UI.

Downloading the Model

To download the model:

• Go to the "Inpaint Anything" tab of the Web UI.
• Click on the "Download model" button next to the Segment Anything Model ID.
  • The SAM is available in three sizes. The sizes are: Base < Large < Huge. Please note that larger sizes consume more VRAM.
• Wait for the download to complete.
• The downloaded model file will be stored in the models directory of this application's repository.

Usage

• Drag and drop your image onto the input image area.
• Click the "Run Segment Anything" button.
• Use sketching to point the area you want to inpaint. You can undo and adjust the pen size.
• Click the "Create mask" button. The mask will appear in the selected mask image area.

Mask Adjustment

• "Expand mask region" button: Use this to slightly expand the area of the mask for broader coverage.
• "Trim mask by sketch" button: Clicking this will exclude the sketched area from the mask.

Inpainting Tab

• Enter the Prompt and Negative Prompt, Choose the Inpainting Model ID.
• Click the "Run Inpainting" button (Please note that it may take some time to download the model for the first time).
• You can change the Sampling Steps, the Guidance Scale and the Seed in the Advanced options.
• Inpainting process is performed using diffusers.

Cleaner Tab

• Choose the Cleaner Model ID.
• Click the "Run Cleaner" button (Please note that it may take some time to download the model for the first time).
• Cleaner process is performed using Lama Cleaner.

Auto-saving images

• The inpainted image will be automatically saved in the folder that matches the current date within the outputs/inpaint-anything directory.
• You can switch to the outputs/img2img-images directory via the "Inpaint Anything" section found in the "Settings" tab on the Web UI.

License

The source code is licensed under the Apache 2.0 license.