sam2-playground

Gradio based playground web UI using facebook/segment-anything-2 models.

Online Demos

Feature

• Segment video for transparent background or pixelated object

Transparent background

Transparent.background.mp4

Pixelate

Pixelate.mp4

• Segment image to divide objects into layers and save them as PSD files.

Divide clothes into layers and save as PSD file

See PROMPT_GUIDE.md to see how to prompt the segmentation parts of the image.

Installation and Running

Prerequisites

To run this Web UI, you need these prerequisites. If you don't have them, please install them in the following links :

• git : https://git-scm.com/downloads
• python=>3.10 : https://www.python.org/downloads/
• FFmpeg : https://ffmpeg.org/download.html

After installing FFmpeg, make sure to add the FFmpeg/bin folder to your system PATH!
And for CUDA, if you're not using an Nvidia GPU and CUDA 12.4, edit the requirements.txt to match your environment.

Option 1 : Running with Shell / Batch Scripts

There's a set of shell / batch scripts for installation and running.

1. Download sam2-playground-portable.zip with the file corresponding to your OS and extract its contents.
2. Run install.bat or install.sh to install dependencies. (It will create a venv directory and install dependencies there.)
3. Start WebUI with start-webui.bat or start-webui.sh (It will run python app.py after activating the venv)
4. To update, run update.bat or update.sh (It will run git pull origin master)

Option 2: Docker

1. Clone the repository

git clone https://github.com/jhj0517/sam2-playground.git

3. Build the image ( Image is about ~6 GB )

docker compose build

3. Run the container

docker compose up

4. Connect to localhost:7860 with your browser.

If needed, update docker-compose.yaml to match your environments.

Todo 🗓

• Support change() API for gradio_image_prompter and automatically generate preview for video predictor