Skip to content

Commit fb9c71a

Browse files
committed
start
1 parent 5dc503a commit fb9c71a

File tree

3 files changed

+54
-26
lines changed

3 files changed

+54
-26
lines changed

docs/source/en/_toctree.yml

Lines changed: 30 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -112,6 +112,8 @@
112112
sections:
113113
- local: modular_diffusers/overview
114114
title: Overview
115+
- local: modular_diffusers/end_to_end_guide
116+
title: Quickstart
115117
- local: modular_diffusers/modular_pipeline
116118
title: Modular Pipeline
117119
- local: modular_diffusers/components_manager
@@ -126,12 +128,34 @@
126128
title: Loop Sequential Pipeline Blocks
127129
- local: modular_diffusers/auto_pipeline_blocks
128130
title: Auto Pipeline Blocks
129-
- local: modular_diffusers/end_to_end_guide
130-
title: End-to-End Example
131-
132-
- title: Training
133-
isExpanded: false
134-
sections:
131+
title: Modular Diffusers
132+
- sections:
133+
- local: using-diffusers/consisid
134+
title: ConsisID
135+
- local: using-diffusers/sdxl
136+
title: Stable Diffusion XL
137+
- local: using-diffusers/sdxl_turbo
138+
title: SDXL Turbo
139+
- local: using-diffusers/kandinsky
140+
title: Kandinsky
141+
- local: using-diffusers/omnigen
142+
title: OmniGen
143+
- local: using-diffusers/pag
144+
title: PAG
145+
- local: using-diffusers/inference_with_lcm
146+
title: Latent Consistency Model
147+
- local: using-diffusers/shap-e
148+
title: Shap-E
149+
- local: using-diffusers/diffedit
150+
title: DiffEdit
151+
- local: using-diffusers/inference_with_tcd_lora
152+
title: Trajectory Consistency Distillation-LoRA
153+
- local: using-diffusers/svd
154+
title: Stable Video Diffusion
155+
- local: using-diffusers/marigold_usage
156+
title: Marigold Computer Vision
157+
title: Specific pipeline examples
158+
- sections:
135159
- local: training/overview
136160
title: Overview
137161
- local: training/create_dataset

docs/source/en/modular_diffusers/overview.md

Lines changed: 18 additions & 20 deletions
Original file line numberDiff line numberDiff line change
@@ -10,33 +10,31 @@ an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express o
1010
specific language governing permissions and limitations under the License.
1111
-->
1212

13-
# Getting Started with Modular Diffusers
13+
# Overview
1414

15-
<Tip warning={true}>
15+
> [!WARNING]
16+
> ⚠︎ Modular Diffusers is still under active development and it's API may change.
1617
17-
🧪 **Experimental Feature**: Modular Diffusers is an experimental feature we are actively developing. The API may be subject to breaking changes.
18+
Modular Diffusers is a unified pipeline system that simplifies your workflow with *pipeline blocks*.
1819

19-
</Tip>
20+
- Blocks are reusable and you only create new blocks that are unique to your pipeline.
21+
- Blocks can be mixed and matched to adapt to or create a pipeline for a specific workflow or multiple workflows.
2022

21-
With Modular Diffusers, we introduce a unified pipeline system that simplifies how you work with diffusion models. Instead of creating separate pipelines for each task, Modular Diffusers lets you:
23+
The Modular Diffusers docs are organized as shown below.
2224

23-
**Write Only What's New**: You won't need to write an entire pipeline from scratch every time you have a new use case. You can create pipeline blocks just for your new workflow's unique aspects and reuse existing blocks for existing functionalities.
25+
## Quickstart
2426

25-
**Assemble Like LEGO®**: You can mix and match between blocks in flexible ways. This allows you to write dedicated blocks unique to specific workflows, and then assemble different blocks into a pipeline that can be used more conveniently for multiple workflows.
27+
- A [quickstart](./end_to_end_guide) start for implementing an example workflow with Modular Diffusers.
2628

29+
## ModularPipeline
2730

28-
Here's how our guides are organized to help you navigate the Modular Diffusers documentation:
31+
- [ModularPipeline](./modular_pipeline) shows you how to build with pipeline blocks and convert them into an executable [`ModularPipeline`].
32+
- [ComponentsManager](./components_manager) shows you how to manage and reuse components across multiple pipelines.
2933

30-
### 🚀 Running Pipelines
31-
- **[Modular Pipeline Guide](./modular_pipeline.md)** - How to use predefined blocks to build a pipeline and run it
32-
- **[Components Manager Guide](./components_manager.md)** - How to manage and reuse components across multiple pipelines
34+
## ModularPipelineBlocks
3335

34-
### 📚 Creating PipelineBlocks
35-
- **[Pipeline and Block States](./modular_diffusers_states.md)** - Understanding PipelineState and BlockState
36-
- **[Pipeline Block](./pipeline_block.md)** - How to write custom PipelineBlocks
37-
- **[SequentialPipelineBlocks](sequential_pipeline_blocks.md)** - Connecting blocks in sequence
38-
- **[LoopSequentialPipelineBlocks](./loop_sequential_pipeline_blocks.md)** - Creating iterative workflows
39-
- **[AutoPipelineBlocks](./auto_pipeline_blocks.md)** - Conditional block selection
40-
41-
### 🎯 Practical Examples
42-
- **[End-to-End Example](./end_to_end_guide.md)** - Complete end-to-end examples including sharing your workflow in huggingface hub and deplying UI nodes
36+
- [States](./modular_diffusers_states) explains how data is shared and communicated between pipeline blocks and [`ModularPipeline`].
37+
- [PipelineBlock](./pipeline_block) is the most basic unit of a [`ModularPipeline`] and this guide shows you how to create one.
38+
- [SequentialPipelineBlocks](./sequential_pipeline_blocks) is a type of block that chains multiple blocks so they run one after another, passing data along the chain. This guide shows you how to create [`SequentialPipelineBlocks`] and how they connect and work together.
39+
- [LoopSequentialPipelineBlocks](./loop_sequential_pipeline_blocks) is a type of block that runs a series of blocks in a loop. This guide shows you how to create [`LoopSequentialPipelineBlocks`].
40+
- [AutoPipelineBlocks](./auto_pipeline_blocks) is a type of block that automatically chooses which blocks to run based on the input. This guide shows you how to create [`AutoPipelineBlocks`].

src/diffusers/__init__.py

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -61,6 +61,12 @@
6161
"is_unidecode_available",
6262
"logging",
6363
],
64+
"image_processor": [
65+
"VaeImageProcessor",
66+
],
67+
"video_processor": [
68+
"VideoProcessor",
69+
],
6470
}
6571

6672
try:

0 commit comments

Comments
 (0)