Skip to content

Commit 5f3ebef

Browse files
committed
update remove duplicated config for pag, and remove the description of all the guiders
1 parent e6ffde2 commit 5f3ebef

File tree

1 file changed

+3
-25
lines changed

1 file changed

+3
-25
lines changed

docs/source/en/modular_diffusers/getting_started.md

Lines changed: 3 additions & 25 deletions
Original file line numberDiff line numberDiff line change
@@ -805,23 +805,6 @@ PerturbedAttentionGuidance {
805805
"perturbed_guidance_scale": 2.5,
806806
"perturbed_guidance_start": 0.01,
807807
"perturbed_guidance_stop": 0.2,
808-
"skip_layer_config": [
809-
{
810-
"dropout": 1.0,
811-
"fqn": "mid_block.attentions.0.transformer_blocks",
812-
"indices": [
813-
2,
814-
9
815-
],
816-
"skip_attention": false,
817-
"skip_attention_scores": true,
818-
"skip_ff": false
819-
}
820-
],
821-
"skip_layer_guidance_layers": null,
822-
"skip_layer_guidance_scale": 2.5,
823-
"skip_layer_guidance_start": 0.01,
824-
"skip_layer_guidance_stop": 0.2,
825808
"start": 0.0,
826809
"stop": 1.0,
827810
"use_original_formulation": false
@@ -833,7 +816,7 @@ The component spec has also been updated to reflect the new guider type:
833816

834817
```py
835818
>>> t2i_pipeline.get_component_spec("guider")
836-
ComponentSpec(name='guider', type_hint=<class 'diffusers.guiders.perturbed_attention_guidance.PerturbedAttentionGuidance'>, description=None, config=FrozenDict([('guidance_scale', 5.0), ('perturbed_guidance_scale', 2.5), ('perturbed_guidance_start', 0.01), ('perturbed_guidance_stop', 0.2), ('perturbed_guidance_layers', None), ('perturbed_guidance_config', LayerSkipConfig(indices=[2, 9], fqn='mid_block.attentions.0.transformer_blocks', skip_attention=False, skip_attention_scores=True, skip_ff=False, dropout=1.0)), ('guidance_rescale', 0.0), ('use_original_formulation', False), ('start', 0.0), ('stop', 1.0), ('_use_default_values', ['use_original_formulation', 'perturbed_guidance_stop', 'stop', 'guidance_rescale', 'start', 'perturbed_guidance_layers', 'perturbed_guidance_start']), ('skip_layer_guidance_scale', 2.5), ('skip_layer_guidance_start', 0.01), ('skip_layer_guidance_stop', 0.2), ('skip_layer_guidance_layers', None), ('skip_layer_config', [LayerSkipConfig(indices=[2, 9], fqn='mid_block.attentions.0.transformer_blocks', skip_attention=False, skip_attention_scores=True, skip_ff=False, dropout=1.0)]), ('_class_name', 'PerturbedAttentionGuidance'), ('_diffusers_version', '0.35.0.dev0')]), repo=None, subfolder=None, variant=None, revision=None, default_creation_method='from_config')
819+
ComponentSpec(name='guider', type_hint=<class 'diffusers.guiders.perturbed_attention_guidance.PerturbedAttentionGuidance'>, description=None, config=FrozenDict([('guidance_scale', 5.0), ('perturbed_guidance_scale', 2.5), ('perturbed_guidance_start', 0.01), ('perturbed_guidance_stop', 0.2), ('perturbed_guidance_layers', None), ('perturbed_guidance_config', LayerSkipConfig(indices=[2, 9], fqn='mid_block.attentions.0.transformer_blocks', skip_attention=False, skip_attention_scores=True, skip_ff=False, dropout=1.0)), ('guidance_rescale', 0.0), ('use_original_formulation', False), ('start', 0.0), ('stop', 1.0), ('_use_default_values', ['use_original_formulation', 'perturbed_guidance_stop', 'stop', 'guidance_rescale', 'start', 'perturbed_guidance_layers', 'perturbed_guidance_start']), ('_class_name', 'PerturbedAttentionGuidance'), ('_diffusers_version', '0.35.0.dev0')]), repo=None, subfolder=None, variant=None, revision=None, default_creation_method='from_config')
837820
```
838821

839822
However, the "guider" is still not included in the pipeline config and will not be saved into the `modular_model_index.json` since it remains a `from_config` component:
@@ -908,14 +891,9 @@ Of course, you can also directly modify the `modular_model_index.json` to add a
908891

909892
<Tip>
910893

911-
💡 **Guidance Techniques Summary**:
912-
- **ClassifierFreeGuidance (CFG)**: The standard choice, best for general use and prompt adherence
913-
- **PerturbedAttentionGuidance (PAG)**: Enhances attention-based features by perturbing attention mechanisms
914-
- **SkipLayerGuidance (SLG)**: Improves structure and anatomy coherence by skipping specific layers
915-
- **SmoothedEnergyGuidance (SEG)**: Helps with energy distribution smoothing
916-
- **AdaptiveProjectedGuidance (APG)**: Adaptive guidance that projects predictions for better quality
894+
Experiment with different techniques and parameters to find what works best for your specific use case! You can find all the guider class we support [here](TODO: API doc)
917895

918-
Experiment with different techniques and parameters to find what works best for your specific use case! Additionally, you can write your own guider implementations, for example, CFG Zero* combined with Skip Layer Guidance, and they should be compatible out-of-the-box with modular diffusers!
896+
Additionally, you can write your own guider implementations, for example, CFG Zero* combined with Skip Layer Guidance, and they should be compatible out-of-the-box with modular diffusers!
919897

920898
</Tip>
921899

0 commit comments

Comments
 (0)