Skip to content

Commit 8882813

Browse files
committed
add a note about the supported models.
1 parent 5a558be commit 8882813

File tree

1 file changed

+5
-1
lines changed

1 file changed

+5
-1
lines changed

examples/dreambooth/REAMDE_sana.md

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -109,6 +109,8 @@ To better track our training experiments, we're using the following flags in the
109109
* `report_to="wandb` will ensure the training runs are tracked on [Weights and Biases](https://wandb.ai/site). To use it, be sure to install `wandb` with `pip install wandb`. Don't forget to call `wandb login <your_api_key>` before training if you haven't done it before.
110110
* `validation_prompt` and `validation_epochs` to allow the script to do a few validation inference runs. This allows us to qualitatively check if the training is progressing as expected.
111111

112+
## Notes
113+
112114
Additionally, we welcome you to explore the following CLI arguments:
113115

114116
* `--lora_layers`: The transformer modules to apply LoRA training on. Please specify the layers in a comma seperated. E.g. - "to_k,to_q,to_v" will result in lora training of attention layers only.
@@ -120,4 +122,6 @@ We provide several options for optimizing memory optimization:
120122

121123
* `--offload`: When enabled, we will offload the text encoder and VAE to CPU, when they are not used.
122124
* `cache_latents`: When enabled, we will pre-compute the latents from the input images with the VAE and remove the VAE from memory once done.
123-
* `--use_8bit_adam`: When enabled, we will use the 8bit version of AdamW provided by the `bitsandbytes` library.
125+
* `--use_8bit_adam`: When enabled, we will use the 8bit version of AdamW provided by the `bitsandbytes` library.
126+
127+
Refer to the [official documentation](https://huggingface.co/docs/diffusers/main/en/api/pipelines/sana) of the `SanaPipeline` to know more about the models available under the SANA family and their preferred dtypes during inference.

0 commit comments

Comments
 (0)