Skip to content

Commit 02de3ce

Browse files
linoytsabanbghira
andauthored
Update examples/dreambooth/train_dreambooth_lora_hidream.py
Co-authored-by: Bagheera <[email protected]>
1 parent fde5eeb commit 02de3ce

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

examples/dreambooth/train_dreambooth_lora_hidream.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1662,7 +1662,7 @@ def get_sigmas(timesteps, n_dim=4, dtype=torch.float32):
16621662
# and instead post-weight the loss
16631663
weighting = compute_loss_weighting_for_sd3(weighting_scheme=args.weighting_scheme, sigmas=sigmas)
16641664

1665-
# flow matching loss (reversed)
1665+
# flow matching loss via reverse ODE (HiDream uses an inverted flow field as compared to the more typical `noise - model_input` target)
16661666
target = model_input - noise
16671667

16681668
if args.with_prior_preservation:

0 commit comments

Comments
 (0)