Skip to content

Conversation

@Marlon154
Copy link
Contributor

What does this PR do?

This PR adds the new FluxSemanticGuidancePipeline to enable semantic guidance (original paper) capabilities in the Flux model family. Works like already existing semantic guidance pipelines.
Example on usage is in the doc string, it works with:

  • FLUX adapters
  • Multiple images per prompt
  • Multiple prompts
  • CFG with negative prompt
  • Without CFG

Examples

Prompt Original Edit Edited
A cat holding a sign that says hello world Original remove "cat", add "dog" Edited
race car on a track image-original-2 add "black sports car" image-edit-2
A sports car under a tree. (with adapter) adapter_orginal add "apple tree", add "dog sitting on the right side of a car" adapter_edit

Before submitting

Who can review?

@linoytsaban

@linoytsaban linoytsaban self-assigned this Jan 20, 2025
@Marlon154 Marlon154 force-pushed the sega-flux-community branch from 8e42936 to a5892d7 Compare January 20, 2025 12:22
Copy link
Collaborator

@linoytsaban linoytsaban left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

great work, thanks @Marlon154!

@linoytsaban linoytsaban requested a review from hlky January 21, 2025 11:04
Copy link
Contributor

@hlky hlky left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

@Marlon154
Copy link
Contributor Author

@hlky implemented requested changes

@linoytsaban linoytsaban requested a review from hlky January 27, 2025 08:50
Copy link
Contributor

@hlky hlky left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for making the changes @Marlon154

@HuggingFaceDocBuilderDev

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@linoytsaban linoytsaban merged commit f7f36c7 into huggingface:main Jan 27, 2025
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants