Skip to content

[CPU][FP8] Support FP8 SDPA for CPU backend #2689

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

Valentine233
Copy link
Collaborator

Description:

  1. Reuse the schema of qscaled_dot_product, and extend the FP8 dtype.
  2. Support the fused attention and fallback math kernels for FP8 SDPA.
  3. Support the pattern match for FP8 SDPA.

Copy link

pytorch-bot bot commented Aug 5, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/ao/2689

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

✅ No Failures

As of commit 123fd8c with merge base 2e361d7 (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Aug 5, 2025
@Valentine233 Valentine233 marked this pull request as draft August 5, 2025 07:13
@Valentine233 Valentine233 added the topic: not user facing Use this tag if you don't want this PR to show up in release notes label Aug 5, 2025
@Valentine233
Copy link
Collaborator Author

@CaoE @jianan-gu Please help review, thanks~

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. topic: not user facing Use this tag if you don't want this PR to show up in release notes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant