Skip to content

Add coreml quant recipes #13265

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 3 commits into
base: gh/abhinaykukkadapu/4/head
Choose a base branch
from
Open

Add coreml quant recipes #13265

wants to merge 3 commits into from
+748 −183

Conversation

abhinaykukkadapu
Copy link
Contributor

@abhinaykukkadapu abhinaykukkadapu commented Aug 10, 2025 •
edited
Loading

Adds coreml quant recipes after FP32/16 recipes added in #13121

Recipes added:

  1. INT8_STATIC
  2. INT8_WEIGHT_ONLY
  3. INT4_WEIGHT_ONLY_PER_CHANNEL
  4. INT4_WEIGHT_ONLY_PER_GROUP
  5. INT8_WEIGHT_ONLY_PER_CHANNEL
  6. INT8_WEIGHT_ONLY_PER_GROUP
  7. CODEBOOK_WEIGHT_ONLY

@abhinaykukkadapu
Update
ebc30b2 
[ghstack-poisoned]
@abhinaykukkadapu
Copy link
Contributor Author

abhinaykukkadapu commented Aug 10, 2025 •
edited
Loading

Stack from ghstack (oldest at bottom):

@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Aug 10, 2025 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/13265

Note: Links to docs will display an error until the docs builds have been completed.

❌ 4 New Failures, 2 Unrelated Failures

As of commit 1137ee9 with merge base 0c1acb3 (image):

NEW FAILURES - The following jobs have failed:

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Aug 10, 2025
abhinaykukkadapu added a commit that referenced this pull request Aug 10, 2025
@abhinaykukkadapu
Add coreml quant recipes
bf7413d 
ghstack-source-id: 1bb73e0
ghstack-comment-id: 3172341606
Pull-Request: #13265
@abhinaykukkadapu abhinaykukkadapu mentioned this pull request Aug 10, 2025
Open
@abhinaykukkadapu
Update
1207a46 
[ghstack-poisoned]
abhinaykukkadapu added a commit that referenced this pull request Aug 10, 2025
@abhinaykukkadapu
Add coreml quant recipes
801d78a 
ghstack-source-id: 76f6fc8
ghstack-comment-id: 3172341606
Pull-Request: #13265
@abhinaykukkadapu abhinaykukkadapu requested review from kimishpatel and metascroy and removed request for shoumikhin, cccclai and mcr229 August 10, 2025 03:52
abhinaykukkadapu
abhinaykukkadapu commented Aug 10, 2025
View reviewed changes
backends/apple/coreml/recipes/coreml_recipe_provider.py
"""Build PT2E-based quantization recipe"""
from executorch.backends.apple.coreml.quantizer import CoreMLQuantizer

minimum_deployment_target = kwargs.get("minimum_deployment_target", None)
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@metascroy i could only get pt2e to work with ios17 and codebook ios18

abhinaykukkadapu added a commit that referenced this pull request Aug 10, 2025
@abhinaykukkadapu
Add coreml quant recipes
c0c32b6 
ghstack-source-id: 76f6fc8
ghstack-comment-id: 3172341606
Pull-Request: #13265
@abhinaykukkadapu
Update
1137ee9 
[ghstack-poisoned]
abhinaykukkadapu added a commit that referenced this pull request Aug 10, 2025
@abhinaykukkadapu
Add coreml quant recipes
7f79b99 
ghstack-source-id: d147f71
ghstack-comment-id: 3172341606
Pull-Request: #13265
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@digantdesai digantdesai Awaiting requested review from digantdesai digantdesai is a code owner

@kimishpatel kimishpatel Awaiting requested review from kimishpatel

@metascroy metascroy Awaiting requested review from metascroy

Assignees
No one assigned
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@abhinaykukkadapu