Skip to content

[Backend Tester] Add test flow CLI arg #13360

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 7 commits into
base: gh/GregoryComer/124/head
Choose a base branch
from
Open

[Backend Tester] Add test flow CLI arg #13360

wants to merge 7 commits into from
+8 −0

Conversation

GregoryComer
Copy link
Member

@GregoryComer GregoryComer commented Aug 13, 2025 •
edited
Loading

Add a CLI arg to filter by test flow. We have a backend filter, but this allows for selecting only a quantized flow, for example.

Verified with the following. Only the (unquantized) CoreML flow was run.

python -m executorch.backends.test.suite.runner operators --filter test_add --flow coreml

@GregoryComer
Update
29c1061 
[ghstack-poisoned]
@GregoryComer GregoryComer requested a review from cccclai as a code owner August 13, 2025 03:06
@GregoryComer
Copy link
Member Author

GregoryComer commented Aug 13, 2025 •
edited
Loading

Stack from ghstack (oldest at bottom):

@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Aug 13, 2025 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/13360

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 Cancelled Job, 58 Pending

As of commit 5fc71bd with merge base 33bd456 (image):

CANCELLED JOB - The following job was cancelled. Please retry:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

GregoryComer added a commit that referenced this pull request Aug 13, 2025
@GregoryComer
[Backend Tester] Add test flow CLI arg
9da9ca2 
ghstack-source-id: 2924b77
ghstack-comment-id: 3182028114
Pull-Request: #13360
@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Aug 13, 2025
This was referenced Aug 13, 2025
Merged
Merged
Merged
Merged
Merged
Open
@GregoryComer
Update
765e960 
[ghstack-poisoned]
GregoryComer added a commit that referenced this pull request Aug 13, 2025
@GregoryComer
[Backend Tester] Add test flow CLI arg
cdc0d29 
ghstack-source-id: 623d2c4
ghstack-comment-id: 3182028114
Pull-Request: #13360
@GregoryComer
Update
724e992 
[ghstack-poisoned]
GregoryComer added a commit that referenced this pull request Aug 13, 2025
@GregoryComer
[Backend Tester] Add test flow CLI arg
d6cbe91 
ghstack-source-id: 623d2c4
ghstack-comment-id: 3182028114
Pull-Request: #13360
@GregoryComer
Update
4fd031e 
[ghstack-poisoned]
GregoryComer added a commit that referenced this pull request Aug 13, 2025
@GregoryComer
[Backend Tester] Add test flow CLI arg
d54471d 
ghstack-source-id: 623d2c4
ghstack-comment-id: 3182028114
Pull-Request: #13360
@GregoryComer
Update
0a017d0 
[ghstack-poisoned]
GregoryComer added a commit that referenced this pull request Aug 13, 2025
@GregoryComer
[Backend Tester] Add test flow CLI arg
22ea03b 
ghstack-source-id: 623d2c4
ghstack-comment-id: 3182028114
Pull-Request: #13360
@GregoryComer
Update
b7d4b4e 
[ghstack-poisoned]
GregoryComer added a commit that referenced this pull request Aug 13, 2025
@GregoryComer
[Backend Tester] Add test flow CLI arg
3581aa0 
ghstack-source-id: d6bbfc1
ghstack-comment-id: 3182028114
Pull-Request: #13360
@GregoryComer
Update
5fc71bd 
[ghstack-poisoned]
GregoryComer added a commit that referenced this pull request Aug 13, 2025
@GregoryComer
[Backend Tester] Add test flow CLI arg
9c56097 
ghstack-source-id: 51144cd
ghstack-comment-id: 3182028114
Pull-Request: #13360
@GregoryComer GregoryComer added the release notes: none Do not include this in the release notes label Aug 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@cccclai cccclai Awaiting requested review from cccclai cccclai is a code owner

@digantdesai digantdesai Awaiting requested review from digantdesai

Assignees
No one assigned
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. release notes: none Do not include this in the release notes
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@GregoryComer