Skip to content

[Backend Tester] Add portable test flow #13250

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 5 commits into
base: gh/GregoryComer/112/head
Choose a base branch
from

Conversation

GregoryComer
Copy link
Member

@GregoryComer GregoryComer commented Aug 8, 2025

Add a portable tester flow to the backend tester. This is mainly intended to help validate the test suite and to get baseline numbers to compare against delegated results.

[ghstack-poisoned]
Copy link

pytorch-bot bot commented Aug 8, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/13250

Note: Links to docs will display an error until the docs builds have been completed.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Aug 8, 2025
GregoryComer added a commit that referenced this pull request Aug 8, 2025
ghstack-source-id: d8c5133
ghstack-comment-id: 3169541265
Pull-Request: #13250
@GregoryComer GregoryComer marked this pull request as ready for review August 9, 2025 00:00
@GregoryComer GregoryComer requested a review from cccclai as a code owner August 9, 2025 00:00
@GregoryComer GregoryComer added the release notes: none Do not include this in the release notes label Aug 9, 2025
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
Copy link
Contributor

@digantdesai digantdesai left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is good.

@manuelcandales is planning to add a way to run through torch.nn.Module for Portable library testing (w/ Facto). This PR wants me to up the discussion we had @GregoryComer about using Facto here. And more generally make it possible to leverage Facto for backend hardening, which may require some changes in Facto, as @manuelcandales and I also discussed.

Can we align on this? And also on the long term direction?

Stamping this PR so you are not blocked Gregory but let's sync.

[ghstack-poisoned]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. release notes: none Do not include this in the release notes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants