Skip to content

Conversation

@martinlsm
Copy link
Collaborator

@martinlsm martinlsm commented Apr 23, 2025

Add unit test that runs the DeiT-Tiny model on the TOSA-MI profile. The output performance is not great at the moment. An internal ticket has been created to debug this problem later.

Test plan

Command used to test the patch:
python -m pytest -s -c /dev/null --log-level=DEBUG "backends/arm/test/models/test_deit_tiny_arm.py"

cc @digantdesai @freddan80 @per @zingo @oscarandersson8218

@pytorch-bot
Copy link

pytorch-bot bot commented Apr 23, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/10391

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 New Failure

As of commit e1aa856 with merge base 7409fd4 (image):

NEW FAILURE - The following job has failed:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Apr 23, 2025
@martinlsm
Copy link
Collaborator Author

@pytorchbot label ciflow/trunk

@martinlsm
Copy link
Collaborator Author

@pytorchbot label "partner: arm"

@pytorch-bot pytorch-bot bot added the partner: arm For backend delegation, kernels, demo, etc. from the 3rd-party partner, Arm label Apr 23, 2025
@martinlsm
Copy link
Collaborator Author

@pytorchbot label "topic: not user facing"

@oscarandersson8218
Copy link
Collaborator

@martinlsm We may need to increase atol or mark the test as flaky?

Add unit test that runs the DeiT-Tiny model on the TOSA-MI profile. The
output performance is not great at the moment. An internal ticket has
been created to debug this problem later.

Change-Id: I5987a57937146a742deeab4e75c72b31a96f1068
@martinlsm martinlsm force-pushed the marlin-deit-tiny-mi branch from 7285c34 to e1aa856 Compare April 24, 2025 13:25
@martinlsm
Copy link
Collaborator Author

martinlsm commented Apr 24, 2025

@martinlsm We may need to increase atol or mark the test as flaky?

I increased it a little bit now. Hopefully enough.

@zingo
Copy link
Collaborator

zingo commented Apr 24, 2025

Lintrunner unrelated

@zingo zingo merged commit 5805786 into pytorch:main Apr 24, 2025
323 of 327 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ciflow/trunk CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. partner: arm For backend delegation, kernels, demo, etc. from the 3rd-party partner, Arm topic: not user facing

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants