-
Notifications
You must be signed in to change notification settings - Fork 729
Fix load time. #5781
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fix load time. #5781
Conversation
Summary: Once loaded Module does nothing next time, we need to recreate the Module again to truly load the method again. Differential Revision: D63678792
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/5781
Note: Links to docs will display an error until the docs builds have been completed. ❌ 3 New FailuresAs of commit 7f35713 with merge base 8079eb7 ( NEW FAILURES - The following jobs have failed:
This comment was automatically generated by Dr. CI and updates every 15 minutes. |
|
This pull request was exported from Phabricator. Differential Revision: D63678792 |
cccclai
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you!
|
This pull request has been merged in 04669a1. |
|
Thank you so much Anthony! With this updated test code I can run the Benchmark app for Llama model on my iPhone16 pro and get the correct model forwarding and loading time! |
|
@pytorchbot cherry-pick --onto release/0.4 -c fixnewfeature |
Summary: Pull Request resolved: #5781 Once loaded Module does nothing next time, we need to recreate the Module again to truly load the method again. Reviewed By: cccclai Differential Revision: D63678792 fbshipit-source-id: 1e8d6a379215e20620b73c05ce7f734e1d0fc5ce (cherry picked from commit 04669a1)
Cherry picking #5781The cherry pick PR is at #5889 and it is recommended to link a fixnewfeature cherry pick PR with an issue. The following tracker issues are updated: Details for Dev Infra teamRaised by workflow job |
Fix load time. (#5781) Summary: Pull Request resolved: #5781 Once loaded Module does nothing next time, we need to recreate the Module again to truly load the method again. Reviewed By: cccclai Differential Revision: D63678792 fbshipit-source-id: 1e8d6a379215e20620b73c05ce7f734e1d0fc5ce (cherry picked from commit 04669a1) Co-authored-by: Anthony Shoumikhin <[email protected]>
Summary: Once loaded Module does nothing next time, we need to recreate the Module again to truly load the method again.
Differential Revision: D63678792