Skip to content

Commit 0d0b14a

Browse files
huydhnfacebook-github-bot
authored andcommitted
Clean up LlamaDemo test on AWS (#5340)
Summary: After #5240, as the test spec becomes more catered toward Minibench, it doesn't work with LlamaDemo anymore because of the different model path and is currently failing in trunk https://hud.pytorch.org/hud/pytorch/executorch/main/1?per_page=50&name_filter=test-llama-app. I think this job has outlived its usefulness and can be cleaned up. We already have android-perf workflow in its place. guangy10 has already cleaned it up once before, but we have kept it around till the benchmark workflow grows a bit more. Pull Request resolved: #5340 Reviewed By: kirklandsign Differential Revision: D62624109 Pulled By: huydhn fbshipit-source-id: 26e09f965ce0f61cba13a5cbc75acccc67376920
1 parent 07e15a9 commit 0d0b14a

File tree

1 file changed

+0
-26
lines changed

1 file changed

+0
-26
lines changed

.github/workflows/android.yml

Lines changed: 0 additions & 26 deletions
Original file line numberDiff line numberDiff line change
@@ -141,29 +141,3 @@ jobs:
141141
emulator-options: -no-snapshot-save -no-window -gpu swiftshader_indirect -noaudio -no-boot-anim -camera-back none
142142
# This is to make sure that the job doesn't fail flakily
143143
emulator-boot-timeout: 900
144-
145-
# Let's see how expensive this job is, we might want to tone it down by running it periodically
146-
test-llama-app:
147-
# Only PR from ExecuTorch itself has permission to access AWS, forked PRs will fail to
148-
# authenticate with the cloud service
149-
if: ${{ !github.event.pull_request.head.repo.fork }}
150-
needs: upload-artifacts
151-
permissions:
152-
id-token: write
153-
contents: read
154-
uses: pytorch/test-infra/.github/workflows/mobile_job.yml@main
155-
with:
156-
device-type: android
157-
runner: linux.2xlarge
158-
test-infra-ref: ''
159-
# This is the ARN of ExecuTorch project on AWS
160-
project-arn: arn:aws:devicefarm:us-west-2:308535385114:project:02a2cf0f-6d9b-45ee-ba1a-a086587469e6
161-
# This is the custom Android device pool that only includes Samsung Galaxy S2x
162-
device-pool-arn: arn:aws:devicefarm:us-west-2:308535385114:devicepool:02a2cf0f-6d9b-45ee-ba1a-a086587469e6/e59f866a-30aa-4aa1-87b7-4510e5820dfa
163-
# Uploaded to S3 from the previous job, the name of the app comes from the project itself
164-
android-app-archive: https://gha-artifacts.s3.amazonaws.com/${{ github.repository }}/${{ github.run_id }}/artifact/llm_demo/app-debug.apk
165-
android-test-archive: https://gha-artifacts.s3.amazonaws.com/${{ github.repository }}/${{ github.run_id }}/artifact/llm_demo/app-debug-androidTest.apk
166-
test-spec: https://ossci-android.s3.amazonaws.com/executorch/android-llm-device-farm-test-spec.yml
167-
# Among the input, this is the biggest file, so it is cached on AWS to make the test faster. Note that the file is deleted by AWS after 30
168-
# days and the job will automatically re-upload the file when that happens.
169-
extra-data: https://ossci-assets.s3.amazonaws.com/executorch-android-llama2-7b-0717.zip

0 commit comments

Comments
 (0)