Skip to content

Commit fba8cfb

Browse files
committed
Update on "Add preprocess to ci"
1. Run `test_preprocess.py` in ci. 2. Refactor `test_preprocess.py` by creating the model artifacts (eager, exported, et) once and re-use them on different inputs (previously, create model artifacts for each test). Test Plan: ``` pytest -c /dev/null -v -n auto examples/models/llama3_2_vision/preprocess/ ``` [ghstack-poisoned]
1 parent 499bc67 commit fba8cfb

File tree

1 file changed

+0
-28
lines changed

1 file changed

+0
-28
lines changed

.github/workflows/pull.yml

Lines changed: 0 additions & 28 deletions
Original file line numberDiff line numberDiff line change
@@ -231,34 +231,6 @@ jobs:
231231
# run e2e (export, tokenizer and runner)
232232
PYTHON_EXECUTABLE=python bash .ci/scripts/test_llava.sh
233233
234-
test-preprocess-linux:
235-
name: test-preprocess-linux
236-
uses: pytorch/test-infra/.github/workflows/linux_job.yml@main
237-
strategy:
238-
fail-fast: false
239-
with:
240-
runner: linux.24xlarge
241-
docker-image: executorch-ubuntu-22.04-clang12
242-
submodules: 'true'
243-
ref: ${{ github.event_name == 'pull_request' && github.event.pull_request.head.sha || github.sha }}
244-
timeout: 90
245-
script: |
246-
# The generic Linux job chooses to use base env, not the one setup by the image
247-
CONDA_ENV=$(conda env list --json | jq -r ".envs | .[-1]")
248-
conda activate "${CONDA_ENV}"
249-
250-
PYTHON_EXECUTABLE=python bash .ci/scripts/setup-linux.sh "cmake"
251-
252-
# install pybind
253-
bash install_requirements.sh --pybind xnnpack
254-
255-
# install preprocess requirements
256-
bash examples/models/llama3_2_vision/install_requirements.sh
257-
258-
# run python unittest
259-
pytest -c /dev/null -v -n auto examples/models/llama3_2_vision/preprocess/
260-
261-
262234
test-quantized-aot-lib-linux:
263235
name: test-quantized-aot-lib-linux
264236
uses: pytorch/test-infra/.github/workflows/linux_job.yml@main

0 commit comments

Comments
 (0)