Skip to content

Commit e97a8f4

Browse files
committed
Arm backend: Add smaller_stories_llama to test_arm_baremetal
Run it in trunk job Signed-off-by: Erik Lundell <[email protected]> Change-Id: Ia1ba80330c7ff457ff06f1975ecfd01262f58457
1 parent ee936b0 commit e97a8f4

File tree

2 files changed

+26
-0
lines changed

2 files changed

+26
-0
lines changed

.github/workflows/trunk.yml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -234,6 +234,7 @@ jobs:
234234
- test_arm_baremetal: test_models_tosa
235235
- test_arm_baremetal: test_models_ethos-u55
236236
- test_arm_baremetal: test_models_ethos-u85
237+
- test_arm_baremetal: test_smaller_stories_llama
237238
fail-fast: false
238239
with:
239240
runner: linux.2xlarge.memory

backends/arm/test/test_arm_baremetal.sh

Lines changed: 25 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -253,6 +253,31 @@ test_full_ethosu_fvp() { # All End to End model tests
253253
echo "${TEST_SUITE_NAME}: PASS"
254254
}
255255

256+
test_smaller_stories_llama() {
257+
echo "${TEST_SUITE_NAME}: Test smaller_stories_llama"
258+
259+
backends/arm/scripts/build_executorch.sh
260+
261+
mkdir -p stories110M
262+
pushd stories110M
263+
wget -N https://huggingface.co/karpathy/tinyllamas/resolve/main/stories110M.pt
264+
echo '{"dim": 768, "multiple_of": 32, "n_heads": 12, "n_layers": 12, "norm_eps": 1e-05, "vocab_size": 32000}' > params.json
265+
popd
266+
267+
# Get path to source directory
268+
pytest \
269+
-c /dev/null \
270+
--verbose \
271+
--color=yes \
272+
--numprocesses=auto \
273+
--log-level=DEBUG \
274+
--junit-xml=stories110M/test-reports/unittest.xml \
275+
-s \
276+
backends/arm/test/models/test_llama.py \
277+
--llama_inputs stories110M/stories110M.pt stories110M/params.json stories110m
278+
279+
echo "${TEST_SUITE_NAME}: PASS"
280+
}
256281

257282

258283
${TEST_SUITE}

0 commit comments

Comments
 (0)