Skip to content

Commit a89fa14

Browse files
committed
Disable gemma accuracy tests
1 parent e6c3c9f commit a89fa14

File tree

1 file changed

+0
-12
lines changed

1 file changed

+0
-12
lines changed

.github/workflows/perf-bench-matrix.json

Lines changed: 0 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -338,18 +338,6 @@
338338
"pytest": "benchmark/tt-xla/test_llms.py::test_qwen_2_5_7b",
339339
"accuracy-testing": true
340340
},
341-
{
342-
"name": "google_gemma-1.1-2b-it_accuracy",
343-
"pyreq": "datasets loguru pytest requests tabulate timm torch==2.9.0 tqdm transformers==4.57.1",
344-
"pytest": "benchmark/tt-xla/test_llms.py::test_gemma_1_1_2b",
345-
"accuracy-testing": true
346-
},
347-
{
348-
"name": "google_gemma-2-2b-it_accuracy",
349-
"pyreq": "datasets loguru pytest requests tabulate timm torch==2.9.0 tqdm transformers==4.57.1",
350-
"pytest": "benchmark/tt-xla/test_llms.py::test_gemma_2_2b",
351-
"accuracy-testing": true
352-
},
353341
{
354342
"name": "microsoft_phi-1_accuracy",
355343
"pyreq": "datasets loguru pytest requests torch==2.9.0 tqdm transformers==4.57.1",

0 commit comments

Comments
 (0)