A770 CI is timing out after several hours

[alexbaden]

The tests on A770 CI are timing out after 5+ hours. The failures appear to be related to recently added mxfp/scaled_dot tests.

2025-04-02T00:46:28.2125909Z [gw9] [ 83%] PASSED language/test_mxfp.py::TestMXFP4Tensor::test_roundtrip[64-128] 
2025-04-02T00:46:28.2172047Z language/test_mxfp.py::TestMXFP4Tensor::test_roundtrip[128-256] 
2025-04-02T00:46:28.2177417Z [gw9] [ 83%] PASSED language/test_mxfp.py::TestMXFP4Tensor::test_roundtrip[128-256] 
2025-04-02T00:46:28.2177809Z language/test_mxfp.py::TestMXFP4Tensor::test_packed_tensor[64-128-0] 
2025-04-02T00:46:28.2178219Z [gw9] [ 83%] PASSED language/test_mxfp.py::TestMXFP4Tensor::test_packed_tensor[64-128-0] 
2025-04-02T00:46:28.2183865Z language/test_mxfp.py::TestMXFP4Tensor::test_packed_tensor[64-128-1] 
2025-04-02T00:46:28.2189466Z [gw9] [ 83%] PASSED language/test_mxfp.py::TestMXFP4Tensor::test_packed_tensor[64-128-1] 
2025-04-02T00:46:28.2268489Z language/test_mxfp.py::TestMXFP4Tensor::test_padding 
2025-04-02T00:46:28.2273992Z [gw9] [ 83%] PASSED language/test_mxfp.py::TestMXFP4Tensor::test_padding 
2025-04-02T00:46:28.2345226Z language/test_mxfp.py::TestMXFP4Tensor::test_zero_values 
2025-04-02T00:46:28.2347085Z [gw9] [ 83%] PASSED language/test_mxfp.py::TestMXFP4Tensor::test_zero_values 
2025-04-02T00:46:28.2404407Z language/test_mxfp.py::TestMXFP4Tensor::test_out_of_range_values 
2025-04-02T00:46:28.2410500Z [gw9] [ 83%] PASSED language/test_mxfp.py::TestMXFP4Tensor::test_out_of_range_values 
2025-04-02T00:46:28.2471944Z language/test_mxfp.py::TestMXFP4Tensor::test_subnormal_numbers 
2025-04-02T00:46:28.2478344Z [gw9] [ 83%] PASSED language/test_mxfp.py::TestMXFP4Tensor::test_subnormal_numbers 
2025-04-02T00:46:28.2541177Z language/test_mxfp.py::TestMXFP4Tensor::test_rounding_edge_cases 
2025-04-02T00:46:28.2545330Z [gw9] [ 83%] PASSED language/test_mxfp.py::TestMXFP4Tensor::test_rounding_edge_cases 
2025-04-02T00:46:28.2603290Z language/test_mxfp.py::TestMXFP4Tensor::test_negative_values 
2025-04-02T00:46:28.2611305Z [gw9] [ 83%] PASSED language/test_mxfp.py::TestMXFP4Tensor::test_negative_values 
2025-04-02T00:46:28.2674351Z language/test_mxfp.py::TestMXFP4Tensor::test_negative_out_of_range 
2025-04-02T00:46:28.2678580Z [gw9] [ 83%] PASSED language/test_mxfp.py::TestMXFP4Tensor::test_negative_out_of_range 
2025-04-02T00:46:28.2687468Z language/test_mxfp.py::TestMXFP4Tensor::test_packing[shape0-0] 
2025-04-02T00:46:28.2693143Z [gw9] [ 83%] PASSED language/test_mxfp.py::TestMXFP4Tensor::test_packing[shape0-0] 
2025-04-02T00:46:28.2714263Z language/test_mxfp.py::TestMXFP4Tensor::test_packing[shape1-0] 
2025-04-02T00:46:28.2718110Z [gw9] [ 83%] PASSED language/test_mxfp.py::TestMXFP4Tensor::test_packing[shape1-0] 
2025-04-02T00:46:28.2741327Z language/test_mxfp.py::TestMXFP4Tensor::test_packing[shape2-1] 
2025-04-02T00:46:28.2744587Z [gw9] [ 83%] PASSED language/test_mxfp.py::TestMXFP4Tensor::test_packing[shape2-1] 
2025-04-02T00:46:28.3325006Z language/test_mxfp.py::TestMXFP4Tensor::test_packing[shape3-2] 
2025-04-02T00:46:28.3350421Z [gw9] [ 83%] PASSED language/test_mxfp.py::TestMXFP4Tensor::test_packing[shape3-2] 
2025-04-02T00:46:28.3361875Z language/test_mxfp.py::TestMXFP4Tensor::test_packing_with_padding 
2025-04-02T00:46:28.3369208Z [gw9] [ 83%] PASSED language/test_mxfp.py::TestMXFP4Tensor::test_packing_with_padding 
2025-04-02T00:46:28.3369978Z language/test_mxfp.py::TestMXFP4Tensor::test_invalid_packing_dimension 
2025-04-02T00:46:28.3370423Z [gw9] [ 83%] PASSED language/test_mxfp.py::TestMXFP4Tensor::test_invalid_packing_dimension 
2025-04-02T00:46:28.3370829Z language/test_mxfp.py::TestMXFP4Tensor::test_empty_tensor 
2025-04-02T00:46:28.3374058Z [gw9] [ 83%] PASSED language/test_mxfp.py::TestMXFP4Tensor::test_empty_tensor 
2025-04-02T00:46:28.3566036Z language/test_mxfp.py::TestMXScaleTensor::test_positive_values 
2025-04-02T00:46:28.3570554Z [gw9] [ 83%] PASSED language/test_mxfp.py::TestMXScaleTensor::test_positive_values 
2025-04-02T00:46:28.3579667Z language/test_mxfp.py::TestMXScaleTensor::test_special_values 
2025-04-02T00:46:28.3584923Z [gw9] [ 83%] PASSED language/test_mxfp.py::TestMXScaleTensor::test_special_values 
2025-04-02T00:46:28.3593176Z language/test_mxfp.py::TestMXScaleTensor::test_e8m0_nan_to_float_nan 
2025-04-02T00:46:28.3597680Z [gw9] [ 83%] PASSED language/test_mxfp.py::TestMXScaleTensor::test_e8m0_nan_to_float_nan 
2025-04-02T00:46:28.3609523Z language/test_mxfp.py::TestMXScaleTensor::test_random_generation 
2025-04-02T00:46:28.3614505Z [gw9] [ 83%] PASSED language/test_mxfp.py::TestMXScaleTensor::test_random_generation 
2025-04-02T00:46:28.3757897Z language/test_mxfp.py::TestMXScaleTensor::test_roundtrip[64-128] 
2025-04-02T00:46:28.3758474Z [gw9] [ 83%] PASSED language/test_mxfp.py::TestMXScaleTensor::test_roundtrip[64-128] 
2025-04-02T00:46:28.3784567Z language/test_mxfp.py::TestMXScaleTensor::test_roundtrip[128-256] 
2025-04-02T00:46:28.3786843Z [gw9] [ 83%] PASSED language/test_mxfp.py::TestMXScaleTensor::test_roundtrip[128-256] 
2025-04-02T00:46:29.2190134Z language/test_pipeliner.py::test_pipeline_matmul[True] 
2025-04-02T00:46:29.2236929Z [gw2] [ 83%] FAILED language/test_core.py::test_scaled_dot[64-32-128-True-False-False-e4m3-bf16-4-16-1] 
2025-04-02T00:46:39.3255801Z language/test_core.py::test_scaled_dot[64-32-128-True-False-False-e4m3-fp16-4-16-1] 
2025-04-02T00:46:39.3487657Z [gw7] [ 83%] FAILED language/test_core.py::test_dot[1-128-128-64-2-True-False-none-tf32-float16-float16-1-None0] 
2025-04-02T00:46:39.5185774Z language/test_core.py::test_dot[1-128-128-64-2-True-False-none-tf32-float16-float16-1-None1] 
2025-04-02T00:46:39.5412836Z [gw7] [ 83%] FAILED language/test_core.py::test_dot[1-128-128-64-2-True-False-none-tf32-float16-float16-1-None1] 
2025-04-02T00:46:41.5734880Z language/test_core.py::test_dot[1-128-128-64-2-True-False-none-tf32-float16-float32-1-None0] 
2025-04-02T00:46:41.5820945Z [gw2] [ 83%] FAILED language/test_core.py::test_scaled_dot[64-32-128-True-False-False-e4m3-fp16-4-16-1] 
2025-04-02T00:46:49.3263329Z language/test_core.py::test_scaled_dot[64-32-128-True-False-False-e5m2-e4m3-4-16-1] 
2025-04-02T00:46:49.3273759Z [gw0] [ 83%] FAILED language/test_core.py::test_scaled_dot[32-64-128-False-False-False-e2m1-e5m2-4-16-1] 
2025-04-02T00:46:55.1115844Z language/test_core.py::test_scaled_dot[32-64-128-False-False-False-e2m1-bf16-4-16-1] 
2025-04-02T00:46:55.1173653Z [gw2] [ 83%] FAILED language/test_core.py::test_scaled_dot[64-32-128-True-False-False-e5m2-e4m3-4-16-1] 
2025-04-02T00:46:56.0486653Z language/test_core.py::test_scaled_dot[64-32-128-True-False-False-e5m2-e5m2-4-16-1] 
2025-04-02T00:46:56.0599715Z [gw3] [ 83%] FAILED language/test_core.py::test_scaled_dot[64-64-128-True-True-True-e4m3-bf16-4-16-1] 
2025-04-02T00:47:00.9496762Z language/test_core.py::test_scaled_dot[64-64-128-True-True-True-e4m3-fp16-4-16-1] 
2025-04-02T00:47:00.9507398Z [gw8] [ 83%] FAILED language/test_core.py::test_scaled_dot[32-128-128-True-False-False-e2m1-e4m3-4-16-1] 
2025-04-02T00:47:08.0838235Z language/test_core.py::test_scaled_dot[32-128-128-True-False-False-e2m1-e5m2-4-16-1] 
2025-04-02T00:47:08.0923648Z [gw2] [ 83%] FAILED language/test_core.py::test_scaled_dot[64-32-128-True-False-False-e5m2-e5m2-4-16-1] 
2025-04-02T00:47:14.8609106Z language/test_core.py::test_scaled_dot[64-32-128-True-False-False-e5m2-bf16-4-16-1] 
2025-04-02T00:47:14.8852541Z [gw7] [ 83%] FAILED language/test_core.py::test_dot[1-128-128-64-2-True-False-none-tf32-float16-float32-1-None0] 
2025-04-02T00:47:15.0810343Z language/test_core.py::test_dot[1-128-128-64-2-True-False-none-tf32-float16-float32-1-None1] 
2025-04-02T00:47:15.1041030Z [gw7] [ 83%] FAILED language/test_core.py::test_dot[1-128-128-64-2-True-False-none-tf32-float16-float32-1-None1] 
2025-04-02T00:47:18.3712244Z language/test_core.py::test_dot[1-128-128-64-2-True-False-none-tf32-float32-float32-1-None0] 
2025-04-02T00:47:18.3724306Z [gw0] [ 83%] FAILED language/test_core.py::test_scaled_dot[32-64-128-False-False-False-e2m1-bf16-4-16-1] 
2025-04-02T00:47:20.8528309Z language/test_core.py::test_scaled_dot[32-64-128-False-False-False-e2m1-fp16-4-16-1] 
2025-04-02T00:47:20.8618349Z [gw2] [ 83%] FAILED language/test_core.py::test_scaled_dot[64-32-128-True-False-False-e5m2-bf16-4-16-1] 
2025-04-02T00:47:23.5122066Z language/test_core.py::test_scaled_dot[64-32-128-True-False-False-e5m2-fp16-4-16-1] 
2025-04-02T00:47:23.5261897Z [gw3] [ 83%] FAILED language/test_core.py::test_scaled_dot[64-64-128-True-True-True-e4m3-fp16-4-16-1] 
2025-04-02T00:47:25.6734714Z language/test_core.py::test_scaled_dot[64-64-128-True-True-True-e5m2-e4m3-4-16-1] 
2025-04-02T00:47:25.6737429Z [gw0] [ 83%] PASSED language/test_core.py::test_scaled_dot[32-64-128-False-False-False-e2m1-fp16-4-16-1] 
2025-04-02T00:47:30.2401890Z language/test_core.py::test_scaled_dot[32-64-128-False-False-False-e4m3-e4m3-4-16-1] 
2025-04-02T00:47:30.2450895Z [gw0] [ 83%] FAILED language/test_core.py::test_scaled_dot[32-64-128-False-False-False-e4m3-e4m3-4-16-1] 
2025-04-02T00:47:32.3944296Z language/test_core.py::test_scaled_dot[32-64-128-False-False-False-e4m3-e5m2-4-16-1] 
2025-04-02T00:47:32.4025300Z [gw2] [ 83%] FAILED language/test_core.py::test_scaled_dot[64-32-128-True-False-False-e5m2-fp16-4-16-1] 
2025-04-02T00:47:34.5272181Z language/test_core.py::test_scaled_dot[64-32-128-True-False-True-e2m1-e4m3-4-16-1] 
2025-04-02T00:47:34.5299008Z [gw0] [ 83%] FAILED language/test_core.py::test_scaled_dot[32-64-128-False-False-False-e4m3-e5m2-4-16-1] 
2025-04-02T00:47:38.3061781Z language/test_core.py::test_scaled_dot[32-64-128-False-False-False-e4m3-bf16-4-16-1] 
2025-04-02T00:47:38.3104188Z [gw0] [ 83%] FAILED language/test_core.py::test_scaled_dot[32-64-128-False-False-False-e4m3-bf16-4-16-1] 
2025-04-02T00:47:41.3276055Z language/test_core.py::test_scaled_dot[32-64-128-False-False-False-e4m3-fp16-4-16-1] 
2025-04-02T00:47:41.3319612Z [gw0] [ 83%] FAILED language/test_core.py::test_scaled_dot[32-64-128-False-False-False-e4m3-fp16-4-16-1] 
2025-04-02T00:47:45.1473175Z language/test_core.py::test_scaled_dot[32-64-128-False-False-False-e5m2-e4m3-4-16-1] 
2025-04-02T00:47:45.1577107Z [gw2] [ 83%] FAILED language/test_core.py::test_scaled_dot[64-32-128-True-False-True-e2m1-e4m3-4-16-1] 
2025-04-02T00:47:45.7064040Z language/test_core.py::test_scaled_dot[64-32-128-True-False-True-e2m1-e5m2-4-16-1] 
2025-04-02T00:47:45.7113740Z [gw0] [ 83%] FAILED language/test_core.py::test_scaled_dot[32-64-128-False-False-False-e5m2-e4m3-4-16-1] 
2025-04-02T00:47:46.5749188Z language/test_core.py::test_scaled_dot[32-64-128-False-False-False-e5m2-e5m2-4-16-1] 
2025-04-02T00:47:46.5986461Z [gw7] [ 83%] FAILED language/test_core.py::test_dot[1-128-128-64-2-True-False-none-tf32-float32-float32-1-None0] 
2025-04-02T00:47:46.8034791Z language/test_core.py::test_dot[1-128-128-64-2-True-False-none-tf32-float32-float32-1-None1] 
2025-04-02T00:47:46.8262925Z [gw7] [ 83%] FAILED language/test_core.py::test_dot[1-128-128-64-2-True-False-none-tf32-float32-float32-1-None1] 
2025-04-02T00:47:48.6916456Z language/test_core.py::test_dot[1-128-128-64-2-False-True-none-tf32-int8-int8-1-None0] 
2025-04-02T00:47:48.6925072Z [gw8] [ 83%] FAILED language/test_core.py::test_scaled_dot[32-128-128-True-False-False-e2m1-e5m2-4-16-1] 
2025-04-02T00:47:49.4630824Z language/test_core.py::test_scaled_dot[32-128-128-True-False-False-e2m1-bf16-4-16-1] 
2025-04-02T00:47:49.4677993Z [gw0] [ 83%] FAILED language/test_core.py::test_scaled_dot[32-64-128-False-False-False-e5m2-e5m2-4-16-1] 
2025-04-02T00:47:53.2389250Z language/test_core.py::test_scaled_dot[32-64-128-False-False-False-e5m2-bf16-4-16-1] 
2025-04-02T00:47:53.2434743Z [gw0] [ 83%] FAILED language/test_core.py::test_scaled_dot[32-64-128-False-False-False-e5m2-bf16-4-16-1] 
2025-04-02T00:47:55.9288237Z language/test_core.py::test_scaled_dot[32-64-128-False-False-False-e5m2-fp16-4-16-1] 
2025-04-02T00:47:55.9331802Z [gw0] [ 83%] FAILED language/test_core.py::test_scaled_dot[32-64-128-False-False-False-e5m2-fp16-4-16-1] 
2025-04-02T00:47:56.2621286Z language/test_core.py::test_scaled_dot[32-64-128-False-False-True-e2m1-e4m3-4-16-1] 
2025-04-02T00:47:56.2781517Z [gw3] [ 83%] FAILED language/test_core.py::test_scaled_dot[64-64-128-True-True-True-e5m2-e4m3-4-16-1] 
2025-04-02T00:47:57.5065770Z language/test_core.py::test_scaled_dot[64-64-128-True-True-True-e5m2-e5m2-4-16-1] 
2025-04-02T00:47:57.5164194Z [gw2] [ 83%] FAILED language/test_core.py::test_scaled_dot[64-32-128-True-False-True-e2m1-e5m2-4-16-1] 
2025-04-02T00:48:01.6901555Z language/test_core.py::test_scaled_dot[64-32-128-True-False-True-e2m1-bf16-4-16-1] 
2025-04-02T00:48:01.6909501Z [gw0] [ 83%] FAILED language/test_core.py::test_scaled_dot[32-64-128-False-False-True-e2m1-e4m3-4-16-1] 
2025-04-02T00:48:07.3920425Z language/test_core.py::test_scaled_dot[32-64-128-False-False-True-e2m1-e5m2-4-16-1] 
2025-04-02T00:48:07.3929059Z [gw0] [ 83%] FAILED language/test_core.py::test_scaled_dot[32-64-128-False-False-True-e2m1-e5m2-4-16-1] 
2025-04-02T00:48:13.1597579Z language/test_core.py::test_scaled_dot[32-64-128-False-False-True-e2m1-bf16-4-16-1] 
2025-04-02T00:48:13.1605930Z [gw0] [ 83%] FAILED language/test_core.py::test_scaled_dot[32-64-128-False-False-True-e2m1-bf16-4-16-1] 
2025-04-02T00:48:14.0946957Z language/test_core.py::test_scaled_dot[32-64-128-False-False-True-e2m1-fp16-4-16-1] 
2025-04-02T00:48:14.0955660Z [gw2] [ 83%] FAILED language/test_core.py::test_scaled_dot[64-32-128-True-False-True-e2m1-bf16-4-16-1] 
2025-04-02T00:48:17.1219120Z language/test_core.py::test_scaled_dot[64-32-128-True-False-True-e2m1-fp16-4-16-1] 
2025-04-02T00:48:17.1220531Z [gw0] [ 83%] PASSED language/test_core.py::test_scaled_dot[32-64-128-False-False-True-e2m1-fp16-4-16-1] 
2025-04-02T00:48:21.5217953Z language/test_core.py::test_scaled_dot[32-64-128-False-False-True-e4m3-e4m3-4-16-1] 
2025-04-02T00:48:21.5427296Z [gw7] [ 83%] FAILED language/test_core.py::test_dot[1-128-128-64-2-False-True-none-tf32-int8-int8-1-None0] 
2025-04-02T00:48:21.6965997Z language/test_core.py::test_dot[1-128-128-64-2-False-True-none-tf32-int8-int8-1-None1] 
2025-04-02T00:48:21.7151051Z [gw7] [ 83%] FAILED language/test_core.py::test_dot[1-128-128-64-2-False-True-none-tf32-int8-int8-1-None1] 
2025-04-02T00:48:23.2639073Z language/test_core.py::test_dot[1-128-128-64-2-False-True-none-tf32-float16-float16-1-None0] 
2025-04-02T00:48:23.2654010Z [gw0] [ 83%] FAILED language/test_core.py::test_scaled_dot[32-64-128-False-False-True-e4m3-e4m3-4-16-1] 
2025-04-02T00:48:27.9144977Z language/test_core.py::test_scaled_dot[32-64-128-False-False-True-e4m3-e5m2-4-16-1] 
2025-04-02T00:48:27.9296486Z [gw3] [ 83%] FAILED language/test_core.py::test_scaled_dot[64-64-128-True-True-True-e5m2-e5m2-4-16-1] 
2025-04-02T00:48:28.3762413Z language/test_core.py::test_scaled_dot[64-64-128-True-True-True-e5m2-bf16-4-16-1] 
2025-04-02T00:48:28.3770660Z [gw2] [ 83%] PASSED language/test_core.py::test_scaled_dot[64-32-128-True-False-True-e2m1-fp16-4-16-1] 
2025-04-02T00:48:29.3169271Z language/test_core.py::test_scaled_dot[64-32-128-True-False-True-e4m3-e4m3-4-16-1] 
2025-04-02T00:48:29.3177620Z [gw0] [ 83%] FAILED language/test_core.py::test_scaled_dot[32-64-128-False-False-True-e4m3-e5m2-4-16-1] 
2025-04-02T00:48:30.3572536Z language/test_core.py::test_scaled_dot[32-64-128-False-False-True-e4m3-bf16-4-16-1] 
2025-04-02T00:48:30.3583269Z [gw8] [ 83%] FAILED language/test_core.py::test_scaled_dot[32-128-128-True-False-False-e2m1-bf16-4-16-1] 
2025-04-02T00:48:31.1796767Z language/test_core.py::test_scaled_dot[32-128-128-True-False-False-e2m1-fp16-4-16-1] 
2025-04-02T00:48:31.1944573Z [gw7] [ 83%] FAILED language/test_core.py::test_dot[1-128-128-64-2-False-True-none-tf32-float16-float16-1-None0] 
2025-04-02T00:48:31.4075628Z language/test_core.py::test_dot[1-128-128-64-2-False-True-none-tf32-float16-float16-1-None1] 
2025-04-02T00:48:31.4240119Z [gw7] [ 84%] FAILED language/test_core.py::test_dot[1-128-128-64-2-False-True-none-tf32-float16-float16-1-None1] 
2025-04-02T00:48:34.7887906Z language/test_core.py::test_dot[1-128-128-64-2-False-True-none-tf32-float16-float32-1-None0] 
2025-04-02T00:48:34.7896305Z [gw0] [ 84%] FAILED language/test_core.py::test_scaled_dot[32-64-128-False-False-True-e4m3-bf16-4-16-1] 
2025-04-02T00:48:39.3575820Z language/test_core.py::test_scaled_dot[32-64-128-False-False-True-e4m3-fp16-4-16-1] 
2025-04-02T00:48:39.3583583Z [gw0] [ 84%] PASSED language/test_core.py::test_scaled_dot[32-64-128-False-False-True-e4m3-fp16-4-16-1] 
2025-04-02T00:48:40.8553789Z language/test_core.py::test_scaled_dot[32-64-128-False-False-True-e5m2-e4m3-4-16-1] 
2025-04-02T00:48:40.8640749Z [gw2] [ 84%] FAILED language/test_core.py::test_scaled_dot[64-32-128-True-False-True-e4m3-e4m3-4-16-1] 
2025-04-02T00:48:44.9212638Z language/test_core.py::test_scaled_dot[64-32-128-True-False-True-e4m3-e5m2-4-16-1] 
2025-04-02T00:48:44.9369105Z [gw7] [ 84%] FAILED language/test_core.py::test_dot[1-128-128-64-2-False-True-none-tf32-float16-float32-1-None0] 
2025-04-02T00:48:45.2599330Z language/test_core.py::test_dot[1-128-128-64-2-False-True-none-tf32-float16-float32-1-None1] 
2025-04-02T00:48:45.2758798Z [gw7] [ 84%] FAILED language/test_core.py::test_dot[1-128-128-64-2-False-True-none-tf32-float16-float32-1-None1] 
2025-04-02T00:48:45.3596694Z language/test_core.py::test_dot[1-128-128-64-2-False-True-none-tf32-float32-float32-1-None0] 
2025-04-02T00:48:45.3608611Z [gw0] [ 84%] FAILED language/test_core.py::test_scaled_dot[32-64-128-False-False-True-e5m2-e4m3-4-16-1] 
2025-04-02T00:48:50.8151577Z language/test_core.py::test_scaled_dot[32-64-128-False-False-True-e5m2-e5m2-4-16-1] 
2025-04-02T00:48:50.8160742Z [gw0] [ 84%] FAILED language/test_core.py::test_scaled_dot[32-64-128-False-False-True-e5m2-e5m2-4-16-1] 
2025-04-02T00:48:53.4658244Z language/test_core.py::test_scaled_dot[32-64-128-False-False-True-e5m2-bf16-4-16-1] 
2025-04-02T00:48:53.4744252Z [gw2] [ 84%] FAILED language/test_core.py::test_scaled_dot[64-32-128-True-False-True-e4m3-e5m2-4-16-1] 
2025-04-02T00:48:56.4506097Z language/test_core.py::test_scaled_dot[64-32-128-True-False-True-e4m3-bf16-4-16-1] 
2025-04-02T00:48:56.4515696Z [gw0] [ 84%] FAILED language/test_core.py::test_scaled_dot[32-64-128-False-False-True-e5m2-bf16-4-16-1] 
2025-04-02T00:48:58.3396427Z language/test_core.py::test_scaled_dot[32-64-128-False-False-True-e5m2-fp16-4-16-1] 
2025-04-02T00:48:58.3553811Z [gw7] [ 84%] FAILED language/test_core.py::test_dot[1-128-128-64-2-False-True-none-tf32-float32-float32-1-None0] 
2025-04-02T00:48:58.5377129Z language/test_core.py::test_dot[1-128-128-64-2-False-True-none-tf32-float32-float32-1-None1] 
2025-04-02T00:48:58.5532743Z [gw7] [ 84%] FAILED language/test_core.py::test_dot[1-128-128-64-2-False-True-none-tf32-float32-float32-1-None1] 
2025-04-02T00:48:59.2567296Z language/test_core.py::test_dot[1-128-128-64-2-False-False-none-tf32-int8-int8-1-None0] 
2025-04-02T00:48:59.2714112Z [gw3] [ 84%] FAILED language/test_core.py::test_scaled_dot[64-64-128-True-True-True-e5m2-bf16-4-16-1] 
2025-04-02T00:49:00.3885323Z language/test_core.py::test_scaled_dot[64-64-128-True-True-True-e5m2-fp16-4-16-1] 
2025-04-02T00:49:00.3889279Z [gw0] [ 84%] PASSED language/test_core.py::test_scaled_dot[32-64-128-False-False-True-e5m2-fp16-4-16-1] 
2025-04-02T00:49:04.7308836Z Fatal Python error: Segmentation fault

[pbchekin]

After increasing the workflow timeout to 12h we have a green run:
https://github.com/intel/intel-xpu-backend-for-triton/actions/runs/14290556556

[anmyachev]

After increasing the workflow timeout to 12h we have a green run: https://github.com/intel/intel-xpu-backend-for-triton/actions/runs/14290556556

This is very long, which will make it difficult to work with this GPU (and with GPUs that use A770 skiplist, for example: ARL). Let's just skip the whole test.