Skip to content
Nightly and release tests on main/release branch

Nightly and release tests on main/release branch #1107

Sign in to view logs

Nightly and release tests on main/release branch

Nightly and release tests on main/release branch #1107

Triggered via schedule September 24, 2025 00:26
@anton-lanton-l
⁠ a72bc0c
main
Status Failure
Total duration 1h 44m 1s
Artifacts 93

nightly_tests.yml

on: schedule
Matrix: Torch quantization nightly tests
Matrix: Nightly Torch CUDA Tests
PyTorch Compile CUDA tests
27m 47s
PyTorch Compile CUDA tests
Torch tests on big GPU
9m 41s
Torch tests on big GPU
Torch Minimum Version CUDA Tests
15m 23s
Torch Minimum Version CUDA Tests
Torch quantization nightly tests
3m 4s
Torch quantization nightly tests
Setup Torch Pipelines CUDA Slow Tests Matrix
2m 55s
Setup Torch Pipelines CUDA Slow Tests Matrix
Matrix: Nightly Torch Pipelines CUDA Tests
Generate Consolidated Test Report
2m 37s
Generate Consolidated Test Report
Fit to window
Zoom out
Zoom in

Annotations

69 errors
Nightly Torch Pipelines CUDA Tests (alt_diffusion)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (audioldm)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (audioldm2)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (audio_diffusion)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (amused)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (bria)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (cogview3)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (blip_diffusion)
Process completed with exit code 5.
Torch tests on big GPU
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (consistency_models)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (allegro)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (dance_diffusion)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (animatediff)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (consisid)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (ddim)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (cosmos)
Process completed with exit code 1.
Torch Minimum Version CUDA Tests
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (i2vgen_xl)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (hunyuandit)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (cogvideo)
Process completed with exit code 1.
Nightly Torch CUDA Tests (models)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (hunyuan_video)
Process completed with exit code 1.
Torch quantization nightly tests (gguf, gguf, peft, kernels)
Process completed with exit code 1.
PyTorch Compile CUDA tests
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (easyanimate)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (kandinsky)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (kandinsky3)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (latent_diffusion_uncond)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (kandinsky2_2)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (latent_diffusion)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (lucy)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (deepfloyd_if)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (musicldm)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (paint_by_example)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (omnigen)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (ip_adapters)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (score_sde_ve)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (controlnet)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (latte)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (marigold)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (skyreels_v2)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (shap_e)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (stable_audio)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (stable_cascade)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (stable_diffusion_gligen)
Process completed with exit code 5.
Torch quantization nightly tests (torchao, torchao)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (stable_diffusion_ldm3d)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (stable_diffusion_safe)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (stable_diffusion_sag)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (qwenimage)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (t2i_adapter)
Process completed with exit code 5.
Torch quantization nightly tests (optimum_quanto, quanto)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (text_to_video_synthesis)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (sana)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (unclip)
Process completed with exit code 5.
Torch quantization nightly tests (bitsandbytes, bnb, peft)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (unidiffuser)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (utils)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (versatile_diffusion)
Process completed with exit code 5.
Nightly Torch CUDA Tests (lora)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (vq_diffusion)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (wuerstchen)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (visualcloze)
Process completed with exit code 1.
Torch quantization nightly tests (nvidia_modelopt, modelopt)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (wan)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (stable_diffusion_2)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (pag)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (stable_diffusion)
Process completed with exit code 1.
Nightly Torch CUDA Tests (single_file)
The self-hosted runner lost communication with the server. Verify the machine is running and has a healthy network connection. Anything in your workflow that terminates the runner process, starves it for CPU/Memory, or blocks its network access can cause this error.

Artifacts

Produced during runtime
Name Size Digest
consolidated_test_report
12.4 KB
sha256:831d04e0691d89416c2acab66d4345ed9e181784696987b4e41f6f3beb1a0606
pipeline_allegro_test_reports
8.05 KB
sha256:153a1c3224a9e6f96670b11d0d3460fe1c129516bd3a573104cb02d219c133a4
pipeline_alt_diffusion_test_reports
1.53 KB
sha256:bdc692e6783a9e182c50a40311bc527231afc1525370814d3b59febb501b020a
pipeline_amused_test_reports
1.42 KB
sha256:88c7a715d66bc8e84dbb17776645a2c230189d3b5a545ba30603a6a4f61b40a0
pipeline_animatediff_test_reports
15.7 KB
sha256:12be4c0a4385171c30c055343971ec07cd216a60eff280fb7baefbb0921cd9ed
pipeline_audio_diffusion_test_reports
1.56 KB
sha256:af8c6e302f30b990eb9d2e1ddf7477a6be1b61920a483d9d67ada3fa46a7cf11
pipeline_audioldm2_test_reports
9.82 KB
sha256:a0605fb0f419e4116419a2f94ed37338e27f4a0dbe8049cc1d5e8cc0b060aa11
pipeline_audioldm_test_reports
1.46 KB
sha256:8474fa46266fefa4cd13dc36687c7a5c720f4924cb7e597e80429b61c80c34d6
pipeline_aura_flow_test_reports
3.1 KB
sha256:f21d609c9ebbd52f5c0792ce6fdbf8c7e1d3ad63c2779012e055edc1436f7616
pipeline_blip_diffusion_test_reports
1.55 KB
sha256:0063d13988aec81bd9409370bdf8094b9c9997d353e470e939c704bdcac9e508
pipeline_bria_test_reports
7.21 KB
sha256:a218e37156c593fc59f2789f621e4abebb2afc1a29c8bf3ef4323d18f86b9874
pipeline_chroma_test_reports
3.92 KB
sha256:f3169c2e4a70f5ed55f9a27f5277e3f78725ff62c6110dbc6654bfd51b5ae708
pipeline_cogvideo_test_reports
11.3 KB
sha256:9b2e80b2ded6d583ecae4b505089291d474d3260230486d4e63dbe090f02de6e
pipeline_cogview3_test_reports
16.3 KB
sha256:c839c7282f87c3dc79d56cc23a9d9f37de8f85e0687888b36037774b76532599
pipeline_cogview4_test_reports
3.79 KB
sha256:46b2efb33fa51c0b4ad89b86c16d8247712b2564e0b00d4bdb11bdf3223922d1
pipeline_consisid_test_reports
7.7 KB
sha256:8aa3a7d09ea7f4bf668467263ae3a2448739176dcc30a0737bdb0bf0e19d1f8b
pipeline_consistency_models_test_reports
6.22 KB
sha256:e4fd3623b46f57ed5464815f21cf62d399983ca1634a3623fccc3b0ce96d9025
pipeline_controlnet_flux_test_reports
5.55 KB
sha256:4610664ae8483205bfbe057e1f4cf3aa057392aa04cc74a4a2e6ff4735889fb2
pipeline_controlnet_sd3_test_reports
3.93 KB
sha256:0b957a819a3a562bfefbab15e133ef587384231756c2ea77fcc23fe8c247cc69
pipeline_controlnet_test_reports
14.6 KB
sha256:73533cdbf9185a1d9ec5f42a01308d82fde211f6c654e60a42f719d74832ee8e
pipeline_cosmos_test_reports
53.4 KB
sha256:00545808f9ddd40b9f54c7ebaf0071f6e9aec22e27d800d912ecbb627ee7f758
pipeline_dance_diffusion_test_reports
1.56 KB
sha256:8360ebf7ea659f65eef223e8f43f59221ef33e25b3cd68ee28505858d072e044
pipeline_ddim_test_reports
4.97 KB
sha256:7338c3788f02c63ca22e1ede5246b5b326e905a930657962f8e7396bf88714c7
pipeline_ddpm_test_reports
1.85 KB
sha256:8f45218ea0c5e5aaf840d152f69738098daa1dd817eed8234faa85d913ad7696
pipeline_deepfloyd_if_test_reports
7.47 KB
sha256:7852e078ef43cc6a8928a3a9677dcf6bd5fc2bbcc929505f281d1cd468e380dd
pipeline_dit_test_reports
3.17 KB
sha256:5132fa435b36f82b34151f58506efe06d452bdc0458deb70606b86bfa0937b19
pipeline_easyanimate_test_reports
6.3 KB
sha256:898827eb54551de2765617c803e4da8e0f33acb85eb70fe855cfa157264b0ad4
pipeline_flux_test_reports
7.02 KB
sha256:4cb3336310b1d4d174679474e06533d816bb5780416496bd63e4fda58673fe3f
pipeline_hidream_image_test_reports
3.93 KB
sha256:4286fb059869c5bd83faf282788084335512e6443ec5cd59b72baab1d5d6b035
pipeline_hunyuan_video_test_reports
16.2 KB
sha256:b6e44ad89c77f7860e503390e7ea1a348465b3c482ff35a45e8c2187a4e707ac
pipeline_hunyuandit_test_reports
16.3 KB
sha256:d3753a31f7a6b45b4990bf97dac6a9795348867a2a760eae7e7e6a3bd2f23836
pipeline_i2vgen_xl_test_reports
1.47 KB
sha256:f5dc58e073d78f8b676ed5372fc94f331d244a4c6732a043f993fa8f8dafd237
pipeline_ip_adapters_test_reports
5.69 KB
sha256:401f84ff1b0ff9146b311cb33e221e2b8db737111020165acb292609a25e0a04
pipeline_kandinsky2_2_test_reports
23.1 KB
sha256:97e5a9fb661e095b8e512696c018f4a2ffec1c2bf5caff23cc77aec9883f4b21
pipeline_kandinsky3_test_reports
8.88 KB
sha256:298a777df450b6252f98be1a96a5b383254e0f28665fbd2b03c9541f10b1cd47
pipeline_kandinsky_test_reports
20.4 KB
sha256:d6cf6515107c6174396376b6dc1b78682d02f30c6bb46e342f8ff168768c14bc
pipeline_kolors_test_reports
3.87 KB
sha256:899b5c480295ce063ba234781ad3464ae94b6f4e42105a03983d7bca1d42d143
pipeline_latent_consistency_models_test_reports
4.93 KB
sha256:5cb90b6d2d42d82037e865bfc2f52cbcf383e01790cc023155cbda2022895e3e
pipeline_latent_diffusion_test_reports
5.58 KB
sha256:38ee66667b2a2d7741ae456c12a6b6af9fc3d41771e23e2615753b8668354d5d
pipeline_latent_diffusion_uncond_test_reports
1.69 KB
sha256:682d1a8280808c310b543bcd4829a78e066a93b26a86653afb323b9e1ac88f4d
pipeline_latte_test_reports
4.99 KB
sha256:96ddbf0d3492fb5bcaa195c323cde88f5535c22ff98ca165852a1049dbf3c0ca
pipeline_ltx_test_reports
5.36 KB
sha256:13c8a13011a8e68d653da5fb5befd671e99c58da9d5f8c5d31d99307224270a8
pipeline_lucy_test_reports
1.39 KB
sha256:458ae2de2ec38277e314129a11e1ced5253c5bee3efc7ce421319782091b7b20
pipeline_lumina2_test_reports
3.09 KB
sha256:98e37a78fbb2d8813f0635dd03b8828f37c4d6862c3466bf39e239b3195cf375
pipeline_marigold_test_reports
7.98 KB
sha256:a9cc91820fdba3cc1ebd8c4680a5d35c7c55b55fd62780afe44201db300972cd
pipeline_mochi_test_reports
3.99 KB
sha256:780155222cee2ffd42fac68d109e19ba50e8251144a248672a04ebffab5ed621
pipeline_musicldm_test_reports
1.46 KB
sha256:e2e21a71de28ed5e8b026bec556eec6bb0d0cda70afb5b728f9e0bfaeff51eb8
pipeline_omnigen_test_reports
6.99 KB
sha256:26ae99856cf755906767dc46f6ba5f9953affe4db9d960f3d8831ad1bd47ae95
pipeline_pag_test_reports
26.9 KB
sha256:26c2c317c8073154607683b7545653a4963265d0b04c88dcd042024cfb48e48b
pipeline_paint_by_example_test_reports
1.58 KB
sha256:61834c17305f0ec17cc598647bd65f1c286eb4eea6b5002d26382e07305d3c38
pipeline_pixart_alpha_test_reports
3.78 KB
sha256:8088b45b948ee952cbb545c90ab3fae8ec8f94b9b4b74fdb74cdd3bdb0b5038e
pipeline_pndm_test_reports
1.82 KB
sha256:b49961aafedaa7df32cf41690028201e78bfafc4d1b9b08a627500652c1fbf27
pipeline_qwenimage_test_reports
9.77 KB
sha256:59763b65669c48dbd238e902d7267d724e2881be3eb1e8e1324ddf0c705ed8fc
pipeline_sana_test_reports
7.04 KB
sha256:3fc8e3cdf3fce28475d664b93c8e17ab5b157082cd1821f245a831991373374c
pipeline_score_sde_ve_test_reports
1.52 KB
sha256:851b12e31fb1fd65110cbdabe8862b7b2f04412a02aaec930b9820cc68c87eda
pipeline_shap_e_test_reports
5.79 KB
sha256:e1fc9f42abaa290cb4e21c579c278fa64032cc74a99b9f161028753d19a4500c
pipeline_skyreels_v2_test_reports
7.59 KB
sha256:d219357c3bc6f34f895ad47b699135dc67ef37faf6c469b30f5e21e81b40e8d2
pipeline_stable_audio_test_reports
6.22 KB
sha256:20f1e8d026da826441306df8e77c1ea149bfa09466fb8d385ec4468daf136305
pipeline_stable_cascade_test_reports
17.3 KB
sha256:ad01cae711190387ee3c16159e26adf92f16a75f44f855385d007722521f8be8
pipeline_stable_diffusion_2_test_reports
16.7 KB
sha256:b99650c603504080a125381ff2c0e41bbf59fd0c5985f6998bb8557cb8fe1d2d
pipeline_stable_diffusion_3_test_reports
4.77 KB
sha256:845b8ffec7dfb6ed06518574ddd94bbbcf93276dc0f3e060905cb100ac185db1
pipeline_stable_diffusion_gligen_test_reports
1.69 KB
sha256:274dbddd7eeb275fa8d8ed782492d96bab9c321e373b0d9caf44c4828c7a53fc
pipeline_stable_diffusion_ldm3d_test_reports
1.67 KB
sha256:6d50bd02f22c01830c0445fdf2342eb9216e95f4f98ca7ef83b9e92af90930cc
pipeline_stable_diffusion_safe_test_reports
1.66 KB
sha256:14e8c97b949d1bf47db382fe6a0c116a5d359ec745e9b65d957298049585bc06
pipeline_stable_diffusion_sag_test_reports
1.64 KB
sha256:d82ca47c2b4ec237c08d8e43e91073d1ae8d50781237c3e842329d2207e5fba2
pipeline_stable_diffusion_test_reports
14.5 KB
sha256:510e9f8650bc9f43a15723c537927c553a318e6f1c1e369e4e368c17a83de570
pipeline_stable_diffusion_xl_test_reports
9.1 KB
sha256:b32c238d092fafe4f28191d8faeb58c6503718d784eb3aec481b99f6dfae1387
pipeline_stable_video_diffusion_test_reports
3.88 KB
sha256:c945272135db2380b33fac1c8925c66784284e383431451ac4de7218973851f3
pipeline_t2i_adapter_test_reports
1.5 KB
sha256:1d94aaf6f5f9f4744b5ab21b9032174b8d08fc516673db83f9bfa448d18c74dc
pipeline_text_to_video_synthesis_test_reports
1.69 KB
sha256:291d3267979053ac2cef54810f3151933e96a2986912c9c1a0ad738c238dee69
pipeline_unclip_test_reports
1.42 KB
sha256:14dd5319852800d4de364d87a9083020cdabd014de29023e7949052832fd9ad5
pipeline_unidiffuser_test_reports
1.5 KB
sha256:39fa601e1af2dd9a0df0767038f532f961327762176fb6d67fa95778209c8e6c
pipeline_utils_test_reports
1.41 KB
sha256:0244ecde6f12ef9c989c1a94cf2be313fd6236889e7f5c1610ac0ff7d77a7092
pipeline_versatile_diffusion_test_reports
1.63 KB
sha256:c81c7b861f772ffde6c260144c5e2db9552390b15c1b15fc0fbb29b9b13015a9
pipeline_visualcloze_test_reports
10.2 KB
sha256:6811caf613aaabebb1f24f517aea3c7f888e4ae1d32ea8975cdb4c34d89b715a
pipeline_vq_diffusion_test_reports
1.52 KB
sha256:c3b754b75e4cdb6804a37d8a0da5d3da47bc51350f621116a7531334e54751cc
pipeline_wan_test_reports
8.41 KB
sha256:e5032ea129b295aeed522700f3cc5b01618ac03c7d7d19ac1121b9e13e131e77
pipeline_wuerstchen_test_reports
1.49 KB
sha256:a6b827b831796a8003c8850a137090d6898e3fc529f8077391bb0c8c810bc19a
test-pipelines.json
601 Bytes
sha256:a9a49fb5632559e36039a55ca37f36703b07c29504624c32e5407e123a9405ea
torch_compile_test_reports
21 KB
sha256:ec38affa6f2b62f889c8991ddb7188e630baeacc10e9e07b863b7f0e64e50f8b
torch_cuda_big_gpu_test_reports
2.53 KB
sha256:03415d016530482ad96193ffe4f1d0f95d175e3b4adf26a73cbc727a9fd22041
torch_cuda_bitsandbytes_reports
15.4 KB
sha256:c1fe94130dc5f86ad4693d36b2c501041b2b7dc2391904456a41f3c5cf7e3f15
torch_cuda_gguf_reports
11.6 KB
sha256:d8ad37aabbaa3b428a06bccc874e57bea9fb2de478937edef6a28e641dc9e3ad
torch_cuda_nvidia_modelopt_reports
2.52 KB
sha256:11006769b4d6556c1f0077ac384020478d175c3e348746e5ea304ab53950cfd6
torch_cuda_optimum_quanto_reports
15.7 KB
sha256:5ec84a5e7ebdbab89b7bca81718389c79629a703232aec17b1cbc2612059a830
torch_cuda_pipeline_level_quant_reports
3.59 KB
sha256:b17ced9be47e7136db4f77fdc114a077c563313dd5bcc0be6d38ace58b6b8676
torch_cuda_torchao_reports
16.3 KB
sha256:ffa9cbb921dc82d9124860691c12393d5d9103f839382bb0856225d6695c14cc
torch_examples_cuda_test_reports
4.66 KB
sha256:df4a83a6963654275f0861ccaff4c76230a1dc6cd0be545dfcce77520e050605
torch_lora_cuda_test_reports
15.7 KB
sha256:58e832df14e4272239838db83559c695e2c657cff9746e29a18e625014f3b9d5
torch_minimum_version_cuda_test_reports
16.9 KB
sha256:05b8cc5bfbc7476e7f5791f226839e40392471a7630b91465ad83e5be532fa42
torch_models_cuda_test_reports
69.9 KB
sha256:221c242ffd2e269e54ec33e20a748eb99dde105c030053714080ac34b1e709f2
torch_others_cuda_test_reports
4.19 KB
sha256:0cd9e41e839494c0f049574029264d556db6436b431bca7b184877c1ffcb0177
torch_schedulers_cuda_test_reports
10.4 KB
sha256:5e5eab9327e9deaf42121c591490961ee11cdab48ef602c0430484820a8ac828