Skip to content

Nightly and release tests on main/release branch #1089

Nightly and release tests on main/release branch

Nightly and release tests on main/release branch #1089

Triggered via schedule September 6, 2025 00:25
Status Failure
Total duration 1h 44m 10s
Artifacts 89

nightly_tests.yml

on: schedule
Matrix: Torch quantization nightly tests
Matrix: Nightly Torch CUDA Tests
PyTorch Compile CUDA tests
26m 16s
PyTorch Compile CUDA tests
Torch tests on big GPU
10m 9s
Torch tests on big GPU
Torch Minimum Version CUDA Tests
14m 59s
Torch Minimum Version CUDA Tests
Torch quantization nightly tests
3m 21s
Torch quantization nightly tests
Setup Torch Pipelines CUDA Slow Tests Matrix
2m 28s
Setup Torch Pipelines CUDA Slow Tests Matrix
Matrix: Nightly Torch Pipelines CUDA Tests
Generate Consolidated Test Report
2m 18s
Generate Consolidated Test Report
Fit to window
Zoom out
Zoom in

Annotations

63 errors
Nightly Torch Pipelines CUDA Tests (alt_diffusion)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (audioldm)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (amused)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (audio_diffusion)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (blip_diffusion)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (bria)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (cogview3)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (audioldm2)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (consistency_models)
Process completed with exit code 1.
Torch tests on big GPU
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (cosmos)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (dance_diffusion)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (cogvideo)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (allegro)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (consisid)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (ddim)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (hunyuandit)
Process completed with exit code 1.
Torch Minimum Version CUDA Tests
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (i2vgen_xl)
Process completed with exit code 5.
Nightly Torch CUDA Tests (models)
Process completed with exit code 1.
Torch quantization nightly tests (gguf, gguf, peft, kernels)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (latent_diffusion)
Process completed with exit code 1.
PyTorch Compile CUDA tests
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (easyanimate)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (kandinsky)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (latent_diffusion_uncond)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (kandinsky3)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (kandinsky2_2)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (musicldm)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (paint_by_example)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (omnigen)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (controlnet)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (ip_adapters)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (score_sde_ve)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (marigold)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (latte)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (skyreels_v2)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (stable_audio)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (shap_e)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (qwenimage)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (stable_diffusion_gligen)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (stable_diffusion_ldm3d)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (stable_diffusion_safe)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (stable_cascade)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (text_to_video_synthesis)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (unclip)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (unidiffuser)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (utils)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (versatile_diffusion)
Process completed with exit code 5.
Nightly Torch Pipelines CUDA Tests (sana)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (vq_diffusion)
Process completed with exit code 5.
Torch quantization nightly tests (torchao, torchao)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (visualcloze)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (wuerstchen)
Process completed with exit code 5.
Torch quantization nightly tests (optimum_quanto, quanto)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (wan)
Process completed with exit code 1.
Torch quantization nightly tests (bitsandbytes, bnb, peft)
Process completed with exit code 1.
Nightly Torch CUDA Tests (lora)
Process completed with exit code 1.
Torch quantization nightly tests (nvidia_modelopt, modelopt)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (stable_diffusion_2)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (pag)
Process completed with exit code 1.
Nightly Torch Pipelines CUDA Tests (stable_diffusion)
Process completed with exit code 1.
Nightly Torch CUDA Tests (single_file)
The self-hosted runner lost communication with the server. Verify the machine is running and has a healthy network connection. Anything in your workflow that terminates the runner process, starves it for CPU/Memory, or blocks its network access can cause this error.

Artifacts

Produced during runtime
Name Size Digest
consolidated_test_report Expired
10.2 KB
sha256:c4e92111a0928f9ab642830261476caf10cdbb8d6f5333efdba55d77851e64db
pipeline_allegro_test_reports Expired
8.01 KB
sha256:d380ed9b408c19665c3d6e47cadb1f14cbcd92736d812a0e653cf73cc9582fa9
pipeline_alt_diffusion_test_reports Expired
1.53 KB
sha256:d7437aee48d27056b26fe8b98f4078db55e71dc757bc946ac0bcdc53af0c8e70
pipeline_amused_test_reports Expired
1.42 KB
sha256:ab47ff6c3e800c227518df64732837fdd8d6670658729464c1e442268f423ea4
pipeline_audio_diffusion_test_reports Expired
1.56 KB
sha256:865bfb88883f23890b5be1df522fb993f636bf34cca9eab54bcb537cb3a84957
pipeline_audioldm2_test_reports Expired
8.69 KB
sha256:5af92a65ba8087e9deb79fbcbbbb5b147ce45272a51cb2a4470ff3a7b58a5530
pipeline_audioldm_test_reports Expired
1.46 KB
sha256:2f52750d029566718e7377c2bcf1d4a4bdd7500f37104d5376dc9b6a7fe9f280
pipeline_aura_flow_test_reports Expired
3.07 KB
sha256:3fc78c9edcbbfff0beaa6328b3722f858c625b21df8234410443e5a57a18b3b1
pipeline_blip_diffusion_test_reports Expired
1.55 KB
sha256:6d3b55e5a8d125cbff562ddb4bf76093caa316f8faa059d4021f130842067a5f
pipeline_bria_test_reports Expired
7.17 KB
sha256:7a122e0d997ad4e1d4678a67bb3b00268c14f3e35a812a33f8c6028f95af29cf
pipeline_chroma_test_reports Expired
3.83 KB
sha256:9b39bbef704b0b6f4e95138c156e8aa28f30dc0f16c74a821d148fbbcb7b8d6f
pipeline_cogvideo_test_reports Expired
11.2 KB
sha256:6398a29167f2c42aed04dadfad6de756c1a4e00bd6c4ba91d67c50da7a304f97
pipeline_cogview3_test_reports Expired
16.3 KB
sha256:6eaaee84f922fffb39faddd65d0ae8ac4fbb6a4d0d1704393053d1e993dcbd4f
pipeline_cogview4_test_reports Expired
3.74 KB
sha256:cbca94dc744710c1f8d7d6e25c27c69471206886bfb48beddc4480c58b54253e
pipeline_consisid_test_reports Expired
7.64 KB
sha256:f726d64da854144fa1fe5769f3ab293e992b2093434e891e1e2bce852ced15d9
pipeline_consistency_models_test_reports Expired
6.2 KB
sha256:24b123e96d0db33e26095dfd5e0804e8a523200f4c6e857a024a4dd9a25ca081
pipeline_controlnet_flux_test_reports Expired
5.45 KB
sha256:14cac7bc2b84d883c0f46d95ce5222fbf981c9b2bccfc6be48637c47ba99f985
pipeline_controlnet_sd3_test_reports Expired
3.86 KB
sha256:80e509e215ec4d7f27baf7dd4ca3e6c7e546398087ce9aec2d9776c2b002fdb3
pipeline_controlnet_test_reports Expired
14.3 KB
sha256:f39c3a2b469482fc7e05563f34a786287f7ea42d8a7c33f2bd4f81f4a0a988cc
pipeline_cosmos_test_reports Expired
48.9 KB
sha256:f27a37ea3c68607036642433da38d083ce019b2f2cf6b68cbbf8eae651fafa99
pipeline_dance_diffusion_test_reports Expired
1.56 KB
sha256:3dbd28a427d8dc1418b1042b67ded463430b56ba064f7ca352c287ed373cd10a
pipeline_ddim_test_reports Expired
4.93 KB
sha256:d2730354c581f71b548c955a47cf13168a87e40f78cdaf8a2a9cfc5b6ae1a5b1
pipeline_ddpm_test_reports Expired
1.85 KB
sha256:0bd13ff20d94a3b402bd8e8bf390221124872e3de5b1f2cf689c3f6527f3b8a3
pipeline_deepfloyd_if_test_reports Expired
5.56 KB
sha256:408672ffa3c820ad3b7d137d2c174c08ff04afbbfe04305e6d3527a3940c5ded
pipeline_dit_test_reports Expired
3.12 KB
sha256:485d96ccc40524d69d3c0d184aee9f3b688368fe7909452255a1836c54a9cb6f
pipeline_easyanimate_test_reports Expired
6.25 KB
sha256:8c15ec6d35bcdb9ab930c4682eb90cbc4eb54bee10ab90ca288c04c01a1196a9
pipeline_flux_test_reports Expired
6.85 KB
sha256:01918363bd336ba8f963140985f482679649bc6ae1fdd9af8e270e88a11cd5a1
pipeline_hidream_image_test_reports Expired
3.89 KB
sha256:dc2fdb30e25afe977b9856fdc19fcc705fa889f695247fdceaf1157e87b42565
pipeline_hunyuan_video_test_reports Expired
5.29 KB
sha256:7cdc65fdde61d333d49b8b6b5bfa9d79574e00697a9a12ce80e1669a66d191ae
pipeline_hunyuandit_test_reports Expired
16.2 KB
sha256:07ac4e2ed0f91361761167240d33e1c43374ade2ce6d38661a4378cdfeea89ef
pipeline_i2vgen_xl_test_reports Expired
1.47 KB
sha256:a7478778dd3e544347aad96675ce38b3c2fb077bd463a20416e38e7f220d7dfc
pipeline_ip_adapters_test_reports Expired
5.69 KB
sha256:438dff0f3f88a5908d0ed39edfe196f9eccbe966eb1458476a3131018022668b
pipeline_kandinsky2_2_test_reports Expired
21.4 KB
sha256:5b187b740e4691b4abcb0cfde4af3423181bb96b17c317984605dbe335eeec23
pipeline_kandinsky3_test_reports Expired
8.79 KB
sha256:9d6b5497ad35e64a332020b1c0af7438b66b6d7c36fbba9228beadd640eb6d5c
pipeline_kandinsky_test_reports Expired
18.6 KB
sha256:3cf492a16b3772a07a843a0d0b27cbf0af799349774e9c70b86cf2af64cfb9a8
pipeline_kolors_test_reports Expired
3.78 KB
sha256:98e01800d3fc4c7c22b468d2939ca87b2062059b7cfb9c4038974d9f47547419
pipeline_latent_consistency_models_test_reports Expired
4.87 KB
sha256:f05011572644a5ea995101c92be8cc4fa4ae00ef131578675dfed14eeb1faed0
pipeline_latent_diffusion_test_reports Expired
5.55 KB
sha256:dcbe1b604b87f6eb5db4e114b04195da0df283dae8bc041f81885c2439d289c8
pipeline_latent_diffusion_uncond_test_reports Expired
1.69 KB
sha256:e1b5520dd9e3e7cfa4caab6cdc966c712fe59d33388656b62e7198e1679fad17
pipeline_latte_test_reports Expired
4.96 KB
sha256:aca0198affef945cf09235ad9577145225fa91696b4fadaae1045e4c6e5cc78b
pipeline_ltx_test_reports Expired
5.26 KB
sha256:9fb4610933a27a1359f168bc0aa6c666556ebecbf93d7a7e60b50a81376a8272
pipeline_lumina2_test_reports Expired
3.03 KB
sha256:8f396dd372f716dd44620cba8fc47d5733c54a85409937c8081f7025f1ec071d
pipeline_marigold_test_reports Expired
7.7 KB
sha256:88889c4b06bb33c15ce0d43751ed8e50fd91ee63e0b7e4754f222869d9af64c0
pipeline_mochi_test_reports Expired
3.95 KB
sha256:87e0deb0ccf18d7f3157fb05b1f8d8556a45be58d7cca18d81ee8e2e5ae4eea4
pipeline_musicldm_test_reports Expired
1.46 KB
sha256:bbb221419b524d0e9def95a78f5ffecb7a09f8243ef0dc44eb8639065223a1bc
pipeline_omnigen_test_reports Expired
6.96 KB
sha256:2245551048120b12685e3267bc4a796a5fbffd20b0365e9ad3dc4f606968e6c6
pipeline_pag_test_reports Expired
26.2 KB
sha256:da1bceafce2fcb052a9a480b9faf6cc1a95a6c383beb7571be51f863e400a35f
pipeline_paint_by_example_test_reports Expired
1.58 KB
sha256:ae42824e807b2f918e3484a2fc06a51fef3c47ffc386068d938e515c1f5b6032
pipeline_pixart_alpha_test_reports Expired
3.75 KB
sha256:99357ae4ec914714cdbb7d0a345781b723db5f4a27372b04ad2cc2cf4c432815
pipeline_pndm_test_reports Expired
1.82 KB
sha256:20919e3bce9e170b3848d936cf38b757c8a7be4f65a7a2ff135983285a22798c
pipeline_qwenimage_test_reports Expired
10.8 KB
sha256:7b3a1ac40f104e657d8b2a01a01aa20aa36bb05c2557427e6fefb5df377d07b4
pipeline_sana_test_reports Expired
6.96 KB
sha256:f40d2c3409aa35dc5afc1ae9590a34b479f0ff0639388b1b41a5a03c44ad57e3
pipeline_score_sde_ve_test_reports Expired
1.52 KB
sha256:8b739dd246261d7ae3e1b940362417e66bf9341a3260a4aaa7b6901500d37d10
pipeline_shap_e_test_reports Expired
5.74 KB
sha256:e22682db589d6c81f532d05864458ca8d879f132756042ad8261c13f907c45f5
pipeline_skyreels_v2_test_reports Expired
7.47 KB
sha256:9c91058463dc2dad94fcd6fa5aac8df49ca0b0f363f291c1f56bdc29a8a3a5f3
pipeline_stable_audio_test_reports Expired
6.16 KB
sha256:3cb53ebb76f5cea7eff6035249dfa5daa45add0e6a58be14de01578345b4cd9a
pipeline_stable_cascade_test_reports Expired
17.3 KB
sha256:0a86f5c82c647a860c0ba826b9094537b9cfe4ce2caaae7bc71612b46b13dcfb
pipeline_stable_diffusion_2_test_reports Expired
16.5 KB
sha256:dec943819e4bad533876f358d1413349bf5540020f356165fc9c80650024a8b2
pipeline_stable_diffusion_3_test_reports Expired
4.67 KB
sha256:ddb0780bc5b9e1175e4cf3c4071c9b744a6d1be058af45820cbf88e11304a744
pipeline_stable_diffusion_gligen_test_reports Expired
1.69 KB
sha256:8318683f2bda01cef3e7dc328660a625d6641125f9213cce06338c9d104b951b
pipeline_stable_diffusion_ldm3d_test_reports Expired
1.67 KB
sha256:a2567d9e1e064044600dcc9129776f2786c0658ec3c8a03c6442c148843366d4
pipeline_stable_diffusion_safe_test_reports Expired
1.66 KB
sha256:3063de6693b480ab54b5b16ff6339d97a3b3704ce788fcdf09df2aa101cd6d9c
pipeline_stable_diffusion_test_reports Expired
14.2 KB
sha256:3e1356fc44ac63d3a6df20e16afe3d608789c2a69e9f8f9508ac31d0c1b82003
pipeline_stable_diffusion_xl_test_reports Expired
8.79 KB
sha256:2cfa10a3a099956c1a32e00c4f3a743d5d661790b512e894d0fc826be2e517a4
pipeline_stable_video_diffusion_test_reports Expired
3.84 KB
sha256:0d882a7f13dc11e12776dc257cda9a3afc09af0f72efcd4163a064fc1df508c1
pipeline_text_to_video_synthesis_test_reports Expired
1.69 KB
sha256:678428b95db3d22236b24e9096476658f6a3a177d0baff3420ad6f13deed40c8
pipeline_unclip_test_reports Expired
1.42 KB
sha256:98160c35cff594f02d9f803e42d5b1e15fb5603d445cf347a259d4b235150ca6
pipeline_unidiffuser_test_reports Expired
1.5 KB
sha256:4126601700f9bc6626d1f3134b2b254d22e6dd52b8ae624ba2c1e49e67f0c4b6
pipeline_utils_test_reports Expired
1.41 KB
sha256:7353190c3b6bee635f215d8609ea46c122c5207524275529cd7f242a8745ccf9
pipeline_versatile_diffusion_test_reports Expired
1.63 KB
sha256:8ca6b5c1ffc18a3bbd251468cdf739cbb469173cc19a0eaeeb68ee7cfbfd48c7
pipeline_visualcloze_test_reports Expired
10.1 KB
sha256:e6a592a468eeacd1fc9c0442ed7518bd9941a5977c5b45fef23bcd03041791f4
pipeline_vq_diffusion_test_reports Expired
1.52 KB
sha256:8a0cea236baefb97e27f3cc5b392834067e15fc0b74555432253d4b3bb2b4a10
pipeline_wan_test_reports Expired
8.2 KB
sha256:923e537840c9a3a2b2fab6b50a7244e3f049d45b2d6306d17f66a0ef2ef2c6da
pipeline_wuerstchen_test_reports Expired
1.49 KB
sha256:66c1f0210537aca1dce1cdccc9f191c6196a8e7a4d2db499ce13585dd43b36dc
test-pipelines.json Expired
584 Bytes
sha256:40275c0f4514c43f437082f59a043d3d735e51c282768d28da52170c9c49107a
torch_compile_test_reports Expired
21 KB
sha256:01922ead35ab3f4c30c6e8b7549361ac0fb907cd3d90723e5ba6b5c52b6a25ca
torch_cuda_big_gpu_test_reports Expired
2.53 KB
sha256:f9ccdee6bcfbee3d4a5d9775abd0be3d2a3dad6c6a0e1df58f0a43b638f2a1a3
torch_cuda_bitsandbytes_reports Expired
15.3 KB
sha256:f05973f2e59564dc488217f99c1b6029e80e30d78e2b92c88e1be3ced2120022
torch_cuda_gguf_reports Expired
9.6 KB
sha256:e49d839ace60462514ec82482404e881ed2702230c88e262881d3378f1f8003b
torch_cuda_nvidia_modelopt_reports Expired
2.52 KB
sha256:a95555fabc7c1519f5a671f06a0211be377afa3061b71e68b070ed7f8feea924
torch_cuda_optimum_quanto_reports Expired
15.7 KB
sha256:99a2e71da2462f1dd652f27cf1092dfff101c8afcda25d1bd9f95cf94b19b59d
torch_cuda_pipeline_level_quant_reports Expired
3.55 KB
sha256:db4467fe2aa1371281af7fc39e207f32ffc591ccbee932fb17b5d4d7c5ffc96c
torch_cuda_torchao_reports Expired
14.8 KB
sha256:c607c6d0e7a42e4620c5cb1b50276ecf2b9702a7fdac22541a5fb30fe150fb19
torch_examples_cuda_test_reports Expired
4.66 KB
sha256:631cbfdc352f9fc2c813367724f8b8ed7fba417ef7eea8da0e8b0cbce5d0e478
torch_lora_cuda_test_reports Expired
15.7 KB
sha256:89c0380fa302237d4ab78333a6b193bd334fb04d9f3122e3afabb4c267411731
torch_minimum_version_cuda_test_reports Expired
16.9 KB
sha256:2f00ab17091ececd4b0650f53b85733378f5f63f45233d776ae399df5ee8f10e
torch_models_cuda_test_reports Expired
37.5 KB
sha256:068c7f7c65df383767bac2284c03b8f70fd1fc218388b3cac851a67421d36e43
torch_others_cuda_test_reports Expired
4.22 KB
sha256:367cfd0040c446acd6019490ac34c31419d608dae872fe2e49fecf36d1d26900
torch_schedulers_cuda_test_reports Expired
10.4 KB
sha256:9831184c36753e9a9622be7dc44938053945dfb797a1a527050016a6a85c67c6