-
Notifications
You must be signed in to change notification settings - Fork 96
Description
Hi, we are Experiencing an total Hang and Bricking of all our CI-Jobs when to many Jobs what to Finish.
According to the Logs and the built-in OS-Processes out Master tries to Cleanup GlobalClassValues add the End of Pipelines.
The Problem is takes forever to finish the Job, leading to excessive Memory and CPU usage when Java tries to run Cleanup GlobalClassValues, leading to this task blocking all other tasks including getting respones from Build Agents and Proceeding or Finishing with other Pipelines.
This prevents unutilized Resources to be freed and leads to a deadlock.
Originally reported by daniel_kaindlrigler, imported from: cleanUpGlobalClassValue hangs entire Jenkins Server
- assignee: daniel_kaindlrigler
- status: Open
- priority: Blocker
- component(s): durable-task-plugin
- label(s): durability, hanging, plugin
- resolution: Unresolved
- votes: 0
- watchers: 4
- imported: 2025-12-09
Raw content of original issue
Hi, we are Experiencing an total Hang and Bricking of all our CI-Jobs when to many Jobs what to Finish.
According to the Logs and the built-in OS-Processes out Master tries to Cleanup GlobalClassValues add the End of Pipelines.
The Problem is takes forever to finish the Job, leading to excessive Memory and CPU usage when Java tries to run Cleanup GlobalClassValues, leading to this task blocking all other tasks including getting respones from Build Agents and Proceeding or Finishing with other Pipelines.
This prevents unutilized Resources to be freed and leads to a deadlock.
environment
Jenkins: 2.504.1<br/>
OS: Linux - 5.14.0-503.40.1.el9_5.x86_64<br/>
Java: 21.0.7 - Red Hat, Inc. (OpenJDK 64-Bit Server VM)<br/>
---<br/>
active-directory:2.40<br/>
ansicolor:1.0.6<br/>
ant:513.vde9e7b_a_0da_0f<br/>
antisamy-markup-formatter:173.v680e3a_b_69ff3<br/>
apache-httpcomponents-client-4-api:4.5.14-269.vfa_2321039a_83<br/>
artifactory:4.0.8<br/>
artifactory-artifact-manager:222.v721418296a_b_1<br/>
artifactory-client-api:2.19.0-92.v57b_50df9c76f<br/>
asm-api:9.8-135.vb_2239d08ee90<br/>
authentication-tokens:1.131.v7199556c3004<br/>
badge:2.8<br/>
blueocean-autofavorite:1.2.5<br/>
blueocean-commons:1.27.19<br/>
blueocean-config:1.27.19<br/>
blueocean-core-js:1.27.19<br/>
blueocean-dashboard:1.27.19<br/>
blueocean-display-url:2.4.4<br/>
blueocean-events:1.27.19<br/>
blueocean-git-pipeline:1.27.19<br/>
blueocean-i18n:1.27.19<br/>
blueocean-jira:1.27.19<br/>
blueocean-jwt:1.27.19<br/>
blueocean-personalization:1.27.19<br/>
blueocean-pipeline-api-impl:1.27.19<br/>
blueocean-pipeline-editor:1.27.19<br/>
blueocean-pipeline-scm-api:1.27.19<br/>
blueocean-rest:1.27.19<br/>
blueocean-rest-impl:1.27.19<br/>
blueocean-web:1.27.19<br/>
bootstrap5-api:5.3.5-1<br/>
bouncycastle-api:2.30.1.80-256.vf98926042a_9b_<br/>
branch-api:2.1217.v43d8b_b_d8b_2c7<br/>
build-failure-analyzer:2.5.5<br/>
build-monitor-plugin:1.14-985.v7b_f37b_3d0b_f5<br/>
caffeine-api:3.2.0-166.v72a_6d74b_870f<br/>
checks-api:370.vb_61a_c57328f3<br/>
cloudbees-disk-usage-simple:241.v0ea_d9a_a_96ee8<br/>
cloudbees-folder:6.1012.v79a_86a_1ea_c1f<br/>
command-launcher:123.v37cfdc92ef67<br/>
commons-compress-api:1.27.1-3<br/>
commons-lang3-api:3.17.0-87.v5cf526e63b_8b_<br/>
commons-text-api:1.13.0-153.v91dcd89e2a_22<br/>
config-file-provider:988.v0461fcc2b_9d1<br/>
coverage:2.5.0<br/>
credentials:1415.v831096eb_5534<br/>
credentials-binding:687.v619cb_15e923f<br/>
cucumber-reports:5.8.5<br/>
dark-theme:524.vd675b_22b_30cb_<br/>
data-tables-api:2.2.2-1<br/>
dependency-track:6.0.1<br/>
display-url-api:2.209.v582ed814ff2f<br/>
docker-commons:451.vd12c371eeeb_3<br/>
docker-workflow:611.v16e84da_6d3ff<br/>
dtkit-api:3.0.3<br/>
durable-task:587.v84b_877235b_45<br/>
echarts-api:5.6.0-4<br/>
eddsa-api:0.3.0.1-19.vc432d923e5ee<br/>
email-ext:1876.v28d8d38315b_d<br/>
emailext-template:233.v1eb_88fc160b_5<br/>
emoji-symbols-api:16.0-26.v9818ff7423f0<br/>
extended-read-permission:61.vf24570ff3b_e9<br/>
external-monitor-job:223.vb_fddcf42c9b_3<br/>
favorite:2.225.v68765b_b_a_1fa_3<br/>
font-awesome-api:6.7.2-1<br/>
forensics-api:3.1.0<br/>
git:5.7.0<br/>
git-client:6.1.3<br/>
github:1.43.0<br/>
github-api:1.321-488.v9b_c0da_9533f8<br/>
github-branch-source:1815.v9152b_2ff7a_1b_<br/>
gitlab-api:5.6.0-100.v83f8f4b_f1129<br/>
gitlab-branch-source:718.v40b_5f0e67cd3<br/>
gitlab-plugin:1.9.8<br/>
google-oauth-plugin:1.335.ve6de40e2db_18<br/>
gradle:2.15<br/>
gson-api:2.13.1-139.v4569c2ef303f<br/>
handy-uri-templates-2-api:2.1.8-36.v85e4cb_234a_13<br/>
htmlpublisher:425<br/>
http_request:1.20<br/>
instance-identity:203.v15e81a_1b_7a_38<br/>
ionicons-api:88.va_4187cb_eddf1<br/>
ivy:582.v35fb_da_0312f7<br/>
jackson2-api:2.18.3-402.v74c4eb_f122b_2<br/>
jakarta-activation-api:2.1.3-2<br/>
jakarta-mail-api:2.1.3-2<br/>
javadoc:327.vdfe586651ee0<br/>
javax-activation-api:1.2.0-8<br/>
javax-mail-api:1.6.2-11<br/>
jaxb:2.3.9-133.vb_ec76a_73f706<br/>
jdk-tool:83.v417146707a_3d<br/>
jenkins-design-language:1.27.19<br/>
jersey2-api:2.45-154.v4ded3dc34f81<br/>
jira:3.15<br/>
jjwt-api:0.11.5-120.v0268cf544b_89<br/>
joda-time-api:2.14.0-127.v7d9da_295a_d51<br/>
jquery:1.12.4-3<br/>
jquery3-api:3.7.1-3<br/>
jsch:0.2.16-95.v3eecb_55fa_b_78<br/>
json-api:20250107-125.v28b_a_ffa_eb_f01<br/>
json-path-api:2.9.0-148.v22a_7ffe323ce<br/>
jsoup:1.20.1-46.ve5f1416988c2<br/>
junit:1335.v6b_a_a_e18534e1<br/>
kubernetes:4340.v345364d31a_2a_<br/>
kubernetes-client-api:6.10.0-251.v556f5f100500<br/>
kubernetes-credentials:192.v4d5b_1c429d17<br/>
ldap:780.vcb_33c9a_e4332<br/>
leastload:62.vfa_8830902733<br/>
lockable-resources:1349.v8b_ccb_c5487f7<br/>
mailer:489.vd4b_25144138f<br/>
matrix-auth:3.2.6<br/>
matrix-project:849.v0cd64ed7e531<br/>
maven-plugin:3.26<br/>
metrics:4.2.30-471.v55fa_495f2b_f5<br/>
mina-sshd-api-common:2.15.0-161.vb_200831a_c15b_<br/>
mina-sshd-api-core:2.15.0-161.vb_200831a_c15b_<br/>
monitoring:2.5.0<br/>
next-build-number:66.v4b_4762172d53<br/>
oauth-credentials:0.657.v7d8dd90b_0382<br/>
okhttp-api:4.11.0-189.v976fa_d3379d6<br/>
openshift-client:1.1.0.424.v829cb_ccf8798<br/>
openshift-sync:1.1.0.818.v3883b_3b_df89a_<br/>
oss-symbols-api:324.v432cce4172ca_<br/>
pam-auth:1.12<br/>
parameterized-scheduler:285.ve611986d4c48<br/>
pipeline-build-step:567.vea_ce550ece97<br/>
pipeline-github-lib:65.v203688e7727e<br/>
pipeline-graph-analysis:237.v2b_75640ca_888<br/>
pipeline-graph-view:524.v313953a_7d4c6<br/>
pipeline-groovy-lib:752.vdddedf804e72<br/>
pipeline-input-step:517.vf8e782ee645c<br/>
pipeline-milestone-step:134.vdf60d179845f<br/>
pipeline-model-api:2.2255.v56a_15e805f12<br/>
pipeline-model-definition:2.2255.v56a_15e805f12<br/>
pipeline-model-extensions:2.2255.v56a_15e805f12<br/>
pipeline-rest-api:2.38<br/>
pipeline-stage-step:322.vecffa_99f371c<br/>
pipeline-stage-tags-metadata:2.2255.v56a_15e805f12<br/>
pipeline-stage-view:2.38<br/>
pipeline-utility-steps:2.19.0<br/>
plain-credentials:195.vb_906e9073dee<br/>
plugin-util-api:6.1.0<br/>
prism-api:1.30.0-1<br/>
prometheus:819.v50953a_c560dd<br/>
pubsub-light:1.19<br/>
resource-disposer:0.25<br/>
reverse-proxy-auth-plugin:238.v82ceca_8417a_6<br/>
run-condition:243.v3c3f94e46a_8b_<br/>
scm-api:704.v3ce5c542825a_<br/>
script-security:1373.vb_b_4a_a_c26fa_00<br/>
sidebar-link:2.4.2<br/>
simple-theme-plugin:211.v5424a_5510e47<br/>
snakeyaml-api:2.3-125.v4d77857a_b_402<br/>
sonar:2.18<br/>
sse-gateway:1.28<br/>
ssh-credentials:355.v9b_e5b_cde5003<br/>
ssh-slaves:3.1031.v72c6b_883b_869<br/>
sshd:3.353.v2b_d33c46e970<br/>
structs:343.vdcf37b_a_c81d5<br/>
support-core:1725.va_2a_9f06eed61<br/>
swarm:3.49<br/>
theme-manager:294.vf2c2fd783821<br/>
timestamper:1.28<br/>
token-macro:444.v52de7e9c573d<br/>
trilead-api:2.209.v0e69b_c43c245<br/>
variant:70.va_d9f17f859e0<br/>
versioncolumn:320.v6b_b_814ca_01f7<br/>
workflow-aggregator:608.v67378e9d3db_1<br/>
workflow-api:1373.v7b_813f10efa_b_<br/>
workflow-basic-steps:1079.vce64b_a_929c5a_<br/>
workflow-cps:4106.v7a_8a_8176d450<br/>
workflow-durable-task-step:1405.v1fcd4a_d00096<br/>
workflow-job:1520.v56d65e3b_4566<br/>
workflow-multibranch:806.vb_b_688f609ee9<br/>
workflow-scm-step:437.v05a_f66b_e5ef8<br/>
workflow-step-api:700.v6e45cb_a_5a_a_21<br/>
workflow-support:968.v8f17397e87b_8<br/>
ws-cleanup:0.48<br/>
xunit:3.1.5
