Skip to content

Conversation

@sanderegg
Copy link
Member

@sanderegg sanderegg commented Jul 7, 2025

image
image

Also update mako library, as version 1.3.7 was yanked.

  • opentelemetry* set of libraries required an update repo-wide
  • setuptools upgraded repo-wide
  • protobuf upgraded repo-wide
  • mako upgraded repo-wide

Bonus CI changes

  • removed cleanup steps, they are not necessary and use time for nothing
  • removed ${{ !cancelled() }} entries are they are not really useful. we want fail fast
  • upgraded UV to 0.7.x

Highlights on updated libraries (only updated libraries are included)

  • #packages before ~ 32
  • #packages after ~ 31
# name before after upgrade count packages
1 deprecated 1.2.18, 1.2.15, 1.2.14 🗑️ removed 27 agent⬆️
api-server⬆️
autoscaling⬆️
aws-library🧪
catalog⬆️
celery-library🧪
clusters-keeper⬆️
dask-sidecar⬆️
datcore-adapter⬆️
director-v2⬆️
director⬆️
docker-api-proxy🧪
dynamic-scheduler⬆️
dynamic-sidecar⬆️
invitations⬆️
notifications-library🧪
notifications⬆️
payments⬆️
postgres-database🧪
resource-usage-tracker⬆️
service-library🧪🧪🧪
simcore-sdk🧪
storage⬆️
swarm-deploy🧪
web⬆️
2 googleapis-common-protos 1.68.0, 1.69.2, 1.69.1, 1.66.0, 1.65.0 1.70.0 minor 18 agent⬆️
api-server⬆️
aws-library🧪
catalog⬆️
datcore-adapter⬆️
director⬆️
docker-api-proxy🧪
dynamic-scheduler⬆️
dynamic-sidecar⬆️
invitations⬆️
notifications⬆️
payments⬆️
resource-usage-tracker⬆️
service-library🧪
simcore-sdk🧪
storage⬆️
swarm-deploy🧪
web⬆️
3 mako 1.3.7, 1.2.2, 1.3.6, 1.3.2, 1.3.9 1.3.10 19 api-server⬆️🧪
catalog⬆️🧪
dynamic-scheduler⬆️
dynamic-sidecar⬆️
notifications-library🧪
notifications⬆️
payments⬆️
postgres-database🧪🧪
resource-usage-tracker⬆️🧪
simcore-sdk🧪🧪
storage⬆️
swarm-deploy🧪
web⬆️🧪
4 opentelemetry-api 1.28.2, 1.30.0, 1.28.1, 1.31.1, 1.31.0, 1.33.1, 1.27.0, 1.26.0 1.34.1 minor 27 agent⬆️
api-server⬆️
autoscaling⬆️
aws-library🧪
catalog⬆️
celery-library🧪
clusters-keeper⬆️
dask-sidecar⬆️
datcore-adapter⬆️
director-v2⬆️
director⬆️
docker-api-proxy🧪
dynamic-scheduler⬆️
dynamic-sidecar⬆️
invitations⬆️
notifications-library🧪
notifications⬆️
payments⬆️
postgres-database🧪
resource-usage-tracker⬆️
service-library🧪🧪🧪
simcore-sdk🧪
storage⬆️
swarm-deploy🧪
web⬆️
5 opentelemetry-exporter-otlp 1.28.2, 1.30.0, 1.28.1, 1.31.1, 1.31.0, 1.33.1, 1.27.0, 1.26.0 1.34.1 minor 23 agent⬆️
api-server⬆️
autoscaling⬆️
aws-library🧪
catalog⬆️
celery-library🧪
clusters-keeper⬆️
dask-sidecar⬆️
datcore-adapter⬆️
director-v2⬆️
director⬆️
docker-api-proxy🧪
dynamic-scheduler⬆️
dynamic-sidecar⬆️
invitations⬆️
notifications⬆️
payments⬆️
resource-usage-tracker⬆️
service-library🧪
simcore-sdk🧪
storage⬆️
swarm-deploy🧪
web⬆️
6 opentelemetry-exporter-otlp-proto-common 1.28.2, 1.30.0, 1.28.1, 1.31.1, 1.31.0, 1.33.1, 1.27.0, 1.26.0 1.34.1 minor 23 agent⬆️
api-server⬆️
autoscaling⬆️
aws-library🧪
catalog⬆️
celery-library🧪
clusters-keeper⬆️
dask-sidecar⬆️
datcore-adapter⬆️
director-v2⬆️
director⬆️
docker-api-proxy🧪
dynamic-scheduler⬆️
dynamic-sidecar⬆️
invitations⬆️
notifications⬆️
payments⬆️
resource-usage-tracker⬆️
service-library🧪
simcore-sdk🧪
storage⬆️
swarm-deploy🧪
web⬆️
7 opentelemetry-exporter-otlp-proto-grpc 1.28.2, 1.30.0, 1.28.1, 1.31.1, 1.31.0, 1.33.1, 1.27.0, 1.26.0 1.34.1 minor 23 agent⬆️
api-server⬆️
autoscaling⬆️
aws-library🧪
catalog⬆️
celery-library🧪
clusters-keeper⬆️
dask-sidecar⬆️
datcore-adapter⬆️
director-v2⬆️
director⬆️
docker-api-proxy🧪
dynamic-scheduler⬆️
dynamic-sidecar⬆️
invitations⬆️
notifications⬆️
payments⬆️
resource-usage-tracker⬆️
service-library🧪
simcore-sdk🧪
storage⬆️
swarm-deploy🧪
web⬆️
8 opentelemetry-exporter-otlp-proto-http 1.28.2, 1.30.0, 1.28.1, 1.31.1, 1.31.0, 1.33.1, 1.27.0, 1.26.0 1.34.1 minor 23 agent⬆️
api-server⬆️
autoscaling⬆️
aws-library🧪
catalog⬆️
celery-library🧪
clusters-keeper⬆️
dask-sidecar⬆️
datcore-adapter⬆️
director-v2⬆️
director⬆️
docker-api-proxy🧪
dynamic-scheduler⬆️
dynamic-sidecar⬆️
invitations⬆️
notifications⬆️
payments⬆️
resource-usage-tracker⬆️
service-library🧪
simcore-sdk🧪
storage⬆️
swarm-deploy🧪
web⬆️
9 opentelemetry-instrumentation 0.51, 0.48, 0.54, 0.52, 0.47, 0.49 0.55 minor 27 agent⬆️
api-server⬆️
autoscaling⬆️
aws-library🧪
catalog⬆️
celery-library🧪
clusters-keeper⬆️
dask-sidecar⬆️
datcore-adapter⬆️
director-v2⬆️
director⬆️
docker-api-proxy🧪
dynamic-scheduler⬆️
dynamic-sidecar⬆️
invitations⬆️
notifications-library🧪
notifications⬆️
payments⬆️
postgres-database🧪
resource-usage-tracker⬆️
service-library🧪🧪🧪
simcore-sdk🧪
storage⬆️
swarm-deploy🧪
web⬆️
10 opentelemetry-instrumentation-aio-pika 0.51, 0.48, 0.54, 0.52, 0.47, 0.49 0.55 minor 23 agent⬆️
api-server⬆️
autoscaling⬆️
aws-library🧪
catalog⬆️
celery-library🧪
clusters-keeper⬆️
dask-sidecar⬆️
datcore-adapter⬆️
director-v2⬆️
director⬆️
docker-api-proxy🧪
dynamic-scheduler⬆️
dynamic-sidecar⬆️
invitations⬆️
notifications⬆️
payments⬆️
resource-usage-tracker⬆️
service-library🧪
simcore-sdk🧪
storage⬆️
swarm-deploy🧪
web⬆️
11 opentelemetry-instrumentation-aiohttp-client 0.51, 0.48 0.55 minor 2 service-library🧪
web⬆️
12 opentelemetry-instrumentation-aiohttp-server 0.51, 0.48 0.55 minor 2 service-library🧪
web⬆️
13 opentelemetry-instrumentation-aiopg 0.51, 0.48 0.55 minor 2 service-library🧪
web⬆️
14 opentelemetry-instrumentation-asgi 0.51, 0.54, 0.52, 0.47, 0.49 0.55 minor 16 agent⬆️
api-server⬆️
autoscaling⬆️
catalog⬆️
clusters-keeper⬆️
datcore-adapter⬆️
director-v2⬆️
director⬆️
dynamic-scheduler⬆️
dynamic-sidecar⬆️
invitations⬆️
notifications⬆️
payments⬆️
resource-usage-tracker⬆️
service-library🧪
storage⬆️
15 opentelemetry-instrumentation-asyncpg 0.51, 0.48, 0.54, 0.52, 0.47, 0.49 0.55 minor 14 api-server⬆️
catalog⬆️
director-v2⬆️
dynamic-scheduler⬆️
dynamic-sidecar⬆️
notifications-library🧪
notifications⬆️
payments⬆️
postgres-database🧪
resource-usage-tracker⬆️
simcore-sdk🧪
storage⬆️
swarm-deploy🧪
web⬆️
16 opentelemetry-instrumentation-botocore 0.54, 0.51, 0.47 0.55 minor 5 autoscaling⬆️
aws-library🧪
clusters-keeper⬆️
resource-usage-tracker⬆️
storage⬆️
17 opentelemetry-instrumentation-celery 0.51 0.55 minor 1 storage⬆️
18 opentelemetry-instrumentation-dbapi 0.51, 0.48 0.55 minor 2 service-library🧪
web⬆️
19 opentelemetry-instrumentation-fastapi 0.51, 0.54, 0.52, 0.47, 0.49 0.55 minor 16 agent⬆️
api-server⬆️
autoscaling⬆️
catalog⬆️
clusters-keeper⬆️
datcore-adapter⬆️
director-v2⬆️
director⬆️
dynamic-scheduler⬆️
dynamic-sidecar⬆️
invitations⬆️
notifications⬆️
payments⬆️
resource-usage-tracker⬆️
service-library🧪
storage⬆️
20 opentelemetry-instrumentation-httpx 0.51, 0.54, 0.52, 0.47, 0.49 0.55 minor 16 agent⬆️
api-server⬆️
autoscaling⬆️
catalog⬆️
clusters-keeper⬆️
datcore-adapter⬆️
director-v2⬆️
director⬆️
dynamic-scheduler⬆️
dynamic-sidecar⬆️
invitations⬆️
notifications⬆️
payments⬆️
resource-usage-tracker⬆️
service-library🧪
storage⬆️
21 opentelemetry-instrumentation-logging 0.51, 0.48, 0.54, 0.52, 0.47, 0.49 0.55 minor 23 agent⬆️
api-server⬆️
autoscaling⬆️
aws-library🧪
catalog⬆️
celery-library🧪
clusters-keeper⬆️
dask-sidecar⬆️
datcore-adapter⬆️
director-v2⬆️
director⬆️
docker-api-proxy🧪
dynamic-scheduler⬆️
dynamic-sidecar⬆️
invitations⬆️
notifications⬆️
payments⬆️
resource-usage-tracker⬆️
service-library🧪
simcore-sdk🧪
storage⬆️
swarm-deploy🧪
web⬆️
22 opentelemetry-instrumentation-redis 0.51, 0.48, 0.54, 0.52, 0.47, 0.49 0.55 minor 23 agent⬆️
api-server⬆️
autoscaling⬆️
aws-library🧪
catalog⬆️
celery-library🧪
clusters-keeper⬆️
dask-sidecar⬆️
datcore-adapter⬆️
director-v2⬆️
director⬆️
docker-api-proxy🧪
dynamic-scheduler⬆️
dynamic-sidecar⬆️
invitations⬆️
notifications⬆️
payments⬆️
resource-usage-tracker⬆️
service-library🧪
simcore-sdk🧪
storage⬆️
swarm-deploy🧪
web⬆️
23 opentelemetry-instrumentation-requests 0.51, 0.48, 0.54, 0.52, 0.47, 0.49 0.55 minor 23 agent⬆️
api-server⬆️
autoscaling⬆️
aws-library🧪
catalog⬆️
celery-library🧪
clusters-keeper⬆️
dask-sidecar⬆️
datcore-adapter⬆️
director-v2⬆️
director⬆️
docker-api-proxy🧪
dynamic-scheduler⬆️
dynamic-sidecar⬆️
invitations⬆️
notifications⬆️
payments⬆️
resource-usage-tracker⬆️
service-library🧪
simcore-sdk🧪
storage⬆️
swarm-deploy🧪
web⬆️
24 opentelemetry-propagator-aws-xray 1.0.1 1.0.2 1 resource-usage-tracker⬆️
25 opentelemetry-proto 1.28.2, 1.30.0, 1.28.1, 1.31.1, 1.31.0, 1.33.1, 1.27.0, 1.26.0 1.34.1 minor 23 agent⬆️
api-server⬆️
autoscaling⬆️
aws-library🧪
catalog⬆️
celery-library🧪
clusters-keeper⬆️
dask-sidecar⬆️
datcore-adapter⬆️
director-v2⬆️
director⬆️
docker-api-proxy🧪
dynamic-scheduler⬆️
dynamic-sidecar⬆️
invitations⬆️
notifications⬆️
payments⬆️
resource-usage-tracker⬆️
service-library🧪
simcore-sdk🧪
storage⬆️
swarm-deploy🧪
web⬆️
26 opentelemetry-sdk 1.28.2, 1.30.0, 1.28.1, 1.31.1, 1.31.0, 1.33.1, 1.27.0, 1.26.0 1.34.1 minor 23 agent⬆️
api-server⬆️
autoscaling⬆️
aws-library🧪
catalog⬆️
celery-library🧪
clusters-keeper⬆️
dask-sidecar⬆️
datcore-adapter⬆️
director-v2⬆️
director⬆️
docker-api-proxy🧪
dynamic-scheduler⬆️
dynamic-sidecar⬆️
invitations⬆️
notifications⬆️
payments⬆️
resource-usage-tracker⬆️
service-library🧪
simcore-sdk🧪
storage⬆️
swarm-deploy🧪
web⬆️
27 opentelemetry-semantic-conventions 0.51, 0.48, 0.54, 0.52, 0.47, 0.49 0.55 minor 27 agent⬆️
api-server⬆️
autoscaling⬆️
aws-library🧪
catalog⬆️
celery-library🧪
clusters-keeper⬆️
dask-sidecar⬆️
datcore-adapter⬆️
director-v2⬆️
director⬆️
docker-api-proxy🧪
dynamic-scheduler⬆️
dynamic-sidecar⬆️
invitations⬆️
notifications-library🧪
notifications⬆️
payments⬆️
postgres-database🧪
resource-usage-tracker⬆️
service-library🧪🧪🧪
simcore-sdk🧪
storage⬆️
swarm-deploy🧪
web⬆️
28 opentelemetry-util-http 0.51, 0.48, 0.54, 0.52, 0.47, 0.49 0.55 minor 25 agent⬆️
api-server⬆️
autoscaling⬆️
aws-library🧪
catalog⬆️
celery-library🧪
clusters-keeper⬆️
dask-sidecar⬆️
datcore-adapter⬆️
director-v2⬆️
director⬆️
docker-api-proxy🧪
dynamic-scheduler⬆️
dynamic-sidecar⬆️
invitations⬆️
notifications⬆️
payments⬆️
resource-usage-tracker⬆️
service-library🧪🧪🧪
simcore-sdk🧪
storage⬆️
swarm-deploy🧪
web⬆️
29 packaging 24.2 25.0 MAJOR 2 datcore-adapter🧪🔧
30 protobuf 5.29.4, 5.29.3, 5.29.0, 5.28.3, 5.29.1, 4.25.4 5.29.5 23 agent⬆️
api-server⬆️
autoscaling⬆️
aws-library🧪
catalog⬆️
celery-library🧪
clusters-keeper⬆️
dask-sidecar⬆️
datcore-adapter⬆️
director-v2⬆️
director⬆️
docker-api-proxy🧪
dynamic-scheduler⬆️
dynamic-sidecar⬆️
invitations⬆️
notifications⬆️
payments⬆️
resource-usage-tracker⬆️
service-library🧪
simcore-sdk🧪
storage⬆️
swarm-deploy🧪
web⬆️
31 setuptools 80.7.1, 78.1.0, 75.6.0, 76.0.0, 74.0.0, 75.8.2, 69.1.1 80.9.0 minor 46 agent🧪🔧
api-server⬆️🧪🔧
autoscaling🧪🔧
aws-library🧪🔧
catalog🔧
clusters-keeper🧪🔧
common-library🔧
dask-sidecar🧪🔧
dask-task-models-library🔧
datcore-adapter⬆️🔧
director-v2🔧
director🔧
docker-api-proxy🔧
dynamic-scheduler🔧
dynamic-sidecar🔧
e2e-playwright🧪
invitations🔧
migration🔧
models-library🔧
notifications-library🔧
notifications🔧
payments🔧
postgres-database🔧
public-api🧪
resource-usage-tracker⬆️🧪🔧
service-integration🔧
service-library🔧
settings-library🔧
simcore-sdk🧪🔧
storage🧪🔧
swarm-deploy🧪
web⬆️🧪🔧
32 typing-extensions 4.13.0, 4.14.0, 4.13.2, 4.12.2 4.14.1 103 agent⬆️🧪🔧
api-server⬆️🧪🔧
autoscaling⬆️🧪🔧
aws-library🧪🧪🔧
catalog⬆️🧪🔧
celery-library🧪🧪🔧
clusters-keeper⬆️🧪🔧
common-library🧪🧪🔧
dask-sidecar⬆️🧪🔧
dask-task-models-library🧪🧪🔧
datcore-adapter⬆️🧪🔧
director-v2⬆️🧪🔧
director⬆️🔧
docker-api-proxy🧪🔧
dynamic-scheduler⬆️🧪🔧
dynamic-sidecar⬆️🧪🔧
e2e-playwright🧪🧪🧪
efs-guardian⬆️🧪🔧
environment-setup🧪
helpers🧪
invitations⬆️🧪🔧
migration🧪🔧
models-library🧪🧪🔧
notifications-library🧪🧪🔧
notifications⬆️🧪🔧
payments⬆️🧪🔧
performance🧪🧪
postgres-database🧪🧪🧪🔧
public-api🧪🧪🧪
resource-usage-tracker⬆️🧪🔧
service-integration🧪🔧
service-library🧪🧪🧪🔧
settings-library🧪🔧
simcore-sdk🧪🧪🔧
storage⬆️🧪🔧
swarm-deploy🧪🧪
tests🧪
web⬆️🧪🔧

Legend:

  • ⬆️ base dependency (only services because packages are floating)
  • 🧪 test dependency
  • 🔧 tool dependency

What do these changes do?

Related issue/s

How to test

Dev-ops

@sanderegg sanderegg added this to the Engage milestone Jul 7, 2025
@sanderegg sanderegg self-assigned this Jul 7, 2025
@sanderegg sanderegg added t:maintenance Some planned maintenance work dependencies labels Jul 7, 2025
@codecov
Copy link

codecov bot commented Jul 7, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 88.25%. Comparing base (7f873b9) to head (51d262b).
Report is 1 commits behind head on master.

Additional details and impacted files
@@           Coverage Diff           @@
##           master    #8053   +/-   ##
=======================================
  Coverage   88.24%   88.25%           
=======================================
  Files        1859     1859           
  Lines       71626    71627    +1     
  Branches     1258     1258           
=======================================
+ Hits        63208    63213    +5     
+ Misses       8054     8050    -4     
  Partials      364      364           
Flag Coverage Δ
integrationtests 64.32% <ø> (-0.01%) ⬇️
unittests 86.87% <100.00%> (+0.01%) ⬆️
Components Coverage Δ
api 76.84% <ø> (ø)
pkg_aws_library 93.93% <ø> (ø)
pkg_celery_library 87.15% <ø> (ø)
pkg_dask_task_models_library 79.62% <ø> (ø)
pkg_models_library 93.27% <ø> (ø)
pkg_notifications_library 85.26% <ø> (ø)
pkg_postgres_database 88.19% <ø> (ø)
pkg_service_integration 69.92% <ø> (ø)
pkg_service_library 71.38% <100.00%> (+<0.01%) ⬆️
pkg_settings_library 90.64% <ø> (ø)
pkg_simcore_sdk 84.99% <ø> (-0.12%) ⬇️
agent 96.29% <ø> (ø)
api_server 92.83% <ø> (ø)
autoscaling 96.03% <ø> (ø)
catalog 92.58% <ø> (ø)
clusters_keeper 99.13% <ø> (ø)
dask_sidecar 91.79% <ø> (+0.22%) ⬆️
datcore_adapter 97.94% <ø> (ø)
director 76.73% <ø> (-0.10%) ⬇️
director_v2 90.98% <ø> (-0.02%) ⬇️
dynamic_scheduler 96.69% <ø> (ø)
dynamic_sidecar 90.09% <ø> (ø)
efs_guardian 89.65% <ø> (ø)
invitations 93.60% <ø> (ø)
payments 92.57% <ø> (ø)
resource_usage_tracker 92.47% <ø> (-0.06%) ⬇️
storage 86.64% <ø> (+0.21%) ⬆️
webclient ∅ <ø> (∅)
webserver 88.61% <ø> (+<0.01%) ⬆️

Continue to review full report in Codecov by Sentry.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 7f873b9...51d262b. Read the comment docs.

🚀 New features to boost your workflow:
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@sanderegg sanderegg force-pushed the security/upgrade-protobuf branch from 91f8342 to 7463aeb Compare July 7, 2025 09:02
@sanderegg sanderegg changed the title ⬆️🔒️Security fix: Upgrade protobuf version ⬆️🔒️Security fix: Upgrade protobuf/setuptools version Jul 7, 2025
@sonarqubecloud
Copy link

sonarqubecloud bot commented Jul 7, 2025

@sanderegg sanderegg marked this pull request as ready for review July 7, 2025 09:14
@sanderegg sanderegg requested a review from bisgaard-itis July 7, 2025 09:14
@sanderegg sanderegg added the 🤖-automerge marks PR as ready to be merged for Mergify label Jul 7, 2025
@sanderegg
Copy link
Member Author

@mergify queue

@mergify
Copy link
Contributor

mergify bot commented Jul 7, 2025

queue

✅ The pull request has been merged automatically

The pull request has been merged automatically at 00b3d1d

Copy link
Contributor

@GitHK GitHK left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

Copy link
Collaborator

@matusdrobuliak66 matusdrobuliak66 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks

Copy link
Member

@pcrespov pcrespov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fantastic! thx

@mergify mergify bot merged commit 00b3d1d into ITISFoundation:master Jul 7, 2025
98 checks passed
@matusdrobuliak66 matusdrobuliak66 mentioned this pull request Aug 5, 2025
88 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

🤖-automerge marks PR as ready to be merged for Mergify t:maintenance Some planned maintenance work

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants