♻️ Extract Celery code to a new simcore library

[giancarloromeo]

What do these changes do?

This PR refactors Celery integration by extracting wrapper logic into a dedicated simcore-celery-library package and updates related CI/CD and dependency configuration.

• Introduces a new simcore-celery-library package with packaging and setup files
• Adds and configures requirements, Makefiles, and version metadata for the new library
• Updates CI workflows, CodeQL, VS Code settings, CODEOWNERS, and Codecov to include the new package

No new features have been added, but a small redesign improves significantly the usability of the Celery interface. Any dependency with a specific App Server (i.e. FastAPI or aiohttp) has been removed and a BaseAppServer wrapper acts as a proxy, hiding the real technology used.

DISCLAIMER

A new queued_task package has been created in servicelib that contains protocols and models independent from Celery technology: they should stay there. A more suitable name can be decided in the future or - better - a general interface that include also old long running tasks.

Related issue/s

How to test

cd packages/celery-library
make install-dev
make test-dev

Dev-ops

Nothing

[codecov]

Codecov Report

Attention: Patch coverage is 60.28708% with 83 lines in your changes missing coverage. Please review.

Project coverage is 87.70%. Comparing base (4ee83ca) to head (eda052e).
Report is 1 commits behind head on master.

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #7698      +/-   ##
==========================================
- Coverage   88.01%   87.70%   -0.32%     
==========================================
  Files        1846     1430     -416     
  Lines       71249    59396   -11853     
  Branches     1225      649     -576     
==========================================
- Hits        62709    52092   -10617     
+ Misses       8187     7085    -1102     
+ Partials      353      219     -134     

Flag	Coverage Δ
integrationtests	64.24% <ø> (+<0.01%)	⬆️
unittests	86.01% <60.28%> (-0.60%)	⬇️

Components	Coverage Δ
api	∅ <ø> (∅)
pkg_aws_library	∅ <ø> (∅)
pkg_celery_library	81.13% <88.31%> (∅)
pkg_dask_task_models_library	∅ <ø> (∅)
pkg_models_library	∅ <ø> (∅)
pkg_notifications_library	∅ <ø> (∅)
pkg_postgres_database	∅ <ø> (∅)
pkg_service_integration	∅ <ø> (∅)
pkg_service_library	71.56% <0.00%> (-1.06%)	⬇️
pkg_settings_library	∅ <ø> (∅)
pkg_simcore_sdk	85.10% <ø> (+0.05%)	⬆️
agent	96.29% <ø> (ø)
api_server	92.31% <ø> (ø)
autoscaling	96.03% <ø> (ø)
catalog	92.29% <ø> (ø)
clusters_keeper	99.13% <ø> (ø)
dask_sidecar	91.79% <ø> (ø)
datcore_adapter	97.94% <ø> (ø)
director	76.73% <ø> (ø)
director_v2	91.17% <ø> (+0.01%)	⬆️
dynamic_scheduler	96.69% <ø> (ø)
dynamic_sidecar	90.09% <ø> (ø)
efs_guardian	89.65% <ø> (ø)
invitations	93.00% <ø> (ø)
payments	92.57% <ø> (ø)
resource_usage_tracker	89.00% <ø> (+0.21%)	⬆️
storage	86.31% <80.55%> (-1.23%)	⬇️
webclient	∅ <ø> (∅)
webserver	87.63% <ø> (-0.03%)	⬇️

---

Continue to review full report in Codecov by Sentry.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 4ee83ca...eda052e. Read the comment docs.

🚀 New features to boost your workflow:

• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[GitHK]

just a few questions

[bisgaard-itis]

Very cool! Thanks a lot for the heroic effort on this one!

[sanderegg]

pair reviewd

[sonarqubecloud]

Quality Gate passed

Issues
2 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud