🎨 Introduce grouping multiple jobs in task manager (Multiport simulation use case) (🗃️)

[matusdrobuliak66]

What do these changes do?

• 🎨 Introduce grouping of multiple jobs in Task Manager (Multiport Simulation use case) (🗃️)

  • 2 new endpoints:
    • ✨ /computation-collection-runs
    • ✨ /computation-collection-runs/{collection_run_id}/tasks

• ✨ Impact on Sim4Life users:

  • When users run a multiport simulation, it will now appear as a single run in the activity overview, even though on the backend it is still implemented as eight separate projects, each with its own run.
  • The naming of runs (e.g., EM Simulation) and tasks (e.g., Line1) shown in Sim4Life will now be consistent with what users see in the oSPARC activity overview.

NEXT STEPS:

• ♻️ Remove unused endpoints once the frontend has been updated to use the new ones.
• ♻️ Remove dependency on projects_custom_metadata. The required information will instead be passed through HTTP headers (Sim4Life application update needed).
• 🎨 Add filter to display only currently running jobs.

Related issue/s

• relates Add project grouping mechanism osparc-issues#1888
• relates https://github.com/ITISFoundation/private-issues/issues/229

How to test

Director-v2:

• services/director-v2/tests/unit/with_dbs/comp_scheduler/test_db_repositories_comp_runs_snapshot_tasks.py
• services/director-v2/tests/unit/with_dbs/comp_scheduler/test_db_repositories_comp_runs.py
• services/director-v2/tests/unit/with_dbs/comp_scheduler/test_api_rpc_computations.py

Webserver:

• services/web/server/tests/unit/with_dbs/01/test_director_v2_handlers.py

Dev-ops

[codecov]

Codecov Report

Attention: Patch coverage is 84.39024% with 64 lines in your changes missing coverage. Please review.

Project coverage is 88.22%. Comparing base (00b3d1d) to head (928a70e).
Report is 1 commits behind head on master.

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #8025      +/-   ##
==========================================
+ Coverage   88.14%   88.22%   +0.07%     
==========================================
  Files        1811     1863      +52     
  Lines       69754    71964    +2210     
  Branches     1258     1261       +3     
==========================================
+ Hits        61488    63490    +2002     
- Misses       7903     8110     +207     
- Partials      363      364       +1     

Flag	Coverage Δ
integrationtests	64.22% <47.49%> (-0.11%)	⬇️
unittests	86.85% <84.14%> (+0.11%)	⬆️

Components	Coverage Δ
api	76.84% <ø> (ø)
pkg_aws_library	93.93% <ø> (ø)
pkg_celery_library	87.15% <ø> (ø)
pkg_dask_task_models_library	79.62% <ø> (ø)
pkg_models_library	93.24% <91.57%> (-0.04%)	⬇️
pkg_notifications_library	85.26% <ø> (ø)
pkg_postgres_database	88.22% <100.00%> (+0.02%)	⬆️
pkg_service_integration	69.92% <ø> (ø)
pkg_service_library	71.25% <0.00%> (-0.17%)	⬇️
pkg_settings_library	90.64% <ø> (ø)
pkg_simcore_sdk	84.99% <ø> (-0.12%)	⬇️
agent	96.29% <ø> (ø)
api_server	92.83% <ø> (ø)
autoscaling	96.03% <ø> (ø)
catalog	92.58% <ø> (ø)
clusters_keeper	99.13% <ø> (ø)
dask_sidecar	91.79% <ø> (-0.57%)	⬇️
datcore_adapter	97.94% <ø> (ø)
director	76.73% <ø> (ø)
director_v2	91.00% <93.54%> (+0.02%)	⬆️
dynamic_scheduler	96.69% <ø> (ø)
dynamic_sidecar	90.09% <ø> (ø)
efs_guardian	89.65% <ø> (ø)
invitations	93.60% <ø> (ø)
payments	92.57% <ø> (ø)
resource_usage_tracker	92.52% <ø> (∅)
storage	86.81% <ø> (+0.33%)	⬆️
webclient	∅ <ø> (∅)
webserver	88.50% <81.06%> (-0.13%)	⬇️

---

Continue to review full report in Codecov by Sentry.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 00b3d1d...928a70e. Read the comment docs.

🚀 New features to boost your workflow:

• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[odeimaiz]

Awesome Matus, thanks!

What would the meta-modelers need to do so that iterations show up grouped?

[mergify]

queue

🛑 The pull request has been removed from the queue default

The pull request can't be updated.

You can take a look at Queue: Embarked in merge queue check runs for more details about the failure.

[pcrespov]

thx. please check the suggestions.

[mergify]

This pull request has been removed from the queue for the following reason: pull request branch update failed.

The pull request can't be updated.

You should update or rebase your pull request manually. If you do, this pull request will automatically be requeued once the queue conditions match again.
If you think this was a flaky issue, you can requeue the pull request, without updating it, by posting a @mergifyio requeue comment.

[sonarqubecloud]

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
2.1% Duplication on New Code

See analysis details on SonarQube Cloud