✨👽️🗃️ Introduce api-server endpoint for deleting solver job assets (s3-data)

[bisgaard-itis]

What do these changes do?

• Introduce an endpoint for deleting "solver job assets" (S3 data associated with a solver job in the api-server). This endpoint marks the underlying project as hidden, deletes the associated s3 data and sets a flag in the projects_to_jobs table in the database.
• Migrate the projects_to_jobs table in the db to add a new column for the flag.
• When attempting to start a solver job for which the s3 data has been deleted, a 409 is returned. This is done in order to prevent potential confusion when trying to start a job whose s3 data has been deleted.

@wvangeit this is probably relevant for you. With this in, it would be very easy to clean up S3-data associated with function jobs without deleting the jobs nor the functions themselves.

Related issue/s

• closes https://github.com/ITISFoundation/private-issues/issues/219

How to test

Dev-ops

[codecov]

Codecov Report

❌ Patch coverage is 86.58537% with 11 lines in your changes missing coverage. Please review.
✅ Project coverage is 88.08%. Comparing base (20163a7) to head (005c2d5).
⚠️ Report is 1 commits behind head on master.

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #8203      +/-   ##
==========================================
- Coverage   88.12%   88.08%   -0.05%     
==========================================
  Files        1855     1910      +55     
  Lines       71017    73492    +2475     
  Branches     1301     1301              
==========================================
+ Hits        62585    64732    +2147     
- Misses       8044     8372     +328     
  Partials      388      388              

Flag	Coverage Δ
integrationtests	64.15% <28.57%> (-0.10%)	⬇️
unittests	86.73% <86.58%> (+0.01%)	⬆️

Components	Coverage Δ
pkg_aws_library	93.93% <ø> (ø)
pkg_celery_library	87.37% <ø> (ø)
pkg_dask_task_models_library	79.62% <ø> (ø)
pkg_models_library	93.04% <100.00%> (+<0.01%)	⬆️
pkg_notifications_library	85.26% <ø> (ø)
pkg_postgres_database	88.02% <ø> (ø)
pkg_service_integration	70.19% <ø> (ø)
pkg_service_library	71.62% <0.00%> (-0.07%)	⬇️
pkg_settings_library	90.46% <ø> (ø)
pkg_simcore_sdk	85.10% <ø> (+0.05%)	⬆️
agent	93.81% <ø> (ø)
api_server	93.26% <97.82%> (+0.06%)	⬆️
autoscaling	95.89% <ø> (ø)
catalog	92.34% <ø> (ø)
clusters_keeper	99.13% <ø> (ø)
dask_sidecar	92.37% <ø> (+0.56%)	⬆️
datcore_adapter	97.94% <ø> (ø)
director	76.14% <ø> (ø)
director_v2	90.89% <ø> (-0.09%)	⬇️
dynamic_scheduler	96.27% <ø> (ø)
dynamic_sidecar	90.12% <ø> (ø)
efs_guardian	89.60% <ø> (ø)
invitations	91.44% <ø> (ø)
payments	92.60% <ø> (ø)
resource_usage_tracker	92.23% <ø> (+0.10%)	⬆️
storage	86.54% <ø> (∅)
webclient	∅ <ø> (∅)
webserver	88.26% <85.71%> (+0.01%)	⬆️

---

Continue to review full report in Codecov by Sentry.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 20163a7...005c2d5. Read the comment docs.

🚀 New features to boost your workflow:

• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[mergify]

🧪 CI Insights

Here's what we observed from your CI run for 005c2d5.

✅ Passed Jobs With Interesting Signals

Pipeline	Job	Signal	Health on base branch	Retries	🔍 CI Insights	📄 Logs
CI	[unit] director-v2 (3.11, ubuntu-24.04)	Base branch is healthy, but retries were needed. Could be early signs of flakiness 👀		1	View	View
	[unit] storage (3.11, ubuntu-24.04)	Base branch is broken, but the job passed. Looks like this might be a real fix 💪		0	View	View
	unit-tests	Base branch is broken, but retries were needed. Could be early signs of flakiness 👀		1	View	View

[matusdrobuliak66]

Thanks

[sanderegg]

Please double check the ProjectPatch thing. this might hide a lot of projects...
Also I would strongly suggest to use assets everywhere for consistency.
Thanks!

[sanderegg]

Thanks for the changes!

[bisgaard-itis]

@Mergifyio queue

[mergify]

queue

🟠 Waiting for conditions to match

• -closed [📌 queue requirement]
• any of: [🔀 queue conditions]
  • all of: [📌 queue conditions of queue default]
    • branch-protection-review-decision = APPROVED [🛡 GitHub branch protection]
    • #approved-reviews-by >= 2 [🛡 GitHub branch protection]
    • #approved-reviews-by>=2
    • #changes-requested-reviews-by = 0 [🛡 GitHub branch protection]
    • #changes-requested-reviews-by=0
    • #review-threads-unresolved = 0 [🛡 GitHub branch protection]
    • #review-threads-unresolved=0
    • -conflict
    • -draft
    • base=master
    • label!=🤖-do-not-merge
    • label=🤖-automerge
    • any of: [🛡 GitHub branch protection]
      • check-skipped = deploy to dockerhub
      • check-neutral = deploy to dockerhub
      • check-success = deploy to dockerhub
    • any of: [🛡 GitHub branch protection]
      • check-success = system-tests
      • check-neutral = system-tests
      • check-skipped = system-tests
    • any of: [🛡 GitHub branch protection]
      • check-success = unit-tests
      • check-neutral = unit-tests
      • check-skipped = unit-tests
    • any of: [🛡 GitHub branch protection]
      • check-success = check OAS' are up to date
      • check-neutral = check OAS' are up to date
      • check-skipped = check OAS' are up to date
    • any of: [🛡 GitHub branch protection]
      • check-success = integration-tests
      • check-neutral = integration-tests
      • check-skipped = integration-tests
    • any of: [🛡 GitHub branch protection]
      • check-success = build-test-images (frontend) / build-test-images
      • check-neutral = build-test-images (frontend) / build-test-images
      • check-skipped = build-test-images (frontend) / build-test-images
    • any of: [🛡 GitHub branch protection]
      • check-success = SonarCloud Code Analysis
      • check-neutral = SonarCloud Code Analysis
      • check-skipped = SonarCloud Code Analysis
• -conflict [📌 queue requirement]
• -draft [📌 queue requirement]
• any of: [📌 queue -> configuration change requirements]
  • -mergify-configuration-changed
  • check-success = Configuration changed

[GitHK]

Thanks, I think you forgot something

[GitHK]

👍

[sonarqubecloud]

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud