🚀 Release `v1.77.0` / `v1.77.1` / `v1.77.2`

[YuryHrytsuk]

Release version

1.77.0 / 1.77.1 / 1.77.2

Commit SHA

f90ca82de6e57f730ae7abadb40996ef1bf68c3a

Previous pre-release

https://github.com/ITISFoundation/osparc-simcore/releases/tag/staging_Eisbock7

Planned date

v1.77.0 - 16.9.2024 - tip.science
v1.77.2 - 19.9.2024 - tip.science
v1.77.2 - 20.9.2024 - all production deployments

Did the commit CI suceeded?

• The commit CI succeeded.

Motivation

Regular sprint release

Changes

• ♻️ Maintenance: Fixes mypy in api-server #6175 by @pcrespov
• ✨dynamic-sidecar now logs into DockerHub (⚠️devops) #6081 by @GitHK
• ♻️Mypy: webserver #6193 by @sanderegg
• ✨AWS library: add start instance method #6159 by @sanderegg
• 🐛 fix services:access endpoint for product group #6213 by @matusdrobuliak66
• ♻️Mypy: webserver2 #6200 by @sanderegg
• ♻️ [Frontend] Retire PUT /study #6211 by @odeimaiz
• 🐛 [Frontend] Fix App mode: Wait until the workbench is deserialized to start #6214 by @odeimaiz
• ♻️ web-api: Updated catalog interface and drafted performance test for pagination #6189 by @pcrespov
• 🐛 fixes broken test in servicelib + code deprecation #6216 by @GitHK
• ♻️ folder_utils is now compatible with user #6148 by @GitHK
• 🎨 [Frontend] Improve blocked card's UX #6207 by @odeimaiz
• 🐛 [Frontend] Fix: reload Share with... list after updating access rights #6218 by @odeimaiz
• ⬆️ Maintenance/upgrade tools&tests requirements #6173 by @pcrespov
• ✨Autoscaling: Start using EBS-based EC2 buffers 🚨 #6143 by @sanderegg
• 🐛 [Frontend] Fix: List grouped tagged templates #6223 by @odeimaiz
• 📝 revision of release template #6226 by @matusdrobuliak66
• 🎨 Improving servicelib.logging_utils #6224 by @pcrespov
• ⬆️ Upgrade to Python 3.11 #6186 by @giancarloromeo
• ⚗️🙈 Don't gitignore the .python-version file (pyenv) #6228 by @mrnicegyu11
• 🐛Autoscaling in computational clusters could not start without SSM parameters  #6229 by @sanderegg
• 🐛 catalog: fixes access-rights to get and update services #6099 by @pcrespov
• 🐛 [Frontend] Minor fixes: File Picker Reset, Node Editor Close, Selection Management, Button Alignment #6219 by @odeimaiz
• ✨ Touch screen support #6178 by @jsaq007
• 🎨 [Frontend] Request Account form for oSPARC 🚨 ⚠️ DEVOPS #6217 by @odeimaiz
• 🎨Autoscaling: chunk prepulled image AWS EC2 tags #6232 by @sanderegg
• ♻️ Preparation of tags for both services and projects 🗃️ #6092 by @pcrespov
• 🎨 [e2e] Start from template playwright test #6225 by @odeimaiz
• ⬆️ Upgrade to traefik v3 (2nd trial) #6190 by @mrnicegyu11
• 🐛⚗️: Traefik V3 syntax fixes #6257 by @mrnicegyu11
• 🐛Autoscaling: Cluster gauges not reset correctly, too many buffer created, log improvements #6256 by @sanderegg
• 🎨 [Frontend] Logger UX improvements #6222 by @odeimaiz
• 🐛 [Frontend] Reopening running study breaks the connections #6259 by @odeimaiz
• 🐛🎨 [Frontend] UI/UX: Study updates #6262 by @odeimaiz
• 🐛 Fix wrong go-style UUID regexp - made portal links fail #6268 by @mrnicegyu11
• Revert "🐛 Fix wrong go-style UUID regexp - made portal links fail (#6268)" #6269 by @mrnicegyu11
• 🐛Traefik: partially revert changes #6270 by @sanderegg
• ✨Autoscaling: add buffer metrics #6260 by @sanderegg
• 🐛Traefik v3: adapt Go regexp (2nd trial) #6273 by @sanderegg
• ♻️ api-server: openapi docs and versioning #6264 by @pcrespov
• 🐛Traefikv3: Use v3 regexp syntax #6275 by @sanderegg
• 🐛Traefik v3: replace v2 regexp with v3 regexp #6277 by @sanderegg
• Add pylint check for Python 3.12 #6265 by @giancarloromeo
• 🐛 [Frontend] Fix: unlink port #6284 by @odeimaiz
• ✨Autoscaling monitoring tool: make compatible with non-billable deploys #6285 by @sanderegg
• 🐛Storage: Copying returns wrong size #6272 by @sanderegg
• Bump micromatch from 4.0.7 to 4.0.8 in /tests/e2e in the npm_and_yarn group across 1 directory #6271 by @dependabot
• 🐛 Fix: file uploads due to bad path encoding 🚨 #6287 by @pcrespov
• 🐛 More than 1 input port containing files can be safely pulled #6286 by @GitHK
• Favicon for 16 and 32 fix #6291 by @jsaq007
• ✨ webapi: new descriptionUI flag to render service a single page UI 🗃️ #6290 by @pcrespov
• 🐛Computational backend: if a pipeline raises, it should not prevent handling of other pipelines #6295 by @sanderegg
• 🐛Autoscaling: SSM client key error fix #6299 by @sanderegg
• 🎨 Backend part of UX improvements #6297 by @sanderegg
• 🐛 Flaky tests improvements #6292 by @GitHK
• ✨ Workspaces / Folders v2 🗃️🚨 #6248 by @matusdrobuliak66
• Add RUT port envs ⚠️ [DEVOPS] #6300 by @YuryHrytsuk
• ✨ [Frontend] Workspaces #6283 by @odeimaiz
• ✨ [Frontend] Description UI #6296 by @odeimaiz
• 🐛S3: when copying files there is no callback if the multipart threshold is not reached #6305 by @sanderegg
• 🎨 [Frontend] Prettify "Creating template" progress #6267 by @odeimaiz
• 🎨 dynamic-sidecar pulls user services images with states and outputs #6301 by @GitHK
• 🎨 Improve worskpace feature (1. Part) #6303 by @matusdrobuliak66
• 🎨 moving projects between workspaces #6312 by @matusdrobuliak66
• 🐛Autoscaling: Buffer pools metrics always showing 0 #6314 by @sanderegg
• 🎨Autoscaling monitoring tool: compatible with TIP, small improvements #6311 by @sanderegg
• ✨ [Frontend] Workspaces: Connect to backend #6304 by @odeimaiz
• 🐛 [Frontend] TIP: Hide Boot Options #6316 by @odeimaiz
• ✨ web-api interface for tags sharing and add to services #6298 by @pcrespov
• ⚗️ Increases timeout of rpc calls #6326 by @pcrespov
• 🎨 Healtcheck diagnostics sensor is now optional #6327 by @pcrespov
• 🎨 folder deletion 🚨 #6324 by @matusdrobuliak66
• ⬆️ upgrades gunicorn dependencies in webserver #6336 by @pcrespov
• 🎨 [Frontend] Folders & Workspaces: Missing features I #6317 by @odeimaiz
• 🐛 [Frontend] Fix: Unique session id #6335 by @odeimaiz
• 🎨 [e2e]: Increase S4L's timeout when there is a workspace to download #6338 by @odeimaiz
• 🎨Autoscaling: Add option to allow a new node to join a cluster directly active (🚨 ⚠️ DEVOPS) #6334 by @sanderegg
• 🐛Autoscaling/Comp backend: drain retired nodes so that they can be re-used #6345 by @sanderegg
• 🐛 adjust storage user project permission based on new logic with workspaces #6337 by @matusdrobuliak66
• 🎨 [Frontend] Workspaces & Folders: Show them as a tree #6343 by @odeimaiz
• 🎨 [Frontend] React to a 401 Unauthorized #6261 by @odeimaiz
• 🔒️ Make Redis Client support TLS  #6342 by @YuryHrytsuk
• ✨ [Frontend] New product: TIP lite 🚨 #6346 by @odeimaiz
• 🐛 Fixes catalog's synchronization background task continues errors due to faulty service info #6344 by @pcrespov
• 🎨 add running_time_in_hours to /services/-/aggregated-usages #6350 by @matusdrobuliak66
• Added some fallback icons for apple devices #6351 by @jsaq007
• 🎨 [Frontend] Workspaces: Improve tree I #6349 by @odeimaiz
• 🐛 [Frontend] Move to folder #6355 by @odeimaiz
• 🐛 fix issue with workspace permissions #6354 by @matusdrobuliak66
• 🎨 [Frontend] Credits summary: Show time #6356 by @odeimaiz
• 🎨 Adds new progress bar to track starting software #6353 by @GitHK
• 🐛 [Frontend] Folders tree: Fixes I #6358 by @odeimaiz
• 🐛 fix version control doesn't populate projects_to_products table #6357 by @matusdrobuliak66
• 🎨 [Frontend] TIP lite: add teaser button #6359 by @odeimaiz
• 🎨E2E: adapt test to new service startup status #6363 by @sanderegg
• 🎨🐛 [Frontend] Folders tree: improvements #6360 by @odeimaiz
• 🎨🐛 [Frontend] Folders tree: improvements II #6364 by @odeimaiz
• 🐛 do not allow moving folder to a child folder #6370 by @matusdrobuliak66
• 🎨 [Frontend] Prettify markdown's outcome #6369 by @odeimaiz
• 🐛 Fixed Redis issue where keys ended up in the wrong deployment. #6368 by @GitHK
• ♻️CI: increase timeout on autoscaling to fix mypy slowness #6375 by @sanderegg
• 🐛 [Frontend] Fix Automatic Shutdown = 0 #6372 by @odeimaiz
• ✨ Add: Tracing via opentelemetry #6168 by @mrnicegyu11
• 🎨 [Frontend] TIP lite: new logos #6377 by @odeimaiz
• 🐛 Wrong opentelemetry-collector config filename #6382 by @mrnicegyu11
• 🎨 [Frontend] Workspaces and Folders: Sync tree #6373 by @odeimaiz
• 🎨Redis: add optional Redis username #6381 by @sanderegg
• 🐛 fix filtering when project shared with product groups #6379 by @matusdrobuliak66
• 🐛 rabbitmq queue name prefix is unique during the lifecycle of the container #6365 by @GitHK
• ✨Adds metrics regarding new style dynamic services timings #6347 by @GitHK
• 🎨 [Frontend] Make the frontend dont-show-folders compatible #6387 by @odeimaiz
• ✨[Frontend] Denylist for (lite) registration emails #6385 by @odeimaiz
• 🎨 backend pulls inputs before iframe is displayed #6392 by @GitHK
• 🚨🐛 Mitigate dy-service file upload bug: Increase traefik timeouts #6395 by @mrnicegyu11

Devops 👷

• Configure Registry pull through cache WONT DO (for next sprints)
  • dalco
  • tip in-house
• Merge Cleanup adminer / appmotiondb labels
• Merge NIH PROD: ssm
• Modify database (original PR) @matusdrobuliak66

Tests assessment: e2e testing check 🧪

No response

Test assessment: targeted-testing 🔍️

No response

Test assessment: user-testing 🧐

No response

Summary 📝

• Prepare release link

make release-prod version=<M.m.0>  git_sha=<commit_sha>

• Draft release changelog
• Announce maintenance ( ** ANNOUNCE AT LEAST 24 HOURS BEFORE ** )
• redis add an entry in db scheduled_maintenance with key maintenance {"start": "2023-03-06T13:00:00.000Z", "end": "2023-03-06T15:00:00.000Z", "reason": "Release <vX.X.0>"}. Note the time is in UTC, please adjust accordingly
  • aws
  • dalco
  • tip
• status page (https://manage.statuspage.io/)
  • osparc
  • s4l
• mattermost channels
  • maintenance
  • power users

Releasing 🚀

• Maintenance page up.

cd /deployment/production/osparc-ops-environments
make up-maintenance
make down-maintenance

• Release by publishing draft
• Check release CI
• Check hanging sidecars. Helper command to run in director-v2 CLI simcore-service-director-v2 close-and-save-service <uuid>
• Check deployed
  • aws deploy
  • dalco deploy
  • tip deploy
• Check testing endpoint ex. https://testing.osparc.speag.com/
• Delete announcement
• Check e2e runs
• Announce

:tada: https://github.com/ITISFoundation/osparc-simcore/releases/tag/v<M.m.0>

[matusdrobuliak66]

⚠️ TODO @GitHK @matusdrobuliak66

Sim4life lite product requires vendor configuration for release notes!! before releasing to the production (webserver has to be restarted) -> Done no action needed