-
Notifications
You must be signed in to change notification settings - Fork 32
Closed
Labels
releasePreparation for pre-release/releasePreparation for pre-release/releaset:maintenanceSome planned maintenance workSome planned maintenance work
Milestone
Description
Release version
1.83.0
Commit SHA
Previous pre-release
https://github.com/ITISFoundation/osparc-simcore/releases/tag/staging_Engage4
Planned date
24th June, 2025
Did the commit CI suceeded?
- The commit CI succeeded.
Motivation
- Regular sprint release
Changes
- ✨ [Frontend] Multiple
conversationsper project #7643 by @odeimaiz - 🐛Dask-Sidecar: explicitely set expand flag to remove confusing error message #7645 by @sanderegg
- 🎨 add safety condition for auto-recharge #7648 by @matusdrobuliak66
- ♻️✨🐛Dask-Sidecar: add RabbitMQ dependency and remove usage of deprecated Pub/Sub for logs 🚨🚨🚨 #7621 by @sanderegg
- ⬆️ Maintenance: upgrade aiohttp, version 3.11.13 is yanked #7649 by @sanderegg
- ♻️Dask sidecar: Glob error tests + autoscaling monitoring fix #7650 by @sanderegg
- 🎨 [Frontend] Enh: Lazy load templates #7647 by @odeimaiz
- ✨ [Frontend] Create Functions #7653 by @odeimaiz
- 🐛 Avoid 401 when listing in process tasks in webserver #7657 by @bisgaard-itis
- 🎨 Improve web-api listing task manager (download logs, credits, node name) #7656 by @matusdrobuliak66
- ⬆️ Maintenance: Upgrade
aioboto3#7662 by @giancarloromeo - 🎨Webserver: use uvloop and aiohttp UV loop worker to increase performances #7663 by @sanderegg
- ✨ [Frontend] App Browser with Hypertools #7658 by @odeimaiz
- 🎨 Improve listing task manager (add filter + and project name, project custom metadata fields) #7661 by @matusdrobuliak66
- ⬆️Maintenance: upgrade to traefik v3.4.0 #7670 by @sanderegg
- ⬆️Maintenance: more upgrades due to last upgrade of traefik to 3.4 #7671 by @sanderegg
- ✨ [Frontend] Activity Center and Activity Overview #7664 by @odeimaiz
- 🐛 [Frontend] Fixes: Data Browsing #7672 by @odeimaiz
- 🐛 [Frontend] Fix: Templates listing #7673 by @odeimaiz
- ✨ task manager improvement: listing
/computations/{project_id}/iterations#7669 by @matusdrobuliak66 - 🎨 [Frontend] Enh: Publish and Template in different sections #7674 by @odeimaiz
- 🐛 Generate API base URL by active product ⚠️ #7619 by @giancarloromeo
- Functions api ✨ 🗃️ #7539 by @wvangeit
- ✨ [Frontend] Templates and Public Projects in Study Browser #7676 by @odeimaiz
- 🎨 add project template type 🚨 (🗃️) #7677 by @matusdrobuliak66
- ♻️Dask-sidecar: remove dask Pub/Sub (🚨🚨🚨 computational services must be switched off prior to deploy) #7660 by @sanderegg
- 🐛 fix project-v0.0.1.json schema #7684 by @matusdrobuliak66
- 🎨 [Frontend] Show Runs history #7681 by @odeimaiz
- ♻️ upgrade
markupsafe#7691 by @matusdrobuliak66 - 🐛 Fixes
WEBSERVER_FUNCTIONSto run in development deploys #7687 by @pcrespov - ✨ Add Support for Filtering Solver Jobs by Custom Metadata via metadata.any Query Parameter #7678 by @pcrespov
- 🎨 Adding filtering for template type + extend patching #7689 by @matusdrobuliak66
- ✨ public-api 0.7.1: adds
version_displayfield in theSolverresponse model #7694 by @pcrespov - 🎨 [Frontend] Filter and patch template types #7690 by @odeimaiz
- ✨ Adding RPC entry points to dynamic-sidecar for
diskandvolumes#7651 by @GitHK - ✨
dynamic-sidecarallows to import old state from legacy services 🚨 #7675 by @GitHK - 🎨 [Frontend] Card Menu: Template menu on template, tutorial and hypertool cards #7696 by @odeimaiz
- ✨ Add exemplars to prometheus metrics #7644 by @bisgaard-itis
- ✨
public-api: list solvers filtered by service_key and version_display patterns #7695 by @pcrespov - ✨ [Frontend] PO Center: Pending Users #7699 by @odeimaiz
- 🐛 [Frontend] Fix: Pricing plan creation and Edit #7702 by @odeimaiz
- ✨🐛Computational Backend: Introduce Dask plugins for tasks lifecycle #7686 by @sanderegg
- Add functions rest api inside webserver ✨ ♻️ #7693 by @wvangeit
- 🐛 Process canonical endpoint in fastapi case when collecting prometheus metrics #7704 by @bisgaard-itis
- Fix functions frontend by using schema_content instead of schema_dict 🐛🚑️ #7705 by @wvangeit
- 🎨 [Frontend] Review 20.05 #7703 by @odeimaiz
- ⬆️Upgrade dask-based services (dask-sidecar, autoscaling, clusters-keeper, director-v2) 🚨🚨🚨 (computational clusters must be down on release) #7701 by @sanderegg
- Fix function job collection changelog descr 🐛 #7708 by @wvangeit
- 🎨 public-api: cleanup openapi routes descriptions #7707 by @pcrespov
- 🎨 [Frontend] Enable/disable Create Functions #7714 by @odeimaiz
- 🎨 web-server: Advertises state of
WEBSERVER_FUNCTIONSso front-end can enable/disable this feature #7715 by @pcrespov - 🎨 remove histogram with many buckets #7706 by @bisgaard-itis
- 🎨 database+web-server: Extending user pre-registration workflow and asyncpg upgrades 🗃️ #7709 by @pcrespov
- ✨ [Frontend] Pretty JSON objects #7710 by @odeimaiz
- 🎨 [Frontend] Runs with children #7712 by @odeimaiz
- 🎨 introduce
include_childrenquery parameter for activity monitor / project activity listings (🗃️) #7718 by @matusdrobuliak66 - 🎨 [Frontend] Support any image url in the Hypertool buttons #7720 by @odeimaiz
- ✨ [Frontend] Allow users access not-running latest runs #7723 by @odeimaiz
- Let frontend return 'number' instead of 'float' for the func schema 🐛 #7726 by @wvangeit
- 🐛Dask-sidecar: ignore unexpected key-value pairs in outputs json data + unreliable computational runs in on-demand clusters #7724 by @sanderegg
- 🎨
api-server: Add GET /solvers/page Public API Route with Pagination and Filter Support #7719 by @pcrespov - 🎨 Improve Exception Context to diagnose Invalid Invitations links #7727 by @pcrespov
- 🐛On-demand computational backend failing #7735 by @sanderegg
- ✨ web-api: admin views and actions for user accounts for the PO center #7560 by @pcrespov
- 🎨 [Frontend] Filter Runs #7728 by @odeimaiz
- 🐛 Fix listing (currently, project activity only shows the current user's actions; activities of other users are not visible) #7732 by @matusdrobuliak66
- 🐛 web-api: wallet update operation has now optional thumbnail #7736 by @pcrespov
- ✨ Add lifespan handling to tracing instrumentation and instrument rabbitmq rpc clients #7642 by @bisgaard-itis
- 🎨 dynamic-sidecar prints disk usage on boot #7740 by @GitHK
- ✨ [Frontend] Listen to
openFunctioniframe's message #7741 by @odeimaiz - 🎨 [Frontend] Fetch tasks from the given projectUuid #7743 by @odeimaiz
- ✨ notifications-library: default email templates for
on_account_approved,on_account_denied#7744 by @pcrespov - ♻️ Maintenance: Updates on new
Annotatedtype style and llm-prompts #7749 by @pcrespov - Add has_function_id filter to function job collection filtering ✨ #7746 by @wvangeit
- 🎨 Add load tests of
functions section in api server #7729 by @bisgaard-itis - 🐛Computational services with large amount of inputs/outputs fail to start (🗃️) #7725 by @sanderegg
- 🔨 Exposes WEBSERVER_FUNCTION env to
wb-api-serversimcore service ⚠️ #7751 by @pcrespov - 🐛 Fix errors observed in front-end due to the HTTP
reasonattribute and new lines #7755 by @pcrespov - 🐛♻️ Fixes public-api pagination issues and overall normalization & documentation #7747 by @pcrespov
- 🐛 Fixes exclusive decorator to handle CouldNotAcquireLockError gracefully #7757 by @pcrespov
- 🐛 Fix tracing exemplars #7750 by @bisgaard-itis
- 🎨 Maintenance: change default chunk size to compute checksums to 8MiB instead of 5KB #7753 by @sanderegg
- ♻️ removed unrequited assert #7754 by @GitHK
- 🐛 web-server: Handles safely overly long status messages in web server responses #7760 by @pcrespov
- 🔨♻️Performance testing: upgrade locust infrastructure #7711 by @sanderegg
- 🐛 Fix: Add default headers for authenticated HTTP methods #7763 by @sanderegg
- ✨ Front-end: Drafts "Pending Users" view on the PO center #7745 by @odeimaiz
- ⬆️♻️Uniformize uvicorn/fastapi dependencies repository-wide #7765 by @sanderegg
- 🎨 introduce
comp_run_snapshot_taskstable (🗃️) 🚨 #7758 by @matusdrobuliak66 - ♻️ Unifying long_running_tasks interfaces #7697 by @GitHK
- Function user permissions ✨ 🗃️ #7764 by @wvangeit
- 🐛 Fixes extra long error/debug message in the front-end #7761 by @pcrespov
- 🐛 Fixes
WEBSERVER_FUNCTIONSwas not properly exposed to front-end #7772 by @pcrespov - Add product permissions to functions 🎨 🗃️ #7771 by @wvangeit
- Mark inputs as required in create function frontend 🎨 #7752 by @wvangeit
- ♻️ speedup project listing 🚨 #7737 by @matusdrobuliak66
- 🐛 add default osparc product name to functions tables (modified previous migration 🗃️) #7787 by @matusdrobuliak66
- 🐛 [Frontend] Runs: Tap Info button for the second time #7788 by @odeimaiz
- 🎨 Update functions loadtest #7768 by @bisgaard-itis
- 🎨 Set 1 minute timeout as default in httpx clients used in api-server #7791 by @bisgaard-itis
- 🎨🐛 [Frontend] Runs and Tasks sorting #7790 by @odeimaiz
- Function cache check success 🎨 #7789 by @wvangeit
- 🐛 fix wrong project name in billing center usage view #7798 by @matusdrobuliak66
- 🎨 [Frontend] Enh: RM 03.06 #7794 by @odeimaiz
- 🎨 Fix/enh: Avoid duplicated port compatibility calls #7803 by @odeimaiz
- 🎨 web-server: accelerate
input:matchvia caching rest client call #7802 by @pcrespov - ✨ catalog: new service inherit icon and thumbnail from latest patched compatible releases 🚨 #7769 by @pcrespov
- 🎨Computational backend: Fail fast in case of malformed input syntax and improve unzipping #7804 by @sanderegg
- 🎨♻️ Enhances web-server's error middle-ware for safe status-line and refactors aiohttp response helpers #7770 by @pcrespov
- ⬆️ Upgraded
aiohttprepo wide #7800 by @GitHK - 🎨 [Frontend] New icons: Hypertools, More, New Folder #7805 by @odeimaiz
- Limit the number of accepted jobs in the api-server's
POST /v0/functions/{function_id}:mapendpoint #7801 by @bisgaard-itis - Add the created_at field to registered function objects 🎨 #7797 by @wvangeit
- 🐛 Refactored retry logic to include failing case in AWS master #7809 by @GitHK
- 🔥 downgrading
aiohttpto try and address issue with content length header #7811 by @GitHK - 🎨 [Frontend] Second app on Sim4Life.lite #7807 by @odeimaiz
- 🎨 Improves webserver's exception handling to enhance diagnoses of catalog's client errors #7817 by @pcrespov
- Revert "🐛 Refactored retry logic to include failing case in AWS maste… #7812 by @GitHK
- Revert "🎨 [Frontend] Second app on Sim4Life.lite (#7807)" #7822 by @matusdrobuliak66
- ✨Add docker healthcheck of Simcore Traefik container #7820 by @sanderegg
- 🐛 [Frontend] Fix: Disabled actions in Project's menu #7808 by @odeimaiz
- 🐛 use
httpxto download output ports #7824 by @GitHK - Add function error handler to api server 🎨 #7810 by @wvangeit
- 🐛 [Frontend] Fix: un-synced frontend's and backend's study objects #7828 by @odeimaiz
- 🎨 [Frontend] Second app on Sim4Life.lite (II) #7823 by @odeimaiz
- 🐛 web-server: fixes invitation data used in approval endpoint #7831 by @pcrespov
- 🎨 webserver: cache authenticated calls #7826 by @pcrespov
- 🐛 [Frontend] Fix: Edit slides #7832 by @odeimaiz
- 🎨 [Frontend] Prettify Project card #7830 by @odeimaiz
- 🐛 [Frontend] Fix: init ui-mode #7837 by @odeimaiz
- ⚗️Dask-sidecar: print file contents or partial contents #7834 by @sanderegg
- Generate unique Celery worker name #7827 by @giancarloromeo
- 🎨 Increase timeout for webserver 02 unittest workflow #7842 by @bisgaard-itis
- ✨ [Frontend] Group Sim4Life Featured services #7841 by @odeimaiz
- 🎨 [Frontend] Expose Tokens page to testers #7847 by @odeimaiz
- Revert "⚗️Dask-sidecar: print file contents or partial contents (#7834)" #7848 by @sanderegg
- 🐛 [Frontend] Fix: Tutorials tab link #7849 by @odeimaiz
- ♻️Computational backend: increase timeout to get results to 35 seconds #7850 by @sanderegg
- 🐛 Mitigates "Projects not being listed on osparc-staging.io" #7836 by @pcrespov
- Check function run permissions 🎨 #7844 by @wvangeit
- 🐛 [Frontend] Fix: service catalog #7856 by @odeimaiz
- ♻️ Enhances various error messages on webserver #7860 by @pcrespov
- ♻️ Towards a common long_running_tasks interface #7833 by @GitHK
- 🎨 add logs during project creation #7862 by @matusdrobuliak66
- 🐛 [Frontend] Incomplete node data in the backend #7864 by @odeimaiz
- 🐛
api-server: fixes product header contamination in webserver's client session #7865 by @pcrespov - 🎨 [Frontend] Enh: Better fit loading page #7866 by @odeimaiz
- 🗃️ Postgres: set statement timeout 🚨 ⚠️ DEVOPS #7858 by @YuryHrytsuk
- 🎨 Filter autogenerated api-keys when listing #7855 by @giancarloromeo
- 🎨 [Frontend] PO Center: Default welcome credits depends on product #7870 by @odeimaiz
- ⬆️ unpinned and upgraded aiohttp #7861 by @GitHK
- 🎨 [Frontend] Grouped list view #7845 by @odeimaiz
- 🎨 [Frontend] Project/Node: Cache more resources #7859 by @odeimaiz
- 🎨 [Frontend] Show Hypertools if there are any #7871 by @odeimaiz
- 🐛 [Frontend] Fix: show support id when pipeline fails to start #7874 by @odeimaiz
- 🐛 Fixes error message displayed to user coming from director-v2 failure #7875 by @pcrespov
- 🎨 [Frontend] Redirect anonymous users to the "account request form" instead of asking them to send an email #7877 by @odeimaiz
- 🎨Only require sticky connection on specific endpoints (🚨🚨) #7839 by @sanderegg
- ♻️ common http API interface for
long_running_tasks#7843 by @GitHK - ♻️ remove listing user services call from listing project #7881 by @matusdrobuliak66
- 🎨 [Frontend] Hide template used to register function #7886 by @odeimaiz
- 🎨🐛 [Frontend] Handle error on
project/services#7883 by @odeimaiz - ♻️ webserver:
securityDomain Refactoring #7867 by @pcrespov - 🐛Director-v2: properly close dask client when use is completed #7880 by @sanderegg
- ✨ Add
x-osparc-trace-idto response headers for requests hitting webserver and api-server #7796 by @bisgaard-itis - ♻️🐛Refactors webserver's errors middleware to handle
LineTooLongexceptions #7878 by @pcrespov - 🐛Increase node testing timeout to wait for website since Github machines are very weak #7893 by @sanderegg
- 🎨 [Frontend] Enh: Visible input ports #7891 by @odeimaiz
- 🐛 [Frontend] Fix: Nodes seem unconnected during running of services #7895 by @odeimaiz
- 🐛CI: Fix timeout value in CI e2e system test #7896 by @sanderegg
- 🐛System-test e2e is again required to pass #7898 by @sanderegg
- Add global functions user permissions 🎨 #7868 by @wvangeit
- 🎨 Increase poll timeout in api-server's webserver rest client to 10 minutes #7890 by @bisgaard-itis
- 🎨 [Frontend] Account request form: adapt defaults #7894 by @odeimaiz
- ✨ Add Controller for
/me/function-permissionsEndpoint in Functions Domain #7901 by @pcrespov - ✨ [Frontend] Check if I can
write_functions#7888 by @odeimaiz - ✨ [Frontend] Request services access #7897 by @odeimaiz
- 🎨 [Frontend] Update guided tours #7906 by @odeimaiz
- 🐛 [p2e] Update vtk tests #7911 by @odeimaiz
- 🎨 Enhance study cloning endpoint to allow modifying
title,description,hidden#7892 by @bisgaard-itis - 🎨 Require parent info headers when running function #7900 by @bisgaard-itis
- 🐛 Fix incorrect setup of IN_DEBT transaction state #7908 by @matusdrobuliak66
- 🐛 [p2e] Update VTK tests #7913 by @odeimaiz
- 🎨 Reduce the number of acquisition/release of DB connection inside function repository #7904 by @sanderegg
- 🐛 fix webserver wallet exclusive queues are removed when they should not #7912 by @matusdrobuliak66
- 🐛 Relax Wallet Access Check for Project Upgrades 🚨 #7917 by @matusdrobuliak66
- ♻️ Remove code duplication after [#7904] #7915 by @sanderegg
- 🐛 Fixed director-v2 getting stuck when removing service #7914 by @GitHK
Cherry-picked: - 🐛 Fixed director-v2 getting stuck when removing service #7914
- 🐛 [Frontend] Fix in_debt tracking #7927
- 🎨 [Frontend] Enh: Request services access #7924
- 🐛Ensure Dask client reference is uniquely defined for reference counting #7937
- 🐛 Fix clone title and description #7940
- 🐛 web-api: Fixes handling of unexpected errors #7939
- 🐛 Stopping a pipeline should not fail when it does not exist #7942
- 🎨🔨 AI-assisted workflow for user-facing messages #7345
- 🎨 [Frontend] Functions: Show Preview only when requested from MMUX #7948
- 🐛 [Frontend] Fix: pass welcome credits to backend #7950
- 🎨 [Frontend] Create Functions: Make default input values editable #7951
Before release
- Shutdown all computational clusters ⬆️Upgrade dask-based services (dask-sidecar, autoscaling, clusters-keeper, director-v2) 🚨🚨🚨 (computational clusters must be down on release) #7701 @YuryHrytsuk @sanderegg
- aws tip
- sim4life
- nih prod
- dalco prod
- inhouse tip
Devops check 👷
- update tls certificates
- sim4life https://git.speag.com/oSparc/osparc-ops-deployment-configuration/-/pipelines/1046032
- nih prod https://git.speag.com/oSparc/osparc-ops-deployment-configuration/-/pipelines/1046033
- aws tip https://git.speag.com/oSparc/osparc-ops-deployment-configuration/-/pipelines/1046034
- dalco prod https://git.speag.com/oSparc/osparc-ops-deployment-configuration/-/pipelines/1046111
- inhouse tip https://git.speag.com/oSparc/osparc-ops-deployment-configuration/-/pipelines/1046112
-
Add policy to expire content in theto be done in next release/exportspath osparc-ops-environments#1031 - Add detailed rabbitmq monitoring osparc-ops-environments#1048
- aws tip
- sim4life
- nih prod
- dalco prod
- inhouse tip --> inhouse tip: services and rabbitmq grafana dashboards missing data osparc-ops-environments#1088
- make sure prometheus / grafana work without tracing enabled in simcore @YuryHrytsuk @bisgaard-itis
- aws tip
- sim4life
- nih prod
- dalco prod
- inhouse tip
- verify simcore grafana dashboards work (with / without exemplars) @bisgaard-itis @YuryHrytsuk
- aws tip
- sim4life
- nih prod
- dalco prod
- inhouse tip --> inhouse tip: services and rabbitmq grafana dashboards missing data osparc-ops-environments#1088
- aws postgres statement timeout
- aws tip
- sim4life
- nih prod
- dalco prod
- inhouse tip
- AWS: remount docker folders using UUID (instead of device name) osparc-ops-environments#1072
- merge and verify new AMIs work
- use new AMIs on all deployments (amis for autoscaling service)
- update static machines on NIH PROD
- do no update machines on inhouse TIP
- update machines on dalco prod
- make sure generic resources were configured
- Fix / Add postgres grafana dashboard osparc-ops-environments#1080
- merge and apply https://git.speag.com/oSparc/osparc-ops-deployment-configuration/-/merge_requests/1445
- merge and apply https://git.speag.com/oSparc/osparc-ops-deployment-configuration/-/merge_requests/1451
- aws tip
- sim4life
- nih prod
- dalco prod
- inhouse tip
Devops after release
- manual addition of one row per product to the funcapi_group_api_access_rights table @wvangeit
- Modify DB tables (templates, hypertools, tutorials ...) @odeimaiz @matusdrobuliak66 https://github.com/ITISFoundation/private-issues/issues/85
- Modify service access rights DB @odeimaiz @matusdrobuliak66 🚀 Release v1.83.0 #7682 (comment)
- jupyterfenics:2.0.0 osparc.io @odeimaiz @matusdrobuliak66 🚀 Release v1.83.0 #7682 (comment)
- jupyterfenics:2.0.0 DALCO PROD @odeimaiz @matusdrobuliak66 🚀 Release v1.83.0 #7682 (comment)
- Metamodelling modifications @bisgaard-itis 🚀 Release v1.83.0 #7682 (comment)
- Metamodeling pricing plans DB @bisgaard-itis @matusdrobuliak66 Ensure Metamodeling services are available with pricing plan in prod #waitingforprod #7851
- We still need to share the READ MMUX and Jsonfiries service with product group (Will be done by @wvangeit on Thursday)
- Pricing plans V9.0 services DB @mguidon @matusdrobuliak66 https://github.com/ITISFoundation/private-issues/issues/206
- We need to modify the
service_specificationDB table + share it with product group
- We need to modify the
Tests assessment: e2e testing check 🧪
No response
Test assessment: targeted-testing 🔍️
No response
Test assessment: user-testing 🧐
No response
Summary 📝
- Prepare release link
make release-prod version=<M.m.0> git_sha=<commit_sha>- Draft release changelog
- Announce maintenance ( ** ANNOUNCE AT LEAST 24 HOURS BEFORE ** )
- redis add an entry in db
scheduled_maintenancewith keymaintenance{"start": "2023-03-06T13:00:00.000Z", "end": "2023-03-06T15:00:00.000Z", "reason": "Release <vX.X.0>"}. Note the time is in UTC, please adjust accordingly- sim4life.io
- osparc.speag.com
- osparc.io
- tip.science
- status page (https://manage.statuspage.io/)
- sim4life.io
- s4l-lite.io
- osparc.io
- tip.science
- mattermost channels
- maintenance
- power users
- Publish draft draft
- Check release CI
Releasing 🚀
- Maintenance page up (https://git.speag.com/oSparc/osparc-ops-deployment-configuration/-/pipeline_schedules)
- Check hanging sidecars. Helper command to run in director-v2 CLI
simcore-service-director-v2 close-and-save-service <uuid> - Remove redis key
- Check deployed
- sim4life.io
- osparc.speag.com
- osparc.io
- tip.science
- Check testing endpoint ex.
https://testing.osparc.speag.com/ - Update status page
- Update Release notes if hotfix (https://github.com/ITISFoundation/osparc-issues/blob/master/scripts/run_after_hotfix_to_prod.py)
- Check e2e runs
- Add a row to the functions api access table to enable function api access for all users #waitingforprod osparc-issues#1932
- Announce in mattermost
:tada: https://github.com/ITISFoundation/osparc-simcore/releases/tag/v<M.m.0>Metadata
Metadata
Assignees
Labels
releasePreparation for pre-release/releasePreparation for pre-release/releaset:maintenanceSome planned maintenance workSome planned maintenance work