Staging SouthIslandIcedTea4

What's Changed

• 🔨 Fixes on pytest_simcore.helpers by @pcrespov in #6024
• 🐛 Enforces regex constraints in some fields by @pcrespov in #6021
• ✨ Implementing new list_services_paginated entrypoint in web-api (part 1) by @pcrespov in #5991
• ✨E2E: jupyterlabs test compatible with jupyter-ml by @sanderegg in #6028
• 🐛 [Frontend] Do not duplicate poll calls by @odeimaiz in #6029
• 🐛E2e: fix typo by @sanderegg in #6030

Full Changelog: staging_SouthIslandIcedTea3...staging_SouthIslandIcedTea4
Release Issue: #6031

Staging SouthIslandIcedTea3

What's Changed

• ♻️Storage: refactoring by @sanderegg in #5981
• ⬆️Maintenance: upgrade uv to 0.2 in Dockerfiles by @sanderegg in #6008
• ⬆️Maintenance: upgraded aioboto3 by @sanderegg in #6009
• ♻️ New fakes in dev/catalog/service by @pcrespov in #6012
• 🐛 [Frontend] Bugfix: Required inputs by @odeimaiz in #6013
• ♻️🐛 [Frontend] Reuse iframe starting sequence for guests by @odeimaiz in #6004
• 🔒️ Resolves security scanning alerts by @pcrespov in #6020
• 🐛Storage: fix database locking by @sanderegg in #6005
• ✨ Limit inflight requests to the api-server by @bisgaard-itis in #6007
• ✨ Add metamodeling load tests by @bisgaard-itis in #6014
• ✨ webserver-catalog rpc connection by @pcrespov in #6003
• 🐛🎨 [Frontend] call /retrieve endpoint also for guests by @odeimaiz in #6022
• 🐛 viewers can now use new style dynamic services by @GitHK in #6023
• 🎨 create efs guardian specific user by @matusdrobuliak66 in #5936

Full Changelog: staging_SouthIslandIcedTea2...staging_SouthIslandIcedTea3
Release Issue: #6010

Staging SouthIslandIcedTea2

What's Changed

• 🎨 [Frontend] Team Black feedback 20.06 by @odeimaiz in #5971
• 🎨 👽️ Improve start job endpoint in webserver and improve error handling in api-server by @bisgaard-itis in #5927
• ♻️🐛Storage: disable handling of dangling multipart uploads by @sanderegg in #5978
• ✨ Auto inject osparc environments to dynamic services by @pcrespov in #5966
• 🎨 Drafts new web-api for catalog services by @pcrespov in #5969
• ♻️E2E: Classic TI wait a bit longer on Run Optimization step by @sanderegg in #5984
• 🐛 Fixes error while updated study with long description by @pcrespov in #5989
• 🐛 [Frontend] Fix: From service running to connect to iframe by @odeimaiz in #5987
• 👽️ Add endpoint for getting credit-price and study-job log files from api server by @bisgaard-itis in #5985
• ♻️ Maintenance: pytest-simcore initial cleanup by @pcrespov in #5986
• 🎨 [Frontend] TIP v3 Feedback by @odeimaiz in #5980
• 🐛 Fixes mismatch on error status-code for start-computation by @pcrespov in #5994
• 🎨 Maintenance: Add new concurrency tooling by @sanderegg in #5997
• ✨ [Frontend] Coins icon for the credits indicator by @odeimaiz in #5993
• 🎨 Fixes Deprecation Warning on redis and aiohttp by @pcrespov in #5996
• ✨ dynamic-sidecar logs changes to input ports by @GitHK in #5999

Full Changelog: staging_SouthIslandIcedTea1...staging_SouthIslandIcedTea2
Release Issue: #6002

1.74.0

This is a hotfix addressing an issue where a red cloud would appear after login that would block users from opening projects.

What's Changed

For the geeks that want to go into the details of which Pull Requests were deployed, take a look at the list below:

All Commits

• hotfix ♻️ rabbitmq queue names ⚠️🚨 #5931
• fixed broken CI test blocking release

Full Changelog: v1.73.0...v1.74.0
Release Issue: #5982

Staging SouthIslandIcedTea1

What's Changed

• ♻️ refactor stop service command ⚠️🚨 by @GitHK in #5924
• ✨ add EFS mount option to sidecar by @matusdrobuliak66 in #5873
• 🐛 [Frontend] API creation Bugfix: Allow only future dates by @odeimaiz in #5929
• ♻️ rabbitmq queue names ⚠️🚨 by @GitHK in #5931
• 🐛 fix patching project workbench when changing data type + e2e 🚨 by @matusdrobuliak66 in #5932
• 🎨 [Frontend] Dashboard: Filter Services by Type by @odeimaiz in #5930
• ♻️ refactor RedisClientsManager and RedisClientSDK by @GitHK in #5888
• 🎨 Improve profiling middleware by @bisgaard-itis in #5935
• 🐛Maintenance: disable CI problematic test by @sanderegg in #5944
• 🐛 disable health check for Redis client by @GitHK in #5946
• ⬆️ Maintenance: upgrade docker image base to latest Debian Bookworm & latest python 3.10.14 🚨 by @sanderegg in #5937
• 🐛 [Frontend bugfix] List everyone group and provide product-everyone group in potential collaborators by @odeimaiz in #5945
• 🐛? [Frontend bugfix?] Directly switch to service's iframe when its status is running by @odeimaiz in #5948
• Bump codecov/codecov-action from 4.4.1 to 4.5.0 by @dependabot in #5954
• 🎨 [Frontend] Request Account form for Billable products by @odeimaiz in #5951
• 🐛Bugfix: fix typo in docker-compose for CI deployment by @sanderegg in #5958
• 🐛 [Frontend bugfix] patch Services access rights by @odeimaiz in #5949
• ♻️ Splits models_library.services by @pcrespov in #5921
• 🎨 [Frontend] Refuse folder drop on Workbech by @odeimaiz in #5957
• 🎨 [Frontend] Guided Tours: add tours for TIP by @odeimaiz in #5933
• 🎨 [Frontend] Disclaimer on TIP login page by @odeimaiz in #5960
• 🎨 [Frontend] Switch to iframe's content also after 302 response by @odeimaiz in #5963
• 🎨 [Frontend] Highlight elements in Guided Tour by @odeimaiz in #5967
• 🐛 [Frontend] Log fetch call's response to running service by @odeimaiz in #5968
• 🐛 [Frontend] Stringify fetch response by @odeimaiz in #5970
• 🎨E2E: improvements on ClassicTIP test by @sanderegg in #5955
• 🔨 Enhance diagnostics info in e2e testing by @pcrespov in #5962
• 🐛E2E: --product-url is an url not a string by @sanderegg in #5972

Full Changelog: staging_LeeroyJenkins5...staging_SouthIslandIcedTea1
Release Issue: #5977

1.73.0

Welcome to the 1.73.0 release of the oSPARC platform. There are many updates in this version that we hope you'll like, some of the key highlights include:

• File Picker's Redesign
• Hide Credits Indicator by default
• Make Inputs required
• Show me the Instructions

File Picker's Redesign

While being in the App Mode, in order to ease the File selection, we have redesign it. Three different options are provided:

• Select New File: upload it from your file browser or simply drop on the dotted box
• Select Download link: if the file you want to add to the pipeline is accessible in the Internet, just type the link and it will added to the pipeline.
• Select File from another project: if the file you want to use was already used or generated in another study or project, select it using the integrated file browser.

Affected products: oSPARC, Sim4Life, Sim4Life Science, TI Planning Tool

Hide Credits Indicator by default

The Credits Indicator that was sitting next to the User Menu, it's now hidden by default. If you would like change this behavior, you will find this setting in the Preferences.
In these same settings, you can also tune the warning threshold, so that it gets automatically visible when your amount of credits goes below this number.

Affected products: Sim4Life, Sim4Life Science

Make Inputs required

In order to improve the User Experience when dealing with unexpected Interactive Service starts, this new features was deployed. You can now make some inputs required and if this inputs are not provided, the Interactive Service will refuse to start. This is specially useful when you forget to push some expected data to the pipeline.

Affected products: oSPARC, Sim4Life, Sim4Life science

Show me the Instructions

If a Study/Project is started in App Mode and if that step in the pipeline contains some instructions provided by the pipeline creator, these will automatically be shown. After closing them, if you want to access them again, just tap the Instructions button right between the pipeline steps and the step view.

Affected products: oSPARC, Sim4Life, Sim4Life Science, TI Planning Tool

What's Changed

For the geeks that want to go into the details of which Pull Requests were deployed, take a look at the list below:

All Commits

• ✨Autoscaling: Drain node before terminating by @sanderegg in #5846
• 🔨 Retires deprecated pkg_resources module by @pcrespov in #5856
• ⬆️ Maintenance: Dask upgrade to 2024.5.1 and upgrades of autoscaling/clusters-keeper/director-v2/dask-sidecar/osparc-gateway 🚨 by @sanderegg in #5737
• ♻️🔨 Removes httpx client capture from api-server and moves to a plugin in pytest_simcore (⚠️) by @pcrespov in #5798
• 🐛⬆️Osparc-gateway-server: missing requirements update by @sanderegg in #5868
• 🐛 fix for pending transactions by @matusdrobuliak66 in #5852
• 🐛Webserver: Fix show weird messages in the frontend UI by @sanderegg in #5863
• ✨Clusters-keeper: terminate broken EC2s🚨 by @sanderegg in #5851
• ⬆️Remove redis deprecation warning by @sanderegg in #5869
• ⬆️Maintenance: upgrade docker-py to latest version, unblocking requests library by @sanderegg in #5871
• ♻️🎨 Improves error handling in the api-server by @pcrespov in #5866
• 🎨Autoscaling/Clusters-keeper: disable public IP address by @sanderegg in #5882
• 🔨 Reuses pytest_simcore fixtures and exposes CLI options to override them by @pcrespov in #5876
• 🐛♻️Clusters-keeper: use private dns name instead of public IP by @sanderegg in #5883
• 🐛 use ip address in upload link check by @bisgaard-itis in #5849
• ✨ Adding deferred tasks ⚠️ by @GitHK in #5704
• ✨ Registers OSPARC_VARIABLE_API_* as osparc session variable (🚨) by @pcrespov in #5858
• ♻️ Dy service checking -> XHR to fetch requests by @ignapas in #5885
• 🐛 Fixes api-keys unique constraint violation (🚨) by @pcrespov in #5890
• 🎨 👽️ allow user to unhide study/solver job by @bisgaard-itis in #5894
• ♻️ Frontend: use PATCH instead of PUT for /projects I by @odeimaiz in #5884
• 👽️ update api-server specs by @bisgaard-itis in #5895
• ⬆️ upgrading faststream repo wide by @GitHK in #5898
• 🎨 Frontend: Redesign File Picker in App Mode by @odeimaiz in #5893
• 🎨 Frontend: Credits indicator only visible in warning zone by default (🚨) by @odeimaiz in #5897
• ✨ introducing elastic file system guardian (OPS ⚠️) by @matusdrobuliak66 in #5887
• ♻️ Removing default network form agent by @GitHK in #5901
• ✨♻️ New version_display and release_date fields for service metadata by @pcrespov in #5902
• ♻️Ensure parent project/node is well structured in the DB 🗃️ by @sanderegg in #5874
• ✨ api-server: New study jobs metadata entrypoints by @pcrespov in #5690
• 🎨 introducing parent ids to rut (🗃️) by @matusdrobuliak66 in #5891
• ✨ Frontend: Expose inputs required property by @odeimaiz in #5899
• 🎨 propagate job parent ids through api server by @bisgaard-itis in #5903
• ✨ dynamic-services will fail if they have any required input that is not set by @GitHK in #5845
• 🎨 Frontend: Usage table: show root_parent_project_name instead of project_name by @odeimaiz in #5908
• 🔨Clusters maintenance script: refactoring and add SSH tunneling by @sanderegg in #5886
• 🔨 New pytest-simcore environment_config fixtures and utils_postgres helpers by @pcrespov in #5909
• ♻️ Major cleanup of catalog service by @pcrespov in #5904
• ✨ [Frontend] Dashboard: filters on the left by @odeimaiz in #5907
• 🎨 [Frontend] App Mode: Pop up instructions if any by @odeimaiz in #5915
• 🎨♻️Use structured parent project/node in director-v2 and connect with RUT by @sanderegg in #5877
• 🐛Dask sidecar: disable concurrent pulling of files until new version is out by @sanderegg in #5912
• ✨ Efs Guardian can create directories (OPS ⚠️) by @matusdrobuliak66 in #5911
• 🐛 [Frontend bugfix] Move side spacer to Resource Browser by @odeimaiz in #5919
• ♻️🎨 ooil config init to create first.osparc config layout by @pcrespov in #5913

Full Changelog: v1.72.0...v1.73.0
Release Issue: #5934

Staging LeeroyJenkins5

What's Changed

• ✨ introducing elastic file system guardian (OPS ⚠️) by @matusdrobuliak66 in #5887
• ♻️ Removing default network form agent by @GitHK in #5901
• ✨♻️ New version_display and release_date fields for service metadata by @pcrespov in #5902
• ♻️Ensure parent project/node is well structured in the DB 🗃️ by @sanderegg in #5874
• ✨ api-server: New study jobs metadata entrypoints by @pcrespov in #5690
• 🎨 introducing parent ids to rut (🗃️) by @matusdrobuliak66 in #5891
• ✨ Frontend: Expose inputs required property by @odeimaiz in #5899
• 🎨 propagate job parent ids through api server by @bisgaard-itis in #5903
• ✨ dynamic-services will fail if they have any required input that is not set by @GitHK in #5845
• 🎨 Frontend: Usage table: show root_parent_project_name instead of project_name by @odeimaiz in #5908
• 🔨Clusters maintenance script: refactoring and add SSH tunneling by @sanderegg in #5886
• 🔨 New pytest-simcore environment_config fixtures and utils_postgres helpers by @pcrespov in #5909
• ♻️ Major cleanup of catalog service by @pcrespov in #5904
• ✨ [Frontend] Dashboard: filters on the left by @odeimaiz in #5907
• 🎨 [Frontend] App Mode: Pop up instructions if any by @odeimaiz in #5915
• 🎨♻️Use structured parent project/node in director-v2 and connect with RUT by @sanderegg in #5877
• 🐛Dask sidecar: disable concurrent pulling of files until new version is out by @sanderegg in #5912
• ✨ Efs Guardian can create directories (OPS ⚠️) by @matusdrobuliak66 in #5911
• 🐛 [Frontend bugfix] Move side spacer to Resource Browser by @odeimaiz in #5919
• ♻️🎨 ooil config init to create first.osparc config layout by @pcrespov in #5913

Full Changelog: staging_LeeroyJenkins4...staging_LeeroyJenkins5
Release Issue: #5928

Staging LeeroyJenkins4

What's Changed

• ✨Autoscaling: Drain node before terminating by @sanderegg in #5846
• 🔨 Retires deprecated pkg_resources module by @pcrespov in #5856
• ⬆️ Maintenance: Dask upgrade to 2024.5.1 and upgrades of autoscaling/clusters-keeper/director-v2/dask-sidecar/osparc-gateway 🚨 by @sanderegg in #5737
• ♻️🔨 Removes httpx client capture from api-server and moves to a plugin in pytest_simcore (⚠️) by @pcrespov in #5798
• 🐛⬆️Osparc-gateway-server: missing requirements update by @sanderegg in #5868
• 🐛 fix for pending transactions by @matusdrobuliak66 in #5852
• 🐛Webserver: Fix show weird messages in the frontend UI by @sanderegg in #5863
• ✨Clusters-keeper: terminate broken EC2s🚨 by @sanderegg in #5851
• ⬆️Remove redis deprecation warning by @sanderegg in #5869
• ⬆️Maintenance: upgrade docker-py to latest version, unblocking requests library by @sanderegg in #5871
• ♻️🎨 Improves error handling in the api-server by @pcrespov in #5866
• 🎨Autoscaling/Clusters-keeper: disable public IP address by @sanderegg in #5882
• 🔨 Reuses pytest_simcore fixtures and exposes CLI options to override them by @pcrespov in #5876
• 🐛♻️Clusters-keeper: use private dns name instead of public IP by @sanderegg in #5883
• 🐛 use ip address in upload link check by @bisgaard-itis in #5849
• ✨ Adding deferred tasks ⚠️ by @GitHK in #5704
• ✨ Registers OSPARC_VARIABLE_API_* as osparc session variable (🚨) by @pcrespov in #5858
• ♻️ Dy service checking -> XHR to fetch requests by @ignapas in #5885
• 🐛 Fixes api-keys unique constraint violation (🚨) by @pcrespov in #5890
• 🎨 👽️ allow user to unhide study/solver job by @bisgaard-itis in #5894
• ♻️ Frontend: use PATCH instead of PUT for /projects I by @odeimaiz in #5884
• 👽️ update api-server specs by @bisgaard-itis in #5895
• ⬆️ upgrading faststream repo wide by @GitHK in #5898
• 🎨 Frontend: Redesign File Picker in App Mode by @odeimaiz in #5893
• 🎨 Frontend: Credits indicator only visible in warning zone by default (🚨) by @odeimaiz in #5897

Full Changelog: staging_LeeroyJenkins3...staging_LeeroyJenkins4
Release Issue: #5889

1.72.0

What's Changed

• 🐛 Fix: successful job's output returns None instead of result by @pcrespov in #5721
• ✨Dynamic proxy: add allowed CORS header by @sanderegg in #5756
• ♻️🔨 Moves httpx-calls-capture tooling to pytest-simcore by @pcrespov in #5727
• 🎨 Frontend: favicons pointing to assets repo by @odeimaiz in #5755
• 🐛 Frontend: bind login page to /announcements by @odeimaiz in #5758
• 🎨 Improve the service startup progress display by @jsaq007 in #5760
• 🐛 fix jupyterlab e2e test by @matusdrobuliak66 in #5761
• 🎨🗃️ improve performance of check resource heartbeat by @matusdrobuliak66 in #5762
• 🎨 Enhanced json serialization by @pcrespov in #5682
• ✨ TIP frontend: 4th plus button by @odeimaiz in #5766
• 🎨E2E: re-enable web-security when running playwright by @sanderegg in #5763
• ✨ Add profiling middleware to simcore services by @bisgaard-itis in #5749
• 🎨 enable show-all in profiling middleware to ensure profile is fully detailed by @bisgaard-itis in #5769
• ⚗️ New web-api service ⚠️🚨 by @pcrespov in #5767
• 🐛 Fixes web-api-server config by @pcrespov in #5779
• 🐛 🔨 Fixes wb-api-server configuration by @pcrespov in #5780
• 🐛 Only allow to search owned files in storage search endpoint by @bisgaard-itis in #5772
• 🐛 Frontend Fix: fetch Announcements at start up by @odeimaiz in #5774
• 🐛Garbage collector: possible fix to "spurious" shutdowns by @sanderegg in #5768
• 🐛 Frontend Fix: Make sure SelectBox's selection is not null by @odeimaiz in #5785
• ✨ e2e: playwright frontend by @odeimaiz in #5717
• ✨ Frontend TIP Feature: Pop up window with available new Plans by @odeimaiz in #5784
• Bump codecov/codecov-action from 4.3.0 to 4.3.1 by @dependabot in #5788
• 🐛⚗️RClone: Disable multi-threading 🚨 by @sanderegg in #5790
• ⬆️ Maintenance: upgrades test and tooling dependencies by @pcrespov in #5787
• 🐛 fixes validation error in notifications call by @pcrespov in #5794
• 🐛Agent: ensure RClone does not create kernel panics by @sanderegg in #5793
• 🐛 improve storage performance when listing files by @bisgaard-itis in #5786
• 🎨 Frontend: Show Tiers in secondary column by @odeimaiz in #5791
• 🎨 Re-fetch project state if it's closing by @odeimaiz in #5800
• 🐛? Frontend: Remove sourceMappingURLs by @odeimaiz in #5801
• 🐛 only pass user_id when project_id is not explicitly specified when listing files by @bisgaard-itis in #5799
• 🎨 Increase performance by paginating search files entry-points by @pcrespov in #5796
• ♻️ Cleanup compose specs environment by @pcrespov in #5776
• ✨E2E: Refactor jupyter lab test and adds large files option by @sanderegg in #5797
• ⬆️ Maintenance: upgrade socket.io to 4.7.5 by @odeimaiz in #5805
• 🐛Fix up-devel Makefile target by @sanderegg in #5806
• ♻️ project & project node PATCH 🚨 by @matusdrobuliak66 in #5802
• 🐛 add validators to ProjectDB model by @matusdrobuliak66 in #5810
• 🐛 fix hardcoded s3 region string by @matusdrobuliak66 in #5808
• 🎨 dynamic-sidecar health check fails if RabbitMQ client disconnects by @GitHK in #5671
• 🎨 patch projects when creating study job by @bisgaard-itis in #5817
• 👽️✨ "Undev" files and studies endpoints by @bisgaard-itis in #5825
• 🐛 improve tip e2e test by @matusdrobuliak66 in #5831
• 🚑️Rclone: downgrade to 1.63.1 by @sanderegg in #5830
• 🐛 Frontend: Fix open issue by @odeimaiz in #5818
• 🐛 Avoid aioredis client form hanging on calls if redis is no longer available by @GitHK in #5821
• ✨Autoscaling: terminate long pending EC2s by @sanderegg in #5832
• 🐛 Fix Frontend: Allow starting in App Mode by @odeimaiz in #5836
• 🐛 Wait for dynamic-sidecar's API to be responding before pinning to node by @GitHK in #5841
• 🐛 Frontend: open node on Full Screen Mode by @odeimaiz in #5844
• ✨ introducing inputs_required to workbench by @matusdrobuliak66 in #5838
• 🎨 Check for zero credits (if pricing unit cost is greater than 0) by @matusdrobuliak66 in #5835
• Bump codecov/codecov-action from 4.3.1 to 4.4.1 by @dependabot in #5847
• ✨Autoscaling: add a delay before draining a node by @sanderegg in #5843

Full Changelog: v1.71.0...v1.72.0

Staging LeeroyJenkins3

What's Changed

• 🎨 dynamic-sidecar health check fails if RabbitMQ client disconnects by @GitHK in #5671
• 🎨 patch projects when creating study job by @bisgaard-itis in #5817
• 👽️✨ "Undev" files and studies endpoints by @bisgaard-itis in #5825
• 🐛 improve tip e2e test by @matusdrobuliak66 in #5831
• 🚑️Rclone: downgrade to 1.63.1 by @sanderegg in #5830
• 🐛 Frontend: Fix open issue by @odeimaiz in #5818
• 🐛 Avoid aioredis client form hanging on calls if redis is no longer available by @GitHK in #5821
• ✨Autoscaling: terminate long pending EC2s by @sanderegg in #5832
• 🐛 Fix Frontend: Allow starting in App Mode by @odeimaiz in #5836
• 🐛 Wait for dynamic-sidecar's API to be responding before pinning to node by @GitHK in #5841
• 🐛 Frontend: open node on Full Screen Mode by @odeimaiz in #5844
• ✨ introducing inputs_required to workbench by @matusdrobuliak66 in #5838
• 🎨 Check for zero credits (if pricing unit cost is greater than 0) by @matusdrobuliak66 in #5835
• Bump codecov/codecov-action from 4.3.1 to 4.4.1 by @dependabot in #5847
• ✨Autoscaling: add a delay before draining a node by @sanderegg in #5843

Full Changelog: staging_LeeroyJenkins2...staging_LeeroyJenkins3
Release Issue: TODO