1.59.0

What's Changed

• ✨ Implements study read operations in api-server by @pcrespov in #4511
• ♻️ fixes mypy issues in servicelib by @matusdrobuliak66 in #4534
• 🐛 fix flaky test_update_service_observation by @GitHK in #4535
• 🐛 Fix e2e: openWithResources by @odeimaiz in #4537
• 🐛 Bugfix: Super collaborator by @odeimaiz in #4499
• ⬆️Upgrade dask-based services by @sanderegg in #4536
• 🎨 Study home page and more improvements by @odeimaiz in #4539
• ♻️ fixes mypy issues in models-library by @matusdrobuliak66 in #4533
• ⬆️ repo-wide upgrade to aiohttp==3.8.5 by @pcrespov in #4544
• ⬆️ upgrading docker-compose to 2.x.x in dynamic-sidecar 🚨 by @GitHK in #4545
• 🐛 fixes broken image build in master by @GitHK in #4547
• ✨⚗️ Add additional docker image tag to simcore github actions (⚠️ DEVOPS) by @mrnicegyu11 in #4548
• ♻️ extending run_id with int_timestamp by @GitHK in #4505
• 🐛Fix unstoppable pipeline in external clusters🗃️ by @sanderegg in #4549
• ⬆️ upgrade dynamic-sidecar service requirements by @GitHK in #4551
• ♻️ refactors garbage-collector and open/close in project plugins by @pcrespov in #4550
• ✨ Wallets: Frontend only by @odeimaiz in #4542
• 🐛 e2e fix: enable the open project button by @odeimaiz in #4557
• 🎨 Notification in bell: "you don't have access anymore" by @odeimaiz in #4558
• ♻️ catalog API schema models moved to models-library by @pcrespov in #4553
• ♻️ Clean up simcore webserver environment ⚠️ DEVOPS by @YuryHrytsuk in #4491
• ♻️ directorv2 API schema models moved to models-library by @pcrespov in #4560
• 🎨 Feature: Stop, and Start, buttons in service options by @odeimaiz in #4564
• ♻️ multipart upload chunks are scheduled a few at a time by @GitHK in #4552
• 🐛 Bugfixes: labelValue is not a String by @odeimaiz in #4563
• 🐛 Fix webserver twilio env by @YuryHrytsuk in #4566
• ♻️ dy-sidecar no longer zips states (⚠️ devops) by @GitHK in #4502
• ✨RabbitMQ: allow secure rabbit protocol (⚠️DevOPS) by @sanderegg in #4567
• ✨🗃️ Is1039/introduce wallets to osparc by @matusdrobuliak66 in #4565
• ✨Resource usage tracking: RabbitMQ messages by @sanderegg in #4569
• 🎨 TIP v2: Last aesthetics changes by @odeimaiz in #4576
• 🐛Uploading files works again by @sanderegg in #4577
• 🐛Check permissions before modifying project nodes by @sanderegg in #4582
• 🐛 Fix openapi swagger page dispay (missing env-var capture) by @mrnicegyu11 in #4584
• 🐛 rclone command output is once again captured and not swallowed by @GitHK in #4575
• 🐛 rclone preserves symlinks even if broken by @GitHK in #4585
• ♻️ Remove docker node constraints from simcore repo (⚠️ DEVOPS) by @YuryHrytsuk in #4571
• 🐛 fix templates publish/open with states as directories by @GitHK in #4586
• 🎨 Feature: Connect Wallets to backend by @odeimaiz in #4568
• ♻️🐛 storage provides presigned download links for files in folders by @GitHK in #4573
• 🐛 bugfix on wallet update by @matusdrobuliak66 in #4589
• 🎨 Wallets: Update Status required by @odeimaiz in #4592
• ✨ Is922/add rabbitMQ to resource usage tracker by @matusdrobuliak66 in #4583
• ✨Meet the clusters-keeper service (⚠️ devops) by @sanderegg in #4591
• ✨ Computational backend: connect to resource tracking via RabbitMQ (🗃️, ⚠️) by @sanderegg in #4570
• ✨ Link assets folder from service to front-end by @GitHK in #4572
• 🐛 fix dynamic-sidecar outputs watcher by @GitHK in #4600
• 🗃️ resource usage tracker - credit tables by @matusdrobuliak66 in #4578
• ✨ Frontend: Allow users to open the study home page of studies with unknown services by @odeimaiz in #4599
• ⬆️ aio-pika: unblock constraint and fix test by @sanderegg in #4605
• ♻️🐛 dynamic-sidecar will ignore inputs pull commands while containers are created by @GitHK in #4601
• 🐛 rabbitmq connection by @matusdrobuliak66 in #4603
• 🎨 Frontend: Improve 3D mesh viewer defaults by @odeimaiz in #4606
• ✨ API server endpoints for performing multipart upload directly to S3 by @bisgaard-itis in #4596
• 🎨 Wallets: some defaults by @odeimaiz in #4607
• 🎨Release workflow improvements by @sanderegg in #4609
• ⬆️Dependencies upgrade by @sanderegg in #4610
• 🎨 Feature: Wallets on staging by @odeimaiz in #4614
• 🐛 Hot-fix: Ensure synchronization between projects/workbench and projects_nodes by @sanderegg in #4617
• 🐛 Make sure openapi is happy about abort endpoint by @bisgaard-itis in #4612
• 🎨 TIP Disclaimer by @odeimaiz in #4621
• 🐛 Unlocks the deploy of builds on master by @GitHK in #4624
• Bump actions/setup-node from 3.7.0 to 3.8.0 by @dependabot in #4608
• e2e: Update TIP test by @odeimaiz in #4625
• 🐛 Fix project_nodes getting out of sync with projects workbench by @sanderegg in #4613
• ⬆️♻️Maintenance: remove docker compose v1 occurences by @sanderegg in #4629
• ⬆️Comp backend: ensure numpy installed in client by @sanderegg in #4630
• ♻️Maintenance: attempt at fixing monkeypatch warnings by @sanderegg in #4627
• ♻️Maintenance: remove backward compatibility code by @sanderegg in #4632
• ♻️ api/specs/web-server now generates OAS using fastapi by @pcrespov in #4562
• 🎨 Add 2 rclone e2e tests by @mguidon in #4635
• 🐛Handle case where metadata in comp_runs are NULL by @sanderegg in #4646
• ♻️📝 API-server files collection cleanup and doc by @pcrespov in #4645
• ✨ Frontend: wait for backend's confirmation before removing a node by @odeimaiz in #4639
• 🐛 Fixes schema error in web-server OAS by @pcrespov in #4647
• ✨ new API entrypoint web-server:clone_project and drafts api-server:clone_study by @pcrespov in #4650
• ✨ Frontend: open Wallets view after log in by @odeimaiz in #4649
• 🎨 e2e: update Kember test by @odeimaiz in #4611
• ♻️ Removes assert w/ validator and fixes code redundancy by @pcrespov in #4653
• 🐛 Sort in multipart upload by @bisgaard-itis in #4626
• 🐛 Add missing email env variables to webserver (:warning: DEVOPS) by @YuryHrytsuk in #4648
• 🐛Director-v2: Fix UNKNOWN state not correctly converted by @sanderegg in #4660
• ✨ new clone_study in api-server by @pcrespov in #4663
• 🐛 Fix: Managers invite new Members by @odeimaiz in #4662
• 🐛 Bugfix: list item by @odeimaiz in #4671
• 🐛Fixed issue where a large number of node progresses were slightly above 1.0 by @sanderegg in #4672
• ✨Tracking messages get a discriminator by @sanderegg in #4677
• ✨ Feature: Payment Gateway in a new window by @odeimaiz in #4658
• ✨ modify rabbit resource tracking started message by @matusdrobuliak66 in #4679
• ✨ New payments service (⚠️ devops) by @pcrespov in #4676
• 🐛 storage fixed paginated file listing by @GitHK in #4675
• 🔨 Fixes deploy push payment service by @pcrespov in #4681
• ✨ 🗃️ Is922/resource usage tracker process rabbit messages by @matusdrobuliak66 in #4666
• 🐛 storage better logging by @GitHK in #4684
• ✨RabbitMQ: Add RPC decorator for server side by @sanderegg in #4682
• 🎨 Wallets: minor Cosmetics and some fixes by @odeimaiz in #4680
• ♻️ adding logs to project copy in storage by @GitHK in #4689
• ♻️ Cleanup in preparation for new payment plugin by @pcrespov in #4686
• 🐛 fix bool in query parameter by @matusdrobuliak66 in #4690
• ✨ Usage overview: request per wallet by @odeimaiz in #4688
• Rabbitmq/separate clients by @sanderegg in #4685
• 🎨 Cosmetics: Description below by @odeimaiz in #4691
• 🐛 removing unsubscribe from rabbitmq + ♻️ comp resource tracking id change by @matusdrobuliak66 in #4687
• ⚗️Storage: reduce pressure while copying and fix logs by @sanderegg in #4694
• 🐛Storage: Improve documentation and fix number of files shown to be copied by @sanderegg in #4695
• 🎨 Enhancements: Account, Preferences and Resource Selection by @odeimaiz in #4693
• ⚗️ storage remove task concurrency locking while duplicating a project by @GitHK in #4698
• 🎨 Cosmetics: User center by @odeimaiz in #4699
• ⬆️Storage: dependencies upgrade by @sanderegg in #4696
• ✨🗃️ Is922/resource usage tracker introduce credits by @matusdrobuliak66 in #4692
• Comp backend/clusters creation functionalities by @sanderegg in #4602
• ♻️Storage: Reduce noisy loggers impact by @sanderegg in #4705
• Bump actions/checkout from 3 to 4 by @dependabot in #4706
• ♻️ Maintenance: removes unused modules by @pcrespov in #4710
• 🐛 🗃️ fix migration by @matusdrobuliak66 in #4712
• ✨ webserver API for wallet/*/payments 🗃️ ⚠️ by @pcrespov in #4683
• ♻️Autoscaling: prepare for computational autoscaling by @sanderegg in #4709
• ✨ Dynamic services backend: connect to resource tracking via RabbitMQ by @GitHK in #4590
• 🐛Fix tests failing issue with newer docker compose (>2.21.0) by @sanderegg in #4716
• ✨Implement delete file endpoint by @bisgaard-itis in #4707
• 🐛 Fixes payment plugin environs (devops ⚠️) by @pcrespov in #4717
• ✨ Frontend: Connect payments and transactions by @odeimaiz in #4704
• ✨ Feature: Pop up Wallet/Resource Selection also when reopening a Project by @odeimaiz in #4718
• ✨ Feature: filter by shared-with-Everyone by @odeimaiz in #4719
• 🐛 Fixes fake payment-completion by @pcrespov in #4720
• ✨ Feature: listen to the ws paymentCompleted event by @odeimaiz in #4721
• 🎨 Feature: Payment status by @odeimaiz in #4726
• ✨ web-api: cancel payments (⚠️ 🗃️) by @pcrespov in #4723
• 🐛 correct service type storing in resource usage tracker by @matusdrobuliak66 in #4725
• 🐛 Fix e2e: TIP test by @odeimaiz in #4728
• ✨Adding system wide user preferences (1st round FrontendPreferences) by @GitHK in #4655
• ♻️Rabbitmq rpc: response shall not be jsonized by @sanderegg in #4730
• ✨ Frontend: S4L-Academia by @odeimaiz in #4729
• 🐛 fixed storage broken dsm cleaner was removing files when uploading to directories by @GitHK in #4732
• ✨ Frontend: Get and Patch Preferences by @odeimaiz in #4702
• ✨Computational backend: connect dv2 to clusters keeper for on-demand clusters (🗃️ + ⚠️devops) by @sanderegg in #4703
• ✨New groups extra properties to use on demand clusters in DB (🗃️) by @sanderegg in #4736
• ✨ Payments service: interface with payments-gateway (part 1) (devops ⚠️) by @pcrespov in #4715
• ♻️ Frontend: Refactoring & Cleanup by @odeimaiz in #4735
• ⬆️ 🔒️ Upgrades vulnerable libraries by @pcrespov in #4742
• ✨Enable on-demand clusters based on groups extra properties (⚠️ devops) by @sanderegg in #4738
• ♻️ Refactor products plugin before extension by @pcrespov in #4741
• ✨Comp backend: Clusters-keeper can create a cluster with no wallet ID defined by @sanderegg in #4746
• ✨Comp backend: allow to change to s3 links on on demand clusters (⚠️ devops) by @sanderegg in #4740
• ⬆️ Maintenance/upgrades tests+tools dependencies by @pcrespov in #4749
• 🐛Webserver: Improve slow synchronous calls by @sanderegg in #4753
• 🔨 Profile api server by @bisgaard-itis in #4754
• ✨ webserver API: exposes payment methods (🗃️) by @pcrespov in #4747
• ♻️ adjust container labels to new standard by @matusdrobuliak66 in #4761
• ✨ Frontend: Payment methods by @odeimaiz in #4759
• ♻️ Feedback on payments plugin and service by @pcrespov in #4763
• Bump docker/setup-buildx-action from 2 to 3 by @dependabot in #4769
• ✨ dynamic-sidecar adding support for metrics and on_shutdown events for user services (⚠️OPS) by @GitHK in #4697
• ♻️On-demand clusters: remove dask-gateway by @sanderegg in #4760
• ✨ Product prices API and table (🗃️ ) by @pcrespov in #4758
• ✨🗃️ Is922/resource usage publish updated wallet credits by @matusdrobuliak66 in #4762
• 🐛 Fixes link to payment form by @pcrespov in #4778
• 🐛Comp. backend: missing timestamps in log file by @sanderegg in #4771
• ♻️✨ Comp backend task state reporting fixed by @sanderegg in #4775
• 🐛Ensure the progress is set to None by @sanderegg in #4783

New Contributors

• @YuryHrytsuk made their first contribution in #4491

Full Changelog: v1.58.0...v1.59.0
Release Issue: #4623