Skip to content

Conversation

@sanderegg
Copy link
Member

@sanderegg sanderegg commented Sep 15, 2025

What do these changes do?

This pull request introduces several improvements and bug fixes across multiple packages, focusing on enhanced error logging, improved logging messages, and minor code cleanups. The most significant changes are grouped below by theme.

Enhanced Error Logging and Troubleshooting

  • Added usage of the new create_troubleshootting_log_kwargs helper for more informative error logs in logging_utils.py
  • Changed several logging messages in the file upload completion workflow to provide clearer information, such as specifying when upload completion is required and clarifying error messages when upload is not ready. Also, increased the log level from debug to info for successful multipart upload completion.
  • Fixed minor formatting and consistency issues, such as trailing commas in function signatures and placement of pylint comments in logging_utils.py and the dynamic scheduler's director client.
  • Improved error reporting in the dynamic scheduler by including the unexpected status error in ServiceWaitingForManualInterventionError for better diagnostics.
  • Removed unused imports in the socket.io handlers for cleaner code.
  • fixed typo in create_troubleshooting_log_kwargs
  • improved speed of test_background_tasks by a factor 100

Related issue/s

How to test

Dev-ops

@sanderegg sanderegg added this to the Cheops milestone Sep 15, 2025
@sanderegg sanderegg requested a review from Copilot September 15, 2025 13:47
@sanderegg sanderegg self-assigned this Sep 15, 2025
@sanderegg sanderegg added the a:services-library issues on packages/service-libs label Sep 15, 2025
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This pull request introduces maintenance improvements focusing on enhanced error logging, cleaner code structure, and better troubleshooting capabilities across multiple services. The changes enhance error reporting with structured logging helpers, improve log message clarity, and clean up unused imports.

  • Enhanced error logging with create_troubleshootting_log_kwargs helper for better diagnostics
  • Improved socketio disconnect handler structure and simplified contextual error handling
  • Updated log messages for file upload completion workflow to be more informative

Reviewed Changes

Copilot reviewed 4 out of 4 changed files in this pull request and generated 2 comments.

File Description
services/web/server/src/simcore_service_webserver/socketio/_handlers.py Removed unused import and restructured disconnect handler with better error logging
services/dynamic-scheduler/src/simcore_service_dynamic_scheduler/services/director_v2/_public_client.py Added trailing commas and enhanced error reporting with status details
packages/simcore-sdk/src/simcore_sdk/node_ports_common/_filemanager_utils.py Improved log messages for upload completion workflow and increased log levels
packages/service-library/src/servicelib/logging_utils.py Added import for troubleshooting helper and enhanced exception logging

Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.

Copy link
Member

@pcrespov pcrespov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thx

@mergify
Copy link
Contributor

mergify bot commented Sep 15, 2025

🧪 CI Insights

Here's what we observed from your CI run for d307be3.

🟢 All jobs passed!

But CI Insights is watching 👀

@codecov
Copy link

codecov bot commented Sep 15, 2025

Codecov Report

❌ Patch coverage is 87.82609% with 14 lines in your changes missing coverage. Please review.
✅ Project coverage is 87.77%. Comparing base (fea215e) to head (d307be3).
⚠️ Report is 1 commits behind head on master.

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #8370      +/-   ##
==========================================
- Coverage   87.88%   87.77%   -0.11%     
==========================================
  Files        1950     1526     -424     
  Lines       75909    63283   -12626     
  Branches     1336      680     -656     
==========================================
- Hits        66711    55547   -11164     
+ Misses       8800     7501    -1299     
+ Partials      398      235     -163     
Flag Coverage Δ
integrationtests 63.94% <90.62%> (-0.01%) ⬇️
unittests 86.18% <85.21%> (-0.38%) ⬇️
Components Coverage Δ
pkg_aws_library ∅ <ø> (∅)
pkg_celery_library ∅ <ø> (∅)
pkg_dask_task_models_library ∅ <ø> (∅)
pkg_models_library ∅ <ø> (∅)
pkg_notifications_library ∅ <ø> (∅)
pkg_postgres_database ∅ <ø> (∅)
pkg_service_integration ∅ <ø> (∅)
pkg_service_library 72.58% <79.48%> (-0.02%) ⬇️
pkg_settings_library ∅ <ø> (∅)
pkg_simcore_sdk 84.99% <100.00%> (ø)
agent 93.53% <ø> (ø)
api_server 91.93% <100.00%> (ø)
autoscaling 95.78% <ø> (ø)
catalog 92.36% <ø> (ø)
clusters_keeper 99.13% <ø> (ø)
dask_sidecar 92.37% <ø> (+0.78%) ⬆️
datcore_adapter 97.94% <ø> (ø)
director 75.81% <ø> (-0.09%) ⬇️
director_v2 90.98% <100.00%> (+0.06%) ⬆️
dynamic_scheduler 96.27% <ø> (ø)
dynamic_sidecar 90.46% <100.00%> (ø)
efs_guardian 89.62% <ø> (ø)
invitations 91.44% <100.00%> (ø)
payments 92.62% <100.00%> (+<0.01%) ⬆️
resource_usage_tracker 91.76% <100.00%> (ø)
storage 86.45% <ø> (-0.09%) ⬇️
webclient ∅ <ø> (∅)
webserver 87.96% <89.09%> (-0.01%) ⬇️

Continue to review full report in Codecov by Sentry.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update fea215e...d307be3. Read the comment docs.

🚀 New features to boost your workflow:
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@sanderegg sanderegg force-pushed the maintenance/fix-multiple-issues branch from 097ec75 to ee0c25a Compare September 16, 2025 08:34
Copy link
Contributor

@GitHK GitHK left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks

@sanderegg sanderegg force-pushed the maintenance/fix-multiple-issues branch 4 times, most recently from a5143f5 to af5e69b Compare September 17, 2025 05:28
@sanderegg sanderegg force-pushed the maintenance/fix-multiple-issues branch from a56bedb to 8dff140 Compare September 17, 2025 07:17
@sanderegg sanderegg added 🤖-automerge marks PR as ready to be merged for Mergify t:maintenance Some planned maintenance work labels Sep 17, 2025
@sanderegg
Copy link
Member Author

@mergify queue

@mergify
Copy link
Contributor

mergify bot commented Sep 17, 2025

queue

🛑 Configuration not compatible with a branch protection setting

The branch protection setting Require branches to be up to date before merging is not compatible with max_parallel_checks>1, queue_conditions != merge_conditions and must be unset.

@sanderegg sanderegg force-pushed the maintenance/fix-multiple-issues branch from dbe60a7 to d307be3 Compare September 17, 2025 07:43
@sonarqubecloud
Copy link

@sanderegg sanderegg merged commit c6d5810 into ITISFoundation:master Sep 17, 2025
95 checks passed
@sanderegg sanderegg deleted the maintenance/fix-multiple-issues branch September 17, 2025 08:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

🤖-automerge marks PR as ready to be merged for Mergify a:services-library issues on packages/service-libs t:maintenance Some planned maintenance work

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants