Skip to content

I/O Timeouts can cause error and audit ingestion to silently stop#4791

Merged
ramonsmits merged 1 commit intorelease-6.3from
hanging-ingestion-6.3
Feb 10, 2025
Merged

I/O Timeouts can cause error and audit ingestion to silently stop#4791
ramonsmits merged 1 commit intorelease-6.3from
hanging-ingestion-6.3

Conversation

@ramonsmits
Copy link
Copy Markdown
Member

…ich can cause the ingestion to never used incoming context tasks and hang.

- Rectored to use BackgroundService
- Fix `catch (OperationCancelledException)` blocks to add `when` guards - only ignore cancellations set by caller
- Overriding Start and Stop to support graceful shutdown and improve intent and readability
- Ensure TrySetException is always set on exception
- Logging improvements around cancellation to inform that tasks got cancelled. Important when shutting down to diagnose where teardown "hangs".
@ramonsmits ramonsmits added this to the 6.3.1 milestone Feb 10, 2025
@ramonsmits ramonsmits changed the title OperationCancelledException can causes hanging ingestion, unnoticed failing tasks, and no logging of timeouts - 6.3 OperationCancelledException can causes hanging ingestion, unnoticed failing tasks, and no logging of timeouts Feb 10, 2025
@ramonsmits ramonsmits merged commit 62c9b20 into release-6.3 Feb 10, 2025
30 checks passed
@ramonsmits ramonsmits deleted the hanging-ingestion-6.3 branch February 10, 2025 13:06
@ramonsmits ramonsmits added the Bug label Feb 11, 2025
@andreasohlund andreasohlund changed the title OperationCancelledException can causes hanging ingestion, unnoticed failing tasks, and no logging of timeouts I/O Timeouts can cause error and audit ingestion to silently stop. Feb 11, 2025
@ramonsmits ramonsmits changed the title I/O Timeouts can cause error and audit ingestion to silently stop. I/O Timeouts can cause error and audit ingestion to silently stop Feb 11, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants