Skip to content

always use StorageMonitor, also make StorageMonitor work for MSQ tasks#19048

Open
clintropolis wants to merge 3 commits intoapache:masterfrom
clintropolis:storage-monitor-improvements
Open

always use StorageMonitor, also make StorageMonitor work for MSQ tasks#19048
clintropolis wants to merge 3 commits intoapache:masterfrom
clintropolis:storage-monitor-improvements

Conversation

@clintropolis
Copy link
Member

Makes StorageMonitor, added in #18742, be always on. The low overhead seems worth the utility. Also added support for MSQ tasks to work correctly with this monitor, emitting extra taskId and groupId dimensions.

@github-actions github-actions bot added Area - Batch Ingestion Area - MSQ For multi stage queries - https://github.com/apache/druid/issues/12262 labels Feb 24, 2026
Copy link
Contributor

@capistrant capistrant left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

code looks good. should we add docs though? especially now that the monitor is always on, I think it makes sense to get the metrics into the metrics table. Perhaps not blocking, I can flip to approve if you'd like to do it as a follow up

@clintropolis
Copy link
Member Author

i think i'd rather do as a follow-up since none of the vsf stuff is documented yet and just get this as part of that. I think its mature enough to start documenting in the next release

Copy link
Contributor

@capistrant capistrant left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm on board with a broader follow up for all vsf related docs

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Area - Batch Ingestion Area - MSQ For multi stage queries - https://github.com/apache/druid/issues/12262 jacoco:skip

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants