Skip to content

[Enhancement] print the detail of workload group in query profile #58783

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
Tech-Circle-48 wants to merge 8 commits into
base: master
Choose a base branch
from
Open

[Enhancement] print the detail of workload group in query profile #58783

Tech-Circle-48 wants to merge 8 commits into from
+339 −143

Conversation

@Tech-Circle-48
Copy link
Contributor

@Tech-Circle-48 Tech-Circle-48 commented Dec 6, 2025 •
edited
Loading

What problem does this PR solve?

Issue Number: close #58048

Related PR: #xxx

Problem Summary:
Currently, the query profile does not show which Workload Group is used by the query, nor does it contain any configuration details of the Workload Group.
This makes it difficult for users to diagnose performance issues related to resource control, such as CPU share, concurrency restriction, I/O bandwidth throttling, memory watermark, and queue behavior.

This PR enhances the query profile by:
• Printing the name of the Workload Group used by the query
• Printing the detailed configuration of that Workload Group, including:
• CPU related settings (cpu share, cpu hard limit)
• Memory limits and watermarks
• Query concurrency / queue settings
• Scan thread settings
• I/O throughput limits (read bytes per second, remote read bytes per second)
• Tag / compute group info

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented Dec 6, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@Tech-Circle-48 Tech-Circle-48 force-pushed the s7 branch 2 times, most recently from 188c844 to 691c69b Compare December 25, 2025 02:14
HappenLee
HappenLee approved these changes Jan 1, 2026
View reviewed changes
Copy link
Contributor

@HappenLee HappenLee left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@HappenLee
Copy link
Contributor

HappenLee commented Jan 1, 2026

run buildall

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jan 1, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Jan 1, 2026

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

github-actions bot commented Jan 1, 2026

PR approved by anyone and no changes requested.

@doris-robot
Copy link

doris-robot commented Jan 1, 2026

TPC-H: Total hot run time: 31862 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5c862d7589d4056781dc86fc198ebae1e7d9a47e, data reload: false

------ Round 1 ----------------------------------
q1	17644	4274	4074	4074
q2	2074	351	236	236
q3	10161	1262	765	765
q4	10220	927	321	321
q5	7564	2138	1843	1843
q6	188	170	139	139
q7	923	809	654	654
q8	9269	1379	1105	1105
q9	5134	4823	4726	4726
q10	6785	1794	1399	1399
q11	506	306	293	293
q12	676	728	584	584
q13	17794	3811	3118	3118
q14	308	313	275	275
q15	584	509	505	505
q16	734	707	650	650
q17	754	768	641	641
q18	7098	6423	6361	6361
q19	1086	965	598	598
q20	406	368	248	248
q21	3110	2533	2347	2347
q22	1050	1035	980	980
Total cold run time: 104068 ms
Total hot run time: 31862 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4108	4056	4018	4018
q2	314	389	313	313
q3	2071	2578	2243	2243
q4	1289	1777	1324	1324
q5	4086	4036	4116	4036
q6	204	164	124	124
q7	1895	1752	2049	1752
q8	2546	2494	2371	2371
q9	7239	7105	7176	7105
q10	2498	2687	2347	2347
q11	578	483	465	465
q12	700	765	654	654
q13	3657	4109	3484	3484
q14	306	287	269	269
q15	547	514	499	499
q16	652	719	677	677
q17	1121	1294	1366	1294
q18	8143	7641	7928	7641
q19	918	924	905	905
q20	2001	2048	1915	1915
q21	4800	4557	4392	4392
q22	1181	1024	993	993
Total cold run time: 50854 ms
Total hot run time: 48821 ms

@doris-robot
Copy link

doris-robot commented Jan 1, 2026

TPC-DS: Total hot run time: 173423 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5c862d7589d4056781dc86fc198ebae1e7d9a47e, data reload: false

query5	4400	606	448	448
query6	338	244	225	225
query7	4218	490	274	274
query8	353	255	242	242
query9	8764	2614	2630	2614
query10	521	365	336	336
query11	15120	15060	14840	14840
query12	171	118	118	118
query13	1265	510	390	390
query14	5847	3058	2707	2707
query14_1	2626	2597	2613	2597
query15	201	195	171	171
query16	1008	473	441	441
query17	1117	704	590	590
query18	2426	449	346	346
query19	238	226	198	198
query20	122	119	119	119
query21	217	139	122	122
query22	3965	4037	4008	4008
query23	15973	15657	15331	15331
query23_1	15424	15394	15425	15394
query24	7468	1631	1219	1219
query24_1	1235	1219	1217	1217
query25	571	490	424	424
query26	1249	284	168	168
query27	2732	482	296	296
query28	4559	2191	2183	2183
query29	793	564	454	454
query30	316	242	216	216
query31	796	650	564	564
query32	83	67	69	67
query33	546	371	296	296
query34	919	944	527	527
query35	793	792	766	766
query36	881	903	815	815
query37	130	96	77	77
query38	2737	2715	2656	2656
query39	772	754	736	736
query39_1	708	705	710	705
query40	217	133	115	115
query41	69	62	61	61
query42	101	104	99	99
query43	447	452	411	411
query44	1389	758	757	757
query45	185	179	172	172
query46	915	1020	596	596
query47	1471	1484	1423	1423
query48	315	335	267	267
query49	593	414	323	323
query50	666	282	201	201
query51	3751	4023	3713	3713
query52	99	103	99	99
query53	295	323	267	267
query54	275	270	267	267
query55	76	73	74	73
query56	275	288	281	281
query57	1026	1011	906	906
query58	264	289	244	244
query59	2093	2124	2113	2113
query60	313	301	284	284
query61	161	157	157	157
query62	378	370	304	304
query63	310	265	262	262
query64	4960	1300	994	994
query65	3815	3793	3676	3676
query66	1444	459	310	310
query67	15762	15279	15237	15237
query68	7045	1053	729	729
query69	508	347	318	318
query70	1050	912	915	912
query71	373	302	273	273
query72	6038	3691	3479	3479
query73	778	775	309	309
query74	8800	8726	8655	8655
query75	2981	2883	2483	2483
query76	3847	1142	667	667
query77	544	384	272	272
query78	9838	9855	9170	9170
query79	1448	959	605	605
query80	681	580	481	481
query81	502	266	223	223
query82	231	144	108	108
query83	260	256	243	243
query84	265	113	104	104
query85	937	521	450	450
query86	409	320	321	320
query87	2897	2906	2741	2741
query88	3249	2300	2286	2286
query89	400	341	333	333
query90	2026	153	146	146
query91	179	179	136	136
query92	77	66	65	65
query93	1046	938	574	574
query94	568	321	290	290
query95	576	333	313	313
query96	604	473	208	208
query97	2345	2374	2313	2313
query98	221	204	198	198
query99	585	595	515	515
Total cold run time: 254183 ms
Total hot run time: 173423 ms

@doris-robot
Copy link

doris-robot commented Jan 1, 2026

ClickBench: Total hot run time: 26.94 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5c862d7589d4056781dc86fc198ebae1e7d9a47e, data reload: false

query1	0.05	0.05	0.05
query2	0.10	0.05	0.05
query3	0.26	0.10	0.09
query4	1.61	0.12	0.11
query5	0.29	0.26	0.26
query6	1.15	0.67	0.65
query7	0.03	0.03	0.03
query8	0.05	0.04	0.04
query9	0.56	0.51	0.51
query10	0.55	0.54	0.55
query11	0.15	0.11	0.12
query12	0.16	0.13	0.13
query13	0.62	0.61	0.60
query14	1.00	0.98	1.00
query15	0.80	0.78	0.81
query16	0.39	0.40	0.42
query17	1.04	1.00	0.96
query18	0.23	0.21	0.23
query19	1.84	1.88	1.91
query20	0.01	0.01	0.02
query21	15.45	0.28	0.14
query22	4.78	0.04	0.05
query23	15.96	0.29	0.10
query24	1.03	0.68	0.19
query25	0.08	0.06	0.06
query26	0.15	0.14	0.14
query27	0.07	0.06	0.06
query28	3.39	1.06	0.88
query29	12.64	3.90	3.17
query30	0.28	0.14	0.12
query31	2.81	0.62	0.38
query32	3.23	0.56	0.47
query33	2.94	3.11	3.05
query34	16.76	5.10	4.42
query35	4.50	4.48	4.49
query36	0.64	0.50	0.48
query37	0.11	0.08	0.07
query38	0.07	0.04	0.04
query39	0.04	0.03	0.03
query40	0.16	0.15	0.13
query41	0.09	0.03	0.03
query42	0.05	0.04	0.03
query43	0.04	0.04	0.04
Total cold run time: 96.16 s
Total hot run time: 26.94 s

@hello-stephen
Copy link
Contributor

hello-stephen commented Jan 1, 2026

FE UT Coverage Report

Increment line coverage 51.87% (97/187) 🎉
Increment coverage report
Complete coverage report

@hello-stephen
Copy link
Contributor

hello-stephen commented Jan 1, 2026

FE Regression Coverage Report

Increment line coverage 45.99% (86/187) 🎉
Increment coverage report
Complete coverage report

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@HappenLee HappenLee HappenLee approved these changes

Assignees

No one assigned

Labels

approved Indicates a PR has been approved by one committer. reviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

[Enhancement] print the detail of workload group in query profile

5 participants

@Tech-Circle-48 @Thearas @HappenLee @doris-robot @hello-stephen