Skip to content

Conversation

yujun777
Copy link
Contributor

cherry pick from #54133

@yujun777 yujun777 requested a review from morrySnow as a code owner August 11, 2025 02:27
@yujun777
Copy link
Contributor Author

run buildall

@Thearas
Copy link
Contributor

Thearas commented Aug 11, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@doris-robot
Copy link

TPC-H: Total hot run time: 32773 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit dd3f0616f9c1d9bd7fa02ce99768cb5e23fb6308, data reload: false

------ Round 1 ----------------------------------
q1	17579	5540	5673	5540
q2	2027	391	309	309
q3	12363	1218	744	744
q4	10319	860	448	448
q5	9371	2406	2154	2154
q6	184	163	134	134
q7	883	731	616	616
q8	9336	1425	1161	1161
q9	5244	4922	4848	4848
q10	6769	2245	1811	1811
q11	481	299	246	246
q12	330	348	203	203
q13	17765	3612	3016	3016
q14	227	228	219	219
q15	524	475	461	461
q16	422	425	370	370
q17	585	858	352	352
q18	6963	6385	6459	6385
q19	1215	940	548	548
q20	338	341	205	205
q21	2850	2324	2001	2001
q22	1054	1028	1002	1002
Total cold run time: 106829 ms
Total hot run time: 32773 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5514	5481	5551	5481
q2	242	322	240	240
q3	2196	2611	2352	2352
q4	1316	1787	1405	1405
q5	4391	4985	4959	4959
q6	169	160	130	130
q7	2049	1964	1853	1853
q8	2601	2841	2652	2652
q9	7263	7229	7190	7190
q10	3033	3239	2782	2782
q11	574	522	488	488
q12	695	782	632	632
q13	3422	3802	3157	3157
q14	280	299	277	277
q15	522	478	475	475
q16	439	479	422	422
q17	1215	1720	1260	1260
q18	7636	7532	7328	7328
q19	813	1151	1092	1092
q20	1977	2029	1916	1916
q21	5304	4858	4469	4469
q22	1084	1082	1038	1038
Total cold run time: 52735 ms
Total hot run time: 51598 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191607 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit dd3f0616f9c1d9bd7fa02ce99768cb5e23fb6308, data reload: false

query1	948	378	377	377
query2	6131	1966	1959	1959
query3	8706	199	195	195
query4	33909	23737	23251	23251
query5	3549	606	441	441
query6	306	210	183	183
query7	4198	479	317	317
query8	306	228	222	222
query9	9390	2561	2542	2542
query10	469	321	252	252
query11	18464	15612	15175	15175
query12	152	107	104	104
query13	1537	526	419	419
query14	9827	6717	6783	6717
query15	233	189	180	180
query16	8044	645	532	532
query17	1566	781	575	575
query18	2194	411	319	319
query19	203	203	162	162
query20	134	124	123	123
query21	209	125	106	106
query22	4688	4679	4515	4515
query23	34945	34063	34419	34063
query24	7469	2694	2694	2694
query25	548	496	434	434
query26	1171	283	172	172
query27	2374	477	370	370
query28	5419	2209	2179	2179
query29	814	596	473	473
query30	246	191	162	162
query31	1035	933	857	857
query32	98	60	58	58
query33	544	369	364	364
query34	771	842	507	507
query35	784	809	722	722
query36	1000	1043	941	941
query37	102	97	68	68
query38	4011	3950	3901	3901
query39	1550	1460	1472	1460
query40	201	112	101	101
query41	55	47	48	47
query42	122	106	107	106
query43	516	514	498	498
query44	1350	818	826	818
query45	187	179	171	171
query46	872	1077	671	671
query47	1978	2014	1929	1929
query48	406	417	344	344
query49	773	512	439	439
query50	675	678	424	424
query51	7467	7288	7324	7288
query52	99	101	91	91
query53	225	256	190	190
query54	538	524	479	479
query55	83	87	83	83
query56	278	268	253	253
query57	1286	1287	1203	1203
query58	243	221	219	219
query59	3100	3242	3144	3144
query60	294	292	269	269
query61	125	123	122	122
query62	810	737	702	702
query63	227	188	191	188
query64	4500	997	627	627
query65	3355	3265	3297	3265
query66	1044	410	314	314
query67	16418	15691	15578	15578
query68	7684	829	529	529
query69	483	300	261	261
query70	1188	1143	1150	1143
query71	379	308	262	262
query72	5147	3777	3758	3758
query73	635	732	353	353
query74	10610	9463	9146	9146
query75	3260	3155	2615	2615
query76	3250	1165	746	746
query77	602	348	265	265
query78	10314	10365	9517	9517
query79	3567	897	581	581
query80	762	512	433	433
query81	507	256	214	214
query82	582	117	94	94
query83	161	164	148	148
query84	241	101	77	77
query85	803	357	291	291
query86	389	314	310	310
query87	4300	4298	4225	4225
query88	5172	2376	2331	2331
query89	411	339	283	283
query90	1785	190	188	188
query91	138	134	112	112
query92	62	53	50	50
query93	2534	853	533	533
query94	682	391	310	310
query95	335	274	267	267
query96	480	600	279	279
query97	3173	3326	3140	3140
query98	225	215	199	199
query99	1587	1407	1293	1293
Total cold run time: 296719 ms
Total hot run time: 191607 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 28.76 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit dd3f0616f9c1d9bd7fa02ce99768cb5e23fb6308, data reload: false

query1	0.03	0.03	0.03
query2	0.06	0.03	0.04
query3	0.23	0.07	0.07
query4	1.62	0.11	0.11
query5	0.52	0.50	0.52
query6	1.13	0.73	0.71
query7	0.02	0.02	0.02
query8	0.05	0.03	0.04
query9	0.57	0.51	0.50
query10	0.54	0.55	0.56
query11	0.14	0.10	0.10
query12	0.14	0.11	0.10
query13	0.61	0.59	0.58
query14	0.78	0.79	0.79
query15	0.84	0.82	0.81
query16	0.38	0.39	0.37
query17	1.01	1.07	1.05
query18	0.23	0.21	0.22
query19	1.89	1.81	1.76
query20	0.01	0.01	0.01
query21	15.39	0.92	0.58
query22	0.74	0.74	0.64
query23	15.17	1.42	0.55
query24	2.95	1.33	0.99
query25	0.24	0.11	0.19
query26	0.43	0.14	0.13
query27	0.05	0.05	0.06
query28	13.09	1.03	0.43
query29	12.57	3.99	3.28
query30	0.25	0.09	0.07
query31	2.82	0.61	0.39
query32	3.22	0.53	0.46
query33	2.99	3.05	2.97
query34	16.69	5.21	4.50
query35	4.56	4.51	4.58
query36	0.62	0.49	0.47
query37	0.09	0.06	0.06
query38	0.04	0.03	0.04
query39	0.04	0.02	0.02
query40	0.16	0.13	0.13
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.04	0.02	0.03
Total cold run time: 103.06 s
Total hot run time: 28.76 s

@yujun777
Copy link
Contributor Author

run feut

@yujun777
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32675 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ac1f33189f57ac1e47a472df78bf56f2df18a9d2, data reload: false

------ Round 1 ----------------------------------
q1	17615	5503	5494	5494
q2	2029	385	279	279
q3	11792	1228	757	757
q4	10299	863	449	449
q5	9172	2393	2122	2122
q6	188	165	133	133
q7	897	742	608	608
q8	9326	1418	1131	1131
q9	5313	4982	4960	4960
q10	6762	2263	1866	1866
q11	478	276	265	265
q12	349	358	206	206
q13	17763	3590	2984	2984
q14	224	224	203	203
q15	520	454	449	449
q16	427	413	369	369
q17	584	854	362	362
q18	6814	6373	6385	6373
q19	1200	959	559	559
q20	337	343	199	199
q21	2830	2175	1936	1936
q22	1059	1032	971	971
Total cold run time: 105978 ms
Total hot run time: 32675 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5551	5543	5476	5476
q2	239	324	238	238
q3	2289	2628	2309	2309
q4	1299	1828	1387	1387
q5	4394	4945	4876	4876
q6	170	165	135	135
q7	2044	1977	1817	1817
q8	2600	2865	2687	2687
q9	7271	7194	7324	7194
q10	3084	3370	2774	2774
q11	572	503	514	503
q12	697	786	643	643
q13	3521	3857	3221	3221
q14	284	297	274	274
q15	511	493	467	467
q16	448	508	439	439
q17	1242	1698	1294	1294
q18	7546	7395	7254	7254
q19	760	1105	1113	1105
q20	2013	2051	1873	1873
q21	5357	4936	4699	4699
q22	1098	1054	1003	1003
Total cold run time: 52990 ms
Total hot run time: 51668 ms

@yujun777
Copy link
Contributor Author

run feut

@doris-robot
Copy link

TPC-DS: Total hot run time: 191076 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ac1f33189f57ac1e47a472df78bf56f2df18a9d2, data reload: false

query1	943	404	406	404
query2	6236	1936	1916	1916
query3	8680	194	195	194
query4	33415	23658	23481	23481
query5	3655	594	460	460
query6	294	193	185	185
query7	4207	488	315	315
query8	296	234	230	230
query9	9442	2546	2532	2532
query10	480	332	254	254
query11	17983	15439	15151	15151
query12	161	107	108	107
query13	1547	532	422	422
query14	9579	6559	7204	6559
query15	242	191	171	171
query16	8057	658	485	485
query17	1570	787	620	620
query18	2128	411	342	342
query19	227	186	169	169
query20	120	119	117	117
query21	206	134	109	109
query22	4497	4570	4353	4353
query23	35053	33851	33797	33797
query24	7340	2686	2717	2686
query25	545	485	434	434
query26	925	288	172	172
query27	1965	481	350	350
query28	5099	2189	2177	2177
query29	741	622	469	469
query30	245	189	165	165
query31	1018	962	818	818
query32	89	62	61	61
query33	500	375	337	337
query34	759	868	535	535
query35	811	815	742	742
query36	1016	1053	986	986
query37	104	96	75	75
query38	4021	3986	3932	3932
query39	1532	1478	1476	1476
query40	207	113	115	113
query41	51	52	47	47
query42	119	105	102	102
query43	505	545	497	497
query44	1312	812	803	803
query45	183	175	172	172
query46	881	1055	674	674
query47	1964	2039	1960	1960
query48	410	416	343	343
query49	726	496	404	404
query50	661	698	458	458
query51	7437	7432	7258	7258
query52	98	102	94	94
query53	222	257	187	187
query54	540	546	477	477
query55	80	84	75	75
query56	266	273	264	264
query57	1245	1264	1204	1204
query58	257	222	217	217
query59	3152	3203	3044	3044
query60	293	286	274	274
query61	134	143	123	123
query62	787	755	702	702
query63	231	197	193	193
query64	4040	983	653	653
query65	3367	3256	3334	3256
query66	982	421	316	316
query67	16452	15720	15399	15399
query68	7641	822	544	544
query69	482	304	263	263
query70	1169	1137	1138	1137
query71	424	290	252	252
query72	5166	3717	3787	3717
query73	642	748	344	344
query74	10579	9353	9042	9042
query75	3909	3146	2670	2670
query76	3578	1174	761	761
query77	762	350	276	276
query78	10237	10347	9563	9563
query79	5935	883	590	590
query80	634	518	439	439
query81	475	254	218	218
query82	228	122	87	87
query83	170	166	145	145
query84	290	99	80	80
query85	748	354	296	296
query86	346	323	294	294
query87	4308	4329	4229	4229
query88	4328	2398	2384	2384
query89	423	341	294	294
query90	2040	188	187	187
query91	137	156	112	112
query92	66	52	52	52
query93	3691	893	536	536
query94	651	416	258	258
query95	344	279	266	266
query96	478	614	279	279
query97	3215	3264	3168	3168
query98	230	207	202	202
query99	1428	1436	1294	1294
Total cold run time: 297084 ms
Total hot run time: 191076 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 28.71 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ac1f33189f57ac1e47a472df78bf56f2df18a9d2, data reload: false

query1	0.03	0.04	0.03
query2	0.06	0.03	0.03
query3	0.23	0.07	0.07
query4	1.63	0.10	0.10
query5	0.51	0.52	0.53
query6	1.13	0.74	0.73
query7	0.02	0.02	0.01
query8	0.05	0.03	0.04
query9	0.56	0.51	0.50
query10	0.56	0.55	0.59
query11	0.15	0.11	0.11
query12	0.14	0.11	0.10
query13	0.62	0.61	0.58
query14	0.77	0.81	0.79
query15	0.83	0.83	0.82
query16	0.39	0.39	0.38
query17	1.00	1.01	1.02
query18	0.23	0.21	0.21
query19	1.95	1.88	1.89
query20	0.02	0.01	0.01
query21	15.43	0.93	0.58
query22	0.75	0.87	0.58
query23	15.13	1.42	0.60
query24	3.17	1.32	0.60
query25	0.13	0.16	0.23
query26	0.34	0.15	0.13
query27	0.07	0.04	0.05
query28	13.11	1.00	0.43
query29	12.61	3.95	3.32
query30	0.25	0.09	0.06
query31	2.83	0.59	0.38
query32	3.22	0.53	0.47
query33	2.98	3.03	3.03
query34	16.70	5.08	4.56
query35	4.54	4.60	4.52
query36	0.64	0.49	0.48
query37	0.09	0.07	0.06
query38	0.05	0.04	0.04
query39	0.03	0.03	0.02
query40	0.17	0.12	0.12
query41	0.07	0.02	0.02
query42	0.03	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 103.25 s
Total hot run time: 28.71 s

@yujun777
Copy link
Contributor Author

run p0

@morrySnow morrySnow merged commit 901dcad into apache:branch-3.1 Aug 13, 2025
22 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants