Skip to content

Conversation

@mrhhsg
Copy link
Member

@mrhhsg mrhhsg commented Mar 28, 2025

What problem does this PR solve?

Pick #37990 and #49571

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@mrhhsg
Copy link
Member Author

mrhhsg commented Mar 28, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49692 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1af4b452ab4df49b717ac1b261e1ff58b72013cd, data reload: false

------ Round 1 ----------------------------------
q1	17686	4390	4372	4372
q2	2072	154	150	150
q3	10436	1922	1884	1884
q4	10343	1294	1318	1294
q5	8759	3904	3978	3904
q6	231	126	123	123
q7	2030	1628	1616	1616
q8	9319	2727	2703	2703
q9	10561	10194	10215	10194
q10	8645	3540	3528	3528
q11	437	256	253	253
q12	477	309	310	309
q13	18348	4017	4080	4017
q14	358	330	330	330
q15	520	471	474	471
q16	548	453	470	453
q17	1142	957	958	957
q18	7269	6903	6885	6885
q19	1667	1562	1474	1474
q20	521	311	311	311
q21	4496	4141	4067	4067
q22	516	397	405	397
Total cold run time: 116381 ms
Total hot run time: 49692 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4363	4284	4314	4284
q2	326	226	221	221
q3	4156	4188	4148	4148
q4	2754	2735	2731	2731
q5	7241	7177	7156	7156
q6	240	123	122	122
q7	3247	2882	2816	2816
q8	4375	4467	4464	4464
q9	14265	14049	13890	13890
q10	4289	4286	4274	4274
q11	751	681	684	681
q12	1025	860	852	852
q13	6570	3713	3775	3713
q14	452	424	425	424
q15	499	459	462	459
q16	654	593	590	590
q17	3792	3830	3829	3829
q18	8846	8730	8800	8730
q19	1720	1664	1697	1664
q20	2379	2120	2119	2119
q21	8386	8380	8463	8380
q22	1040	939	926	926
Total cold run time: 81370 ms
Total hot run time: 76473 ms

@doris-robot
Copy link

BE UT Coverage Report

Increment line coverage 20.00% (6/30) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 38.56% (8313/21557)
Line Coverage 30.26% (68766/227238)
Region Coverage 29.68% (35411/119291)
Branch Coverage 25.44% (18201/71536)

@doris-robot
Copy link

TPC-DS: Total hot run time: 212718 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 1af4b452ab4df49b717ac1b261e1ff58b72013cd, data reload: false

query1	935	426	381	381
query2	6560	2135	2281	2135
query3	6924	199	203	199
query4	23291	21534	21697	21534
query5	19731	6555	6558	6555
query6	289	222	242	222
query7	4336	311	311	311
query8	274	256	257	256
query9	3102	2663	2620	2620
query10	469	317	304	304
query11	15570	15015	15380	15015
query12	128	81	75	75
query13	1039	457	449	449
query14	17768	13496	13141	13141
query15	386	220	234	220
query16	6481	282	268	268
query17	1762	928	922	922
query18	898	319	315	315
query19	215	156	153	153
query20	107	99	102	99
query21	189	99	96	96
query22	5208	5082	5015	5015
query23	34226	33686	33672	33672
query24	7719	6264	6351	6264
query25	539	431	436	431
query26	1232	166	165	165
query27	2291	302	288	288
query28	6074	2279	2266	2266
query29	2978	2861	2795	2795
query30	248	168	170	168
query31	961	739	748	739
query32	75	60	61	60
query33	439	274	265	265
query34	861	484	484	484
query35	1158	980	897	897
query36	1297	1333	1179	1179
query37	94	62	62	62
query38	3086	2970	2956	2956
query39	1378	1326	1341	1326
query40	313	97	94	94
query41	40	40	38	38
query42	93	93	78	78
query43	704	576	553	553
query44	1198	713	728	713
query45	243	233	229	229
query46	1227	944	977	944
query47	1995	1772	1962	1772
query48	512	425	418	418
query49	656	382	396	382
query50	853	639	650	639
query51	4807	4665	4629	4629
query52	89	78	86	78
query53	233	188	186	186
query54	2661	2494	2509	2494
query55	90	87	84	84
query56	233	210	214	210
query57	1268	1227	1179	1179
query58	238	206	191	191
query59	3494	3427	3400	3400
query60	244	199	206	199
query61	97	95	95	95
query62	866	473	441	441
query63	203	178	175	175
query64	3492	1550	1519	1519
query65	3660	3548	3561	3548
query66	786	458	396	396
query67	18913	16208	14850	14850
query68	9473	670	666	666
query69	508	290	263	263
query70	1625	1341	1442	1341
query71	407	322	324	322
query72	6897	4896	5003	4896
query73	746	322	321	321
query74	6265	5791	5836	5791
query75	5187	3701	3722	3701
query76	5271	1152	1199	1152
query77	914	254	260	254
query78	12974	11690	12555	11690
query79	8612	648	656	648
query80	1224	418	399	399
query81	497	237	242	237
query82	1157	98	101	98
query83	162	136	133	133
query84	256	72	72	72
query85	916	326	330	326
query86	324	328	300	300
query87	3269	3033	3055	3033
query88	4568	2324	2300	2300
query89	448	285	289	285
query90	1900	216	218	216
query91	160	132	127	127
query92	62	54	51	51
query93	5479	577	568	568
query94	714	218	214	214
query95	2097	2022	1658	1658
query96	664	330	318	318
query97	6585	6411	6451	6411
query98	242	206	195	195
query99	3062	896	992	896
Total cold run time: 322191 ms
Total hot run time: 212718 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.8 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 1af4b452ab4df49b717ac1b261e1ff58b72013cd, data reload: false

query1	0.03	0.03	0.02
query2	0.07	0.02	0.02
query3	0.24	0.04	0.04
query4	1.79	0.08	0.07
query5	0.53	0.53	0.52
query6	1.27	0.61	0.62
query7	0.02	0.01	0.00
query8	0.03	0.03	0.02
query9	0.52	0.49	0.49
query10	0.55	0.54	0.54
query11	0.12	0.09	0.09
query12	0.12	0.10	0.09
query13	0.63	0.62	0.61
query14	0.80	0.79	0.80
query15	0.78	0.77	0.77
query16	0.38	0.36	0.36
query17	1.03	1.02	0.99
query18	0.22	0.24	0.25
query19	1.92	1.83	1.85
query20	0.01	0.00	0.01
query21	15.46	0.54	0.54
query22	2.29	2.77	1.56
query23	17.03	1.13	1.15
query24	5.38	0.86	0.88
query25	0.36	0.12	0.07
query26	0.50	0.15	0.16
query27	0.04	0.03	0.03
query28	7.98	0.83	0.77
query29	12.73	2.19	2.16
query30	0.59	0.54	0.52
query31	2.79	0.40	0.38
query32	3.34	0.50	0.50
query33	3.12	3.07	3.08
query34	15.27	4.84	4.84
query35	4.90	4.90	4.87
query36	1.06	1.01	1.02
query37	0.06	0.04	0.05
query38	0.04	0.02	0.02
query39	0.02	0.02	0.01
query40	0.16	0.14	0.14
query41	0.07	0.01	0.02
query42	0.03	0.02	0.01
query43	0.02	0.01	0.02
Total cold run time: 104.3 s
Total hot run time: 30.8 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 1af4b452ab4df49b717ac1b261e1ff58b72013cd with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       21.8 seconds inserted 10000000 Rows, about 458K ops/s

@yiguolei
Copy link
Contributor

run buildall

@doris-robot
Copy link

BE UT Coverage Report

Increment line coverage 20.00% (6/30) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 38.55% (8311/21557)
Line Coverage 30.25% (68745/227245)
Region Coverage 29.67% (35397/119293)
Branch Coverage 25.43% (18194/71538)

@yiguolei yiguolei merged commit 2891f80 into apache:branch-2.0 Jun 20, 2025
19 of 24 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants