Skip to content

[feature](iceberg)support read iceberg v3 deletion vector. #59272

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
hubgeter wants to merge 2 commits into
base: master
Choose a base branch
from
Open

[feature](iceberg)support read iceberg v3 deletion vector. #59272

hubgeter wants to merge 2 commits into from
+873 −205

Conversation

@hubgeter
Copy link
Contributor

@hubgeter hubgeter commented Dec 23, 2025 •
edited
Loading

What problem does this PR solve?

Problem Summary:

This pull request primarily supports reading the Iceberg v3 deletion vector.
Additionally, for easier testing, I upgraded the Docker Iceberg version to v1.10.0.

Release note

Supports read Iceberg v3 deletion vector.

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented Dec 23, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@hubgeter
Copy link
Contributor Author

hubgeter commented Dec 23, 2025

run buildall

2 similar comments
@hubgeter
Copy link
Contributor Author

hubgeter commented Dec 23, 2025

run buildall

@hubgeter
Copy link
Contributor Author

hubgeter commented Dec 31, 2025

run buildall

@hello-stephen
Copy link
Contributor

hello-stephen commented Dec 31, 2025

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 79.52% (1774/2231)
Line Coverage 64.80% (31405/48466)
Region Coverage 65.35% (15620/23901)
Branch Coverage 56.01% (8314/14844)

@hello-stephen
Copy link
Contributor

hello-stephen commented Dec 31, 2025

BE UT Coverage Report

Increment line coverage 0.89% (2/224) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 53.39% (18965/35520)
Line Coverage 39.25% (175996/448395)
Region Coverage 33.81% (136127/402566)
Branch Coverage 34.76% (58809/169200)

@hello-stephen
Copy link
Contributor

hello-stephen commented Dec 31, 2025

BE Regression && UT Coverage Report

Increment line coverage 0.89% (2/224) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 72.17% (25060/34725)
Line Coverage 58.88% (263291/447203)
Region Coverage 53.71% (218466/406729)
Branch Coverage 55.30% (93883/169762)

@hubgeter hubgeter force-pushed the update_docker_iceberg_version branch from 13f4949 to 47cd2f0 Compare January 1, 2026 04:47
@hubgeter
Copy link
Contributor Author

hubgeter commented Jan 1, 2026

run buildall

@doris-robot
Copy link

doris-robot commented Jan 1, 2026

TPC-H: Total hot run time: 32026 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 47cd2f013fd6f2bae84aa2aa309f88dc812b3102, data reload: false

------ Round 1 ----------------------------------
q1	16737	4189	4025	4025
q2	2006	347	242	242
q3	9883	1269	743	743
q4	10084	812	320	320
q5	7632	2130	1926	1926
q6	199	175	147	147
q7	973	815	677	677
q8	9266	1364	1173	1173
q9	5181	4674	4666	4666
q10	6780	1780	1380	1380
q11	493	312	293	293
q12	707	724	602	602
q13	17792	3866	3110	3110
q14	282	303	274	274
q15	569	512	508	508
q16	681	679	623	623
q17	694	754	667	667
q18	6670	6483	6378	6378
q19	1095	966	646	646
q20	407	369	256	256
q21	3191	2588	2389	2389
q22	1079	1032	981	981
Total cold run time: 102401 ms
Total hot run time: 32026 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4090	4025	4047	4025
q2	327	399	307	307
q3	2070	2626	2203	2203
q4	1304	1732	1288	1288
q5	4079	3945	4016	3945
q6	214	170	131	131
q7	1902	1792	1690	1690
q8	2771	2440	2408	2408
q9	7195	7159	7092	7092
q10	2492	2753	2283	2283
q11	562	501	466	466
q12	754	752	676	676
q13	3646	4175	3360	3360
q14	308	311	273	273
q15	545	582	562	562
q16	686	696	652	652
q17	1143	1253	1349	1253
q18	8182	7755	7595	7595
q19	939	901	936	901
q20	2072	2110	2065	2065
q21	5034	4522	4377	4377
q22	1154	1056	980	980
Total cold run time: 51469 ms
Total hot run time: 48532 ms

@doris-robot
Copy link

doris-robot commented Jan 1, 2026

TPC-DS: Total hot run time: 173412 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 47cd2f013fd6f2bae84aa2aa309f88dc812b3102, data reload: false

query5	4394	587	439	439
query6	334	220	209	209
query7	4211	472	273	273
query8	353	259	264	259
query9	8763	2643	2637	2637
query10	503	375	318	318
query11	15096	15179	14831	14831
query12	176	120	114	114
query13	1259	513	397	397
query14	6071	2971	2833	2833
query14_1	2680	2660	2688	2660
query15	200	209	176	176
query16	992	468	453	453
query17	1111	694	586	586
query18	2467	440	352	352
query19	226	222	198	198
query20	122	120	116	116
query21	217	142	120	120
query22	3816	3916	3766	3766
query23	15946	15440	15392	15392
query23_1	15432	15352	15253	15253
query24	7198	1605	1209	1209
query24_1	1262	1222	1237	1222
query25	576	492	430	430
query26	1242	270	163	163
query27	2754	468	301	301
query28	4395	2201	2190	2190
query29	829	560	475	475
query30	321	241	216	216
query31	791	651	568	568
query32	79	72	71	71
query33	545	378	300	300
query34	901	893	536	536
query35	769	822	710	710
query36	883	850	776	776
query37	124	140	75	75
query38	2755	2714	2680	2680
query39	772	755	750	750
query39_1	706	710	703	703
query40	218	132	115	115
query41	65	68	60	60
query42	104	103	102	102
query43	442	450	419	419
query44	1359	766	750	750
query45	182	182	180	180
query46	863	974	612	612
query47	1433	1479	1316	1316
query48	318	331	245	245
query49	601	411	320	320
query50	659	273	205	205
query51	3754	3728	3726	3726
query52	104	109	98	98
query53	297	326	271	271
query54	281	259	249	249
query55	80	79	75	75
query56	295	287	291	287
query57	992	988	951	951
query58	274	243	254	243
query59	2131	2220	1939	1939
query60	315	307	293	293
query61	201	168	163	163
query62	389	363	308	308
query63	293	263	271	263
query64	4898	1294	998	998
query65	3787	3679	3731	3679
query66	1416	438	315	315
query67	15636	15406	14985	14985
query68	6688	1019	731	731
query69	495	343	309	309
query70	1078	933	978	933
query71	372	305	276	276
query72	6095	3409	3436	3409
query73	772	734	320	320
query74	8822	8819	8711	8711
query75	2880	2846	2511	2511
query76	3939	1083	667	667
query77	512	393	282	282
query78	9613	9887	9193	9193
query79	1246	937	613	613
query80	617	593	494	494
query81	512	259	233	233
query82	224	148	114	114
query83	267	259	243	243
query84	259	129	105	105
query85	924	505	470	470
query86	379	325	310	310
query87	2887	2858	2727	2727
query88	3257	2320	2302	2302
query89	386	360	322	322
query90	2178	159	158	158
query91	178	169	140	140
query92	91	66	64	64
query93	1139	934	564	564
query94	585	322	308	308
query95	568	333	304	304
query96	603	470	209	209
query97	2298	2361	2287	2287
query98	219	216	204	204
query99	584	574	482	482
Total cold run time: 252025 ms
Total hot run time: 173412 ms

@doris-robot
Copy link

doris-robot commented Jan 1, 2026

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 79.52% (1774/2231)
Line Coverage 64.75% (31384/48466)
Region Coverage 65.32% (15611/23901)
Branch Coverage 55.93% (8302/14844)

@doris-robot
Copy link

doris-robot commented Jan 1, 2026

ClickBench: Total hot run time: 27.85 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 47cd2f013fd6f2bae84aa2aa309f88dc812b3102, data reload: false

query1	0.06	0.05	0.04
query2	0.14	0.07	0.07
query3	0.32	0.08	0.08
query4	1.61	0.10	0.10
query5	0.26	0.25	0.25
query6	1.15	0.65	0.64
query7	0.03	0.02	0.03
query8	0.08	0.06	0.07
query9	0.57	0.50	0.49
query10	0.53	0.54	0.55
query11	0.26	0.14	0.14
query12	0.26	0.15	0.14
query13	0.63	0.63	0.62
query14	1.02	1.01	0.99
query15	0.87	0.80	0.82
query16	0.39	0.42	0.39
query17	1.00	1.03	0.98
query18	0.24	0.22	0.21
query19	1.91	1.85	1.88
query20	0.02	0.02	0.02
query21	15.39	0.27	0.24
query22	4.99	0.10	0.09
query23	15.39	0.39	0.23
query24	2.38	0.51	0.32
query25	0.10	0.09	0.09
query26	0.17	0.17	0.17
query27	0.09	0.09	0.09
query28	3.94	1.12	0.96
query29	12.58	4.06	3.27
query30	0.33	0.13	0.10
query31	2.80	0.67	0.42
query32	3.24	0.59	0.49
query33	3.08	3.00	3.10
query34	16.93	5.08	4.47
query35	4.58	4.50	4.54
query36	0.61	0.50	0.49
query37	0.25	0.08	0.08
query38	0.21	0.06	0.05
query39	0.06	0.04	0.04
query40	0.19	0.18	0.16
query41	0.12	0.07	0.06
query42	0.09	0.05	0.05
query43	0.07	0.05	0.05
Total cold run time: 98.94 s
Total hot run time: 27.85 s

@doris-robot
Copy link

doris-robot commented Jan 1, 2026

BE UT Coverage Report

Increment line coverage 0.85% (2/235) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 53.43% (18978/35520)
Line Coverage 39.28% (176138/448403)
Region Coverage 33.85% (136256/402576)
Branch Coverage 34.79% (58868/169212)

@hello-stephen
Copy link
Contributor

hello-stephen commented Jan 1, 2026

BE Regression && UT Coverage Report

Increment line coverage 0.85% (2/235) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 72.26% (25094/34725)
Line Coverage 58.97% (263698/447211)
Region Coverage 53.86% (219079/406739)
Branch Coverage 55.38% (94022/169774)

@hello-stephen
Copy link
Contributor

hello-stephen commented Jan 1, 2026

FE Regression Coverage Report

Increment line coverage 55.26% (21/38) 🎉
Increment coverage report
Complete coverage report

@hubgeter hubgeter changed the title test docker iceberg version 1.10.0 [feature](iceberg)support read iceberg v3 deletion vector. Jan 4, 2026
@hubgeter
Copy link
Contributor Author

hubgeter commented Jan 4, 2026

run buildall

@hello-stephen
Copy link
Contributor

hello-stephen commented Jan 4, 2026

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 79.53% (1776/2233)
Line Coverage 64.80% (31435/48508)
Region Coverage 65.34% (15627/23918)
Branch Coverage 56.00% (8318/14854)

@doris-robot
Copy link

doris-robot commented Jan 4, 2026

TPC-H: Total hot run time: 32066 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2f30859d131b91510a6ca66b4077d4388127c2d0, data reload: false

------ Round 1 ----------------------------------
q1	17500	4227	4024	4024
q2	2052	360	248	248
q3	10076	1272	719	719
q4	10220	897	318	318
q5	7507	2134	1910	1910
q6	190	179	138	138
q7	937	790	655	655
q8	9278	1392	1149	1149
q9	5035	4528	4609	4528
q10	6791	1822	1407	1407
q11	551	299	284	284
q12	704	727	600	600
q13	17766	3842	3117	3117
q14	291	287	281	281
q15	572	515	500	500
q16	698	709	609	609
q17	690	813	537	537
q18	7208	6455	6932	6455
q19	1054	1038	677	677
q20	441	389	277	277
q21	3263	2708	2578	2578
q22	1179	1089	1055	1055
Total cold run time: 104003 ms
Total hot run time: 32066 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4286	4225	4274	4225
q2	343	410	326	326
q3	2300	2905	2317	2317
q4	1435	1860	1392	1392
q5	4672	4398	4410	4398
q6	233	175	124	124
q7	2044	1961	1738	1738
q8	2577	2306	2501	2306
q9	7078	7106	7325	7106
q10	2397	2823	2285	2285
q11	557	476	473	473
q12	734	756	623	623
q13	3547	3839	3097	3097
q14	261	286	261	261
q15	529	493	486	486
q16	603	653	617	617
q17	1116	1269	1334	1269
q18	7451	7449	7216	7216
q19	818	784	830	784
q20	1872	1979	1787	1787
q21	4537	4247	4170	4170
q22	1065	1020	980	980
Total cold run time: 50455 ms
Total hot run time: 47980 ms

@doris-robot
Copy link

doris-robot commented Jan 4, 2026

TPC-DS: Total hot run time: 173024 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2f30859d131b91510a6ca66b4077d4388127c2d0, data reload: false

query5	4427	607	437	437
query6	329	230	225	225
query7	4218	451	259	259
query8	327	233	246	233
query9	8778	2602	2586	2586
query10	513	367	318	318
query11	15442	15287	14962	14962
query12	167	116	108	108
query13	1254	463	373	373
query14	6007	2903	2678	2678
query14_1	2588	2613	2632	2613
query15	201	191	173	173
query16	1009	490	476	476
query17	1109	675	567	567
query18	2438	440	339	339
query19	224	222	200	200
query20	125	119	118	118
query21	218	138	127	127
query22	3947	4081	3810	3810
query23	16161	15672	15615	15615
query23_1	15545	15438	15527	15438
query24	7434	1551	1180	1180
query24_1	1196	1168	1200	1168
query25	558	482	434	434
query26	1258	271	160	160
query27	2759	453	294	294
query28	4546	2133	2122	2122
query29	763	543	450	450
query30	312	245	211	211
query31	803	648	564	564
query32	79	70	76	70
query33	535	349	298	298
query34	899	905	522	522
query35	765	794	716	716
query36	879	884	854	854
query37	131	94	79	79
query38	2775	2751	2671	2671
query39	780	744	715	715
query39_1	737	741	703	703
query40	222	139	122	122
query41	71	69	68	68
query42	106	103	102	102
query43	463	434	426	426
query44	1314	746	740	740
query45	191	189	179	179
query46	837	968	615	615
query47	1477	1400	1411	1400
query48	313	324	261	261
query49	624	432	341	341
query50	669	278	207	207
query51	3794	3808	3718	3718
query52	107	110	98	98
query53	290	322	268	268
query54	294	264	286	264
query55	80	71	66	66
query56	289	294	304	294
query57	1053	1010	944	944
query58	264	248	243	243
query59	2161	2116	2078	2078
query60	321	312	284	284
query61	163	157	162	157
query62	397	367	304	304
query63	291	268	274	268
query64	4922	1301	996	996
query65	3802	3651	3741	3651
query66	1467	417	298	298
query67	14812	15317	14977	14977
query68	8108	974	696	696
query69	557	348	308	308
query70	1053	961	943	943
query71	377	308	276	276
query72	6060	3426	3396	3396
query73	753	701	301	301
query74	8931	8790	8633	8633
query75	2851	2832	2450	2450
query76	3882	1043	636	636
query77	514	369	282	282
query78	9754	9897	9272	9272
query79	1040	896	587	587
query80	660	563	478	478
query81	508	266	228	228
query82	215	140	109	109
query83	259	258	231	231
query84	261	114	99	99
query85	876	497	463	463
query86	349	331	339	331
query87	2810	2858	2790	2790
query88	3089	2201	2171	2171
query89	386	352	324	324
query90	1960	152	150	150
query91	172	167	144	144
query92	73	68	62	62
query93	988	885	531	531
query94	575	318	294	294
query95	573	386	292	292
query96	579	449	203	203
query97	2312	2358	2270	2270
query98	226	204	191	191
query99	582	588	500	500
Total cold run time: 253530 ms
Total hot run time: 173024 ms

@doris-robot
Copy link

doris-robot commented Jan 4, 2026

ClickBench: Total hot run time: 27.96 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 2f30859d131b91510a6ca66b4077d4388127c2d0, data reload: false

query1	0.06	0.05	0.05
query2	0.14	0.07	0.06
query3	0.33	0.08	0.07
query4	1.61	0.09	0.09
query5	0.27	0.24	0.24
query6	1.15	0.64	0.64
query7	0.03	0.02	0.02
query8	0.07	0.06	0.06
query9	0.59	0.52	0.50
query10	0.56	0.55	0.54
query11	0.27	0.13	0.13
query12	0.27	0.15	0.14
query13	0.62	0.62	0.60
query14	1.01	0.97	0.96
query15	0.88	0.82	0.80
query16	0.40	0.38	0.39
query17	1.00	1.05	1.04
query18	0.24	0.21	0.23
query19	1.96	1.79	1.89
query20	0.03	0.02	0.01
query21	15.39	0.28	0.24
query22	5.00	0.09	0.10
query23	15.40	0.40	0.22
query24	2.41	0.46	0.32
query25	0.11	0.13	0.10
query26	0.18	0.17	0.17
query27	0.09	0.09	0.09
query28	3.62	1.14	0.97
query29	12.58	4.10	3.28
query30	0.35	0.13	0.11
query31	2.81	0.67	0.45
query32	3.23	0.60	0.49
query33	3.01	3.04	3.08
query34	17.00	5.14	4.54
query35	4.58	4.60	4.54
query36	0.61	0.50	0.51
query37	0.25	0.08	0.09
query38	0.20	0.05	0.06
query39	0.08	0.04	0.04
query40	0.19	0.17	0.15
query41	0.13	0.06	0.06
query42	0.07	0.05	0.05
query43	0.06	0.06	0.05
Total cold run time: 98.84 s
Total hot run time: 27.96 s

@doris-robot
Copy link

doris-robot commented Jan 4, 2026

BE UT Coverage Report

Increment line coverage 0.85% (2/235) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 53.26% (18965/35607)
Line Coverage 39.20% (175935/448808)
Region Coverage 33.74% (136093/403333)
Branch Coverage 34.71% (58787/169354)

@hello-stephen
Copy link
Contributor

hello-stephen commented Jan 4, 2026

BE Regression && UT Coverage Report

Increment line coverage 0.85% (2/235) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 72.21% (25138/34812)
Line Coverage 58.91% (263710/447626)
Region Coverage 53.83% (219380/407520)
Branch Coverage 55.40% (94130/169920)

@hello-stephen
Copy link
Contributor

hello-stephen commented Jan 4, 2026

FE Regression Coverage Report

Increment line coverage 94.74% (36/38) 🎉
Increment coverage report
Complete coverage report

@hubgeter hubgeter marked this pull request as ready for review January 5, 2026 03:06
@hubgeter
Copy link
Contributor Author

hubgeter commented Jan 5, 2026

run buildall

@doris-robot
Copy link

doris-robot commented Jan 5, 2026

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 79.53% (1776/2233)
Line Coverage 64.82% (31442/48508)
Region Coverage 65.39% (15639/23918)
Branch Coverage 56.00% (8318/14854)

@hello-stephen
Copy link
Contributor

hello-stephen commented Jan 5, 2026

FE UT Coverage Report

Increment line coverage 0.00% (0/38) 🎉
Increment coverage report
Complete coverage report

@doris-robot
Copy link

doris-robot commented Jan 5, 2026

TPC-H: Total hot run time: 31927 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b54cfd2b86cf38513fc496a256c380e526d0d603, data reload: false

------ Round 1 ----------------------------------
q1	17656	4283	4081	4081
q2	2042	363	236	236
q3	10521	1279	769	769
q4	10431	851	322	322
q5	9416	2069	1918	1918
q6	232	169	137	137
q7	932	822	660	660
q8	9277	1454	1159	1159
q9	5115	4554	4548	4548
q10	6864	1823	1380	1380
q11	530	286	275	275
q12	755	723	608	608
q13	17837	3791	3088	3088
q14	290	297	274	274
q15	582	516	504	504
q16	669	675	632	632
q17	690	803	539	539
q18	6682	6424	7271	6424
q19	1602	1011	621	621
q20	429	402	256	256
q21	3282	2713	2493	2493
q22	1123	1043	1003	1003
Total cold run time: 106957 ms
Total hot run time: 31927 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4380	4321	4263	4263
q2	342	445	329	329
q3	2228	2815	2460	2460
q4	1431	1903	1357	1357
q5	4687	4302	4590	4302
q6	216	167	128	128
q7	1970	1910	1932	1910
q8	2582	2462	2404	2404
q9	7097	7119	7078	7078
q10	2526	2718	2302	2302
q11	544	530	466	466
q12	766	909	611	611
q13	3547	4055	3195	3195
q14	264	291	255	255
q15	524	497	485	485
q16	622	675	608	608
q17	1112	1268	1279	1268
q18	7546	7300	7253	7253
q19	804	809	823	809
q20	1897	1976	1793	1793
q21	4561	4453	4249	4249
q22	1077	1020	993	993
Total cold run time: 50723 ms
Total hot run time: 48518 ms

@doris-robot
Copy link

doris-robot commented Jan 5, 2026

TPC-DS: Total hot run time: 172584 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b54cfd2b86cf38513fc496a256c380e526d0d603, data reload: false

query5	4620	588	441	441
query6	345	218	202	202
query7	4213	453	265	265
query8	332	251	235	235
query9	8761	2603	2611	2603
query10	502	379	312	312
query11	15379	15122	14783	14783
query12	182	118	121	118
query13	1269	496	411	411
query14	5930	2997	2716	2716
query14_1	2643	2621	2647	2621
query15	208	206	185	185
query16	982	489	469	469
query17	1095	679	584	584
query18	2438	452	353	353
query19	228	227	214	214
query20	124	119	118	118
query21	216	140	124	124
query22	3923	3991	3863	3863
query23	15988	15718	15340	15340
query23_1	15534	15380	15355	15355
query24	7339	1510	1186	1186
query24_1	1177	1148	1182	1148
query25	526	449	396	396
query26	1241	268	152	152
query27	2770	448	282	282
query28	4572	2131	2115	2115
query29	744	523	461	461
query30	309	238	211	211
query31	790	632	532	532
query32	78	70	64	64
query33	541	330	282	282
query34	929	890	516	516
query35	730	800	715	715
query36	890	883	825	825
query37	126	91	75	75
query38	2719	2724	2679	2679
query39	757	766	755	755
query39_1	699	707	704	704
query40	216	132	116	116
query41	67	60	61	60
query42	106	107	105	105
query43	438	480	389	389
query44	1309	729	725	725
query45	184	181	173	173
query46	838	964	609	609
query47	1450	1390	1296	1296
query48	304	339	237	237
query49	603	402	314	314
query50	631	282	209	209
query51	3804	3758	3719	3719
query52	103	111	98	98
query53	281	321	270	270
query54	295	260	241	241
query55	78	77	74	74
query56	283	288	297	288
query57	998	967	902	902
query58	266	255	238	238
query59	2182	2184	2064	2064
query60	315	329	303	303
query61	161	173	162	162
query62	389	353	311	311
query63	294	261	282	261
query64	4924	1280	1093	1093
query65	3854	3725	3763	3725
query66	1450	450	320	320
query67	14964	14865	14953	14865
query68	3308	1043	747	747
query69	505	369	318	318
query70	1040	966	999	966
query71	355	311	282	282
query72	6092	3628	3438	3438
query73	756	725	299	299
query74	8742	8765	8561	8561
query75	2854	2787	2456	2456
query76	3738	1076	643	643
query77	523	375	277	277
query78	9680	9780	9260	9260
query79	1310	866	587	587
query80	675	582	491	491
query81	500	259	234	234
query82	410	151	112	112
query83	264	261	241	241
query84	256	112	98	98
query85	896	505	461	461
query86	348	306	290	290
query87	2885	2884	2737	2737
query88	3259	2230	2225	2225
query89	386	341	339	339
query90	1997	167	155	155
query91	175	175	141	141
query92	78	70	64	64
query93	1120	946	529	529
query94	594	336	298	298
query95	594	375	315	315
query96	582	477	205	205
query97	2366	2382	2302	2302
query98	233	210	202	202
query99	592	585	492	492
Total cold run time: 248743 ms
Total hot run time: 172584 ms

@doris-robot
Copy link

doris-robot commented Jan 5, 2026

ClickBench: Total hot run time: 27.86 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b54cfd2b86cf38513fc496a256c380e526d0d603, data reload: false

query1	0.05	0.04	0.04
query2	0.14	0.06	0.06
query3	0.37	0.07	0.08
query4	1.62	0.11	0.10
query5	0.26	0.24	0.25
query6	1.15	0.65	0.65
query7	0.03	0.02	0.03
query8	0.07	0.06	0.05
query9	0.58	0.50	0.50
query10	0.56	0.56	0.54
query11	0.27	0.13	0.13
query12	0.27	0.14	0.15
query13	0.62	0.62	0.59
query14	1.00	0.99	0.99
query15	0.86	0.83	0.83
query16	0.40	0.38	0.40
query17	1.04	1.02	1.08
query18	0.24	0.22	0.22
query19	1.91	1.88	1.85
query20	0.02	0.02	0.01
query21	15.39	0.29	0.23
query22	4.97	0.10	0.09
query23	15.39	0.37	0.22
query24	2.49	0.48	0.33
query25	0.10	0.09	0.09
query26	0.17	0.18	0.16
query27	0.10	0.09	0.09
query28	3.97	1.12	0.96
query29	12.55	4.01	3.23
query30	0.35	0.14	0.11
query31	2.82	0.64	0.45
query32	3.24	0.62	0.49
query33	3.05	3.05	3.06
query34	16.79	5.14	4.45
query35	4.52	4.50	4.52
query36	0.61	0.50	0.49
query37	0.24	0.09	0.08
query38	0.21	0.05	0.05
query39	0.07	0.05	0.05
query40	0.20	0.16	0.16
query41	0.13	0.06	0.07
query42	0.08	0.05	0.04
query43	0.06	0.06	0.05
Total cold run time: 98.96 s
Total hot run time: 27.86 s

@doris-robot
Copy link

doris-robot commented Jan 5, 2026

BE UT Coverage Report

Increment line coverage 0.83% (2/240) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 53.25% (18971/35628)
Line Coverage 39.19% (175946/448988)
Region Coverage 33.72% (136055/403489)
Branch Coverage 34.69% (58766/169412)

@morningman morningman force-pushed the update_docker_iceberg_version branch from b54cfd2 to a7c4b8d Compare January 5, 2026 08:33
@hello-stephen
Copy link
Contributor

hello-stephen commented Jan 5, 2026

BE Regression && UT Coverage Report

Increment line coverage 0.83% (2/240) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 70.21% (24456/34832)
Line Coverage 56.50% (252994/447802)
Region Coverage 51.00% (207904/407675)
Branch Coverage 52.52% (89266/169978)

@morningman
Copy link
Contributor

morningman commented Jan 5, 2026

run buildall

@hello-stephen
Copy link
Contributor

hello-stephen commented Jan 5, 2026

FE Regression Coverage Report

Increment line coverage 0.00% (0/38) 🎉
Increment coverage report
Complete coverage report

@hello-stephen
Copy link
Contributor

hello-stephen commented Jan 5, 2026

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 79.53% (1776/2233)
Line Coverage 64.84% (31451/48508)
Region Coverage 65.35% (15631/23918)
Branch Coverage 56.03% (8322/14854)

@hello-stephen
Copy link
Contributor

hello-stephen commented Jan 5, 2026

FE UT Coverage Report

Increment line coverage 0.00% (0/38) 🎉
Increment coverage report
Complete coverage report

@doris-robot
Copy link

doris-robot commented Jan 5, 2026

TPC-H: Total hot run time: 32066 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a7c4b8d8e624c2edad18b6dd534f2e45a35ea078, data reload: false

------ Round 1 ----------------------------------
q1	17605	4208	4075	4075
q2	2003	358	239	239
q3	10554	1287	740	740
q4	10316	840	321	321
q5	9445	2139	1831	1831
q6	241	170	140	140
q7	955	808	673	673
q8	9312	1422	1168	1168
q9	5214	4645	4586	4586
q10	6843	1805	1441	1441
q11	546	317	289	289
q12	747	740	579	579
q13	17813	3820	3059	3059
q14	293	295	273	273
q15	580	524	502	502
q16	697	681	624	624
q17	693	859	488	488
q18	6645	6503	7145	6503
q19	1474	1046	688	688
q20	429	385	257	257
q21	3231	2542	2601	2542
q22	1153	1115	1048	1048
Total cold run time: 106789 ms
Total hot run time: 32066 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4280	4248	4229	4229
q2	325	408	307	307
q3	2325	2722	2461	2461
q4	1426	1857	1458	1458
q5	4671	4491	4265	4265
q6	217	171	129	129
q7	1902	1969	1793	1793
q8	2538	2374	2395	2374
q9	7097	7100	7188	7100
q10	2526	2825	2290	2290
q11	588	465	438	438
q12	703	788	595	595
q13	3285	3769	3081	3081
q14	277	279	254	254
q15	515	497	504	497
q16	632	647	594	594
q17	1085	1225	1303	1225
q18	7511	7403	7267	7267
q19	844	796	820	796
q20	1904	1994	1769	1769
q21	4510	4291	4093	4093
q22	1074	1040	989	989
Total cold run time: 50235 ms
Total hot run time: 48004 ms

@doris-robot
Copy link

doris-robot commented Jan 5, 2026

TPC-DS: Total hot run time: 173370 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a7c4b8d8e624c2edad18b6dd534f2e45a35ea078, data reload: false

query5	4568	589	438	438
query6	336	236	216	216
query7	4228	461	271	271
query8	328	242	245	242
query9	8772	2646	2692	2646
query10	555	376	316	316
query11	15261	15177	14763	14763
query12	170	116	114	114
query13	1278	483	392	392
query14	6115	2935	2847	2847
query14_1	2705	2580	2632	2580
query15	199	192	169	169
query16	992	461	462	461
query17	1122	691	580	580
query18	2456	448	357	357
query19	233	235	197	197
query20	125	119	113	113
query21	219	138	126	126
query22	4032	3954	3843	3843
query23	16088	15706	15267	15267
query23_1	15336	15498	15497	15497
query24	7349	1539	1164	1164
query24_1	1192	1182	1186	1182
query25	578	480	423	423
query26	1257	258	160	160
query27	2793	454	302	302
query28	4521	2165	2157	2157
query29	804	566	471	471
query30	309	245	214	214
query31	770	632	574	574
query32	80	75	69	69
query33	575	350	293	293
query34	886	876	515	515
query35	745	809	718	718
query36	852	865	806	806
query37	133	100	81	81
query38	2765	2724	2655	2655
query39	760	759	726	726
query39_1	704	715	715	715
query40	227	141	121	121
query41	72	72	67	67
query42	104	106	106	106
query43	439	445	417	417
query44	1306	735	723	723
query45	188	186	181	181
query46	873	982	614	614
query47	1374	1425	1423	1423
query48	326	329	270	270
query49	626	432	341	341
query50	643	279	204	204
query51	3789	3866	3814	3814
query52	110	117	103	103
query53	311	328	278	278
query54	308	273	260	260
query55	80	77	73	73
query56	299	354	293	293
query57	996	1021	984	984
query58	287	268	248	248
query59	2084	2225	2124	2124
query60	323	306	289	289
query61	158	158	165	158
query62	383	345	344	344
query63	297	267	284	267
query64	4934	1304	997	997
query65	3839	3750	3758	3750
query66	1438	418	302	302
query67	15167	15164	15157	15157
query68	8107	1001	708	708
query69	489	355	314	314
query70	1111	943	965	943
query71	363	303	278	278
query72	6084	3551	3476	3476
query73	761	714	304	304
query74	8767	8677	8529	8529
query75	2835	2800	2486	2486
query76	3926	1057	642	642
query77	530	371	277	277
query78	9764	10034	9161	9161
query79	1485	914	594	594
query80	665	561	470	470
query81	518	265	227	227
query82	214	146	112	112
query83	265	253	235	235
query84	255	122	102	102
query85	927	541	466	466
query86	385	315	322	315
query87	2812	2834	2721	2721
query88	3221	2239	2220	2220
query89	378	365	331	331
query90	2093	164	154	154
query91	176	178	145	145
query92	81	68	64	64
query93	1276	901	530	530
query94	577	323	288	288
query95	576	332	365	332
query96	589	458	208	208
query97	2319	2384	2319	2319
query98	232	198	194	194
query99	574	587	508	508
Total cold run time: 254708 ms
Total hot run time: 173370 ms

@doris-robot
Copy link

doris-robot commented Jan 5, 2026

ClickBench: Total hot run time: 27.79 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a7c4b8d8e624c2edad18b6dd534f2e45a35ea078, data reload: false

query1	0.06	0.05	0.04
query2	0.14	0.07	0.07
query3	0.32	0.08	0.08
query4	1.60	0.10	0.09
query5	0.26	0.25	0.24
query6	1.15	0.64	0.66
query7	0.04	0.02	0.02
query8	0.07	0.06	0.06
query9	0.57	0.49	0.51
query10	0.57	0.55	0.56
query11	0.27	0.13	0.13
query12	0.27	0.14	0.15
query13	0.63	0.62	0.60
query14	0.98	0.97	0.99
query15	0.87	0.81	0.82
query16	0.39	0.38	0.39
query17	1.02	1.01	1.04
query18	0.24	0.22	0.23
query19	1.93	1.75	1.88
query20	0.02	0.01	0.02
query21	15.41	0.29	0.23
query22	5.00	0.12	0.10
query23	15.38	0.41	0.22
query24	2.47	0.49	0.31
query25	0.10	0.10	0.09
query26	0.18	0.17	0.16
query27	0.09	0.09	0.09
query28	3.86	1.14	0.97
query29	12.56	4.08	3.28
query30	0.33	0.13	0.11
query31	2.84	0.66	0.43
query32	3.24	0.60	0.49
query33	3.01	3.02	3.03
query34	17.02	5.05	4.48
query35	4.54	4.50	4.49
query36	0.61	0.49	0.50
query37	0.24	0.09	0.08
query38	0.21	0.06	0.06
query39	0.07	0.05	0.06
query40	0.20	0.19	0.19
query41	0.13	0.06	0.06
query42	0.08	0.05	0.05
query43	0.06	0.05	0.04
Total cold run time: 99.03 s
Total hot run time: 27.79 s

@doris-robot
Copy link

doris-robot commented Jan 5, 2026

BE UT Coverage Report

Increment line coverage 0.83% (2/240) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 53.20% (18961/35639)
Line Coverage 39.18% (175940/449061)
Region Coverage 33.71% (136090/403738)
Branch Coverage 34.67% (58728/169370)

@hello-stephen
Copy link
Contributor

hello-stephen commented Jan 5, 2026

BE Regression && UT Coverage Report

Increment line coverage 77.08% (185/240) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 64.33% (22411/34840)
Line Coverage 50.68% (226962/447843)
Region Coverage 45.52% (185660/407858)
Branch Coverage 46.78% (79491/169919)

@hello-stephen
Copy link
Contributor

hello-stephen commented Jan 5, 2026

FE Regression Coverage Report

Increment line coverage 0.00% (0/38) 🎉
Increment coverage report
Complete coverage report

@hubgeter hubgeter force-pushed the update_docker_iceberg_version branch from a7c4b8d to 8bd8dcc Compare January 5, 2026 15:41
@hubgeter
Copy link
Contributor Author

hubgeter commented Jan 5, 2026

run buildall

@doris-robot
Copy link

doris-robot commented Jan 5, 2026

TPC-H: Total hot run time: 32369 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8bd8dcc2f11480737bfbcf360b0fd9f04bfc8ef0, data reload: false

------ Round 1 ----------------------------------
q1	17618	4208	4045	4045
q2	2069	361	248	248
q3	10097	1301	710	710
q4	10221	889	321	321
q5	7583	2083	1916	1916
q6	187	171	139	139
q7	942	780	662	662
q8	9280	1450	1239	1239
q9	4914	4688	4530	4530
q10	6776	1792	1415	1415
q11	537	313	299	299
q12	711	732	599	599
q13	17791	3862	3166	3166
q14	286	297	289	289
q15	581	507	503	503
q16	709	701	638	638
q17	682	830	528	528
q18	6445	6495	6895	6495
q19	973	1053	674	674
q20	450	383	274	274
q21	3209	2605	2597	2597
q22	1121	1103	1082	1082
Total cold run time: 103182 ms
Total hot run time: 32369 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4328	4413	4419	4413
q2	324	395	319	319
q3	2268	2752	2471	2471
q4	1457	1826	1436	1436
q5	4432	4309	4301	4301
q6	225	173	132	132
q7	1929	1997	1785	1785
q8	2584	2372	2454	2372
q9	7408	7152	6958	6958
q10	2568	2724	2239	2239
q11	562	465	447	447
q12	765	748	678	678
q13	3606	4183	3315	3315
q14	302	318	279	279
q15	530	495	495	495
q16	672	682	650	650
q17	1173	1282	1355	1282
q18	7646	7295	7318	7295
q19	839	796	809	796
q20	1883	1996	1801	1801
q21	4584	4266	4089	4089
q22	1055	1026	994	994
Total cold run time: 51140 ms
Total hot run time: 48547 ms

@doris-robot
Copy link

doris-robot commented Jan 5, 2026

TPC-DS: Total hot run time: 172758 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8bd8dcc2f11480737bfbcf360b0fd9f04bfc8ef0, data reload: false

query5	4976	607	456	456
query6	338	230	213	213
query7	4218	482	266	266
query8	328	243	237	237
query9	8752	2613	2665	2613
query10	541	358	331	331
query11	15194	15107	14769	14769
query12	180	114	112	112
query13	1267	493	356	356
query14	6425	3069	2787	2787
query14_1	2725	2747	2699	2699
query15	203	188	170	170
query16	960	467	449	449
query17	1039	653	562	562
query18	2610	434	336	336
query19	262	218	186	186
query20	126	115	113	113
query21	216	143	117	117
query22	4078	3969	3930	3930
query23	16037	15623	15335	15335
query23_1	15404	15397	15179	15179
query24	7405	1549	1189	1189
query24_1	1173	1186	1196	1186
query25	528	444	389	389
query26	1243	266	156	156
query27	2772	455	287	287
query28	4533	2143	2118	2118
query29	776	567	466	466
query30	312	245	222	222
query31	776	635	560	560
query32	85	73	73	73
query33	576	329	280	280
query34	905	918	528	528
query35	746	790	695	695
query36	883	914	803	803
query37	126	97	78	78
query38	2761	2683	2696	2683
query39	789	744	720	720
query39_1	710	710	700	700
query40	215	136	116	116
query41	64	61	63	61
query42	108	103	105	103
query43	468	480	424	424
query44	1302	729	727	727
query45	190	184	177	177
query46	860	952	603	603
query47	1384	1409	1326	1326
query48	304	326	245	245
query49	629	405	326	326
query50	650	293	205	205
query51	3837	3749	3771	3749
query52	106	108	98	98
query53	312	331	274	274
query54	316	265	247	247
query55	86	78	72	72
query56	289	291	288	288
query57	1010	995	932	932
query58	262	254	252	252
query59	2063	2203	1955	1955
query60	322	319	305	305
query61	161	159	163	159
query62	408	347	315	315
query63	299	271	276	271
query64	4873	1307	991	991
query65	3779	3698	3764	3698
query66	1400	427	304	304
query67	15097	15058	15509	15058
query68	2793	1031	746	746
query69	451	358	324	324
query70	1004	922	948	922
query71	331	305	289	289
query72	6341	3709	3681	3681
query73	593	723	305	305
query74	8743	8790	8647	8647
query75	2808	2792	2499	2499
query76	2914	1054	679	679
query77	350	384	289	289
query78	9727	9961	9187	9187
query79	991	854	582	582
query80	1076	581	464	464
query81	545	267	230	230
query82	227	146	112	112
query83	363	261	238	238
query84	258	116	108	108
query85	941	532	458	458
query86	345	325	322	322
query87	2844	2851	2780	2780
query88	3103	2219	2196	2196
query89	385	349	341	341
query90	1948	170	157	157
query91	193	170	146	146
query92	74	76	65	65
query93	927	884	539	539
query94	583	337	280	280
query95	567	383	305	305
query96	581	446	200	200
query97	2317	2392	2298	2298
query98	212	197	196	196
query99	585	609	491	491
Total cold run time: 247649 ms
Total hot run time: 172758 ms

@doris-robot
Copy link

doris-robot commented Jan 5, 2026

ClickBench: Total hot run time: 27.3 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8bd8dcc2f11480737bfbcf360b0fd9f04bfc8ef0, data reload: false

query1	0.06	0.05	0.05
query2	0.09	0.05	0.04
query3	0.28	0.09	0.08
query4	1.61	0.12	0.11
query5	0.27	0.25	0.25
query6	1.14	0.68	0.65
query7	0.04	0.03	0.02
query8	0.05	0.04	0.04
query9	0.57	0.50	0.50
query10	0.55	0.55	0.57
query11	0.15	0.10	0.09
query12	0.15	0.11	0.12
query13	0.60	0.59	0.59
query14	0.96	0.94	0.95
query15	0.80	0.77	0.78
query16	0.40	0.40	0.39
query17	0.98	1.01	1.01
query18	0.23	0.21	0.21
query19	1.99	1.89	1.86
query20	0.02	0.01	0.02
query21	15.53	0.28	0.14
query22	5.18	0.05	0.05
query23	16.04	0.29	0.10
query24	1.38	0.23	0.68
query25	0.12	0.12	0.06
query26	0.14	0.15	0.14
query27	0.08	0.06	0.05
query28	4.61	1.04	0.88
query29	12.65	3.86	3.12
query30	0.28	0.14	0.12
query31	2.84	0.64	0.41
query32	3.23	0.55	0.47
query33	2.98	3.04	3.10
query34	16.81	5.15	4.53
query35	4.46	4.80	5.08
query36	0.71	0.54	0.56
query37	0.12	0.07	0.07
query38	0.08	0.04	0.04
query39	0.04	0.03	0.03
query40	0.17	0.17	0.14
query41	0.10	0.03	0.02
query42	0.04	0.02	0.03
query43	0.03	0.03	0.03
Total cold run time: 98.56 s
Total hot run time: 27.3 s

@hello-stephen
Copy link
Contributor

hello-stephen commented Jan 5, 2026

FE UT Coverage Report

Increment line coverage 0.00% (0/38) 🎉
Increment coverage report
Complete coverage report

@hello-stephen
Copy link
Contributor

hello-stephen commented Jan 5, 2026

BE UT Coverage Report

Increment line coverage 0.83% (2/240) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 53.21% (18964/35639)
Line Coverage 39.19% (175999/449045)
Region Coverage 33.71% (136081/403735)
Branch Coverage 34.68% (58730/169364)

@hello-stephen
Copy link
Contributor

hello-stephen commented Jan 5, 2026

BE Regression && UT Coverage Report

Increment line coverage 0.83% (2/240) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 70.05% (24406/34840)
Line Coverage 56.35% (252330/447826)
Region Coverage 50.72% (206864/407855)
Branch Coverage 52.25% (88784/169913)

@hello-stephen
Copy link
Contributor

hello-stephen commented Jan 5, 2026

FE Regression Coverage Report

Increment line coverage 94.74% (36/38) 🎉
Increment coverage report
Complete coverage report

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

dev/4.1.x

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

5 participants

@hubgeter @Thearas @hello-stephen @doris-robot @morningman