[Feature](Streaming Job) Extend streaming job to support Postgres synchronization #59461

JNSimba · 2025-12-29T10:45:23Z

What problem does this PR solve?

This Issues (#58896) implements multi-table synchronization in MySQL, The main purpose of this PR is to extend the data source to Postgres.

Check List (For Author)

Test
- Regression test
- Unit Test
- Manual test (add detailed scripts or steps below)
- No need to test or manual test. Explain why:
  - This is a refactor/code format and no logic has been changed.
  - Previous test can cover this change.
  - No code files have been changed.
  - Other reason
Behavior changed:
- No.
- Yes.
Does this need documentation?
- No.
- Yes.

Check List (For Reviewer who merge this PR)

Confirm the release note
Confirm test cases
Confirm document
Add branch pick label

hello-stephen · 2025-12-29T10:45:28Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

JNSimba · 2025-12-29T10:59:36Z

run buildall

JNSimba · 2025-12-29T11:21:03Z

run buildall

doris-robot · 2025-12-29T12:00:43Z

TPC-H: Total hot run time: 34820 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3aee2e9049eeff52ddf41da691c3c43904d76ae4, data reload: false

------ Round 1 ----------------------------------
q1	17588	4259	4075	4075
q2	2006	348	236	236
q3	10201	1271	734	734
q4	10224	863	318	318
q5	7534	2162	1874	1874
q6	211	167	134	134
q7	981	800	658	658
q8	9284	1394	1145	1145
q9	6747	5147	5143	5143
q10	6746	1782	1391	1391
q11	505	318	291	291
q12	666	729	590	590
q13	17811	3836	3030	3030
q14	285	296	273	273
q15	583	516	509	509
q16	680	674	627	627
q17	697	756	590	590
q18	7368	7253	8014	7253
q19	1257	994	612	612
q20	441	397	268	268
q21	4441	4201	4006	4006
q22	1138	1144	1063	1063
Total cold run time: 107394 ms
Total hot run time: 34820 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4242	4271	4289	4271
q2	355	404	326	326
q3	2255	2805	2495	2495
q4	1399	1852	1430	1430
q5	4432	4579	4186	4186
q6	219	163	124	124
q7	1916	1899	1745	1745
q8	2513	2431	2279	2279
q9	7271	7112	7097	7097
q10	2481	2526	2137	2137
q11	524	455	430	430
q12	650	681	575	575
q13	3315	3826	3078	3078
q14	263	285	254	254
q15	523	484	491	484
q16	603	645	609	609
q17	1078	1289	1326	1289
q18	7179	7227	7033	7033
q19	858	829	859	829
q20	1865	1975	1797	1797
q21	4556	4327	4088	4088
q22	1069	1061	994	994
Total cold run time: 49566 ms
Total hot run time: 47550 ms

doris-robot · 2025-12-29T12:11:33Z

TPC-DS: Total hot run time: 174319 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3aee2e9049eeff52ddf41da691c3c43904d76ae4, data reload: false

query5	4852	589	450	450
query6	335	236	220	220
query7	4217	460	271	271
query8	335	248	251	248
query9	8795	2624	2629	2624
query10	518	378	317	317
query11	15456	15102	15061	15061
query12	176	114	113	113
query13	1260	495	397	397
query14	6301	2942	2762	2762
query14_1	2637	2637	2628	2628
query15	202	189	171	171
query16	982	466	446	446
query17	1070	683	596	596
query18	2511	451	357	357
query19	234	220	200	200
query20	126	115	113	113
query21	216	137	122	122
query22	3854	4085	3955	3955
query23	15937	15566	15192	15192
query23_1	15333	15540	15183	15183
query24	7501	1599	1223	1223
query24_1	1215	1195	1260	1195
query25	567	474	431	431
query26	1242	269	163	163
query27	2762	452	309	309
query28	4535	2186	2167	2167
query29	785	527	426	426
query30	305	238	209	209
query31	800	628	584	584
query32	76	70	67	67
query33	541	335	273	273
query34	893	879	545	545
query35	742	775	705	705
query36	869	878	762	762
query37	123	90	76	76
query38	2714	2729	2645	2645
query39	782	757	739	739
query39_1	700	724	697	697
query40	216	128	113	113
query41	65	61	63	61
query42	102	101	99	99
query43	449	453	403	403
query44	1341	773	744	744
query45	182	182	178	178
query46	886	963	620	620
query47	1364	1398	1415	1398
query48	311	334	244	244
query49	593	436	329	329
query50	637	279	220	220
query51	3789	3753	3759	3753
query52	103	105	95	95
query53	292	331	272	272
query54	312	267	244	244
query55	74	76	71	71
query56	274	276	283	276
query57	1023	989	870	870
query58	272	250	245	245
query59	2068	2059	1985	1985
query60	321	314	289	289
query61	161	158	154	154
query62	400	356	322	322
query63	298	271	267	267
query64	5041	1292	1000	1000
query65	3743	3741	3684	3684
query66	1421	424	319	319
query67	15034	15691	14737	14737
query68	5153	1023	753	753
query69	494	343	313	313
query70	975	936	860	860
query71	358	298	281	281
query72	6193	4782	4825	4782
query73	681	570	303	303
query74	8820	8830	8506	8506
query75	2903	2894	2560	2560
query76	3898	1068	650	650
query77	508	365	279	279
query78	9685	9897	9155	9155
query79	1097	971	614	614
query80	683	584	484	484
query81	481	266	228	228
query82	207	143	113	113
query83	267	272	244	244
query84	254	120	105	105
query85	883	505	456	456
query86	339	292	318	292
query87	2884	2880	2807	2807
query88	3320	2311	2311	2311
query89	396	360	329	329
query90	1963	163	161	161
query91	180	172	147	147
query92	72	69	67	67
query93	1075	940	575	575
query94	574	318	291	291
query95	585	380	309	309
query96	607	478	219	219
query97	2345	2357	2268	2268
query98	214	196	198	196
query99	574	553	516	516
Total cold run time: 250780 ms
Total hot run time: 174319 ms

doris-robot · 2025-12-29T12:16:34Z

ClickBench: Total hot run time: 26.89 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 3aee2e9049eeff52ddf41da691c3c43904d76ae4, data reload: false

query1	0.05	0.04	0.04
query2	0.10	0.04	0.05
query3	0.25	0.08	0.08
query4	1.60	0.11	0.11
query5	0.28	0.25	0.28
query6	1.16	0.67	0.66
query7	0.04	0.02	0.03
query8	0.05	0.04	0.04
query9	0.57	0.51	0.49
query10	0.55	0.54	0.56
query11	0.15	0.11	0.11
query12	0.17	0.13	0.13
query13	0.62	0.60	0.60
query14	0.98	0.97	0.97
query15	0.81	0.79	0.78
query16	0.39	0.41	0.40
query17	1.06	0.99	1.04
query18	0.24	0.23	0.22
query19	1.99	1.90	1.80
query20	0.02	0.02	0.01
query21	15.44	0.29	0.14
query22	4.73	0.05	0.05
query23	16.05	0.29	0.10
query24	0.98	0.53	0.19
query25	0.12	0.08	0.06
query26	0.14	0.14	0.14
query27	0.07	0.05	0.08
query28	3.84	1.06	0.88
query29	12.56	3.89	3.19
query30	0.28	0.14	0.12
query31	2.82	0.62	0.38
query32	3.23	0.55	0.46
query33	2.99	3.00	3.06
query34	16.55	5.12	4.56
query35	4.51	4.47	4.45
query36	0.67	0.49	0.49
query37	0.11	0.07	0.07
query38	0.06	0.04	0.04
query39	0.04	0.02	0.02
query40	0.17	0.14	0.13
query41	0.08	0.04	0.03
query42	0.04	0.03	0.03
query43	0.04	0.04	0.03
Total cold run time: 96.6 s
Total hot run time: 26.89 s

doris-robot · 2025-12-29T12:29:56Z

BE UT Coverage Report

Increment line coverage 100.00% (2/2) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	53.42% (18963/35500)
Line Coverage	39.29% (175898/447719)
Region Coverage	33.83% (136048/402166)
Branch Coverage	34.77% (58759/168979)

hello-stephen · 2025-12-29T12:32:44Z

FE UT Coverage Report

Increment line coverage 2.70% (2/74) 🎉
Increment coverage report
Complete coverage report

hello-stephen · 2025-12-29T14:02:53Z

BE Regression && UT Coverage Report

Increment line coverage 23.08% (3/13) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	72.23% (25066/34705)
Line Coverage	58.95% (263246/446536)
Region Coverage	53.82% (218688/406352)
Branch Coverage	55.32% (93791/169545)

hello-stephen · 2025-12-29T14:18:32Z

FE Regression Coverage Report

Increment line coverage 66.22% (49/74) 🎉
Increment coverage report
Complete coverage report

JNSimba · 2025-12-30T07:09:22Z

run buildall

hello-stephen · 2025-12-30T08:19:09Z

FE UT Coverage Report

Increment line coverage 2.47% (2/81) 🎉
Increment coverage report
Complete coverage report

hello-stephen · 2025-12-30T08:20:57Z

BE UT Coverage Report

Increment line coverage 100.00% (2/2) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	53.41% (18964/35508)
Line Coverage	39.29% (176028/448063)
Region Coverage	33.85% (136228/402437)
Branch Coverage	34.79% (58844/169138)

JNSimba · 2025-12-31T03:55:12Z

run buildall

doris-robot · 2025-12-31T04:31:09Z

TPC-H: Total hot run time: 34172 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ed7b9dd016575f2c97889985fb7a6e7dd8828830, data reload: false

------ Round 1 ----------------------------------
q1	17621	4294	4103	4103
q2	2016	353	233	233
q3	10203	1281	750	750
q4	10239	907	326	326
q5	7541	2161	1904	1904
q6	190	165	136	136
q7	937	841	658	658
q8	9263	1427	1069	1069
q9	6791	5166	5121	5121
q10	6801	1786	1418	1418
q11	498	301	291	291
q12	682	734	565	565
q13	17791	3812	3101	3101
q14	285	290	276	276
q15	595	510	507	507
q16	710	686	640	640
q17	693	733	649	649
q18	7453	7088	7312	7088
q19	1100	972	632	632
q20	401	371	251	251
q21	4175	3945	3487	3487
q22	1091	1035	967	967
Total cold run time: 107076 ms
Total hot run time: 34172 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4136	4058	4069	4058
q2	328	403	322	322
q3	2078	2598	2203	2203
q4	1297	1848	1314	1314
q5	4123	4016	4891	4016
q6	239	185	138	138
q7	2061	1930	1799	1799
q8	2491	2390	2389	2389
q9	7090	7082	7111	7082
q10	2554	2702	2324	2324
q11	531	506	453	453
q12	714	785	631	631
q13	3828	4132	3359	3359
q14	303	303	285	285
q15	542	524	512	512
q16	671	735	680	680
q17	1196	1296	1339	1296
q18	7987	8030	8145	8030
q19	943	886	925	886
q20	1983	2151	1978	1978
q21	4873	4446	4230	4230
q22	1120	1044	1005	1005
Total cold run time: 51088 ms
Total hot run time: 48990 ms

doris-robot · 2025-12-31T04:41:59Z

TPC-DS: Total hot run time: 174841 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ed7b9dd016575f2c97889985fb7a6e7dd8828830, data reload: false

query5	4385	578	431	431
query6	324	230	199	199
query7	4215	462	278	278
query8	357	253	244	244
query9	8784	2590	2598	2590
query10	502	371	327	327
query11	15115	15077	14869	14869
query12	184	117	114	114
query13	1257	504	393	393
query14	5797	3000	2647	2647
query14_1	2651	2580	2607	2580
query15	193	192	176	176
query16	984	459	451	451
query17	1086	673	568	568
query18	2423	435	331	331
query19	218	214	189	189
query20	118	119	115	115
query21	208	137	118	118
query22	3874	3972	4004	3972
query23	15996	15556	15319	15319
query23_1	15378	15547	15410	15410
query24	7348	1589	1201	1201
query24_1	1196	1168	1216	1168
query25	560	450	392	392
query26	1237	270	159	159
query27	2767	472	287	287
query28	4563	2171	2161	2161
query29	779	537	428	428
query30	303	243	209	209
query31	768	621	562	562
query32	79	67	67	67
query33	537	343	280	280
query34	897	902	533	533
query35	735	797	692	692
query36	849	923	844	844
query37	124	94	73	73
query38	2760	2660	2613	2613
query39	780	748	730	730
query39_1	720	710	725	710
query40	219	131	115	115
query41	67	68	62	62
query42	108	103	102	102
query43	434	483	385	385
query44	1370	754	745	745
query45	190	183	175	175
query46	910	977	610	610
query47	1311	1471	1293	1293
query48	315	334	245	245
query49	621	431	349	349
query50	663	303	208	208
query51	3799	3765	3705	3705
query52	107	107	102	102
query53	293	339	273	273
query54	300	274	299	274
query55	76	85	77	77
query56	298	306	308	306
query57	1028	1014	941	941
query58	275	256	265	256
query59	2048	2144	2033	2033
query60	339	330	315	315
query61	193	188	197	188
query62	402	377	323	323
query63	302	268	274	268
query64	5170	1446	1119	1119
query65	3791	3734	3678	3678
query66	1459	455	327	327
query67	14803	15313	15006	15006
query68	5771	1060	745	745
query69	511	344	320	320
query70	1067	882	949	882
query71	380	311	273	273
query72	6265	4911	5027	4911
query73	744	693	316	316
query74	8716	8729	8638	8638
query75	2905	2885	2461	2461
query76	3808	1083	662	662
query77	520	386	285	285
query78	9723	9829	9189	9189
query79	1256	959	599	599
query80	681	588	488	488
query81	517	270	231	231
query82	215	154	109	109
query83	264	253	244	244
query84	260	121	102	102
query85	913	517	470	470
query86	335	326	324	324
query87	2889	2859	2728	2728
query88	3166	2269	2232	2232
query89	381	350	328	328
query90	2036	157	148	148
query91	168	167	143	143
query92	75	68	65	65
query93	1014	960	566	566
query94	566	325	295	295
query95	565	374	306	306
query96	595	464	210	210
query97	2295	2373	2276	2276
query98	221	203	208	203
query99	585	589	494	494
Total cold run time: 250394 ms
Total hot run time: 174841 ms

doris-robot · 2025-12-31T04:47:00Z

ClickBench: Total hot run time: 26.93 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ed7b9dd016575f2c97889985fb7a6e7dd8828830, data reload: false

query1	0.06	0.05	0.04
query2	0.09	0.05	0.05
query3	0.26	0.09	0.08
query4	1.60	0.13	0.11
query5	0.27	0.25	0.25
query6	1.14	0.67	0.65
query7	0.03	0.03	0.03
query8	0.06	0.05	0.04
query9	0.55	0.50	0.51
query10	0.55	0.56	0.54
query11	0.15	0.11	0.11
query12	0.16	0.14	0.12
query13	0.61	0.60	0.59
query14	1.00	0.98	0.98
query15	0.81	0.80	0.85
query16	0.42	0.39	0.37
query17	1.01	1.04	1.06
query18	0.23	0.21	0.21
query19	1.89	1.88	1.83
query20	0.02	0.02	0.01
query21	15.45	0.28	0.14
query22	4.87	0.05	0.05
query23	16.23	0.27	0.11
query24	1.40	0.50	0.19
query25	0.06	0.08	0.08
query26	0.14	0.13	0.13
query27	0.12	0.05	0.05
query28	3.25	1.05	0.89
query29	12.58	3.92	3.14
query30	0.27	0.13	0.12
query31	2.82	0.61	0.38
query32	3.25	0.54	0.46
query33	2.98	3.04	3.15
query34	16.61	5.10	4.51
query35	4.44	4.47	4.50
query36	0.65	0.49	0.48
query37	0.10	0.07	0.06
query38	0.08	0.04	0.04
query39	0.05	0.03	0.03
query40	0.17	0.14	0.13
query41	0.08	0.03	0.03
query42	0.05	0.03	0.02
query43	0.04	0.04	0.03
Total cold run time: 96.6 s
Total hot run time: 26.93 s

hello-stephen · 2025-12-31T05:27:10Z

BE UT Coverage Report

Increment line coverage 100.00% (2/2) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	53.38% (18955/35510)
Line Coverage	39.27% (175948/448079)
Region Coverage	33.81% (136062/402431)
Branch Coverage	34.76% (58791/169140)

Copilot

Pull request overview

Copilot reviewed 43 out of 43 changed files in this pull request and generated 10 comments.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

fs_brokers/cdc_client/src/main/java/org/apache/doris/cdcclient/utils/ConfigUtil.java

...nt/src/main/java/org/apache/doris/cdcclient/source/reader/postgres/PostgresSourceReader.java

regression-test/suites/job_p0/streaming_job/cdc/test_streaming_postgres_job_all_type.groovy

regression-test/suites/job_p0/streaming_job/cdc/test_streaming_postgres_job.groovy

regression-test/data/job_p0/streaming_job/cdc/test_streaming_postgres_job_priv.out

...c_client/src/main/java/org/apache/doris/cdcclient/source/reader/mysql/MySqlSourceReader.java

...nt/src/main/java/org/apache/doris/cdcclient/source/reader/postgres/PostgresSourceReader.java

JNSimba · 2025-12-31T08:32:21Z

run buildall

doris-robot · 2025-12-31T08:52:46Z

TPC-H: Total hot run time: 34217 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 64c6024ba30a9258f27588cc24a7851bc64b4bbd, data reload: false

------ Round 1 ----------------------------------
q1	17604	4191	4122	4122
q2	2079	360	239	239
q3	10146	1274	763	763
q4	10237	920	333	333
q5	7521	2183	1891	1891
q6	188	176	137	137
q7	938	804	655	655
q8	9272	1419	1128	1128
q9	6780	5201	5183	5183
q10	6740	1821	1409	1409
q11	493	305	301	301
q12	681	742	585	585
q13	17778	3822	3103	3103
q14	295	299	268	268
q15	575	526	500	500
q16	713	674	636	636
q17	701	744	636	636
q18	7989	7448	7169	7169
q19	1103	971	619	619
q20	410	367	255	255
q21	4203	3906	3314	3314
q22	1054	1002	971	971
Total cold run time: 107500 ms
Total hot run time: 34217 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4154	4111	4093	4093
q2	345	395	325	325
q3	2113	2604	2227	2227
q4	1349	1778	1304	1304
q5	4069	3954	4923	3954
q6	236	186	139	139
q7	2126	1987	1779	1779
q8	2582	2353	2376	2353
q9	7302	7086	7189	7086
q10	2566	2746	2288	2288
q11	579	560	513	513
q12	723	799	617	617
q13	3599	4009	3393	3393
q14	293	310	275	275
q15	538	505	521	505
q16	649	702	670	670
q17	1340	1445	1303	1303
q18	8220	7935	7438	7438
q19	935	952	952	952
q20	2004	2053	1960	1960
q21	4729	4564	4421	4421
q22	1155	1128	1029	1029
Total cold run time: 51606 ms
Total hot run time: 48624 ms

doris-robot · 2025-12-31T09:03:36Z

TPC-DS: Total hot run time: 174918 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 64c6024ba30a9258f27588cc24a7851bc64b4bbd, data reload: false

query5	4430	565	422	422
query6	351	240	218	218
query7	4230	465	271	271
query8	341	263	244	244
query9	8746	2641	2638	2638
query10	520	382	319	319
query11	15325	15061	15083	15061
query12	174	121	117	117
query13	1272	505	403	403
query14	5852	2996	2705	2705
query14_1	2630	2581	2610	2581
query15	195	191	173	173
query16	1014	473	453	453
query17	1107	663	589	589
query18	2427	421	330	330
query19	218	219	184	184
query20	125	115	120	115
query21	210	136	124	124
query22	4014	4157	4008	4008
query23	16033	15667	15325	15325
query23_1	15475	15513	15556	15513
query24	7514	1569	1180	1180
query24_1	1240	1220	1234	1220
query25	533	444	393	393
query26	1238	262	160	160
query27	2778	450	292	292
query28	4568	2204	2189	2189
query29	741	550	418	418
query30	309	241	215	215
query31	786	642	551	551
query32	76	67	67	67
query33	547	331	305	305
query34	911	863	539	539
query35	733	787	719	719
query36	818	823	798	798
query37	135	90	78	78
query38	2737	2717	2633	2633
query39	791	752	731	731
query39_1	719	719	702	702
query40	216	133	116	116
query41	66	63	64	63
query42	105	110	106	106
query43	454	478	415	415
query44	1313	798	739	739
query45	190	182	171	171
query46	869	959	613	613
query47	1373	1481	1376	1376
query48	301	328	247	247
query49	617	408	328	328
query50	639	287	229	229
query51	3815	3885	3767	3767
query52	109	106	95	95
query53	295	324	271	271
query54	293	256	243	243
query55	84	74	73	73
query56	289	285	285	285
query57	1003	1026	958	958
query58	281	257	250	250
query59	2077	2186	2147	2147
query60	318	308	301	301
query61	164	167	176	167
query62	405	345	335	335
query63	297	267	266	266
query64	4964	1291	1062	1062
query65	3739	3660	3774	3660
query66	1472	449	334	334
query67	15388	15285	14839	14839
query68	2765	1049	774	774
query69	451	356	320	320
query70	981	966	933	933
query71	314	304	278	278
query72	5963	5089	4780	4780
query73	479	540	305	305
query74	8828	8736	8617	8617
query75	2822	2875	2511	2511
query76	2866	1056	649	649
query77	336	379	289	289
query78	9701	9817	9110	9110
query79	2352	882	619	619
query80	1692	574	492	492
query81	552	271	235	235
query82	975	145	115	115
query83	337	262	239	239
query84	258	121	103	103
query85	936	522	466	466
query86	410	327	314	314
query87	2865	2908	2773	2773
query88	3381	2272	2263	2263
query89	388	350	327	327
query90	1970	153	150	150
query91	173	167	143	143
query92	70	77	62	62
query93	1101	906	574	574
query94	662	320	296	296
query95	582	317	308	308
query96	593	460	210	210
query97	2302	2379	2293	2293
query98	217	202	200	200
query99	604	575	520	520
Total cold run time: 250023 ms
Total hot run time: 174918 ms

doris-robot · 2025-12-31T09:08:38Z

ClickBench: Total hot run time: 26.88 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 64c6024ba30a9258f27588cc24a7851bc64b4bbd, data reload: false

query1	0.05	0.04	0.04
query2	0.11	0.06	0.05
query3	0.26	0.09	0.08
query4	1.62	0.11	0.11
query5	0.27	0.26	0.27
query6	1.17	0.68	0.64
query7	0.03	0.02	0.02
query8	0.05	0.04	0.04
query9	0.57	0.51	0.50
query10	0.55	0.54	0.53
query11	0.16	0.11	0.12
query12	0.17	0.13	0.13
query13	0.62	0.60	0.60
query14	1.00	0.98	0.98
query15	0.81	0.79	0.81
query16	0.42	0.39	0.42
query17	1.07	1.05	1.04
query18	0.24	0.22	0.21
query19	1.95	1.82	1.88
query20	0.02	0.01	0.01
query21	15.49	0.27	0.13
query22	4.91	0.05	0.04
query23	16.02	0.28	0.11
query24	1.16	0.69	0.18
query25	0.10	0.07	0.09
query26	0.13	0.14	0.13
query27	0.07	0.04	0.04
query28	4.50	1.06	0.87
query29	12.61	3.89	3.18
query30	0.27	0.14	0.11
query31	2.81	0.64	0.37
query32	3.22	0.55	0.47
query33	3.00	3.09	3.03
query34	16.50	5.11	4.49
query35	4.51	4.47	4.49
query36	0.66	0.49	0.49
query37	0.11	0.07	0.06
query38	0.07	0.04	0.04
query39	0.04	0.03	0.03
query40	0.17	0.15	0.13
query41	0.09	0.03	0.04
query42	0.04	0.03	0.03
query43	0.04	0.04	0.03
Total cold run time: 97.66 s
Total hot run time: 26.88 s

hello-stephen · 2025-12-31T09:55:08Z

BE UT Coverage Report

Increment line coverage 100.00% (2/2) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	53.38% (18955/35510)
Line Coverage	39.27% (175966/448085)
Region Coverage	33.85% (136218/402437)
Branch Coverage	34.77% (58802/169140)

JNSimba · 2025-12-31T10:38:00Z

run nonConcurrent

hello-stephen · 2025-12-31T12:46:46Z

BE Regression && UT Coverage Report

Increment line coverage 23.08% (3/13) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	72.21% (25067/34715)
Line Coverage	58.96% (263505/446902)
Region Coverage	53.73% (218497/406621)
Branch Coverage	55.32% (93887/169704)

liaoxin01

LGTM

github-actions · 2026-01-04T03:47:45Z

PR approved by at least one committer and no changes requested.

github-actions · 2026-01-04T03:47:47Z

PR approved by anyone and no changes requested.

shuke987 · 2026-01-04T06:06:52Z

skip buildall

…chronization (#59461) ### What problem does this PR solve? This Issues (#58896) implements multi-table synchronization in MySQL, The main purpose of this PR is to extend the data source to Postgres.

…Postgres synchronization #59461 (#59530) Cherry-picked from #59461 Co-authored-by: wudi <[email protected]>

JNSimba added 6 commits December 22, 2025 20:03

add pg step1

2ce6d24

add pg chunk data read

b511991

add pg incr consumer

c43404d

fix pg incr consumer

53f2832

fix offset and pg

2f9be93

add alltype case

d788021

JNSimba requested review from CalvinKirs and morningman as code owners December 29, 2025 10:45

JNSimba and others added 2 commits December 29, 2025 18:48

clang style fix

d048921

add license

dae08c7

JNSimba added the dev/4.0.x label Dec 29, 2025

improve ci

3aee2e9

JNSimba added 3 commits December 30, 2025 11:35

Merge branch 'master-new' into pgcdc

27844f5

fix ci and case

090d9b8

fix exclude case

168abce

JNSimba requested a review from Copilot December 30, 2025 08:28

Copilot started reviewing on behalf of JNSimba December 30, 2025 08:29 View session

fix

ed7b9dd

JNSimba requested a review from Copilot December 31, 2025 06:12

Copilot started reviewing on behalf of JNSimba December 31, 2025 06:13 View session

Copilot AI reviewed Dec 31, 2025

View reviewed changes

fix audit log

64c6024

liaoxin01 approved these changes Jan 4, 2026

View reviewed changes

github-actions bot added the approved Indicates a PR has been approved by one committer. label Jan 4, 2026

github-actions bot added the reviewed label Jan 4, 2026

CalvinKirs approved these changes Jan 4, 2026

View reviewed changes

JNSimba merged commit 5f92656 into apache:master Jan 4, 2026
28 of 31 checks passed

github-actions bot mentioned this pull request Jan 4, 2026

branch-4.0: [Feature](Streaming Job) Extend streaming job to support Postgres synchronization #59461 #59530

Merged

yiguolei pushed a commit that referenced this pull request Jan 5, 2026

branch-4.0: [Feature](Streaming Job) Extend streaming job to support …

d81698c

…Postgres synchronization #59461 (#59530) Cherry-picked from #59461 Co-authored-by: wudi <[email protected]>

yiguolei added dev/4.0.3-merged and removed dev/4.0.x labels Jan 5, 2026

[Feature](Streaming Job) Extend streaming job to support Postgres synchronization #59461

[Feature](Streaming Job) Extend streaming job to support Postgres synchronization #59461

Uh oh!

Conversation

JNSimba commented Dec 29, 2025

What problem does this PR solve?

Check List (For Author)

Check List (For Reviewer who merge this PR)

Uh oh!

hello-stephen commented Dec 29, 2025

Uh oh!

JNSimba commented Dec 29, 2025

Uh oh!

JNSimba commented Dec 29, 2025

Uh oh!

doris-robot commented Dec 29, 2025

Uh oh!

doris-robot commented Dec 29, 2025

Uh oh!

doris-robot commented Dec 29, 2025

Uh oh!

doris-robot commented Dec 29, 2025

BE UT Coverage Report

Uh oh!

hello-stephen commented Dec 29, 2025

FE UT Coverage Report

Uh oh!

hello-stephen commented Dec 29, 2025

BE Regression && UT Coverage Report

Uh oh!

hello-stephen commented Dec 29, 2025

FE Regression Coverage Report

Uh oh!

JNSimba commented Dec 30, 2025

Uh oh!

hello-stephen commented Dec 30, 2025

FE UT Coverage Report

Uh oh!

hello-stephen commented Dec 30, 2025

BE UT Coverage Report

Uh oh!

JNSimba commented Dec 31, 2025

Uh oh!

doris-robot commented Dec 31, 2025

Uh oh!

doris-robot commented Dec 31, 2025

Uh oh!

doris-robot commented Dec 31, 2025

Uh oh!

hello-stephen commented Dec 31, 2025

BE UT Coverage Report

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

JNSimba commented Dec 31, 2025

Uh oh!

doris-robot commented Dec 31, 2025

Uh oh!

doris-robot commented Dec 31, 2025

Uh oh!

doris-robot commented Dec 31, 2025

Uh oh!

hello-stephen commented Dec 31, 2025

BE UT Coverage Report

Uh oh!

JNSimba commented Dec 31, 2025

Uh oh!

hello-stephen commented Dec 31, 2025