[minor](Prefetch) Revert some useless check

[0AyanamiRei]

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

maybe useless long time check

Release note

None

Check List (For Author)

• Test

  • Regression test
  • Unit Test
  • Manual test (add detailed scripts or steps below)
  • No need to test or manual test. Explain why:
    • This is a refactor/code format and no logic has been changed.
    • Previous test can cover this change.
    • No code files have been changed.
    • Other reason

• Behavior changed:

  • No.
  • Yes.

• Does this need documentation?

  • No.
  • Yes.

Check List (For Reviewer who merge this PR)

• Confirm the release note
• Confirm test cases
• Confirm document
• Add branch pick label

[Thearas]

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
3. What features were added. Why was this function added?
4. Which code was refactored and why was this part of the code refactored?
5. Which functions were optimized and what is the difference before and after the optimization?

[0AyanamiRei]

run buildall

[doris-robot]

TPC-H: Total hot run time: 31346 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ebf2832bfb7bcaf122cba18f1271c14d7bdb47cc, data reload: false

------ Round 1 ----------------------------------
q1	17619	4240	4039	4039
q2	2037	388	238	238
q3	10151	1232	752	752
q4	10206	937	322	322
q5	7535	2106	1874	1874
q6	186	171	140	140
q7	927	797	653	653
q8	9276	1419	1105	1105
q9	4969	4657	4571	4571
q10	6795	1809	1403	1403
q11	508	283	292	283
q12	667	727	581	581
q13	17788	3833	3087	3087
q14	303	300	272	272
q15	593	517	498	498
q16	709	669	628	628
q17	663	749	558	558
q18	6747	6499	6257	6257
q19	1116	949	606	606
q20	408	357	258	258
q21	3006	2352	2271	2271
q22	1034	1027	950	950
Total cold run time: 103243 ms
Total hot run time: 31346 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4102	4061	4062	4061
q2	315	388	336	336
q3	2101	2599	2243	2243
q4	1303	1756	1347	1347
q5	4090	3993	4091	3993
q6	215	173	134	134
q7	1857	1818	1660	1660
q8	2802	2466	2478	2466
q9	7323	7184	7296	7184
q10	2484	2811	2322	2322
q11	561	492	463	463
q12	761	808	601	601
q13	3643	4000	3308	3308
q14	293	333	383	333
q15	551	507	495	495
q16	614	674	640	640
q17	1169	1308	1395	1308
q18	8154	7761	7831	7761
q19	857	806	881	806
q20	2015	2040	1883	1883
q21	4862	4675	4143	4143
q22	1110	1028	969	969
Total cold run time: 51182 ms
Total hot run time: 48456 ms

[doris-robot]

TPC-DS: Total hot run time: 175680 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ebf2832bfb7bcaf122cba18f1271c14d7bdb47cc, data reload: false

query5	4447	602	465	465
query6	352	249	243	243
query7	4229	471	273	273
query8	375	286	271	271
query9	8830	2709	2726	2709
query10	533	392	343	343
query11	15142	15167	14854	14854
query12	185	122	123	122
query13	1293	517	409	409
query14	5832	3040	2768	2768
query14_1	2690	2732	2691	2691
query15	202	200	181	181
query16	1034	480	489	480
query17	1178	742	619	619
query18	2468	472	419	419
query19	229	231	209	209
query20	124	118	120	118
query21	211	138	131	131
query22	3900	3940	3759	3759
query23	16006	15649	15559	15559
query23_1	15448	15552	15422	15422
query24	7407	1545	1185	1185
query24_1	1199	1170	1187	1170
query25	577	486	477	477
query26	1239	272	162	162
query27	2764	455	295	295
query28	4558	2163	2147	2147
query29	799	577	483	483
query30	318	250	217	217
query31	804	640	565	565
query32	85	71	76	71
query33	567	351	313	313
query34	893	865	531	531
query35	743	786	713	713
query36	898	882	858	858
query37	129	99	82	82
query38	2751	2727	2622	2622
query39	770	748	750	748
query39_1	705	705	716	705
query40	228	142	122	122
query41	92	79	81	79
query42	107	110	113	110
query43	473	450	428	428
query44	1331	753	732	732
query45	195	188	187	187
query46	863	966	587	587
query47	1430	1490	1356	1356
query48	335	356	270	270
query49	638	445	362	362
query50	640	282	215	215
query51	3861	3924	3897	3897
query52	104	110	97	97
query53	299	330	283	283
query54	306	270	272	270
query55	86	78	73	73
query56	317	309	317	309
query57	1030	1041	955	955
query58	287	266	270	266
query59	2084	2088	2089	2088
query60	344	340	326	326
query61	203	207	204	204
query62	409	356	342	342
query63	308	270	273	270
query64	5305	1607	1310	1310
query65	3821	3727	3749	3727
query66	1516	473	371	371
query67	14992	15292	15191	15191
query68	4857	1015	730	730
query69	537	377	336	336
query70	1110	907	946	907
query71	367	328	288	288
query72	6529	3868	3756	3756
query73	771	734	310	310
query74	8797	8802	8624	8624
query75	2869	2842	2471	2471
query76	3877	1084	650	650
query77	531	388	299	299
query78	9655	9842	9205	9205
query79	1497	911	596	596
query80	709	610	525	525
query81	517	267	236	236
query82	217	153	123	123
query83	273	274	271	271
query84	268	124	108	108
query85	1061	633	595	595
query86	396	307	326	307
query87	2865	2878	2763	2763
query88	3162	2283	2289	2283
query89	406	353	347	347
query90	2061	160	154	154
query91	207	200	166	166
query92	88	72	65	65
query93	1059	898	531	531
query94	590	341	309	309
query95	603	401	322	322
query96	581	456	213	213
query97	2319	2374	2279	2279
query98	246	214	203	203
query99	586	616	504	504
Total cold run time: 252750 ms
Total hot run time: 175680 ms

[doris-robot]

ClickBench: Total hot run time: 27.14 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ebf2832bfb7bcaf122cba18f1271c14d7bdb47cc, data reload: false

query1	0.05	0.05	0.05
query2	0.10	0.05	0.04
query3	0.25	0.08	0.09
query4	1.61	0.11	0.10
query5	0.27	0.26	0.25
query6	1.14	0.66	0.65
query7	0.03	0.03	0.03
query8	0.05	0.04	0.04
query9	0.57	0.50	0.49
query10	0.55	0.55	0.54
query11	0.14	0.09	0.10
query12	0.14	0.11	0.11
query13	0.60	0.59	0.58
query14	0.94	0.94	0.94
query15	0.81	0.77	0.78
query16	0.38	0.39	0.42
query17	1.01	1.00	1.00
query18	0.24	0.21	0.21
query19	1.92	1.88	1.86
query20	0.02	0.02	0.01
query21	15.43	0.27	0.15
query22	4.87	0.06	0.04
query23	15.88	0.29	0.11
query24	1.05	0.55	0.69
query25	0.11	0.08	0.05
query26	0.15	0.14	0.13
query27	0.06	0.05	0.06
query28	4.46	1.04	0.89
query29	12.69	3.95	3.17
query30	0.28	0.14	0.12
query31	2.81	0.63	0.40
query32	3.24	0.55	0.45
query33	3.01	3.11	3.05
query34	16.42	5.20	4.44
query35	4.52	4.48	4.50
query36	0.69	0.49	0.50
query37	0.10	0.07	0.06
query38	0.08	0.04	0.03
query39	0.05	0.03	0.03
query40	0.18	0.14	0.14
query41	0.08	0.04	0.03
query42	0.04	0.03	0.02
query43	0.04	0.04	0.03
Total cold run time: 97.06 s
Total hot run time: 27.14 s

[doris-robot]

BE UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	53.23% (18972/35642)
Line Coverage	39.19% (175720/448373)
Region Coverage	33.76% (136143/403305)
Branch Coverage	34.72% (58753/169200)

[hello-stephen]

BE Regression && UT Coverage Report

Increment line coverage 100% (0/0) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	72.28% (25185/34843)
Line Coverage	59.11% (264296/447155)
Region Coverage	53.96% (219861/407425)
Branch Coverage	55.54% (94285/169749)