[Test](client) Add s3 storage client test sketelon #57456

wyxxxcat · 2025-10-29T07:13:48Z

What problem does this PR solve?

If you want to run unit tests using a real cloud provider, you can configure it in custom_env.sh.

# Enable S3 client for unit tests
export ENABLE_S3_CLIENT=1
# S3 client config
export S3_AK="xxx"
export S3_SK="xxx"
export S3_ENDPOINT="xxx"
export S3_PROVIDER="xxx"
export S3_BUCKET="xxx"
export S3_REGION="xxx"
export S3_PREFIX=""

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

Test
- Regression test
- Unit Test
- Manual test (add detailed scripts or steps below)
- No need to test or manual test. Explain why:
  - This is a refactor/code format and no logic has been changed.
  - Previous test can cover this change.
  - No code files have been changed.
  - Other reason
Behavior changed:
- No.
- Yes.
Does this need documentation?
- No.
- Yes.

Check List (For Reviewer who merge this PR)

Confirm the release note
Confirm test cases
Confirm document
Add branch pick label

wyxxxcat · 2025-10-31T02:11:13Z

run buildall

doris-robot · 2025-10-31T03:44:39Z

ClickBench: Total hot run time: 28.32 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 397134aaed1d532097d589a575e4f5b15854068b, data reload: false

query1	0.06	0.05	0.06
query2	0.10	0.05	0.05
query3	0.25	0.08	0.08
query4	1.61	0.12	0.12
query5	0.28	0.27	0.26
query6	1.16	0.66	0.66
query7	0.03	0.03	0.03
query8	0.06	0.04	0.04
query9	0.64	0.55	0.53
query10	0.57	0.58	0.58
query11	0.18	0.12	0.12
query12	0.16	0.13	0.13
query13	0.63	0.62	0.61
query14	1.04	0.99	1.02
query15	0.87	0.86	0.85
query16	0.40	0.41	0.41
query17	1.07	1.06	1.04
query18	0.22	0.20	0.20
query19	1.93	1.79	1.83
query20	0.02	0.01	0.02
query21	15.43	0.18	0.13
query22	5.14	0.07	0.05
query23	15.69	0.25	0.11
query24	2.33	0.86	0.88
query25	0.08	0.06	0.06
query26	0.15	0.14	0.14
query27	0.07	0.07	0.06
query28	4.87	1.14	0.94
query29	12.56	4.02	3.32
query30	0.29	0.14	0.12
query31	2.83	0.60	0.39
query32	3.23	0.56	0.49
query33	3.06	3.03	3.09
query34	16.00	5.15	4.59
query35	4.58	4.60	4.64
query36	0.67	0.52	0.50
query37	0.11	0.07	0.07
query38	0.07	0.05	0.04
query39	0.05	0.04	0.03
query40	0.18	0.18	0.15
query41	0.09	0.03	0.03
query42	0.05	0.04	0.03
query43	0.05	0.05	0.03
Total cold run time: 98.86 s
Total hot run time: 28.32 s

wyxxxcat · 2025-10-31T10:07:59Z

run buildall

hello-stephen · 2025-10-31T11:24:17Z

BE UT Coverage Report

Increment line coverage 0.00% (0/4) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	52.69% (18044/34247)
Line Coverage	37.94% (163828/431752)
Region Coverage	32.27% (124861/386880)
Branch Coverage	33.68% (54607/162137)

doris-robot · 2025-10-31T11:49:32Z

ClickBench: Total hot run time: 28.13 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f6c3d9b90e4b48741f86072a0312237b27e0b76b, data reload: false

query1	0.06	0.04	0.05
query2	0.09	0.05	0.05
query3	0.26	0.08	0.08
query4	1.60	0.11	0.12
query5	0.28	0.26	0.26
query6	1.15	0.67	0.65
query7	0.03	0.03	0.03
query8	0.06	0.04	0.05
query9	0.61	0.53	0.52
query10	0.59	0.59	0.57
query11	0.18	0.11	0.12
query12	0.15	0.12	0.12
query13	0.62	0.61	0.60
query14	1.02	1.03	1.00
query15	0.86	0.85	0.86
query16	0.39	0.40	0.41
query17	1.05	1.07	1.08
query18	0.23	0.21	0.21
query19	2.02	1.87	1.93
query20	0.02	0.01	0.02
query21	15.43	0.21	0.13
query22	5.09	0.07	0.05
query23	15.68	0.26	0.10
query24	2.58	0.63	0.63
query25	0.07	0.06	0.07
query26	0.15	0.14	0.14
query27	0.07	0.06	0.05
query28	5.01	1.16	0.95
query29	12.63	4.06	3.39
query30	0.28	0.15	0.11
query31	2.83	0.62	0.39
query32	3.23	0.56	0.47
query33	3.12	3.07	3.14
query34	15.96	5.20	4.55
query35	4.56	4.59	4.60
query36	0.71	0.51	0.50
query37	0.10	0.06	0.07
query38	0.07	0.04	0.05
query39	0.04	0.04	0.03
query40	0.19	0.16	0.13
query41	0.09	0.04	0.03
query42	0.04	0.03	0.03
query43	0.05	0.04	0.04
Total cold run time: 99.25 s
Total hot run time: 28.13 s

hello-stephen · 2025-10-31T14:59:30Z

BE Regression && UT Coverage Report

Increment line coverage 25.00% (1/4) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	71.41% (24034/33656)
Line Coverage	57.86% (250199/432441)
Region Coverage	52.96% (207824/392434)
Branch Coverage	54.72% (89326/163238)

dataroaring · 2025-11-06T18:30:55Z

run buildall

doris-robot · 2025-11-06T20:11:17Z

TPC-DS: Total hot run time: 189275 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 329d10879c1c5e73b7175aca5cbdc336c931b2ca, data reload: false

query1	1040	393	413	393
query2	6559	1707	1686	1686
query3	6759	224	223	223
query4	26473	23290	23484	23290
query5	4480	608	459	459
query6	331	239	237	237
query7	4660	495	302	302
query8	310	267	253	253
query9	8735	2619	2604	2604
query10	503	346	309	309
query11	15264	15011	14874	14874
query12	186	122	115	115
query13	1699	561	441	441
query14	11171	9398	9360	9360
query15	198	190	173	173
query16	7692	672	525	525
query17	1341	738	631	631
query18	2032	411	305	305
query19	223	218	200	200
query20	141	131	123	123
query21	223	145	119	119
query22	4541	4579	4500	4500
query23	34943	33452	33954	33452
query24	8608	2579	2535	2535
query25	650	640	505	505
query26	1263	294	179	179
query27	3032	545	364	364
query28	4385	2261	2210	2210
query29	899	668	533	533
query30	340	237	204	204
query31	955	871	742	742
query32	81	80	75	75
query33	598	410	345	345
query34	841	890	538	538
query35	845	854	796	796
query36	971	972	892	892
query37	126	113	87	87
query38	3577	3503	3531	3503
query39	1486	1432	1407	1407
query40	220	132	171	132
query41	59	58	55	55
query42	117	110	106	106
query43	468	492	460	460
query44	1227	740	741	740
query45	180	174	172	172
query46	870	985	634	634
query47	1737	1773	1709	1709
query48	387	423	336	336
query49	778	528	403	403
query50	641	696	403	403
query51	3930	3945	3845	3845
query52	106	100	94	94
query53	231	263	196	196
query54	304	288	273	273
query55	86	84	84	84
query56	308	332	310	310
query57	1156	1185	1116	1116
query58	292	269	273	269
query59	2496	2738	2506	2506
query60	351	347	329	329
query61	160	155	153	153
query62	797	747	694	694
query63	223	195	193	193
query64	4484	1191	877	877
query65	4043	3958	4019	3958
query66	1095	428	330	330
query67	15446	15152	14901	14901
query68	8598	926	593	593
query69	494	321	299	299
query70	1358	1293	1277	1277
query71	528	348	314	314
query72	5986	4936	4998	4936
query73	724	590	358	358
query74	9290	9032	8944	8944
query75	3996	3385	2816	2816
query76	3816	1196	727	727
query77	790	412	315	315
query78	9542	9784	8946	8946
query79	2409	809	617	617
query80	710	576	510	510
query81	492	262	226	226
query82	451	157	134	134
query83	303	258	248	248
query84	306	106	96	96
query85	912	480	436	436
query86	336	270	297	270
query87	3784	3726	3634	3634
query88	2840	2295	2208	2208
query89	416	323	297	297
query90	2039	217	209	209
query91	165	168	139	139
query92	81	69	67	67
query93	1230	969	639	639
query94	709	447	339	339
query95	401	315	305	305
query96	483	576	276	276
query97	2923	2980	2853	2853
query98	238	213	211	211
query99	1420	1413	1269	1269
Total cold run time: 278123 ms
Total hot run time: 189275 ms

doris-robot · 2025-11-06T20:16:23Z

ClickBench: Total hot run time: 27.79 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 329d10879c1c5e73b7175aca5cbdc336c931b2ca, data reload: false

query1	0.05	0.04	0.05
query2	0.10	0.05	0.05
query3	0.24	0.08	0.08
query4	1.61	0.12	0.11
query5	0.28	0.26	0.25
query6	1.18	0.64	0.65
query7	0.03	0.03	0.02
query8	0.06	0.04	0.04
query9	0.58	0.53	0.51
query10	0.58	0.57	0.59
query11	0.16	0.12	0.11
query12	0.15	0.12	0.12
query13	0.63	0.61	0.60
query14	1.00	0.99	0.99
query15	0.84	0.83	0.85
query16	0.39	0.40	0.38
query17	1.01	1.08	1.02
query18	0.21	0.20	0.20
query19	1.92	1.83	1.82
query20	0.02	0.01	0.02
query21	15.46	0.19	0.12
query22	5.10	0.07	0.05
query23	15.68	0.26	0.09
query24	2.94	0.82	0.86
query25	0.09	0.06	0.05
query26	0.14	0.13	0.13
query27	0.06	0.05	0.05
query28	4.50	1.14	0.92
query29	12.61	3.92	3.21
query30	0.28	0.13	0.11
query31	2.82	0.58	0.38
query32	3.22	0.54	0.48
query33	3.08	3.04	3.12
query34	15.76	5.16	4.53
query35	4.56	4.57	4.58
query36	0.68	0.50	0.50
query37	0.10	0.06	0.07
query38	0.06	0.04	0.04
query39	0.04	0.03	0.03
query40	0.18	0.14	0.14
query41	0.08	0.03	0.02
query42	0.04	0.03	0.03
query43	0.04	0.04	0.03
Total cold run time: 98.56 s
Total hot run time: 27.79 s

hello-stephen · 2025-11-06T21:31:55Z

BE UT Coverage Report

Increment line coverage 0.00% (0/12) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	52.70% (18225/34581)
Line Coverage	38.08% (165762/435256)
Region Coverage	33.12% (129009/389462)
Branch Coverage	33.85% (55310/163396)

hello-stephen · 2025-11-06T22:47:23Z

BE Regression && UT Coverage Report

Increment line coverage 8.33% (1/12) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	71.51% (24276/33947)
Line Coverage	57.98% (252468/435438)
Region Coverage	53.25% (210196/394698)
Branch Coverage	54.62% (89789/164403)

wyxxxcat · 2025-11-10T08:48:49Z

run buildall

doris-robot · 2025-11-10T10:22:28Z

TPC-H: Total hot run time: 35163 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 996e24cec70ec55b7d284cb213d9012eb10b9767, data reload: false

------ Round 1 ----------------------------------
q1	17616	5262	5005	5005
q2	2024	333	203	203
q3	10257	1269	725	725
q4	10231	979	388	388
q5	7513	2440	2356	2356
q6	188	168	137	137
q7	966	764	654	654
q8	9361	1372	1151	1151
q9	7291	5166	5185	5166
q10	6881	2258	1848	1848
q11	498	300	275	275
q12	334	369	232	232
q13	17803	3640	3091	3091
q14	233	248	216	216
q15	585	513	501	501
q16	1025	990	949	949
q17	599	878	361	361
q18	7484	7510	7664	7510
q19	1402	1025	576	576
q20	360	336	245	245
q21	3989	4227	2510	2510
q22	1164	1118	1064	1064
Total cold run time: 107804 ms
Total hot run time: 35163 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5436	5302	5577	5302
q2	252	338	232	232
q3	2368	2881	2651	2651
q4	1417	1887	1367	1367
q5	4685	4507	4717	4507
q6	209	167	127	127
q7	1961	1920	1726	1726
q8	2653	2593	2479	2479
q9	7597	7261	7409	7261
q10	3122	3243	2833	2833
q11	582	530	492	492
q12	619	722	587	587
q13	3260	3695	3061	3061
q14	269	290	257	257
q15	579	505	495	495
q16	1009	1049	999	999
q17	1115	1401	1397	1397
q18	7253	7169	6948	6948
q19	741	747	794	747
q20	1897	1941	1802	1802
q21	4761	4474	4326	4326
q22	1116	1040	993	993
Total cold run time: 52901 ms
Total hot run time: 50589 ms

doris-robot · 2025-11-10T10:34:06Z

TPC-DS: Total hot run time: 188130 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 996e24cec70ec55b7d284cb213d9012eb10b9767, data reload: false

query1	1045	396	399	396
query2	6558	1684	1661	1661
query3	6767	226	231	226
query4	26365	23384	23401	23384
query5	4365	620	447	447
query6	323	241	210	210
query7	4637	494	292	292
query8	306	254	248	248
query9	8700	2571	2564	2564
query10	505	340	283	283
query11	15406	14980	14775	14775
query12	172	122	112	112
query13	1668	556	423	423
query14	10242	9260	9274	9260
query15	201	188	178	178
query16	7532	692	526	526
query17	1256	772	627	627
query18	2040	428	328	328
query19	241	210	183	183
query20	135	123	126	123
query21	228	132	116	116
query22	4115	4130	3974	3974
query23	34612	33177	32973	32973
query24	8476	2402	2423	2402
query25	626	547	484	484
query26	921	269	164	164
query27	2739	498	356	356
query28	4369	2208	2170	2170
query29	799	629	513	513
query30	305	223	200	200
query31	923	806	777	777
query32	80	70	74	70
query33	569	361	327	327
query34	781	840	515	515
query35	801	853	759	759
query36	935	1008	897	897
query37	130	109	81	81
query38	3548	3533	3530	3530
query39	1478	1447	1402	1402
query40	212	125	120	120
query41	64	61	58	58
query42	129	111	110	110
query43	506	485	465	465
query44	1216	744	733	733
query45	189	178	173	173
query46	876	985	639	639
query47	1733	1769	1697	1697
query48	395	413	319	319
query49	730	513	420	420
query50	642	693	409	409
query51	3899	3976	3871	3871
query52	108	106	101	101
query53	232	273	199	199
query54	319	294	277	277
query55	89	87	83	83
query56	317	312	316	312
query57	1189	1184	1133	1133
query58	298	305	291	291
query59	2580	2708	2564	2564
query60	353	359	329	329
query61	192	158	156	156
query62	811	731	678	678
query63	230	192	192	192
query64	3728	1144	832	832
query65	4032	3961	3971	3961
query66	993	440	336	336
query67	15355	15215	15209	15209
query68	8216	874	587	587
query69	493	321	282	282
query70	1362	1197	1233	1197
query71	464	333	327	327
query72	6011	4873	4930	4873
query73	666	596	365	365
query74	9149	9131	8926	8926
query75	3607	3325	2798	2798
query76	3379	1168	767	767
query77	556	392	317	317
query78	9541	9674	8947	8947
query79	2228	858	600	600
query80	719	570	493	493
query81	519	261	235	235
query82	305	162	135	135
query83	258	258	248	248
query84	251	112	97	97
query85	876	466	452	452
query86	389	300	291	291
query87	3734	3715	3586	3586
query88	2971	2279	2295	2279
query89	383	335	294	294
query90	1875	240	232	232
query91	165	164	133	133
query92	85	70	62	62
query93	2575	981	635	635
query94	707	467	327	327
query95	406	319	321	319
query96	493	577	285	285
query97	2892	2961	2884	2884
query98	241	220	208	208
query99	1349	1431	1326	1326
Total cold run time: 273181 ms
Total hot run time: 188130 ms

doris-robot · 2025-11-10T10:39:13Z

ClickBench: Total hot run time: 27.38 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 996e24cec70ec55b7d284cb213d9012eb10b9767, data reload: false

query1	0.06	0.05	0.05
query2	0.09	0.04	0.04
query3	0.25	0.08	0.09
query4	1.61	0.11	0.11
query5	0.28	0.25	0.26
query6	1.18	0.64	0.65
query7	0.03	0.02	0.02
query8	0.06	0.04	0.04
query9	0.59	0.51	0.52
query10	0.58	0.57	0.56
query11	0.16	0.12	0.11
query12	0.15	0.12	0.11
query13	0.62	0.60	0.60
query14	0.99	1.00	1.00
query15	0.86	0.83	0.84
query16	0.39	0.39	0.40
query17	1.03	1.04	1.04
query18	0.21	0.20	0.20
query19	1.93	1.77	1.78
query20	0.01	0.02	0.01
query21	15.43	0.20	0.13
query22	5.08	0.07	0.05
query23	15.67	0.25	0.10
query24	2.84	0.68	0.35
query25	0.09	0.06	0.06
query26	0.14	0.13	0.14
query27	0.06	0.06	0.06
query28	4.72	1.13	0.92
query29	12.56	3.87	3.26
query30	0.29	0.14	0.11
query31	2.81	0.60	0.39
query32	3.23	0.55	0.47
query33	3.01	3.04	3.07
query34	15.82	5.16	4.55
query35	4.64	4.56	4.57
query36	0.67	0.50	0.49
query37	0.10	0.06	0.07
query38	0.06	0.04	0.03
query39	0.04	0.03	0.03
query40	0.18	0.14	0.15
query41	0.09	0.04	0.03
query42	0.04	0.02	0.02
query43	0.05	0.04	0.04
Total cold run time: 98.7 s
Total hot run time: 27.38 s

doris-robot · 2025-11-10T11:45:25Z

BE UT Coverage Report

Increment line coverage 0.00% (0/12) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	52.70% (18226/34582)
Line Coverage	38.09% (165786/435305)
Region Coverage	33.14% (129076/389488)
Branch Coverage	33.85% (55316/163408)

hello-stephen · 2025-11-10T12:51:28Z

BE Regression && UT Coverage Report

Increment line coverage 8.33% (1/12) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	71.58% (24299/33948)
Line Coverage	58.06% (252854/435489)
Region Coverage	53.29% (210356/394724)
Branch Coverage	54.68% (89910/164415)

wyxxxcat · 2025-11-12T08:04:21Z

run buildall

doris-robot · 2025-11-12T09:19:10Z

TPC-H: Total hot run time: 34672 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a439049a10f122f64601e067acb3c24c040b3aa7, data reload: false

------ Round 1 ----------------------------------
q1	17624	5222	5026	5026
q2	1999	332	209	209
q3	10238	1305	739	739
q4	10236	935	387	387
q5	7546	2417	2400	2400
q6	182	166	137	137
q7	934	793	637	637
q8	9369	1367	1133	1133
q9	7074	5176	5181	5176
q10	6878	2278	1842	1842
q11	539	303	292	292
q12	360	365	235	235
q13	17800	3673	3095	3095
q14	246	241	218	218
q15	598	518	512	512
q16	996	993	955	955
q17	600	880	383	383
q18	7443	7265	7117	7117
q19	1099	969	557	557
q20	392	369	244	244
q21	4281	3240	2387	2387
q22	1078	1033	991	991
Total cold run time: 107512 ms
Total hot run time: 34672 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5113	5114	5148	5114
q2	249	318	234	234
q3	2249	2714	2306	2306
q4	1405	1783	1347	1347
q5	4217	4668	4586	4586
q6	222	171	125	125
q7	2059	2003	1844	1844
q8	2705	2673	2547	2547
q9	7386	7275	7336	7275
q10	3310	3254	2764	2764
q11	579	537	520	520
q12	692	791	630	630
q13	3600	4036	3397	3397
q14	302	312	293	293
q15	530	496	535	496
q16	1087	1126	1054	1054
q17	1215	1587	1464	1464
q18	7826	7568	7517	7517
q19	843	871	911	871
q20	2011	2062	1980	1980
q21	5214	4511	4402	4402
q22	1112	1062	1013	1013
Total cold run time: 53926 ms
Total hot run time: 51779 ms

doris-robot · 2025-11-12T09:30:54Z

TPC-DS: Total hot run time: 188818 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a439049a10f122f64601e067acb3c24c040b3aa7, data reload: false

query1	1061	414	397	397
query2	6577	1739	1740	1739
query3	6765	228	221	221
query4	26395	23495	23552	23495
query5	4457	665	458	458
query6	339	236	216	216
query7	4641	497	301	301
query8	299	246	247	246
query9	8662	2592	2588	2588
query10	507	334	291	291
query11	15588	15090	14819	14819
query12	171	118	110	110
query13	1669	557	450	450
query14	10352	9186	9179	9179
query15	212	187	174	174
query16	7362	667	516	516
query17	1231	744	613	613
query18	1991	416	313	313
query19	202	197	171	171
query20	125	126	117	117
query21	220	131	114	114
query22	4022	4154	4084	4084
query23	34268	33333	33331	33331
query24	8517	2396	2407	2396
query25	589	510	475	475
query26	1235	275	154	154
query27	2775	489	362	362
query28	4380	2221	2218	2218
query29	823	598	496	496
query30	299	226	188	188
query31	881	808	744	744
query32	86	74	76	74
query33	612	384	333	333
query34	793	833	505	505
query35	835	846	731	731
query36	961	982	897	897
query37	114	106	89	89
query38	3585	3543	3499	3499
query39	1461	1415	1404	1404
query40	230	136	122	122
query41	68	64	68	64
query42	129	126	115	115
query43	478	512	482	482
query44	1246	759	748	748
query45	187	183	178	178
query46	899	991	640	640
query47	1786	1790	1708	1708
query48	403	429	324	324
query49	799	537	447	447
query50	649	688	409	409
query51	3831	3943	3911	3911
query52	118	111	101	101
query53	242	273	204	204
query54	319	305	291	291
query55	94	90	91	90
query56	348	359	326	326
query57	1188	1184	1130	1130
query58	309	288	280	280
query59	2585	2741	2590	2590
query60	382	355	344	344
query61	186	189	186	186
query62	802	724	666	666
query63	232	201	196	196
query64	4671	1282	947	947
query65	4065	3940	3954	3940
query66	1204	482	361	361
query67	15705	15052	15171	15052
query68	8313	938	603	603
query69	501	333	355	333
query70	1338	1307	1271	1271
query71	479	349	316	316
query72	5800	4933	4842	4842
query73	663	566	360	360
query74	8889	8890	8855	8855
query75	3930	3337	2819	2819
query76	3734	1142	765	765
query77	817	395	311	311
query78	9610	9690	8892	8892
query79	2693	800	605	605
query80	700	559	510	510
query81	524	258	232	232
query82	451	157	135	135
query83	276	263	247	247
query84	258	117	96	96
query85	919	483	450	450
query86	384	295	292	292
query87	3720	3627	3601	3601
query88	3827	2206	2212	2206
query89	391	327	299	299
query90	1930	221	221	221
query91	167	181	149	149
query92	88	69	68	68
query93	2113	990	637	637
query94	713	449	343	343
query95	400	322	313	313
query96	479	575	280	280
query97	2923	2988	2901	2901
query98	251	219	212	212
query99	1639	1393	1294	1294
Total cold run time: 277137 ms
Total hot run time: 188818 ms

doris-robot · 2025-11-12T09:35:58Z

ClickBench: Total hot run time: 27.17 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a439049a10f122f64601e067acb3c24c040b3aa7, data reload: false

query1	0.05	0.04	0.04
query2	0.09	0.05	0.05
query3	0.26	0.08	0.08
query4	1.60	0.11	0.11
query5	0.26	0.26	0.25
query6	1.19	0.65	0.64
query7	0.03	0.02	0.02
query8	0.05	0.04	0.04
query9	0.58	0.52	0.51
query10	0.58	0.56	0.56
query11	0.17	0.11	0.11
query12	0.15	0.12	0.12
query13	0.62	0.60	0.60
query14	1.01	1.00	0.99
query15	0.84	0.82	0.83
query16	0.39	0.39	0.42
query17	1.01	1.05	1.03
query18	0.22	0.19	0.20
query19	1.90	1.80	1.79
query20	0.02	0.01	0.02
query21	15.47	0.20	0.12
query22	5.16	0.06	0.04
query23	15.67	0.26	0.11
query24	1.91	1.03	0.29
query25	0.07	0.07	0.06
query26	0.13	0.15	0.13
query27	0.06	0.06	0.05
query28	4.03	1.14	0.93
query29	12.58	3.82	3.18
query30	0.27	0.14	0.11
query31	2.82	0.58	0.38
query32	3.23	0.56	0.46
query33	3.01	3.03	3.06
query34	15.93	5.16	4.52
query35	4.51	4.60	4.56
query36	0.70	0.50	0.49
query37	0.10	0.07	0.06
query38	0.07	0.04	0.04
query39	0.03	0.03	0.03
query40	0.17	0.13	0.13
query41	0.09	0.04	0.03
query42	0.04	0.03	0.03
query43	0.04	0.04	0.04
Total cold run time: 97.11 s
Total hot run time: 27.17 s

hello-stephen · 2025-11-12T11:09:54Z

BE UT Coverage Report

Increment line coverage 0.00% (0/5) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	52.74% (18279/34659)
Line Coverage	38.13% (166178/435797)
Region Coverage	33.15% (129194/389740)
Branch Coverage	33.89% (55433/163567)

wyxxxcat · 2025-11-13T08:08:23Z

run buildall

doris-robot · 2025-11-13T10:06:38Z

TPC-H: Total hot run time: 36713 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 54437ab1510b22d9ec68c09cefcbd4be95a23be4, data reload: false

------ Round 1 ----------------------------------
q1	17598	5233	5107	5107
q2	2069	369	232	232
q3	10168	1322	783	783
q4	10243	928	384	384
q5	7583	2423	2636	2423
q6	198	171	145	145
q7	947	810	659	659
q8	9411	1386	1220	1220
q9	7020	5173	5259	5173
q10	6934	2229	1853	1853
q11	514	316	290	290
q12	371	380	252	252
q13	17785	3660	3065	3065
q14	244	243	219	219
q15	580	523	513	513
q16	996	1009	982	982
q17	617	879	380	380
q18	7574	7768	8068	7768
q19	1353	1011	619	619
q20	399	382	246	246
q21	4454	3841	3375	3375
q22	1144	1101	1025	1025
Total cold run time: 108202 ms
Total hot run time: 36713 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5523	5550	5372	5372
q2	259	331	250	250
q3	2465	2810	2531	2531
q4	1460	1932	1472	1472
q5	4630	4385	4445	4385
q6	205	160	121	121
q7	2091	1983	1784	1784
q8	2680	2653	2521	2521
q9	7308	7369	7241	7241
q10	3061	3273	2754	2754
q11	580	537	487	487
q12	653	753	586	586
q13	3313	3655	3032	3032
q14	270	288	254	254
q15	533	489	482	482
q16	1005	1059	1006	1006
q17	1126	1524	1326	1326
q18	7461	7164	6946	6946
q19	823	869	960	869
q20	1919	1978	1847	1847
q21	4683	4406	4501	4406
q22	1091	1036	995	995
Total cold run time: 53139 ms
Total hot run time: 50667 ms

doris-robot · 2025-11-13T10:18:18Z

TPC-DS: Total hot run time: 187832 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 54437ab1510b22d9ec68c09cefcbd4be95a23be4, data reload: false

query1	1026	420	395	395
query2	6563	1688	1715	1688
query3	6759	230	225	225
query4	26463	23704	23185	23185
query5	4861	635	489	489
query6	357	245	235	235
query7	4648	507	306	306
query8	316	267	253	253
query9	8750	2614	2607	2607
query10	533	359	295	295
query11	15830	15143	14803	14803
query12	195	122	112	112
query13	1707	545	443	443
query14	11997	9248	9200	9200
query15	200	190	166	166
query16	7670	709	498	498
query17	1445	749	606	606
query18	2014	405	313	313
query19	201	216	172	172
query20	125	126	120	120
query21	217	146	120	120
query22	4072	4016	4004	4004
query23	34008	33320	33041	33041
query24	8266	2387	2403	2387
query25	617	551	478	478
query26	1247	275	167	167
query27	2744	507	353	353
query28	4390	2239	2206	2206
query29	833	634	509	509
query30	300	227	234	227
query31	925	823	714	714
query32	89	80	71	71
query33	604	376	325	325
query34	799	854	516	516
query35	804	852	746	746
query36	953	993	899	899
query37	137	109	82	82
query38	3493	3554	3476	3476
query39	1466	1420	1418	1418
query40	220	133	119	119
query41	80	66	72	66
query42	128	114	118	114
query43	485	490	467	467
query44	1215	748	733	733
query45	187	183	182	182
query46	889	998	638	638
query47	1770	1755	1715	1715
query48	390	415	331	331
query49	770	515	392	392
query50	651	692	413	413
query51	3849	3990	3838	3838
query52	109	112	96	96
query53	236	271	195	195
query54	309	299	274	274
query55	92	82	84	82
query56	328	337	316	316
query57	1192	1178	1118	1118
query58	298	269	282	269
query59	2617	2729	2647	2647
query60	347	338	328	328
query61	165	156	153	153
query62	828	751	725	725
query63	230	196	193	193
query64	4455	1161	858	858
query65	4027	3937	3948	3937
query66	1079	462	335	335
query67	15429	14990	14946	14946
query68	7166	925	591	591
query69	494	323	279	279
query70	1331	1356	1246	1246
query71	447	337	305	305
query72	6008	4986	4916	4916
query73	647	577	364	364
query74	8831	9082	8804	8804
query75	3307	3287	2817	2817
query76	3333	1159	732	732
query77	513	397	318	318
query78	9475	9825	8956	8956
query79	1411	849	582	582
query80	1663	557	529	529
query81	549	264	231	231
query82	400	158	130	130
query83	371	265	249	249
query84	253	115	103	103
query85	906	476	445	445
query86	387	320	290	290
query87	3709	3701	3618	3618
query88	2845	2289	2269	2269
query89	384	319	296	296
query90	1785	228	215	215
query91	168	159	134	134
query92	69	70	66	66
query93	1131	986	649	649
query94	735	433	353	353
query95	413	319	320	319
query96	492	559	285	285
query97	2903	3014	2897	2897
query98	237	221	209	209
query99	1293	1429	1305	1305
Total cold run time: 273655 ms
Total hot run time: 187832 ms

doris-robot · 2025-11-13T10:23:23Z

ClickBench: Total hot run time: 27.52 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 54437ab1510b22d9ec68c09cefcbd4be95a23be4, data reload: false

query1	0.06	0.05	0.04
query2	0.09	0.05	0.05
query3	0.25	0.08	0.08
query4	1.61	0.12	0.11
query5	0.26	0.24	0.26
query6	1.17	0.64	0.65
query7	0.03	0.03	0.03
query8	0.06	0.05	0.05
query9	0.59	0.53	0.52
query10	0.58	0.58	0.57
query11	0.16	0.11	0.12
query12	0.16	0.12	0.12
query13	0.62	0.61	0.61
query14	0.99	0.99	1.00
query15	0.85	0.83	0.85
query16	0.39	0.40	0.41
query17	1.02	1.01	1.03
query18	0.22	0.20	0.20
query19	1.86	1.80	1.77
query20	0.01	0.01	0.02
query21	15.48	0.19	0.13
query22	5.03	0.07	0.05
query23	15.66	0.26	0.10
query24	2.42	0.48	0.49
query25	0.08	0.06	0.06
query26	0.14	0.13	0.14
query27	0.07	0.06	0.05
query28	4.23	1.12	0.95
query29	12.58	3.91	3.23
query30	0.29	0.14	0.13
query31	2.81	0.60	0.37
query32	3.24	0.57	0.47
query33	3.02	3.23	3.02
query34	15.83	5.11	4.55
query35	4.56	4.57	4.60
query36	0.68	0.50	0.48
query37	0.10	0.07	0.07
query38	0.06	0.04	0.03
query39	0.04	0.03	0.03
query40	0.17	0.14	0.14
query41	0.08	0.04	0.04
query42	0.04	0.03	0.03
query43	0.04	0.03	0.03
Total cold run time: 97.63 s
Total hot run time: 27.52 s

doris-robot · 2025-11-13T11:01:54Z

BE UT Coverage Report

Increment line coverage 0.00% (0/5) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	52.73% (18280/34666)
Line Coverage	38.13% (166240/435926)
Region Coverage	33.17% (129307/389844)
Branch Coverage	33.89% (55461/163632)

hello-stephen · 2025-11-13T11:56:32Z

BE Regression && UT Coverage Report

Increment line coverage 20.00% (1/5) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	71.53% (24332/34018)
Line Coverage	58.03% (253055/436066)
Region Coverage	53.57% (211622/395070)
Branch Coverage	54.75% (90134/164631)

hello-stephen · 2025-11-14T11:03:42Z

BE Regression && UT Coverage Report

Increment line coverage 20.00% (1/5) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	71.54% (24336/34018)
Line Coverage	58.04% (253100/436066)
Region Coverage	53.55% (211575/395070)
Branch Coverage	54.75% (90134/164631)

wyxxxcat · 2025-11-17T07:51:50Z

run check_coverage

hello-stephen · 2025-11-17T08:08:20Z

BE Regression && UT Coverage Report

Increment line coverage 20.00% (1/5) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	71.54% (24336/34018)
Line Coverage	58.04% (253100/436066)
Region Coverage	53.55% (211575/395070)
Branch Coverage	54.75% (90134/164631)

github-actions · 2025-11-19T09:25:06Z

PR approved by at least one committer and no changes requested.

github-actions · 2025-11-19T09:25:08Z

PR approved by anyone and no changes requested.

dataroaring

LGTM

### What problem does this PR solve? If you want to run unit tests using a real cloud provider, you can configure it in `custom_env.sh`. ``` # Enable S3 client for unit tests export ENABLE_S3_CLIENT=1 # S3 client config export S3_AK="xxx" export S3_SK="xxx" export S3_ENDPOINT="xxx" export S3_PROVIDER="xxx" export S3_BUCKET="xxx" export S3_REGION="xxx" export S3_PREFIX="" ```

…#58164) Cherry-picked from #57456 Co-authored-by: Yixuan Wang <wangyixuan@selectdb.com>

wyxxxcat force-pushed the chore_fs_accessor_ut branch from 1b1bb78 to 397134a Compare October 30, 2025 08:18

wyxxxcat marked this pull request as ready for review October 30, 2025 08:18

wyxxxcat requested review from dataroaring and gavinchou as code owners October 30, 2025 08:18

wyxxxcat force-pushed the chore_fs_accessor_ut branch from 397134a to f6c3d9b Compare October 31, 2025 10:07

wyxxxcat force-pushed the chore_fs_accessor_ut branch from f6c3d9b to 329d108 Compare November 3, 2025 06:42

wyxxxcat force-pushed the chore_fs_accessor_ut branch from 329d108 to 996e24c Compare November 10, 2025 08:48

wyxxxcat force-pushed the chore_fs_accessor_ut branch from 996e24c to a439049 Compare November 12, 2025 08:03

1

54437ab

wyxxxcat force-pushed the chore_fs_accessor_ut branch from 7f623d8 to 54437ab Compare November 13, 2025 08:07

gavinchou approved these changes Nov 19, 2025

View reviewed changes

gavinchou added dev/3.1.x dev/4.0.x labels Nov 19, 2025

github-actions bot added the approved Indicates a PR has been approved by one committer. label Nov 19, 2025

github-actions bot added the reviewed label Nov 19, 2025

koarz approved these changes Nov 19, 2025

View reviewed changes

0AyanamiRei approved these changes Nov 19, 2025

View reviewed changes

dataroaring approved these changes Nov 19, 2025

View reviewed changes

hello-stephen merged commit a7ec6d6 into apache:master Nov 20, 2025
33 of 34 checks passed

github-actions bot mentioned this pull request Nov 20, 2025

branch-3.1: [Test](client) Add s3 storage client test sketelon #57456 #58163

Open

github-actions bot mentioned this pull request Nov 20, 2025

branch-4.0: [Test](client) Add s3 storage client test sketelon #57456 #58164

Merged

wyxxxcat mentioned this pull request Nov 21, 2025

[Test](client) Add s3 storage client test for accessor #58242

Open

16 tasks

yiguolei pushed a commit that referenced this pull request Nov 24, 2025

branch-4.0: [Test](client) Add s3 storage client test sketelon #57456 (…

78da615

…#58164) Cherry-picked from #57456 Co-authored-by: Yixuan Wang <wangyixuan@selectdb.com>

yiguolei added dev/4.0.2-merged and removed dev/4.0.x labels Nov 24, 2025

[Test](client) Add s3 storage client test sketelon #57456

[Test](client) Add s3 storage client test sketelon #57456

Conversation

wyxxxcat commented Oct 29, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What problem does this PR solve?

Release note

Check List (For Author)

Check List (For Reviewer who merge this PR)

Uh oh!

wyxxxcat commented Oct 31, 2025

Uh oh!

doris-robot commented Oct 31, 2025

Uh oh!

wyxxxcat commented Oct 31, 2025

Uh oh!

hello-stephen commented Oct 31, 2025

BE UT Coverage Report

Uh oh!

doris-robot commented Oct 31, 2025

Uh oh!

hello-stephen commented Oct 31, 2025

BE Regression && UT Coverage Report

Uh oh!

dataroaring commented Nov 6, 2025

Uh oh!

doris-robot commented Nov 6, 2025

Uh oh!

doris-robot commented Nov 6, 2025

Uh oh!

hello-stephen commented Nov 6, 2025

BE UT Coverage Report

Uh oh!

hello-stephen commented Nov 6, 2025

BE Regression && UT Coverage Report

Uh oh!

wyxxxcat commented Nov 10, 2025

Uh oh!

doris-robot commented Nov 10, 2025

Uh oh!

doris-robot commented Nov 10, 2025

Uh oh!

doris-robot commented Nov 10, 2025

Uh oh!

doris-robot commented Nov 10, 2025

BE UT Coverage Report

Uh oh!

hello-stephen commented Nov 10, 2025

BE Regression && UT Coverage Report

Uh oh!

wyxxxcat commented Nov 12, 2025

Uh oh!

doris-robot commented Nov 12, 2025

Uh oh!

doris-robot commented Nov 12, 2025

Uh oh!

doris-robot commented Nov 12, 2025

Uh oh!

hello-stephen commented Nov 12, 2025

BE UT Coverage Report

Uh oh!

wyxxxcat commented Nov 13, 2025

Uh oh!

doris-robot commented Nov 13, 2025

Uh oh!

doris-robot commented Nov 13, 2025

Uh oh!

doris-robot commented Nov 13, 2025

Uh oh!

doris-robot commented Nov 13, 2025

BE UT Coverage Report

Uh oh!

hello-stephen commented Nov 13, 2025

BE Regression && UT Coverage Report

Uh oh!

hello-stephen commented Nov 14, 2025

BE Regression && UT Coverage Report

Uh oh!

wyxxxcat commented Nov 17, 2025

Uh oh!

wyxxxcat commented Oct 29, 2025 •

edited

Loading