Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[fix](analyze) correct duplicated counting of updated rows for mv in cloud mode #33136

Merged
merged 2 commits into from
Apr 2, 2024
Merged

[fix](analyze) correct duplicated counting of updated rows for mv in cloud mode #33136

merged 2 commits into from
Apr 2, 2024

Conversation

freemandealer
Copy link
Contributor

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 1, 2024

PR approved by anyone and no changes requested.

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 1, 2024

clang-tidy review says "All clean, LGTM! 👍"

dataroaring
dataroaring previously approved these changes Apr 1, 2024
View reviewed changes
Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dataroaring
Copy link
Contributor

run buildall

@freemandealer
Copy link
Contributor Author

run buildall

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 1, 2024

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 39272 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 78b0bc8674f115f185c6b6e22ec9a446483d73e0, data reload: false

------ Round 1 ----------------------------------
q1	18023	4280	4236	4236
q2	2555	197	186	186
q3	11008	1360	1413	1360
q4	10208	908	1020	908
q5	7546	2980	2931	2931
q6	216	132	131	131
q7	1121	645	611	611
q8	9409	2082	2061	2061
q9	6757	6216	6213	6213
q10	8430	3538	3523	3523
q11	411	234	237	234
q12	377	215	208	208
q13	17767	2894	2887	2887
q14	278	243	240	240
q15	534	502	488	488
q16	503	380	373	373
q17	973	937	927	927
q18	7295	6494	6481	6481
q19	1615	1536	1553	1536
q20	598	339	331	331
q21	3550	3145	3103	3103
q22	350	307	304	304
Total cold run time: 109524 ms
Total hot run time: 39272 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4099	4075	4075	4075
q2	335	217	223	217
q3	2981	2968	2958	2958
q4	1890	1849	1836	1836
q5	5265	5226	5250	5226
q6	207	124	124	124
q7	2261	1817	1802	1802
q8	3234	3300	3289	3289
q9	8490	8568	8530	8530
q10	3747	3869	3829	3829
q11	540	441	441	441
q12	699	521	550	521
q13	11025	2881	2882	2881
q14	296	273	259	259
q15	520	472	474	472
q16	452	402	401	401
q17	1727	1698	1680	1680
q18	7678	7221	7220	7220
q19	1641	1653	1658	1653
q20	1941	1727	1724	1724
q21	5053	4777	4761	4761
q22	469	441	417	417
Total cold run time: 64550 ms
Total hot run time: 54316 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 181856 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 78b0bc8674f115f185c6b6e22ec9a446483d73e0, data reload: false

query1	1222	1123	1127	1123
query2	6484	1863	1863	1863
query3	6662	207	215	207
query4	24850	21528	21410	21410
query5	4209	396	400	396
query6	266	191	200	191
query7	4608	314	313	313
query8	235	176	189	176
query9	8491	2316	2314	2314
query10	574	254	260	254
query11	15049	14565	14530	14530
query12	142	100	94	94
query13	1632	409	385	385
query14	8652	6780	6798	6780
query15	227	190	186	186
query16	7173	286	282	282
query17	981	625	578	578
query18	1925	293	283	283
query19	203	168	163	163
query20	99	96	96	96
query21	207	136	129	129
query22	5045	4790	4825	4790
query23	33621	32858	32865	32858
query24	12485	3202	3197	3197
query25	703	400	405	400
query26	1900	164	164	164
query27	3000	338	328	328
query28	6744	1898	1893	1893
query29	1417	596	603	596
query30	307	154	153	153
query31	1006	733	754	733
query32	101	66	65	65
query33	725	274	262	262
query34	1035	478	495	478
query35	845	707	691	691
query36	1000	872	865	865
query37	290	79	75	75
query38	3587	3403	3397	3397
query39	1596	1561	1546	1546
query40	304	139	137	137
query41	51	47	50	47
query42	119	116	104	104
query43	446	409	415	409
query44	1100	705	714	705
query45	265	263	260	260
query46	1062	799	770	770
query47	1882	1810	1800	1800
query48	385	313	317	313
query49	1169	379	370	370
query50	801	396	388	388
query51	6833	6783	6653	6653
query52	111	101	105	101
query53	363	297	292	292
query54	328	242	245	242
query55	90	84	77	77
query56	253	225	233	225
query57	1239	1091	1123	1091
query58	246	229	229	229
query59	2570	2545	2481	2481
query60	267	254	262	254
query61	115	110	108	108
query62	730	440	453	440
query63	319	282	285	282
query64	6480	3086	3220	3086
query65	3084	3035	3013	3013
query66	1434	326	319	319
query67	15657	15422	14707	14707
query68	8948	585	575	575
query69	550	341	360	341
query70	1335	1094	1105	1094
query71	484	277	267	267
query72	6417	2588	2398	2398
query73	1310	330	328	328
query74	6762	6436	6418	6418
query75	3555	2279	2296	2279
query76	5199	1081	1234	1081
query77	613	253	245	245
query78	10975	10159	10078	10078
query79	9794	548	536	536
query80	1593	431	427	427
query81	507	230	224	224
query82	378	104	101	101
query83	210	167	164	164
query84	270	93	95	93
query85	1039	291	286	286
query86	364	294	305	294
query87	3678	3567	3487	3487
query88	3909	2390	2389	2389
query89	570	378	377	377
query90	2001	183	181	181
query91	134	121	106	106
query92	61	54	52	52
query93	6788	545	545	545
query94	1352	197	197	197
query95	447	339	341	339
query96	611	281	278	278
query97	2649	2471	2498	2471
query98	240	220	210	210
query99	1175	851	848	848
Total cold run time: 300919 ms
Total hot run time: 181856 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.04 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 78b0bc8674f115f185c6b6e22ec9a446483d73e0, data reload: false

query1	0.04	0.03	0.04
query2	0.07	0.04	0.04
query3	0.23	0.05	0.05
query4	1.68	0.06	0.07
query5	0.48	0.48	0.49
query6	1.13	0.65	0.66
query7	0.02	0.01	0.01
query8	0.05	0.04	0.04
query9	0.57	0.50	0.52
query10	0.56	0.57	0.56
query11	0.15	0.11	0.11
query12	0.13	0.12	0.11
query13	0.61	0.59	0.59
query14	0.77	0.79	0.79
query15	0.86	0.83	0.84
query16	0.35	0.35	0.35
query17	0.97	0.95	1.01
query18	0.27	0.24	0.25
query19	1.88	1.78	1.75
query20	0.01	0.02	0.01
query21	15.70	0.76	0.72
query22	2.77	5.38	2.64
query23	17.76	1.32	1.14
query24	1.56	0.21	0.24
query25	0.13	0.10	0.08
query26	0.28	0.17	0.19
query27	0.09	0.09	0.09
query28	13.71	0.94	0.94
query29	12.54	3.44	3.34
query30	0.26	0.07	0.05
query31	2.86	0.38	0.38
query32	3.28	0.48	0.47
query33	2.87	2.87	2.89
query34	15.51	4.34	4.34
query35	4.37	4.32	4.38
query36	0.67	0.47	0.47
query37	0.19	0.18	0.17
query38	0.19	0.16	0.16
query39	0.05	0.05	0.04
query40	0.18	0.15	0.15
query41	0.10	0.05	0.05
query42	0.07	0.05	0.06
query43	0.04	0.05	0.04
Total cold run time: 106.01 s
Total hot run time: 31.04 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 78b0bc8674f115f185c6b6e22ec9a446483d73e0 with default session variables
Stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       15.3 seconds inserted 10000000 Rows, about 653K ops/s

@freemandealer
[fix](analyze) correct duplicated counting of updated rows for mv in …
369edab 
…cloud mode

Signed-off-by: freemandealer <freeman.zhang1992@gmail.com>
@freemandealer
Copy link
Contributor Author

run buildall

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 1, 2024

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 38562 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 369edabae1ca4bb91baa30b83cb27a9426613e19, data reload: false

------ Round 1 ----------------------------------
q1	17605	4065	4044	4044
q2	2016	195	181	181
q3	10478	1267	1393	1267
q4	10202	828	1041	828
q5	7458	2975	2896	2896
q6	219	131	131	131
q7	1076	610	622	610
q8	9427	2027	2045	2027
q9	6762	6219	6146	6146
q10	8458	3503	3498	3498
q11	433	242	243	242
q12	382	218	215	215
q13	17782	2900	2918	2900
q14	274	242	238	238
q15	530	496	479	479
q16	499	387	371	371
q17	954	882	883	882
q18	7169	6500	6401	6401
q19	1862	1508	1539	1508
q20	605	315	305	305
q21	3437	3131	3088	3088
q22	384	305	305	305
Total cold run time: 108012 ms
Total hot run time: 38562 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4043	4012	4036	4012
q2	327	215	218	215
q3	2970	2918	2936	2918
q4	1864	1838	1835	1835
q5	5219	5187	5206	5187
q6	206	123	126	123
q7	2215	1825	1810	1810
q8	3192	3270	3235	3235
q9	8429	8418	8429	8418
q10	3726	3884	3986	3884
q11	567	484	474	474
q12	735	578	632	578
q13	16892	3091	3087	3087
q14	311	271	277	271
q15	534	521	498	498
q16	512	476	465	465
q17	1757	1724	1713	1713
q18	8081	8024	7504	7504
q19	1680	1654	1673	1654
q20	2028	1825	1845	1825
q21	5031	4965	4904	4904
q22	482	441	442	441
Total cold run time: 70801 ms
Total hot run time: 55051 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 182598 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 369edabae1ca4bb91baa30b83cb27a9426613e19, data reload: false

query1	886	1130	360	360
query2	6321	1940	1841	1841
query3	6682	210	207	207
query4	24896	21403	21458	21403
query5	4177	405	413	405
query6	281	209	201	201
query7	4594	303	308	303
query8	226	187	179	179
query9	8446	2327	2330	2327
query10	451	254	270	254
query11	14899	14437	14390	14390
query12	141	96	98	96
query13	1644	400	393	393
query14	8386	7064	7022	7022
query15	205	180	178	178
query16	6825	274	276	274
query17	981	591	564	564
query18	1843	289	274	274
query19	202	156	159	156
query20	98	95	93	93
query21	204	130	130	130
query22	4964	4805	4832	4805
query23	33365	32673	32835	32673
query24	12505	3241	3148	3148
query25	700	405	399	399
query26	1818	180	166	166
query27	3208	379	385	379
query28	6923	1972	1914	1914
query29	1294	609	623	609
query30	302	159	160	159
query31	1036	767	762	762
query32	95	73	69	69
query33	712	252	248	248
query34	1098	510	520	510
query35	857	750	754	750
query36	1004	866	867	866
query37	181	86	83	83
query38	3761	3571	3571	3571
query39	1638	1607	1604	1604
query40	248	145	143	143
query41	50	48	50	48
query42	110	109	113	109
query43	464	410	445	410
query44	1159	739	750	739
query45	290	254	255	254
query46	1112	846	803	803
query47	2021	1873	1892	1873
query48	407	313	321	313
query49	952	374	385	374
query50	825	425	420	420
query51	7530	6884	6928	6884
query52	118	96	114	96
query53	378	304	301	301
query54	309	246	240	240
query55	93	80	80	80
query56	273	243	242	242
query57	1267	1170	1160	1160
query58	249	253	244	244
query59	2728	2646	2448	2448
query60	260	236	245	236
query61	107	107	107	107
query62	666	453	442	442
query63	313	282	287	282
query64	5811	2980	3043	2980
query65	3039	3024	3020	3020
query66	1309	318	311	311
query67	15799	14897	14897	14897
query68	9170	556	608	556
query69	571	330	338	330
query70	1312	1089	1116	1089
query71	496	266	261	261
query72	6263	2567	2434	2434
query73	1438	328	326	326
query74	6621	6364	6341	6341
query75	3442	2319	2307	2307
query76	5084	1093	1211	1093
query77	554	248	249	248
query78	10842	10156	10140	10140
query79	10679	526	541	526
query80	1637	421	423	421
query81	506	228	221	221
query82	202	101	103	101
query83	216	160	166	160
query84	263	91	90	90
query85	965	294	282	282
query86	369	298	302	298
query87	3755	3475	3443	3443
query88	4327	2369	2379	2369
query89	527	372	377	372
query90	1928	180	175	175
query91	130	106	104	104
query92	66	50	50	50
query93	6827	551	540	540
query94	1211	198	196	196
query95	1090	1100	1090	1090
query96	620	277	270	270
query97	2666	2533	2500	2500
query98	229	217	213	213
query99	1219	831	839	831
Total cold run time: 300961 ms
Total hot run time: 182598 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.38 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 369edabae1ca4bb91baa30b83cb27a9426613e19, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.04	0.03
query3	0.23	0.05	0.05
query4	1.68	0.07	0.06
query5	0.48	0.48	0.49
query6	1.12	0.66	0.65
query7	0.02	0.01	0.01
query8	0.05	0.05	0.04
query9	0.57	0.51	0.52
query10	0.57	0.58	0.57
query11	0.15	0.12	0.12
query12	0.14	0.12	0.12
query13	0.61	0.60	0.59
query14	0.78	0.79	0.78
query15	0.86	0.84	0.84
query16	0.35	0.36	0.36
query17	0.98	0.98	0.98
query18	0.24	0.25	0.25
query19	1.80	1.72	1.73
query20	0.01	0.01	0.01
query21	15.83	0.76	0.66
query22	3.05	5.60	1.94
query23	17.43	1.21	1.16
query24	1.52	0.21	0.27
query25	0.12	0.09	0.09
query26	0.29	0.17	0.19
query27	0.08	0.09	0.09
query28	13.65	0.94	0.95
query29	12.57	3.29	3.30
query30	0.26	0.06	0.06
query31	2.86	0.39	0.40
query32	3.26	0.47	0.47
query33	2.85	2.87	2.89
query34	15.49	4.37	4.35
query35	4.36	4.38	4.39
query36	0.67	0.47	0.48
query37	0.20	0.16	0.18
query38	0.18	0.16	0.16
query39	0.04	0.04	0.04
query40	0.18	0.15	0.16
query41	0.10	0.05	0.04
query42	0.05	0.06	0.05
query43	0.05	0.04	0.04
Total cold run time: 105.84 s
Total hot run time: 30.38 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 369edabae1ca4bb91baa30b83cb27a9426613e19 with default session variables
Stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       15.6 seconds inserted 10000000 Rows, about 641K ops/s

@freemandealer
Copy link
Contributor Author

run feut

1 similar comment
@freemandealer
Copy link
Contributor Author

run feut

@freemandealer
Copy link
Contributor Author

run buildall

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 2, 2024

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 39457 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b8fc47ecf771a22361a8b5bfd1e69890f6afe559, data reload: false

------ Round 1 ----------------------------------
q1	17631	4084	4073	4073
q2	2199	188	197	188
q3	10463	1193	1367	1193
q4	10216	895	1044	895
q5	7489	2929	2929	2929
q6	219	133	134	133
q7	1100	647	620	620
q8	9853	2121	2028	2028
q9	6821	6207	6201	6201
q10	8474	3545	3529	3529
q11	414	248	239	239
q12	383	218	218	218
q13	17790	2919	2928	2919
q14	271	247	245	245
q15	549	499	493	493
q16	532	381	386	381
q17	966	921	905	905
q18	9192	6902	6904	6902
q19	2104	1568	1566	1566
q20	625	344	320	320
q21	3554	3174	3161	3161
q22	392	319	338	319
Total cold run time: 111237 ms
Total hot run time: 39457 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4289	4239	4181	4181
q2	336	230	229	229
q3	2982	2959	2960	2959
q4	1882	1816	1842	1816
q5	5242	5214	5211	5211
q6	207	125	125	125
q7	2277	1798	1824	1798
q8	3199	3258	3279	3258
q9	8483	8503	8520	8503
q10	3956	4002	4019	4002
q11	548	525	506	506
q12	765	581	585	581
q13	16917	3177	3131	3131
q14	310	282	280	280
q15	526	481	485	481
q16	519	442	438	438
q17	1772	1742	1730	1730
q18	8117	7745	7761	7745
q19	1831	1703	1656	1656
q20	1986	1789	1840	1789
q21	5188	4971	5012	4971
q22	509	434	435	434
Total cold run time: 71841 ms
Total hot run time: 55824 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 182520 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b8fc47ecf771a22361a8b5bfd1e69890f6afe559, data reload: false

query1	1237	1110	1111	1110
query2	6234	1985	1984	1984
query3	6672	214	212	212
query4	24832	21425	21487	21425
query5	4177	408	418	408
query6	278	189	202	189
query7	4602	298	309	298
query8	237	186	191	186
query9	8467	2325	2328	2325
query10	445	262	257	257
query11	14934	14654	14476	14476
query12	146	96	94	94
query13	1632	374	377	374
query14	8488	6961	7002	6961
query15	215	180	177	177
query16	6727	287	283	283
query17	964	605	586	586
query18	1846	288	287	287
query19	210	168	182	168
query20	106	97	97	97
query21	199	139	136	136
query22	4941	4755	4799	4755
query23	33812	32593	32596	32593
query24	12837	3228	3264	3228
query25	721	427	430	427
query26	1869	182	172	172
query27	3203	377	417	377
query28	7067	1966	1930	1930
query29	1265	641	622	622
query30	320	160	156	156
query31	1019	752	793	752
query32	109	69	75	69
query33	710	253	254	253
query34	1202	526	534	526
query35	869	746	758	746
query36	1019	875	870	870
query37	184	83	87	83
query38	3815	3594	3613	3594
query39	1142	1043	1090	1043
query40	237	152	147	147
query41	48	51	47	47
query42	116	108	114	108
query43	470	428	424	424
query44	1138	748	739	739
query45	301	280	283	280
query46	1141	842	811	811
query47	1947	1911	1896	1896
query48	399	314	320	314
query49	955	377	382	377
query50	821	439	420	420
query51	7215	6958	6891	6891
query52	119	108	110	108
query53	373	306	321	306
query54	314	252	251	251
query55	88	82	78	78
query56	263	242	257	242
query57	1283	1180	1192	1180
query58	247	232	229	229
query59	2720	2540	2295	2295
query60	259	238	250	238
query61	91	87	89	87
query62	685	472	436	436
query63	310	289	287	287
query64	5866	3386	3280	3280
query65	3028	3056	3045	3045
query66	1324	318	314	314
query67	15741	14861	14935	14861
query68	9104	599	617	599
query69	541	333	333	333
query70	1262	1113	1127	1113
query71	493	278	301	278
query72	6258	2583	2419	2419
query73	1143	328	329	328
query74	6716	6305	6355	6305
query75	3380	2290	2298	2290
query76	4991	1159	1204	1159
query77	557	247	250	247
query78	10988	10126	10101	10101
query79	10774	534	515	515
query80	2021	418	409	409
query81	519	219	223	219
query82	716	103	100	100
query83	208	159	156	156
query84	258	87	90	87
query85	1333	309	279	279
query86	431	291	275	275
query87	3734	3485	3475	3475
query88	3961	2364	2399	2364
query89	555	376	365	365
query90	1881	177	178	177
query91	131	103	103	103
query92	68	55	51	51
query93	7002	530	527	527
query94	1040	193	200	193
query95	434	332	346	332
query96	635	275	276	275
query97	2692	2508	2483	2483
query98	236	215	214	214
query99	1319	833	829	829
Total cold run time: 301632 ms
Total hot run time: 182520 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.54 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b8fc47ecf771a22361a8b5bfd1e69890f6afe559, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.04	0.04
query3	0.23	0.04	0.04
query4	1.68	0.06	0.06
query5	0.48	0.48	0.48
query6	1.12	0.65	0.66
query7	0.02	0.01	0.02
query8	0.05	0.05	0.04
query9	0.56	0.50	0.51
query10	0.56	0.57	0.57
query11	0.15	0.12	0.11
query12	0.14	0.13	0.11
query13	0.62	0.60	0.59
query14	0.77	0.79	0.78
query15	0.85	0.84	0.83
query16	0.35	0.35	0.35
query17	1.01	1.01	1.00
query18	0.24	0.24	0.26
query19	1.86	1.69	1.72
query20	0.01	0.01	0.00
query21	15.40	0.76	0.67
query22	2.86	5.15	3.24
query23	17.75	1.32	1.14
query24	1.44	0.35	0.22
query25	0.14	0.08	0.08
query26	0.29	0.18	0.19
query27	0.08	0.09	0.07
query28	13.56	0.97	0.93
query29	12.56	3.48	3.35
query30	0.26	0.06	0.05
query31	2.86	0.38	0.40
query32	3.28	0.48	0.47
query33	2.89	2.85	2.90
query34	15.51	4.33	4.32
query35	4.38	4.37	4.36
query36	0.67	0.47	0.47
query37	0.20	0.16	0.18
query38	0.16	0.16	0.16
query39	0.04	0.04	0.04
query40	0.18	0.15	0.14
query41	0.10	0.05	0.06
query42	0.06	0.06	0.05
query43	0.04	0.05	0.04
Total cold run time: 105.52 s
Total hot run time: 31.54 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit b8fc47ecf771a22361a8b5bfd1e69890f6afe559 with default session variables
Stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       15.5 seconds inserted 10000000 Rows, about 645K ops/s

@freemandealer
Copy link
Contributor Author

run feut

dataroaring
dataroaring approved these changes Apr 2, 2024
View reviewed changes
Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dataroaring dataroaring merged commit 1f3524b into apache:master Apr 2, 2024
27 of 28 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@gavinchou gavinchou gavinchou approved these changes

@dataroaring dataroaring dataroaring approved these changes

Assignees
No one assigned
Labels
meta-change reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@freemandealer @doris-robot @dataroaring @gavinchou