Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[opt](coordinator) support nereids coordinator for cloud mode #46879

Merged
merged 21 commits into from
Jan 23, 2025
Merged

[opt](coordinator) support nereids coordinator for cloud mode #46879

merged 21 commits into from
Jan 23, 2025

Conversation

924060929
Copy link
Contributor

@924060929 924060929 commented Jan 13, 2025 •
edited
Loading

What problem does this PR solve?

support nereids coordinator for cloud mode

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@924060929
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32641 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6efb080f866579c82cd28e759139f44f11307965, data reload: false

------ Round 1 ----------------------------------
q1	17592	6146	6055	6055
q2	2040	296	174	174
q3	10418	1247	724	724
q4	10217	853	428	428
q5	7536	2169	1992	1992
q6	205	180	148	148
q7	875	747	614	614
q8	9247	1386	1121	1121
q9	5248	4944	4895	4895
q10	6751	2288	1834	1834
q11	473	282	268	268
q12	345	360	220	220
q13	17752	3611	3128	3128
q14	246	232	213	213
q15	570	511	514	511
q16	640	614	590	590
q17	572	846	342	342
q18	7015	6522	6367	6367
q19	1219	985	536	536
q20	315	327	193	193
q21	2890	2160	1978	1978
q22	354	330	310	310
Total cold run time: 102520 ms
Total hot run time: 32641 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6457	6227	6223	6223
q2	239	338	261	261
q3	2302	2640	2348	2348
q4	1389	1787	1353	1353
q5	4378	4738	4754	4738
q6	188	179	139	139
q7	2084	1975	1820	1820
q8	2635	2829	2696	2696
q9	7206	7196	7212	7196
q10	3046	3305	2812	2812
q11	605	514	490	490
q12	672	753	623	623
q13	3387	3868	3271	3271
q14	271	309	274	274
q15	555	515	516	515
q16	676	697	646	646
q17	1219	1748	1250	1250
q18	7691	7629	6941	6941
q19	778	1106	1056	1056
q20	1945	2016	1903	1903
q21	5499	5001	5000	5000
q22	594	592	540	540
Total cold run time: 53816 ms
Total hot run time: 52095 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 188916 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6efb080f866579c82cd28e759139f44f11307965, data reload: false

query1	965	372	381	372
query2	6530	2292	2289	2289
query3	6701	218	214	214
query4	34121	23715	23276	23276
query5	4440	628	446	446
query6	302	197	188	188
query7	4630	496	308	308
query8	298	241	232	232
query9	9632	2700	2684	2684
query10	476	315	253	253
query11	17926	15207	15240	15207
query12	158	101	101	101
query13	1655	501	384	384
query14	10147	7470	6428	6428
query15	242	195	197	195
query16	8076	636	462	462
query17	1558	734	544	544
query18	2113	409	306	306
query19	212	179	164	164
query20	118	109	119	109
query21	207	120	102	102
query22	4575	4667	4454	4454
query23	34009	33047	33351	33047
query24	6413	2262	2260	2260
query25	492	439	374	374
query26	817	268	157	157
query27	1989	467	353	353
query28	5075	2427	2388	2388
query29	636	549	425	425
query30	233	182	155	155
query31	930	853	774	774
query32	85	59	86	59
query33	509	360	305	305
query34	742	836	487	487
query35	788	801	723	723
query36	999	1027	955	955
query37	127	101	81	81
query38	4024	4115	3976	3976
query39	1487	1437	1401	1401
query40	206	118	104	104
query41	55	53	53	53
query42	133	105	105	105
query43	528	507	478	478
query44	1300	814	804	804
query45	173	171	165	165
query46	838	1027	637	637
query47	1851	1855	1786	1786
query48	388	395	317	317
query49	747	468	405	405
query50	644	662	394	394
query51	6979	6891	6877	6877
query52	106	99	91	91
query53	223	251	182	182
query54	476	503	425	425
query55	90	79	83	79
query56	300	260	253	253
query57	1192	1187	1093	1093
query58	264	240	250	240
query59	3101	3029	3044	3029
query60	272	281	255	255
query61	121	114	114	114
query62	871	771	691	691
query63	223	190	195	190
query64	3605	996	656	656
query65	3249	3162	3190	3162
query66	858	442	379	379
query67	15911	15802	15495	15495
query68	7069	702	520	520
query69	478	285	255	255
query70	1206	1185	1061	1061
query71	408	287	267	267
query72	6361	3830	3892	3830
query73	643	748	352	352
query74	10208	8892	8888	8888
query75	3621	3110	2629	2629
query76	3188	1182	757	757
query77	586	365	273	273
query78	9926	10005	10627	10005
query79	3088	719	582	582
query80	637	555	459	459
query81	502	287	244	244
query82	352	155	121	121
query83	185	173	151	151
query84	231	97	81	81
query85	861	413	366	366
query86	402	304	302	302
query87	4562	4414	4191	4191
query88	4318	2149	2095	2095
query89	394	332	299	299
query90	1854	186	186	186
query91	133	136	116	116
query92	70	59	52	52
query93	944	816	536	536
query94	706	380	293	293
query95	398	263	257	257
query96	477	599	280	280
query97	2869	2928	2799	2799
query98	224	198	200	198
query99	1434	1505	1374	1374
Total cold run time: 287476 ms
Total hot run time: 188916 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.1 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6efb080f866579c82cd28e759139f44f11307965, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.04	0.04
query3	0.23	0.07	0.07
query4	1.62	0.10	0.10
query5	0.42	0.42	0.43
query6	1.14	0.66	0.64
query7	0.02	0.02	0.02
query8	0.04	0.03	0.04
query9	0.58	0.50	0.50
query10	0.56	0.57	0.56
query11	0.14	0.10	0.10
query12	0.14	0.11	0.11
query13	0.62	0.60	0.59
query14	2.73	2.83	2.82
query15	0.90	0.82	0.82
query16	0.40	0.37	0.39
query17	1.08	1.05	1.09
query18	0.24	0.20	0.21
query19	1.90	1.82	2.06
query20	0.02	0.01	0.01
query21	15.36	0.98	0.58
query22	0.75	0.82	0.57
query23	15.33	1.43	0.64
query24	2.60	0.64	1.86
query25	0.24	0.13	0.14
query26	0.27	0.15	0.14
query27	0.07	0.05	0.06
query28	13.66	1.52	1.04
query29	12.55	4.00	3.28
query30	0.25	0.09	0.06
query31	2.84	0.59	0.39
query32	3.22	0.55	0.45
query33	3.08	3.03	3.15
query34	16.66	5.20	4.51
query35	4.51	4.52	4.51
query36	0.64	0.48	0.47
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.17	0.14	0.12
query41	0.08	0.02	0.02
query42	0.04	0.02	0.02
query43	0.03	0.04	0.03
Total cold run time: 105.41 s
Total hot run time: 31.1 s

@924060929 924060929 force-pushed the distribute_planner_for_cloud_mode branch from 6efb080 to 4057605 Compare January 13, 2025 07:09
@924060929
Copy link
Contributor Author

run buildall

1 similar comment
@924060929
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32669 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1b51e459bcf17998896ee23613e614b8bb04e16f, data reload: false

------ Round 1 ----------------------------------
q1	17604	6161	6219	6161
q2	2046	316	175	175
q3	10410	1226	733	733
q4	10241	860	438	438
q5	8222	2210	1954	1954
q6	210	177	147	147
q7	908	777	613	613
q8	9258	1378	1135	1135
q9	5168	4921	4862	4862
q10	6762	2286	1824	1824
q11	492	292	246	246
q12	345	366	226	226
q13	17748	3703	3079	3079
q14	242	231	216	216
q15	561	505	509	505
q16	615	630	603	603
q17	584	843	342	342
q18	6840	6455	6386	6386
q19	1960	956	539	539
q20	322	313	183	183
q21	2839	2274	1990	1990
q22	362	334	312	312
Total cold run time: 103739 ms
Total hot run time: 32669 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6327	6264	6226	6226
q2	246	335	237	237
q3	2274	2673	2318	2318
q4	1427	1788	1364	1364
q5	4293	4756	4810	4756
q6	190	180	144	144
q7	2059	1987	1814	1814
q8	2646	2844	2668	2668
q9	7234	7299	7271	7271
q10	3089	3301	2776	2776
q11	586	531	500	500
q12	708	792	628	628
q13	3459	3867	3237	3237
q14	303	303	273	273
q15	576	512	492	492
q16	660	679	656	656
q17	1239	1701	1273	1273
q18	7826	7411	7418	7411
q19	867	1149	1089	1089
q20	1982	2023	2012	2012
q21	5720	5172	5006	5006
q22	612	632	559	559
Total cold run time: 54323 ms
Total hot run time: 52710 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 195871 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 1b51e459bcf17998896ee23613e614b8bb04e16f, data reload: false

query1	1328	982	944	944
query2	6423	2484	2364	2364
query3	11158	4780	5010	4780
query4	32804	23480	23525	23480
query5	5065	608	456	456
query6	304	201	195	195
query7	3984	494	300	300
query8	287	243	214	214
query9	9292	2669	2635	2635
query10	498	305	248	248
query11	17935	15703	15186	15186
query12	156	107	104	104
query13	1569	515	397	397
query14	10364	7099	7894	7099
query15	243	216	206	206
query16	7984	676	531	531
query17	1554	773	595	595
query18	2113	427	332	332
query19	231	210	192	192
query20	121	121	115	115
query21	207	133	116	116
query22	4594	4576	4566	4566
query23	33871	33281	33973	33281
query24	6431	2344	2331	2331
query25	482	465	394	394
query26	876	281	160	160
query27	2189	470	341	341
query28	5499	2480	2461	2461
query29	643	556	422	422
query30	222	194	156	156
query31	972	912	803	803
query32	86	58	55	55
query33	489	382	329	329
query34	765	861	508	508
query35	836	830	747	747
query36	1000	1021	966	966
query37	129	106	73	73
query38	4238	4163	4020	4020
query39	1537	1447	1433	1433
query40	212	115	101	101
query41	50	53	53	53
query42	126	108	107	107
query43	547	545	494	494
query44	1408	818	824	818
query45	191	178	165	165
query46	912	1061	666	666
query47	1866	1906	1855	1855
query48	386	405	322	322
query49	723	509	414	414
query50	661	667	404	404
query51	7166	7117	6830	6830
query52	104	99	93	93
query53	231	269	190	190
query54	495	518	417	417
query55	88	80	83	80
query56	269	274	251	251
query57	1228	1196	1123	1123
query58	250	234	224	224
query59	3175	3210	3186	3186
query60	294	281	283	281
query61	142	120	119	119
query62	855	805	752	752
query63	231	199	190	190
query64	3453	1024	664	664
query65	3347	3215	3262	3215
query66	955	412	335	335
query67	16289	15780	15514	15514
query68	8488	713	516	516
query69	508	319	269	269
query70	1218	1108	1123	1108
query71	450	289	258	258
query72	6464	3866	3903	3866
query73	658	773	364	364
query74	10155	8774	8781	8774
query75	4182	3142	2645	2645
query76	3681	1172	769	769
query77	786	381	269	269
query78	9927	9950	9370	9370
query79	3386	817	580	580
query80	718	598	509	509
query81	482	281	243	243
query82	609	157	124	124
query83	191	171	149	149
query84	288	94	79	79
query85	763	362	298	298
query86	340	330	300	300
query87	4568	4422	4425	4422
query88	4278	2170	2142	2142
query89	404	324	291	291
query90	1850	197	199	197
query91	131	141	105	105
query92	76	59	55	55
query93	1383	884	533	533
query94	645	387	289	289
query95	331	270	261	261
query96	486	615	275	275
query97	2908	2964	2813	2813
query98	219	201	190	190
query99	1674	1514	1410	1410
Total cold run time: 296380 ms
Total hot run time: 195871 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.38 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 1b51e459bcf17998896ee23613e614b8bb04e16f, data reload: false

query1	0.03	0.03	0.06
query2	0.08	0.03	0.03
query3	0.24	0.07	0.07
query4	1.60	0.11	0.11
query5	0.41	0.42	0.40
query6	1.14	0.65	0.66
query7	0.03	0.02	0.02
query8	0.03	0.03	0.03
query9	0.59	0.50	0.51
query10	0.56	0.57	0.55
query11	0.16	0.10	0.11
query12	0.15	0.11	0.12
query13	0.60	0.61	0.60
query14	2.69	2.79	2.73
query15	0.90	0.83	0.81
query16	0.38	0.38	0.41
query17	1.07	0.97	1.06
query18	0.23	0.21	0.21
query19	1.94	1.81	2.00
query20	0.02	0.02	0.01
query21	15.37	0.92	0.59
query22	0.76	0.81	0.71
query23	15.25	1.40	0.53
query24	3.47	1.59	1.01
query25	0.17	0.14	0.15
query26	0.26	0.14	0.14
query27	0.06	0.05	0.05
query28	13.92	1.49	1.04
query29	12.63	3.91	3.23
query30	0.25	0.08	0.06
query31	2.82	0.60	0.38
query32	3.24	0.56	0.46
query33	3.13	3.07	3.25
query34	16.92	5.09	4.55
query35	4.48	4.52	4.52
query36	0.64	0.50	0.48
query37	0.09	0.06	0.05
query38	0.04	0.04	0.03
query39	0.04	0.03	0.02
query40	0.17	0.14	0.12
query41	0.08	0.03	0.03
query42	0.03	0.02	0.03
query43	0.03	0.03	0.03
Total cold run time: 106.7 s
Total hot run time: 31.38 s

@924060929
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32391 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ce36ca595f3029ede73ddeb34268d3b08561898a, data reload: false

------ Round 1 ----------------------------------
q1	17590	6119	5996	5996
q2	2052	297	174	174
q3	10414	1210	701	701
q4	10213	866	433	433
q5	7514	2146	1907	1907
q6	201	184	149	149
q7	903	731	626	626
q8	9243	1339	1148	1148
q9	5068	4942	4895	4895
q10	6733	2295	1830	1830
q11	490	272	253	253
q12	338	352	217	217
q13	17761	3655	3046	3046
q14	234	228	207	207
q15	555	505	508	505
q16	621	604	584	584
q17	541	847	324	324
q18	6984	6552	6445	6445
q19	1206	951	540	540
q20	315	325	186	186
q21	2721	2131	1916	1916
q22	363	332	309	309
Total cold run time: 102060 ms
Total hot run time: 32391 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6254	6184	6190	6184
q2	241	331	236	236
q3	2183	2577	2269	2269
q4	1389	1783	1345	1345
q5	4293	4715	4593	4593
q6	179	171	137	137
q7	2083	1965	1813	1813
q8	2578	2765	2637	2637
q9	7280	7189	7272	7189
q10	2983	3293	2821	2821
q11	601	523	507	507
q12	678	734	590	590
q13	3447	3898	3218	3218
q14	299	319	277	277
q15	583	514	487	487
q16	654	670	644	644
q17	1229	1708	1260	1260
q18	7708	7212	6989	6989
q19	718	1059	1060	1059
q20	1860	1971	1877	1877
q21	5352	5055	4605	4605
q22	613	604	559	559
Total cold run time: 53205 ms
Total hot run time: 51296 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 187678 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ce36ca595f3029ede73ddeb34268d3b08561898a, data reload: false

query1	967	397	372	372
query2	6517	2318	2220	2220
query3	6712	216	222	216
query4	33552	23451	23160	23160
query5	4384	633	477	477
query6	295	201	190	190
query7	4618	513	305	305
query8	305	243	233	233
query9	9260	2702	2671	2671
query10	508	306	247	247
query11	17846	15724	14957	14957
query12	153	107	109	107
query13	1644	499	385	385
query14	10258	7265	6542	6542
query15	259	204	180	180
query16	8048	588	433	433
query17	1569	708	550	550
query18	2113	385	289	289
query19	218	183	150	150
query20	116	107	112	107
query21	211	124	114	114
query22	4371	4278	4248	4248
query23	33711	32950	33275	32950
query24	6493	2374	2256	2256
query25	542	466	411	411
query26	1215	273	161	161
query27	2027	471	336	336
query28	5041	2468	2415	2415
query29	714	553	419	419
query30	233	184	156	156
query31	954	856	799	799
query32	93	63	60	60
query33	515	364	357	357
query34	750	836	483	483
query35	807	807	743	743
query36	992	1017	953	953
query37	124	111	83	83
query38	4109	3983	4021	3983
query39	1466	1438	1394	1394
query40	207	115	102	102
query41	51	50	56	50
query42	130	107	105	105
query43	524	523	471	471
query44	1354	799	797	797
query45	179	170	162	162
query46	855	1026	638	638
query47	1812	1783	1752	1752
query48	367	400	314	314
query49	786	486	417	417
query50	625	656	385	385
query51	6890	6972	6949	6949
query52	100	106	90	90
query53	225	257	183	183
query54	484	510	401	401
query55	81	82	80	80
query56	274	266	249	249
query57	1154	1154	1076	1076
query58	256	243	235	235
query59	2968	3240	3088	3088
query60	282	279	263	263
query61	120	118	115	115
query62	869	803	727	727
query63	237	201	197	197
query64	4582	1010	733	733
query65	3227	3167	3202	3167
query66	1100	431	332	332
query67	15914	15709	15298	15298
query68	9400	712	535	535
query69	462	293	261	261
query70	1234	1133	1139	1133
query71	443	296	256	256
query72	6260	3775	3803	3775
query73	662	763	361	361
query74	10083	8746	8700	8700
query75	4624	3136	2654	2654
query76	5289	1166	816	816
query77	988	363	295	295
query78	9966	9970	9354	9354
query79	3105	814	606	606
query80	750	547	444	444
query81	464	285	242	242
query82	584	153	135	135
query83	203	181	154	154
query84	288	97	80	80
query85	789	431	355	355
query86	358	312	267	267
query87	4368	4317	4258	4258
query88	3386	2182	2144	2144
query89	414	332	299	299
query90	1943	193	196	193
query91	134	141	108	108
query92	68	62	58	58
query93	1671	872	533	533
query94	672	383	291	291
query95	336	272	254	254
query96	483	612	276	276
query97	2797	2954	2804	2804
query98	229	200	199	199
query99	1618	1510	1350	1350
Total cold run time: 293434 ms
Total hot run time: 187678 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.77 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ce36ca595f3029ede73ddeb34268d3b08561898a, data reload: false

query1	0.03	0.04	0.03
query2	0.07	0.03	0.03
query3	0.23	0.07	0.07
query4	1.62	0.10	0.10
query5	0.44	0.41	0.42
query6	1.14	0.65	0.65
query7	0.02	0.02	0.01
query8	0.04	0.03	0.03
query9	0.60	0.48	0.50
query10	0.55	0.56	0.55
query11	0.15	0.10	0.10
query12	0.13	0.12	0.11
query13	0.60	0.60	0.59
query14	2.73	2.78	2.84
query15	0.89	0.83	0.82
query16	0.39	0.39	0.40
query17	1.06	1.00	1.05
query18	0.23	0.21	0.21
query19	1.83	1.78	1.97
query20	0.02	0.02	0.01
query21	15.36	0.90	0.61
query22	0.75	0.75	0.58
query23	15.38	1.40	0.61
query24	3.02	2.23	1.38
query25	0.16	0.26	0.08
query26	0.17	0.17	0.13
query27	0.09	0.07	0.06
query28	14.43	1.47	1.04
query29	12.62	4.08	3.38
query30	0.25	0.09	0.07
query31	2.82	0.60	0.38
query32	3.23	0.53	0.45
query33	3.04	3.14	3.16
query34	16.80	5.08	4.48
query35	4.45	4.48	4.45
query36	0.67	0.49	0.47
query37	0.10	0.07	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.18	0.14	0.12
query41	0.09	0.03	0.02
query42	0.04	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.54 s
Total hot run time: 31.77 s

@924060929
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32531 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 034aab910ceb04b8214bbb006b023ca89aafffdd, data reload: false

------ Round 1 ----------------------------------
q1	17574	6123	6607	6123
q2	2047	311	182	182
q3	10394	1244	706	706
q4	10222	866	450	450
q5	7528	2161	1965	1965
q6	202	181	151	151
q7	899	740	596	596
q8	9235	1329	1163	1163
q9	5250	4864	4807	4807
q10	6751	2296	1836	1836
q11	488	284	263	263
q12	335	360	218	218
q13	17788	3700	3083	3083
q14	234	232	219	219
q15	569	513	500	500
q16	626	614	581	581
q17	560	840	325	325
q18	7107	6391	6305	6305
q19	1578	946	558	558
q20	320	315	204	204
q21	2833	2181	1984	1984
q22	361	327	312	312
Total cold run time: 102901 ms
Total hot run time: 32531 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6221	6191	6166	6166
q2	247	337	258	258
q3	2217	2662	2320	2320
q4	1411	1774	1377	1377
q5	4320	4730	4746	4730
q6	181	176	141	141
q7	2083	2018	1791	1791
q8	2618	2757	2677	2677
q9	7165	7188	7109	7109
q10	3063	3384	2873	2873
q11	608	544	498	498
q12	685	788	633	633
q13	3474	3834	3199	3199
q14	289	299	296	296
q15	556	503	505	503
q16	674	685	649	649
q17	1218	1712	1276	1276
q18	7761	7482	7220	7220
q19	761	1080	1047	1047
q20	1934	1959	1776	1776
q21	5542	5096	4815	4815
q22	586	615	570	570
Total cold run time: 53614 ms
Total hot run time: 51924 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 187322 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 034aab910ceb04b8214bbb006b023ca89aafffdd, data reload: false

query1	976	384	357	357
query2	6526	2362	2316	2316
query3	6704	210	213	210
query4	33630	23189	23734	23189
query5	4402	627	491	491
query6	299	206	190	190
query7	4634	482	305	305
query8	307	253	229	229
query9	9395	2690	2643	2643
query10	467	301	250	250
query11	18319	15015	15136	15015
query12	166	110	102	102
query13	1666	499	378	378
query14	11195	7103	7024	7024
query15	255	188	187	187
query16	7851	579	445	445
query17	1531	727	548	548
query18	2015	393	296	296
query19	214	181	150	150
query20	119	112	108	108
query21	210	125	100	100
query22	4203	4234	4245	4234
query23	33932	32663	33332	32663
query24	6433	2275	2284	2275
query25	505	478	401	401
query26	1208	280	162	162
query27	1981	459	328	328
query28	5271	2413	2464	2413
query29	649	531	413	413
query30	229	180	155	155
query31	946	851	782	782
query32	73	64	59	59
query33	586	349	299	299
query34	737	858	509	509
query35	771	827	739	739
query36	988	1032	958	958
query37	126	96	83	83
query38	4094	4013	4054	4013
query39	1490	1400	1410	1400
query40	210	118	100	100
query41	52	50	49	49
query42	120	99	101	99
query43	520	545	503	503
query44	1325	794	803	794
query45	184	174	163	163
query46	842	1035	642	642
query47	1823	1832	1817	1817
query48	382	394	317	317
query49	779	507	433	433
query50	612	640	373	373
query51	7016	6957	6705	6705
query52	101	100	98	98
query53	228	251	192	192
query54	471	484	419	419
query55	83	81	83	81
query56	279	262	246	246
query57	1167	1150	1051	1051
query58	238	234	241	234
query59	2969	3138	2799	2799
query60	275	270	248	248
query61	120	115	115	115
query62	873	759	721	721
query63	229	194	191	191
query64	4236	1012	684	684
query65	3242	3173	3181	3173
query66	1068	414	313	313
query67	15566	15482	15316	15316
query68	7337	765	513	513
query69	464	291	273	273
query70	1131	1154	1125	1125
query71	427	283	258	258
query72	5999	3815	3838	3815
query73	637	748	355	355
query74	10024	8851	8725	8725
query75	3810	3188	2638	2638
query76	3507	1176	759	759
query77	772	353	282	282
query78	9854	10076	9356	9356
query79	3651	768	640	640
query80	676	535	437	437
query81	494	268	246	246
query82	604	153	122	122
query83	180	178	149	149
query84	236	99	75	75
query85	724	347	288	288
query86	402	317	355	317
query87	4280	4239	4207	4207
query88	4654	2179	2137	2137
query89	414	323	288	288
query90	1840	199	194	194
query91	133	137	108	108
query92	71	57	51	51
query93	1769	868	535	535
query94	653	394	292	292
query95	337	272	263	263
query96	489	612	282	282
query97	2854	2951	2727	2727
query98	231	206	194	194
query99	1502	1509	1376	1376
Total cold run time: 290269 ms
Total hot run time: 187322 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.08 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 034aab910ceb04b8214bbb006b023ca89aafffdd, data reload: false

query1	0.03	0.04	0.02
query2	0.10	0.03	0.04
query3	0.24	0.07	0.07
query4	1.62	0.11	0.10
query5	0.39	0.42	0.42
query6	1.13	0.65	0.66
query7	0.03	0.02	0.02
query8	0.04	0.03	0.03
query9	0.59	0.51	0.51
query10	0.55	0.56	0.55
query11	0.14	0.10	0.10
query12	0.14	0.10	0.11
query13	0.61	0.60	0.60
query14	2.77	2.88	2.83
query15	0.88	0.83	0.82
query16	0.37	0.39	0.38
query17	1.05	1.06	1.01
query18	0.24	0.21	0.20
query19	1.80	1.75	2.02
query20	0.01	0.01	0.02
query21	15.36	0.89	0.59
query22	0.76	0.73	0.75
query23	15.24	1.47	0.53
query24	3.42	0.64	1.39
query25	0.28	0.13	0.09
query26	0.27	0.14	0.14
query27	0.05	0.07	0.05
query28	13.21	1.52	1.05
query29	12.59	4.08	3.42
query30	0.26	0.09	0.06
query31	2.81	0.62	0.38
query32	3.22	0.55	0.46
query33	3.08	3.08	3.21
query34	16.58	5.04	4.46
query35	4.45	4.44	4.41
query36	0.63	0.48	0.48
query37	0.10	0.07	0.05
query38	0.04	0.04	0.04
query39	0.04	0.02	0.02
query40	0.17	0.13	0.13
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 105.44 s
Total hot run time: 31.08 s

morrySnow
morrySnow previously approved these changes Jan 13, 2025
View reviewed changes
@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jan 13, 2025
@github-actions GitHub Actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions GitHub Actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@github-actions github-actions bot removed the approved Indicates a PR has been approved by one committer. label Jan 14, 2025
@924060929
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32782 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 09cc6a85642d22656dfa78691896a80d511d6c17, data reload: false

------ Round 1 ----------------------------------
q1	17567	6132	6038	6038
q2	2070	327	179	179
q3	10422	1279	766	766
q4	10195	881	445	445
q5	7539	2225	2014	2014
q6	208	183	149	149
q7	901	754	615	615
q8	9261	1366	1146	1146
q9	5280	4885	4892	4885
q10	6756	2308	1868	1868
q11	478	288	268	268
q12	329	355	220	220
q13	17785	3706	3076	3076
q14	227	229	213	213
q15	576	547	531	531
q16	625	618	582	582
q17	576	864	316	316
q18	7091	6496	6416	6416
q19	1219	960	554	554
q20	316	330	193	193
q21	2903	2278	1988	1988
q22	370	341	320	320
Total cold run time: 102694 ms
Total hot run time: 32782 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6239	6238	6209	6209
q2	249	336	237	237
q3	2277	2663	2311	2311
q4	1416	1855	1346	1346
q5	4325	4735	4753	4735
q6	187	175	140	140
q7	2074	1993	1827	1827
q8	2642	2843	2729	2729
q9	7352	7265	7329	7265
q10	3062	3359	2777	2777
q11	581	518	497	497
q12	688	828	607	607
q13	3539	3884	3303	3303
q14	280	316	275	275
q15	581	540	529	529
q16	634	701	633	633
q17	1245	1759	1263	1263
q18	7822	7592	7464	7464
q19	787	1144	1090	1090
q20	1999	2037	1883	1883
q21	5748	5199	5080	5080
q22	629	596	582	582
Total cold run time: 54356 ms
Total hot run time: 52782 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 194844 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 09cc6a85642d22656dfa78691896a80d511d6c17, data reload: false

query1	1330	949	916	916
query2	6169	2053	2060	2053
query3	10971	4529	4536	4529
query4	32406	23469	23194	23194
query5	3587	622	466	466
query6	296	203	213	203
query7	3993	488	316	316
query8	285	241	232	232
query9	9451	2669	2667	2667
query10	468	302	246	246
query11	17643	15175	15455	15175
query12	158	105	105	105
query13	1546	489	383	383
query14	9188	7776	7390	7390
query15	239	211	191	191
query16	8125	629	491	491
query17	1665	772	610	610
query18	2115	430	326	326
query19	222	205	172	172
query20	122	117	127	117
query21	208	125	107	107
query22	4516	4641	4378	4378
query23	34387	33876	33490	33490
query24	6637	2278	2333	2278
query25	513	469	392	392
query26	1129	279	158	158
query27	2199	480	336	336
query28	5144	2501	2511	2501
query29	727	581	439	439
query30	218	207	162	162
query31	950	905	856	856
query32	84	61	58	58
query33	479	381	315	315
query34	770	905	534	534
query35	819	832	785	785
query36	1049	1061	975	975
query37	124	108	83	83
query38	4357	4400	4289	4289
query39	1523	1445	1451	1445
query40	217	116	104	104
query41	64	53	55	53
query42	123	111	106	106
query43	518	544	497	497
query44	1389	849	863	849
query45	190	177	170	170
query46	891	1062	674	674
query47	1948	1918	1884	1884
query48	398	429	326	326
query49	772	513	400	400
query50	642	682	385	385
query51	7068	7054	6940	6940
query52	99	102	102	102
query53	236	255	196	196
query54	505	488	430	430
query55	85	87	85	85
query56	283	306	256	256
query57	1226	1178	1133	1133
query58	254	244	248	244
query59	3259	3378	3139	3139
query60	287	284	260	260
query61	122	121	127	121
query62	848	795	729	729
query63	220	190	185	185
query64	4061	1047	672	672
query65	3285	3192	3132	3132
query66	998	413	360	360
query67	16066	15562	15630	15562
query68	5656	830	541	541
query69	476	298	261	261
query70	1180	1154	1071	1071
query71	372	288	257	257
query72	5938	2772	3896	2772
query73	648	760	372	372
query74	10144	9044	8810	8810
query75	3282	3177	2693	2693
query76	3101	1217	774	774
query77	449	363	283	283
query78	9957	9992	9355	9355
query79	3140	826	588	588
query80	1240	568	458	458
query81	536	284	239	239
query82	719	149	122	122
query83	196	174	163	163
query84	241	93	73	73
query85	766	353	306	306
query86	398	327	302	302
query87	4432	4466	4473	4466
query88	4901	2233	2227	2227
query89	401	334	301	301
query90	1721	193	197	193
query91	133	140	111	111
query92	66	58	51	51
query93	2742	889	533	533
query94	780	377	287	287
query95	341	272	258	258
query96	491	613	289	289
query97	2811	2918	2758	2758
query98	246	206	195	195
query99	1411	1506	1378	1378
Total cold run time: 290781 ms
Total hot run time: 194844 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.61 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 09cc6a85642d22656dfa78691896a80d511d6c17, data reload: false

query1	0.03	0.03	0.03
query2	0.06	0.04	0.03
query3	0.23	0.07	0.07
query4	1.62	0.11	0.10
query5	0.42	0.42	0.41
query6	1.17	0.65	0.66
query7	0.02	0.01	0.02
query8	0.04	0.04	0.03
query9	0.58	0.52	0.53
query10	0.54	0.56	0.55
query11	0.14	0.11	0.10
query12	0.13	0.11	0.11
query13	0.60	0.62	0.59
query14	2.83	2.83	2.85
query15	0.90	0.83	0.82
query16	0.38	0.41	0.38
query17	1.05	1.07	1.05
query18	0.22	0.21	0.21
query19	1.93	1.85	1.97
query20	0.01	0.01	0.02
query21	15.36	0.87	0.56
query22	0.76	0.75	0.67
query23	15.33	1.36	0.55
query24	3.28	1.20	1.43
query25	0.14	0.19	0.18
query26	0.35	0.15	0.14
query27	0.04	0.04	0.05
query28	13.97	1.49	1.05
query29	12.59	3.98	3.30
query30	0.25	0.09	0.06
query31	2.82	0.60	0.38
query32	3.23	0.56	0.47
query33	3.08	2.96	3.03
query34	16.36	5.21	4.47
query35	4.56	4.57	4.45
query36	0.65	0.50	0.48
query37	0.10	0.06	0.06
query38	0.04	0.03	0.03
query39	0.04	0.02	0.02
query40	0.17	0.12	0.12
query41	0.08	0.03	0.02
query42	0.04	0.03	0.02
query43	0.03	0.04	0.03
Total cold run time: 106.17 s
Total hot run time: 31.61 s

@doris-robot
Copy link

TPC-H: Total hot run time: 32415 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 03510514e3c4cc78da69d84af7944a61b2930c6a, data reload: false

------ Round 1 ----------------------------------
q1	17582	5442	5388	5388
q2	2049	293	164	164
q3	10436	1215	724	724
q4	10226	960	512	512
q5	7985	2380	2185	2185
q6	192	165	131	131
q7	910	737	600	600
q8	9227	1354	1159	1159
q9	5109	4925	4977	4925
q10	6822	2352	1884	1884
q11	485	270	253	253
q12	345	355	218	218
q13	17766	3669	3103	3103
q14	239	228	209	209
q15	521	468	481	468
q16	623	615	575	575
q17	566	860	334	334
q18	6842	6545	6480	6480
q19	1267	969	541	541
q20	324	331	192	192
q21	2841	2240	2039	2039
q22	373	335	331	331
Total cold run time: 102730 ms
Total hot run time: 32415 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5546	5540	5529	5529
q2	235	332	239	239
q3	2258	2688	2329	2329
q4	1397	1815	1388	1388
q5	4632	4765	4650	4650
q6	172	156	126	126
q7	2050	1968	1804	1804
q8	2655	2838	2689	2689
q9	7374	7230	7334	7230
q10	3038	3260	2815	2815
q11	575	534	487	487
q12	637	724	604	604
q13	3491	3997	3283	3283
q14	285	311	278	278
q15	526	489	477	477
q16	629	725	629	629
q17	1255	1721	1261	1261
q18	7827	7405	7404	7404
q19	816	1184	1053	1053
q20	2023	2087	1868	1868
q21	5694	5141	5033	5033
q22	580	598	586	586
Total cold run time: 53695 ms
Total hot run time: 51762 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 194378 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 03510514e3c4cc78da69d84af7944a61b2930c6a, data reload: false

query1	1298	940	945	940
query2	6403	2072	2069	2069
query3	11114	4625	4513	4513
query4	61380	28858	23213	23213
query5	5461	595	440	440
query6	424	220	203	203
query7	5539	500	300	300
query8	313	245	221	221
query9	8486	2581	2578	2578
query10	454	298	242	242
query11	17346	14973	15284	14973
query12	163	110	114	110
query13	1428	538	434	434
query14	10856	6905	7294	6905
query15	217	213	195	195
query16	7254	644	487	487
query17	1111	735	619	619
query18	1905	436	337	337
query19	202	179	167	167
query20	116	126	110	110
query21	213	127	109	109
query22	4476	4611	4671	4611
query23	34031	33216	33529	33216
query24	5631	2408	2308	2308
query25	449	445	405	405
query26	641	274	148	148
query27	1626	469	350	350
query28	4033	2453	2447	2447
query29	517	592	418	418
query30	243	188	158	158
query31	921	924	826	826
query32	73	61	59	59
query33	412	367	295	295
query34	745	843	518	518
query35	799	878	768	768
query36	1007	1068	925	925
query37	116	116	85	85
query38	4287	4250	4265	4250
query39	1520	1461	1509	1461
query40	207	127	99	99
query41	59	52	47	47
query42	126	103	106	103
query43	543	550	512	512
query44	1302	830	833	830
query45	194	177	163	163
query46	906	1063	646	646
query47	1900	1920	1865	1865
query48	391	404	320	320
query49	697	508	397	397
query50	649	685	395	395
query51	7110	7094	6984	6984
query52	101	100	89	89
query53	231	261	185	185
query54	474	492	424	424
query55	88	86	79	79
query56	258	259	239	239
query57	1264	1224	1169	1169
query58	241	238	260	238
query59	3146	3146	2979	2979
query60	270	257	256	256
query61	149	111	121	111
query62	748	703	659	659
query63	221	183	181	181
query64	1228	1001	645	645
query65	3287	3142	3124	3124
query66	721	384	301	301
query67	15917	15745	15552	15552
query68	4671	826	525	525
query69	494	308	261	261
query70	1201	1158	1154	1154
query71	417	277	255	255
query72	5315	3828	3800	3800
query73	792	750	355	355
query74	10434	8868	9163	8868
query75	3224	3154	2663	2663
query76	3560	1163	768	768
query77	526	348	272	272
query78	10210	10041	9453	9453
query79	3426	820	584	584
query80	1652	510	438	438
query81	543	274	233	233
query82	440	150	120	120
query83	267	173	153	153
query84	293	90	75	75
query85	782	380	296	296
query86	467	324	282	282
query87	4534	4423	4481	4423
query88	4491	2177	2148	2148
query89	406	319	293	293
query90	1550	188	186	186
query91	140	143	106	106
query92	60	56	52	52
query93	2838	886	527	527
query94	743	413	302	302
query95	320	259	251	251
query96	485	606	286	286
query97	2947	2858	2786	2786
query98	228	198	206	198
query99	1322	1372	1260	1260
Total cold run time: 314416 ms
Total hot run time: 194378 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.19 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 03510514e3c4cc78da69d84af7944a61b2930c6a, data reload: false

query1	0.03	0.04	0.03
query2	0.07	0.03	0.03
query3	0.24	0.07	0.07
query4	1.62	0.10	0.10
query5	0.41	0.42	0.40
query6	1.16	0.64	0.65
query7	0.02	0.02	0.02
query8	0.04	0.03	0.04
query9	0.60	0.49	0.50
query10	0.56	0.57	0.54
query11	0.14	0.10	0.10
query12	0.14	0.11	0.11
query13	0.60	0.59	0.61
query14	2.84	2.69	2.70
query15	0.89	0.81	0.82
query16	0.38	0.37	0.37
query17	1.03	1.04	0.99
query18	0.23	0.22	0.21
query19	1.98	1.77	2.01
query20	0.02	0.01	0.02
query21	15.37	0.93	0.60
query22	0.75	0.74	0.68
query23	15.29	1.39	0.58
query24	2.78	0.52	1.45
query25	0.20	0.13	0.09
query26	0.29	0.16	0.13
query27	0.06	0.05	0.05
query28	13.85	1.02	0.44
query29	12.57	3.96	3.27
query30	0.25	0.10	0.06
query31	2.82	0.61	0.39
query32	3.23	0.55	0.49
query33	3.02	3.01	2.97
query34	16.77	5.24	4.54
query35	4.64	4.60	4.59
query36	0.78	0.48	0.48
query37	0.10	0.07	0.06
query38	0.04	0.04	0.03
query39	0.03	0.02	0.02
query40	0.17	0.14	0.13
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.03	0.03	0.04
Total cold run time: 106.15 s
Total hot run time: 30.19 s

@924060929
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32549 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 183b79b497811f66a67f09158f412d224e1b5839, data reload: false

------ Round 1 ----------------------------------
q1	17671	5464	5359	5359
q2	2050	298	167	167
q3	10426	1230	752	752
q4	10249	995	542	542
q5	8098	2407	2206	2206
q6	196	168	138	138
q7	902	768	597	597
q8	9237	1363	1233	1233
q9	5270	4873	5007	4873
q10	6886	2382	1934	1934
q11	483	274	273	273
q12	355	382	233	233
q13	17911	3700	3091	3091
q14	238	241	209	209
q15	512	482	465	465
q16	639	619	592	592
q17	580	867	342	342
q18	6895	6508	6448	6448
q19	1936	960	562	562
q20	322	322	188	188
q21	2880	2272	2031	2031
q22	370	336	314	314
Total cold run time: 104106 ms
Total hot run time: 32549 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5551	5470	5547	5470
q2	251	332	249	249
q3	2265	2607	2321	2321
q4	1456	1835	1409	1409
q5	4340	4748	4728	4728
q6	174	162	126	126
q7	2084	1915	1822	1822
q8	2613	2841	2719	2719
q9	7339	7238	7288	7238
q10	3037	3278	2788	2788
q11	566	520	476	476
q12	645	736	585	585
q13	3554	3966	3324	3324
q14	293	315	282	282
q15	521	487	469	469
q16	649	706	663	663
q17	1270	1751	1278	1278
q18	7872	7462	7360	7360
q19	890	1146	1141	1141
q20	2000	2039	1880	1880
q21	5719	5223	5034	5034
q22	627	641	559	559
Total cold run time: 53716 ms
Total hot run time: 51921 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 194954 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 183b79b497811f66a67f09158f412d224e1b5839, data reload: false

query1	1307	972	957	957
query2	6390	2086	2072	2072
query3	11062	4550	4727	4550
query4	32296	23436	23046	23046
query5	3675	590	461	461
query6	313	215	182	182
query7	3981	484	312	312
query8	284	227	217	217
query9	9344	2669	2664	2664
query10	468	310	248	248
query11	17521	15095	15000	15000
query12	151	104	100	100
query13	1553	531	405	405
query14	9106	6802	7054	6802
query15	242	191	195	191
query16	8049	640	500	500
query17	1584	770	574	574
query18	2148	433	330	330
query19	206	195	170	170
query20	121	120	121	120
query21	215	128	109	109
query22	4544	4676	4440	4440
query23	34011	33456	33438	33438
query24	6820	2366	2393	2366
query25	526	486	434	434
query26	801	283	152	152
query27	2077	477	331	331
query28	5692	2495	2488	2488
query29	682	572	426	426
query30	231	184	162	162
query31	948	876	824	824
query32	85	61	57	57
query33	496	367	309	309
query34	760	865	520	520
query35	782	874	766	766
query36	1041	1080	943	943
query37	122	101	78	78
query38	4445	4427	4327	4327
query39	1535	1443	1406	1406
query40	198	112	99	99
query41	57	50	52	50
query42	117	104	100	100
query43	533	540	499	499
query44	1280	808	820	808
query45	190	172	171	171
query46	896	1067	647	647
query47	1911	1940	1820	1820
query48	387	404	321	321
query49	751	508	403	403
query50	665	676	409	409
query51	7082	7089	6874	6874
query52	102	97	105	97
query53	234	252	183	183
query54	494	496	438	438
query55	88	77	81	77
query56	271	258	254	254
query57	1215	1217	1130	1130
query58	243	230	241	230
query59	3090	3319	3362	3319
query60	289	272	258	258
query61	136	128	120	120
query62	779	714	693	693
query63	231	191	189	189
query64	3633	1043	672	672
query65	3269	3159	3167	3159
query66	776	392	293	293
query67	15998	15779	15409	15409
query68	5803	817	532	532
query69	503	344	257	257
query70	1218	1183	1179	1179
query71	391	287	251	251
query72	6263	3872	3943	3872
query73	651	749	358	358
query74	10361	9053	9254	9053
query75	3204	3155	2689	2689
query76	3150	1201	767	767
query77	479	359	267	267
query78	9949	9961	9387	9387
query79	2852	788	612	612
query80	687	518	435	435
query81	508	275	234	234
query82	306	154	123	123
query83	172	176	151	151
query84	240	106	70	70
query85	752	341	301	301
query86	393	318	291	291
query87	4418	4471	4613	4471
query88	5025	2209	2186	2186
query89	403	328	290	290
query90	1827	192	195	192
query91	138	137	108	108
query92	66	56	53	53
query93	2182	869	531	531
query94	655	405	290	290
query95	335	271	287	271
query96	495	661	284	284
query97	2806	2827	2778	2778
query98	235	199	193	193
query99	1266	1364	1279	1279
Total cold run time: 288262 ms
Total hot run time: 194954 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.67 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 183b79b497811f66a67f09158f412d224e1b5839, data reload: false

query1	0.04	0.05	0.03
query2	0.07	0.03	0.04
query3	0.25	0.07	0.07
query4	1.60	0.10	0.11
query5	0.42	0.44	0.41
query6	1.17	0.65	0.66
query7	0.02	0.02	0.01
query8	0.04	0.03	0.03
query9	0.59	0.50	0.51
query10	0.56	0.56	0.55
query11	0.14	0.10	0.10
query12	0.14	0.11	0.10
query13	0.61	0.59	0.60
query14	2.72	2.71	2.74
query15	0.89	0.83	0.82
query16	0.38	0.37	0.38
query17	1.04	1.00	1.02
query18	0.23	0.22	0.21
query19	1.91	1.79	1.94
query20	0.01	0.01	0.01
query21	15.38	0.95	0.60
query22	0.74	0.95	0.76
query23	15.05	1.42	0.62
query24	2.87	0.82	0.83
query25	0.27	0.10	0.13
query26	0.27	0.16	0.13
query27	0.07	0.05	0.05
query28	13.38	1.06	0.44
query29	12.56	3.92	3.27
query30	0.25	0.09	0.06
query31	2.82	0.61	0.38
query32	3.22	0.55	0.46
query33	2.96	3.11	3.08
query34	16.70	5.14	4.53
query35	4.58	4.50	4.56
query36	0.64	0.49	0.48
query37	0.10	0.06	0.06
query38	0.05	0.03	0.03
query39	0.04	0.02	0.03
query40	0.16	0.14	0.13
query41	0.08	0.03	0.02
query42	0.04	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 105.1 s
Total hot run time: 30.67 s

@924060929
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33448 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit aa21f2f6b543bf4bcecbc0d41d4ad50809dbcf22, data reload: false

------ Round 1 ----------------------------------
q1	17770	5494	5470	5470
q2	2038	313	200	200
q3	10638	1311	744	744
q4	11404	975	519	519
q5	8008	2404	2196	2196
q6	228	174	137	137
q7	910	743	622	622
q8	9242	1497	1295	1295
q9	5416	4996	5001	4996
q10	6873	2362	1893	1893
q11	494	277	264	264
q12	345	375	224	224
q13	18392	3729	3139	3139
q14	241	235	214	214
q15	528	478	475	475
q16	628	619	584	584
q17	584	911	330	330
q18	8062	7076	6839	6839
q19	6667	1131	815	815
q20	311	315	183	183
q21	2772	2165	1987	1987
q22	394	342	322	322
Total cold run time: 111945 ms
Total hot run time: 33448 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6017	5696	5692	5692
q2	285	336	239	239
q3	2236	2664	2309	2309
q4	1450	1771	1339	1339
q5	4523	5064	4867	4867
q6	184	168	131	131
q7	2068	1971	1792	1792
q8	2656	2813	2743	2743
q9	7312	7305	7164	7164
q10	2952	3276	2747	2747
q11	593	516	487	487
q12	693	747	634	634
q13	3471	3914	3274	3274
q14	294	309	268	268
q15	518	477	493	477
q16	663	686	657	657
q17	1303	1728	1255	1255
q18	7886	7539	7410	7410
q19	843	1233	1158	1158
q20	2099	2089	1881	1881
q21	5477	5177	4924	4924
q22	608	606	574	574
Total cold run time: 54131 ms
Total hot run time: 52022 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 194987 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit aa21f2f6b543bf4bcecbc0d41d4ad50809dbcf22, data reload: false

query1	1322	974	951	951
query2	6410	2062	2130	2062
query3	10968	4394	4455	4394
query4	60501	29222	23088	23088
query5	5296	584	479	479
query6	426	179	184	179
query7	5558	505	294	294
query8	322	228	213	213
query9	8085	2685	2684	2684
query10	453	309	257	257
query11	17594	15145	15376	15145
query12	157	115	107	107
query13	1459	546	420	420
query14	10942	7034	7287	7034
query15	219	202	188	188
query16	7502	629	502	502
query17	1117	754	619	619
query18	1918	428	319	319
query19	243	179	158	158
query20	120	111	119	111
query21	208	128	107	107
query22	4429	4735	4450	4450
query23	33792	33773	33751	33751
query24	5939	2351	2343	2343
query25	467	464	419	419
query26	648	282	157	157
query27	1725	464	325	325
query28	4098	2520	2450	2450
query29	532	558	412	412
query30	207	189	162	162
query31	919	911	846	846
query32	68	59	57	57
query33	486	362	302	302
query34	755	929	518	518
query35	841	846	753	753
query36	1059	1073	975	975
query37	119	97	74	74
query38	4293	4307	4223	4223
query39	1514	1431	1460	1431
query40	209	118	106	106
query41	51	53	52	52
query42	116	104	108	104
query43	532	532	492	492
query44	1293	831	847	831
query45	186	173	171	171
query46	884	1055	664	664
query47	1946	1950	1867	1867
query48	392	423	318	318
query49	705	486	400	400
query50	658	660	391	391
query51	7116	6987	6981	6981
query52	110	98	101	98
query53	224	247	181	181
query54	483	502	416	416
query55	79	79	77	77
query56	268	252	278	252
query57	1237	1223	1158	1158
query58	242	224	230	224
query59	3133	3174	2990	2990
query60	262	297	259	259
query61	117	114	112	112
query62	699	738	642	642
query63	227	181	183	181
query64	1275	1020	654	654
query65	3219	3153	3147	3147
query66	652	387	303	303
query67	15826	15607	15572	15572
query68	5068	828	525	525
query69	478	287	263	263
query70	1201	1201	1128	1128
query71	420	288	259	259
query72	6236	3940	3893	3893
query73	798	771	372	372
query74	9892	9098	8925	8925
query75	3254	3131	2657	2657
query76	3777	1180	776	776
query77	469	378	288	288
query78	10060	10037	9224	9224
query79	3440	810	584	584
query80	1612	521	552	521
query81	547	272	237	237
query82	572	156	127	127
query83	263	168	164	164
query84	293	88	78	78
query85	791	352	306	306
query86	454	323	296	296
query87	4415	4522	4407	4407
query88	4451	2178	2180	2178
query89	393	325	292	292
query90	1556	192	186	186
query91	131	143	110	110
query92	67	63	50	50
query93	2842	854	537	537
query94	761	382	305	305
query95	321	258	257	257
query96	491	604	284	284
query97	2821	2810	2726	2726
query98	225	208	197	197
query99	1295	1399	1233	1233
Total cold run time: 314246 ms
Total hot run time: 194987 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.32 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit aa21f2f6b543bf4bcecbc0d41d4ad50809dbcf22, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.03	0.04
query3	0.24	0.07	0.08
query4	1.62	0.10	0.10
query5	0.43	0.42	0.43
query6	1.18	0.67	0.65
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.57	0.52	0.52
query10	0.54	0.56	0.56
query11	0.14	0.10	0.10
query12	0.14	0.10	0.11
query13	0.60	0.62	0.59
query14	2.72	2.73	2.87
query15	0.91	0.83	0.83
query16	0.36	0.37	0.37
query17	1.00	1.01	1.01
query18	0.22	0.22	0.20
query19	1.92	1.77	2.00
query20	0.01	0.01	0.02
query21	15.36	0.92	0.59
query22	0.76	0.79	0.63
query23	15.34	1.39	0.55
query24	3.43	0.63	1.24
query25	0.29	0.19	0.18
query26	0.31	0.15	0.14
query27	0.07	0.04	0.05
query28	13.26	1.02	0.43
query29	12.56	3.95	3.30
query30	0.26	0.09	0.06
query31	2.82	0.59	0.37
query32	3.22	0.54	0.46
query33	2.97	3.05	3.02
query34	16.73	5.14	4.51
query35	4.50	4.49	4.51
query36	0.66	0.49	0.47
query37	0.10	0.06	0.05
query38	0.05	0.04	0.04
query39	0.04	0.03	0.02
query40	0.17	0.14	0.13
query41	0.08	0.03	0.02
query42	0.03	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 105.82 s
Total hot run time: 30.32 s

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jan 23, 2025
@github-actions GitHub Actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@924060929 924060929 merged commit fab38f5 into apache:master Jan 23, 2025
27 of 28 checks passed
@924060929 924060929 deleted the distribute_planner_for_cloud_mode branch January 23, 2025 09:59
@924060929 924060929 mentioned this pull request Jan 24, 2025
Merged
16 tasks
924060929 added a commit that referenced this pull request Jan 26, 2025
@924060929
[fix](point query) fix point query throw npe (#47409)
fec9e9a 
fix point query throw npe, introduced by #46879.

sql:
```sql
select 1
```
the exception:
```
java.sql.SQLException: errCode = 2, detailMessage = Cannot invoke "org.apache.doris.nereids.trees.plans.distribute.FragmentIdMapping.valueList()" because the return value of "org.apache.doris.nereids.NereidsPlanner.getDistributedPlans()" is null
```
lzyy2024 pushed a commit to lzyy2024/doris that referenced this pull request Feb 21, 2025
@924060929 @lzyy2024
[opt](coordinator) support nereids coordinator for cloud mode (apache…
5d93741 
…#46879)

support nereids coordinator for cloud mode
lzyy2024 pushed a commit to lzyy2024/doris that referenced this pull request Feb 21, 2025
@924060929 @lzyy2024
[fix](point query) fix point query throw npe (apache#47409)
67ee557 
fix point query throw npe, introduced by apache#46879.

sql:
```sql
select 1
```
the exception:
```
java.sql.SQLException: errCode = 2, detailMessage = Cannot invoke "org.apache.doris.nereids.trees.plans.distribute.FragmentIdMapping.valueList()" because the return value of "org.apache.doris.nereids.NereidsPlanner.getDistributedPlans()" is null
```
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@gavinchou gavinchou gavinchou approved these changes

@starocean999 starocean999 starocean999 approved these changes

@morrySnow morrySnow morrySnow approved these changes

@dataroaring dataroaring Awaiting requested review from dataroaring dataroaring is a code owner

@w41ter w41ter Awaiting requested review from w41ter w41ter is a code owner

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
7 participants
@924060929 @hello-stephen @doris-robot @gavinchou @starocean999 @morrySnow @shuke987