Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[fix](Nereids) fix cancel task jobs failed #44755

Open
wants to merge 10 commits into
base: master
Choose a base branch
from

Conversation

LiBinfeng-01
Copy link
Collaborator

@LiBinfeng-01 LiBinfeng-01 commented Nov 28, 2024

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #44279

Problem Summary:

when cancel task, it should use "taskId" as unbound slot in and right child's left child, otherwise it would failed
Regression test to be added by @CalvinKirs

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@@ -79,14 +80,17 @@ private void validate() throws AnalysisException {
throw new AnalysisException("JobName value must is string");
}
this.jobName = ((StringLikeLiteral) expr.child(0).child(1)).getStringValue();
String taskIdInput = ((StringLikeLiteral) expr.child(1).child(0)).getStringValue();
if (!(expr.child(1).child(0) instanceof UnboundSlot)) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

if jobName must string, i think we should change syntax to ensure it

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe u should use get text from identifier to keep it same as legacy planner

@LiBinfeng-01
Copy link
Collaborator Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39831 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 00c6e5be060294635b33ce2fe8980f8b8dbf508f, data reload: false

------ Round 1 ----------------------------------
q1	17613	7457	7323	7323
q2	2060	175	175	175
q3	10860	1116	1199	1116
q4	10570	747	781	747
q5	7607	2730	2675	2675
q6	235	148	149	148
q7	999	671	598	598
q8	9236	1804	1871	1804
q9	6650	6433	6463	6433
q10	6983	2328	2371	2328
q11	461	252	261	252
q12	427	225	224	224
q13	17794	3012	3082	3012
q14	238	210	225	210
q15	581	528	524	524
q16	676	583	600	583
q17	971	588	534	534
q18	7176	6841	6728	6728
q19	1343	999	1038	999
q20	472	180	182	180
q21	4048	3247	2930	2930
q22	372	320	308	308
Total cold run time: 107372 ms
Total hot run time: 39831 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7237	7264	7214	7214
q2	342	224	225	224
q3	2911	2802	2952	2802
q4	2080	1846	1919	1846
q5	5647	5665	5633	5633
q6	232	147	150	147
q7	2273	1848	1810	1810
q8	3418	3516	3509	3509
q9	8960	8990	8987	8987
q10	3594	3582	3537	3537
q11	614	502	497	497
q12	835	628	613	613
q13	12169	3264	3222	3222
q14	301	289	277	277
q15	582	525	537	525
q16	706	635	633	633
q17	1883	1643	1609	1609
q18	8172	7931	7594	7594
q19	1691	1637	1630	1630
q20	2139	1914	1902	1902
q21	5663	5451	5565	5451
q22	646	577	551	551
Total cold run time: 72095 ms
Total hot run time: 60213 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197890 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 00c6e5be060294635b33ce2fe8980f8b8dbf508f, data reload: false

query1	1241	947	948	947
query2	6242	2042	2061	2042
query3	10977	4512	4497	4497
query4	66844	29184	23537	23537
query5	4982	471	461	461
query6	396	187	171	171
query7	5522	308	286	286
query8	317	247	252	247
query9	8731	2712	2688	2688
query10	442	244	263	244
query11	17248	15279	16066	15279
query12	156	106	110	106
query13	1465	428	415	415
query14	11028	7486	6883	6883
query15	225	193	189	189
query16	6665	487	461	461
query17	1221	574	578	574
query18	1337	296	306	296
query19	207	145	145	145
query20	120	111	146	111
query21	205	107	101	101
query22	4711	4644	4671	4644
query23	35159	34796	34774	34774
query24	5591	2488	2519	2488
query25	478	388	382	382
query26	651	147	156	147
query27	2045	278	284	278
query28	4375	2435	2436	2435
query29	668	407	417	407
query30	205	155	156	155
query31	1025	865	844	844
query32	64	53	58	53
query33	417	293	299	293
query34	940	506	535	506
query35	908	797	768	768
query36	1087	974	984	974
query37	122	74	71	71
query38	4481	4484	4381	4381
query39	1524	1512	1495	1495
query40	198	107	102	102
query41	45	41	43	41
query42	108	93	100	93
query43	553	490	487	487
query44	1179	819	814	814
query45	224	175	176	175
query46	1175	721	726	721
query47	2033	1965	1918	1918
query48	391	341	319	319
query49	741	395	383	383
query50	833	381	385	381
query51	7457	7206	7107	7107
query52	107	88	90	88
query53	255	177	177	177
query54	487	396	382	382
query55	78	76	73	73
query56	254	239	231	231
query57	1248	1100	1122	1100
query58	227	228	217	217
query59	3050	3019	3045	3019
query60	273	230	234	230
query61	100	101	101	101
query62	806	681	672	672
query63	208	192	179	179
query64	1331	689	622	622
query65	3266	3230	3272	3230
query66	700	295	309	295
query67	15921	15698	15672	15672
query68	3784	563	552	552
query69	430	249	247	247
query70	1233	1132	1124	1124
query71	362	248	245	245
query72	6308	4083	4019	4019
query73	771	362	359	359
query74	9565	9108	9146	9108
query75	3426	2667	2642	2642
query76	1827	1179	1116	1116
query77	518	311	281	281
query78	10459	9445	9433	9433
query79	1670	578	592	578
query80	873	420	437	420
query81	497	237	225	225
query82	1313	132	124	124
query83	252	142	141	141
query84	289	69	67	67
query85	885	301	287	287
query86	335	295	313	295
query87	4666	4635	4633	4633
query88	3526	2198	2228	2198
query89	412	296	291	291
query90	2006	192	192	192
query91	140	112	104	104
query92	66	56	52	52
query93	1938	540	533	533
query94	741	276	269	269
query95	345	247	253	247
query96	631	275	297	275
query97	2912	2727	2725	2725
query98	215	195	201	195
query99	1849	1353	1309	1309
Total cold run time: 317514 ms
Total hot run time: 197890 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.14 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 00c6e5be060294635b33ce2fe8980f8b8dbf508f, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.03	0.03
query3	0.24	0.08	0.07
query4	1.61	0.10	0.10
query5	0.41	0.42	0.42
query6	1.14	0.65	0.65
query7	0.02	0.01	0.02
query8	0.04	0.03	0.03
query9	0.59	0.51	0.50
query10	0.55	0.56	0.55
query11	0.15	0.11	0.10
query12	0.14	0.12	0.11
query13	0.61	0.61	0.59
query14	2.70	2.70	2.77
query15	0.91	0.83	0.83
query16	0.39	0.38	0.38
query17	1.07	1.06	0.97
query18	0.23	0.21	0.21
query19	1.88	1.71	1.83
query20	0.02	0.01	0.01
query21	15.37	0.59	0.59
query22	2.34	2.61	1.61
query23	17.02	1.18	0.91
query24	2.84	1.80	2.09
query25	0.30	0.06	0.05
query26	0.64	0.14	0.14
query27	0.05	0.06	0.04
query28	9.77	1.10	1.08
query29	12.61	3.24	3.21
query30	0.25	0.07	0.07
query31	2.86	0.38	0.38
query32	3.28	0.47	0.48
query33	3.03	3.09	3.06
query34	17.29	4.44	4.44
query35	4.48	4.50	4.47
query36	0.65	0.49	0.49
query37	0.09	0.06	0.06
query38	0.04	0.04	0.04
query39	0.03	0.02	0.02
query40	0.16	0.13	0.13
query41	0.08	0.03	0.03
query42	0.03	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.05 s
Total hot run time: 33.14 s

@LiBinfeng-01
Copy link
Collaborator Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39869 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2816bc2db0afd9121be898f05e80ea8f8a47a207, data reload: false

------ Round 1 ----------------------------------
q1	17675	7491	7270	7270
q2	2049	172	165	165
q3	10636	1127	1245	1127
q4	10226	693	745	693
q5	7623	2691	2680	2680
q6	236	149	143	143
q7	994	626	611	611
q8	9238	1805	1934	1805
q9	6626	6466	6435	6435
q10	6955	2289	2312	2289
q11	454	266	254	254
q12	410	219	218	218
q13	17761	3032	2986	2986
q14	245	215	213	213
q15	564	526	541	526
q16	644	586	590	586
q17	989	604	518	518
q18	7278	6668	6768	6668
q19	1341	979	990	979
q20	471	185	182	182
q21	4387	3214	3274	3214
q22	385	307	313	307
Total cold run time: 107187 ms
Total hot run time: 39869 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7280	7233	7193	7193
q2	329	228	231	228
q3	2886	2751	3026	2751
q4	2121	1868	1771	1771
q5	5597	5695	5650	5650
q6	217	139	141	139
q7	2196	1748	1874	1748
q8	3392	3526	3467	3467
q9	8983	8999	9153	8999
q10	3583	3535	3517	3517
q11	587	501	489	489
q12	836	629	639	629
q13	12846	3203	3166	3166
q14	295	261	266	261
q15	586	528	516	516
q16	694	640	630	630
q17	1788	1611	1533	1533
q18	7955	7381	7414	7381
q19	1642	1558	1492	1492
q20	2053	1821	1831	1821
q21	5405	5285	5429	5285
q22	636	548	555	548
Total cold run time: 71907 ms
Total hot run time: 59214 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191193 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2816bc2db0afd9121be898f05e80ea8f8a47a207, data reload: false

query1	977	377	362	362
query2	6516	2073	2034	2034
query3	6706	209	215	209
query4	33985	23556	23696	23556
query5	4342	477	482	477
query6	285	194	193	193
query7	4620	291	302	291
query8	298	236	230	230
query9	9513	2694	2688	2688
query10	482	276	260	260
query11	18278	15242	15189	15189
query12	140	99	101	99
query13	1644	399	411	399
query14	9122	7122	7142	7122
query15	254	175	178	175
query16	8126	430	460	430
query17	1610	559	560	559
query18	2123	281	285	281
query19	338	154	138	138
query20	113	119	107	107
query21	204	99	105	99
query22	4692	4462	4282	4282
query23	35505	34306	34278	34278
query24	10562	2401	2368	2368
query25	636	383	376	376
query26	1468	148	153	148
query27	2838	276	266	266
query28	7985	2407	2423	2407
query29	915	406	398	398
query30	294	148	152	148
query31	1000	799	864	799
query32	96	61	57	57
query33	777	282	272	272
query34	985	502	515	502
query35	854	728	724	724
query36	1090	905	959	905
query37	141	87	73	73
query38	4221	4134	4211	4134
query39	1524	1421	1421	1421
query40	276	97	98	97
query41	46	43	44	43
query42	110	104	96	96
query43	532	490	481	481
query44	1281	795	791	791
query45	179	167	167	167
query46	1166	708	715	708
query47	1961	1889	1863	1863
query48	425	315	317	315
query49	1171	400	392	392
query50	817	389	380	380
query51	7272	7208	7194	7194
query52	99	98	87	87
query53	265	180	174	174
query54	1065	403	401	401
query55	82	76	75	75
query56	260	223	240	223
query57	1272	1095	1110	1095
query58	232	206	215	206
query59	3163	3019	2930	2930
query60	268	242	270	242
query61	120	108	110	108
query62	866	676	683	676
query63	216	188	190	188
query64	5431	761	733	733
query65	3311	3212	3260	3212
query66	1312	336	321	321
query67	16008	15813	15564	15564
query68	4903	548	535	535
query69	413	249	251	249
query70	1162	1113	1111	1111
query71	319	265	268	265
query72	6462	4122	4111	4111
query73	762	352	352	352
query74	10070	8960	8999	8960
query75	3397	2672	2674	2672
query76	2758	995	1033	995
query77	392	274	339	274
query78	10378	9524	9502	9502
query79	2488	592	602	592
query80	1198	474	423	423
query81	529	228	229	228
query82	928	126	120	120
query83	236	146	143	143
query84	235	68	67	67
query85	1254	298	300	298
query86	416	291	294	291
query87	4647	4619	4429	4429
query88	3986	2196	2206	2196
query89	416	302	304	302
query90	1904	186	186	186
query91	134	103	106	103
query92	74	51	53	51
query93	1673	540	542	540
query94	796	286	298	286
query95	346	246	241	241
query96	609	277	276	276
query97	2834	2672	2713	2672
query98	219	192	193	192
query99	1540	1329	1313	1313
Total cold run time: 301943 ms
Total hot run time: 191193 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.95 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 2816bc2db0afd9121be898f05e80ea8f8a47a207, data reload: false

query1	0.03	0.04	0.03
query2	0.06	0.03	0.03
query3	0.24	0.08	0.07
query4	1.62	0.10	0.11
query5	0.42	0.42	0.43
query6	1.16	0.67	0.66
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.58	0.51	0.52
query10	0.56	0.56	0.56
query11	0.14	0.10	0.10
query12	0.13	0.12	0.11
query13	0.61	0.61	0.59
query14	2.84	2.72	2.76
query15	0.90	0.83	0.84
query16	0.39	0.38	0.38
query17	1.07	1.07	1.05
query18	0.23	0.20	0.20
query19	1.92	1.83	1.96
query20	0.02	0.01	0.02
query21	15.42	0.60	0.59
query22	2.50	2.21	2.38
query23	17.04	0.84	0.79
query24	2.58	0.94	1.52
query25	0.22	0.36	0.11
query26	0.32	0.14	0.14
query27	0.04	0.04	0.04
query28	10.59	1.10	1.08
query29	12.59	3.26	3.21
query30	0.25	0.06	0.05
query31	2.88	0.38	0.38
query32	3.28	0.48	0.47
query33	3.06	2.97	3.04
query34	16.79	4.48	4.44
query35	4.48	4.53	4.49
query36	0.68	0.50	0.51
query37	0.09	0.06	0.06
query38	0.04	0.03	0.04
query39	0.03	0.02	0.02
query40	0.16	0.12	0.12
query41	0.08	0.02	0.03
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.17 s
Total hot run time: 32.95 s

| DROP JOB (IF EXISTS)? wildWhere? #dropJob
| RESUME JOB wildWhere? #resumeJob
| CANCEL TASK wildWhere? #cancelJobTask
| PAUSE JOB WHERE (jobNameKey=STRING_LITERAL) EQ (jobNameValue=STRING_LITERAL) #pauseJob
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

jobNameKey is not a string literal. should be identifier

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

@LiBinfeng-01
Copy link
Collaborator Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40235 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5feed090d94b480e6db76d73aa2ac26a3e5f2260, data reload: false

------ Round 1 ----------------------------------
q1	17579	7460	7314	7314
q2	2041	183	170	170
q3	10558	1093	1169	1093
q4	10449	723	689	689
q5	7635	2712	2744	2712
q6	248	151	149	149
q7	997	631	599	599
q8	9250	1857	1866	1857
q9	6731	6567	6564	6564
q10	7051	2331	2379	2331
q11	467	283	269	269
q12	432	226	223	223
q13	17781	3061	2989	2989
q14	260	212	212	212
q15	587	547	535	535
q16	650	567	579	567
q17	1003	586	571	571
q18	7344	6759	6787	6759
q19	1343	972	927	927
q20	462	178	182	178
q21	4290	3237	3225	3225
q22	387	325	302	302
Total cold run time: 107545 ms
Total hot run time: 40235 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7229	7284	7231	7231
q2	330	243	234	234
q3	2927	2886	2894	2886
q4	2064	1803	1817	1803
q5	5702	5675	5680	5675
q6	229	143	147	143
q7	2241	1883	1784	1784
q8	3447	3569	3516	3516
q9	8996	9082	9031	9031
q10	3619	3624	3559	3559
q11	606	513	514	513
q12	813	582	609	582
q13	11529	3274	3209	3209
q14	307	296	275	275
q15	579	530	529	529
q16	705	641	643	641
q17	1879	1671	1630	1630
q18	8258	7800	7592	7592
q19	1715	1571	1649	1571
q20	2082	1895	1859	1859
q21	5622	5444	5482	5444
q22	662	578	559	559
Total cold run time: 71541 ms
Total hot run time: 60266 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197336 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5feed090d94b480e6db76d73aa2ac26a3e5f2260, data reload: false

query1	1264	956	965	956
query2	6258	2051	2070	2051
query3	10938	4369	4603	4369
query4	67377	28543	23548	23548
query5	5001	470	444	444
query6	403	188	189	188
query7	5520	307	298	298
query8	314	225	224	224
query9	8727	2737	2718	2718
query10	450	248	248	248
query11	16933	15169	16017	15169
query12	163	108	105	105
query13	1444	459	443	443
query14	9801	7257	7503	7257
query15	229	199	190	190
query16	7132	488	500	488
query17	1071	580	613	580
query18	1832	349	322	322
query19	205	165	163	163
query20	122	112	112	112
query21	216	146	102	102
query22	4697	4682	4544	4544
query23	34635	34334	34495	34334
query24	5516	2539	2443	2443
query25	506	384	379	379
query26	676	156	148	148
query27	2164	283	289	283
query28	4506	2533	2488	2488
query29	681	429	414	414
query30	211	144	147	144
query31	1004	834	836	834
query32	68	60	55	55
query33	398	292	290	290
query34	924	516	539	516
query35	907	776	771	771
query36	1092	963	969	963
query37	128	76	73	73
query38	4543	4255	4444	4255
query39	1669	1467	1505	1467
query40	205	102	98	98
query41	48	44	43	43
query42	119	104	100	100
query43	555	509	501	501
query44	1179	852	844	844
query45	195	169	170	169
query46	1198	741	748	741
query47	2050	1931	1930	1930
query48	429	331	362	331
query49	747	397	400	397
query50	877	401	406	401
query51	7435	7240	7128	7128
query52	99	85	87	85
query53	258	183	178	178
query54	507	396	397	396
query55	79	79	75	75
query56	247	241	240	240
query57	1218	1139	1110	1110
query58	205	209	220	209
query59	3200	2839	2913	2839
query60	272	244	239	239
query61	110	106	104	104
query62	797	657	676	657
query63	212	189	189	189
query64	1414	654	644	644
query65	3264	3251	3284	3251
query66	663	299	303	299
query67	16083	15754	15857	15754
query68	3765	580	581	580
query69	447	250	240	240
query70	1170	1129	1123	1123
query71	336	250	257	250
query72	6413	4044	4068	4044
query73	776	357	357	357
query74	10301	8887	9041	8887
query75	3408	2646	2674	2646
query76	1872	1108	1076	1076
query77	487	278	272	272
query78	10542	9498	9450	9450
query79	2132	613	610	610
query80	1383	428	422	422
query81	503	247	237	237
query82	1125	124	118	118
query83	168	152	157	152
query84	274	72	70	70
query85	1002	298	361	298
query86	382	297	293	293
query87	4661	4532	4664	4532
query88	3655	2233	2180	2180
query89	422	297	292	292
query90	2008	187	192	187
query91	132	103	111	103
query92	65	50	51	50
query93	2629	542	540	540
query94	812	287	342	287
query95	338	252	251	251
query96	627	289	277	277
query97	2859	2707	2673	2673
query98	213	204	194	194
query99	1601	1317	1328	1317
Total cold run time: 319898 ms
Total hot run time: 197336 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.78 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5feed090d94b480e6db76d73aa2ac26a3e5f2260, data reload: false

query1	0.04	0.03	0.02
query2	0.07	0.03	0.03
query3	0.23	0.07	0.07
query4	1.63	0.11	0.10
query5	0.41	0.39	0.42
query6	1.16	0.65	0.65
query7	0.02	0.02	0.02
query8	0.04	0.03	0.04
query9	0.58	0.51	0.53
query10	0.56	0.55	0.56
query11	0.14	0.10	0.11
query12	0.14	0.11	0.11
query13	0.60	0.61	0.60
query14	2.82	2.88	2.82
query15	0.90	0.83	0.84
query16	0.38	0.38	0.37
query17	1.05	1.01	1.08
query18	0.23	0.21	0.21
query19	1.98	1.89	2.00
query20	0.01	0.01	0.01
query21	15.38	0.57	0.60
query22	2.70	2.24	1.66
query23	17.27	0.85	0.76
query24	3.21	1.29	1.59
query25	0.35	0.12	0.08
query26	0.52	0.13	0.14
query27	0.04	0.04	0.04
query28	9.81	1.10	1.09
query29	12.54	3.20	3.23
query30	0.25	0.07	0.07
query31	2.87	0.40	0.38
query32	3.27	0.47	0.46
query33	3.04	3.01	3.04
query34	17.10	4.45	4.42
query35	4.53	4.52	4.52
query36	0.66	0.50	0.49
query37	0.09	0.06	0.05
query38	0.05	0.03	0.03
query39	0.03	0.02	0.02
query40	0.17	0.13	0.12
query41	0.07	0.02	0.02
query42	0.03	0.02	0.02
query43	0.03	0.04	0.03
Total cold run time: 107 s
Total hot run time: 32.78 s

@@ -59,36 +44,9 @@ public <R, C> R accept(PlanVisitor<R, C> visitor, C context) {

@Override
public void run(ConnectContext ctx, StmtExecutor executor) throws Exception {
validate();
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Did we miss the permission check?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes, mistoken delete

@LiBinfeng-01
Copy link
Collaborator Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40163 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1941723cb7d4adf1b62f0731847cd492e1db01b6, data reload: false

------ Round 1 ----------------------------------
q1	17713	7468	7309	7309
q2	2096	185	172	172
q3	10691	1130	1228	1130
q4	10422	769	693	693
q5	7597	2767	2756	2756
q6	238	149	157	149
q7	1022	672	622	622
q8	9260	1866	1968	1866
q9	6676	6516	6519	6516
q10	7045	2284	2283	2283
q11	472	266	258	258
q12	413	222	230	222
q13	17768	3084	3083	3083
q14	254	217	214	214
q15	565	540	521	521
q16	659	593	590	590
q17	989	534	586	534
q18	7517	6688	6605	6605
q19	1363	1010	1055	1010
q20	475	180	186	180
q21	4153	3142	3398	3142
q22	382	308	318	308
Total cold run time: 107770 ms
Total hot run time: 40163 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7361	7286	7282	7282
q2	323	228	233	228
q3	2934	2929	3114	2929
q4	2130	1815	1833	1815
q5	5582	5725	5645	5645
q6	223	142	143	142
q7	2222	1802	1847	1802
q8	3390	3501	3538	3501
q9	8990	9032	9110	9032
q10	3600	3579	3531	3531
q11	595	505	525	505
q12	816	625	608	608
q13	12280	3159	3230	3159
q14	304	275	255	255
q15	558	519	509	509
q16	674	626	629	626
q17	1828	1602	1556	1556
q18	7764	7503	7299	7299
q19	1656	1485	1569	1485
q20	2068	1809	1823	1809
q21	5483	5270	5325	5270
q22	628	560	559	559
Total cold run time: 71409 ms
Total hot run time: 59547 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191123 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 1941723cb7d4adf1b62f0731847cd492e1db01b6, data reload: false

query1	1196	390	390	390
query2	6537	2082	1974	1974
query3	6711	213	214	213
query4	34014	23927	23453	23453
query5	4398	463	454	454
query6	302	196	188	188
query7	4631	294	299	294
query8	314	250	221	221
query9	9466	2687	2687	2687
query10	468	242	241	241
query11	18176	15187	15277	15187
query12	151	104	99	99
query13	1648	403	386	386
query14	10157	7267	7436	7267
query15	270	180	177	177
query16	7624	492	477	477
query17	1691	595	578	578
query18	1483	307	321	307
query19	368	150	152	150
query20	114	108	107	107
query21	209	99	99	99
query22	4605	4387	4214	4214
query23	34966	34061	34282	34061
query24	10356	2379	2470	2379
query25	631	371	376	371
query26	1220	152	151	151
query27	2612	289	280	280
query28	7797	2445	2436	2436
query29	791	396	411	396
query30	292	151	150	150
query31	1045	813	827	813
query32	90	55	55	55
query33	758	328	285	285
query34	934	503	524	503
query35	847	753	741	741
query36	1092	938	963	938
query37	148	76	73	73
query38	4408	4192	4189	4189
query39	1479	1470	1410	1410
query40	198	101	97	97
query41	46	42	43	42
query42	110	101	104	101
query43	538	507	476	476
query44	1270	802	790	790
query45	192	173	163	163
query46	1149	678	707	678
query47	1931	1876	1836	1836
query48	394	317	313	313
query49	1157	413	381	381
query50	812	383	377	377
query51	7226	6948	6985	6948
query52	97	90	87	87
query53	255	181	179	179
query54	1116	394	415	394
query55	82	79	79	79
query56	278	249	263	249
query57	1249	1130	1104	1104
query58	236	231	241	231
query59	3117	2949	3024	2949
query60	301	250	250	250
query61	111	109	109	109
query62	870	679	683	679
query63	222	187	181	181
query64	4593	688	640	640
query65	3330	3213	3235	3213
query66	1347	318	319	318
query67	16000	15698	15665	15665
query68	4067	568	560	560
query69	415	251	242	242
query70	1200	1152	1157	1152
query71	326	258	244	244
query72	6456	4342	4212	4212
query73	776	363	371	363
query74	10069	9096	8900	8900
query75	3392	2616	2650	2616
query76	2678	1089	1097	1089
query77	446	265	289	265
query78	10339	9476	9571	9476
query79	2551	605	616	605
query80	1149	429	518	429
query81	541	245	229	229
query82	680	116	113	113
query83	246	143	141	141
query84	236	67	75	67
query85	1497	308	299	299
query86	458	304	300	300
query87	4720	4511	4701	4511
query88	3959	2235	2187	2187
query89	411	308	297	297
query90	2102	188	182	182
query91	145	105	111	105
query92	67	52	53	52
query93	1445	545	545	545
query94	985	283	280	280
query95	343	252	250	250
query96	615	275	291	275
query97	2828	2723	2704	2704
query98	263	191	191	191
query99	1597	1319	1357	1319
Total cold run time: 299228 ms
Total hot run time: 191123 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.34 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 1941723cb7d4adf1b62f0731847cd492e1db01b6, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.03	0.04
query3	0.24	0.08	0.07
query4	1.61	0.10	0.11
query5	0.42	0.42	0.38
query6	1.17	0.65	0.66
query7	0.02	0.02	0.02
query8	0.03	0.04	0.03
query9	0.57	0.50	0.52
query10	0.56	0.55	0.54
query11	0.14	0.10	0.10
query12	0.16	0.12	0.11
query13	0.61	0.61	0.60
query14	2.74	2.74	2.78
query15	0.90	0.83	0.83
query16	0.38	0.40	0.40
query17	1.09	1.06	1.01
query18	0.23	0.21	0.21
query19	1.93	2.06	1.91
query20	0.02	0.01	0.01
query21	15.35	0.56	0.56
query22	2.39	1.72	1.79
query23	17.25	0.94	0.86
query24	3.22	1.60	0.65
query25	0.28	0.05	0.07
query26	0.47	0.15	0.14
query27	0.07	0.04	0.04
query28	10.54	1.10	1.09
query29	12.58	3.22	3.25
query30	0.26	0.07	0.07
query31	2.86	0.39	0.40
query32	3.24	0.46	0.46
query33	3.01	3.05	3.04
query34	17.10	4.49	4.50
query35	4.50	4.59	4.49
query36	0.67	0.48	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.03
query40	0.17	0.14	0.13
query41	0.08	0.02	0.02
query42	0.04	0.02	0.03
query43	0.04	0.03	0.03
Total cold run time: 107.21 s
Total hot run time: 32.34 s

@LiBinfeng-01
Copy link
Collaborator Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39688 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1f92321d8079a4d6f13a0b11b981af3fd47f8323, data reload: false

------ Round 1 ----------------------------------
q1	17572	7450	7248	7248
q2	2055	180	166	166
q3	10551	1142	1122	1122
q4	10230	745	688	688
q5	7614	2647	2634	2634
q6	236	147	145	145
q7	993	623	616	616
q8	9262	1853	1941	1853
q9	6726	6508	6441	6441
q10	6966	2278	2304	2278
q11	456	264	249	249
q12	402	216	224	216
q13	17772	3066	3045	3045
q14	245	202	214	202
q15	569	534	528	528
q16	633	583	603	583
q17	982	599	530	530
q18	7405	6661	6614	6614
q19	1335	999	927	927
q20	473	180	178	178
q21	4175	3317	3102	3102
q22	391	323	327	323
Total cold run time: 107043 ms
Total hot run time: 39688 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7243	7266	7207	7207
q2	335	232	232	232
q3	2902	2760	2945	2760
q4	2116	1855	1828	1828
q5	5533	5655	5619	5619
q6	221	140	138	138
q7	2223	1791	1808	1791
q8	3352	3570	3487	3487
q9	8992	8981	8961	8961
q10	3613	3570	3532	3532
q11	621	509	496	496
q12	830	626	592	592
q13	12805	3271	3206	3206
q14	296	268	273	268
q15	573	525	529	525
q16	670	615	623	615
q17	1774	1566	1565	1565
q18	7862	7458	7427	7427
q19	1647	1559	1568	1559
q20	2028	1840	1794	1794
q21	5418	5176	5219	5176
q22	633	588	588	588
Total cold run time: 71687 ms
Total hot run time: 59366 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 189460 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 1f92321d8079a4d6f13a0b11b981af3fd47f8323, data reload: false

query1	960	384	370	370
query2	6521	2072	2016	2016
query3	6711	216	212	212
query4	34060	23637	23450	23450
query5	4398	458	440	440
query6	282	180	202	180
query7	4646	291	311	291
query8	299	243	214	214
query9	9751	2669	2691	2669
query10	467	243	242	242
query11	18235	15245	15177	15177
query12	147	99	105	99
query13	1640	396	377	377
query14	9625	6418	6372	6372
query15	254	172	182	172
query16	8042	469	431	431
query17	1617	571	546	546
query18	2113	297	300	297
query19	233	159	155	155
query20	120	111	118	111
query21	213	102	102	102
query22	4384	4397	4342	4342
query23	34811	33790	34342	33790
query24	11329	2427	2576	2427
query25	692	407	395	395
query26	1751	154	155	154
query27	2933	281	287	281
query28	8071	2438	2432	2432
query29	1028	421	442	421
query30	303	149	148	148
query31	1015	826	833	826
query32	97	54	56	54
query33	772	285	284	284
query34	1004	491	514	491
query35	888	806	753	753
query36	1122	955	923	923
query37	162	79	70	70
query38	4364	4177	4224	4177
query39	1468	1400	1428	1400
query40	286	99	96	96
query41	47	42	43	42
query42	111	96	98	96
query43	527	486	488	486
query44	1299	817	798	798
query45	187	162	173	162
query46	1153	708	704	704
query47	1966	1886	1869	1869
query48	394	303	327	303
query49	1262	378	380	378
query50	807	387	370	370
query51	7339	7134	6995	6995
query52	99	90	91	90
query53	254	185	180	180
query54	1195	402	395	395
query55	79	75	73	73
query56	264	228	248	228
query57	1239	1099	1149	1099
query58	235	214	210	210
query59	3287	2873	2991	2873
query60	260	255	240	240
query61	113	106	111	106
query62	909	669	662	662
query63	215	187	182	182
query64	5234	647	619	619
query65	3285	3190	3292	3190
query66	1429	294	310	294
query67	15915	15794	15751	15751
query68	4949	539	527	527
query69	429	251	265	251
query70	1240	1078	1131	1078
query71	335	251	243	243
query72	6419	4025	3877	3877
query73	765	351	363	351
query74	10444	9094	9024	9024
query75	3451	2660	2645	2645
query76	2915	1083	1065	1065
query77	426	261	263	261
query78	10380	9391	9447	9391
query79	1616	592	586	586
query80	1090	427	419	419
query81	518	239	235	235
query82	937	120	166	120
query83	240	142	145	142
query84	232	71	71	71
query85	1308	294	295	294
query86	363	303	304	303
query87	4740	4590	4529	4529
query88	3504	2196	2166	2166
query89	402	289	292	289
query90	2063	188	183	183
query91	138	101	103	101
query92	57	51	54	51
query93	1094	568	522	522
query94	1043	291	294	291
query95	341	240	243	240
query96	610	287	274	274
query97	2843	2653	2652	2652
query98	223	191	188	188
query99	1559	1309	1311	1309
Total cold run time: 302592 ms
Total hot run time: 189460 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.37 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 1f92321d8079a4d6f13a0b11b981af3fd47f8323, data reload: false

query1	0.04	0.03	0.03
query2	0.06	0.03	0.03
query3	0.23	0.08	0.07
query4	1.59	0.10	0.10
query5	0.43	0.39	0.41
query6	1.17	0.65	0.65
query7	0.02	0.01	0.01
query8	0.04	0.03	0.04
query9	0.58	0.51	0.51
query10	0.56	0.55	0.56
query11	0.13	0.10	0.11
query12	0.13	0.11	0.11
query13	0.60	0.60	0.60
query14	2.80	2.82	2.70
query15	0.90	0.82	0.83
query16	0.40	0.39	0.38
query17	1.04	1.05	0.98
query18	0.23	0.21	0.22
query19	1.96	1.84	2.03
query20	0.01	0.02	0.01
query21	15.36	0.60	0.60
query22	2.30	2.53	2.37
query23	17.32	0.84	0.80
query24	3.45	1.26	1.22
query25	0.32	0.21	0.25
query26	0.44	0.14	0.13
query27	0.03	0.04	0.04
query28	10.07	1.10	1.06
query29	12.60	3.27	3.28
query30	0.24	0.06	0.06
query31	2.86	0.39	0.37
query32	3.28	0.46	0.46
query33	2.99	3.03	3.03
query34	17.01	4.43	4.46
query35	4.53	4.42	4.49
query36	0.66	0.48	0.48
query37	0.09	0.06	0.06
query38	0.05	0.04	0.03
query39	0.04	0.02	0.02
query40	0.17	0.13	0.14
query41	0.07	0.02	0.03
query42	0.04	0.02	0.02
query43	0.04	0.03	0.02
Total cold run time: 106.88 s
Total hot run time: 33.37 s

CalvinKirs
CalvinKirs previously approved these changes Dec 11, 2024
starocean999
starocean999 previously approved these changes Dec 11, 2024
@LiBinfeng-01 LiBinfeng-01 dismissed stale reviews from starocean999 and CalvinKirs via c32dabf December 11, 2024 06:37
@LiBinfeng-01
Copy link
Collaborator Author

run p0

@@ -770,41 +770,38 @@ public LogicalPlan visitCreateScheduledJob(DorisParser.CreateScheduledJobContext
return new CreateJobCommand(createJobInfo);
}

private void checkJobNameKey(String key, String keyFormat) {
if (key.isEmpty() || !key.equalsIgnoreCase(keyFormat)) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why add key.isEmpty()?

@@ -770,41 +770,38 @@ public LogicalPlan visitCreateScheduledJob(DorisParser.CreateScheduledJobContext
return new CreateJobCommand(createJobInfo);
}

private void checkJobNameKey(String key, String keyFormat) {
if (key.isEmpty() || !key.equalsIgnoreCase(keyFormat)) {
throw new ParseException(keyFormat + " should be: '" + keyFormat + "'");
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

error message is not very clear, we should use ParseException with Origin, or different statement use different error message to let user could know the error reason easily

Comment on lines 800 to 801
checkJobNameKey(stripQuotes(ctx.jobNameKey.getText()), "jobName");
checkJobNameKey(stripQuotes(ctx.taskIdKey.getText()), "taskId");
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i don't think must write jobName before taskId is a good idea. since we use where here, we should support jobName = xxx and taskId = xx and taskId = xx and jobName = xxx

@LiBinfeng-01
Copy link
Collaborator Author

run buildall

1 similar comment
@LiBinfeng-01
Copy link
Collaborator Author

run buildall

@LiBinfeng-01
Copy link
Collaborator Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32409 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a783a59232f8054169d663bbc2925fdcf9b9274c, data reload: false

------ Round 1 ----------------------------------
q1	17608	5651	5441	5441
q2	2050	303	171	171
q3	10565	1280	743	743
q4	10294	977	535	535
q5	8757	2448	2171	2171
q6	198	166	137	137
q7	906	773	622	622
q8	9235	1377	1238	1238
q9	5313	4908	4848	4848
q10	6834	2355	1883	1883
q11	481	281	267	267
q12	352	365	224	224
q13	17774	3758	3100	3100
q14	239	224	218	218
q15	512	476	462	462
q16	627	605	587	587
q17	586	875	326	326
q18	7101	6519	6392	6392
q19	3137	965	538	538
q20	309	328	190	190
q21	2946	2259	2003	2003
q22	369	335	313	313
Total cold run time: 106193 ms
Total hot run time: 32409 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5655	5459	5502	5459
q2	247	343	243	243
q3	2275	2677	2344	2344
q4	1427	1828	1409	1409
q5	4314	4798	4932	4798
q6	183	162	131	131
q7	2059	2047	1822	1822
q8	2632	2769	2738	2738
q9	7261	7195	7176	7176
q10	3006	3296	2819	2819
q11	582	520	485	485
q12	677	789	613	613
q13	3576	3970	3268	3268
q14	270	300	277	277
q15	514	489	458	458
q16	657	710	661	661
q17	1290	1745	1304	1304
q18	7646	7461	7348	7348
q19	821	1176	1048	1048
q20	2025	2110	1880	1880
q21	5767	5293	4902	4902
q22	625	598	575	575
Total cold run time: 53509 ms
Total hot run time: 51758 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 188210 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a783a59232f8054169d663bbc2925fdcf9b9274c, data reload: false

query1	977	374	381	374
query2	6527	2056	1954	1954
query3	6783	223	217	217
query4	33471	23798	23286	23286
query5	4324	614	436	436
query6	266	186	205	186
query7	4605	493	309	309
query8	293	232	213	213
query9	9639	2583	2579	2579
query10	476	314	266	266
query11	18038	15312	15314	15312
query12	156	107	102	102
query13	1641	502	382	382
query14	9134	7603	7568	7568
query15	272	196	190	190
query16	8038	626	475	475
query17	1633	757	563	563
query18	2059	396	305	305
query19	219	185	157	157
query20	116	110	119	110
query21	215	123	103	103
query22	4379	4173	4078	4078
query23	34085	32947	33119	32947
query24	6448	2313	2372	2313
query25	535	520	376	376
query26	1191	276	153	153
query27	1993	462	334	334
query28	5385	2406	2397	2397
query29	717	548	407	407
query30	232	187	159	159
query31	950	900	792	792
query32	85	64	59	59
query33	522	368	301	301
query34	813	838	507	507
query35	798	828	732	732
query36	1002	1017	962	962
query37	117	103	79	79
query38	4146	4158	4037	4037
query39	1456	1441	1602	1441
query40	211	115	108	108
query41	54	51	53	51
query42	143	103	105	103
query43	514	504	491	491
query44	1305	812	813	812
query45	178	181	162	162
query46	861	1057	640	640
query47	1813	1850	1775	1775
query48	378	396	311	311
query49	791	479	395	395
query50	621	661	377	377
query51	7026	6949	6645	6645
query52	102	106	95	95
query53	222	249	183	183
query54	497	485	426	426
query55	87	80	81	80
query56	289	261	259	259
query57	1159	1153	1070	1070
query58	250	229	257	229
query59	3085	3060	2882	2882
query60	273	262	244	244
query61	121	117	113	113
query62	816	724	647	647
query63	227	191	190	190
query64	4436	1010	646	646
query65	3239	3227	3164	3164
query66	1083	415	314	314
query67	16213	15667	15519	15519
query68	4725	832	535	535
query69	467	296	267	267
query70	1184	1106	1112	1106
query71	399	281	271	271
query72	5804	3847	3828	3828
query73	648	755	367	367
query74	10288	9232	8795	8795
query75	3242	3173	2644	2644
query76	3213	1178	771	771
query77	457	380	284	284
query78	9953	10077	9384	9384
query79	2895	792	607	607
query80	662	528	422	422
query81	506	280	237	237
query82	223	151	123	123
query83	178	173	150	150
query84	247	101	69	69
query85	738	412	312	312
query86	400	325	292	292
query87	4564	4540	4401	4401
query88	5104	2150	2100	2100
query89	395	335	304	304
query90	2003	188	188	188
query91	130	134	105	105
query92	67	60	59	59
query93	2362	896	523	523
query94	664	415	293	293
query95	326	267	253	253
query96	494	622	280	280
query97	2760	2875	2699	2699
query98	239	202	205	202
query99	1305	1348	1247	1247
Total cold run time: 286372 ms
Total hot run time: 188210 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.9 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a783a59232f8054169d663bbc2925fdcf9b9274c, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.04	0.03
query3	0.24	0.07	0.07
query4	1.61	0.11	0.11
query5	0.41	0.41	0.42
query6	1.15	0.65	0.65
query7	0.02	0.01	0.02
query8	0.04	0.04	0.03
query9	0.59	0.50	0.51
query10	0.55	0.57	0.54
query11	0.14	0.10	0.11
query12	0.13	0.11	0.11
query13	0.62	0.61	0.60
query14	2.72	2.80	2.85
query15	0.89	0.83	0.81
query16	0.38	0.39	0.38
query17	1.00	1.02	1.02
query18	0.22	0.21	0.21
query19	1.81	1.81	1.99
query20	0.02	0.01	0.01
query21	15.38	0.97	0.57
query22	0.75	0.98	0.73
query23	15.05	1.39	0.51
query24	2.60	1.15	1.95
query25	0.13	0.15	0.14
query26	0.26	0.15	0.14
query27	0.05	0.06	0.04
query28	14.18	1.01	0.42
query29	12.66	3.92	3.25
query30	0.25	0.10	0.06
query31	2.81	0.61	0.38
query32	3.23	0.56	0.45
query33	3.14	3.02	3.09
query34	16.27	5.17	4.49
query35	4.61	4.54	4.58
query36	0.66	0.50	0.48
query37	0.09	0.06	0.05
query38	0.05	0.04	0.04
query39	0.04	0.02	0.02
query40	0.16	0.13	0.13
query41	0.08	0.03	0.02
query42	0.04	0.02	0.03
query43	0.04	0.03	0.02
Total cold run time: 105.18 s
Total hot run time: 30.9 s

@LiBinfeng-01
Copy link
Collaborator Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32375 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 90209ad5163e52c71f9daf8bb2e9fbac44f04d77, data reload: false

------ Round 1 ----------------------------------
q1	17615	5563	5402	5402
q2	2054	311	169	169
q3	10409	1331	747	747
q4	10227	975	547	547
q5	7558	2396	2217	2217
q6	190	172	135	135
q7	897	776	603	603
q8	9242	1377	1150	1150
q9	5274	4911	4906	4906
q10	6837	2335	1918	1918
q11	459	277	255	255
q12	346	358	219	219
q13	17777	3707	3091	3091
q14	241	245	231	231
q15	511	463	460	460
q16	622	636	600	600
q17	574	862	340	340
q18	7261	6463	6331	6331
q19	1231	945	537	537
q20	314	329	191	191
q21	2801	2215	2011	2011
q22	373	328	315	315
Total cold run time: 102813 ms
Total hot run time: 32375 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5495	5520	5515	5515
q2	250	335	237	237
q3	2300	2658	2392	2392
q4	1411	1855	1374	1374
q5	4329	4757	4787	4757
q6	179	169	133	133
q7	2105	1979	1901	1901
q8	2635	2777	2707	2707
q9	7326	7257	7262	7257
q10	3013	3280	2798	2798
q11	592	507	501	501
q12	700	776	619	619
q13	3512	3983	3341	3341
q14	292	291	273	273
q15	547	476	462	462
q16	665	697	644	644
q17	1199	1715	1264	1264
q18	7687	7493	7295	7295
q19	755	1100	1083	1083
q20	2015	2047	1894	1894
q21	5794	5228	4820	4820
q22	614	610	590	590
Total cold run time: 53415 ms
Total hot run time: 51857 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 188201 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 90209ad5163e52c71f9daf8bb2e9fbac44f04d77, data reload: false

query1	967	392	374	374
query2	6518	2057	2022	2022
query3	6791	219	209	209
query4	33502	23400	23141	23141
query5	4394	645	480	480
query6	294	234	195	195
query7	4594	503	304	304
query8	282	231	228	228
query9	9362	2585	2587	2585
query10	475	316	249	249
query11	17893	15182	15230	15182
query12	174	114	108	108
query13	1654	549	408	408
query14	9267	7738	7010	7010
query15	248	194	181	181
query16	8110	629	451	451
query17	1615	729	547	547
query18	2119	394	286	286
query19	216	178	153	153
query20	117	107	105	105
query21	206	129	104	104
query22	4196	4313	4175	4175
query23	33971	33349	32606	32606
query24	6465	2337	2334	2334
query25	488	452	385	385
query26	1196	274	156	156
query27	2016	467	337	337
query28	5316	2427	2415	2415
query29	753	553	414	414
query30	231	186	164	164
query31	953	868	809	809
query32	92	63	61	61
query33	544	357	300	300
query34	746	847	517	517
query35	804	810	753	753
query36	1005	1042	924	924
query37	117	107	81	81
query38	4097	4227	4158	4158
query39	1425	1418	1416	1416
query40	210	120	102	102
query41	53	54	52	52
query42	120	104	100	100
query43	506	518	483	483
query44	1293	813	811	811
query45	183	170	167	167
query46	870	1044	653	653
query47	1819	1845	1786	1786
query48	383	391	314	314
query49	789	485	428	428
query50	624	659	396	396
query51	6916	6975	6952	6952
query52	103	103	94	94
query53	226	253	188	188
query54	487	492	419	419
query55	80	84	81	81
query56	275	274	245	245
query57	1202	1168	1084	1084
query58	254	232	236	232
query59	3127	2954	3018	2954
query60	288	272	254	254
query61	122	120	117	117
query62	780	724	667	667
query63	233	189	190	189
query64	4632	1113	768	768
query65	3242	3148	3189	3148
query66	1071	430	336	336
query67	15890	15724	15368	15368
query68	4296	857	546	546
query69	463	317	269	269
query70	1216	1132	1122	1122
query71	387	294	260	260
query72	5927	3811	3846	3811
query73	661	755	363	363
query74	9912	9179	8904	8904
query75	3171	3192	2674	2674
query76	3204	1195	772	772
query77	474	376	300	300
query78	10033	9992	9356	9356
query79	3984	805	583	583
query80	697	530	461	461
query81	521	298	240	240
query82	706	158	121	121
query83	180	172	154	154
query84	247	91	84	84
query85	807	365	303	303
query86	404	311	280	280
query87	4604	4542	4505	4505
query88	4904	2150	2142	2142
query89	401	332	284	284
query90	1768	195	203	195
query91	136	144	108	108
query92	69	56	54	54
query93	2652	921	529	529
query94	698	386	298	298
query95	342	281	266	266
query96	489	623	283	283
query97	2788	2842	2758	2758
query98	234	205	201	201
query99	1316	1419	1260	1260
Total cold run time: 286682 ms
Total hot run time: 188201 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.13 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 90209ad5163e52c71f9daf8bb2e9fbac44f04d77, data reload: false

query1	0.04	0.04	0.06
query2	0.08	0.03	0.03
query3	0.24	0.07	0.07
query4	1.63	0.10	0.10
query5	0.44	0.42	0.40
query6	1.17	0.65	0.67
query7	0.02	0.02	0.02
query8	0.04	0.03	0.04
query9	0.59	0.50	0.51
query10	0.56	0.57	0.55
query11	0.14	0.10	0.10
query12	0.15	0.11	0.11
query13	0.62	0.60	0.59
query14	2.71	2.72	2.79
query15	0.88	0.82	0.84
query16	0.38	0.38	0.38
query17	1.07	1.07	1.00
query18	0.22	0.22	0.21
query19	1.98	1.85	2.02
query20	0.02	0.01	0.02
query21	15.35	0.92	0.57
query22	0.76	0.90	0.63
query23	15.24	1.41	0.54
query24	3.02	1.39	0.50
query25	0.25	0.12	0.06
query26	0.25	0.15	0.13
query27	0.06	0.07	0.05
query28	13.26	1.00	0.43
query29	12.56	3.90	3.25
query30	0.25	0.08	0.06
query31	2.83	0.60	0.38
query32	3.24	0.55	0.46
query33	3.00	3.02	3.00
query34	16.61	5.17	4.57
query35	4.56	4.58	4.55
query36	0.64	0.48	0.50
query37	0.09	0.06	0.05
query38	0.05	0.04	0.03
query39	0.04	0.02	0.02
query40	0.17	0.14	0.13
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.02
Total cold run time: 105.36 s
Total hot run time: 30.13 s

Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jan 22, 2025
Copy link
Contributor

PR approved by anyone and no changes requested.

@LiBinfeng-01
Copy link
Collaborator Author

run feut

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants