Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[test](nereids)add SimplifyCastRule test case #26708

Merged
merged 4 commits into from
Jan 29, 2024
Merged

[test](nereids)add SimplifyCastRule test case #26708

merged 4 commits into from
Jan 29, 2024

Conversation

starocean999
Copy link
Contributor

@starocean999 starocean999 commented Nov 9, 2023 •
edited
Loading

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@starocean999
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 44.38 seconds
stream load tsv: 554 seconds loaded 74807831229 Bytes, about 128 MB/s
stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.9 seconds inserted 10000000 Rows, about 346K ops/s
storage size: 17162134334 Bytes

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' 
Tpch sf100 test result on commit 447244f95f3567476c495ba44338749680c50e16, data reload: false

run tpch-sf100 query with default conf and session variables
q1	5231	5091	5068	5068
q2	369	190	199	190
q3	2121	2052	2100	2052
q4	1492	1440	1424	1424
q5	4090	4120	4134	4120
q6	260	136	133	133
q7	2078	1601	1625	1601
q8	2777	2754	2756	2754
q9	10526	10242	10260	10242
q10	3513	3573	3558	3558
q11	379	243	254	243
q12	460	295	292	292
q13	4532	4158	4111	4111
q14	336	291	300	291
q15	660	573	566	566
q16	706	622	608	608
q17	1145	1107	1085	1085
q18	7751	7443	7326	7326
q19	1691	1745	1711	1711
q20	596	350	344	344
q21	4985	4592	4586	4586
q22	523	435	428	428
Total cold run time: 56221 ms
Total hot run time: 52733 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	5034	5041	5140	5041
q2	334	276	252	252
q3	3998	3965	3935	3935
q4	2812	2769	2768	2768
q5	6483	6500	6463	6463
q6	248	128	126	126
q7	3120	2680	2739	2680
q8	4796	4746	4709	4709
q9	17762	17655	17717	17655
q10	4072	4155	4168	4155
q11	755	680	658	658
q12	1000	842	837	837
q13	4347	3912	3897	3897
q14	378	363	353	353
q15	614	560	581	560
q16	788	701	708	701
q17	3917	3943	3864	3864
q18	9586	9231	9197	9197
q19	1891	1784	1812	1784
q20	2387	2035	2026	2026
q21	8786	8721	8711	8711
q22	952	911	852	852
Total cold run time: 84060 ms
Total hot run time: 81224 ms

@morrySnow morrySnow changed the title [Test](nereids)add fe ut [test](nereids)add SimplifyArithmeticComparisonRule and SimplifyCastRule test case Nov 10, 2023
@starocean999 starocean999 changed the title [test](nereids)add SimplifyArithmeticComparisonRule and SimplifyCastRule test case [test](nereids)add SimplifyCastRule test case Nov 13, 2023
@starocean999
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' 
Tpch sf100 test result on commit 05df020a36d80bc3232d69539582693dd0a2e332, data reload: false

run tpch-sf100 query with default conf and session variables
q1	5311	5103	5206	5103
q2	355	161	159	159
q3	2034	1985	1982	1982
q4	1403	1336	1377	1336
q5	3988	3989	3961	3961
q6	259	129	133	129
q7	1452	895	899	895
q8	2767	2811	2768	2768
q9	9779	9554	9352	9352
q10	3475	3556	3544	3544
q11	396	254	252	252
q12	478	287	281	281
q13	4598	4178	4166	4166
q14	320	281	289	281
q15	643	592	558	558
q16	687	593	584	584
q17	1134	1083	1071	1071
q18	8053	7624	7516	7516
q19	1683	1673	1691	1673
q20	538	305	293	293
q21	4684	4341	4371	4341
q22	521	422	420	420
Total cold run time: 54558 ms
Total hot run time: 50665 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	5059	5098	5041	5041
q2	358	229	239	229
q3	4102	4019	3968	3968
q4	2832	2759	2769	2759
q5	9730	9615	9583	9583
q6	246	127	122	122
q7	3104	2512	2557	2512
q8	4865	4797	4851	4797
q9	13109	12933	12986	12933
q10	4094	4187	4189	4187
q11	775	653	689	653
q12	990	855	870	855
q13	4282	3915	3886	3886
q14	397	344	349	344
q15	618	567	550	550
q16	777	743	721	721
q17	3919	3871	3842	3842
q18	9655	9563	9714	9563
q19	1914	1794	1758	1758
q20	2413	2112	2043	2043
q21	9091	8897	8940	8897
q22	970	857	841	841
Total cold run time: 83300 ms
Total hot run time: 80084 ms

@doris-robot
Copy link

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 45.2 seconds
stream load tsv: 553 seconds loaded 74807831229 Bytes, about 129 MB/s
stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.9 seconds inserted 10000000 Rows, about 346K ops/s
storage size: 17162317599 Bytes

@starocean999
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 44.8 seconds
stream load tsv: 553 seconds loaded 74807831229 Bytes, about 129 MB/s
stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.7 seconds inserted 10000000 Rows, about 348K ops/s
storage size: 17094749649 Bytes

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' 
Tpch sf100 test result on commit c9067209ebc3b9df2deafbb9e68f616863216bdb, data reload: false

run tpch-sf100 query with default conf and session variables
q1	5304	5156	5160	5156
q2	356	158	158	158
q3	2036	2020	1978	1978
q4	1399	1381	1363	1363
q5	3952	3939	3979	3939
q6	252	133	132	132
q7	1487	890	905	890
q8	2788	2784	2765	2765
q9	9683	9545	9619	9545
q10	3442	3555	3513	3513
q11	381	254	250	250
q12	427	279	287	279
q13	4576	4125	4105	4105
q14	314	284	293	284
q15	622	557	549	549
q16	670	580	583	580
q17	1133	1074	1091	1074
q18	8089	7670	7653	7653
q19	1677	1705	1665	1665
q20	534	304	309	304
q21	4685	4315	4355	4315
q22	514	398	418	398
Total cold run time: 54321 ms
Total hot run time: 50895 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	5032	5020	4992	4992
q2	334	239	227	227
q3	4108	4047	3994	3994
q4	2786	2760	2763	2760
q5	9807	9766	9770	9766
q6	240	123	122	122
q7	3025	2488	2484	2484
q8	4887	4883	4898	4883
q9	13273	13224	13083	13083
q10	4070	4194	4182	4182
q11	755	625	633	625
q12	985	801	820	801
q13	4276	3849	3865	3849
q14	379	344	340	340
q15	645	570	525	525
q16	749	711	677	677
q17	3865	3894	3895	3894
q18	9631	9400	9486	9400
q19	1836	1791	1773	1773
q20	2422	2037	2039	2037
q21	8919	8748	8715	8715
q22	986	869	844	844
Total cold run time: 83010 ms
Total hot run time: 79973 ms

@starocean999
Copy link
Contributor Author

run buildall

@starocean999
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 43.61 seconds
stream load tsv: 571 seconds loaded 74807831229 Bytes, about 124 MB/s
stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.9 seconds inserted 10000000 Rows, about 346K ops/s
storage size: 17162735907 Bytes

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' 
Tpch sf100 test result on commit e9b8cb942116ff1861e9356e80a29c045ba2c82b, data reload: false

run tpch-sf100 query with default conf and session variables
q1	4885	4680	4670	4670
q2	348	166	159	159
q3	1511	1303	1273	1273
q4	1145	964	944	944
q5	3218	3227	3221	3221
q6	247	134	128	128
q7	1009	508	562	508
q8	2245	2256	2224	2224
q9	6931	6933	6911	6911
q10	3298	3370	3372	3370
q11	334	207	208	207
q12	349	218	212	212
q13	4667	3837	3905	3837
q14	247	213	209	209
q15	592	533	524	524
q16	413	401	382	382
q17	1022	669	612	612
q18	8056	8430	7548	7548
q19	1547	1539	1533	1533
q20	1426	331	307	307
q21	3413	2968	2935	2935
q22	361	298	300	298
Total cold run time: 47264 ms
Total hot run time: 42012 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	4578	4568	4561	4561
q2	329	199	229	199
q3	3727	3748	3741	3741
q4	2511	2505	2504	2504
q5	6202	6173	6183	6173
q6	244	121	123	121
q7	2573	1952	1993	1952
q8	3733	3659	3634	3634
q9	9513	9458	9388	9388
q10	4055	4134	4136	4134
q11	623	525	491	491
q12	813	615	617	615
q13	4371	3603	3619	3603
q14	279	249	249	249
q15	587	526	527	526
q16	495	516	493	493
q17	2071	2027	2046	2027
q18	9440	8884	9040	8884
q19	1809	1778	1765	1765
q20	2308	1996	1998	1996
q21	7380	6828	6840	6828
q22	624	546	558	546
Total cold run time: 68265 ms
Total hot run time: 64430 ms

@starocean999
Copy link
Contributor Author

run buildall

@starocean999
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38781 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 948ef9885fc850ed2a736e93c4b6448c283a13f8, data reload: false

------ Round 1 ----------------------------------
q1	17895	5246	5382	5246
q2	2225	136	137	136
q3	11410	1160	1182	1160
q4	10469	753	817	753
q5	8134	3220	3176	3176
q6	207	123	121	121
q7	865	510	471	471
q8	9271	1937	1964	1937
q9	7296	6343	6396	6343
q10	8191	3005	3067	3005
q11	411	200	195	195
q12	351	191	186	186
q13	17974	3336	3379	3336
q14	238	212	216	212
q15	547	508	494	494
q16	423	370	365	365
q17	937	555	490	490
q18	7486	6906	6862	6862
q19	1573	1422	1305	1305
q20	569	317	277	277
q21	2846	2400	2428	2400
q22	359	312	311	311
Total cold run time: 109677 ms
Total hot run time: 38781 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5495	5275	5177	5177
q2	332	221	209	209
q3	3345	3252	3233	3233
q4	2109	2013	2037	2013
q5	6027	5971	5948	5948
q6	192	121	117	117
q7	2339	1935	1838	1838
q8	3220	3399	3409	3399
q9	8920	8783	8826	8783
q10	3902	3825	3869	3825
q11	561	442	455	442
q12	820	603	637	603
q13	16921	3178	3158	3158
q14	281	256	274	256
q15	554	508	496	496
q16	511	464	483	464
q17	1897	1810	1862	1810
q18	9602	19380	9637	9637
q19	24254	1559	1538	1538
q20	4623	1930	1933	1930
q21	14466	5436	5379	5379
q22	970	523	506	506
Total cold run time: 111341 ms
Total hot run time: 60761 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 185570 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 948ef9885fc850ed2a736e93c4b6448c283a13f8, data reload: false

query1	938	332	332	332
query2	6558	1963	1881	1881
query3	6694	198	195	195
query4	30562	22194	22312	22194
query5	4468	439	351	351
query6	241	153	149	149
query7	4595	263	258	258
query8	224	175	176	175
query9	8364	2540	2527	2527
query10	408	249	215	215
query11	17141	15562	15487	15487
query12	116	67	65	65
query13	1687	377	382	377
query14	10595	6910	6954	6910
query15	206	174	173	173
query16	5793	260	249	249
query17	950	462	464	462
query18	1787	253	245	245
query19	176	131	129	129
query20	72	72	67	67
query21	189	129	124	124
query22	5000	4781	4787	4781
query23	31605	30615	30718	30615
query24	11810	2818	2827	2818
query25	575	327	308	308
query26	1608	142	142	142
query27	3226	286	281	281
query28	7111	1824	1804	1804
query29	1567	607	611	607
query30	278	134	137	134
query31	946	745	770	745
query32	81	50	48	48
query33	692	207	212	207
query34	1134	447	461	447
query35	901	767	817	767
query36	1313	1173	1159	1159
query37	93	59	61	59
query38	3400	3249	3218	3218
query39	1321	1271	1253	1253
query40	199	83	86	83
query41	37	38	34	34
query42	87	77	81	77
query43	504	453	452	452
query44	1095	693	692	692
query45	191	173	169	169
query46	1062	637	654	637
query47	1643	1558	1472	1472
query48	389	300	309	300
query49	1129	286	285	285
query50	683	303	299	299
query51	5295	5182	5213	5182
query52	85	77	71	71
query53	324	245	260	245
query54	245	178	181	178
query55	83	82	73	73
query56	174	166	158	158
query57	1015	864	926	864
query58	189	147	159	147
query59	2874	2598	2708	2598
query60	201	176	178	176
query61	83	85	82	82
query62	626	355	361	355
query63	284	261	254	254
query64	5054	1776	1732	1732
query65	3333	3256	3233	3233
query66	1300	312	306	306
query67	15600	15331	14981	14981
query68	12097	524	514	514
query69	585	294	285	285
query70	1676	1488	1428	1428
query71	10418	10201	10197	10197
query72	4936	2785	2817	2785
query73	2454	318	316	316
query74	7394	6321	6393	6321
query75	4682	2291	2326	2291
query76	6236	1015	1080	1015
query77	668	233	224	224
query78	9194	8771	8520	8520
query79	1723	514	512	512
query80	598	326	314	314
query81	476	196	198	196
query82	209	81	75	75
query83	129	118	115	115
query84	274	66	65	65
query85	1092	347	327	327
query86	382	375	356	356
query87	3538	3358	3331	3331
query88	3362	2214	2211	2211
query89	430	361	361	361
query90	1968	182	181	181
query91	150	135	126	126
query92	48	43	42	42
query93	2926	434	450	434
query94	1268	160	155	155
query95	497	452	450	450
query96	614	323	312	312
query97	4249	4181	4150	4150
query98	206	193	180	180
query99	1006	738	688	688
Total cold run time: 303694 ms
Total hot run time: 185570 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.97 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 948ef9885fc850ed2a736e93c4b6448c283a13f8, data reload: false

query1	0.04	0.03	0.02
query2	0.06	0.03	0.02
query3	0.22	0.05	0.05
query4	1.69	0.07	0.06
query5	0.56	0.53	0.53
query6	1.27	0.63	0.63
query7	0.01	0.01	0.02
query8	0.04	0.02	0.02
query9	0.55	0.49	0.49
query10	0.56	0.55	0.56
query11	0.11	0.08	0.08
query12	0.11	0.09	0.08
query13	0.60	0.60	0.60
query14	0.79	0.80	0.78
query15	0.78	0.77	0.78
query16	0.39	0.39	0.38
query17	0.98	1.01	1.04
query18	0.23	0.27	0.23
query19	1.87	1.74	1.79
query20	0.01	0.01	0.01
query21	15.44	0.56	0.58
query22	2.60	2.25	1.42
query23	17.19	0.82	0.77
query24	2.73	0.50	1.24
query25	0.42	0.21	0.07
query26	0.47	0.14	0.13
query27	0.05	0.06	0.05
query28	11.15	0.76	0.76
query29	12.49	3.30	3.24
query30	0.50	0.47	0.48
query31	2.78	0.34	0.35
query32	3.36	0.48	0.47
query33	3.21	3.27	3.20
query34	15.95	4.34	4.30
query35	4.41	4.30	4.30
query36	1.11	1.07	1.08
query37	0.07	0.05	0.05
query38	0.04	0.02	0.03
query39	0.02	0.02	0.01
query40	0.16	0.13	0.13
query41	0.07	0.02	0.02
query42	0.02	0.02	0.01
query43	0.02	0.02	0.02
Total cold run time: 105.13 s
Total hot run time: 29.97 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 948ef9885fc850ed2a736e93c4b6448c283a13f8 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       13.7 seconds inserted 10000000 Rows, about 729K ops/s

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jan 29, 2024
@github-actions GitHub Actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions GitHub Actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@morrySnow morrySnow merged commit 193f62e into apache:master Jan 29, 2024
26 of 28 checks passed
yiguolei pushed a commit that referenced this pull request Jan 29, 2024
@starocean999 @Doris-Extras
[test](nereids) add SimplifyCastRule test case (#26708)
edeec32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@englefly englefly englefly approved these changes

@morrySnow morrySnow morrySnow approved these changes

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. dev/3.0.0-merged reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@starocean999 @doris-robot @englefly @morrySnow @dataroaring