Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[feature](datatype) add BE config to allow zero date (#34961) #37214

Merged
merged 1 commit into from
Jul 3, 2024

Conversation

kaijchen
Copy link
Contributor

@kaijchen kaijchen commented Jul 3, 2024

Proposed changes

cherry-pick #34961

Co-authored-by: Gabriel <gabrielleebuaa@gmail.com>
@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@kaijchen
Copy link
Contributor Author

kaijchen commented Jul 3, 2024

run buildall

Copy link
Contributor

github-actions bot commented Jul 3, 2024

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jul 3, 2024
Copy link
Contributor

github-actions bot commented Jul 3, 2024

PR approved by anyone and no changes requested.

Copy link
Contributor

github-actions bot commented Jul 3, 2024

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 49888 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0e98d182ce0ea7f1997bfc20ef95f16dc544aafb, data reload: false

------ Round 1 ----------------------------------
q1	17693	4433	4380	4380
q2	2071	159	147	147
q3	10450	1893	1915	1893
q4	10210	1220	1336	1220
q5	8677	3906	3912	3906
q6	242	148	133	133
q7	2061	1630	1589	1589
q8	9252	2715	2711	2711
q9	10704	10571	10335	10335
q10	8642	3511	3502	3502
q11	423	239	245	239
q12	472	298	301	298
q13	18376	3949	4023	3949
q14	357	331	320	320
q15	514	453	458	453
q16	684	579	582	579
q17	1141	956	997	956
q18	7331	6811	6841	6811
q19	1789	1732	1650	1650
q20	544	317	295	295
q21	4438	4132	4070	4070
q22	536	452	458	452
Total cold run time: 116607 ms
Total hot run time: 49888 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4326	4339	4277	4277
q2	322	229	227	227
q3	4173	4142	4138	4138
q4	2749	2743	2740	2740
q5	7133	7112	7079	7079
q6	239	121	119	119
q7	3243	2811	2811	2811
q8	4324	4411	4448	4411
q9	16853	16835	16765	16765
q10	4246	4248	4310	4248
q11	751	707	683	683
q12	1036	847	866	847
q13	7296	3724	3684	3684
q14	465	428	438	428
q15	491	454	463	454
q16	744	684	676	676
q17	3752	3827	3795	3795
q18	8841	8739	8723	8723
q19	1700	1698	1689	1689
q20	2378	2119	2071	2071
q21	8430	8527	8427	8427
q22	1031	993	954	954
Total cold run time: 84523 ms
Total hot run time: 79246 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.89% (8115/21417)
Line Coverage: 29.57% (66490/224877)
Region Coverage: 29.04% (34272/118026)
Branch Coverage: 24.91% (17605/70670)
Coverage Report: http://coverage.selectdb-in.cc/coverage/0e98d182ce0ea7f1997bfc20ef95f16dc544aafb_0e98d182ce0ea7f1997bfc20ef95f16dc544aafb/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 205154 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0e98d182ce0ea7f1997bfc20ef95f16dc544aafb, data reload: false

query1	940	423	393	393
query2	6570	2730	2631	2631
query3	6917	207	202	202
query4	20981	18014	18001	18001
query5	19737	6533	6498	6498
query6	289	225	230	225
query7	4162	302	305	302
query8	458	422	402	402
query9	3135	2707	2624	2624
query10	406	300	296	296
query11	11392	10667	10673	10667
query12	125	82	79	79
query13	5602	683	670	670
query14	17902	13477	13628	13477
query15	358	241	247	241
query16	6475	291	270	270
query17	1729	1444	872	872
query18	2340	415	413	413
query19	216	148	154	148
query20	82	79	81	79
query21	190	93	94	93
query22	5206	4967	4920	4920
query23	32462	31829	31877	31829
query24	7078	6529	6442	6442
query25	531	436	447	436
query26	533	160	160	160
query27	1867	294	296	294
query28	6204	2372	2330	2330
query29	2856	2727	2836	2727
query30	246	165	168	165
query31	922	739	738	738
query32	69	64	61	61
query33	394	261	248	248
query34	846	460	487	460
query35	1105	882	913	882
query36	1463	1155	1106	1106
query37	86	61	59	59
query38	3028	2919	3019	2919
query39	1382	1305	1322	1305
query40	207	99	94	94
query41	47	45	46	45
query42	87	88	91	88
query43	761	739	684	684
query44	1130	710	707	707
query45	252	238	235	235
query46	1216	948	968	948
query47	1756	1853	1748	1748
query48	1011	711	698	698
query49	632	376	374	374
query50	852	591	606	591
query51	4865	4597	4631	4597
query52	99	83	88	83
query53	451	333	326	326
query54	2666	2459	2462	2459
query55	94	90	86	86
query56	243	214	220	214
query57	1203	1070	1041	1041
query58	218	203	205	203
query59	4121	4124	4105	4105
query60	220	208	205	205
query61	98	94	96	94
query62	822	465	486	465
query63	498	343	351	343
query64	2489	1502	1474	1474
query65	3652	3570	3536	3536
query66	778	377	389	377
query67	15322	17659	17033	17033
query68	8986	629	637	629
query69	571	363	346	346
query70	1501	1370	1313	1313
query71	419	311	319	311
query72	6555	3494	3464	3464
query73	726	322	329	322
query74	6341	5826	5884	5826
query75	5241	3661	3704	3661
query76	5493	1133	1183	1133
query77	918	262	276	262
query78	12636	11603	11637	11603
query79	5976	642	637	637
query80	956	381	396	381
query81	494	235	236	235
query82	1478	98	99	98
query83	190	135	134	134
query84	265	73	73	73
query85	879	317	314	314
query86	330	298	302	298
query87	3257	3046	3051	3046
query88	4642	2317	2326	2317
query89	370	297	274	274
query90	1936	202	212	202
query91	185	136	142	136
query92	61	54	53	53
query93	4089	539	558	539
query94	718	210	217	210
query95	1129	1068	1082	1068
query96	642	329	331	329
query97	6449	6377	6407	6377
query98	190	172	159	159
query99	2938	887	946	887
Total cold run time: 308635 ms
Total hot run time: 205154 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.12 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0e98d182ce0ea7f1997bfc20ef95f16dc544aafb, data reload: false

query1	0.02	0.01	0.02
query2	0.07	0.02	0.02
query3	0.25	0.04	0.04
query4	1.81	0.06	0.08
query5	0.53	0.52	0.52
query6	1.23	0.62	0.61
query7	0.02	0.01	0.01
query8	0.03	0.02	0.02
query9	0.54	0.49	0.47
query10	0.52	0.52	0.53
query11	0.12	0.08	0.09
query12	0.12	0.10	0.08
query13	0.63	0.60	0.60
query14	0.79	0.79	0.78
query15	0.76	0.75	0.76
query16	0.36	0.38	0.37
query17	1.02	0.96	1.00
query18	0.23	0.26	0.22
query19	1.82	1.75	1.86
query20	0.02	0.01	0.01
query21	15.50	0.56	0.56
query22	1.93	2.13	1.62
query23	16.99	1.12	1.07
query24	8.34	0.39	0.94
query25	0.36	0.12	0.06
query26	0.76	0.17	0.15
query27	0.04	0.05	0.03
query28	5.50	0.74	0.76
query29	12.71	2.37	2.33
query30	0.61	0.53	0.53
query31	2.81	0.40	0.37
query32	3.38	0.50	0.49
query33	3.07	3.06	3.03
query34	15.24	4.79	4.78
query35	4.87	4.84	4.86
query36	1.05	1.01	1.02
query37	0.06	0.04	0.05
query38	0.03	0.02	0.02
query39	0.02	0.02	0.01
query40	0.16	0.14	0.14
query41	0.06	0.02	0.01
query42	0.02	0.02	0.01
query43	0.02	0.02	0.01
Total cold run time: 104.42 s
Total hot run time: 30.12 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 0e98d182ce0ea7f1997bfc20ef95f16dc544aafb with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.3 seconds inserted 10000000 Rows, about 469K ops/s

@gavinchou gavinchou merged commit 7c0b113 into apache:branch-2.0 Jul 3, 2024
26 of 29 checks passed
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants