Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[fix](index profile) fix missing update inverted_index_searcher_cache_hit/miss in #36545 #36636

Merged
merged 1 commit into from
Jun 21, 2024

Conversation

xiaokang
Copy link
Contributor

fix missing update inverted_index_searcher_cache_hit/miss in #36545

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@xiaokang
Copy link
Contributor Author

run buildall

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.85% (8105/21415)
Line Coverage: 29.52% (66332/224714)
Region Coverage: 28.99% (34180/117918)
Branch Coverage: 24.86% (17548/70600)
Coverage Report: http://coverage.selectdb-in.cc/coverage/cf28a8c85dead57056e131c23f8193d18bf6759a_cf28a8c85dead57056e131c23f8193d18bf6759a/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 49643 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit cf28a8c85dead57056e131c23f8193d18bf6759a, data reload: false

------ Round 1 ----------------------------------
q1	17877	4440	4390	4390
q2	2083	164	155	155
q3	10520	1913	1931	1913
q4	10322	1238	1325	1238
q5	8619	3869	3917	3869
q6	254	143	126	126
q7	2071	1590	1616	1590
q8	9532	2725	2701	2701
q9	13533	10374	10166	10166
q10	8642	3544	3529	3529
q11	406	256	255	255
q12	477	304	311	304
q13	18341	3924	4012	3924
q14	361	317	335	317
q15	510	469	455	455
q16	649	588	569	569
q17	1148	953	904	904
q18	7191	6766	6980	6766
q19	1766	1658	1617	1617
q20	533	288	302	288
q21	4398	4169	4121	4121
q22	527	446	446	446
Total cold run time: 119760 ms
Total hot run time: 49643 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4350	4354	4330	4330
q2	330	226	222	222
q3	4184	4141	4134	4134
q4	2746	2760	2735	2735
q5	7154	7100	7105	7100
q6	237	121	121	121
q7	3206	2896	2882	2882
q8	4379	4482	4495	4482
q9	16867	16769	16743	16743
q10	4248	4283	4256	4256
q11	765	701	658	658
q12	1031	847	852	847
q13	7399	3758	3724	3724
q14	444	419	421	419
q15	518	462	457	457
q16	737	700	694	694
q17	3819	3877	3872	3872
q18	8761	8849	8739	8739
q19	1722	1714	1660	1660
q20	2340	2131	2071	2071
q21	8405	8436	8389	8389
q22	1071	982	997	982
Total cold run time: 84713 ms
Total hot run time: 79517 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 203135 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit cf28a8c85dead57056e131c23f8193d18bf6759a, data reload: false

query1	914	423	378	378
query2	6528	2881	2783	2783
query3	6926	206	199	199
query4	20668	18000	18112	18000
query5	19718	6504	6574	6504
query6	289	230	239	230
query7	4164	307	307	307
query8	431	422	434	422
query9	3105	2653	2595	2595
query10	412	312	296	296
query11	11371	10705	10781	10705
query12	121	84	79	79
query13	5599	706	691	691
query14	17971	13562	13733	13562
query15	361	253	247	247
query16	6466	292	265	265
query17	1717	1437	900	900
query18	2287	416	422	416
query19	219	149	151	149
query20	83	81	82	81
query21	192	93	100	93
query22	5108	4868	5026	4868
query23	32610	31905	31964	31905
query24	7000	6529	6607	6529
query25	561	432	426	426
query26	530	161	158	158
query27	1892	297	292	292
query28	6201	2322	2269	2269
query29	2803	2901	2712	2712
query30	243	168	169	168
query31	908	734	749	734
query32	71	68	60	60
query33	411	260	254	254
query34	849	458	476	458
query35	1127	913	901	901
query36	1310	1109	1154	1109
query37	92	58	63	58
query38	3082	2912	2976	2912
query39	1391	1331	1325	1325
query40	207	94	95	94
query41	47	43	45	43
query42	80	94	76	76
query43	735	722	686	686
query44	1162	722	727	722
query45	252	239	234	234
query46	1213	976	982	976
query47	1946	1587	1631	1587
query48	1021	724	712	712
query49	622	371	373	371
query50	846	591	592	591
query51	4688	4645	4614	4614
query52	82	81	85	81
query53	462	330	317	317
query54	2655	2454	2469	2454
query55	90	82	84	82
query56	235	236	220	220
query57	1153	1120	1062	1062
query58	229	197	212	197
query59	4173	3821	4254	3821
query60	217	196	217	196
query61	100	97	97	97
query62	874	438	452	438
query63	481	348	343	343
query64	2622	1552	1340	1340
query65	3619	3570	3570	3570
query66	796	385	382	382
query67	15744	15133	15657	15133
query68	10502	662	643	643
query69	564	351	346	346
query70	2016	1457	1415	1415
query71	423	300	324	300
query72	6661	3509	3505	3505
query73	741	324	317	317
query74	6284	5872	5816	5816
query75	5525	3782	3808	3782
query76	6893	1176	1155	1155
query77	1187	258	260	258
query78	13049	11647	11476	11476
query79	10232	644	629	629
query80	731	400	413	400
query81	490	245	234	234
query82	1119	102	93	93
query83	169	136	132	132
query84	262	71	74	71
query85	805	317	318	317
query86	326	295	289	289
query87	3246	3018	3020	3018
query88	4580	2294	2295	2294
query89	479	286	301	286
query90	1970	216	217	216
query91	176	154	157	154
query92	63	55	52	52
query93	6994	540	552	540
query94	736	208	208	208
query95	1104	1061	1049	1049
query96	637	319	320	319
query97	6468	6324	6396	6324
query98	188	183	176	176
query99	3036	842	893	842
Total cold run time: 319738 ms
Total hot run time: 203135 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.87 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit cf28a8c85dead57056e131c23f8193d18bf6759a, data reload: false

query1	0.02	0.03	0.02
query2	0.07	0.02	0.02
query3	0.25	0.06	0.05
query4	1.77	0.07	0.07
query5	0.54	0.53	0.52
query6	1.25	0.61	0.63
query7	0.01	0.01	0.02
query8	0.03	0.02	0.03
query9	0.51	0.48	0.48
query10	0.54	0.55	0.54
query11	0.12	0.08	0.08
query12	0.12	0.09	0.09
query13	0.62	0.61	0.61
query14	0.79	0.79	0.76
query15	0.80	0.76	0.77
query16	0.35	0.37	0.38
query17	1.02	0.96	1.02
query18	0.23	0.23	0.24
query19	1.94	1.87	1.82
query20	0.02	0.01	0.01
query21	15.46	0.56	0.56
query22	1.92	2.10	1.66
query23	17.17	1.01	0.92
query24	7.22	1.66	1.26
query25	0.41	0.10	0.06
query26	0.84	0.15	0.15
query27	0.04	0.04	0.03
query28	5.08	0.78	0.73
query29	12.63	2.31	2.13
query30	0.58	0.58	0.52
query31	2.82	0.38	0.38
query32	3.37	0.50	0.50
query33	3.03	3.09	3.08
query34	15.28	4.81	4.78
query35	4.83	4.86	4.84
query36	1.03	1.01	1.00
query37	0.06	0.04	0.05
query38	0.04	0.02	0.02
query39	0.02	0.01	0.02
query40	0.15	0.14	0.14
query41	0.06	0.02	0.01
query42	0.02	0.01	0.01
query43	0.02	0.02	0.01
Total cold run time: 103.08 s
Total hot run time: 30.87 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit cf28a8c85dead57056e131c23f8193d18bf6759a with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       22.0 seconds inserted 10000000 Rows, about 454K ops/s

@xiaokang xiaokang merged commit a59c15a into apache:branch-2.0 Jun 21, 2024
23 of 25 checks passed
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants