[optimize](invert index) avoid redundant checks for exist. #30191

zzzxl1993 · 2024-01-21T05:07:38Z

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

zzzxl1993 · 2024-01-21T05:09:57Z

run buildall

doris-robot · 2024-01-21T05:30:00Z

TPC-H: Total hot run time: 39104 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 787f711934e1f23f1d232a079c4c79fb7a23a981, data reload: false

------ Round 1 ----------------------------------
q1	17900	5262	5462	5262
q2	2354	146	139	139
q3	10953	1214	1202	1202
q4	10577	791	841	791
q5	7964	3261	3220	3220
q6	204	123	123	123
q7	864	498	477	477
q8	9241	1923	1960	1923
q9	7261	6389	6366	6366
q10	8200	3057	3064	3057
q11	408	217	214	214
q12	355	190	194	190
q13	17985	3393	3376	3376
q14	245	210	220	210
q15	541	525	500	500
q16	429	367	374	367
q17	949	492	515	492
q18	7557	6899	6848	6848
q19	1573	1382	1341	1341
q20	570	304	292	292
q21	2810	2403	2421	2403
q22	363	311	315	311
Total cold run time: 109303 ms
Total hot run time: 39104 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5535	5151	5340	5151
q2	334	226	218	218
q3	3391	3237	3257	3237
q4	2049	2104	2059	2059
q5	6073	5935	5869	5869
q6	196	117	116	116
q7	2325	1881	1846	1846
q8	3246	3385	3372	3372
q9	8934	8938	8754	8754
q10	3966	3824	3815	3815
q11	583	476	450	450
q12	832	628	620	620
q13	16946	3159	3129	3129
q14	278	257	268	257
q15	552	509	509	509
q16	507	460	477	460
q17	3148	1804	1817	1804
q18	9449	12186	9578	9578
q19	25108	1621	1539	1539
q20	4601	1935	1938	1935
q21	15234	5467	5573	5467
q22	2241	537	544	537
Total cold run time: 115528 ms
Total hot run time: 60722 ms

doris-robot · 2024-01-21T05:41:34Z

TPC-DS: Total hot run time: 176580 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 787f711934e1f23f1d232a079c4c79fb7a23a981, data reload: false

query1	914	347	326	326
query2	6553	2048	1843	1843
query3	6710	202	197	197
query4	34131	22137	22174	22137
query5	6910	591	587	587
query6	244	160	172	160
query7	4595	259	266	259
query8	223	177	176	176
query9	8471	2548	2528	2528
query10	433	229	239	229
query11	16952	15694	15474	15474
query12	126	72	66	66
query13	1679	371	372	371
query14	10484	6956	7049	6956
query15	214	179	195	179
query16	4604	236	227	227
query17	993	477	478	477
query18	1796	253	252	252
query19	178	135	134	134
query20	73	68	71	68
query21	195	127	118	118
query22	4963	4666	4671	4666
query23	31590	30869	30803	30803
query24	12480	2848	2790	2790
query25	562	311	305	305
query26	1793	151	139	139
query27	3193	267	273	267
query28	7193	1822	1816	1816
query29	2078	661	631	631
query30	283	136	139	136
query31	955	735	744	735
query32	76	50	47	47
query33	707	210	213	210
query34	1145	454	465	454
query35	912	774	780	774
query36	1299	1126	1103	1103
query37	95	57	60	57
query38	3419	3241	3211	3211
query39	1315	1254	1248	1248
query40	347	83	82	82
query41	39	35	36	35
query42	91	86	82	82
query43	505	468	449	449
query44	1061	708	693	693
query45	196	176	174	174
query46	1079	675	648	648
query47	1684	1522	1639	1522
query48	397	321	309	309
query49	1211	298	279	279
query50	673	305	307	305
query51	5347	5156	5210	5156
query52	87	85	81	81
query53	325	254	253	253
query54	461	301	286	286
query55	76	75	75	75
query56	175	171	163	163
query57	1012	936	940	936
query58	192	158	161	158
query59	2935	2724	2736	2724
query60	208	184	186	184
query61	87	89	83	83
query62	620	363	374	363
query63	278	269	251	251
query64	6143	1805	1735	1735
query65	3327	3252	3248	3248
query66	1401	313	305	305
query67	15355	15306	15230	15230
query68	12116	525	504	504
query69	623	304	294	294
query70	1593	1486	1445	1445
query71	553	213	201	201
query72	4917	2838	2860	2838
query73	2369	308	318	308
query74	7133	6420	6401	6401
query75	4832	2295	2330	2295
query76	6626	1021	979	979
query77	736	229	237	229
query78	9328	8749	8572	8572
query79	997	512	515	512
query80	580	325	321	321
query81	449	200	207	200
query82	208	77	79	77
query83	138	115	116	115
query84	277	67	67	67
query85	1054	335	318	318
query86	376	368	353	353
query87	3517	3337	3302	3302
query88	3316	2195	2172	2172
query89	441	354	360	354
query90	1986	186	180	180
query91	154	130	135	130
query92	51	43	44	43
query93	1735	444	449	444
query94	1128	156	159	156
query95	487	454	450	450
query96	612	321	316	316
query97	4259	4129	4141	4129
query98	205	188	191	188
query99	1071	753	722	722
Total cold run time: 299715 ms
Total hot run time: 176580 ms

doris-robot · 2024-01-21T05:47:00Z

ClickBench: Total hot run time: 30.95 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 787f711934e1f23f1d232a079c4c79fb7a23a981, data reload: false

query1	0.04	0.02	0.02
query2	0.05	0.02	0.02
query3	0.22	0.05	0.05
query4	1.70	0.10	0.08
query5	0.53	0.51	0.53
query6	1.28	0.64	0.64
query7	0.02	0.01	0.01
query8	0.04	0.02	0.03
query9	0.55	0.50	0.49
query10	0.55	0.55	0.56
query11	0.10	0.09	0.08
query12	0.10	0.09	0.09
query13	0.60	0.61	0.60
query14	0.77	0.83	0.80
query15	0.80	0.77	0.77
query16	0.37	0.37	0.39
query17	1.00	1.02	1.01
query18	0.24	0.24	0.26
query19	1.77	1.76	1.80
query20	0.02	0.01	0.01
query21	15.46	0.56	0.57
query22	2.76	2.43	2.07
query23	17.27	0.78	0.77
query24	2.41	1.29	0.90
query25	0.37	0.24	0.12
query26	0.60	0.13	0.14
query27	0.04	0.05	0.06
query28	11.32	0.77	0.76
query29	12.52	3.16	3.20
query30	0.52	0.50	0.47
query31	2.78	0.35	0.34
query32	3.38	0.49	0.49
query33	3.24	3.21	3.23
query34	15.76	4.24	4.28
query35	4.42	4.25	4.33
query36	1.12	1.08	1.07
query37	0.06	0.05	0.05
query38	0.03	0.02	0.03
query39	0.02	0.01	0.02
query40	0.16	0.13	0.13
query41	0.07	0.01	0.02
query42	0.02	0.01	0.02
query43	0.02	0.02	0.01
Total cold run time: 105.1 s
Total hot run time: 30.95 s

github-actions · 2024-01-21T05:47:34Z

clang-tidy review says "All clean, LGTM! 👍"

doris-robot · 2024-01-21T05:50:04Z

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 787f711934e1f23f1d232a079c4c79fb7a23a981 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       13.7 seconds inserted 10000000 Rows, about 729K ops/s

airborne12

LGTM

github-actions · 2024-01-26T11:52:32Z

PR approved by anyone and no changes requested.

airborne12 · 2024-01-26T14:36:17Z

be/src/olap/rowset/segment_v2/inverted_index_cache.cpp

@@ -145,6 +145,14 @@ Status InvertedIndexSearcherCache::get_index_searcher(
        return Status::OK();
    }

+    // check index file existence


line 162 below also checks index exists

zzzxl1993 · 2024-01-28T06:48:03Z

run buildall

github-actions · 2024-01-28T06:54:56Z

clang-tidy review says "All clean, LGTM! 👍"

doris-robot · 2024-01-28T07:07:53Z

TPC-H: Total hot run time: 37814 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e08815227e859df1219730ce9d0b8b4681b0d908, data reload: false

------ Round 1 ----------------------------------
q1	17918	5510	5049	5049
q2	2606	151	140	140
q3	11350	994	953	953
q4	5082	734	762	734
q5	8370	2892	2792	2792
q6	189	120	121	120
q7	1154	725	728	725
q8	9277	2003	2022	2003
q9	7301	6391	6332	6332
q10	8130	2418	2402	2402
q11	421	201	220	201
q12	748	293	298	293
q13	17999	3314	3313	3313
q14	273	244	243	243
q15	525	488	491	488
q16	469	393	398	393
q17	949	547	499	499
q18	7117	6268	6072	6072
q19	1574	1370	1423	1370
q20	589	359	334	334
q21	6990	3081	3065	3065
q22	811	305	293	293
Total cold run time: 109842 ms
Total hot run time: 37814 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5222	4961	4699	4699
q2	347	237	245	237
q3	3043	2744	2752	2744
q4	1796	1553	1533	1533
q5	5274	5288	5265	5265
q6	201	116	116	116
q7	2124	1808	1742	1742
q8	3087	3200	3176	3176
q9	8638	8588	10709	8588
q10	5455	3448	3394	3394
q11	549	453	457	453
q12	785	624	626	624
q13	16935	3104	3080	3080
q14	275	248	272	248
q15	527	497	491	491
q16	516	480	470	470
q17	2015	1628	1729	1628
q18	8908	10393	8706	8706
q19	24667	1568	1530	1530
q20	4640	1931	1882	1882
q21	16125	4772	4705	4705
q22	1048	451	504	451
Total cold run time: 112177 ms
Total hot run time: 55762 ms

doris-robot · 2024-01-28T07:19:02Z

TPC-DS: Total hot run time: 173234 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e08815227e859df1219730ce9d0b8b4681b0d908, data reload: false

query1	946	332	320	320
query2	6556	2017	1952	1952
query3	6720	205	203	203
query4	33302	22087	22221	22087
query5	4447	421	413	413
query6	251	168	159	159
query7	4596	269	258	258
query8	240	183	189	183
query9	8499	2282	2265	2265
query10	408	216	201	201
query11	17948	15446	15373	15373
query12	121	69	69	69
query13	1683	371	377	371
query14	9181	6367	6488	6367
query15	207	173	183	173
query16	5714	261	251	251
query17	947	466	466	466
query18	1800	255	247	247
query19	173	128	129	128
query20	75	73	71	71
query21	194	134	127	127
query22	4966	4595	4696	4595
query23	31143	30435	30399	30399
query24	11650	2760	2719	2719
query25	596	316	319	316
query26	1783	138	137	137
query27	3193	282	281	281
query28	7618	1835	1827	1827
query29	1835	603	601	601
query30	281	133	139	133
query31	891	714	719	714
query32	75	51	52	51
query33	703	208	214	208
query34	1140	443	465	443
query35	845	768	747	747
query36	1360	1211	1285	1211
query37	95	56	56	56
query38	3243	3169	3149	3149
query39	1310	1248	1245	1245
query40	313	81	83	81
query41	39	36	35	35
query42	92	77	84	77
query43	507	491	478	478
query44	1066	677	679	677
query45	194	182	175	175
query46	1055	656	652	652
query47	1534	1507	1492	1492
query48	404	296	305	296
query49	1128	293	277	277
query50	690	302	299	299
query51	5286	5140	5212	5140
query52	103	73	84	73
query53	315	250	252	250
query54	259	182	183	182
query55	79	75	80	75
query56	172	157	160	157
query57	983	915	904	904
query58	183	156	156	156
query59	2826	2545	2619	2545
query60	204	175	174	174
query61	89	85	88	85
query62	629	370	361	361
query63	288	256	267	256
query64	4947	1751	1724	1724
query65	3290	3236	3220	3220
query66	1263	326	307	307
query67	14401	14193	14141	14141
query68	3735	507	488	488
query69	433	304	288	288
query70	1572	1619	1551	1551
query71	295	234	208	208
query72	3690	2849	2836	2836
query73	691	311	325	311
query74	6654	6266	6259	6259
query75	2804	2254	2254	2254
query76	2656	1019	1004	1004
query77	369	232	231	231
query78	9017	8698	8555	8555
query79	2631	482	497	482
query80	2032	314	314	314
query81	520	198	202	198
query82	704	82	79	79
query83	239	116	120	116
query84	288	74	79	74
query85	2289	348	322	322
query86	519	420	419	419
query87	3422	3270	3246	3246
query88	3868	2204	2191	2191
query89	394	341	350	341
query90	1960	187	181	181
query91	147	118	118	118
query92	56	42	39	39
query93	3186	459	434	434
query94	1327	160	155	155
query95	486	464	476	464
query96	609	318	327	318
query97	4219	4093	4117	4093
query98	227	199	180	180
query99	1122	680	701	680
Total cold run time: 281235 ms
Total hot run time: 173234 ms

doris-robot · 2024-01-28T07:24:27Z

ClickBench: Total hot run time: 30.36 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e08815227e859df1219730ce9d0b8b4681b0d908, data reload: false

query1	0.04	0.03	0.03
query2	0.06	0.02	0.03
query3	0.23	0.06	0.06
query4	1.67	0.09	0.09
query5	0.53	0.51	0.51
query6	1.22	0.66	0.64
query7	0.02	0.01	0.01
query8	0.03	0.02	0.02
query9	0.56	0.50	0.50
query10	0.56	0.54	0.55
query11	0.12	0.08	0.08
query12	0.10	0.09	0.09
query13	0.60	0.61	0.60
query14	0.78	0.79	0.80
query15	0.80	0.78	0.77
query16	0.40	0.38	0.38
query17	0.98	1.03	1.04
query18	0.22	0.27	0.24
query19	1.80	1.83	1.78
query20	0.01	0.01	0.01
query21	15.41	0.57	0.56
query22	2.82	2.40	1.41
query23	17.08	0.76	0.74
query24	2.55	0.61	0.70
query25	0.34	0.14	0.15
query26	0.53	0.14	0.14
query27	0.05	0.06	0.06
query28	12.19	0.84	0.82
query29	12.53	3.21	3.16
query30	0.62	0.55	0.54
query31	2.79	0.35	0.36
query32	3.35	0.47	0.48
query33	3.24	3.26	3.26
query34	16.09	4.34	4.37
query35	4.31	4.38	4.27
query36	1.11	1.07	1.05
query37	0.07	0.05	0.05
query38	0.04	0.03	0.03
query39	0.02	0.01	0.01
query40	0.17	0.12	0.13
query41	0.08	0.01	0.01
query42	0.02	0.02	0.01
query43	0.02	0.02	0.02
Total cold run time: 106.16 s
Total hot run time: 30.36 s

doris-robot · 2024-01-28T07:27:32Z

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit e08815227e859df1219730ce9d0b8b4681b0d908 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       15.1 seconds inserted 10000000 Rows, about 662K ops/s

qidaye

LGTM

github-actions · 2024-01-29T02:40:47Z

PR approved by at least one committer and no changes requested.

zzzxl1993 · 2024-01-29T02:51:14Z

run buildall

github-actions · 2024-01-29T02:59:37Z

clang-tidy review says "All clean, LGTM! 👍"

doris-robot · 2024-01-29T03:20:51Z

TeamCity be ut coverage result:
Function Coverage: 36.18% (8620/23823)
Line Coverage: 28.25% (70505/249575)
Region Coverage: 27.24% (36372/133517)
Branch Coverage: 24.04% (18642/77534)
Coverage Report: http://coverage.selectdb-in.cc/coverage/09015c62441ecd25a54eb36228e2fcd241397d98_09015c62441ecd25a54eb36228e2fcd241397d98/report/index.html

doris-robot · 2024-01-29T03:24:37Z

TPC-H: Total hot run time: 37590 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 09015c62441ecd25a54eb36228e2fcd241397d98, data reload: false

------ Round 1 ----------------------------------
q1	17677	5286	4962	4962
q2	2039	142	134	134
q3	10697	917	930	917
q4	4689	713	741	713
q5	7668	2916	2914	2914
q6	184	118	118	118
q7	1090	724	713	713
q8	9351	2025	1987	1987
q9	7141	6345	6283	6283
q10	8062	2409	2408	2408
q11	409	203	202	202
q12	784	285	271	271
q13	18005	3321	3271	3271
q14	286	246	236	236
q15	529	492	484	484
q16	458	396	411	396
q17	923	533	514	514
q18	6925	6243	6086	6086
q19	1691	1416	1333	1333
q20	603	356	332	332
q21	6839	3005	3038	3005
q22	811	311	315	311
Total cold run time: 106861 ms
Total hot run time: 37590 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5079	4975	5001	4975
q2	330	236	238	236
q3	2985	2677	2588	2588
q4	1842	1613	1463	1463
q5	5312	5201	5382	5201
q6	194	115	116	115
q7	2212	1811	1844	1811
q8	3132	3236	3208	3208
q9	8652	8536	9118	8536
q10	5358	3476	3490	3476
q11	573	459	457	457
q12	723	587	609	587
q13	16906	3057	3035	3035
q14	277	253	256	253
q15	551	482	496	482
q16	504	464	470	464
q17	1965	1719	1638	1638
q18	9169	9966	8219	8219
q19	24090	1567	1550	1550
q20	4600	1907	1893	1893
q21	14785	4676	4653	4653
q22	1019	465	486	465
Total cold run time: 110258 ms
Total hot run time: 55305 ms

doris-robot · 2024-01-29T03:35:57Z

TPC-DS: Total hot run time: 173940 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 09015c62441ecd25a54eb36228e2fcd241397d98, data reload: false

query1	945	327	321	321
query2	6562	2061	1888	1888
query3	6699	201	194	194
query4	33079	22028	22029	22028
query5	4447	346	351	346
query6	250	161	149	149
query7	4613	263	269	263
query8	256	173	181	173
query9	8600	2303	2284	2284
query10	410	207	214	207
query11	17661	15495	15279	15279
query12	122	65	67	65
query13	1669	369	375	369
query14	9174	6536	6523	6523
query15	199	173	181	173
query16	5697	265	255	255
query17	934	470	470	470
query18	1801	253	243	243
query19	174	137	134	134
query20	69	76	65	65
query21	193	130	123	123
query22	5104	4907	4667	4667
query23	31268	30379	30484	30379
query24	11594	2822	2796	2796
query25	610	305	315	305
query26	1788	137	139	137
query27	3176	281	278	278
query28	8758	1850	1827	1827
query29	1808	616	629	616
query30	279	139	136	136
query31	896	718	728	718
query32	74	52	47	47
query33	696	208	214	208
query34	1162	466	461	461
query35	858	760	770	760
query36	1386	1106	1225	1106
query37	96	57	58	57
query38	3311	3187	3201	3187
query39	1313	1258	1272	1258
query40	519	87	80	80
query41	37	35	36	35
query42	93	79	86	79
query43	523	471	471	471
query44	1074	699	703	699
query45	204	185	175	175
query46	1041	665	644	644
query47	1617	1514	1531	1514
query48	388	314	299	299
query49	1213	292	275	275
query50	681	314	333	314
query51	5421	5472	5391	5391
query52	96	84	84	84
query53	343	269	265	265
query54	267	211	204	204
query55	86	79	77	77
query56	203	162	173	162
query57	1078	1038	955	955
query58	199	171	181	171
query59	2809	2704	2641	2641
query60	217	188	189	188
query61	87	87	84	84
query62	633	365	360	360
query63	293	259	274	259
query64	6741	1781	1754	1754
query65	3308	3279	3240	3240
query66	2268	324	321	321
query67	14624	14381	14391	14381
query68	5157	466	501	466
query69	454	299	299	299
query70	1581	1549	1460	1460
query71	281	213	218	213
query72	4013	2841	2830	2830
query73	684	311	327	311
query74	6752	6302	6275	6275
query75	2832	2332	2306	2306
query76	3503	1051	981	981
query77	373	240	235	235
query78	9212	8728	8525	8525
query79	2717	484	495	484
query80	2060	317	309	309
query81	524	207	199	199
query82	693	85	74	74
query83	233	119	122	119
query84	286	73	80	73
query85	2452	370	334	334
query86	503	389	372	372
query87	3450	3241	3298	3241
query88	4179	2175	2176	2175
query89	419	346	365	346
query90	1941	189	185	185
query91	150	115	114	114
query92	57	44	45	44
query93	4301	442	454	442
query94	1316	158	160	158
query95	500	457	446	446
query96	620	315	313	313
query97	4259	4118	4161	4118
query98	202	195	192	192
query99	995	695	684	684
Total cold run time: 290493 ms
Total hot run time: 173940 ms

doris-robot · 2024-01-29T03:41:25Z

ClickBench: Total hot run time: 31.41 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 09015c62441ecd25a54eb36228e2fcd241397d98, data reload: false

query1	0.04	0.03	0.03
query2	0.06	0.03	0.02
query3	0.23	0.06	0.05
query4	1.66	0.10	0.10
query5	0.54	0.52	0.52
query6	1.21	0.63	0.66
query7	0.02	0.02	0.01
query8	0.03	0.03	0.03
query9	0.55	0.48	0.51
query10	0.55	0.56	0.56
query11	0.12	0.08	0.08
query12	0.12	0.09	0.09
query13	0.62	0.61	0.61
query14	0.78	0.82	0.78
query15	0.81	0.77	0.76
query16	0.39	0.38	0.38
query17	1.05	1.00	1.03
query18	0.23	0.28	0.23
query19	1.90	1.82	1.74
query20	0.01	0.01	0.01
query21	15.40	0.59	0.59
query22	2.56	2.39	2.39
query23	17.30	0.72	0.83
query24	2.43	1.38	0.79
query25	0.22	0.28	0.06
query26	0.68	0.15	0.15
query27	0.03	0.05	0.06
query28	11.70	0.84	0.84
query29	12.51	3.27	3.19
query30	0.62	0.55	0.52
query31	2.78	0.35	0.37
query32	3.34	0.48	0.49
query33	3.18	3.23	3.20
query34	15.99	4.31	4.31
query35	4.35	4.42	4.36
query36	1.09	1.07	1.06
query37	0.06	0.04	0.04
query38	0.04	0.03	0.03
query39	0.02	0.01	0.01
query40	0.19	0.13	0.13
query41	0.08	0.01	0.02
query42	0.02	0.01	0.01
query43	0.03	0.01	0.02
Total cold run time: 105.54 s
Total hot run time: 31.41 s

doris-robot · 2024-01-29T03:44:29Z

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 09015c62441ecd25a54eb36228e2fcd241397d98 with default session variables
Stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       14.4 seconds inserted 10000000 Rows, about 694K ops/s

qidaye

LGTM

github-actions · 2024-01-29T06:12:08Z

PR approved by at least one committer and no changes requested.

xiaokang added the dev/2.0.5 label Jan 22, 2024

airborne12 approved these changes Jan 26, 2024

View reviewed changes

github-actions bot added the reviewed label Jan 26, 2024

airborne12 reviewed Jan 26, 2024

View reviewed changes

zzzxl1993 force-pushed the exists_file branch from 787f711 to e088152 Compare January 28, 2024 06:45

qidaye previously approved these changes Jan 29, 2024

View reviewed changes

github-actions bot added the approved Indicates a PR has been approved by one committer. label Jan 29, 2024

[optimize](invert index) avoid redundant checks for exist.

09015c6

zzzxl1993 dismissed qidaye’s stale review via 09015c6 January 29, 2024 02:50

zzzxl1993 force-pushed the exists_file branch from e088152 to 09015c6 Compare January 29, 2024 02:50

github-actions bot removed the approved Indicates a PR has been approved by one committer. label Jan 29, 2024

qidaye approved these changes Jan 29, 2024

View reviewed changes

github-actions bot added the approved Indicates a PR has been approved by one committer. label Jan 29, 2024

qidaye merged commit 453c345 into apache:master Jan 29, 2024
27 checks passed

yiguolei pushed a commit that referenced this pull request Jan 29, 2024

[optimize](invert index) avoid redundant checks for exist. (#30191)

11f1b12

dataroaring added the dev/3.0.0-merged label Aug 5, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[optimize](invert index) avoid redundant checks for exist. #30191

[optimize](invert index) avoid redundant checks for exist. #30191

zzzxl1993 commented Jan 21, 2024

zzzxl1993 commented Jan 21, 2024

doris-robot commented Jan 21, 2024

doris-robot commented Jan 21, 2024

doris-robot commented Jan 21, 2024

github-actions bot commented Jan 21, 2024

doris-robot commented Jan 21, 2024

airborne12 left a comment

github-actions bot commented Jan 26, 2024

airborne12 Jan 26, 2024

zzzxl1993 commented Jan 28, 2024

github-actions bot commented Jan 28, 2024

doris-robot commented Jan 28, 2024

doris-robot commented Jan 28, 2024

doris-robot commented Jan 28, 2024

doris-robot commented Jan 28, 2024

qidaye left a comment

github-actions bot commented Jan 29, 2024

zzzxl1993 commented Jan 29, 2024

github-actions bot commented Jan 29, 2024

doris-robot commented Jan 29, 2024

doris-robot commented Jan 29, 2024

doris-robot commented Jan 29, 2024

doris-robot commented Jan 29, 2024

doris-robot commented Jan 29, 2024

qidaye left a comment

github-actions bot commented Jan 29, 2024

[optimize](invert index) avoid redundant checks for exist. #30191

[optimize](invert index) avoid redundant checks for exist. #30191

Conversation

zzzxl1993 commented Jan 21, 2024

Proposed changes

Further comments

zzzxl1993 commented Jan 21, 2024

doris-robot commented Jan 21, 2024

doris-robot commented Jan 21, 2024

doris-robot commented Jan 21, 2024

github-actions bot commented Jan 21, 2024

doris-robot commented Jan 21, 2024

airborne12 left a comment

Choose a reason for hiding this comment

github-actions bot commented Jan 26, 2024

airborne12 Jan 26, 2024

Choose a reason for hiding this comment

zzzxl1993 commented Jan 28, 2024

github-actions bot commented Jan 28, 2024

doris-robot commented Jan 28, 2024

doris-robot commented Jan 28, 2024

doris-robot commented Jan 28, 2024

doris-robot commented Jan 28, 2024

qidaye left a comment

Choose a reason for hiding this comment

github-actions bot commented Jan 29, 2024

zzzxl1993 commented Jan 29, 2024

github-actions bot commented Jan 29, 2024

doris-robot commented Jan 29, 2024

doris-robot commented Jan 29, 2024

doris-robot commented Jan 29, 2024

doris-robot commented Jan 29, 2024

doris-robot commented Jan 29, 2024

qidaye left a comment

Choose a reason for hiding this comment

github-actions bot commented Jan 29, 2024