Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[fix](hive) report error with escape char and null format #39700

Merged
merged 4 commits into from
Aug 22, 2024
Merged

[fix](hive) report error with escape char and null format #39700

merged 4 commits into from
Aug 22, 2024

Conversation

suxiaogang223
Copy link
Contributor

Proposed changes

Because be did not process escape char and null format when reading the hive text table, an error was reported when fe found that this value was not the default value.

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@suxiaogang223 suxiaogang223 changed the title report error with escape char and null format [fix](hive) report error with escape char and null format Aug 21, 2024
@suxiaogang223
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38412 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 36a5bb9d399fc5145a19ba158bfc665838ff6b18, data reload: false

------ Round 1 ----------------------------------
q1	18345	4586	4352	4352
q2	2062	211	209	209
q3	11749	991	1168	991
q4	10529	766	852	766
q5	7810	2898	2826	2826
q6	268	159	158	158
q7	1028	664	667	664
q8	9588	2116	2127	2116
q9	7578	6556	6541	6541
q10	7055	2328	2240	2240
q11	551	288	268	268
q12	432	256	258	256
q13	18768	3002	2984	2984
q14	299	242	252	242
q15	553	529	533	529
q16	530	412	400	400
q17	986	642	716	642
q18	7428	6851	6796	6796
q19	6566	1061	1112	1061
q20	721	349	358	349
q21	3855	3012	3010	3010
q22	1125	1020	1012	1012
Total cold run time: 117826 ms
Total hot run time: 38412 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4536	4339	4299	4299
q2	405	305	302	302
q3	2878	2680	2723	2680
q4	1980	1768	1735	1735
q5	5703	5693	5676	5676
q6	254	161	156	156
q7	2161	1856	1750	1750
q8	3304	3508	3492	3492
q9	8834	8788	8810	8788
q10	3674	3352	3331	3331
q11	634	508	522	508
q12	867	707	679	679
q13	17274	3197	3089	3089
q14	334	289	302	289
q15	572	546	510	510
q16	524	469	455	455
q17	1829	1562	1510	1510
q18	8280	7843	7664	7664
q19	7668	1592	1647	1592
q20	2167	1903	1836	1836
q21	14378	5357	5254	5254
q22	1181	1092	1069	1069
Total cold run time: 89437 ms
Total hot run time: 56664 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196304 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 36a5bb9d399fc5145a19ba158bfc665838ff6b18, data reload: false

query1	1318	913	888	888
query2	6682	1997	1963	1963
query3	10641	3968	3886	3886
query4	54535	24185	23280	23280
query5	5625	719	733	719
query6	479	217	214	214
query7	5785	334	333	333
query8	516	442	440	440
query9	9106	2561	2541	2541
query10	597	343	334	334
query11	18092	14995	14934	14934
query12	200	151	147	147
query13	1671	474	481	474
query14	11237	7388	7363	7363
query15	247	195	192	192
query16	7629	520	502	502
query17	1176	616	610	610
query18	2080	346	354	346
query19	305	176	170	170
query20	143	141	133	133
query21	246	142	139	139
query22	4605	4366	4627	4366
query23	34494	33757	33649	33649
query24	6171	2997	3000	2997
query25	570	426	431	426
query26	716	188	186	186
query27	1735	310	323	310
query28	4206	2234	2184	2184
query29	728	452	443	443
query30	228	192	195	192
query31	1053	844	781	781
query32	101	77	77	77
query33	526	353	335	335
query34	897	503	505	503
query35	872	766	825	766
query36	1102	956	936	936
query37	157	106	106	106
query38	3903	3857	3848	3848
query39	1524	1504	1460	1460
query40	235	154	152	152
query41	135	133	133	133
query42	142	120	118	118
query43	544	496	514	496
query44	1116	772	781	772
query45	229	199	199	199
query46	1141	790	800	790
query47	1901	1870	1864	1864
query48	409	333	329	329
query49	925	578	577	577
query50	857	464	466	464
query51	7253	7130	7024	7024
query52	123	109	107	107
query53	304	225	226	225
query54	622	512	498	498
query55	92	112	88	88
query56	325	302	300	300
query57	1204	1115	1110	1110
query58	295	295	290	290
query59	2910	2734	2693	2693
query60	354	317	318	317
query61	145	143	156	143
query62	782	691	672	672
query63	250	231	227	227
query64	3308	1861	1841	1841
query65	3289	3210	3179	3179
query66	1023	702	655	655
query67	15437	15476	15041	15041
query68	5534	570	581	570
query69	520	313	320	313
query70	1223	1145	1151	1145
query71	529	317	311	311
query72	6547	2356	2141	2141
query73	808	352	350	350
query74	9490	8820	8818	8818
query75	3621	2732	2749	2732
query76	2826	1087	1031	1031
query77	708	429	429	429
query78	10418	9124	9032	9032
query79	7080	555	561	555
query80	2810	608	617	608
query81	604	263	259	259
query82	1133	155	154	154
query83	370	212	214	212
query84	295	98	96	96
query85	1333	351	352	351
query86	475	319	321	319
query87	4392	4306	4211	4211
query88	5366	2445	2443	2443
query89	444	368	331	331
query90	2058	225	225	225
query91	152	124	125	124
query92	85	74	73	73
query93	5646	550	553	550
query94	966	322	304	304
query95	390	291	295	291
query96	636	283	282	282
query97	3240	3028	3103	3028
query98	250	230	221	221
query99	1795	1323	1318	1318
Total cold run time: 328992 ms
Total hot run time: 196304 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.14 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 36a5bb9d399fc5145a19ba158bfc665838ff6b18, data reload: false

query1	0.05	0.04	0.04
query2	0.09	0.04	0.05
query3	0.23	0.06	0.06
query4	1.66	0.09	0.09
query5	0.52	0.51	0.49
query6	1.13	0.74	0.73
query7	0.02	0.02	0.02
query8	0.06	0.05	0.05
query9	0.55	0.50	0.51
query10	0.55	0.56	0.54
query11	0.15	0.13	0.13
query12	0.16	0.13	0.13
query13	0.63	0.59	0.61
query14	0.78	0.80	0.79
query15	0.85	0.84	0.82
query16	0.38	0.37	0.38
query17	0.98	1.04	0.97
query18	0.23	0.21	0.22
query19	1.80	1.80	1.81
query20	0.02	0.02	0.01
query21	15.39	0.66	0.66
query22	4.06	7.12	1.96
query23	18.28	1.38	1.24
query24	2.18	0.23	0.22
query25	0.17	0.09	0.08
query26	0.27	0.18	0.18
query27	0.08	0.08	0.08
query28	13.23	1.04	1.01
query29	12.59	3.31	3.33
query30	0.42	0.20	0.20
query31	2.80	0.42	0.40
query32	3.27	0.49	0.48
query33	2.94	3.02	2.93
query34	16.99	4.32	4.35
query35	4.50	4.45	4.51
query36	0.66	0.50	0.51
query37	0.20	0.19	0.18
query38	0.17	0.16	0.17
query39	0.06	0.05	0.06
query40	0.20	0.15	0.15
query41	0.11	0.07	0.07
query42	0.08	0.07	0.08
query43	0.07	0.06	0.06
Total cold run time: 109.56 s
Total hot run time: 31.14 s

@suxiaogang223
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38569 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8c4a2bbf7c44200e33132eaecd0f8eb713ac786f, data reload: false

------ Round 1 ----------------------------------
q1	17866	4441	4304	4304
q2	2054	214	224	214
q3	11671	990	1259	990
q4	10542	728	846	728
q5	7791	2862	2842	2842
q6	267	160	162	160
q7	1015	658	647	647
q8	9406	2143	2126	2126
q9	7079	6563	6577	6563
q10	7047	2217	2198	2198
q11	486	284	274	274
q12	430	261	273	261
q13	17808	3042	3038	3038
q14	312	267	258	258
q15	555	538	549	538
q16	525	432	419	419
q17	997	625	716	625
q18	7405	6900	6953	6900
q19	1474	1171	1084	1084
q20	707	384	374	374
q21	3920	3135	2985	2985
q22	1159	1093	1041	1041
Total cold run time: 110516 ms
Total hot run time: 38569 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4378	4353	4284	4284
q2	423	327	321	321
q3	2897	2668	2683	2668
q4	1976	1651	1759	1651
q5	5674	5715	5675	5675
q6	241	154	149	149
q7	2294	1894	1864	1864
q8	3314	3472	3452	3452
q9	8811	8851	8876	8851
q10	3606	3357	3339	3339
q11	649	551	551	551
q12	881	678	668	668
q13	16010	3251	3243	3243
q14	335	305	311	305
q15	592	521	526	521
q16	511	465	464	464
q17	1812	1521	1486	1486
q18	8200	7819	7817	7817
q19	1809	1528	1480	1480
q20	2186	1931	1944	1931
q21	5709	5478	5530	5478
q22	1181	1151	1080	1080
Total cold run time: 73489 ms
Total hot run time: 57278 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 198175 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8c4a2bbf7c44200e33132eaecd0f8eb713ac786f, data reload: false

query1	1314	905	878	878
query2	6452	2007	2028	2007
query3	10652	4076	3890	3890
query4	59647	26435	23391	23391
query5	5873	726	721	721
query6	480	213	210	210
query7	5921	326	334	326
query8	522	436	437	436
query9	8921	2552	2551	2551
query10	579	354	336	336
query11	18149	15120	15529	15120
query12	185	133	125	125
query13	1593	442	446	442
query14	11260	7093	7103	7093
query15	256	195	195	195
query16	7531	509	503	503
query17	1198	630	621	621
query18	1898	378	349	349
query19	309	173	173	173
query20	147	141	139	139
query21	256	144	144	144
query22	4636	4473	4559	4473
query23	34580	34098	34544	34098
query24	6136	2966	2964	2964
query25	588	435	432	432
query26	709	188	182	182
query27	1749	318	314	314
query28	3817	2147	2134	2134
query29	725	489	463	463
query30	240	194	195	194
query31	1033	874	877	874
query32	109	79	97	79
query33	509	354	362	354
query34	916	544	514	514
query35	892	760	763	760
query36	1114	973	977	973
query37	157	103	108	103
query38	3946	3864	3869	3864
query39	1548	1476	1459	1459
query40	232	152	153	152
query41	139	138	136	136
query42	137	114	117	114
query43	551	520	538	520
query44	1126	787	801	787
query45	228	199	195	195
query46	1142	761	770	761
query47	1951	1854	1860	1854
query48	416	351	346	346
query49	947	587	591	587
query50	892	468	472	468
query51	7281	7098	7100	7098
query52	120	108	108	108
query53	301	228	222	222
query54	619	511	517	511
query55	91	90	89	89
query56	331	312	311	311
query57	1257	1125	1112	1112
query58	304	309	301	301
query59	3172	3056	3083	3056
query60	361	329	332	329
query61	147	150	147	147
query62	794	701	711	701
query63	251	226	226	226
query64	3860	2308	1845	1845
query65	3288	3219	3222	3219
query66	953	678	678	678
query67	15759	15260	15404	15260
query68	4652	609	657	609
query69	455	331	322	322
query70	1202	1069	1210	1069
query71	383	325	325	325
query72	6482	2390	2107	2107
query73	787	361	360	360
query74	9134	8834	8983	8834
query75	3440	2757	2832	2757
query76	1944	1129	1085	1085
query77	661	437	466	437
query78	9990	9121	10051	9121
query79	1864	568	565	565
query80	1016	609	613	609
query81	594	262	258	258
query82	364	152	153	152
query83	309	207	209	207
query84	294	104	97	97
query85	1038	369	356	356
query86	411	328	289	289
query87	4411	4299	4215	4215
query88	3662	2544	2518	2518
query89	438	325	335	325
query90	1875	230	231	230
query91	152	128	127	127
query92	88	74	74	74
query93	1443	547	560	547
query94	805	307	317	307
query95	398	300	306	300
query96	609	294	286	286
query97	3267	3159	3115	3115
query98	245	228	228	228
query99	1576	1327	1339	1327
Total cold run time: 317186 ms
Total hot run time: 198175 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.89 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8c4a2bbf7c44200e33132eaecd0f8eb713ac786f, data reload: false

query1	0.05	0.04	0.04
query2	0.08	0.05	0.04
query3	0.23	0.06	0.06
query4	1.65	0.09	0.08
query5	0.53	0.51	0.50
query6	1.14	0.73	0.72
query7	0.02	0.02	0.02
query8	0.06	0.05	0.05
query9	0.55	0.48	0.50
query10	0.55	0.56	0.53
query11	0.16	0.13	0.12
query12	0.16	0.13	0.13
query13	0.63	0.60	0.59
query14	0.76	0.83	0.76
query15	0.84	0.82	0.85
query16	0.36	0.38	0.39
query17	0.99	1.03	1.10
query18	0.21	0.20	0.19
query19	1.96	1.86	1.85
query20	0.01	0.01	0.02
query21	15.40	0.68	0.66
query22	4.61	6.42	2.41
query23	18.34	1.42	1.38
query24	2.13	0.23	0.23
query25	0.15	0.10	0.08
query26	0.26	0.18	0.17
query27	0.09	0.09	0.09
query28	13.23	1.04	1.01
query29	12.61	3.45	3.41
query30	0.43	0.25	0.24
query31	2.80	0.40	0.39
query32	3.24	0.49	0.49
query33	3.01	2.96	3.05
query34	17.06	4.32	4.42
query35	4.46	4.40	4.48
query36	0.67	0.49	0.48
query37	0.21	0.18	0.19
query38	0.16	0.17	0.18
query39	0.08	0.06	0.07
query40	0.19	0.17	0.16
query41	0.12	0.07	0.07
query42	0.08	0.07	0.07
query43	0.08	0.07	0.06
Total cold run time: 110.35 s
Total hot run time: 31.89 s

@suxiaogang223
Copy link
Contributor Author

run buildalll

1 similar comment
@suxiaogang223
Copy link
Contributor Author

run buildalll

@suxiaogang223
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 37920 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b99b4c1c972f754b611bddfca2d96f6d2f6abb52, data reload: false

------ Round 1 ----------------------------------
q1	17779	4584	4302	4302
q2	2026	186	179	179
q3	11430	968	1147	968
q4	10499	703	742	703
q5	7749	2888	2857	2857
q6	221	134	136	134
q7	973	611	593	593
q8	9345	2112	2073	2073
q9	7102	6517	6557	6517
q10	7059	2220	2237	2220
q11	472	241	240	240
q12	394	230	224	224
q13	17983	3032	3046	3032
q14	296	241	248	241
q15	516	475	479	475
q16	504	408	395	395
q17	1034	644	794	644
q18	7371	6792	6910	6792
q19	1414	1094	939	939
q20	667	342	334	334
q21	3980	3058	3114	3058
q22	1130	1062	1000	1000
Total cold run time: 109944 ms
Total hot run time: 37920 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4398	4334	4240	4240
q2	382	269	262	262
q3	2887	2677	2660	2660
q4	1918	1663	1613	1613
q5	5583	5694	5679	5679
q6	239	144	137	137
q7	2252	1884	1855	1855
q8	3309	3436	3469	3436
q9	8836	8818	8772	8772
q10	3612	3375	3398	3375
q11	621	512	511	511
q12	858	674	663	663
q13	14349	3206	3243	3206
q14	325	291	289	289
q15	519	486	503	486
q16	516	447	455	447
q17	1807	1523	1536	1523
q18	8195	7841	7868	7841
q19	1718	1565	1550	1550
q20	2174	1906	1895	1895
q21	5873	5514	5505	5505
q22	1107	1050	1055	1050
Total cold run time: 71478 ms
Total hot run time: 56995 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191630 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b99b4c1c972f754b611bddfca2d96f6d2f6abb52, data reload: false

query1	1269	879	861	861
query2	6297	1962	1890	1890
query3	10612	3944	4021	3944
query4	59446	25715	23180	23180
query5	5333	485	502	485
query6	411	166	167	166
query7	5830	292	286	286
query8	284	200	208	200
query9	8863	2438	2418	2418
query10	481	282	264	264
query11	18043	14980	15166	14980
query12	159	105	101	101
query13	1605	383	382	382
query14	10877	7619	7233	7233
query15	245	174	182	174
query16	7563	518	465	465
query17	1151	551	566	551
query18	2029	295	286	286
query19	306	148	145	145
query20	117	111	110	110
query21	206	104	104	104
query22	4633	4317	4359	4317
query23	34386	33645	33440	33440
query24	5893	2814	2770	2770
query25	530	398	411	398
query26	685	155	152	152
query27	1803	285	277	277
query28	3836	2031	2012	2012
query29	681	403	402	402
query30	244	154	152	152
query31	927	792	744	744
query32	88	55	55	55
query33	415	286	279	279
query34	859	476	465	465
query35	830	727	716	716
query36	1040	917	946	917
query37	143	86	81	81
query38	3889	3886	3952	3886
query39	1454	1375	1393	1375
query40	201	119	112	112
query41	47	44	43	43
query42	116	95	95	95
query43	506	460	469	460
query44	1118	733	760	733
query45	193	166	171	166
query46	1107	719	761	719
query47	1868	1801	1811	1801
query48	370	293	296	293
query49	774	435	436	435
query50	817	408	420	408
query51	7301	6983	7016	6983
query52	100	89	87	87
query53	253	181	179	179
query54	567	467	455	455
query55	79	79	77	77
query56	296	258	266	258
query57	1184	1096	1042	1042
query58	236	252	246	246
query59	2922	2906	2726	2726
query60	302	287	282	282
query61	120	120	117	117
query62	748	673	655	655
query63	213	190	181	181
query64	3459	1847	1852	1847
query65	3226	3171	3180	3171
query66	672	346	350	346
query67	15484	15180	15160	15160
query68	3158	585	594	585
query69	416	280	276	276
query70	1157	1097	1124	1097
query71	375	276	273	273
query72	6381	2454	2324	2324
query73	772	321	324	321
query74	9261	8854	8779	8779
query75	3326	2666	2658	2658
query76	1414	942	1088	942
query77	533	317	306	306
query78	9711	9187	9042	9042
query79	1653	533	526	526
query80	1069	502	505	502
query81	560	231	223	223
query82	735	135	131	131
query83	226	147	144	144
query84	271	74	75	74
query85	882	291	312	291
query86	425	295	298	295
query87	4408	4384	4279	4279
query88	3169	2369	2370	2369
query89	398	285	288	285
query90	1850	195	191	191
query91	134	98	98	98
query92	59	49	53	49
query93	1696	533	533	533
query94	810	306	292	292
query95	355	261	258	258
query96	588	273	275	273
query97	3202	3035	3067	3035
query98	215	201	203	201
query99	1888	1238	1295	1238
Total cold run time: 308839 ms
Total hot run time: 191630 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.47 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b99b4c1c972f754b611bddfca2d96f6d2f6abb52, data reload: false

query1	0.05	0.04	0.04
query2	0.08	0.04	0.04
query3	0.23	0.05	0.05
query4	1.68	0.08	0.07
query5	0.48	0.51	0.49
query6	1.12	0.75	0.73
query7	0.02	0.01	0.02
query8	0.05	0.05	0.04
query9	0.55	0.49	0.49
query10	0.55	0.53	0.54
query11	0.15	0.12	0.11
query12	0.14	0.12	0.12
query13	0.61	0.59	0.59
query14	0.76	0.80	0.77
query15	0.85	0.83	0.82
query16	0.37	0.37	0.37
query17	1.05	1.05	1.05
query18	0.21	0.21	0.21
query19	1.94	1.79	1.79
query20	0.01	0.01	0.00
query21	15.39	0.66	0.66
query22	4.06	6.06	2.65
query23	18.35	1.38	1.28
query24	1.64	0.34	0.22
query25	0.15	0.09	0.08
query26	0.25	0.19	0.18
query27	0.08	0.08	0.07
query28	13.34	1.01	1.00
query29	12.65	3.28	3.27
query30	0.24	0.06	0.06
query31	2.86	0.40	0.39
query32	3.28	0.48	0.48
query33	2.96	3.02	2.98
query34	16.96	4.36	4.39
query35	4.39	4.44	4.40
query36	0.67	0.48	0.49
query37	0.19	0.16	0.16
query38	0.16	0.15	0.16
query39	0.05	0.04	0.03
query40	0.16	0.12	0.13
query41	0.09	0.04	0.04
query42	0.06	0.05	0.05
query43	0.04	0.04	0.04
Total cold run time: 108.92 s
Total hot run time: 31.47 s

morningman
morningman approved these changes Aug 22, 2024
View reviewed changes
Copy link
Contributor

@morningman morningman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Aug 22, 2024
@github-actions GitHub Actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions GitHub Actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@morningman morningman merged commit f53d1eb into apache:master Aug 22, 2024
27 of 30 checks passed
morningman pushed a commit to morningman/doris that referenced this pull request Aug 23, 2024
@suxiaogang223 @morningman
[fix](hive) report error with escape char and null format (apache#39700)
80b3bd4 
## Proposed changes

Because be did not process escape char and null format when reading the
hive text table, an error was reported when fe found that this value was
not the default value.
@morningman morningman mentioned this pull request Aug 23, 2024
Merged
yiguolei pushed a commit that referenced this pull request Aug 24, 2024
@morningman @suxiaogang223
[fix](hive) report error with escape char and null format (#39700) (#…
b9da934 
…39869)

bp #39700

Co-authored-by: Socrates <suxiaogang223@icloud.com>
dataroaring pushed a commit that referenced this pull request Aug 26, 2024
@suxiaogang223 @dataroaring
[fix](hive) report error with escape char and null format (#39700)
00b065d 
## Proposed changes

Because be did not process escape char and null format when reading the
hive text table, an error was reported when fe found that this value was
not the default value.
@suxiaogang223 suxiaogang223 mentioned this pull request Sep 2, 2024
Merged
morningman pushed a commit that referenced this pull request Sep 27, 2024
@suxiaogang223
[fix](hive) support null_format and escape_char for hive text (#40291)
ba6102b 
## Proposed changes
related pr: #39700
support escape.delim and serialization.null.format for hive text
suxiaogang223 added a commit to suxiaogang223/doris that referenced this pull request Oct 10, 2024
@suxiaogang223
[fix](hive) support null_format and escape_char for hive text (apache…
d941524 
…#40291)

## Proposed changes
related pr: apache#39700
support escape.delim and serialization.null.format for hive text
suxiaogang223 added a commit to suxiaogang223/doris that referenced this pull request Oct 10, 2024
@suxiaogang223
[fix](hive) support null_format and escape_char for hive text (apache…
f603ef7 
…#40291)

## Proposed changes
related pr: apache#39700
support escape.delim and serialization.null.format for hive text
suxiaogang223 added a commit to suxiaogang223/doris that referenced this pull request Oct 11, 2024
@suxiaogang223
[fix](hive) support null_format and escape_char for hive text (apache…
cdab0c1 
…#40291)

## Proposed changes
related pr: apache#39700
support escape.delim and serialization.null.format for hive text
@suxiaogang223 suxiaogang223 mentioned this pull request Oct 11, 2024
Merged
cjj2010 pushed a commit to cjj2010/doris that referenced this pull request Oct 12, 2024
@suxiaogang223 @cjj2010
[fix](hive) support null_format and escape_char for hive text (apache…
22d8e71 
…#40291)

## Proposed changes
related pr: apache#39700
support escape.delim and serialization.null.format for hive text
@suxiaogang223 suxiaogang223 deleted the report_error_with_escape_char branch October 21, 2024 11:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@morningman morningman morningman approved these changes

@BePPPower BePPPower BePPPower approved these changes

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. dev/2.1.6-merged dev/3.0.2-merged reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
6 participants
@suxiaogang223 @doris-robot @morningman @BePPPower @yiguolei @dataroaring