Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Revert "[bugfix](paimon)upgrade paimon to 0.9" #42075

Merged
merged 1 commit into from
Oct 18, 2024

Conversation

morningman
Copy link
Contributor

Reverts #41337
paimon 0.9 introduce a breaking change that user can not read bucket table without bucket key.

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@morningman
Copy link
Contributor Author

run buildall

Copy link
Contributor

@kaka11chen kaka11chen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Oct 18, 2024
Copy link
Contributor

PR approved by at least one committer and no changes requested.

Copy link
Contributor

PR approved by anyone and no changes requested.

Copy link
Member

@CalvinKirs CalvinKirs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Since shade version 2.1.2 only updates Paimon, it is sufficient to roll back to 2.1.1. If Paimon releases a compatible version in the future, I will re-release the shade version.

@doris-robot
Copy link

TPC-H: Total hot run time: 41587 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ae9590f0debe412e66108a3a5f30f9697b45910a, data reload: false

------ Round 1 ----------------------------------
q1	17565	7443	7322	7322
q2	2025	288	288	288
q3	12043	1092	1192	1092
q4	10567	863	899	863
q5	7746	3110	3075	3075
q6	235	149	152	149
q7	1003	634	616	616
q8	9367	1971	1949	1949
q9	6632	6468	6458	6458
q10	7094	2412	2491	2412
q11	441	250	246	246
q12	411	227	230	227
q13	17792	3010	3007	3007
q14	244	209	216	209
q15	561	526	530	526
q16	653	570	586	570
q17	969	541	495	495
q18	7399	6714	6763	6714
q19	1353	956	1054	956
q20	472	189	186	186
q21	4003	3231	3388	3231
q22	1083	1002	996	996
Total cold run time: 109658 ms
Total hot run time: 41587 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7306	7314	7328	7314
q2	327	245	246	245
q3	3055	2989	3022	2989
q4	2061	1829	1803	1803
q5	5766	5818	5847	5818
q6	233	146	151	146
q7	2289	1842	1817	1817
q8	3412	3449	3503	3449
q9	8958	8967	9046	8967
q10	3630	3576	3621	3576
q11	591	493	492	492
q12	860	642	642	642
q13	11169	3277	3201	3201
q14	303	275	267	267
q15	598	529	536	529
q16	702	638	633	633
q17	1856	1653	1601	1601
q18	8374	7836	7693	7693
q19	1711	1625	1617	1617
q20	2106	1909	1871	1871
q21	5621	5554	5521	5521
q22	1151	1077	1071	1071
Total cold run time: 72079 ms
Total hot run time: 61262 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192169 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ae9590f0debe412e66108a3a5f30f9697b45910a, data reload: false

query1	893	392	404	392
query2	6246	2127	2107	2107
query3	8690	194	199	194
query4	34134	23767	23711	23711
query5	3354	487	462	462
query6	261	170	162	162
query7	4195	311	285	285
query8	289	230	240	230
query9	9664	2743	2717	2717
query10	453	276	283	276
query11	18007	15489	15261	15261
query12	171	103	100	100
query13	1567	445	396	396
query14	9864	7543	6955	6955
query15	257	170	185	170
query16	7981	463	482	463
query17	1583	604	577	577
query18	2096	333	322	322
query19	318	161	167	161
query20	126	113	114	113
query21	219	113	108	108
query22	4837	4408	4647	4408
query23	35133	34440	34242	34242
query24	10971	2724	2758	2724
query25	636	411	412	411
query26	1151	160	163	160
query27	2309	283	287	283
query28	7493	2430	2414	2414
query29	833	428	420	420
query30	263	148	156	148
query31	1062	775	810	775
query32	97	55	58	55
query33	781	293	299	293
query34	926	503	524	503
query35	911	770	775	770
query36	1104	957	951	951
query37	161	90	91	90
query38	4031	3874	3901	3874
query39	1478	1429	1423	1423
query40	207	99	99	99
query41	50	47	48	47
query42	122	101	101	101
query43	542	501	499	499
query44	1241	808	802	802
query45	201	166	167	166
query46	1147	695	687	687
query47	1935	1824	1789	1789
query48	425	319	327	319
query49	964	437	440	437
query50	820	393	395	393
query51	7051	7057	6994	6994
query52	101	88	91	88
query53	253	181	189	181
query54	1119	440	431	431
query55	85	78	78	78
query56	275	287	260	260
query57	1312	1153	1159	1153
query58	238	238	236	236
query59	3209	3034	2982	2982
query60	300	275	276	275
query61	109	102	99	99
query62	877	695	661	661
query63	230	193	190	190
query64	4080	648	607	607
query65	3294	3232	3261	3232
query66	824	303	306	303
query67	15993	15634	15681	15634
query68	4471	548	565	548
query69	484	314	289	289
query70	1186	1131	1090	1090
query71	366	277	282	277
query72	7242	4021	4044	4021
query73	772	359	359	359
query74	10373	9037	9068	9037
query75	3469	2651	2690	2651
query76	2876	946	913	913
query77	620	313	301	301
query78	10430	9690	9553	9553
query79	1325	595	587	587
query80	1062	451	467	451
query81	589	250	244	244
query82	746	147	139	139
query83	302	133	134	133
query84	271	71	69	69
query85	1307	299	287	287
query86	343	297	308	297
query87	4446	4301	4278	4278
query88	3876	2200	2178	2178
query89	406	289	290	289
query90	2184	192	190	190
query91	134	101	100	100
query92	61	49	51	49
query93	1134	535	530	530
query94	1070	294	296	294
query95	359	252	250	250
query96	624	287	290	287
query97	3284	3121	3150	3121
query98	223	211	195	195
query99	1574	1331	1313	1313
Total cold run time: 299158 ms
Total hot run time: 192169 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.37 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ae9590f0debe412e66108a3a5f30f9697b45910a, data reload: false

query1	0.04	0.03	0.02
query2	0.06	0.03	0.02
query3	0.22	0.07	0.07
query4	1.64	0.10	0.10
query5	0.52	0.52	0.51
query6	1.12	0.73	0.72
query7	0.02	0.02	0.01
query8	0.03	0.03	0.04
query9	0.57	0.49	0.48
query10	0.55	0.56	0.55
query11	0.15	0.10	0.12
query12	0.14	0.11	0.11
query13	0.61	0.61	0.59
query14	2.81	2.79	2.74
query15	0.92	0.82	0.84
query16	0.39	0.39	0.38
query17	1.07	1.07	0.99
query18	0.19	0.19	0.20
query19	1.96	1.79	2.01
query20	0.01	0.01	0.01
query21	15.39	0.61	0.59
query22	2.73	1.91	1.84
query23	17.22	0.91	0.77
query24	2.76	1.59	0.75
query25	0.25	0.12	0.08
query26	0.38	0.14	0.14
query27	0.04	0.05	0.05
query28	10.74	1.10	1.07
query29	12.56	3.23	3.23
query30	0.25	0.06	0.07
query31	2.85	0.36	0.39
query32	3.28	0.46	0.48
query33	2.99	3.02	3.04
query34	17.09	4.46	4.49
query35	4.54	4.56	4.49
query36	0.69	0.49	0.47
query37	0.08	0.06	0.06
query38	0.04	0.03	0.04
query39	0.03	0.02	0.02
query40	0.17	0.12	0.12
query41	0.08	0.02	0.03
query42	0.03	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 107.24 s
Total hot run time: 32.37 s

@morningman morningman merged commit fc3e99b into master Oct 18, 2024
39 of 40 checks passed
@dataroaring dataroaring deleted the revert-41337-fix-paimon-upgrade-0.9 branch January 19, 2025 09:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants