[Feature] Support jodatime_format function to partition pruning #52620

renzhimin7 · 2024-11-05T07:34:19Z

Why I'm doing:

hive 外表testDb.testTable 分区字段是dt ，有6个分区
dt=20241101
dt=20241102
dt=20241103
dt=20241104
dt=20241105
dt=20241106
在执行下面SQL时，无法执行分区裁剪
select * from flight.zhimin_t where dt = jodatime_format('2024-11-02 15:58:51', 'yyyyMMdd')

What I'm doing:

增加jodatime_format转换方法
验证可以裁剪

Fixes #52680

What type of PR is this:

Does this PR entail a change in behavior?

Yes, this PR will result in a change in behavior.
No, this PR will not result in a change in behavior.

If yes, please specify the type of change:

Interface/UI changes: syntax, type conversion, expression evaluation, display information
Parameter changes: default values, similar parameters but with different default values
Policy changes: use new policy to replace old one, functionality automatically enabled
Feature removed
Miscellaneous: upgrade & downgrade compatibility, etc.

Checklist:

I have added test cases for my bug fix or my new feature
This pr needs user documentation (for new or modified features or behaviors)
I have added documentation for my new feature or new function
This is a backport pr

Bugfix cherry-pick branch check:

fe/fe-core/src/main/java/com/starrocks/sql/optimizer/rewrite/ScalarOperatorFunctions.java

Signed-off-by: zhiminr.ren <1240388654@qq.com>

trueeyu · 2024-11-07T08:32:01Z

@Mergifyio rebase main

mergify · 2024-11-07T08:32:35Z

rebase main

✅ Branch has been successfully rebased

Signed-off-by: zhiminr.ren <1240388654@qq.com>

…min7-main

Signed-off-by: zhiminr.ren <1240388654@qq.com>

fe/fe-core/src/main/java/com/starrocks/sql/optimizer/rewrite/ScalarOperatorFunctions.java

Signed-off-by: zhiminr.ren <1240388654@qq.com>

sonarqubecloud · 2024-11-12T01:46:39Z

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarCloud

github-actions · 2024-11-12T03:26:20Z

[Java-Extensions Incremental Coverage Report]

✅ pass : 0 / 0 (0%)

github-actions · 2024-11-12T03:26:57Z

[FE Incremental Coverage Report]

✅ pass : 9 / 9 (100.00%)

file detail

	path	covered_line	new_line	coverage	not_covered_line_detail
🔵	com/starrocks/sql/optimizer/rewrite/ScalarOperatorFunctions.java	9	9	100.00%	[]

github-actions · 2024-11-12T03:27:09Z

[BE Incremental Coverage Report]

✅ pass : 0 / 0 (0%)

murphyatwork · 2024-11-15T01:59:29Z

@mergify backport branch-3.3 branch-3.2

mergify · 2024-11-15T01:59:39Z

backport branch-3.3 branch-3.2

✅ Backports have been created

#52915 [Feature] Support jodatime_format function to partition pruning (backport #52620) has been created for branch branch-3.3
#52916 [Feature] Support jodatime_format function to partition pruning (backport #52620) has been created for branch branch-3.2 but encountered conflicts

Signed-off-by: zhiminr.ren <1240388654@qq.com> (cherry picked from commit f0ef59e)

Signed-off-by: zhiminr.ren <1240388654@qq.com> (cherry picked from commit f0ef59e) # Conflicts: # fe/fe-core/src/main/java/com/starrocks/sql/optimizer/rewrite/ScalarOperatorFunctions.java

Signed-off-by: zhiminr.ren <1240388654@qq.com> (cherry picked from commit f0ef59e) Signed-off-by: Murphy <mofei@starrocks.com> # Conflicts: # fe/fe-core/src/main/java/com/starrocks/sql/optimizer/rewrite/ScalarOperatorFunctions.java

…port #52620) (#52916) Co-authored-by: renzhimin7 <1240388654@qq.com>

…port #52620) (#52915) Co-authored-by: renzhimin7 <1240388654@qq.com>

renzhimin7 requested a review from a team as a code owner November 5, 2024 07:34

github-actions bot added the title needs [type] label Nov 5, 2024

mergify bot assigned renzhimin7 Nov 5, 2024

starrocks-cr bot reviewed Nov 5, 2024

View reviewed changes

fe/fe-core/src/main/java/com/starrocks/sql/optimizer/rewrite/ScalarOperatorFunctions.java Show resolved Hide resolved

renzhimin7 changed the title ~~Support jodatime_format function to partition pruning~~ [Feature] Support jodatime_format function to partition pruning Nov 5, 2024

github-actions bot removed the title needs [type] label Nov 5, 2024

renzhimin7 force-pushed the renzhimin7-main branch from ab5c8ba to 51c8575 Compare November 5, 2024 08:17

renzhimin7 added 3 commits November 5, 2024 20:54

Support jodatime_fata function to partition pruning

16dedb1

Signed-off-by: zhiminr.ren <1240388654@qq.com>

Support jodatime_fata function to partition pruning

2ecbdb8

Signed-off-by: zhiminr.ren <1240388654@qq.com>

Support jodatime_fata function to partition pruning

5d21686

Signed-off-by: zhiminr.ren <1240388654@qq.com>

renzhimin7 force-pushed the renzhimin7-main branch from 7a0188a to 5d21686 Compare November 5, 2024 12:55

Astralidea previously approved these changes Nov 5, 2024

View reviewed changes

Seaven previously approved these changes Nov 6, 2024

View reviewed changes

Astralidea enabled auto-merge (squash) November 6, 2024 19:01

auto-merge was automatically disabled November 7, 2024 04:36
Head branch was pushed to by a user without write access

renzhimin7 dismissed stale reviews from Seaven and Astralidea via 76f878b November 7, 2024 04:36

Support jodatime_fata function to partition pruning

fc91bff

Signed-off-by: zhiminr.ren <1240388654@qq.com>

renzhimin7 force-pushed the renzhimin7-main branch from 76f878b to fc91bff Compare November 7, 2024 05:29

trueeyu previously approved these changes Nov 7, 2024

View reviewed changes

Seaven previously approved these changes Nov 7, 2024

View reviewed changes

trueeyu force-pushed the renzhimin7-main branch from fc91bff to 237bc03 Compare November 7, 2024 08:32

Support jodatime_format function to partition pruning

f0cd76f

Signed-off-by: zhiminr.ren <1240388654@qq.com>

renzhimin7 dismissed stale reviews from trueeyu and Seaven via f0cd76f November 7, 2024 11:19

renzhimin7 force-pushed the renzhimin7-main branch from 237bc03 to f0cd76f Compare November 7, 2024 11:19

renzhimin7 added 2 commits November 7, 2024 21:16

Support jodatime_format function to partition pruning

ef9b875

Signed-off-by: zhiminr.ren <1240388654@qq.com>

Merge remote-tracking branch 'renzhimin7/renzhimin7-main' into renzhi…

2ecf4c1

…min7-main

renzhimin7 added 4 commits November 9, 2024 14:16

Support jodatime_format function to partition pruning

87743af

Signed-off-by: zhiminr.ren <1240388654@qq.com>

Support jodatime_format function to partition pruning

199c8a8

Signed-off-by: zhiminr.ren <1240388654@qq.com>

Support jodatime_format function to partition pruning

b3239e4

Signed-off-by: zhiminr.ren <1240388654@qq.com>

Support jodatime_format function to partition pruning

dee396c

Signed-off-by: zhiminr.ren <1240388654@qq.com>

Astralidea enabled auto-merge (squash) November 10, 2024 16:22

murphyatwork reviewed Nov 11, 2024

View reviewed changes

fe/fe-core/src/main/java/com/starrocks/sql/optimizer/rewrite/ScalarOperatorFunctions.java Outdated Show resolved Hide resolved

Support jodatime_format function to partition pruning

ce1c6b7

Signed-off-by: zhiminr.ren <1240388654@qq.com>

auto-merge was automatically disabled November 12, 2024 01:38
Head branch was pushed to by a user without write access

murphyatwork approved these changes Nov 12, 2024

View reviewed changes

Youngwb approved these changes Nov 12, 2024

View reviewed changes

Youngwb enabled auto-merge (squash) November 12, 2024 02:17

Seaven approved these changes Nov 14, 2024

View reviewed changes

Youngwb merged commit f0ef59e into StarRocks:main Nov 14, 2024
53 checks passed

github-actions bot added the version:3.4 label Nov 14, 2024

wanpengfei-git mentioned this pull request Nov 14, 2024

Support jodatime_format function to partition pruning #52680

Open

1 task

mergify bot pushed a commit that referenced this pull request Nov 15, 2024

[Feature] Support jodatime_format function to partition pruning (#52620)

898000e

Signed-off-by: zhiminr.ren <1240388654@qq.com> (cherry picked from commit f0ef59e)

This was referenced Nov 15, 2024

[Feature] Support jodatime_format function to partition pruning (backport #52620) #52915

Merged

[Feature] Support jodatime_format function to partition pruning (backport #52620) #52916

Merged

wanpengfei-git pushed a commit that referenced this pull request Nov 15, 2024

[Feature] Support jodatime_format function to partition pruning (back…

9d27779

…port #52620) (#52916) Co-authored-by: renzhimin7 <1240388654@qq.com>

github-actions bot added the 3.2-merged label Nov 15, 2024

wanpengfei-git pushed a commit that referenced this pull request Nov 15, 2024

[Feature] Support jodatime_format function to partition pruning (back…

4b0bc86

…port #52620) (#52915) Co-authored-by: renzhimin7 <1240388654@qq.com>

github-actions bot added the 3.3-merged label Nov 15, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Feature] Support jodatime_format function to partition pruning #52620

[Feature] Support jodatime_format function to partition pruning #52620

renzhimin7 commented Nov 5, 2024 •

edited by Astralidea

Loading

trueeyu commented Nov 7, 2024

mergify bot commented Nov 7, 2024

sonarqubecloud bot commented Nov 12, 2024

github-actions bot commented Nov 12, 2024

github-actions bot commented Nov 12, 2024

github-actions bot commented Nov 12, 2024

murphyatwork commented Nov 15, 2024

mergify bot commented Nov 15, 2024 •

edited

Loading

[Feature] Support jodatime_format function to partition pruning #52620

[Feature] Support jodatime_format function to partition pruning #52620

Conversation

renzhimin7 commented Nov 5, 2024 • edited by Astralidea Loading

Why I'm doing:

What I'm doing:

What type of PR is this:

Checklist:

Bugfix cherry-pick branch check:

trueeyu commented Nov 7, 2024

mergify bot commented Nov 7, 2024

✅ Branch has been successfully rebased

sonarqubecloud bot commented Nov 12, 2024

Quality Gate passed

github-actions bot commented Nov 12, 2024

[Java-Extensions Incremental Coverage Report]

github-actions bot commented Nov 12, 2024

[FE Incremental Coverage Report]

file detail

github-actions bot commented Nov 12, 2024

[BE Incremental Coverage Report]

murphyatwork commented Nov 15, 2024

mergify bot commented Nov 15, 2024 • edited Loading

✅ Backports have been created

renzhimin7 commented Nov 5, 2024 •

edited by Astralidea

Loading

mergify bot commented Nov 15, 2024 •

edited

Loading