Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Enhancement] import 2.5 enhancement #11380 port ORCHdfsFileStream to OrcScanner to… #24946

Open
wants to merge 7 commits into
base: branch-2.3
Choose a base branch
from

Conversation

XinzhuangL
Copy link
Contributor

@XinzhuangL XinzhuangL commented Jun 9, 2023

Fixes #issue

What type of PR is this:

  • BugFix
  • Feature
  • Enhancement
  • Refactor
  • UT
  • Doc
  • Tool

Checklist:

  • I have added test cases for my bug fix or my new feature
  • This pr will affect users' behaviors
  • This pr needs user documentation (for new or modified features or behaviors)
    • I have added documentation for my new feature or new function

Bugfix cherry-pick branch check:

import 2.5 enhancement #11380 port ORCHdfsFileStream to OrcScanner to 2.3

“Class ORCHdfsFileStream has capability to do pre-read and io coalesce functionalities. However OrcScanner does not use it, which makes broker load extremly slow and do a lot of random IO.
With this enhancement, case2 can be cutdown from 35s -> 5/6s.”

XinzhuangL and others added 7 commits April 26, 2023 10:03
…canner to 2.3

Signed-off-by: lixinzhuang1 <lixinzhuang1@jd.com>
Signed-off-by: lixinzhuang1 <lixinzhuang1@jd.com>
Signed-off-by: lixinzhuang1 <lixinzhuang1@jd.com>
Signed-off-by: lixinzhuang1 <lixinzhuang1@jd.com>
Signed-off-by: lixinzhuang1 <lixinzhuang1@jd.com>
Signed-off-by: lixinzhuang1 <lixinzhuang1@jd.com>
@XinzhuangL XinzhuangL changed the title Branch 2.3 [Enhancement] import 2.5 enhancement #11380 port ORCHdfsFileStream to OrcScanner to… Jun 9, 2023
@XinzhuangL XinzhuangL closed this Jun 9, 2023
@XinzhuangL XinzhuangL reopened this Jun 9, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant