Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BugFix] Fix array parquet def, rep level parsed error #17626

Merged
merged 1 commit into from
Feb 10, 2023

Conversation

Smith-Cruise
Copy link
Contributor

@Smith-Cruise Smith-Cruise commented Feb 9, 2023

What type of PR is this:

  • BugFix
  • Feature
  • Enhancement
  • Refactor
  • UT
  • Doc
  • Tool

Which issues of this PR fixes :

Fixes #

Problem Summary(Required) :

Sometimes we faced that chunk's check_or_die() method failed in ArrayColumn, the reason is that:
A chunk's size is 4096, but sometimes RepeatedColumnReader will read one more (rep & def) level, so in def_rep_to_offset method, it will calculate as 4097 rows, which means this ArrayColumn's size is 4097, not satisfied chunk's size.

Checklist:

  • I have added test cases for my bug fix or my new feature
  • This pr will affect users' behaviors
  • This pr needs user documentation (for new or modified features or behaviors)
    • I have added documentation for my new feature or new function

Bugfix cherry-pick branch check:

  • I have checked the version labels which the pr will be auto backported to target branch
    • 2.5
    • 2.4
    • 2.3
    • 2.2

@Smith-Cruise Smith-Cruise changed the title [BugFix] Fix array parquet def, rep level parse error [BugFix] Fix array parquet def, rep level parsed error Feb 9, 2023
@github-actions github-actions bot added the 2.5 label Feb 9, 2023
@Smith-Cruise Smith-Cruise force-pushed the fix-struct-parquet branch 3 times, most recently from fd2e525 to 17b4b9c Compare February 9, 2023 13:10
@github-actions github-actions bot removed the 2.5 label Feb 9, 2023
@Smith-Cruise
Copy link
Contributor Author

run starrocks_be_unittest

1 similar comment
@Smith-Cruise
Copy link
Contributor Author

run starrocks_be_unittest

@Smith-Cruise Smith-Cruise force-pushed the fix-struct-parquet branch 2 times, most recently from 3931219 to 751806b Compare February 9, 2023 16:33
Signed-off-by: Smith Cruise <chendingchao1@126.com>
@github-actions
Copy link

github-actions bot commented Feb 9, 2023

clang-tidy review says "All clean, LGTM! 👍"

@wanpengfei-git wanpengfei-git added the Approved Ready to merge label Feb 10, 2023
@wanpengfei-git
Copy link
Collaborator

run starrocks_admit_test

@Smith-Cruise
Copy link
Contributor Author

run starrocks_admit_test

@stephen-shelby stephen-shelby merged commit d9c249e into StarRocks:main Feb 10, 2023
@github-actions github-actions bot added 2.5 and removed Approved Ready to merge be-build labels Feb 10, 2023
@Smith-Cruise Smith-Cruise deleted the fix-struct-parquet branch February 10, 2023 05:51
@github-actions
Copy link

clang-tidy review says "All clean, LGTM! 👍"

@sonarqubecloud
Copy link

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

No Coverage information No Coverage information
0.7% 0.7% Duplication

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants