-
Notifications
You must be signed in to change notification settings - Fork 2.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Flink: Add disk-based insertedRowMap to resolve the OOM while ingesting. #4298
Conversation
@openinx, is this related to the other PR that refactors the writers? Should we work on this one or the other one first? Also, is there any way to break this into smaller PRs for review? This is quite large and I'm concerned about getting it reviewed since it is big. |
This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull request requires a review, please simply write any comment. If closed, you can revive the PR at any time and @mention a reviewer or discuss it on the dev@iceberg.apache.org list. Thank you for your contributions. |
This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If you think that is incorrect, or the pull request requires review, you can revive the PR at any time. |
This PR is trying to add the disk-based insertedRowMap (which was published here before) on top of the newly introduced
PartitioningWriter
interfaces.