Skip to content

Replace TypedSet with new BlockSet #18034

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Jun 26, 2023
Merged

Replace TypedSet with new BlockSet #18034

merged 1 commit into from
Jun 26, 2023

Conversation

dain
Copy link
Member

@dain dain commented Jun 25, 2023

Description

BlockSet does not copy values out of the input blocks, and instead a direct reference is kept. This improves performance for cases where the set is a temporary data structure.
Most uses of TypedSet can be replaced with BlockSet, because the set is used in a single lexical scope.

Release notes

(x) This is not user-visible or docs only and no release notes are required.

@dain dain requested a review from electrum June 25, 2023 04:07
@cla-bot cla-bot bot added the cla-signed label Jun 25, 2023
@raunaqmorarka
Copy link
Member

Can we use BlockSet instead of TypedSet in DynamicFilterSourceOperator as well ? We have a JMH benchmark BenchmarkDynamicFilterSourceOperator available to see if it improves perf.

@dain
Copy link
Member Author

dain commented Jun 26, 2023

Can we use BlockSet instead of TypedSet in DynamicFilterSourceOperator as well ? We have a JMH benchmark BenchmarkDynamicFilterSourceOperator available to see if it improves perf.

No, but I have a branch that rewrites that part that I'll be putting up for review soon

@dain dain requested a review from electrum June 26, 2023 19:48
BlockSet does not copy values out of the input blocks, and instead a
direct reference is kept. This improves performance for cases where the
set is a temporary data structure.
@dain dain merged commit 601bdcb into trinodb:master Jun 26, 2023
@dain dain deleted the block-set branch June 26, 2023 22:08
@github-actions github-actions bot added this to the 421 milestone Jun 26, 2023
@martint martint mentioned this pull request Jul 10, 2023
19 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Development

Successfully merging this pull request may close these issues.

3 participants