Skip to content

supports falling back hash join to sort merge join when hash table is too big#753

Merged
lihao712 merged 1 commit intomasterfrom
dev-hj-fallback-smj
Jan 17, 2025
Merged

supports falling back hash join to sort merge join when hash table is too big#753
lihao712 merged 1 commit intomasterfrom
dev-hj-fallback-smj

Conversation

@richox
Copy link
Contributor

@richox richox commented Jan 9, 2025

partially close #721
we cannot use partition-merge based solution because it breaks the output ordering. so we use a fallback approach to avoid creating too big hash tables.

@richox richox force-pushed the dev-hj-fallback-smj branch 2 times, most recently from c64aaf3 to ca69b3b Compare January 9, 2025 16:55
@richox richox changed the title WIP: supports falling back hash join to sort merge join when hash table is too big supports falling back hash join to sort merge join when hash table is too big Jan 13, 2025
@richox richox force-pushed the dev-hj-fallback-smj branch 2 times, most recently from 00ca59a to e70e799 Compare January 14, 2025 08:12
@richox richox force-pushed the dev-hj-fallback-smj branch from e70e799 to 67ee5d2 Compare January 17, 2025 02:48
@lihao712 lihao712 merged commit e05b838 into master Jan 17, 2025
618 checks passed
@richox richox mentioned this pull request Apr 27, 2025
@cxzl25 cxzl25 deleted the dev-hj-fallback-smj branch September 5, 2025 08:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Spillable broadcast/shuffled hash join

2 participants