Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable lookup-joins for join benchmarks based on session settings #323

Merged
merged 1 commit into from
Sep 9, 2024

Conversation

mkleen
Copy link
Contributor

@mkleen mkleen commented Aug 28, 2024

Summary of the changes / Why this is an improvement

Depending on mfussenegger/cr8#381

Checklist

  • Link to issue this PR refers to (if applicable):
  • CLA is signed

@mkleen mkleen requested a review from matriv August 28, 2024 08:05
specs/joins.toml Outdated
@@ -8,6 +8,9 @@ statements = [
"optimize table articles with (max_num_segments = 1)",
]

[session_settings]
optimizer_equi_join_to_lookup_join = "true"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

do we need it true here? This can make joins which were executed with hashjoin all this time to be executed with lookup join now, no? Isn't it enough to set it only to the other lookup_join.toml file?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why would we disable a join optimization in a join benchmark ? For the query
"select * from articles inner join colors on articles.id = colors.id where colors.id = -1"
this optimization is significant.
Screenshot 2024-08-28 at 11 24 18

Copy link
Contributor

@matriv matriv Aug 28, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

my concern is that then we loose benchmark info for a normal inner hash join. Can we track perf regressions for this case then by another query?
If not, imho, we could add it to the specialized file for lookup joins.

@mkleen mkleen requested a review from matriv August 28, 2024 09:39
@matriv
Copy link
Contributor

matriv commented Aug 28, 2024

I believe you need to update this: https://github.com/crate/crate-benchmarks/blob/master/requirements.txt#L14 once cr8 with the new functionality is released.

@mkleen mkleen merged commit 85a2c5b into master Sep 9, 2024
@mkleen mkleen deleted the mkleen/enable-lookup-joins branch September 9, 2024 12:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants