Skip to content

Conversation

jayzhan211
Copy link
Contributor

Which issue does this PR close?

Closes #.

Rationale for this change

While working on #7629, I found create_hashes is placed to physical-expr.

Hash utils only import functions from arrow, std, and df-common. It seems it should be placed to df-common not physical-expr.

What changes are included in this PR?

We can have hash_utils from df-common.

Are these changes tested?

Nope, only import is modified, no need to add additional tests.

Are there any user-facing changes?

@github-actions github-actions bot added the physical-expr Changes to the physical-expr crates label Sep 28, 2023
Copy link
Contributor

@alamb alamb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you @jayzhan211

I double checked and this change adds no new dependencies:
https://crates.io/crates/half/reverse_dependencies is already a dependency on arrow as is ahash: https://crates.io/crates/ahash/reverse_dependencies?page=3

@@ -28,7 +28,6 @@ pub mod equivalence;
pub mod execution_props;
pub mod expressions;
pub mod functions;
pub mod hash_utils;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this is technically a breaking change if someone used hash_utils directly in their code.

Perhaps we could leave a pointer like

Suggested change
pub mod hash_utils;
// backwards compatibility
pub use datafusion_common::hash_util;

But I don't think that is critical

Signed-off-by: jayzhan211 <jayzhan211@gmail.com>
Signed-off-by: jayzhan211 <jayzhan211@gmail.com>
@jayzhan211
Copy link
Contributor Author

how to re-run CI without code changes?

@alamb
Copy link
Contributor

alamb commented Sep 29, 2023

how to re-run CI without code changes?

You can go to the job and click rerun:

https://github.com/apache/arrow-datafusion/actions/runs/6345797930/job/17238371168?pr=7684

Screenshot 2023-09-29 at 9 52 45 AM

@jayzhan211
Copy link
Contributor Author

Screenshot 2023-09-29 at 22 24 29
I dont have the option :(

@alamb
Copy link
Contributor

alamb commented Sep 29, 2023

I dont have the option :(

It must be related to permissions.

Another way to do so is to merge up from main (git merge apache/main) which I just did for this PR -- I'll plan to merge it once CI passes. Thank you

@alamb alamb merged commit 85f3578 into apache:main Sep 29, 2023
Ted-Jiang pushed a commit to Ted-Jiang/arrow-datafusion that referenced this pull request Oct 7, 2023
* move hash utils to common

Signed-off-by: jayzhan211 <jayzhan211@gmail.com>

* support backward compatibility

Signed-off-by: jayzhan211 <jayzhan211@gmail.com>

---------

Signed-off-by: jayzhan211 <jayzhan211@gmail.com>
Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
physical-expr Changes to the physical-expr crates
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants