Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[xray] Fix UniqueID hashing for object and task IDs. #2017

Merged
merged 2 commits into from
May 11, 2018

Conversation

stephanie-wang
Copy link
Contributor

What do these changes do?

ObjectIDs in xray share the same suffix as the ID of the task that created the objects. The prefix is the index of the object creation (0 for the task, <0 for objects created by ray.put, >0 for returned objects). Therefore, hashing on the prefix bytes will cause more collisions than expected. This PR skips the prefix for the UniqueID hash function.

@AmplabJenkins
Copy link

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/5276/
Test PASSed.

Copy link
Contributor

@pcmoritz pcmoritz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1 Good catch!

@pcmoritz
Copy link
Contributor

@stephanie-wang Can you fix the linting error?

@AmplabJenkins
Copy link

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/5315/
Test PASSed.

@stephanie-wang stephanie-wang merged commit a292d7b into ray-project:master May 11, 2018
@stephanie-wang stephanie-wang deleted the unique-id-hash branch May 11, 2018 04:56
alok added a commit to alok/ray that referenced this pull request May 11, 2018
* master:
  [xray] Fix UniqueID hashing for object and task IDs. (ray-project#2017)
  [DataFrame] Fixing bugs in groupby (ray-project#2031)
  [DataFrame] Fixes dropna subset bug (ray-project#2018)
alok added a commit to alok/ray that referenced this pull request May 11, 2018
* master:
  [xray] Fix UniqueID hashing for object and task IDs. (ray-project#2017)
  [DataFrame] Fixing bugs in groupby (ray-project#2031)
  [DataFrame] Fixes dropna subset bug (ray-project#2018)
  [DataFrame] Implement where (ray-project#1989)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants