Skip to content

Conversation

@stephanie-wang
Copy link
Contributor

What do these changes do?

ObjectIDs in xray share the same suffix as the ID of the task that created the objects. The prefix is the index of the object creation (0 for the task, <0 for objects created by ray.put, >0 for returned objects). Therefore, hashing on the prefix bytes will cause more collisions than expected. This PR skips the prefix for the UniqueID hash function.

@AmplabJenkins
Copy link

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/5276/
Test PASSed.

Copy link
Contributor

@pcmoritz pcmoritz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1 Good catch!

@pcmoritz
Copy link
Contributor

@stephanie-wang Can you fix the linting error?

@AmplabJenkins
Copy link

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/5315/
Test PASSed.

@stephanie-wang stephanie-wang merged commit a292d7b into ray-project:master May 11, 2018
@stephanie-wang stephanie-wang deleted the unique-id-hash branch May 11, 2018 04:56
alok added a commit to alok/ray that referenced this pull request May 11, 2018
* master:
  [xray] Fix UniqueID hashing for object and task IDs. (ray-project#2017)
  [DataFrame] Fixing bugs in groupby (ray-project#2031)
  [DataFrame] Fixes dropna subset bug (ray-project#2018)
alok added a commit to alok/ray that referenced this pull request May 11, 2018
* master:
  [xray] Fix UniqueID hashing for object and task IDs. (ray-project#2017)
  [DataFrame] Fixing bugs in groupby (ray-project#2031)
  [DataFrame] Fixes dropna subset bug (ray-project#2018)
  [DataFrame] Implement where (ray-project#1989)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants