Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a distributed Dataframe API to Ray #1330

Merged
merged 17 commits into from
Dec 20, 2017
Merged

Add a distributed Dataframe API to Ray #1330

Changes from 1 commit
Commits
Show all changes
17 commits
Select commit Hold shift + click to select a range
abc5376
Adding dataframe object and minor APIs
devin-petersohn Dec 9, 2017
1eb5f24
Adding reduce functionality
devin-petersohn Dec 12, 2017
9279e41
Adding some print and making reduce work on current Ray
devin-petersohn Dec 12, 2017
f13cc38
Cleanup
devin-petersohn Dec 12, 2017
e736d3f
Added new functionality and docs.
devin-petersohn Dec 14, 2017
44b5e15
Adding more functionality.
devin-petersohn Dec 14, 2017
9430d5b
New functionality with older cleanup
devin-petersohn Dec 15, 2017
d9fa1be
Complying with flake8 formatting
devin-petersohn Dec 16, 2017
8f1f91b
Added tests and addressed reviewer comments
devin-petersohn Dec 17, 2017
7de0254
Complying with flake8.
devin-petersohn Dec 18, 2017
8f3f054
Adding pandas to travis and requirements doc
devin-petersohn Dec 19, 2017
26a68c3
Fixing flake8 failures
devin-petersohn Dec 19, 2017
6bf51d6
Fixing flake8 errors from imports
devin-petersohn Dec 19, 2017
7dddd0e
Fixing import error
devin-petersohn Dec 19, 2017
23b6222
Fixing import errors
devin-petersohn Dec 19, 2017
3b32a84
Addressing reviewer comments
devin-petersohn Dec 20, 2017
e171e66
Addressing lint error
devin-petersohn Dec 20, 2017
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Fixing flake8 errors from imports
  • Loading branch information
@devin-petersohn
devin-petersohn committed Dec 19, 2017
commit 6bf51d604fb9123ade300fdaf986e0bc347469aa
5 changes: 3 additions & 2 deletions python/ray/dataframe/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
# from .dataframe import DataFrame
from .dataframe import *
from .dataframe import DataFrame
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more. 

from __future__ import absolute_import
from __future__ import division
from __future__ import print_function

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sorry about that! Please see above.

from .dataframe import from_pandas
from .dataframe import to_pandas

ray.register_custom_serializer(pd.DataFrame, use_pickle=True)
ray.register_custom_serializer(pd.core.indexes.base.Index, use_pickle=True)