-
Notifications
You must be signed in to change notification settings - Fork 670
Implement cluster spawning API #1702
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Implement cluster spawning API #1702
Conversation
Codecov Report
@@ Coverage Diff @@
## master #1702 +/- ##
==========================================
- Coverage 87.57% 84.04% -3.54%
==========================================
Files 72 77 +5
Lines 7391 7943 +552
==========================================
+ Hits 6473 6676 +203
- Misses 918 1267 +349
Continue to review full report at Codecov.
|
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
cafa2d4 to
28ca2e3
Compare
It should now die when cluster dies, so objects created in separate contexts with the same cluster are interchangeable Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Also make RayScale.spawn() and .destroy() call implementation immediately when wait=True Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Windows localhost is IPv6 but WSL IPv6 support is buggy Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Also change Cluster .spawn() and .destroy() to be asynchronous by default Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
6117240 to
8fe723f
Compare
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
devin-petersohn
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @vnlitvinov, this looks great! We need a couple of docstrings added and I have some suggestions on API. Please let me know your thoughts!
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
|
@devin-petersohn I hope I've addressed your API concerns. |
devin-petersohn
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks great, thanks @vnlitvinov!
What do these changes do?
modin.experimental.cloudpackage that will be dealing with spawning clusters in a cloudflake8 modinblack --check modingit commit -sNotes: