-
Notifications
You must be signed in to change notification settings - Fork 6k
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[docs] Polish community integrations docs (#10780)
- Loading branch information
Showing
18 changed files
with
109 additions
and
58 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -8,3 +8,4 @@ commonmark==0.8.1 | |
recommonmark==0.5.0 | ||
sphinx<2 | ||
readthedocs-sphinx-ext<1.1 | ||
sphinx-book-theme |
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,3 +1,5 @@ | ||
.. _ray-multiprocessing: | ||
|
||
Distributed multiprocessing.Pool | ||
================================ | ||
|
||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,79 +1,128 @@ | ||
.. _ray-oss-list: | ||
|
||
Community libraries that integrate with Ray | ||
=========================================== | ||
Community Integrations | ||
====================== | ||
|
||
This page lists libraries that integrate with Ray for distributed execution. If you'd like to add your project to this list, feel free to file a pull request or open an issue on GitHub. | ||
This page lists libraries that have integrations with Ray for distributed execution. If you'd like to add your project to this list, feel free to file a pull request or open an issue on GitHub. | ||
|
||
ClassyVision |classyvision| | ||
--------------------------- | ||
|
||
Horovod | ||
------- | ||
Classy Vision is a new end-to-end, PyTorch-based framework for large-scale training of state-of-the-art image and video classification models. The library features a modular, flexible design that allows anyone to train machine learning models on top of PyTorch using very simple abstractions. | ||
|
||
Horovod is a distributed deep learning training framework for TensorFlow, Keras, PyTorch, and Apache MXNet. The goal of Horovod is to make distributed deep learning fast and easy to use. | ||
|
||
[`Link to integration <https://horovod.readthedocs.io/en/stable/ray_include.html>`__] | ||
[`Link to integration <https://classyvision.ai/tutorials/ray_aws>`__] | ||
|
||
MARS | ||
---- | ||
Dask |dask| | ||
----------- | ||
|
||
Mars is a tensor-based unified framework for large-scale data computation which scales Numpy, Pandas and Scikit-learn. | ||
Dask provides advanced parallelism for analytics, enabling performance at scale for the tools you love. Dask uses existing Python APIs and data structures to make it easy to switch between Numpy, Pandas, Scikit-learn to their Dask-powered equivalents. | ||
|
||
[:ref:`Link to integration <mars-on-ray>`] | ||
[`Link to integration <dask-on-ray>`__] | ||
|
||
Spacy | ||
----- | ||
spaCy is a library for advanced Natural Language Processing in Python and Cython. It's built on the very latest research, and was designed from day one to be used in real products. | ||
Flambe |flambe| | ||
--------------- | ||
|
||
[`Link to integration <https://pypi.org/project/spacy-ray/>`__] | ||
Flambé is a machine learning experimentation framework built to accelerate the entire research life cycle. Flambé’s main objective is to provide a unified interface for prototyping models, running experiments containing complex pipelines, monitoring those experiments in real-time, reporting results, and deploying a final model for inference. | ||
|
||
Github: `https://github.com/asappresearch/flambe <https://github.com/asappresearch/flambe>`_ | ||
|
||
Hugging Face Transformers | ||
------------------------- | ||
MARS |mars| | ||
----------- | ||
|
||
State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0. | ||
Mars is a tensor-based unified framework for large-scale data computation which scales Numpy, Pandas and Scikit-learn. Mars can scale in to a single machine, and scale out to a cluster with thousands of machines. | ||
|
||
[`Link to integration <https://huggingface.co/transformers/master/main_classes/trainer.html#transformers.Trainer.hyperparameter_search>`__] | ||
|
||
Seldon Alibi | ||
------------ | ||
[`Link to integration <mars-on-ray>`__] | ||
|
||
Alibi is an open source Python library aimed at machine learning model inspection and interpretation. The focus of the library is to provide high-quality implementations of black-box, white-box, local and global explanation methods for classification and regression models. | ||
Modin |modin| | ||
------------- | ||
|
||
Github: `https://github.com/SeldonIO/alibi <https://github.com/SeldonIO/alibi>`__ | ||
Scale your pandas workflows by changing one line of code. Modin transparently distributes the data and computation so that all you need to do is continue using the pandas API as you were before installing Modin. | ||
|
||
GitHub: `https://github.com/modin-project/modin <https://github.com/modin-project/modin>`_ | ||
|
||
Horovod |horovod| | ||
----------------- | ||
|
||
Horovod is a distributed deep learning training framework for TensorFlow, Keras, PyTorch, and Apache MXNet. The goal of Horovod is to make distributed deep learning fast and easy to use. | ||
|
||
[`Link to integration <https://horovod.readthedocs.io/en/stable/ray_include.html>`__] | ||
|
||
Hugging Face Transformers |hugging| | ||
----------------------------------- | ||
|
||
State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0. | ||
|
||
Intel Analytics Zoo | ||
------------------- | ||
[`Link to integration <https://huggingface.co/transformers/master/main_classes/trainer.html#transformers.Trainer.hyperparameter_search>`__] | ||
|
||
Intel Analytics Zoo |zoo| | ||
------------------------- | ||
|
||
Analytics Zoo seamless scales TensorFlow, Keras and PyTorch to distributed big data (using Spark, Flink & Ray). | ||
|
||
[`Link to integration <https://analytics-zoo.github.io/master/#ProgrammingGuide/rayonspark/>`__] | ||
|
||
Modin | ||
----- | ||
PyCaret |pycaret| | ||
----------------- | ||
|
||
Scale your pandas workflows by changing one line of code. | ||
PyCaret is an open source low-code machine learning library in Python that aims to reduce the hypothesis to insights cycle time in a ML experiment. It enables data scientists to perform end-to-end experiments quickly and efficiently. | ||
|
||
Github: `https://github.com/modin-project/modin/ <https://github.com/modin-project/modin/>`__ | ||
Github: `https://github.com/pycaret/pycaret/ <https://github.com/pycaret/pycaret/>`_ | ||
|
||
Seldon Alibi |seldon| | ||
--------------------- | ||
|
||
ClassyVision | ||
------------ | ||
Alibi is an open source Python library aimed at machine learning model inspection and interpretation. The focus of the library is to provide high-quality implementations of black-box, white-box, local and global explanation methods for classification and regression models. | ||
|
||
An end-to-end framework for image and video classification. | ||
Github: `https://github.com/SeldonIO/alibi <https://github.com/SeldonIO/alibi>`__ | ||
|
||
[`Link to integration <https://classyvision.ai/tutorials/ray_aws>`__] | ||
Spacy |spacy| | ||
------------- | ||
spaCy is a library for advanced Natural Language Processing in Python and Cython. It's built on the very latest research, and was designed from day one to be used in real products. | ||
|
||
PyCaret | ||
------- | ||
[`Link to integration <https://pypi.org/project/spacy-ray/>`__] | ||
|
||
An open-source, low-code machine learning library in Python. | ||
.. |classyvision| image:: images/classyvision.png | ||
:class: inline-figure | ||
:height: 30 | ||
|
||
Github: `https://github.com/pycaret/pycaret/ <https://github.com/pycaret/pycaret/>`_ | ||
.. |dask| image:: images/dask.png | ||
:class: inline-figure | ||
:height: 30 | ||
|
||
Flambe | ||
------ | ||
.. |flambe| image:: images/flambe.png | ||
:class: inline-figure | ||
:height: 30 | ||
|
||
Flambé is a machine learning experimentation framework built to accelerate the entire research life cycle. Flambé’s main objective is to provide a unified interface for prototyping models, running experiments containing complex pipelines, monitoring those experiments in real-time, reporting results, and deploying a final model for inference. | ||
.. |mars| image:: images/mars.png | ||
:class: inline-figure | ||
:height: 30 | ||
|
||
Github: `https://github.com/asappresearch/flambe <https://github.com/asappresearch/flambe>`_ | ||
.. |modin| image:: images/modin.png | ||
:class: inline-figure | ||
:height: 30 | ||
|
||
.. |horovod| image:: images/horovod.png | ||
:class: inline-figure | ||
:height: 30 | ||
|
||
.. |hugging| image:: images/hugging.png | ||
:class: inline-figure | ||
:height: 30 | ||
|
||
.. |zoo| image:: images/zoo.png | ||
:class: inline-figure | ||
:height: 30 | ||
|
||
.. |pycaret| image:: images/pycaret.png | ||
:class: inline-figure | ||
:height: 30 | ||
|
||
.. |seldon| image:: images/seldon.png | ||
:class: inline-figure | ||
:height: 30 | ||
|
||
.. |spacy| image:: images/spacy.png | ||
:class: inline-figure | ||
:height: 30 |
This file was deleted.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters