#

distributed-computing

Here are 419 public repositories matching this topic...

ColossalAI

hpcaitech / ColossalAI

Making large AI models cheaper, faster and more accessible

ai deep-learning hpc distributed-computing inference big-model large-scale data-parallelism model-parallelism pipeline-parallelism foundation-models heterogeneous-training

Updated Nov 18, 2024
Python

catalyst-team / catalyst

Accelerated deep learning R&D

python infrastructure machine-learning natural-language-processing information-retrieval research reinforcement-learning computer-vision deep-learning text-classification distributed-computing image-processing pytorch image-classification metric-learning recommender-system object-detection image-segmentation reproducibility text-segmentation

Updated Mar 20, 2024
Python

alpa-projects / alpa

Training and serving large-scale neural networks with auto parallelization.

machine-learning deep-learning compiler distributed-computing high-performance-computing distributed-training jax alpa auto-parallelization llm

Updated Dec 9, 2023
Python

jostmey / NakedTensor

Bare bone examples of machine learning in TensorFlow

big-data simple tensorflow linear-regression distributed-computing tensorflow-tutorials tensorflow-exercises tensorflow-examples

Updated Mar 14, 2017
Python

pytorch / rl

A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.

machine-learning control reinforcement-learning ai robotics decision-making distributed-computing torch pytorch rl model-based-reinforcement-learning multi-agent-reinforcement-learning marl

Updated Nov 18, 2024
Python

fugue-project / fugue

A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.

distributed-systems machine-learning sql spark distributed-computing pandas distributed dask data-practitioners

Updated Sep 21, 2024
Python

dask / distributed

A distributed task scheduler for Dask

python pydata distributed-computing dask hacktoberfest

Updated Nov 19, 2024
Python

maxpumperla / elephas

Distributed Deep learning with Keras & Spark

spark deep-learning distributed-computing keras neural-networks

Updated May 1, 2023
Python

google / vizier

Python-based research interface for blackbox and hyperparameter optimization, based on the internal Google Vizier Service.

open-source distributed-systems machine-learning google algorithm deep-learning optimization distributed-computing grpc tuning hyperparameter-optimization evolutionary-algorithms tuning-parameters bayesian-optimization hyperparameter-tuning blackbox-optimization vizier

Updated Nov 18, 2024
Python

TsingZ0 / PFLlib

37 traditional FL (tFL) or personalized FL (pFL) algorithms, 3 scenarios, and 20 datasets.

python iot privacy attack distributed-computing pytorch personalization imagenet differential-privacy privacy-protection heterogeneity federated-learning dlg non-iid domainnet

Updated Nov 11, 2024
Python

AshwinRJ / Federated-Learning-PyTorch

Implementation of Communication-Efficient Learning of Deep Networks from Decentralized Data

python deep-learning distributed-computing pytorch federated-learning

Updated May 7, 2024
Python

lensacom / sparkit-learn

PySpark + Scikit-learn = Sparkit-learn

python machine-learning apache-spark scikit-learn distributed-computing

Updated Dec 31, 2020
Python

Haidra-Org / AI-Horde

A crowdsourced distributed cluster for AI art and text generation

ai distributed-computing gpt flask-api volunteer-computing opt stable-diffusion

Updated Nov 17, 2024
Python

fiber

uber / fiber

Distributed Computing for AI Made Simple

python machine-learning sandbox multiprocessing distributed-computing

Updated Mar 19, 2023
Python

couler-proj / couler

Unified Interface for Constructing and Managing Workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow.

python kubernetes machine-learning workflow-engine scheduler distributed-computing cloud-native workflow-management unified-interface workflow-automation unified-api apache-airflow kubeflow argo-workflows tekton-pipelines

Updated Oct 8, 2024
Python

BaguaSys / bagua

Bagua Speeds up PyTorch

distributed-systems machine-learning deep-learning distributed-computing pytorch distributed rust-lang bagua

Updated Aug 1, 2024
Python

fyoorer / ShadowClone

Unleash the power of cloud

aws cloud serverless lambda-functions distributed-computing recon bugbounty

Updated Jun 17, 2024
Python

HDI-Project / ATM

Auto Tune Models - A multi-tenant, multi-data system for automated machine learning (model selection and tuning).

data-science machine-learning distributed-computing hyperparameter-optimization automl

Updated Feb 21, 2020
Python

lablup / backend.ai

Backend.AI is a streamlined, container-based computing cluster platform that hosts popular computing/ML frameworks and diverse programming languages, with pluggable heterogeneous accelerator support including CUDA GPU, ROCm GPU, TPU, IPU and other NPUs.

python api docker documentation monitoring hpc containers distributed-computing paas cloud-computing backendai

Updated Nov 18, 2024
Python

CamDavidsonPilon / tdigest

t-Digest data structure in Python. Useful for percentiles and quantiles, including distributed enviroments like PySpark

python estimate distributed-computing quantile pyspark mapreduce percentile

Updated May 4, 2023
Python

Improve this page

Add a description, image, and links to the distributed-computing topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the distributed-computing topic, visit your repo's landing page and select "manage topics."