Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

StackStorm (aka "IFTTT for Ops") is event-driven automation for auto-remediation, incident responses, troubleshooting, deployments, and more for DevOps and SREs. Includes rules engine, workflow, 160 integration packs with 6000+ actions (see https://exchange.stackstorm.org) and ChatOps. Installer at https://docs.stackstorm.com/install/index.html

All-in-One Development Tool based on PaddlePaddle

[ECCV 2022] ByteTrack: Multi-Object Tracking by Associating Every Detection Box

🪄 Turns your machine learning code into microservices with web API, interactive GUI, and more.

OpenMMLab Model Deployment Framework

Cobbler is a versatile Linux deployment server

Deploy your agentic worfklows to production

Like Vercel, but open source and for all languages.

Turn any computer or edge device into a command center for your computer vision projects.

Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀

Deploy a ML inference service on a budget in less than 10 lines of code.

Create deployable system images from OS X installer

Distribute and run AI workloads magically in Python, like PyTorch for ML infra.

Powerful CLI tool to simplify Amazon ECS deployments, rollbacks & scaling

Train and Deploy an ML REST API to predict crypto prices, in 10 steps

yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.

Chat with your Kubernetes Cluster using AI tools and IDEs like Claude and Cursor!

🐶 A tool to package, serve, and deploy any ML model on any platform. Archived to be resurrected one day🤞