🏕️ Reproducible development environment
Declarative Intent Driven Platform Orchestrator for Internal Developer Platform (IDP).
🕵️♂️ Library designed for developers eager to explore the potential of Large Language Models (LLMs) and other generative AI through a clean, effective, and Go-idiomatic approach.
Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
Finetune LLMs on K8s by using Runbooks
A diverse, simple, and secure all-in-one LLMOps platform
🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.
Sister project to OpenLLMetry, but in Go. Open-source observability for your LLM application, based on OpenTelemetry
The reliability layer between your code and LLM providers.
Add a description, image, and links to the llmops topic page so that developers can more easily learn about it.
To associate your repository with the llmops topic, visit your repo's landing page and select "manage topics."