🏕️ Reproducible development environment
Declarative Intent Driven Platform Orchestrator for Internal Developer Platform (IDP).
🕵️♂️ Library designed for developers eager to explore the potential of Large Language Models (LLMs) and other generative AI through a clean, effective, and Go-idiomatic approach.
Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
Finetune LLMs on K8s by using Runbooks
A diverse, simple, and secure all-in-one LLMOps platform
🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.
Build self-hosted RAG AI Agents powered by open-source LLMs, use LLM models from Ollama and Huggingface, add external API calls, python and shell scripts for context-aware LLM interactions, add validation checks, and build Bring Your Own Infrastructure (BYOI) Dockerized AI Agent images.
The reliability layer between your code and LLM providers.
Sister project to OpenLLMetry, but in Go. Open-source observability for your LLM application, based on OpenTelemetry
Add a description, image, and links to the llmops topic page so that developers can more easily learn about it.
To associate your repository with the llmops topic, visit your repo's landing page and select "manage topics."