Live index of the newest LLMOps tooling — track what's shipping in LLM observability and deployment
⭐ Star this repo to bookmark — fresh data every 15 minutes
A continuously-updated tracker that discovers, catalogs, and scores new LLMOps tools as they appear on GitHub and Product Hunt. Unlike static awesome-lists, it runs daily via GitHub Actions to surface tools launched in the past week across categories like observability, prompt management, cost tracking, and gateways.
This list is auto-updated every 15 minutes by a GitHub Actions cron. Each commit reflects a real change in the upstream data source — new items added, expired items removed — so you can rely on what you see being current.
⏰ Last updated: 2026-09-12 18:00 UTC
Data source:
GitHub Search APIThe table below is rewritten on every cron tick. Star the repo to bookmark.
| # | Name | ⭐ | Lang | Updated | Description |
|---|---|---|---|---|---|
| 1 | anthony-chaudhary/fak | 38 | Go | 2026-09-12 | Agentic Runtime |
| 2 | korczis/prismatic-majordomus | 0 | Rust | 2026-09-12 | A lightweight supervisory control layer for AI-assisted work: one policy, generated instructions for every AI tool, dura |
| 3 | cloudrift-ai/emmy | 80 | Python | 2026-09-12 | Optimized GPU compiler for LLM inference. Choose from a list of optimized recipes or optimize your own model via kernel |
| 4 | ihabkhaled/ClawAI | 22 | TypeScript | 2026-09-12 | Claw is a local-first AI control plane that runs powerful open models on your machine and connects to top LLM providers. |
| 5 | cognifityai/verdict | 0 | Python | 2026-09-12 | Open-source LLM observability and drift detection for AI apps |
| 6 | ThakiCloud/thakicloud.github.io | 4 | JavaScript | 2026-09-12 | ThakiCloud Tech Blog |
| 7 | neuralnexustech/freeroute | 0 | TypeScript | 2026-09-12 | Get up to 50M+ or virtually unlimited free AI tokens daily! Universal OpenAI gateway that pools free-tier models across |
| 8 | linny006/llmops-radar | 3 | Python | 2026-09-12 | Live index of the newest LLMOps tooling — track what's shipping in LLM observability and deployment |
| 9 | AgentEra/Agently | 1651 | Python | 2026-09-12 | [GenAI Application Development Framework] 🚀 Build GenAI application quick and easy 💬 Easy to interact with GenAI agent |
| 10 | Red1-Rahman/NiriZan | 2 | Jupyter Notebook | 2026-09-12 | Continuous Evaluation Infrastructure for Production AI |
| 11 | BerriAI/litellm | 58570 | Python | 2026-09-12 | The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tra |
| 12 | llmsyscore/llm-systems-manager | 4 | Python | 2026-09-12 | LLM Systems Manager — real-time observability and control for LLM systems |
| 13 | davidahmann/applied-ai-field-guide | 107 | JavaScript | 2026-09-12 | The Applied AI Field Guide: fieldwork, value, engineering, and operations for AI that works beyond the demo. |
| 14 | maximhq/bifrost | 7996 | Go | 2026-09-12 | Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ mod |
| 15 | MubashirShafique/enterprise-agentic-rag | 0 | Python | 2026-09-12 | Enterprise Agentic RAG on PydanticAI docs with LangGraph, NeMo Guardrails, Qdrant, Portkey, Logfire observability, and a |
| 16 | mloda-ai/mloda | 86 | Python | 2026-09-12 | mloda.ai - Open Data Access for AI and ML. Plugin-based. Traceable. Framework-agnostic. |
| 17 | Farukul-Islam/from-mlops-to-llmops | 0 | PHP | 2026-09-12 | 🔍 Explore the shift from MLOps to LLMOps with materials that simplify AI deployment and enhance document intelligence. |
| 18 | Tearfullnex/SpecGuard | 0 | Python | 2026-09-12 | 🛡️ Enforce AI behavior guidelines with SpecGuard, a tool that turns policies into executable tests for reliable and scal |
| 19 | matiaslanza99/SuperStore.SalesDashboard | 0 | CSS | 2026-09-12 | 📊 Build insightful sales dashboards for SuperStore, enhancing decision-making and driving business growth with real-time |
| 20 | regabbb22/Flipkart-Product-Recommender-RAG | 3 | Python | 2026-09-12 | 🛒 Build a leading-edge e-commerce recommendation system using RAG architecture, Groq Llama 3, LangChain, and AstraDB, de |
| 21 | rrahimi-uci/caliber-suite | 1 | Python | 2026-09-12 | Open-source MLflow plugin for AI agents and agentic workflows: prompts, tools, skills, MCP servers, RAG knowledge bases, |
| 22 | JavisBot-Service/javis-transparency | 1 | Python | 2026-09-12 | Third-party-verifiable model-authenticity audit for the javis.bot Claude/GPT relay — open-source probe, runs on GitHub A |
| 23 | Lukaa1507/langchain-runner | 1 | Python | 2026-09-12 | 🚀 Expose your LangChain agents as services with zero configuration; turn scripts into web services using simple wrappers |
| 24 | mlflow/mlflow | 27920 | Python | 2026-09-12 | The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, eva |
| 25 | TheusHen/eleanity | 1 | Python | 2026-09-12 | CLI-first LLM runtime parity diagnostics. Same model, same input, first causal divergence. |
| 26 | Lo3okSky/LLM_course | 3 | Jupyter Notebook | 2026-09-12 | 🐙 Explore the inner workings of large language models with hands-on Python and PyTorch code. Master LLM architecture, tr |
| 27 | ngu-gif/genai-role-playbook | 1 | HTML | 2026-09-12 | GenAI Career Roadmap 2026 🚀 | AI Job Paths & Skills Guide |
| 28 | GetBusbar/busbar | 143 | Rust | 2026-09-12 | The execution control plane for AI agents. Govern every model request, MCP tool call, A2A delegation, and downstream act |
| 29 | garcetemedinamateoandres-sketch/agent-deployment-orchestrator | 1 | HTML | 2026-09-12 | 🚀 AI Agent Deployment on GCP 2026: Fast-Track Production Templates & CI/CD |
| 30 | Root1V/prometheus-inference-platform | 1 | Python | 2026-09-12 | Production-grade self-hosted LLM inference platform — FastAPI gateway with JWT auth, fine-grained per-model authorizatio |
| 31 | liuanye9-lab/codex-os-brain | 1 | JavaScript | 2026-09-12 | Native-first, verifier-gated agent harness with a direct CLI, bounded recall, measurable policies, and privacy-safe beha |
| 32 | 0xPlaygrounds/rig | 8602 | Rust | 2026-09-12 | ⚙️🦀 Build modular and scalable LLM Applications in Rust |
| 33 | promptfoo/promptfoo | 25046 | TypeScript | 2026-09-12 | Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, C |
| 34 | redevops-io/DataOpsBench | 0 | Python | 2026-09-12 | A model- and framework-agnostic benchmark for AI-assisted data operations (the DataOps analogue of TPC-C): diagnose, rep |
| 35 | sauravbhattacharya001/prompt | 1 | C# | 2026-09-12 | .NET 8 prompt engineering toolkit — Azure OpenAI client, template engine, prompt chaining, injection detection, bias det |
| 36 | redevops-io/redevops-demo | 0 | Python | 2026-09-12 | Self-demonstrating ReDevOps × AWS deploy-and-operate demo: one prompt in Projects provisions, secures, monitors and self |
| 37 | redevops-io/mission-sdk | 0 | Python | 2026-09-12 | Mission SDK — the developer boundary over the ReDevOps Mission Runtime (author, validate, explain a governed MissionProg |
| 38 | vivek-541/vivek-541 | 3 | HTML | 2026-09-12 | AI Engineer building production-grade ML systems | LLMs, RAG, ML Pipelines | Python, TensorFlow, LangChain | Open to opp |
| 39 | api7/aisix | 151 | Rust | 2026-09-12 | Open-source AI gateway for LLMs & AI agents, built in Rust. One OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bed |
| 40 | vitas/evidra-bench | 0 | Go | 2026-09-12 | Evidra Bench runs live infrastructure scenarios for AI agents, MCP servers, and AI SRE tools, then shows pass/fail, unsa |
| 41 | jakbuczarnecki/intergrax | 4 | Python | 2026-09-12 | Source-available operating layer for governed AI applications — reuse policy, authority, evidence, execution, and recove |
| 42 | MakazhanAlpamys/Soup | 6202 | Python | 2026-09-12 | Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU. |
| 43 | AixleHQ/flow | 17 | Ruby | 2026-09-12 | Aixle Flow — orchestrate coding agents through durable, inspectable workflows. |
| 44 | royalpinto007/awesome-llm-guardrails | 0 | HTML | 2026-09-12 | A curated, auto-updating list of open-source guardrails for LLM applications: prompt-injection defense, PII, content saf |
| 45 | royalpinto007/awesome-agent-evals | 0 | HTML | 2026-09-12 | A curated list of tools, frameworks, benchmarks, and ideas for evaluating AI agents. |
| 46 | langfuse/langfuse | 34506 | TypeScript | 2026-09-12 | 🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform. |
| 47 | langwatch/langwatch | 3533 | TypeScript | 2026-09-12 | The platform for LLM evaluations and AI agent testing |
| 48 | justanotheruser82174/cua-lite | 0 | Python | 2026-09-12 | Standardize computer-use agents, sandboxes, data, evaluation, SFT, and RL across desktop, browser, and mobile with one u |
| 49 | Satisfiable-polopony613/EVIE-Preview-4.5B | 2 | Python | 2026-09-12 | Retrieve multilingual visual documents with ultra-compact token embeddings from this Qwen3.5-4B-powered ColPali engine. |
| 50 | ashrafb8962/agentic-ops-and-rag | 1 | Jupyter Notebook | 2026-09-12 | Build and evaluate production-ready RAG pipelines with hands-on notebooks, templates, and proven performance strategies. |
Every 15 minutes, a GitHub Action runs tracker.py. That script:
- Fetches the latest state from
GitHub Search API. - Diffs against
data/items.json(the previous snapshot). - Rewrites the table above between the
<!-- TRACKER_TABLE_* -->markers. - Commits
feat: +N added, -M removed (timestamp)if anything changed.
No external services. No paid APIs. Just a public data source and a free GitHub Action.
See CONTRIBUTING.md — usually you don't need to: the tracker keeps itself current.
If you spot a data-source bug or want to suggest a new column for the table, open
an issue.
If you find this useful, you might also like these other auto-updated trackers from the same maintainer — same mechanism, different upstream:
- trending-claude-skills — What's shipping in Claude Skills this week (
topic:claude-skills) - mcp-servers-live — Live index of newest MCP servers (
topic:mcp-server) - cursor-rules-live — Newest Cursor rules and .cursorrules patterns (
topic:cursor-rules) - claude-code-plugin-tracker — Claude Code plugins and hook configs (
topic:claude-code) - llm-agents-radar — Newest LLM agent frameworks (
topic:llm-agent) - rag-radar — Newest RAG implementations and tools (
topic:rag) - llm-eval-tracker — Newest LLM evaluation tools and benchmarks (
topic:llm-eval) - agent-framework-radar — Newest agent frameworks shipping on GitHub (
topic:agent-framework) - vector-db-live — Newest vector DB projects and integrations (
topic:vector-database) - prompt-tools-live — Newest prompt-engineering tools and prompt repos (
topic:prompt-engineering) - agent-eval-harness — Live benchmark of AI coding agents (
topic:llm-eval) - skills-tracker — Tracking new GitHub 'skills' repos (
topic:agent-skills) - awesome-agent-skills — Curated auto-updated awesome-list of AI agent skills (
topic:agent-skills)
MIT — see LICENSE.