Skip to content

Repository files navigation

LLMOps Radar

Live index of the newest LLMOps tooling — track what's shipping in LLM observability and deployment

Stars Last Commit Items Updated

⭐ Star this repo to bookmark — fresh data every 15 minutes

English · 中文 · 日本語 · 한국어 · Español · Português


💡 What is this?

A continuously-updated tracker that discovers, catalogs, and scores new LLMOps tools as they appear on GitHub and Product Hunt. Unlike static awesome-lists, it runs daily via GitHub Actions to surface tools launched in the past week across categories like observability, prompt management, cost tracking, and gateways.

This list is auto-updated every 15 minutes by a GitHub Actions cron. Each commit reflects a real change in the upstream data source — new items added, expired items removed — so you can rely on what you see being current.


📋 Current Items

⏰ Last updated: 2026-09-12 18:00 UTC

Data source: GitHub Search API

The table below is rewritten on every cron tick. Star the repo to bookmark.

# Name Lang Updated Description
1 anthony-chaudhary/fak 38 Go 2026-09-12 Agentic Runtime
2 korczis/prismatic-majordomus 0 Rust 2026-09-12 A lightweight supervisory control layer for AI-assisted work: one policy, generated instructions for every AI tool, dura
3 cloudrift-ai/emmy 80 Python 2026-09-12 Optimized GPU compiler for LLM inference. Choose from a list of optimized recipes or optimize your own model via kernel
4 ihabkhaled/ClawAI 22 TypeScript 2026-09-12 Claw is a local-first AI control plane that runs powerful open models on your machine and connects to top LLM providers.
5 cognifityai/verdict 0 Python 2026-09-12 Open-source LLM observability and drift detection for AI apps
6 ThakiCloud/thakicloud.github.io 4 JavaScript 2026-09-12 ThakiCloud Tech Blog
7 neuralnexustech/freeroute 0 TypeScript 2026-09-12 Get up to 50M+ or virtually unlimited free AI tokens daily! Universal OpenAI gateway that pools free-tier models across
8 linny006/llmops-radar 3 Python 2026-09-12 Live index of the newest LLMOps tooling — track what's shipping in LLM observability and deployment
9 AgentEra/Agently 1651 Python 2026-09-12 [GenAI Application Development Framework] 🚀 Build GenAI application quick and easy 💬 Easy to interact with GenAI agent
10 Red1-Rahman/NiriZan 2 Jupyter Notebook 2026-09-12 Continuous Evaluation Infrastructure for Production AI
11 BerriAI/litellm 58570 Python 2026-09-12 The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tra
12 llmsyscore/llm-systems-manager 4 Python 2026-09-12 LLM Systems Manager — real-time observability and control for LLM systems
13 davidahmann/applied-ai-field-guide 107 JavaScript 2026-09-12 The Applied AI Field Guide: fieldwork, value, engineering, and operations for AI that works beyond the demo.
14 maximhq/bifrost 7996 Go 2026-09-12 Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ mod
15 MubashirShafique/enterprise-agentic-rag 0 Python 2026-09-12 Enterprise Agentic RAG on PydanticAI docs with LangGraph, NeMo Guardrails, Qdrant, Portkey, Logfire observability, and a
16 mloda-ai/mloda 86 Python 2026-09-12 mloda.ai - Open Data Access for AI and ML. Plugin-based. Traceable. Framework-agnostic.
17 Farukul-Islam/from-mlops-to-llmops 0 PHP 2026-09-12 🔍 Explore the shift from MLOps to LLMOps with materials that simplify AI deployment and enhance document intelligence.
18 Tearfullnex/SpecGuard 0 Python 2026-09-12 🛡️ Enforce AI behavior guidelines with SpecGuard, a tool that turns policies into executable tests for reliable and scal
19 matiaslanza99/SuperStore.SalesDashboard 0 CSS 2026-09-12 📊 Build insightful sales dashboards for SuperStore, enhancing decision-making and driving business growth with real-time
20 regabbb22/Flipkart-Product-Recommender-RAG 3 Python 2026-09-12 🛒 Build a leading-edge e-commerce recommendation system using RAG architecture, Groq Llama 3, LangChain, and AstraDB, de
21 rrahimi-uci/caliber-suite 1 Python 2026-09-12 Open-source MLflow plugin for AI agents and agentic workflows: prompts, tools, skills, MCP servers, RAG knowledge bases,
22 JavisBot-Service/javis-transparency 1 Python 2026-09-12 Third-party-verifiable model-authenticity audit for the javis.bot Claude/GPT relay — open-source probe, runs on GitHub A
23 Lukaa1507/langchain-runner 1 Python 2026-09-12 🚀 Expose your LangChain agents as services with zero configuration; turn scripts into web services using simple wrappers
24 mlflow/mlflow 27920 Python 2026-09-12 The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, eva
25 TheusHen/eleanity 1 Python 2026-09-12 CLI-first LLM runtime parity diagnostics. Same model, same input, first causal divergence.
26 Lo3okSky/LLM_course 3 Jupyter Notebook 2026-09-12 🐙 Explore the inner workings of large language models with hands-on Python and PyTorch code. Master LLM architecture, tr
27 ngu-gif/genai-role-playbook 1 HTML 2026-09-12 GenAI Career Roadmap 2026 🚀 | AI Job Paths & Skills Guide
28 GetBusbar/busbar 143 Rust 2026-09-12 The execution control plane for AI agents. Govern every model request, MCP tool call, A2A delegation, and downstream act
29 garcetemedinamateoandres-sketch/agent-deployment-orchestrator 1 HTML 2026-09-12 🚀 AI Agent Deployment on GCP 2026: Fast-Track Production Templates & CI/CD
30 Root1V/prometheus-inference-platform 1 Python 2026-09-12 Production-grade self-hosted LLM inference platform — FastAPI gateway with JWT auth, fine-grained per-model authorizatio
31 liuanye9-lab/codex-os-brain 1 JavaScript 2026-09-12 Native-first, verifier-gated agent harness with a direct CLI, bounded recall, measurable policies, and privacy-safe beha
32 0xPlaygrounds/rig 8602 Rust 2026-09-12 ⚙️🦀 Build modular and scalable LLM Applications in Rust
33 promptfoo/promptfoo 25046 TypeScript 2026-09-12 Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, C
34 redevops-io/DataOpsBench 0 Python 2026-09-12 A model- and framework-agnostic benchmark for AI-assisted data operations (the DataOps analogue of TPC-C): diagnose, rep
35 sauravbhattacharya001/prompt 1 C# 2026-09-12 .NET 8 prompt engineering toolkit — Azure OpenAI client, template engine, prompt chaining, injection detection, bias det
36 redevops-io/redevops-demo 0 Python 2026-09-12 Self-demonstrating ReDevOps × AWS deploy-and-operate demo: one prompt in Projects provisions, secures, monitors and self
37 redevops-io/mission-sdk 0 Python 2026-09-12 Mission SDK — the developer boundary over the ReDevOps Mission Runtime (author, validate, explain a governed MissionProg
38 vivek-541/vivek-541 3 HTML 2026-09-12 AI Engineer building production-grade ML systems | LLMs, RAG, ML Pipelines | Python, TensorFlow, LangChain | Open to opp
39 api7/aisix 151 Rust 2026-09-12 Open-source AI gateway for LLMs & AI agents, built in Rust. One OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bed
40 vitas/evidra-bench 0 Go 2026-09-12 Evidra Bench runs live infrastructure scenarios for AI agents, MCP servers, and AI SRE tools, then shows pass/fail, unsa
41 jakbuczarnecki/intergrax 4 Python 2026-09-12 Source-available operating layer for governed AI applications — reuse policy, authority, evidence, execution, and recove
42 MakazhanAlpamys/Soup 6202 Python 2026-09-12 Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
43 AixleHQ/flow 17 Ruby 2026-09-12 Aixle Flow — orchestrate coding agents through durable, inspectable workflows.
44 royalpinto007/awesome-llm-guardrails 0 HTML 2026-09-12 A curated, auto-updating list of open-source guardrails for LLM applications: prompt-injection defense, PII, content saf
45 royalpinto007/awesome-agent-evals 0 HTML 2026-09-12 A curated list of tools, frameworks, benchmarks, and ideas for evaluating AI agents.
46 langfuse/langfuse 34506 TypeScript 2026-09-12 🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.
47 langwatch/langwatch 3533 TypeScript 2026-09-12 The platform for LLM evaluations and AI agent testing
48 justanotheruser82174/cua-lite 0 Python 2026-09-12 Standardize computer-use agents, sandboxes, data, evaluation, SFT, and RL across desktop, browser, and mobile with one u
49 Satisfiable-polopony613/EVIE-Preview-4.5B 2 Python 2026-09-12 Retrieve multilingual visual documents with ultra-compact token embeddings from this Qwen3.5-4B-powered ColPali engine.
50 ashrafb8962/agentic-ops-and-rag 1 Jupyter Notebook 2026-09-12 Build and evaluate production-ready RAG pipelines with hands-on notebooks, templates, and proven performance strategies.

🔍 How it works

Every 15 minutes, a GitHub Action runs tracker.py. That script:

  1. Fetches the latest state from GitHub Search API.
  2. Diffs against data/items.json (the previous snapshot).
  3. Rewrites the table above between the <!-- TRACKER_TABLE_* --> markers.
  4. Commits feat: +N added, -M removed (timestamp) if anything changed.

No external services. No paid APIs. Just a public data source and a free GitHub Action.


🤝 Contributing

See CONTRIBUTING.md — usually you don't need to: the tracker keeps itself current. If you spot a data-source bug or want to suggest a new column for the table, open an issue.


🔗 Related live trackers

If you find this useful, you might also like these other auto-updated trackers from the same maintainer — same mechanism, different upstream:


📜 License

MIT — see LICENSE.