The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.
LLM abstractions that aren't obstructions
NyaProxy acts like a smart, central manager for accessing various online services (APIs) – think AI tools (like OpenAI, Gemini, Anthropic), image generators, or almost any web service that uses access keys. It helps you use these services more reliably, efficiently, and securely.
Arcade Tool Development Kit (TDK), Worker, Evals, and CLI
Control Gmail, Google Calendar, Docs, Sheets, Slides, Chat, Forms, Tasks, Search & Drive with AI - Comprehensive Google Workspace / G Suite MCP Server
A command-line interface tool for serving LLM using vLLM.
Open‑WebUI Tools is a modular toolkit designed to extend and enrich your Open WebUI instance, turning it into a powerful AI workstation. With a suite of over 15 specialized tools, function pipelines, and filters, this project supports academic research, agentic autonomy, multimodal creativity, workflows, and more
Surgical context engineering with a nice UI, Windows, Mac, Linux, BSD, anywhere where python & Qt run
A powerful AI observability framework that provides comprehensive insights into agent interactions across platforms, enabling developers to monitor, analyze, and optimize AI-driven applications with minimal integration effort.
An MCP server that provides safe, read-only access to SQLite databases through Model Context Protocol (MCP). This server is built with the FastMCP framework, which enables LLMs to explore and query SQLite databases with built-in safety features and query validation.
Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)
Toolchain built around the Megatron-LM for Distributed Training
A collection of LLM related papers, thesis, tools, datasets, courses, open source models, benchmarks
Official Oxylabs MCP integration
🔍Model Context Protocol (MCP) server for Apache Airflow API integration. Provides comprehensive tools for managing Airflow clusters including service operations, configuration management, status monitoring, and request tracking.
Mathematical benchmark exposing the massive performance gap between real agents and LLM wrappers. Rigorous multi-dimensional evaluation with statistical validation (95% CI, Cohen's h) and reproducible methodology. Separates architectural theater from real systems through stress testing, network resilience, and failure analysis.
Experiment on QnA tabular data using LLMs and SQL
Add a description, image, and links to the llm-tools topic page so that developers can more easily learn about it.
To associate your repository with the llm-tools topic, visit your repo's landing page and select "manage topics."