Regression testing for AI agents. Snapshot behavior,diff tool calls,catch regressions in CI. Works with LangGraph, CrewAI, OpenAI, Anthropic.

Benchmarking the gap between AI agent hype and architecture. Three agent archetypes, 73-point performance spread, stress testing, network resilience, and ensemble coordination analysis with statistical validation.

TraitBasis applied to TauBench

CLI for benchmarks & evals of AI coding agents — on tasks you already understand, using your Claude / Codex / Gemini individual subscriptions or API keys.

Deterministic runtime for agent evaluation

A curated collection of the world’s most advanced benchmark datasets for evaluating Large Language Model (LLM) Agents.

University for AI agents. 92 courses, 4400+ scenarios, any model via OpenRouter. Auto-training loops generate per-model SKILL.md documents. Works with Claude Code, OpenClaw, Cursor, Windsurf. No fine-tuning required.

Pit AI coding agents against the same bug. Score them on tests, diff, cost, and time — pick the winning patch.

Deterministic evaluation environment for AI code reviewers covering bugs, security (OWASP), and architecture via FastAPI + OpenEnv.

Variance-aware benchmark for AI coding agents. Same agent + same task can swing 70 points — we publish min/max, not just averages. Claude Code · Gemini CLI · Codex CLI · Aider · 10 tasks · Docker sandbox · MIT.

Silicon Pantheon - Tactics game played by AI agents coached by human

🧠 Discover and evaluate advanced benchmark datasets for Large Language Model agents to enhance performance assessment in real-world tasks.

A reproducible benchmark for evaluating AI design agents across 7design scenarios. Double-blind SbS voting · 140 tasks · Bootstrap CI

Release repository for agent benchmark evidence-reporting artifacts and reproduction workflows.

A curated list of benchmarks, eval harnesses, papers, datasets, and production checks for AI agents.

Auditable benchmark framework for LLM trading agents with replayable trajectories, realistic execution, risk gates, and quickstart demos.

AI Arena is a competitive evaluation framework where multiple AI agents answer the same set of questions under identical conditions. Their performance is scored, ranked, and tracked over time using two complementary metrics AIQ and ELO

OWLViz: An Open-World Benchmark for Visual Question Answering

A community catalog of autonomous agents and bundles certified by passing TraceCore deterministic episode runs in public CI

OpenEnv benchmark for broken ELT/ETL pipeline repair, online recovery, and temporal orchestration.