tracking performance of rustc-generated binaries over time

Detects when a deploy silently ships a noindex, drops a schema block, or rewrites your canonical. Baselines a page's SEO contract, diffs every change with Critical/Warning/Info severity, and points fixes to claude-seo sub-skills. A Claude Code skill. Open source.

Fast, lightweight Rust benchmarking library. Dev mode: profile like Criterion. Prod mode: monitor with <10ns overhead. Features: async benchmarks, regression alerts, health metrics, p95/p99 latency tracking. Thread-safe, minimal deps. Benchmark any code block or function with one macro.

Detects semantic regressions across PRs that git's merge conflict detection misses

A new package that helps developers integration-test AI and LLM applications by validating structured outputs. It takes a user's test scenario or prompt as input, sends it to an LLM, and uses pattern

Statistical regression detection and CI quality gates for AI agents

Unified benchmarking and profiling framework for the JAX scientific ML ecosystem. Timing, GPU/energy monitoring, FLOPS counting, roofline analysis, statistical testing, regression detection, and CI integration.

Catch silent agent failures in CI. Pytest plugin with regression detection for LLM agents.

This program enables users to microbenchmark their Java code to detect regression in performance.

Proof, not guesses, for agent-caused regressions.

Agent and LLM evaluation harness — golden datasets, multi-scorer execution, regression detection across model versions, cost-quality leaderboards, and CI gates for model promotion.

Automated ML experiment triage: parse TensorBoard/W&B/CSV logs, run statistical comparisons, detect regressions, and export interactive HTML reports.

Performance regression detection for OCP — Streamlit UI for cloud-bulldozer/orion

Operations console for AI agent fleets — runs, traces, cost budgets, regression detection, SLA scoring, and incident routing. The Datadog-shaped layer between agent platforms and the SRE/SecOps tooling enterprises already trust.

Operator console for AI agent fleets. Runs, traces, cost budgets, regression detection, SLA scoring. Datadog-shaped layer between agent platforms and SRE/SecOps teams.

MCP server for safe AI agent runtime upgrades — version-aware regression catalog, pre/post snapshot diff, rollback guides. Read-only advisor: never executes upgrades. Bring your own catalog for non-OpenClaw runtimes.