Test your prompts, agents, and RAGs. AI Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.

Test and evaluate LLMs and model configurations, across all the scenarios that matter for your application

AgentTrace is a lightweight observability library to trace and evaluate agentic systems.

TypeScript SDK for evaluating content quality using both traditional metrics and LLM-powered evaluation

4-stage evaluation framework for testing Claude Code plugin component triggering. Validates skills, agents, and commands activate correctly via programmatic detection and LLM judgment.

Light-weight AI agent evaluation and optimization framework

Community Plugin for Genkit to use Promptfoo

Quick web app to collect feedback from LLM chat interactions

This repository represents the transition from behavioral safety to Neural Forensics. It provides the infrastructure to detect, audit, and mitigate high-order AI risks—such as Latent Deception, Sycophancy-Masking, and Synthetic Intimacy—directly at the mechanistic activation layer.

Integrated Evaluation Framework - Front-End Web Application

A web sandbox for hands-on learning of LLM and RAG Evaluation

Polymath Corporation professional profile

🚀 Automate the evaluation of Claude Code plugin components to ensure accurate triggering of skills, agents, commands, and hooks.

Sample implementation demonstrating how to use Firebase Genkit with Promptfoo