Autonomous failure investigation, root-cause analysis, and validated interventions for LLMs, VLMs, and agents.
-
Updated
Oct 18, 2026 - Python
Autonomous failure investigation, root-cause analysis, and validated interventions for LLMs, VLMs, and agents.
Self-Refine iterative critique-and-refinement loop evaluating constraint adherence and applying structured revisions
Self-Refine iterative critique-and-refinement loop evaluating constraint adherence and applying structured revisions
🤖🛡️ Evaluation and Deployment Gating for Generative AI
Evaluate performance of LLM models for Q&A in any domain
AI-powered student assignment evaluator written in Rust. Supports code, PDF, and DOCX files. Uses local or remote LLMs to grade submissions based on configurable criteria, and exports results to Excel.
A Unity-based generate-and-test framework for procedural FPS interiors using static spatial analysis, empirically calibrated combat metrics, and automated layout validation.
Production Retrieval-Augmented Generation (RAG) System using LangChain, Google Gemini, Hybrid Retrieval, ChromaDB, and Automated Evaluation Pipeline.
Open protocol for testing whether ML and AI-safety metrics add information beyond cheap baselines.
To associate your repository with the automated-evaluation topic, visit your repo's landing page and select "manage topics."