Delta-MFP: counterfactual-replay failure diagnosis for local tool-use agents (FAGEN @ ICML 2026)
-
Updated
Oct 3, 2026 - Python
#
failure-analysis
Here are 140 public repositories matching this topic...
Research prototype for trace-based observability and failure analysis in retrieval-augmented generation.
evaluation observability research-engineering rag failure-analysis research-prototype retrieval-augmented-generation
-
Updated
Oct 5, 2026 - Python
Quantify the compute and developer-time cost of flaky tests from JUnit XML - classify flakes vs genuine failures across reruns, rank them by cost. Python 3.11, stdlib only.
python testing continuous-integration ci junit pytest quality-assurance flaky-tests flake-detection failure-analysis test-analytics developer-productivity offline-tools test-optimization
-
Updated
Sep 11, 2026 - Python
Autonomous failure investigation, root-cause analysis, and validated interventions for LLMs, VLMs, and agents.
interpretability root-cause-analysis failure-analysis model-debugging llm-evaluation multimodal-ai agent-evaluation automated-evaluation
-
Updated
Oct 18, 2026 - Python
Giving Every Modality a Voice in Microservice Failure Diagnosis via Multimodal Adaptive Optimization
-
Updated
Nov 25, 2024 - Python
[IJCNN'24] Official repository of "FashionFail: Addressing Failure Cases in Fashion Object Detection and Segmentation".
fashion pytorch dataset e-commerce object-detection image-segmentation maskrcnn onnx failure-analysis clothing-parsing pytorch-lightning
-
Updated
Sep 11, 2024 - Python
Automated AI-powered root cause analysis for GitHub Actions workflow failures.
testing debugging devops automation log-analysis ai continuous-integration ci-cd workflow-automation root-cause-analysis quality-engineering failure-analysis github-actions llm
-
Updated
Jul 20, 2026 - Python
GenPark AI Agent Skill - Episodic verbal self-reflection memory, failure trajectory analyzer, and self-correction prompt optimizer.
reinforcement-learning reflexion self-reflection failure-analysis mcp-server prompt-optimizer genpark-agent
-
Updated
Sep 6, 2026 - Python
A framework for per-modality failure analysis and missing-data evaluation in multimodal clinical AI.
medical-imaging interpretability failure-analysis model-robustness clinical-ai healthcare-ai multimodal-ai
-
Updated
Sep 23, 2026 - Python
GenPark AI Agent Skill - Episodic verbal self-reflection memory, failure trajectory analyzer, and self-correction prompt optimizer.
reinforcement-learning reflexion self-reflection failure-analysis mcp-server prompt-optimizer genpark-agent
-
Updated
Sep 6, 2026 - Python
Failure Compiler for AI agents: turn failed outputs into replayable regression cases.
python debugging cli open-source evaluation verification test-automation developer-tools regression-testing quality-assurance observability automated-testing typer ai-agents failure-analysis pydantic llm llmops agentic-ai ai-reliability
-
Updated
Oct 8, 2026 - Python
MedFailBench exposes critical safety boundary failures in medical AI through clinician built, reproducible open source evaluation.
open-source benchmark ai-safety evaluation-framework synthetic-data failure-analysis patient-safety clinical-nlp responsible-ai medical-ai healthcare-ai clinical-safety medical-llm llm-evaluation llm-safety source-verification medical-ai-safety clinician-review turkish-medical-ai medfailbench
-
Updated
Aug 25, 2026 - Python
A graph-based failure modeling and deterministic detection system for LLM agent runtimes.
observability ai-safety failure-analysis causal-graph prompt-engineering langchain langsmith llm-agents
-
Updated
Apr 29, 2026 - Python
Post-hoc audit of a 22.3σ val_bpb false-positive in a 19M-parameter knowledge distillation experiment. Dual-dimension attribution: token-level gradient + sample-level pass@k.
reproducibility knowledge-distillation case-study reasoning failure-analysis gradient-attribution llm
-
Updated
Apr 24, 2026 - Python
AI agent for failure analysis and O&M indicators in wind farms. Developed for the Alura Challenge during the Oracle Next Education AI Tech Builder training program.
python alura wind-turbine indicators operation-and-maintenance wind-farm rag failure-analysis streamlit oracle-next-education llm generative-ai challengealuralatam google-gemini
-
Updated
Sep 23, 2026 - Python
Toolkit for analysing trajectory predictors: trajectory metrics and rule checks, input-novelty percentiles, risk maps and decision-tree failure rules behind a Python library, CLI, FastAPI service and Streamlit dashboard.
python risk-assessment trajectory-prediction interpretable-ml explainable-ai failure-analysis fastapi streamlit trustworthy-ai
-
Updated
Oct 12, 2026 - Python
Software-only embodied AI evaluation stack for benchmark trajectories, ROS-compatible logs, replay, failure analysis, and comparison reports.
-
Updated
May 15, 2026 - Python
Benchmarking multi-agent orchestration reliability: routing, failure recovery, cascade propagation, and decomposition quality.
python benchmark reliability orchestration reproducibility multi-agent-systems ai-agents failure-analysis llm
-
Updated
Aug 5, 2026 - Python
Evaluation-driven Agent Runtime & Formal Evaluation platform for CI/Test Failure Triage, with reproducible trajectories, evidence attribution and controlled ablations.
-
Updated
Sep 19, 2026 - Python
A model-agnostic benchmark for sealed, re playable AI reasoning failures and tamper-evident failure history.
benchmark provenance deterministic reasoning tamper-evident replayability failure-analysis ai-evaluation auditability llm-evals
-
Updated
Jul 25, 2026 - Python
Add this topic to your repo
To associate your repository with the failure-analysis topic, visit your repo's landing page and select "manage topics."