46 vulnerable + clean AI agent code samples with known OWASP ASI mappings. Use to test AgentGuard, Semgrep, CodeQL, and other SAST tools for agent-specific vulnerabilities.
A curated collection of vulnerable AI agent code samples organized by OWASP ASI Top 10 category. Each sample is a minimal, reproducible example of a real vulnerability pattern found in production AI agent code.
Use this suite to:
- Test if your scanner detects known patterns
- Measure false positive rates against clean code
- Compare AgentGuard vs. other SAST tools
- Learn about agent-specific vulnerability patterns
samples/
ASI01/ # Prompt Injection (6 samples)
ASI02/ # Tool Abuse (5 samples)
ASI03/ # Data Exfiltration (4 samples)
ASI06/ # Insecure Output Handling (2 samples)
ASI07/ # Credential Exposure (6 samples)
ASI09/ # Agent Loop Exploitation (2 samples)
ASI10/ # Trust Boundary Violation (5 samples)
clean/ # Safe code (2 samples) - for FP testing
pip install dfx-agentguard
# Scan all samples
for dir in samples/*/; do
echo "=== Scanning $dir ==="
agentguard "$dir" --format json --no-exit-code
done
# Compare results
python benchmark.py --scanner agentguard --dir samples/Hand-crafted benchmark samples validate rule coverage. Each sample is designed to test a specific detection rule against its intended vulnerability pattern.
| Category | Samples | Expected Findings | Coverage |
|---|---|---|---|
| ASI01 | 6 | 6 | Covered |
| ASI02 | 5 | 5 | Covered |
| ASI03 | 4 | 4 | Covered |
| ASI06 | 2 | 2 | Covered |
| ASI07 | 6 | 6 | Covered |
| ASI09 | 2 | 2 | Covered |
| ASI10 | 5 | 5 | Covered |
| clean | 2 | 0 | Verified clean |
Found a vulnerability pattern not covered? Add a sample!
- One vulnerability per file
- Name:
{ASI category}_{pattern}_{language}.{ext} - Include a comment describing the vulnerability
- Clean samples go in
clean/
MIT
AgentGuard is the core security scanner. Companion tools:
| Tool | Purpose | Install |
|---|---|---|
| agentguard | AI agent code security scanner | pip install dfx-agentguard |
| mcp-scanner | MCP server security audit | pip install dfx-mcp-scanner |
| agentguard-app | GitHub App for PR reviews | Install from Marketplace |
| agentguard-vscode | VS Code inline diagnostics | Install from VS Code |
| agentguard-benchmark | Detection benchmark suite | git clone |
| agentguard-demo | Live demo with Code Scanning | git clone |
19 detection rules | 102 tests | 50 benchmark samples | OWASP ASI Top 10 GitHub Action: dockfixlabs/agentguard@v1