llm-security

Open-source AI penetration testing tool to find and fix your app’s vulnerabilities.

Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in the AI Agent Economy. Is the agent doing what is supposed to do? With iFixAi you can have this answer in less than 120 seconds.

the LLM vulnerability scanner

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

🐢 Open-Source Evaluation & Testing library for LLM Agents

A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.

The Security Toolkit for LLM Interactions

Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪

ADR secures enterprise AI agents through observability, security benchmarking, and threat detection. Deployed at Uber.

OWASP Top 10 for Large Language Model Apps (Part of the GenAI Security Project)

A security scanner for your LLM agentic workflows

AI-first security scanner. NEW in v2026.7: Claude Code compromise detection — vet .claude/ hooks, permissions & skills before you clone — plus an always-on AI attack-signature scanner and native Rust & PHP rules. Also: medusa scan --git to vet any repo, medusa secrets scan for leaked API keys. 40,000+ patterns, zero setup.

An easy-to-use Python framework to generate adversarial jailbreak prompts.

Local security audit for AI API relays and LLM proxies: detects prompt injection, model substitution, tool-call rewriting, SSE anomalies, error leakage, and Web3 wallet risks.

Papers and resources related to the security and privacy of LLMs 🤖

Open-source runtime AI agent security tool - monitors and controls AI agents, catching malicious tool use, prompt injection, and policy drift in real time, before the agent acts.

⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs

This repository provides a benchmark for prompt injection attacks and defenses in LLMs

Security toolkit for AI agents. Scan your machine for dangerous skills and MCP configs, monitor for supply chain attacks, test prompt injection resistance, and audit live MCP servers for tool poisoning.

Self-hosted runtime control plane for AI agents. Observe or HITL approve or Block rogue tool calls before it executes: secret leaks, prompt injection, supply chain etc in a local dashboard. Agent agnostic (Claude,codex etc.)