Skip to content

Commit 3443be6

Browse files
committed
Add Ollama local LLM setup instructions to main README
- Include installation steps for Ollama - Add model setup recommendations (llama2, mistral, codellama) - Provide usage examples for local LLM testing - Document configuration and performance requirements - Enable cost-free PoC testing without API keys
1 parent ced27d5 commit 3443be6

1 file changed

Lines changed: 38 additions & 0 deletions

File tree

README.md

Lines changed: 38 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -16,6 +16,44 @@ This repository is for **educational and internal security research** purposes o
1616

1717
Navigate into each `pocs/<attack_name>/` folder and follow the README to replicate the attack scenario.
1818

19+
### 🤖 Testing with Local LLMs (Recommended)
20+
21+
For enhanced PoC demonstrations without API costs, use Ollama with local models:
22+
23+
#### Install Ollama
24+
```bash
25+
# Linux/macOS
26+
curl -fsSL https://ollama.ai/install.sh | sh
27+
28+
# Or download from https://ollama.ai/download
29+
```
30+
31+
#### Setup Local Model
32+
```bash
33+
# Pull a lightweight model (recommended for testing)
34+
ollama pull llama2
35+
36+
# Or use a more capable model
37+
ollama pull mistral
38+
ollama pull codellama
39+
```
40+
41+
#### Run PoCs with Local LLM
42+
```bash
43+
# Advanced Tool Poisoning with real LLM
44+
cd pocs/AdvancedToolPoisoning
45+
python3 advanced_tool_poisoning_agent.py local
46+
47+
# Other PoCs work with simulation mode
48+
cd pocs/ContextPackingAttacks
49+
python3 context_packing_agent.py
50+
```
51+
52+
#### Ollama Configuration
53+
- **Default endpoint**: `http://localhost:11434`
54+
- **Model selection**: Edit the model name in PoC files if needed
55+
- **Performance**: Llama2 (~4GB RAM), Mistral (~4GB RAM), CodeLlama (~4GB RAM)
56+
1957
## 🧩 Attack Vectors Covered
2058

2159
### 🤖 MCP & Agent Systems

0 commit comments

Comments
 (0)