Phase 1: Core Parallelization - Worker Threads & Request Queue

[jessfortemnaturae8717]

Overview

Move blast-radius evaluation off the main thread and add request queuing with backpressure.

Target: 3 evals/sec → 15-20 evals/sec per process

Tasks

1.1 Async Evaluation Pipeline

• Wrap evaluateBlastRadius() in Worker thread pool
• Use piscina or workerpool for thread management
• Max workers = CPU cores - 1
• Fallback to async queue if workers exhausted

Files:

• src/evaluator/terraform.ts
• src/evaluator/shell.ts
• src/evaluator/mcp.ts

1.2 Request Queue with Backpressure

• Add p-queue with concurrency limit
• Implement circuit breaker for downstream failures
• Add queue depth metrics
• Return 429 when queue exceeds threshold

Files:

• src/mcp/server.ts
• src/http/server.ts

Dependencies

piscina: ^4.0.0
p-queue: ^7.0.0

Timeline

Week 1-2

---

Part of: Multi-Agent Scaling Roadmap (Pro Feature)