Load Testing

[AmileshN]

Purpose

Ensure CityAgent performs reliably under concurrent load.

Tools

• Locust(look more into this)
• Mock LLMs or smaller models

Tasks

• Implement load tests for:
  • Full query pipeline
  • LLM invocation rate handling
  • ChromaDB retrieval under rapid queries
• Measure:
  • Latency
  • Error rate
  • Throughput

Definition of Done

• Load test scripts exist
• System handles concurrent users without crashing
• Response time ≤ 1 minute under expected load