Testing

Tasks

• 10 million requests
• Test with 1000, 5000 and 10000 concurrent requests
• Reach the goals stated below (on dedicated HW, single node) - with fake, locally available data (to test spray and template performance)
• Benchmark also with real, remotely available data (to test spray-client too)

Metrics

• Throughput
  • Max
  • Average (goal: 10000req/sec)
  • Stdev
• Latency
  • Max
  • Average (goal: 10msec)
  • Stdev
• CPU times on server
• Memory usage on server
• Ratio of failed/timed out requests (should be less than 1%)

Tools

• Single client to single server
  • Wrk
• Multiple clients to single server
  • Apache JMeter

Sources

• http://www.techempower.com/blog/2013/04/05/frameworks-round-2/
• http://http-kit.org/600k-concurrent-connection-http-kit.html
• https://github.com/ericmoritz/wsdemo/blob/results-v1/results.md