These benchmarks were conducted using gamache/httpc_bench.
GET requests lasting 10 ms are performed.
Clients ran on AWS m5.4xlarge (16 vCPUs, 64 GB RAM) running Ubuntu 18.04.
The server ran on a separate m5.4xlarge, configured identically.
Clients:
- Mojito 0.3.0 (Mint 0.2.1)
- Buoy
b65c06f
- MachineGun 0.1.5 (Gun 1.3.0)
- Dlhttpc
1072652
- Hackney 1.15.1
- Ibrowse 4.4.1
- Httpc (OTP 21.2)
- Mint 0.2.1, without pooling or keepalive, as a reference client.
This benchmark was run after optimizing the servers for high-concurrency
tasks by executing ulimit -n 12000000
to increase the allowable number
of open files. This configuration is very different from the default
ulimit -n 1024
on Ubuntu systems.
The enhanced configuration showed that Buoy and Gun really shine when they are allowed to stretch their legs. Mojito performs well but has catch-up work to do! Likely areas of improvement are in pipelining (we use none, currently) and concurrency-friendly connection checkout in a similar manner to Shackle or Dispcount.
Client | Pool Count | Pool Size | Concurrency | Req/sec | Error % |
---|---|---|---|---|---|
Client | Pool Count | Pool Size | Concurrency | Req/sec | Error % |
Buoy | 1 | 1024 | 4096 | 101280 | 79.6 |
Buoy | 1 | 1024 | 8192 | 97029 | 79.7 |
Buoy | 1 | 1024 | 2048 | 96272 | 79.5 |
Buoy | 1 | 1024 | 16384 | 85672 | 79.6 |
Buoy | 1 | 512 | 4096 | 84345 | 89.8 |
Buoy | 1 | 512 | 2048 | 78757 | 89.8 |
Buoy | 1 | 512 | 8192 | 77945 | 90 |
MachineGun | 1 | 1024 | 2048 | 72950 | 0 |
Buoy | 1 | 512 | 16384 | 72247 | 90 |
MachineGun | 1 | 1024 | 4096 | 72108 | 0 |
MachineGun | 1 | 1024 | 1024 | 71219 | 0 |
Buoy | 1 | 256 | 4096 | 62332 | 94.9 |
Mojito | 4 | 256 | 4096 | 62068 | 0.8 |
MachineGun | 1 | 1024 | 8192 | 61205 | 1 |
Mojito | 8 | 128 | 4096 | 59354 | 0.8 |
Mojito | 4 | 256 | 8192 | 59353 | 0.8 |
Buoy | 1 | 1024 | 1024 | 59273 | 79.4 |
Buoy | 1 | 256 | 2048 | 59069 | 94.9 |
Mojito | 8 | 128 | 8192 | 58707 | 0.8 |
Mojito | 8 | 256 | 8192 | 58066 | 0.8 |
Mojito | 8 | 128 | 16384 | 57690 | 0.8 |
Mojito | 16 | 64 | 2048 | 57468 | 0.8 |
Mojito | 16 | 64 | 16384 | 57098 | 0.8 |
Mojito | 16 | 128 | 8192 | 56712 | 0.8 |
Mojito | 4 | 256 | 16384 | 56690 | 0.8 |
Mojito | 16 | 64 | 8192 | 56645 | 0.8 |
Mojito | 8 | 256 | 4096 | 56325 | 0.9 |
Mojito | 8 | 256 | 16384 | 56198 | 0.8 |
Buoy | 1 | 256 | 8192 | 55993 | 95.1 |
Mojito | 16 | 512 | 4096 | 55633 | 0.6 |
Mojito | 16 | 1024 | 2048 | 55272 | 0.7 |
Mojito | 4 | 512 | 4096 | 55131 | 0.9 |
MachineGun | 1 | 1024 | 16384 | 55055 | 2.9 |
Mojito | 32 | 32 | 1024 | 54993 | 0.8 |
Mojito | 32 | 32 | 8192 | 54943 | 0.8 |
Mojito | 32 | 32 | 16384 | 54500 | 0.8 |
Mojito | 16 | 1024 | 4096 | 54381 | 0.8 |
Mojito | 32 | 64 | 8192 | 54240 | 0.8 |
Mojito | 16 | 128 | 16384 | 53882 | 0.9 |
Mojito | 1 | 1024 | 1024 | 53848 | 1.2 |
Mojito | 4 | 512 | 2048 | 53814 | 0.8 |
Mojito | 16 | 64 | 4096 | 53731 | 1 |
Mojito | 16 | 128 | 4096 | 53702 | 0.9 |
Mojito | 32 | 512 | 4096 | 53622 | 0.6 |
Mojito | 16 | 128 | 2048 | 53610 | 0.9 |
Mojito | 8 | 512 | 4096 | 53488 | 0.7 |
Mojito | 32 | 32 | 2048 | 53451 | 0.8 |
Mojito | 8 | 1024 | 2048 | 53283 | 0.9 |
Mojito | 1 | 1024 | 2048 | 53091 | 1.5 |
Mojito | 32 | 128 | 2048 | 53006 | 0.7 |
Mojito | 16 | 256 | 4096 | 52844 | 0.9 |
Mojito | 4 | 1024 | 4096 | 52789 | 0.8 |
Mojito | 16 | 256 | 2048 | 52650 | 0.8 |
Mojito | 32 | 64 | 16384 | 52511 | 0.9 |
Mojito | 1 | 1024 | 4096 | 52297 | 0.9 |
Mojito | 32 | 64 | 2048 | 52247 | 0.8 |
Mojito | 4 | 1024 | 1024 | 52235 | 1.2 |
Mojito | 32 | 64 | 4096 | 52169 | 0.9 |
Mojito | 32 | 128 | 4096 | 52016 | 0.9 |
Buoy | 1 | 256 | 16384 | 51785 | 95.1 |
Mojito | 8 | 1024 | 4096 | 51780 | 0.7 |
Mojito | 8 | 256 | 2048 | 51741 | 0.9 |
Mojito | 4 | 1024 | 2048 | 51627 | 0.8 |
Mojito | 4 | 512 | 8192 | 51388 | 0.9 |
Mojito | 32 | 512 | 2048 | 51387 | 0.8 |
Mojito | 8 | 512 | 2048 | 51378 | 0.9 |
Mojito | 8 | 512 | 8192 | 51008 | 0.8 |
Mojito | 32 | 256 | 2048 | 50834 | 0.8 |
Mojito | 16 | 512 | 2048 | 50630 | 0.8 |
Mojito | 8 | 1024 | 1024 | 50204 | 1.3 |
Mojito | 4 | 256 | 2048 | 50108 | 1.3 |
Mojito | 32 | 512 | 1024 | 50034 | 1.1 |
Mojito | 32 | 64 | 1024 | 49968 | 0.9 |
Mojito | 32 | 256 | 16384 | 49966 | 1.8 |
Buoy | 1 | 512 | 1024 | 49709 | 89.8 |
Mojito | 4 | 256 | 1024 | 49635 | 1.5 |
Mojito | 16 | 256 | 1024 | 49613 | 1 |
Mojito | 16 | 256 | 16384 | 49330 | 1.1 |
Mojito | 8 | 512 | 1024 | 49264 | 1 |
Mojito | 32 | 32 | 4096 | 49209 | 0.9 |
Mojito | 32 | 256 | 4096 | 49164 | 0.8 |
Mojito | 8 | 128 | 2048 | 49152 | 1.2 |
Mojito | 32 | 128 | 8192 | 48732 | 0.9 |
Mojito | 16 | 256 | 8192 | 48395 | 0.9 |
Mojito | 8 | 128 | 1024 | 48349 | 1.5 |
Mojito | 4 | 512 | 1024 | 48100 | 1.2 |
Mojito | 32 | 128 | 16384 | 48067 | 1.1 |
Mojito | 16 | 128 | 1024 | 47859 | 1.3 |
Mojito | 16 | 512 | 1024 | 47576 | 1.3 |
Mojito | 1 | 1024 | 8192 | 47573 | 0.8 |
Mojito | 8 | 256 | 1024 | 47218 | 1.2 |
Mojito | 32 | 256 | 8192 | 46845 | 1.7 |
Mojito | 16 | 512 | 8192 | 46811 | 1.4 |
Mojito | 16 | 1024 | 1024 | 46721 | 1.3 |
Mojito | 4 | 1024 | 8192 | 46195 | 1.3 |
Mojito | 16 | 512 | 16384 | 46190 | 1.6 |
Mojito | 32 | 128 | 1024 | 45386 | 1.2 |
Mojito | 32 | 256 | 1024 | 45115 | 1.2 |
Mojito | 16 | 64 | 1024 | 45082 | 1.4 |
Mojito | 4 | 512 | 16384 | 44398 | 1.2 |
Mojito | 8 | 1024 | 16384 | 43890 | 2.1 |
MachineGun | 1 | 512 | 1024 | 43529 | 0 |
MachineGun | 1 | 512 | 2048 | 43491 | 0 |
Mojito | 4 | 128 | 4096 | 43476 | 0.9 |
Mojito | 8 | 64 | 8192 | 43327 | 0.9 |
Mojito | 8 | 64 | 16384 | 43300 | 0.9 |
Mojito | 4 | 128 | 8192 | 43240 | 0.9 |
Mojito | 4 | 128 | 2048 | 43067 | 0.9 |
Mojito | 16 | 32 | 4096 | 42978 | 0.9 |
Mojito | 16 | 32 | 8192 | 42936 | 0.9 |
Mojito | 4 | 128 | 16384 | 42892 | 0.9 |
Mojito | 16 | 32 | 16384 | 42858 | 0.9 |
Mojito | 32 | 512 | 8192 | 42817 | 1.4 |
Mojito | 8 | 64 | 2048 | 42718 | 0.9 |
Mojito | 8 | 64 | 4096 | 42662 | 0.9 |
Mojito | 4 | 128 | 1024 | 42556 | 0.9 |
Mojito | 1 | 512 | 2048 | 42497 | 0.9 |
Mojito | 16 | 32 | 2048 | 42367 | 0.9 |
MachineGun | 1 | 512 | 4096 | 42362 | 0 |
Mojito | 1 | 512 | 4096 | 42187 | 0.9 |
Mojito | 8 | 64 | 1024 | 41979 | 0.9 |
Mojito | 16 | 32 | 1024 | 41876 | 0.9 |
Buoy | 1 | 128 | 4096 | 40492 | 97.5 |
Buoy | 1 | 256 | 1024 | 40148 | 94.9 |
MachineGun | 1 | 512 | 8192 | 39488 | 1.1 |
Mojito | 1 | 512 | 1024 | 39362 | 1 |
Mojito | 1 | 512 | 8192 | 37746 | 0.9 |
MachineGun | 1 | 512 | 16384 | 37613 | 3.1 |
Buoy | 1 | 128 | 2048 | 37507 | 97.5 |
Mojito | 32 | 1024 | 8192 | 36927 | 0.7 |
Buoy | 1 | 128 | 8192 | 36476 | 97.5 |
Mojito | 16 | 1024 | 8192 | 33914 | 0.8 |
Ibrowse | 1 | 32 | 8192 | 33847 | 4.4 |
Mojito | 32 | 512 | 16384 | 33554 | 2.2 |
Ibrowse | 1 | 32 | 4096 | 33002 | 3.9 |
Ibrowse | 1 | 32 | 2048 | 31958 | 2.9 |
Buoy | 1 | 128 | 16384 | 31956 | 97.6 |
Mojito | 32 | 1024 | 4096 | 31289 | 3.1 |
Buoy | 1 | 128 | 1024 | 30956 | 97.4 |
Mojito | 8 | 1024 | 8192 | 30955 | 2.4 |
Mojito | 1 | 512 | 16384 | 30296 | 5.2 |
Ibrowse | 1 | 32 | 16384 | 30091 | 4.9 |
Mojito | 1 | 1024 | 16384 | 28546 | 8.6 |
Dlhttpc | 1 | 1024 | 1024 | 28443 | 70.5 |
Mojito | 16 | 1024 | 16384 | 27933 | 2.4 |
Mojito | 8 | 512 | 16384 | 27761 | 2.2 |
Ibrowse | 1 | 32 | 1024 | 27589 | 0.1 |
Ibrowse | 1 | 64 | 4096 | 26942 | 0.2 |
Ibrowse | 1 | 64 | 2048 | 26386 | 0.4 |
Ibrowse | 1 | 64 | 8192 | 26133 | 0.7 |
Mojito | 32 | 1024 | 2048 | 25969 | 4.4 |
Mojito | 32 | 1024 | 16384 | 24921 | 2.8 |
Ibrowse | 1 | 64 | 16384 | 24618 | 0.4 |
Ibrowse | 1 | 128 | 4096 | 23537 | 0 |
Dlhttpc | 1 | 1024 | 8192 | 23528 | 95.2 |
Ibrowse | 1 | 64 | 1024 | 23308 | 0 |
MachineGun | 1 | 256 | 1024 | 23134 | 0.1 |
MachineGun | 1 | 256 | 2048 | 23058 | 0.1 |
Mojito | 4 | 1024 | 16384 | 22908 | 4.3 |
MachineGun | 1 | 256 | 4096 | 22816 | 0.1 |
Buoy | 1 | 64 | 4096 | 22782 | 98.7 |
Mojito | 4 | 64 | 4096 | 22759 | 1 |
Mojito | 1 | 256 | 1024 | 22702 | 1 |
Mojito | 4 | 64 | 16384 | 22666 | 1 |
Mojito | 1 | 256 | 2048 | 22637 | 1 |
Mojito | 8 | 32 | 8192 | 22620 | 1 |
Mojito | 1 | 256 | 4096 | 22604 | 1 |
Mojito | 4 | 64 | 8192 | 22598 | 1 |
Mojito | 8 | 32 | 16384 | 22469 | 1 |
Mojito | 8 | 32 | 4096 | 22469 | 1 |
Ibrowse | 1 | 128 | 2048 | 22469 | 0.1 |
Mojito | 4 | 64 | 2048 | 22463 | 1 |
Mojito | 8 | 32 | 2048 | 22384 | 1 |
Ibrowse | 1 | 128 | 8192 | 22330 | 0 |
Hackney | 1 | 256 | 1024 | 22316 | 0 |
Mojito | 4 | 64 | 1024 | 22296 | 1 |
Mojito | 8 | 32 | 1024 | 22239 | 1 |
MachineGun | 1 | 256 | 8192 | 22063 | 1 |
Buoy | 1 | 64 | 2048 | 21941 | 98.7 |
Hackney | 1 | 256 | 2048 | 21694 | 0 |
MachineGun | 1 | 256 | 16384 | 21479 | 3.3 |
Ibrowse | 1 | 128 | 16384 | 21437 | 0.1 |
Mojito | 1 | 256 | 8192 | 21220 | 1.1 |
Buoy | 1 | 64 | 8192 | 21124 | 98.7 |
Hackney | 1 | 256 | 4096 | 21031 | 0 |
Ibrowse | 1 | 128 | 1024 | 20333 | 0 |
Buoy | 1 | 64 | 16384 | 20244 | 98.8 |
Dlhttpc | 1 | 512 | 2048 | 19964 | 94.9 |
Buoy | 1 | 64 | 1024 | 19597 | 98.7 |
Hackney | 1 | 256 | 8192 | 19085 | 0 |
Mojito | 1 | 256 | 16384 | 19067 | 5.8 |
Hackney | 1 | 512 | 1024 | 18643 | 0 |
Ibrowse | 1 | 256 | 4096 | 18626 | 0 |
Dlhttpc | 1 | 1024 | 16384 | 18513 | 96.5 |
Hackney | 1 | 512 | 4096 | 18133 | 0 |
Ibrowse | 1 | 256 | 2048 | 17955 | 0 |
Ibrowse | 1 | 256 | 8192 | 17925 | 0 |
Hackney | 1 | 256 | 16384 | 17633 | 0 |
Dlhttpc | 1 | 1024 | 2048 | 17571 | 87.6 |
Hackney | 1 | 512 | 2048 | 17538 | 0 |
Ibrowse | 1 | 256 | 16384 | 17126 | 0 |
Dlhttpc | 1 | 1024 | 4096 | 16957 | 92.6 |
Ibrowse | 1 | 256 | 1024 | 16948 | 0 |
Mojito | 4 | 32 | 16384 | 15805 | 6.2 |
Mojito | 32 | 1024 | 1024 | 15511 | 8.5 |
Hackney | 1 | 512 | 8192 | 15265 | 0 |
Dlhttpc | 1 | 512 | 8192 | 13699 | 97.6 |
Ibrowse | 1 | 512 | 4096 | 13698 | 0 |
Mojito | 1 | 128 | 16384 | 13285 | 14.7 |
Ibrowse | 1 | 512 | 8192 | 13145 | 0 |
Ibrowse | 1 | 512 | 2048 | 13078 | 0 |
Ibrowse | 1 | 512 | 16384 | 12705 | 0 |
Hackney | 1 | 512 | 16384 | 12579 | 0 |
Buoy | 1 | 32 | 2048 | 12492 | 99.4 |
Ibrowse | 1 | 512 | 1024 | 12369 | 0 |
Buoy | 1 | 32 | 8192 | 11657 | 99.4 |
MachineGun | 1 | 128 | 1024 | 11615 | 0.1 |
MachineGun | 1 | 128 | 2048 | 11606 | 0.1 |
Mojito | 1 | 128 | 1024 | 11603 | 1 |
Mojito | 1 | 128 | 2048 | 11596 | 1 |
Hackney | 1 | 1024 | 2048 | 11573 | 0 |
Mojito | 4 | 32 | 4096 | 11571 | 1 |
MachineGun | 1 | 128 | 4096 | 11570 | 0.1 |
Mojito | 1 | 128 | 4096 | 11568 | 1 |
Hackney | 1 | 1024 | 1024 | 11566 | 0 |
Mojito | 4 | 32 | 2048 | 11556 | 1 |
Mojito | 4 | 32 | 8192 | 11550 | 1 |
Mojito | 4 | 32 | 1024 | 11517 | 1 |
Hackney | 1 | 128 | 1024 | 11465 | 0 |
Buoy | 1 | 32 | 4096 | 11463 | 99.4 |
Buoy | 1 | 32 | 16384 | 11443 | 99.4 |
Hackney | 1 | 128 | 2048 | 11438 | 0 |
MachineGun | 1 | 128 | 8192 | 11432 | 0.9 |
Hackney | 1 | 128 | 4096 | 11430 | 0 |
Mojito | 1 | 128 | 8192 | 11249 | 1.3 |
Hackney | 1 | 128 | 8192 | 11152 | 0 |
Buoy | 1 | 32 | 1024 | 10956 | 99.4 |
Hackney | 1 | 1024 | 4096 | 10725 | 0 |
Hackney | 1 | 128 | 16384 | 10544 | 0 |
Dlhttpc | 1 | 256 | 2048 | 10270 | 97.7 |
Hackney | 1 | 1024 | 8192 | 9662 | 0 |
Dlhttpc | 1 | 256 | 1024 | 9114 | 96.8 |
Hackney | 1 | 1024 | 16384 | 8551 | 0 |
Dlhttpc | 1 | 512 | 1024 | 8393 | 89.9 |
Ibrowse | 1 | 1024 | 4096 | 8365 | 0 |
Dlhttpc | 1 | 512 | 4096 | 8319 | 95.9 |
Ibrowse | 1 | 1024 | 2048 | 8149 | 0 |
Ibrowse | 1 | 1024 | 8192 | 8121 | 0 |
Mojito | 1 | 64 | 8192 | 7993 | 15.3 |
Dlhttpc | 1 | 256 | 8192 | 7966 | 98.7 |
Ibrowse | 1 | 1024 | 16384 | 7962 | 0 |
Ibrowse | 1 | 1024 | 1024 | 7828 | 0 |
Dlhttpc | 1 | 512 | 16384 | 6968 | 98.2 |
Dlhttpc | 1 | 256 | 16384 | 6722 | 99 |
MachineGun | 1 | 64 | 1024 | 5810 | 0.1 |
MachineGun | 1 | 64 | 4096 | 5807 | 0.1 |
MachineGun | 1 | 64 | 2048 | 5807 | 0.1 |
Mojito | 1 | 64 | 2048 | 5806 | 1 |
Mojito | 1 | 64 | 1024 | 5806 | 1 |
Mojito | 1 | 64 | 4096 | 5805 | 1 |
Hackney | 1 | 64 | 1024 | 5791 | 0 |
Hackney | 1 | 64 | 2048 | 5787 | 0 |
Hackney | 1 | 64 | 4096 | 5781 | 0 |
Dlhttpc | 1 | 128 | 1024 | 5753 | 98.6 |
Hackney | 1 | 64 | 8192 | 5746 | 0 |
Httpc | 1 | 32 | 1024 | 5742 | 0 |
Hackney | 1 | 64 | 16384 | 5682 | 0 |
Dlhttpc | 1 | 128 | 2048 | 5680 | 99 |
Httpc | 1 | 1024 | 2048 | 5571 | 0 |
Httpc | 1 | 256 | 1024 | 5568 | 0 |
Mojito | 1 | 32 | 4096 | 5562 | 17.4 |
Httpc | 1 | 64 | 1024 | 5560 | 0 |
Httpc | 1 | 128 | 1024 | 5543 | 0 |
Httpc | 1 | 256 | 4096 | 5532 | 0 |
Httpc | 1 | 512 | 2048 | 5488 | 0 |
Httpc | 1 | 512 | 1024 | 5467 | 0 |
Httpc | 1 | 128 | 4096 | 5408 | 0 |
Httpc | 1 | 1024 | 4096 | 5397 | 0 |
Httpc | 1 | 1024 | 1024 | 5340 | 0 |
Httpc | 1 | 256 | 2048 | 5263 | 0 |
Httpc | 1 | 32 | 2048 | 5231 | 0 |
Httpc | 1 | 64 | 2048 | 5186 | 0 |
Dlhttpc | 1 | 128 | 4096 | 5184 | 99.2 |
Httpc | 1 | 128 | 2048 | 5143 | 0 |
Httpc | 1 | 32 | 8192 | 5082 | 0 |
Httpc | 1 | 32 | 4096 | 5031 | 0 |
Httpc | 1 | 256 | 8192 | 5013 | 0 |
Httpc | 1 | 64 | 8192 | 5001 | 0 |
Httpc | 1 | 512 | 4096 | 4998 | 0 |
Mojito | 1 | 32 | 8192 | 4991 | 31.8 |
Httpc | 1 | 512 | 8192 | 4973 | 0 |
Httpc | 1 | 64 | 4096 | 4971 | 0 |
Httpc | 1 | 1024 | 8192 | 4718 | 0 |
Httpc | 1 | 64 | 16384 | 4590 | 0 |
Httpc | 1 | 128 | 8192 | 4540 | 0 |
Httpc | 1 | 256 | 16384 | 4525 | 0 |
Httpc | 1 | 32 | 16384 | 4427 | 0 |
Httpc | 1 | 1024 | 16384 | 4408 | 0 |
Dlhttpc | 1 | 128 | 8192 | 4364 | 99.4 |
Httpc | 1 | 128 | 16384 | 4298 | 0 |
Httpc | 1 | 512 | 16384 | 4268 | 0 |
Dlhttpc | 1 | 128 | 16384 | 3693 | 99.5 |
Mint | 1 | 1 | 2048 | 3474 | 2 |
Mint | 1 | 1 | 1024 | 3440 | 2 |
Dlhttpc | 1 | 256 | 4096 | 3374 | 98.4 |
Mint | 1 | 1 | 8192 | 3326 | 6.6 |
Dlhttpc | 1 | 64 | 1024 | 3178 | 99.4 |
Dlhttpc | 1 | 64 | 2048 | 3170 | 99.5 |
Mint | 1 | 1 | 4096 | 3114 | 8.7 |
MachineGun | 1 | 32 | 2048 | 2906 | 0.1 |
Mojito | 1 | 32 | 2048 | 2903 | 1 |
Mojito | 1 | 32 | 1024 | 2903 | 1 |
Hackney | 1 | 32 | 1024 | 2898 | 0 |
Hackney | 1 | 32 | 4096 | 2897 | 0 |
Hackney | 1 | 32 | 2048 | 2897 | 0 |
Hackney | 1 | 32 | 8192 | 2896 | 0 |
MachineGun | 1 | 32 | 1024 | 2891 | 0 |
Hackney | 1 | 32 | 16384 | 2885 | 0 |
Dlhttpc | 1 | 64 | 4096 | 2622 | 99.6 |
MachineGun | 1 | 32 | 4096 | 2362 | 42.2 |
Dlhttpc | 1 | 64 | 8192 | 2155 | 99.7 |
Dlhttpc | 1 | 64 | 16384 | 2091 | 99.7 |
MachineGun | 1 | 64 | 8192 | 1871 | 77.1 |
Dlhttpc | 1 | 32 | 2048 | 1681 | 99.8 |
Mint | 1 | 1 | 16384 | 1658 | 0 |
Dlhttpc | 1 | 32 | 1024 | 1606 | 99.7 |
Dlhttpc | 1 | 32 | 4096 | 1411 | 99.8 |
Dlhttpc | 1 | 32 | 8192 | 1209 | 99.9 |
Dlhttpc | 1 | 32 | 16384 | 1022 | 99.9 |
MachineGun | 1 | 128 | 16384 | 467 | 97.1 |
MachineGun | 1 | 64 | 16384 | 196 | 98.8 |
Mojito | 1 | 64 | 16384 | 96 | 98.8 |
MachineGun | 1 | 32 | 16384 | 96 | 99.4 |
MachineGun | 1 | 32 | 8192 | 48 | 99.4 |
Mojito | 1 | 32 | 16384 | 47 | 99.4 |
With server specs as above, except using Ubuntu's default ulimit -n 1024
.
This benchmark rightly showed that Mojito is fast, but wrongly showed it
being faster than Buoy. It does tell us that Mojito excels in
resource-constrained environments, or where configuring custom ulimit
s
is not possible.
Client | Pool Count | Pool Size | Concurrency | Req/sec | Error % |
---|---|---|---|---|---|
Client | Pool Count | Pool Size | Concurrency | Req/sec | Error % |
Mojito | 4 | 256 | 2048 | 52519 | 1.2 |
Mojito | 8 | 128 | 4096 | 52105 | 1.1 |
Mojito | 8 | 128 | 2048 | 51621 | 1 |
Mojito | 8 | 128 | 16384 | 51538 | 0.9 |
Mojito | 8 | 128 | 8192 | 51287 | 1 |
Mojito | 4 | 256 | 4096 | 51116 | 1.2 |
Mojito | 16 | 64 | 2048 | 51064 | 1.1 |
Mojito | 32 | 32 | 4096 | 50930 | 0.9 |
Mojito | 16 | 64 | 8192 | 50848 | 1 |
Mojito | 16 | 64 | 4096 | 50336 | 0.9 |
Mojito | 16 | 64 | 16384 | 50294 | 1 |
Mojito | 4 | 256 | 8192 | 49134 | 1.1 |
Mojito | 32 | 32 | 16384 | 48470 | 1 |
Mojito | 32 | 32 | 8192 | 48103 | 0.9 |
Mojito | 32 | 32 | 2048 | 47914 | 1 |
Mojito | 4 | 256 | 16384 | 46866 | 1.2 |
Mojito | 8 | 64 | 8192 | 43531 | 0.9 |
Mojito | 1 | 512 | 2048 | 43437 | 0.9 |
Mojito | 4 | 128 | 8192 | 43224 | 0.9 |
Mojito | 4 | 128 | 2048 | 43183 | 0.9 |
Mojito | 4 | 128 | 16384 | 43128 | 0.9 |
Mojito | 4 | 128 | 4096 | 42845 | 0.9 |
Mojito | 8 | 64 | 16384 | 42537 | 0.9 |
Mojito | 1 | 512 | 4096 | 42255 | 0.9 |
Mojito | 8 | 64 | 2048 | 42020 | 0.9 |
Mojito | 8 | 64 | 4096 | 41900 | 0.9 |
Mojito | 16 | 32 | 4096 | 41842 | 0.9 |
Mojito | 16 | 32 | 16384 | 41480 | 0.9 |
Mojito | 16 | 32 | 8192 | 41318 | 0.9 |
Mojito | 16 | 32 | 2048 | 40702 | 0.9 |
Mojito | 1 | 512 | 8192 | 37407 | 1 |
Buoy | 1 | 512 | 8192 | 36833 | 89.8 |
Buoy | 1 | 512 | 16384 | 34942 | 89.6 |
Buoy | 1 | 512 | 4096 | 34417 | 89.8 |
Buoy | 1 | 512 | 2048 | 31889 | 89.8 |
Mojito | 1 | 512 | 16384 | 30870 | 5.6 |
Mojito | 4 | 512 | 2048 | 26924 | 2 |
Mojito | 16 | 128 | 2048 | 24494 | 1.7 |
Mojito | 32 | 64 | 2048 | 24210 | 1.4 |
Mojito | 4 | 64 | 16384 | 22923 | 1 |
Mojito | 1 | 256 | 2048 | 22843 | 1 |
Mojito | 8 | 32 | 8192 | 22745 | 1 |
Mojito | 4 | 64 | 2048 | 22727 | 1 |
Mojito | 4 | 64 | 4096 | 22698 | 1 |
Mojito | 4 | 64 | 8192 | 22677 | 1 |
Mojito | 8 | 32 | 4096 | 22677 | 1 |
Mojito | 8 | 32 | 16384 | 22644 | 1 |
Mojito | 1 | 256 | 4096 | 22588 | 1 |
Mojito | 8 | 32 | 2048 | 22282 | 1 |
Hackney | 1 | 256 | 2048 | 21885 | 0 |
Mojito | 1 | 256 | 8192 | 21336 | 1.1 |
Hackney | 1 | 256 | 4096 | 21226 | 0 |
Mojito | 32 | 64 | 16384 | 21054 | 8.8 |
Mojito | 16 | 128 | 16384 | 19618 | 11.6 |
Dlhttpc | 1 | 512 | 2048 | 19493 | 95.1 |
Mojito | 1 | 256 | 16384 | 19310 | 5.4 |
Hackney | 1 | 256 | 8192 | 19033 | 0 |
Buoy | 1 | 256 | 4096 | 18692 | 94.9 |
Buoy | 1 | 256 | 8192 | 18531 | 94.9 |
Mojito | 8 | 256 | 16384 | 18409 | 7.2 |
Buoy | 1 | 256 | 16384 | 18052 | 94.8 |
Ibrowse | 1 | 256 | 2048 | 17655 | 0 |
Ibrowse | 1 | 256 | 4096 | 17626 | 0 |
Hackney | 1 | 512 | 2048 | 17619 | 0 |
Hackney | 1 | 256 | 16384 | 17272 | 0 |
Mojito | 4 | 512 | 8192 | 17157 | 9.5 |
Mojito | 8 | 256 | 4096 | 17022 | 4.8 |
Ibrowse | 1 | 256 | 8192 | 17007 | 0 |
Buoy | 1 | 256 | 2048 | 16973 | 94.9 |
Hackney | 1 | 512 | 4096 | 16821 | 0 |
Ibrowse | 1 | 256 | 16384 | 16527 | 0 |
Mojito | 16 | 128 | 4096 | 15636 | 3.9 |
Mojito | 8 | 256 | 2048 | 15459 | 1.6 |
Mojito | 8 | 512 | 2048 | 15385 | 2 |
Mojito | 16 | 512 | 2048 | 15334 | 1.8 |
Mojito | 8 | 256 | 8192 | 15332 | 9.7 |
Mojito | 4 | 512 | 4096 | 15318 | 5.1 |
Mojito | 32 | 64 | 4096 | 15179 | 6.2 |
Hackney | 1 | 512 | 8192 | 14954 | 0 |
Dlhttpc | 1 | 512 | 8192 | 14884 | 97.3 |
Mojito | 32 | 64 | 8192 | 14882 | 8.5 |
Mojito | 16 | 256 | 2048 | 14794 | 1.9 |
Mojito | 32 | 512 | 2048 | 14780 | 1.9 |
Mojito | 16 | 128 | 8192 | 14673 | 10.6 |
Mojito | 4 | 512 | 16384 | 14638 | 14.8 |
Ibrowse | 1 | 512 | 2048 | 13318 | 0 |
Ibrowse | 1 | 512 | 4096 | 13291 | 0 |
Hackney | 1 | 512 | 16384 | 13061 | 0 |
Ibrowse | 1 | 512 | 8192 | 12787 | 0 |
Mojito | 32 | 128 | 2048 | 12315 | 2.6 |
Ibrowse | 1 | 512 | 16384 | 12271 | 0 |
Mojito | 32 | 256 | 2048 | 12050 | 2.6 |
Mojito | 32 | 128 | 4096 | 11634 | 4.6 |
Mojito | 1 | 128 | 2048 | 11602 | 1 |
Mojito | 4 | 32 | 2048 | 11583 | 1 |
Ibrowse | 1 | 128 | 2048 | 11567 | 0.1 |
Mojito | 1 | 128 | 4096 | 11552 | 1 |
Mojito | 4 | 32 | 4096 | 11540 | 1 |
Dlhttpc | 1 | 512 | 16384 | 11493 | 98.1 |
Hackney | 1 | 128 | 2048 | 11491 | 0 |
Ibrowse | 1 | 128 | 4096 | 11488 | 0 |
Mojito | 32 | 128 | 16384 | 11462 | 19.3 |
Hackney | 1 | 128 | 4096 | 11418 | 0 |
Mojito | 32 | 128 | 8192 | 11361 | 10.8 |
Mojito | 16 | 256 | 8192 | 11276 | 11.8 |
Mojito | 1 | 128 | 8192 | 11260 | 1.3 |
Ibrowse | 1 | 128 | 8192 | 11232 | 0 |
Hackney | 1 | 128 | 8192 | 11151 | 0 |
Mojito | 4 | 32 | 16384 | 11015 | 48.2 |
Mojito | 4 | 32 | 8192 | 10855 | 1.7 |
Dlhttpc | 1 | 256 | 2048 | 10737 | 97.7 |
Ibrowse | 1 | 128 | 16384 | 10655 | 3.8 |
Hackney | 1 | 128 | 16384 | 10590 | 0 |
Dlhttpc | 1 | 256 | 4096 | 10181 | 98.3 |
Mojito | 16 | 256 | 4096 | 10162 | 4.3 |
Mojito | 8 | 512 | 16384 | 10153 | 14.6 |
Mojito | 32 | 256 | 4096 | 9852 | 4.9 |
Mojito | 16 | 512 | 4096 | 9673 | 5.7 |
Buoy | 1 | 128 | 4096 | 9626 | 97.4 |
Mojito | 8 | 512 | 4096 | 9617 | 7.9 |
Mojito | 8 | 512 | 8192 | 9518 | 11.3 |
Mojito | 1 | 128 | 16384 | 9425 | 47.4 |
Buoy | 1 | 128 | 8192 | 9403 | 97.4 |
Buoy | 1 | 128 | 2048 | 9036 | 97.4 |
Buoy | 1 | 128 | 16384 | 8624 | 97.6 |
Mojito | 16 | 256 | 16384 | 8524 | 31.6 |
Dlhttpc | 1 | 256 | 8192 | 8110 | 98.7 |
Dlhttpc | 1 | 512 | 4096 | 7998 | 96.3 |
Mojito | 32 | 512 | 4096 | 7538 | 16.2 |
Dlhttpc | 1 | 256 | 16384 | 7152 | 98.8 |
Mojito | 16 | 512 | 8192 | 6690 | 16.5 |
Mojito | 32 | 256 | 8192 | 6547 | 12.7 |
Mojito | 16 | 512 | 16384 | 6467 | 17.6 |
Mojito | 32 | 256 | 16384 | 6234 | 21.8 |
Mojito | 1 | 64 | 2048 | 5810 | 1 |
Mojito | 1 | 64 | 4096 | 5809 | 1 |
Ibrowse | 1 | 64 | 4096 | 5805 | 0 |
Hackney | 1 | 64 | 2048 | 5798 | 0 |
Hackney | 1 | 64 | 4096 | 5791 | 0 |
Ibrowse | 1 | 64 | 2048 | 5791 | 0 |
Ibrowse | 1 | 64 | 8192 | 5788 | 3.4 |
Hackney | 1 | 64 | 8192 | 5758 | 0 |
Ibrowse | 1 | 64 | 16384 | 5756 | 30 |
Mojito | 32 | 512 | 8192 | 5715 | 24.4 |
Httpc | 1 | 64 | 2048 | 5698 | 0 |
Httpc | 1 | 128 | 2048 | 5691 | 0 |
Hackney | 1 | 64 | 16384 | 5673 | 0 |
Httpc | 1 | 256 | 2048 | 5506 | 0 |
Httpc | 1 | 32 | 4096 | 5464 | 0 |
Httpc | 1 | 512 | 2048 | 5438 | 0 |
Httpc | 1 | 512 | 4096 | 5436 | 0 |
Httpc | 1 | 128 | 4096 | 5370 | 0 |
Dlhttpc | 1 | 128 | 2048 | 5319 | 99 |
Httpc | 1 | 64 | 4096 | 5300 | 0 |
Httpc | 1 | 32 | 2048 | 5265 | 0 |
Httpc | 1 | 128 | 8192 | 5173 | 0 |
Dlhttpc | 1 | 128 | 4096 | 5170 | 99.2 |
Httpc | 1 | 256 | 4096 | 5026 | 0 |
Httpc | 1 | 64 | 8192 | 4885 | 0 |
Httpc | 1 | 512 | 8192 | 4884 | 0 |
Mojito | 1 | 64 | 8192 | 4878 | 49.6 |
Httpc | 1 | 128 | 16384 | 4828 | 0 |
Buoy | 1 | 64 | 2048 | 4793 | 98.7 |
Buoy | 1 | 64 | 4096 | 4774 | 98.7 |
Httpc | 1 | 32 | 16384 | 4564 | 0 |
Mojito | 32 | 512 | 16384 | 4525 | 19 |
Httpc | 1 | 512 | 16384 | 4514 | 0 |
Httpc | 1 | 256 | 8192 | 4480 | 0 |
Buoy | 1 | 64 | 8192 | 4427 | 98.8 |
Httpc | 1 | 32 | 8192 | 4421 | 0 |
Httpc | 1 | 256 | 16384 | 4367 | 0 |
Buoy | 1 | 64 | 16384 | 4321 | 98.8 |
Dlhttpc | 1 | 128 | 8192 | 4122 | 99.4 |
Httpc | 1 | 64 | 16384 | 4087 | 0 |
Dlhttpc | 1 | 128 | 16384 | 3934 | 99.4 |
Mojito | 1 | 32 | 2048 | 2905 | 1 |
Hackney | 1 | 32 | 2048 | 2903 | 0 |
Hackney | 1 | 32 | 4096 | 2902 | 0 |
Ibrowse | 1 | 32 | 16384 | 2901 | 55.1 |
Ibrowse | 1 | 32 | 4096 | 2900 | 3.8 |
Hackney | 1 | 32 | 8192 | 2899 | 0 |
Ibrowse | 1 | 32 | 8192 | 2892 | 31.5 |
Ibrowse | 1 | 32 | 2048 | 2887 | 0.1 |
Hackney | 1 | 32 | 16384 | 2883 | 0 |
Dlhttpc | 1 | 64 | 2048 | 2860 | 99.5 |
Dlhttpc | 1 | 64 | 4096 | 2745 | 99.6 |
Mojito | 1 | 32 | 4096 | 2477 | 59.5 |
Buoy | 1 | 32 | 2048 | 2386 | 99.4 |
Dlhttpc | 1 | 64 | 8192 | 2282 | 99.7 |
Buoy | 1 | 32 | 4096 | 2203 | 99.4 |
Buoy | 1 | 32 | 8192 | 2160 | 99.4 |
Buoy | 1 | 32 | 16384 | 2144 | 99.4 |
Dlhttpc | 1 | 64 | 16384 | 2072 | 99.7 |
Mojito | 1 | 32 | 8192 | 1897 | 74.2 |
Dlhttpc | 1 | 32 | 2048 | 1592 | 99.8 |
Dlhttpc | 1 | 32 | 4096 | 1500 | 99.8 |
Dlhttpc | 1 | 32 | 8192 | 1195 | 99.8 |
Dlhttpc | 1 | 32 | 16384 | 1119 | 99.8 |
Mint | 1 | 1 | 16384 | 254 | 79 |
Mint | 1 | 1 | 8192 | 227 | 51.9 |
Mint | 1 | 1 | 4096 | 206 | 35 |
Mojito | 1 | 64 | 16384 | 97 | 98.8 |
Mojito | 1 | 32 | 16384 | 47 | 99.4 |