2023-06-25 i9-13900KF (32) @ 5.500GHz, 64G RAM

[LesnyRumcajs]

Specs

OS: Fedora release 38 (Thirty Eight) x86_64
Host: Z790 UD AX
Kernel: 6.3.6-200.fc38.x86_64
CPU: 13th Gen Intel i9-13900KF (32) @ 5.500GHz
GPU: NVIDIA GeForce RTX 4090
Memory: 64119MiB

Results

1 CPU

-----------------------------------------------------------------------------------------------------------------------------------------
| name                        |   req/s |   avg. latency |        90 % in |        95 % in |        99 % in | avg. cpu |   avg. memory |
-----------------------------------------------------------------------------------------------------------------------------------------
| java_vertx_grpc             |  201739 |        4.93 ms |        5.57 ms |        6.60 ms |       10.70 ms |   96.63% |     109.0 MiB |
| dotnet_grpc                 |  189382 |        4.97 ms |        5.74 ms |        6.58 ms |       50.39 ms |   99.59% |    239.78 MiB |
| rust_thruster_st            |  189079 |        5.26 ms |        5.70 ms |        5.97 ms |        6.76 ms |   94.39% |     17.51 MiB |
| rust_thruster_mt            |  186403 |        5.34 ms |        2.33 ms |        2.75 ms |      137.25 ms |   93.78% |     19.33 MiB |
| rust_tonic_st               |  181329 |        5.49 ms |        5.96 ms |        6.21 ms |        6.59 ms |   94.35% |     18.31 MiB |
| rust_grpcio                 |  177021 |        5.63 ms |        6.27 ms |        6.48 ms |        7.01 ms |   77.65% |    229.43 MiB |
| cpp_grpc_mt                 |  175054 |        5.69 ms |        6.59 ms |        6.88 ms |        7.52 ms |   76.31% |     20.13 MiB |
| cpp_grpc_st                 |  174633 |        5.70 ms |        6.45 ms |        6.69 ms |        7.30 ms |   76.07% |      9.99 MiB |
| cpp_asio_grpc               |  170664 |        5.84 ms |        6.65 ms |        6.94 ms |        7.55 ms |   77.04% |     20.75 MiB |
| rust_tonic_mt               |  161976 |        6.15 ms |        2.65 ms |        2.92 ms |      175.00 ms |   88.21% |     21.83 MiB |
| java_quarkus                |  154048 |        6.46 ms |        7.95 ms |        8.47 ms |       52.38 ms |   95.76% |    189.95 MiB |
| scala_akka                  |  153432 |        6.44 ms |        5.61 ms |       40.73 ms |       46.93 ms |  100.14% |    840.53 MiB |
| go_vtgrpc                   |  150175 |        6.57 ms |       10.40 ms |       11.61 ms |       13.64 ms |   96.94% |     33.86 MiB |
| java_hotspot_grpc_pgc       |  125344 |        7.93 ms |        8.41 ms |       37.68 ms |       43.12 ms |   99.84% |   1021.64 MiB |
| java_armeria                |  124418 |        8.00 ms |        6.24 ms |       51.80 ms |       56.16 ms |   99.81% |    783.71 MiB |
| java_hotspot_grpc_zgc       |  123294 |        8.07 ms |        8.75 ms |       39.01 ms |       63.16 ms |  100.09% |   4378.28 MiB |
| java_hotspot_grpc_sgc       |  120976 |        8.22 ms |        9.03 ms |       37.66 ms |       43.33 ms |  100.18% |    129.19 MiB |
| java_hotspot_grpc_g1gc      |  118320 |        8.41 ms |        9.06 ms |       38.93 ms |       43.02 ms |   100.0% |    350.85 MiB |
| java_hotspot_grpc_she       |  117975 |        8.44 ms |        9.51 ms |       39.64 ms |       63.87 ms |   99.74% |   5097.76 MiB |
| go_grpc                     |  115488 |        8.58 ms |       13.62 ms |       14.91 ms |       17.71 ms |   97.35% |     34.97 MiB |
| crystal_grpc                |  110101 |        9.06 ms |        9.78 ms |       10.05 ms |       10.98 ms |   96.86% |      65.6 MiB |
| java_openj9_grpc_gencon     |   97721 |       10.19 ms |       40.21 ms |       47.02 ms |       50.88 ms |   99.82% |    255.14 MiB |
| scala_fs2                   |   93017 |       10.71 ms |       54.53 ms |       57.52 ms |       71.60 ms |   99.56% |   2007.95 MiB |
| kotlin_grpc                 |   85440 |       11.67 ms |       60.27 ms |       62.29 ms |       74.27 ms |   100.0% |   1241.09 MiB |
| java_quarkus_native         |   80312 |       12.43 ms |       13.60 ms |       17.75 ms |       21.96 ms |   97.77% |    248.58 MiB |
| java_micronaut              |   69576 |       14.35 ms |       56.28 ms |       58.96 ms |       73.60 ms |  100.57% |   1119.18 MiB |
| java_micronaut_workstealing |   67775 |       14.73 ms |       56.29 ms |       58.87 ms |       71.85 ms |  100.51% |   1325.85 MiB |
| swift_grpc                  |   56524 |       17.67 ms |       18.13 ms |       18.47 ms |       19.01 ms |   98.46% |     51.01 MiB |
| scala_zio                   |   45483 |       21.95 ms |       74.97 ms |       77.34 ms |       84.74 ms |  100.29% |   2102.33 MiB |
| go_connect                  |   36430 |       27.43 ms |       51.88 ms |       74.75 ms |      151.53 ms |   87.83% |     37.68 MiB |
| node_grpcjs_st              |   35875 |       27.82 ms |       43.89 ms |       49.11 ms |       55.78 ms |  100.11% |    192.79 MiB |
| python_async_grpc           |   21035 |       47.51 ms |       66.22 ms |       68.50 ms |       71.85 ms |   99.41% |     84.26 MiB |
| java_aot                    |   18890 |       52.78 ms |      101.64 ms |      197.47 ms |      402.95 ms |   100.0% |   1255.55 MiB |
| python_grpc                 |   16932 |       59.02 ms |       74.25 ms |       77.11 ms |       85.11 ms |  100.52% |     51.71 MiB |
| d_grpc                      |   12755 |       77.80 ms |      113.63 ms |      140.20 ms |      190.52 ms |  101.17% |     65.86 MiB |
| ruby_grpc                   |   12533 |       79.36 ms |       91.16 ms |       93.54 ms |       97.68 ms |  100.27% |     67.08 MiB |
| php_grpc                    |    5954 |      167.70 ms |      196.77 ms |      197.46 ms |      198.87 ms |   99.68% |    134.41 MiB |
| erlang_grpcbox              |    5832 |      171.19 ms |      201.61 ms |      208.16 ms |      267.77 ms |  103.39% |   1659.68 MiB |
-----------------------------------------------------------------------------------------------------------------------------------------
Benchmark Execution Parameters:
241998b Sat, 24 Jun 2023 17:08:13 +0200 GitHub temporarily disable Elixir benchmark (#353)
- GRPC_BENCHMARK_DURATION=120s
- GRPC_BENCHMARK_WARMUP=30s
- GRPC_SERVER_CPUS=1
- GRPC_SERVER_RAM=8192m
- GRPC_CLIENT_CONNECTIONS=50
- GRPC_CLIENT_CONCURRENCY=1000
- GRPC_CLIENT_QPS=0
- GRPC_CLIENT_CPUS=25
- GRPC_REQUEST_SCENARIO=complex_proto
- GRPC_GHZ_TAG=0.114.0

2 CPUs

-----------------------------------------------------------------------------------------------------------------------------------------
| name                        |   req/s |   avg. latency |        90 % in |        95 % in |        99 % in | avg. cpu |   avg. memory |
-----------------------------------------------------------------------------------------------------------------------------------------
| dotnet_grpc                 |  297672 |        3.08 ms |        3.93 ms |        4.61 ms |        8.58 ms |  197.79% |    187.56 MiB |
| rust_thruster_mt            |  276698 |        3.47 ms |        9.89 ms |       18.38 ms |       25.30 ms |  188.41% |     14.26 MiB |
| cpp_grpc_mt                 |  272725 |        3.51 ms |        5.08 ms |        6.43 ms |       22.26 ms |  201.84% |     41.83 MiB |
| cpp_asio_grpc               |  266892 |        3.60 ms |        5.17 ms |        6.66 ms |       23.41 ms |  200.66% |     41.53 MiB |
| rust_grpcio                 |  259899 |        3.77 ms |        4.62 ms |        5.10 ms |        6.85 ms |  161.84% |    260.09 MiB |
| scala_akka                  |  252787 |        3.74 ms |        4.68 ms |        6.42 ms |       35.06 ms |  202.02% |   1203.48 MiB |
| rust_tonic_mt               |  245246 |        4.00 ms |       10.60 ms |       18.40 ms |       29.95 ms |  176.13% |     16.49 MiB |
| go_vtgrpc                   |  228855 |        4.17 ms |        6.42 ms |        7.18 ms |        8.65 ms |  190.74% |     25.15 MiB |
| java_quarkus                |  226972 |        4.34 ms |        5.34 ms |        5.98 ms |       31.01 ms |  188.96% |    540.14 MiB |
| java_hotspot_grpc_pgc       |  214398 |        4.53 ms |        4.64 ms |        7.86 ms |       44.94 ms |  200.41% |    620.92 MiB |
| java_hotspot_grpc_zgc       |  211233 |        4.61 ms |        4.37 ms |        7.68 ms |       42.16 ms |  201.69% |   5820.59 MiB |
| java_hotspot_grpc_g1gc      |  206440 |        4.73 ms |        4.71 ms |       35.06 ms |       44.52 ms |  200.61% |    592.47 MiB |
| java_armeria                |  203987 |        4.72 ms |        3.99 ms |        7.55 ms |       52.92 ms |  200.42% |     685.0 MiB |
| java_hotspot_grpc_sgc       |  203677 |        4.80 ms |        5.10 ms |       12.74 ms |       38.59 ms |  201.09% |    132.75 MiB |
| java_hotspot_grpc_she       |  203121 |        4.81 ms |        4.53 ms |       12.48 ms |       42.85 ms |  200.87% |   5157.94 MiB |
| java_vertx_grpc             |  192354 |        5.18 ms |        5.64 ms |        5.97 ms |       10.04 ms |   97.43% |    295.36 MiB |
| go_grpc                     |  186562 |        5.20 ms |        7.88 ms |        8.82 ms |       10.42 ms |  193.15% |     24.82 MiB |
| rust_thruster_st            |  184955 |        5.38 ms |        5.85 ms |        6.27 ms |        7.48 ms |   94.34% |     10.12 MiB |
| rust_tonic_st               |  180868 |        5.50 ms |        5.94 ms |        6.21 ms |        6.59 ms |   94.36% |     10.36 MiB |
| cpp_grpc_st                 |  174842 |        5.70 ms |        6.50 ms |        6.77 ms |        7.45 ms |   76.34% |      9.42 MiB |
| java_openj9_grpc_gencon     |  166583 |        5.92 ms |        5.46 ms |       41.59 ms |       55.18 ms |  200.37% |    249.82 MiB |
| kotlin_grpc                 |  157313 |        6.23 ms |        5.26 ms |       52.98 ms |       66.24 ms |  201.61% |   1027.13 MiB |
| scala_fs2                   |  148717 |        6.62 ms |        5.54 ms |       52.63 ms |       62.24 ms |  200.26% |   1893.94 MiB |
| java_quarkus_native         |  140905 |        7.07 ms |        7.91 ms |        9.01 ms |       16.45 ms |  191.49% |    362.92 MiB |
| java_micronaut              |  122182 |        8.13 ms |        6.00 ms |       53.21 ms |       56.58 ms |  202.69% |    944.61 MiB |
| java_micronaut_workstealing |  119977 |        8.29 ms |        6.64 ms |       51.50 ms |       57.11 ms |  202.54% |    974.54 MiB |
| crystal_grpc                |  110451 |        9.04 ms |        9.76 ms |       10.00 ms |       10.93 ms |   96.85% |     60.23 MiB |
| swift_grpc                  |  107137 |        9.31 ms |        9.98 ms |       10.16 ms |       10.57 ms |  196.78% |      6.96 MiB |
| scala_zio                   |   69449 |       14.34 ms |       71.20 ms |       73.47 ms |       77.98 ms |  201.58% |   2133.28 MiB |
| go_connect                  |   66649 |       14.98 ms |       22.65 ms |       26.40 ms |       33.54 ms |  177.82% |     28.71 MiB |
| node_grpcjs_st              |   44644 |       22.36 ms |       25.44 ms |       29.59 ms |       33.68 ms |   124.9% |    125.05 MiB |
| java_aot                    |   39498 |       25.08 ms |       92.85 ms |       94.67 ms |       99.62 ms |  199.84% |    1437.3 MiB |
| python_async_grpc           |   30064 |       33.24 ms |       34.19 ms |       34.69 ms |       36.06 ms |  143.93% |     61.77 MiB |
| python_grpc                 |   24357 |       41.04 ms |       44.80 ms |       46.99 ms |       53.09 ms |  143.74% |     39.73 MiB |
| d_grpc                      |   22836 |       43.52 ms |       66.43 ms |       73.11 ms |       86.93 ms |  187.79% |     52.04 MiB |
| ruby_grpc                   |   16284 |       61.17 ms |       68.42 ms |       70.44 ms |       73.94 ms |  129.64% |     54.59 MiB |
| erlang_grpcbox              |   13295 |       75.15 ms |       84.12 ms |       87.95 ms |       95.43 ms |   151.8% |   1630.38 MiB |
| php_grpc                    |   11879 |       84.10 ms |       97.03 ms |       97.78 ms |       99.52 ms |  199.89% |     73.98 MiB |
-----------------------------------------------------------------------------------------------------------------------------------------
Benchmark Execution Parameters:
241998b Sat, 24 Jun 2023 17:08:13 +0200 GitHub temporarily disable Elixir benchmark (#353)
- GRPC_BENCHMARK_DURATION=120s
- GRPC_BENCHMARK_WARMUP=30s
- GRPC_SERVER_CPUS=2
- GRPC_SERVER_RAM=8192m
- GRPC_CLIENT_CONNECTIONS=50
- GRPC_CLIENT_CONCURRENCY=1000
- GRPC_CLIENT_QPS=0
- GRPC_CLIENT_CPUS=25
- GRPC_REQUEST_SCENARIO=complex_proto
- GRPC_GHZ_TAG=0.114.0

3 CPUs

-----------------------------------------------------------------------------------------------------------------------------------------
| name                        |   req/s |   avg. latency |        90 % in |        95 % in |        99 % in | avg. cpu |   avg. memory |
-----------------------------------------------------------------------------------------------------------------------------------------
| dotnet_grpc                 |  373093 |        2.37 ms |        3.57 ms |        4.31 ms |        8.40 ms |  286.25% |    200.18 MiB |
| scala_akka                  |  349865 |        2.64 ms |        4.09 ms |        5.36 ms |       27.51 ms |  303.02% |    856.59 MiB |
| rust_thruster_mt            |  342462 |        2.77 ms |        5.75 ms |        8.93 ms |       13.93 ms |  274.86% |     15.26 MiB |
| cpp_grpc_mt                 |  319272 |        2.95 ms |        4.70 ms |        6.07 ms |       18.31 ms |  303.39% |     52.57 MiB |
| rust_tonic_mt               |  313373 |        3.06 ms |        5.78 ms |        7.92 ms |       12.46 ms |  262.27% |     17.87 MiB |
| rust_grpcio                 |  312567 |        3.08 ms |        4.47 ms |        5.06 ms |        6.14 ms |  244.09% |    281.54 MiB |
| cpp_asio_grpc               |  307778 |        3.07 ms |        4.62 ms |        5.88 ms |       19.45 ms |  303.89% |     57.57 MiB |
| java_quarkus                |  295440 |        3.19 ms |        4.59 ms |        5.42 ms |       21.22 ms |  280.99% |    433.67 MiB |
| go_vtgrpc                   |  287280 |        3.25 ms |        4.96 ms |        5.58 ms |        7.07 ms |   280.7% |     26.32 MiB |
| java_hotspot_grpc_pgc       |  269862 |        3.49 ms |        4.27 ms |        6.00 ms |       36.70 ms |  302.05% |    481.56 MiB |
| java_hotspot_grpc_zgc       |  267704 |        3.52 ms |        4.02 ms |        5.96 ms |       35.35 ms |  302.26% |   5903.19 MiB |
| java_hotspot_grpc_g1gc      |  259096 |        3.64 ms |        4.12 ms |        6.00 ms |       42.01 ms |  301.22% |    418.92 MiB |
| java_hotspot_grpc_sgc       |  255735 |        3.70 ms |        4.65 ms |        6.57 ms |       33.71 ms |  302.19% |    141.06 MiB |
| java_hotspot_grpc_she       |  251240 |        3.76 ms |        4.28 ms |        6.52 ms |       45.15 ms |  303.04% |   5206.19 MiB |
| java_armeria                |  250994 |        3.71 ms |        3.75 ms |        5.62 ms |       47.92 ms |  300.22% |    907.44 MiB |
| go_grpc                     |  235835 |        3.98 ms |        6.09 ms |        6.81 ms |        8.33 ms |  286.87% |     25.67 MiB |
| kotlin_grpc                 |  211178 |        4.53 ms |        4.40 ms |       14.09 ms |       55.75 ms |  301.57% |     993.9 MiB |
| java_openj9_grpc_gencon     |  210589 |        4.58 ms |        4.63 ms |        7.32 ms |       42.18 ms |  301.67% |    237.28 MiB |
| scala_fs2                   |  198912 |        4.84 ms |        4.80 ms |       46.33 ms |       57.58 ms |  300.97% |   1955.33 MiB |
| java_vertx_grpc             |  188486 |        5.28 ms |        5.85 ms |        6.29 ms |       10.30 ms |   97.65% |    251.66 MiB |
| rust_thruster_st            |  187054 |        5.31 ms |        5.83 ms |        6.16 ms |        7.27 ms |   94.42% |      9.91 MiB |
| java_quarkus_native         |  180623 |        5.50 ms |        6.38 ms |        6.94 ms |       15.29 ms |  283.53% |    488.41 MiB |
| rust_tonic_st               |  178007 |        5.59 ms |        6.70 ms |        7.10 ms |        7.61 ms |   94.85% |     12.05 MiB |
| cpp_grpc_st                 |  173586 |        5.74 ms |        6.57 ms |        6.90 ms |        7.56 ms |   76.09% |     11.76 MiB |
| java_micronaut              |  163778 |        6.00 ms |        4.85 ms |       48.73 ms |       56.00 ms |  305.37% |   2027.06 MiB |
| java_micronaut_workstealing |  162568 |        6.04 ms |        5.06 ms |       49.01 ms |       55.53 ms |  305.37% |   1333.18 MiB |
| swift_grpc                  |  142971 |        6.97 ms |        7.62 ms |        7.91 ms |        8.38 ms |  295.95% |      7.23 MiB |
| crystal_grpc                |  109103 |        9.15 ms |        9.82 ms |       10.07 ms |       10.72 ms |   96.89% |     60.71 MiB |
| go_connect                  |   87981 |       11.34 ms |       16.98 ms |       19.05 ms |       24.65 ms |  267.88% |     30.82 MiB |
| scala_zio                   |   75128 |       13.21 ms |       65.34 ms |       69.35 ms |       75.90 ms |  301.38% |   2199.38 MiB |
| java_aot                    |   60123 |       16.33 ms |       83.93 ms |       86.36 ms |       90.47 ms |  300.58% |   1598.98 MiB |
| node_grpcjs_st              |   44589 |       22.39 ms |       24.25 ms |       30.81 ms |       33.68 ms |  124.41% |    122.45 MiB |
| python_async_grpc           |   30155 |       33.15 ms |       34.26 ms |       34.61 ms |       36.61 ms |   142.6% |     58.61 MiB |
| python_grpc                 |   24540 |       40.73 ms |       44.46 ms |       46.73 ms |       51.62 ms |   143.6% |     39.11 MiB |
| d_grpc                      |   22538 |       44.10 ms |       66.01 ms |       72.75 ms |       85.92 ms |  206.54% |     51.72 MiB |
| php_grpc                    |   17991 |       55.54 ms |       81.16 ms |       81.94 ms |       83.32 ms |  300.59% |     73.88 MiB |
| ruby_grpc                   |   16246 |       61.38 ms |       68.84 ms |       71.00 ms |       74.16 ms |  129.54% |     45.25 MiB |
| erlang_grpcbox              |   13286 |       75.20 ms |       84.24 ms |       87.95 ms |       95.39 ms |  152.27% |   1627.53 MiB |
-----------------------------------------------------------------------------------------------------------------------------------------
Benchmark Execution Parameters:
241998b Sat, 24 Jun 2023 17:08:13 +0200 GitHub temporarily disable Elixir benchmark (#353)
- GRPC_BENCHMARK_DURATION=120s
- GRPC_BENCHMARK_WARMUP=30s
- GRPC_SERVER_CPUS=3
- GRPC_SERVER_RAM=8192m
- GRPC_CLIENT_CONNECTIONS=50
- GRPC_CLIENT_CONCURRENCY=1000
- GRPC_CLIENT_QPS=0
- GRPC_CLIENT_CPUS=25
- GRPC_REQUEST_SCENARIO=complex_proto
- GRPC_GHZ_TAG=0.114.0

4 CPUs

-----------------------------------------------------------------------------------------------------------------------------------------
| name                        |   req/s |   avg. latency |        90 % in |        95 % in |        99 % in | avg. cpu |   avg. memory |
-----------------------------------------------------------------------------------------------------------------------------------------
| scala_akka                  |  411553 |        2.11 ms |        3.47 ms |        4.19 ms |        6.18 ms |  384.02% |    668.34 MiB |
| dotnet_grpc                 |  400748 |        2.17 ms |        3.38 ms |        4.10 ms |        6.06 ms |  346.29% |    226.08 MiB |
| rust_thruster_mt            |  377493 |        2.45 ms |        4.26 ms |        5.33 ms |        8.00 ms |  341.93% |     16.95 MiB |
| rust_tonic_mt               |  356484 |        2.64 ms |        4.36 ms |        5.29 ms |        7.51 ms |  336.52% |     19.04 MiB |
| java_quarkus                |  353631 |        2.66 ms |        3.99 ms |        4.78 ms |        8.88 ms |  356.93% |    465.04 MiB |
| cpp_grpc_mt                 |  352484 |        2.63 ms |        4.32 ms |        5.56 ms |       12.96 ms |  405.13% |     60.92 MiB |
| cpp_asio_grpc               |  339408 |        2.74 ms |        4.32 ms |        5.51 ms |       14.08 ms |  405.28% |     64.87 MiB |
| rust_grpcio                 |  331127 |        2.87 ms |        4.17 ms |        4.56 ms |        5.89 ms |  317.54% |    290.55 MiB |
| java_hotspot_grpc_pgc       |  327305 |        2.81 ms |        3.79 ms |        5.19 ms |       26.48 ms |  403.61% |    731.31 MiB |
| go_vtgrpc                   |  323691 |        2.82 ms |        4.45 ms |        5.07 ms |        6.62 ms |  358.91% |     26.42 MiB |
| java_hotspot_grpc_zgc       |  322975 |        2.85 ms |        3.74 ms |        4.98 ms |       27.67 ms |  404.32% |   5769.78 MiB |
| java_hotspot_grpc_g1gc      |  307977 |        3.02 ms |        3.76 ms |        5.01 ms |       28.97 ms |  403.47% |    576.89 MiB |
| java_hotspot_grpc_she       |  304302 |        3.06 ms |        3.81 ms |        5.27 ms |       30.28 ms |  403.51% |   5252.61 MiB |
| java_hotspot_grpc_sgc       |  302358 |        3.10 ms |        4.25 ms |        5.69 ms |       24.98 ms |  405.08% |    153.46 MiB |
| java_armeria                |  289756 |        3.10 ms |        3.50 ms |        5.06 ms |       41.32 ms |  401.16% |    746.47 MiB |
| go_grpc                     |  279145 |        3.35 ms |        5.11 ms |        5.77 ms |        7.31 ms |  375.75% |      26.6 MiB |
| kotlin_grpc                 |  254854 |        3.68 ms |        3.92 ms |        5.75 ms |       52.51 ms |  403.28% |   1244.62 MiB |
| java_openj9_grpc_gencon     |  248892 |        3.80 ms |        4.28 ms |        6.01 ms |       37.89 ms |  403.46% |    270.41 MiB |
| scala_fs2                   |  233873 |        4.06 ms |        4.52 ms |       14.18 ms |       53.72 ms |  402.78% |    1638.4 MiB |
| java_quarkus_native         |  209559 |        4.70 ms |        5.63 ms |        6.38 ms |       14.60 ms |  374.21% |    581.94 MiB |
| java_micronaut_workstealing |  197618 |        4.89 ms |        4.40 ms |       40.97 ms |       49.73 ms |  406.87% |    1891.1 MiB |
| java_micronaut              |  196576 |        4.91 ms |        4.48 ms |       42.49 ms |       50.07 ms |  406.17% |   1469.55 MiB |
| java_vertx_grpc             |  188418 |        5.28 ms |        5.88 ms |        6.58 ms |       10.20 ms |   97.61% |    276.89 MiB |
| rust_thruster_st            |  186055 |        5.34 ms |        6.00 ms |        6.65 ms |        7.62 ms |   94.53% |     10.04 MiB |
| rust_tonic_st               |  179240 |        5.55 ms |        6.40 ms |        7.00 ms |        8.00 ms |   94.68% |     11.31 MiB |
| swift_grpc                  |  176314 |        5.64 ms |        6.34 ms |        6.59 ms |        7.05 ms |  395.35% |      7.51 MiB |
| cpp_grpc_st                 |  173898 |        5.73 ms |        6.57 ms |        6.90 ms |        7.53 ms |   76.33% |     10.74 MiB |
| crystal_grpc                |  111399 |        8.96 ms |        9.91 ms |       10.20 ms |       11.16 ms |   96.81% |     61.68 MiB |
| go_connect                  |  106135 |        9.39 ms |       14.48 ms |       16.78 ms |       23.50 ms |  357.91% |     32.11 MiB |
| scala_zio                   |  103447 |        9.51 ms |        8.18 ms |       64.17 ms |       69.64 ms |  404.22% |   2219.86 MiB |
| java_aot                    |   80801 |       12.08 ms |       70.58 ms |       79.35 ms |       90.34 ms |  401.37% |   1374.26 MiB |
| node_grpcjs_st              |   44036 |       22.67 ms |       25.97 ms |       32.21 ms |       35.31 ms |  124.74% |    126.21 MiB |
| python_async_grpc           |   30078 |       33.23 ms |       34.35 ms |       34.70 ms |       36.58 ms |  142.89% |     55.19 MiB |
| python_grpc                 |   24334 |       41.07 ms |       44.97 ms |       47.79 ms |       54.16 ms |  143.51% |     42.51 MiB |
| php_grpc                    |   23810 |       41.97 ms |       65.55 ms |       66.89 ms |       69.77 ms |   401.3% |     73.92 MiB |
| d_grpc                      |   22554 |       44.09 ms |       67.23 ms |       73.89 ms |       87.33 ms |  181.18% |     52.19 MiB |
| ruby_grpc                   |   16360 |       60.92 ms |       67.93 ms |       70.02 ms |       73.45 ms |  129.69% |      45.5 MiB |
| erlang_grpcbox              |   13291 |       75.17 ms |       84.25 ms |       87.96 ms |       94.49 ms |  145.77% |   1640.45 MiB |
-----------------------------------------------------------------------------------------------------------------------------------------
Benchmark Execution Parameters:
241998b Sat, 24 Jun 2023 17:08:13 +0200 GitHub temporarily disable Elixir benchmark (#353)
- GRPC_BENCHMARK_DURATION=120s
- GRPC_BENCHMARK_WARMUP=30s
- GRPC_SERVER_CPUS=4
- GRPC_SERVER_RAM=8192m
- GRPC_CLIENT_CONNECTIONS=50
- GRPC_CLIENT_CONCURRENCY=1000
- GRPC_CLIENT_QPS=0
- GRPC_CLIENT_CPUS=25
- GRPC_REQUEST_SCENARIO=complex_proto
- GRPC_GHZ_TAG=0.114.0

5 CPUs

-----------------------------------------------------------------------------------------------------------------------------------------
| name                        |   req/s |   avg. latency |        90 % in |        95 % in |        99 % in | avg. cpu |   avg. memory |
-----------------------------------------------------------------------------------------------------------------------------------------
| scala_akka                  |  419853 |        2.02 ms |        3.41 ms |        4.18 ms |        6.28 ms |  397.53% |    652.78 MiB |
| dotnet_grpc                 |  409031 |        2.09 ms |        3.26 ms |        3.95 ms |        5.60 ms |  375.19% |    249.44 MiB |
| rust_thruster_mt            |  395454 |        2.27 ms |        3.79 ms |        4.56 ms |        6.47 ms |  392.55% |     17.13 MiB |
| cpp_grpc_mt                 |  388086 |        2.33 ms |        3.96 ms |        4.76 ms |        6.76 ms |  507.56% |     66.81 MiB |
| java_quarkus                |  386550 |        2.38 ms |        3.84 ms |        4.73 ms |        7.58 ms |  427.71% |    477.02 MiB |
| rust_tonic_mt               |  382615 |        2.40 ms |        3.96 ms |        4.65 ms |        6.27 ms |   395.9% |     20.04 MiB |
| java_hotspot_grpc_pgc       |  381519 |        2.29 ms |        3.64 ms |        4.95 ms |       14.13 ms |  504.42% |    550.36 MiB |
| cpp_asio_grpc               |  372696 |        2.45 ms |        4.03 ms |        4.94 ms |        7.79 ms |  507.59% |     74.84 MiB |
| java_hotspot_grpc_zgc       |  369729 |        2.37 ms |        3.67 ms |        4.80 ms |       16.19 ms |  504.87% |   4573.07 MiB |
| rust_grpcio                 |  362270 |        2.57 ms |        3.68 ms |        4.43 ms |        5.77 ms |   376.0% |    314.61 MiB |
| java_hotspot_grpc_g1gc      |  357799 |        2.48 ms |        3.68 ms |        4.89 ms |       19.51 ms |   504.2% |    635.22 MiB |
| java_hotspot_grpc_she       |  357230 |        2.50 ms |        3.69 ms |        4.97 ms |       19.75 ms |   504.5% |   5259.78 MiB |
| java_hotspot_grpc_sgc       |  355226 |        2.52 ms |        4.02 ms |        5.34 ms |       14.33 ms |  505.24% |    159.59 MiB |
| go_vtgrpc                   |  344809 |        2.63 ms |        4.25 ms |        4.97 ms |        6.68 ms |  434.89% |     26.53 MiB |
| java_armeria                |  328387 |        2.65 ms |        3.63 ms |        5.18 ms |       30.45 ms |  501.96% |   1104.81 MiB |
| go_grpc                     |  303706 |        3.04 ms |        4.82 ms |        5.52 ms |        7.42 ms |  459.71% |     26.81 MiB |
| kotlin_grpc                 |  296356 |        3.05 ms |        3.89 ms |        5.66 ms |       37.34 ms |  502.93% |    850.59 MiB |
| java_openj9_grpc_gencon     |  280141 |        3.32 ms |        4.02 ms |        5.48 ms |       32.03 ms |  505.04% |    252.37 MiB |
| scala_fs2                   |  267235 |        3.46 ms |        4.51 ms |        6.85 ms |       37.60 ms |  502.06% |    1761.0 MiB |
| java_quarkus_native         |  235741 |        4.06 ms |        5.00 ms |        6.12 ms |       13.69 ms |  463.06% |    657.47 MiB |
| java_micronaut              |  217755 |        4.37 ms |        4.59 ms |        8.45 ms |       44.83 ms |  509.34% |   1404.09 MiB |
| java_micronaut_workstealing |  214123 |        4.45 ms |        4.42 ms |        7.90 ms |       45.55 ms |  508.72% |   2005.39 MiB |
| swift_grpc                  |  205682 |        4.82 ms |        5.54 ms |        5.83 ms |        7.16 ms |   496.2% |      7.53 MiB |
| rust_thruster_st            |  186950 |        5.32 ms |        6.32 ms |        6.89 ms |        7.78 ms |   94.22% |      9.99 MiB |
| java_vertx_grpc             |  186756 |        5.33 ms |        5.83 ms |        6.13 ms |       10.29 ms |   97.99% |    270.79 MiB |
| rust_tonic_st               |  181184 |        5.49 ms |        6.13 ms |        6.42 ms |        7.05 ms |   93.96% |     10.25 MiB |
| cpp_grpc_st                 |  174191 |        5.72 ms |        6.57 ms |        6.84 ms |        7.47 ms |   76.23% |      9.44 MiB |
| scala_zio                   |  122009 |        8.00 ms |        7.36 ms |       59.63 ms |       75.90 ms |  505.59% |    2307.3 MiB |
| go_connect                  |  118893 |        8.37 ms |       13.42 ms |       15.60 ms |       21.09 ms |  449.38% |     33.14 MiB |
| crystal_grpc                |  109502 |        9.11 ms |        9.86 ms |       10.10 ms |       11.15 ms |    96.9% |     60.75 MiB |
| java_aot                    |  102374 |        9.44 ms |       13.68 ms |       71.68 ms |       75.15 ms |  501.58% |   1549.26 MiB |
| node_grpcjs_st              |   44556 |       22.40 ms |       25.90 ms |       34.14 ms |       37.00 ms |  124.89% |    124.11 MiB |
| php_grpc                    |   30597 |       32.66 ms |       48.89 ms |       49.97 ms |       51.74 ms |  501.43% |     74.43 MiB |
| python_async_grpc           |   29810 |       33.53 ms |       34.43 ms |       34.93 ms |       36.21 ms |  142.16% |     57.42 MiB |
| python_grpc                 |   24455 |       40.87 ms |       44.62 ms |       47.00 ms |       53.83 ms |  143.69% |      39.3 MiB |
| d_grpc                      |   23041 |       43.17 ms |       66.00 ms |       72.98 ms |       86.16 ms |  187.85% |     52.14 MiB |
| ruby_grpc                   |   16124 |       61.78 ms |       69.49 ms |       71.66 ms |       74.76 ms |  129.44% |      46.8 MiB |
| erlang_grpcbox              |   13273 |       75.28 ms |       84.11 ms |       87.95 ms |       94.05 ms |  167.92% |    1626.0 MiB |
-----------------------------------------------------------------------------------------------------------------------------------------
Benchmark Execution Parameters:
241998b Sat, 24 Jun 2023 17:08:13 +0200 GitHub temporarily disable Elixir benchmark (#353)
- GRPC_BENCHMARK_DURATION=120s
- GRPC_BENCHMARK_WARMUP=30s
- GRPC_SERVER_CPUS=5
- GRPC_SERVER_RAM=8192m
- GRPC_CLIENT_CONNECTIONS=50
- GRPC_CLIENT_CONCURRENCY=1000
- GRPC_CLIENT_QPS=0
- GRPC_CLIENT_CPUS=25
- GRPC_REQUEST_SCENARIO=complex_proto
- GRPC_GHZ_TAG=0.114.0

6 CPUs

-----------------------------------------------------------------------------------------------------------------------------------------
| name                        |   req/s |   avg. latency |        90 % in |        95 % in |        99 % in | avg. cpu |   avg. memory |
-----------------------------------------------------------------------------------------------------------------------------------------
| scala_akka                  |  420953 |        2.00 ms |        3.36 ms |        4.13 ms |        6.16 ms |  420.11% |    636.43 MiB |
| java_hotspot_grpc_pgc       |  418525 |        2.01 ms |        3.55 ms |        4.46 ms |        7.12 ms |  591.74% |     513.5 MiB |
| java_hotspot_grpc_zgc       |  416372 |        2.02 ms |        3.55 ms |        4.47 ms |        7.19 ms |  596.58% |    5618.4 MiB |
| dotnet_grpc                 |  412447 |        2.06 ms |        3.29 ms |        4.10 ms |        5.91 ms |  402.07% |    277.61 MiB |
| java_quarkus                |  409927 |        2.16 ms |        3.64 ms |        4.50 ms |        7.76 ms |  488.44% |    479.54 MiB |
| java_hotspot_grpc_g1gc      |  408701 |        2.08 ms |        3.52 ms |        4.41 ms |        6.61 ms |  605.95% |    557.79 MiB |
| java_hotspot_grpc_she       |  405815 |        2.10 ms |        3.61 ms |        4.64 ms |        7.75 ms |  605.37% |   5307.62 MiB |
| rust_thruster_mt            |  398653 |        2.19 ms |        3.76 ms |        4.51 ms |        6.14 ms |  416.48% |     17.71 MiB |
| rust_tonic_mt               |  397776 |        2.27 ms |        3.83 ms |        4.55 ms |        6.27 ms |  448.57% |     21.03 MiB |
| cpp_grpc_mt                 |  397682 |        2.26 ms |        3.79 ms |        4.54 ms |        6.30 ms |  560.27% |     74.16 MiB |
| java_hotspot_grpc_sgc       |  394405 |        2.19 ms |        3.80 ms |        4.62 ms |        7.08 ms |  590.94% |    155.27 MiB |
| cpp_asio_grpc               |  388865 |        2.32 ms |        3.78 ms |        4.51 ms |        6.18 ms |  583.13% |     84.43 MiB |
| rust_grpcio                 |  386411 |        2.35 ms |        3.50 ms |        4.23 ms |        5.61 ms |  432.08% |    348.18 MiB |
| java_armeria                |  365995 |        2.31 ms |        3.77 ms |        5.07 ms |       17.00 ms |  605.04% |    941.38 MiB |
| go_vtgrpc                   |  363081 |        2.47 ms |        4.13 ms |        4.86 ms |        6.62 ms |  499.26% |     26.91 MiB |
| kotlin_grpc                 |  333221 |        2.65 ms |        3.92 ms |        5.64 ms |       25.69 ms |  605.07% |    585.64 MiB |
| go_grpc                     |  321731 |        2.85 ms |        4.56 ms |        5.30 ms |        7.36 ms |  535.86% |     27.66 MiB |
| java_openj9_grpc_gencon     |  311614 |        2.91 ms |        3.91 ms |        5.35 ms |       27.79 ms |  607.28% |    302.72 MiB |
| scala_fs2                   |  293210 |        3.10 ms |        4.59 ms |        6.57 ms |       30.02 ms |  604.71% |   1608.99 MiB |
| java_quarkus_native         |  261617 |        3.60 ms |        4.86 ms |        6.19 ms |       13.40 ms |  552.45% |     691.0 MiB |
| java_micronaut_workstealing |  233589 |        4.05 ms |        4.48 ms |        6.82 ms |       40.51 ms |   612.9% |   1474.28 MiB |
| java_micronaut              |  232795 |        4.07 ms |        4.48 ms |        6.98 ms |       45.99 ms |   614.6% |   1638.42 MiB |
| swift_grpc                  |  231460 |        4.24 ms |        5.06 ms |        5.53 ms |        7.41 ms |  595.99% |      7.89 MiB |
| rust_thruster_st            |  186858 |        5.32 ms |        5.78 ms |        6.03 ms |        6.77 ms |   94.58% |     10.02 MiB |
| java_vertx_grpc             |  184758 |        5.39 ms |        5.84 ms |        6.11 ms |       10.36 ms |   98.28% |    267.74 MiB |
| rust_tonic_st               |  180624 |        5.51 ms |        6.12 ms |        6.60 ms |        7.63 ms |    94.2% |     10.86 MiB |
| cpp_grpc_st                 |  174758 |        5.70 ms |        6.56 ms |        6.88 ms |        7.60 ms |   75.97% |       9.3 MiB |
| scala_zio                   |  154655 |        6.25 ms |        6.30 ms |       51.82 ms |       59.61 ms |  608.62% |   2273.74 MiB |
| go_connect                  |  130738 |        7.60 ms |       12.78 ms |       14.82 ms |       19.43 ms |  540.81% |     34.74 MiB |
| java_aot                    |  122712 |        7.82 ms |        9.94 ms |       62.94 ms |       68.93 ms |  603.38% |   1418.98 MiB |
| crystal_grpc                |  110201 |        9.06 ms |        9.75 ms |        9.97 ms |       10.92 ms |   96.85% |     60.25 MiB |
| node_grpcjs_st              |   44480 |       22.43 ms |       27.67 ms |       30.69 ms |       36.37 ms |  125.41% |    122.17 MiB |
| php_grpc                    |   34900 |       28.63 ms |       34.25 ms |       35.79 ms |       38.15 ms |   602.8% |     74.32 MiB |
| python_async_grpc           |   29906 |       33.42 ms |       34.39 ms |       34.81 ms |       36.43 ms |  142.54% |     60.65 MiB |
| python_grpc                 |   24395 |       40.97 ms |       44.90 ms |       47.30 ms |       53.04 ms |  143.37% |     38.17 MiB |
| d_grpc                      |   22883 |       43.45 ms |       66.41 ms |       73.25 ms |       86.45 ms |  189.53% |     52.66 MiB |
| ruby_grpc                   |   16269 |       61.33 ms |       68.35 ms |       70.47 ms |       74.06 ms |  130.18% |     44.86 MiB |
| erlang_grpcbox              |   13249 |       75.41 ms |       84.18 ms |       87.94 ms |       94.00 ms |  142.25% |   1628.67 MiB |
-----------------------------------------------------------------------------------------------------------------------------------------
Benchmark Execution Parameters:
241998b Sat, 24 Jun 2023 17:08:13 +0200 GitHub temporarily disable Elixir benchmark (#353)
- GRPC_BENCHMARK_DURATION=120s
- GRPC_BENCHMARK_WARMUP=30s
- GRPC_SERVER_CPUS=6
- GRPC_SERVER_RAM=8192m
- GRPC_CLIENT_CONNECTIONS=50
- GRPC_CLIENT_CONCURRENCY=1000
- GRPC_CLIENT_QPS=0
- GRPC_CLIENT_CPUS=25
- GRPC_REQUEST_SCENARIO=complex_proto
- GRPC_GHZ_TAG=0.114.0

[plokhotnyuk]

What do you mean for CPU number reported? Have you disabled all other CPUs in BIOS?

[LesnyRumcajs]

Docker is limiting CPU usage. https://github.com/LesnyRumcajs/grpc_bench/blob/master/bench.sh#L57. The value of the CPU count for the server is also passed to the server so it can handle it properly (otherwise, the concurrency reported will still be of the host machine).

[DartMitai]

Dart?

[LesnyRumcajs]

Dart implementation no longer compiles, so I disabled it; see #146

[kyle-revio]

Did not expect dotnet to be so fast ⚡ any reason/s why?

[He-Pin]

@kyle-revio Becase MSFT has $$$$$$

[LesnyRumcajs]

@kyle-revio It used not to perform great before @JamesNK intervened. :) See more https://devblogs.microsoft.com/dotnet/grpc-performance-improvements-in-net-5/

[JamesNK]

Did not expect dotnet to be so fast ⚡ any reason/s why?

There isn't one thing that makes .NET + gRPC fast. It's many small improvements everywhere over time.

[pantonis]

We are building low latency high perf systems and we saw huge improvements throughout the trip from .net core 3.1 to .NET 7. .Net has dramatically improved.

[tsloughter]

Saw a tweet about this and that Erlang was in last place :) so I sent a patch to update to the latest grpc lib that has a lot rewritten in the http/2 server #363

[mysteriousmy]

scala akka.. can try dotnet orleans framework？