Skip to content

Update prom/prometheus Docker tag to v3.4.1 #706

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented May 31, 2025

This PR contains the following updates:

Package Update Change
prom/prometheus patch v3.4.0 -> v3.4.1

Release Notes

prometheus/prometheus (prom/prometheus)

v3.4.1

Compare Source


Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label May 31, 2025
Copy link

Overview for: federation/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 176 5501 total, 0 failed avg: 1330ms, p95: 3830ms
grafbase 167 5282 total, 0 failed avg: 1533ms, p95: 3142ms
apollo-router 158 4996 total, 18 failed avg: 1474ms, p95: 3549ms ❌ 18 failed requests, 18 non-200 responses, 18 unexpected GraphQL errors, non-compatible response structure (1)
hive-gateway-bun 88 3084 total, 0 failed avg: 5012ms, p95: 8027ms
apollo-server 86 3038 total, 0 failed avg: 5284ms, p95: 33116ms
hive-gateway 86 3051 total, 0 failed avg: 5247ms, p95: 33090ms
mercurius 74 2455 total, 0 failed avg: 6356ms, p95: 11164ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 16443      ✗ 0    
     data_received..................: 483 MB  16 MB/s
     data_sent......................: 6.5 MB  210 kB/s
     http_req_blocked...............: avg=4.89ms   min=1.44µs  med=3.5µs    max=4.75s  p(90)=20.76µs p(95)=31.27ms
     http_req_connecting............: avg=4.25ms   min=0s      med=0s       max=4.75s  p(90)=0s      p(95)=30.24ms
     http_req_duration..............: avg=1.33s    min=3.2ms   med=909.42ms max=6.78s  p(90)=3.11s   p(95)=3.82s  
       { expected_response:true }...: avg=1.33s    min=3.2ms   med=909.42ms max=6.78s  p(90)=3.11s   p(95)=3.82s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 5501 
     http_req_receiving.............: avg=607.52ms min=35.39µs med=131.41µs max=5.85s  p(90)=2.32s   p(95)=3.07s  
     http_req_sending...............: avg=21.47ms  min=8.15µs  med=16.16µs  max=4.46s  p(90)=4.56ms  p(95)=18.54ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s      p(95)=0s     
     http_req_waiting...............: avg=701.4ms  min=3.04ms  med=676.94ms max=2.4s   p(90)=1.29s   p(95)=1.43s  
     http_reqs......................: 5501    176.484027/s
     iteration_duration.............: avg=2.75s    min=20.56ms med=2.21s    max=14.27s p(90)=6.05s   p(95)=7.09s  
     iterations.....................: 5481    175.842383/s
     vus............................: 143     min=143      max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15786      ✗ 0    
     data_received..................: 464 MB  15 MB/s
     data_sent......................: 6.3 MB  199 kB/s
     http_req_blocked...............: avg=4.08ms   min=1.49µs  med=3.4µs   max=3.3s  p(90)=31.14µs  p(95)=13.35ms
     http_req_connecting............: avg=3.6ms    min=0s      med=0s      max=2.89s p(90)=0s       p(95)=13.15ms
     http_req_duration..............: avg=1.53s    min=3.28ms  med=1.41s   max=6.48s p(90)=2.75s    p(95)=3.14s  
       { expected_response:true }...: avg=1.53s    min=3.28ms  med=1.41s   max=6.48s p(90)=2.75s    p(95)=3.14s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 5282 
     http_req_receiving.............: avg=284.18ms min=34.08µs med=76.67µs max=5.03s p(90)=1.28s    p(95)=2s     
     http_req_sending...............: avg=33.58ms  min=7.94µs  med=15.27µs max=3.58s p(90)=584.69µs p(95)=4.21ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s    p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=1.21s    min=3.19ms  med=1.23s   max=4.93s p(90)=1.94s    p(95)=2.32s  
     http_reqs......................: 5282    167.78654/s
     iteration_duration.............: avg=2.9s     min=26.05ms med=2.63s   max=14.4s p(90)=5.35s    p(95)=6.31s  
     iterations.....................: 5262    167.151225/s
     vus............................: 288     min=288      max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✗ response code was 200
      ↳  99% — ✓ 4958 / ✗ 18
     ✗ no graphql errors
      ↳  99% — ✓ 4958 / ✗ 18
     ✗ valid response structure
      ↳  99% — ✓ 4958 / ✗ 1

     █ setup

     checks.........................: 99.75% ✓ 14874      ✗ 37   
     data_received..................: 437 MB 14 MB/s
     data_sent......................: 5.9 MB 189 kB/s
     http_req_blocked...............: avg=9.57ms  min=1.52µs  med=3.56µs   max=3.46s  p(90)=910.1µs  p(95)=12.42ms
     http_req_connecting............: avg=9.12ms  min=0s      med=0s       max=3.46s  p(90)=653.44µs p(95)=12.26ms
     http_req_duration..............: avg=1.47s   min=6.74ms  med=1.32s    max=7.54s  p(90)=2.95s    p(95)=3.54s  
       { expected_response:true }...: avg=1.47s   min=6.74ms  med=1.32s    max=7.54s  p(90)=2.95s    p(95)=3.53s  
     http_req_failed................: 0.36%  ✓ 18         ✗ 4978 
     http_req_receiving.............: avg=399ms   min=0s      med=103.3µs  max=6.56s  p(90)=1.35s    p(95)=2.45s  
     http_req_sending...............: avg=48.25ms min=8.55µs  med=16.61µs  max=3.77s  p(90)=975.07µs p(95)=6.05ms 
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=1.02s   min=6.65ms  med=972.48ms max=4.43s  p(90)=1.9s     p(95)=2.43s  
     http_reqs......................: 4996   158.963797/s
     iteration_duration.............: avg=3.07s   min=36.59ms med=2.74s    max=13.46s p(90)=5.97s    p(95)=7.1s   
     iterations.....................: 4976   158.327433/s
     vus............................: 280    min=280      max=500
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 9192      ✗ 0    
     data_received..................: 271 MB  7.7 MB/s
     data_sent......................: 3.7 MB  105 kB/s
     http_req_blocked...............: avg=6.56ms   min=1.94µs   med=3.81µs   max=110.81ms p(90)=35.35ms  p(95)=52.24ms
     http_req_connecting............: avg=6.35ms   min=0s       med=0s       max=90.81ms  p(90)=33.41ms  p(95)=51.34ms
     http_req_duration..............: avg=5.01s    min=15.17ms  med=4.65s    max=10.46s   p(90)=7.4s     p(95)=8.02s  
       { expected_response:true }...: avg=5.01s    min=15.17ms  med=4.65s    max=10.46s   p(90)=7.4s     p(95)=8.02s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 3084 
     http_req_receiving.............: avg=138.83ms min=38.6µs   med=111.69µs max=3.68s    p(90)=464.77ms p(95)=1.01s  
     http_req_sending...............: avg=4.79ms   min=9.04µs   med=19.64µs  max=467.58ms p(90)=28.25ms  p(95)=31.16ms
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=4.86s    min=14.96ms  med=4.55s    max=10.46s   p(90)=7.05s    p(95)=7.79s  
     http_reqs......................: 3084    88.200345/s
     iteration_duration.............: avg=5.29s    min=373.37ms med=4.84s    max=10.69s   p(90)=8.03s    p(95)=8.64s  
     iterations.....................: 3064    87.628359/s
     vus............................: 2       min=2       max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 9054      ✗ 0    
     data_received..................: 267 MB  7.6 MB/s
     data_sent......................: 3.6 MB  102 kB/s
     http_req_blocked...............: avg=878.67µs min=1.63µs   med=3.15µs   max=21.42ms  p(90)=2.5ms    p(95)=7.38ms  
     http_req_connecting............: avg=850.45µs min=0s       med=0s       max=17.34ms  p(90)=2.29ms   p(95)=7.11ms  
     http_req_duration..............: avg=5.28s    min=11.19ms  med=1.53s    max=34.78s   p(90)=31.62s   p(95)=33.11s  
       { expected_response:true }...: avg=5.28s    min=11.19ms  med=1.53s    max=34.78s   p(90)=31.62s   p(95)=33.11s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 3038 
     http_req_receiving.............: avg=612.45µs min=43.58µs  med=106.72µs max=100.37ms p(90)=267.08µs p(95)=593.97µs
     http_req_sending...............: avg=207.2µs  min=9.15µs   med=16.3µs   max=37.96ms  p(90)=447.18µs p(95)=972.7µs 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=5.28s    min=11.08ms  med=1.53s    max=34.78s   p(90)=31.62s   p(95)=33.11s  
     http_reqs......................: 3038    86.309909/s
     iteration_duration.............: avg=5.33s    min=365.58ms med=1.56s    max=34.79s   p(90)=31.66s   p(95)=33.12s  
     iterations.....................: 3018    85.741707/s
     vus............................: 15      min=15      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 9093      ✗ 0    
     data_received..................: 268 MB  7.6 MB/s
     data_sent......................: 3.6 MB  103 kB/s
     http_req_blocked...............: avg=3.44ms   min=2.03µs   med=4.22µs  max=48.97ms  p(90)=22.58ms  p(95)=28.16ms
     http_req_connecting............: avg=3.36ms   min=0s       med=0s      max=38.56ms  p(90)=22.3ms   p(95)=27.88ms
     http_req_duration..............: avg=5.24s    min=14.76ms  med=2.18s   max=34.78s   p(90)=16.23s   p(95)=33.09s 
       { expected_response:true }...: avg=5.24s    min=14.76ms  med=2.18s   max=34.78s   p(90)=16.23s   p(95)=33.09s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 3051 
     http_req_receiving.............: avg=2.88ms   min=42.44µs  med=96.08µs max=415.1ms  p(90)=813.36µs p(95)=4.46ms 
     http_req_sending...............: avg=890.61µs min=9.71µs   med=23.2µs  max=134.08ms p(90)=1.87ms   p(95)=5.72ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s      max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=5.24s    min=14.66ms  med=2.18s   max=34.78s   p(90)=16.22s   p(95)=33.08s 
     http_reqs......................: 3051    86.464092/s
     iteration_duration.............: avg=5.34s    min=430.18ms med=2.24s   max=34.79s   p(90)=16.87s   p(95)=33.17s 
     iterations.....................: 3031    85.8973/s
     vus............................: 28      min=28      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7305      ✗ 0    
     data_received..................: 216 MB  6.6 MB/s
     data_sent......................: 2.9 MB  89 kB/s
     http_req_blocked...............: avg=3.18ms  min=1.7µs    med=4.31µs   max=48.47ms p(90)=17.32ms  p(95)=22.34ms 
     http_req_connecting............: avg=3.11ms  min=0s       med=0s       max=35.67ms p(90)=17.11ms  p(95)=22.01ms 
     http_req_duration..............: avg=6.35s   min=11.75ms  med=6.39s    max=12.88s  p(90)=8.35s    p(95)=11.16s  
       { expected_response:true }...: avg=6.35s   min=11.75ms  med=6.39s    max=12.88s  p(90)=8.35s    p(95)=11.16s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2455 
     http_req_receiving.............: avg=42.16ms min=37.23µs  med=110.49µs max=1.84s   p(90)=904.86µs p(95)=297.11ms
     http_req_sending...............: avg=426.1µs min=9.5µs    med=25.01µs  max=53.78ms p(90)=940.92µs p(95)=2.68ms  
     http_req_tls_handshaking.......: avg=0s      min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=6.31s   min=11.63ms  med=6.38s    max=12.88s  p(90)=8.35s    p(95)=11.16s  
     http_reqs......................: 2455    74.697164/s
     iteration_duration.............: avg=6.46s   min=423.34ms med=6.42s    max=12.92s  p(90)=8.39s    p(95)=11.19s  
     iterations.....................: 2435    74.088634/s
     vus............................: 280     min=280     max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

Overview for: federation/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 300 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 173 5322 total, 0 failed avg: 864ms, p95: 2699ms
cosmo 170 5274 total, 0 failed avg: 836ms, p95: 2287ms
apollo-router 157 4868 total, 0 failed avg: 926ms, p95: 2530ms
hive-gateway-bun 90 2984 total, 0 failed avg: 3122ms, p95: 5263ms
apollo-server 86 2886 total, 0 failed avg: 3249ms, p95: 21872ms
hive-gateway 85 2842 total, 0 failed avg: 3295ms, p95: 18609ms
mercurius 71 2290 total, 0 failed avg: 4020ms, p95: 6098ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15906      ✗ 0    
     data_received..................: 468 MB  15 MB/s
     data_sent......................: 6.3 MB  206 kB/s
     http_req_blocked...............: avg=1.42ms   min=1.38µs  med=3.16µs   max=2.44s p(90)=5.11µs   p(95)=312.67µs
     http_req_connecting............: avg=1.33ms   min=0s      med=0s       max=2.44s p(90)=0s       p(95)=211.53µs
     http_req_duration..............: avg=864.37ms min=3.24ms  med=670.44ms max=7.02s p(90)=1.95s    p(95)=2.69s   
       { expected_response:true }...: avg=864.37ms min=3.24ms  med=670.44ms max=7.02s p(90)=1.95s    p(95)=2.69s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5322 
     http_req_receiving.............: avg=331.03ms min=35.44µs med=81.19µs  max=5.95s p(90)=1.38s    p(95)=2.16s   
     http_req_sending...............: avg=15.93ms  min=7.99µs  med=14.43µs  max=3.47s p(90)=311.75µs p(95)=5.15ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=517.4ms  min=3.16ms  med=503.77ms max=2.18s p(90)=1s       p(95)=1.07s   
     http_reqs......................: 5322    173.096428/s
     iteration_duration.............: avg=1.7s     min=17.56ms med=1.38s    max=12.6s p(90)=3.56s    p(95)=4.5s    
     iterations.....................: 5302    172.445934/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15762      ✗ 0    
     data_received..................: 463 MB  15 MB/s
     data_sent......................: 6.3 MB  203 kB/s
     http_req_blocked...............: avg=1.41ms   min=1.49µs  med=3.62µs   max=1.69s p(90)=7.42µs   p(95)=267.04µs
     http_req_connecting............: avg=1.31ms   min=0s      med=0s       max=1.69s p(90)=0s       p(95)=180.7µs 
     http_req_duration..............: avg=835.55ms min=3.29ms  med=703.75ms max=5.52s p(90)=1.76s    p(95)=2.28s   
       { expected_response:true }...: avg=835.55ms min=3.29ms  med=703.75ms max=5.52s p(90)=1.76s    p(95)=2.28s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5274 
     http_req_receiving.............: avg=245.24ms min=34.97µs med=94.04µs  max=3.82s p(90)=1.03s    p(95)=1.53s   
     http_req_sending...............: avg=21.34ms  min=8.55µs  med=17.57µs  max=2.91s p(90)=159.68µs p(95)=3.42ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=568.97ms min=3.2ms   med=535.09ms max=2.78s p(90)=1.01s    p(95)=1.14s   
     http_reqs......................: 5274    170.565472/s
     iteration_duration.............: avg=1.72s    min=26.11ms med=1.45s    max=8.66s p(90)=3.57s    p(95)=4.4s    
     iterations.....................: 5254    169.918656/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 14544      ✗ 0    
     data_received..................: 427 MB  14 MB/s
     data_sent......................: 5.8 MB  187 kB/s
     http_req_blocked...............: avg=2.07ms   min=1.56µs  med=3.56µs   max=2.51s p(90)=6.33µs   p(95)=811.42µs
     http_req_connecting............: avg=1.75ms   min=0s      med=0s       max=2.51s p(90)=0s       p(95)=600.08µs
     http_req_duration..............: avg=926.1ms  min=6.43ms  med=731.41ms max=6.02s p(90)=2.07s    p(95)=2.53s   
       { expected_response:true }...: avg=926.1ms  min=6.43ms  med=731.41ms max=6.02s p(90)=2.07s    p(95)=2.53s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 4868 
     http_req_receiving.............: avg=315.7ms  min=33.57µs med=90.24µs  max=5.47s p(90)=1.23s    p(95)=1.87s   
     http_req_sending...............: avg=19.1ms   min=7.42µs  med=16.88µs  max=4.36s p(90)=285.38µs p(95)=3.75ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=591.29ms min=6.36ms  med=540.35ms max=2.98s p(90)=1.1s     p(95)=1.35s   
     http_reqs......................: 4868    157.338565/s
     iteration_duration.............: avg=1.87s    min=41.97ms med=1.56s    max=8.88s p(90)=3.83s    p(95)=4.62s   
     iterations.....................: 4848    156.692145/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8892      ✗ 0    
     data_received..................: 262 MB  7.9 MB/s
     data_sent......................: 3.5 MB  107 kB/s
     http_req_blocked...............: avg=471.46µs min=1.83µs   med=4.14µs   max=15.34ms  p(90)=99.54µs  p(95)=3.49ms  
     http_req_connecting............: avg=451.3µs  min=0s       med=0s       max=15.3ms   p(90)=64.61µs  p(95)=3.15ms  
     http_req_duration..............: avg=3.12s    min=14.39ms  med=2.85s    max=6.95s    p(90)=4.57s    p(95)=5.26s   
       { expected_response:true }...: avg=3.12s    min=14.39ms  med=2.85s    max=6.95s    p(90)=4.57s    p(95)=5.26s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2984 
     http_req_receiving.............: avg=64.27ms  min=41.2µs   med=205.85µs max=1.53s    p(90)=12.87ms  p(95)=587.5ms 
     http_req_sending...............: avg=422.7µs  min=8.93µs   med=23.26µs  max=121.62ms p(90)=138.79µs p(95)=383.34µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.05s    min=14.29ms  med=2.83s    max=6.95s    p(90)=4.57s    p(95)=5.21s   
     http_reqs......................: 2984    90.011648/s
     iteration_duration.............: avg=3.18s    min=234.48ms med=2.88s    max=6.97s    p(90)=4.64s    p(95)=5.28s   
     iterations.....................: 2964    89.408353/s
     vus............................: 23      min=23      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8598      ✗ 0    
     data_received..................: 254 MB  7.6 MB/s
     data_sent......................: 3.4 MB  103 kB/s
     http_req_blocked...............: avg=738.3µs  min=1.57µs  med=3.12µs   max=15.26ms p(90)=164.44µs p(95)=6.84ms  
     http_req_connecting............: avg=714.82µs min=0s      med=0s       max=14.96ms p(90)=106.89µs p(95)=6.58ms  
     http_req_duration..............: avg=3.24s    min=11.04ms med=1.55s    max=32.78s  p(90)=2.12s    p(95)=21.87s  
       { expected_response:true }...: avg=3.24s    min=11.04ms med=1.55s    max=32.78s  p(90)=2.12s    p(95)=21.87s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2886 
     http_req_receiving.............: avg=274.43µs min=43.18µs med=101.52µs max=87.62ms p(90)=218.09µs p(95)=412.99µs
     http_req_sending...............: avg=149.28µs min=8.52µs  med=15.54µs  max=36.59ms p(90)=181.06µs p(95)=518.11µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.24s    min=10.97ms med=1.55s    max=32.78s  p(90)=2.12s    p(95)=21.87s  
     http_reqs......................: 2886    86.963102/s
     iteration_duration.............: avg=3.28s    min=361.5ms med=1.57s    max=32.79s  p(90)=2.14s    p(95)=22.16s  
     iterations.....................: 2866    86.360447/s
     vus............................: 19      min=19      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8466      ✗ 0    
     data_received..................: 250 MB  7.5 MB/s
     data_sent......................: 3.4 MB  102 kB/s
     http_req_blocked...............: avg=654.78µs min=1.81µs  med=4.16µs   max=29.47ms  p(90)=206.29µs p(95)=3.83ms 
     http_req_connecting............: avg=602.81µs min=0s      med=0s       max=20.81ms  p(90)=119.04µs p(95)=3.55ms 
     http_req_duration..............: avg=3.29s    min=14.58ms med=1.7s     max=32.76s   p(90)=3.17s    p(95)=18.6s  
       { expected_response:true }...: avg=3.29s    min=14.58ms med=1.7s     max=32.76s   p(90)=3.17s    p(95)=18.6s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2842 
     http_req_receiving.............: avg=1.05ms   min=43.79µs med=102.04µs max=194.37ms p(90)=509.54µs p(95)=1.46ms 
     http_req_sending...............: avg=378.78µs min=9.52µs  med=23.22µs  max=44.67ms  p(90)=174.33µs p(95)=477.4µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=3.29s    min=14.44ms med=1.7s     max=32.76s   p(90)=3.17s    p(95)=18.6s  
     http_reqs......................: 2842    85.538459/s
     iteration_duration.............: avg=3.34s    min=74.23ms med=1.74s    max=32.77s   p(90)=3.23s    p(95)=18.72s 
     iterations.....................: 2822    84.936499/s
     vus............................: 29      min=29      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 6810      ✗ 0    
     data_received..................: 201 MB  6.3 MB/s
     data_sent......................: 2.7 MB  85 kB/s
     http_req_blocked...............: avg=1.28ms   min=2.18µs  med=4.78µs   max=21.77ms  p(90)=6.3ms    p(95)=11.98ms
     http_req_connecting............: avg=1.11ms   min=0s      med=0s       max=16.24ms  p(90)=5.73ms   p(95)=10.13ms
     http_req_duration..............: avg=4.02s    min=12.56ms med=4.02s    max=8.68s    p(90)=5.18s    p(95)=6.09s  
       { expected_response:true }...: avg=4.02s    min=12.56ms med=4.02s    max=8.68s    p(90)=5.18s    p(95)=6.09s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2290 
     http_req_receiving.............: avg=8.17ms   min=45.72µs med=118.98µs max=977.74ms p(90)=346.3µs  p(95)=1.18ms 
     http_req_sending...............: avg=195.21µs min=10.14µs med=28.45µs  max=42.78ms  p(90)=412.28µs p(95)=1.3ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=4.01s    min=12.43ms med=4.02s    max=8.68s    p(90)=5.18s    p(95)=6.09s  
     http_reqs......................: 2290    71.420693/s
     iteration_duration.............: avg=4.09s    min=446.6ms med=4.04s    max=8.69s    p(90)=5.21s    p(95)=6.14s  
     iterations.....................: 2270    70.796932/s
     vus............................: 26      min=26      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

Overview for: federation/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 300 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 184 5696 total, 0 failed avg: 811ms, p95: 1798ms
grafbase 172 5294 total, 0 failed avg: 903ms, p95: 2699ms
apollo-router 160 4963 total, 0 failed avg: 915ms, p95: 2379ms
hive-gateway-bun 91 3014 total, 0 failed avg: 3078ms, p95: 5467ms
apollo-server 86 2885 total, 0 failed avg: 3257ms, p95: 27383ms
hive-gateway 81 2718 total, 0 failed avg: 3440ms, p95: 20283ms
mercurius 78 2491 total, 0 failed avg: 3695ms, p95: 5383ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 17028      ✗ 0    
     data_received..................: 500 MB  16 MB/s
     data_sent......................: 6.8 MB  219 kB/s
     http_req_blocked...............: avg=1.43ms   min=1.54µs  med=3.2µs    max=1.39s    p(90)=5.13µs   p(95)=207.24µs
     http_req_connecting............: avg=882.48µs min=0s      med=0s       max=988.32ms p(90)=0s       p(95)=117.23µs
     http_req_duration..............: avg=811.37ms min=3.14ms  med=727.24ms max=3.93s    p(90)=1.45s    p(95)=1.79s   
       { expected_response:true }...: avg=811.37ms min=3.14ms  med=727.24ms max=3.93s    p(90)=1.45s    p(95)=1.79s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5696 
     http_req_receiving.............: avg=177.45ms min=34.29µs med=78.18µs  max=3.19s    p(90)=790.14ms p(95)=1.16s   
     http_req_sending...............: avg=19.51ms  min=8.4µs   med=14.23µs  max=2.31s    p(90)=153.99µs p(95)=10.01ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=614.4ms  min=3.02ms  med=593.77ms max=2.3s     p(90)=1.02s    p(95)=1.18s   
     http_reqs......................: 5696    184.563127/s
     iteration_duration.............: avg=1.59s    min=24.98ms med=1.38s    max=7.22s    p(90)=3.01s    p(95)=3.6s    
     iterations.....................: 5676    183.915082/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15822      ✗ 0    
     data_received..................: 465 MB  15 MB/s
     data_sent......................: 6.3 MB  204 kB/s
     http_req_blocked...............: avg=1.32ms   min=1.41µs  med=3.24µs   max=1.13s    p(90)=5.65µs   p(95)=896.71µs
     http_req_connecting............: avg=899.89µs min=0s      med=0s       max=742.86ms p(90)=0s       p(95)=483.54µs
     http_req_duration..............: avg=902.89ms min=3.39ms  med=640.62ms max=5.82s    p(90)=2.17s    p(95)=2.69s   
       { expected_response:true }...: avg=902.89ms min=3.39ms  med=640.62ms max=5.82s    p(90)=2.17s    p(95)=2.69s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5294 
     http_req_receiving.............: avg=367.43ms min=35.02µs med=85.33µs  max=5.02s    p(90)=1.36s    p(95)=2.24s   
     http_req_sending...............: avg=17.16ms  min=7.93µs  med=14.96µs  max=4.1s     p(90)=153.21µs p(95)=2.35ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=518.29ms min=3.32ms  med=438.32ms max=2.73s    p(90)=1.03s    p(95)=1.3s    
     http_reqs......................: 5294    172.056019/s
     iteration_duration.............: avg=1.7s     min=24.39ms med=1.33s    max=9.11s    p(90)=3.66s    p(95)=4.5s    
     iterations.....................: 5274    171.406015/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 14829      ✗ 0    
     data_received..................: 436 MB  14 MB/s
     data_sent......................: 5.9 MB  191 kB/s
     http_req_blocked...............: avg=1.35ms   min=1.42µs  med=3.37µs   max=1.41s p(90)=6.25µs   p(95)=1.82ms 
     http_req_connecting............: avg=1.24ms   min=0s      med=0s       max=1.41s p(90)=0s       p(95)=1.66ms 
     http_req_duration..............: avg=915.21ms min=6.41ms  med=773.47ms max=5.83s p(90)=1.81s    p(95)=2.37s  
       { expected_response:true }...: avg=915.21ms min=6.41ms  med=773.47ms max=5.83s p(90)=1.81s    p(95)=2.37s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 4963 
     http_req_receiving.............: avg=281.3ms  min=33.27µs med=88.52µs  max=4.66s p(90)=1.08s    p(95)=1.64s  
     http_req_sending...............: avg=15.57ms  min=7.63µs  med=15.67µs  max=1.97s p(90)=323.23µs p(95)=10.06ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=618.33ms min=6.33ms  med=595.12ms max=2.16s p(90)=1.11s    p(95)=1.19s  
     http_reqs......................: 4963    160.891002/s
     iteration_duration.............: avg=1.83s    min=35.26ms med=1.61s    max=9.24s p(90)=3.64s    p(95)=4.4s   
     iterations.....................: 4943    160.24264/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8982      ✗ 0    
     data_received..................: 265 MB  8.0 MB/s
     data_sent......................: 3.6 MB  108 kB/s
     http_req_blocked...............: avg=655.11µs min=1.82µs  med=3.78µs   max=27.55ms  p(90)=161.59µs p(95)=5.8ms   
     http_req_connecting............: avg=611.2µs  min=0s      med=0s       max=25.1ms   p(90)=0s       p(95)=5.6ms   
     http_req_duration..............: avg=3.07s    min=13.27ms med=2.85s    max=6.42s    p(90)=4.88s    p(95)=5.46s   
       { expected_response:true }...: avg=3.07s    min=13.27ms med=2.85s    max=6.42s    p(90)=4.88s    p(95)=5.46s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 3014 
     http_req_receiving.............: avg=63.05ms  min=40.36µs med=146.53µs max=1.6s     p(90)=39.32ms  p(95)=595.28ms
     http_req_sending...............: avg=638.22µs min=9.98µs  med=20.52µs  max=204.34ms p(90)=236.96µs p(95)=1.75ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.01s    min=13.13ms med=2.82s    max=6.42s    p(90)=4.87s    p(95)=5.46s   
     http_reqs......................: 3014    91.07143/s
     iteration_duration.............: avg=3.15s    min=424.1ms med=2.9s     max=6.47s    p(90)=4.95s    p(95)=5.51s   
     iterations.....................: 2994    90.467107/s
     vus............................: 11      min=11      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8595      ✗ 0    
     data_received..................: 254 MB  7.6 MB/s
     data_sent......................: 3.4 MB  103 kB/s
     http_req_blocked...............: avg=652.95µs min=1.51µs   med=3.27µs   max=16.86ms p(90)=273.26µs p(95)=6.07ms  
     http_req_connecting............: avg=633.3µs  min=0s       med=0s       max=16.81ms p(90)=165.81µs p(95)=5.99ms  
     http_req_duration..............: avg=3.25s    min=11.51ms  med=1.36s    max=32.81s  p(90)=2.17s    p(95)=27.38s  
       { expected_response:true }...: avg=3.25s    min=11.51ms  med=1.36s    max=32.81s  p(90)=2.17s    p(95)=27.38s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2885 
     http_req_receiving.............: avg=399.92µs min=43.29µs  med=107.09µs max=99.76ms p(90)=196.55µs p(95)=328.97µs
     http_req_sending...............: avg=224.57µs min=8.89µs   med=17.24µs  max=21.38ms p(90)=149.34µs p(95)=1.26ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.25s    min=11.42ms  med=1.36s    max=32.8s   p(90)=2.17s    p(95)=27.38s  
     http_reqs......................: 2885    86.768188/s
     iteration_duration.............: avg=3.29s    min=335.17ms med=1.38s    max=32.82s  p(90)=2.21s    p(95)=27.92s  
     iterations.....................: 2865    86.166675/s
     vus............................: 30      min=30      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8094      ✗ 0    
     data_received..................: 239 MB  7.1 MB/s
     data_sent......................: 3.2 MB  96 kB/s
     http_req_blocked...............: avg=1.18ms   min=2.08µs   med=5.14µs   max=46.76ms  p(90)=2.09ms   p(95)=11.1ms  
     http_req_connecting............: avg=1.13ms   min=0s       med=0s       max=25.4ms   p(90)=1.89ms   p(95)=10.58ms 
     http_req_duration..............: avg=3.44s    min=15.53ms  med=1.76s    max=32.93s   p(90)=3.36s    p(95)=20.28s  
       { expected_response:true }...: avg=3.44s    min=15.53ms  med=1.76s    max=32.93s   p(90)=3.36s    p(95)=20.28s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2718 
     http_req_receiving.............: avg=1.06ms   min=44.88µs  med=122.49µs max=119.88ms p(90)=608.26µs p(95)=1.66ms  
     http_req_sending...............: avg=246.28µs min=10.84µs  med=30.83µs  max=116.83ms p(90)=221.5µs  p(95)=555.36µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.43s    min=15.4ms   med=1.76s    max=32.93s   p(90)=3.36s    p(95)=20.28s  
     http_reqs......................: 2718    81.046134/s
     iteration_duration.............: avg=3.49s    min=125.86ms med=1.8s     max=32.96s   p(90)=3.43s    p(95)=20.36s  
     iterations.....................: 2698    80.449768/s
     vus............................: 46      min=46      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7413      ✗ 0    
     data_received..................: 219 MB  6.9 MB/s
     data_sent......................: 3.0 MB  93 kB/s
     http_req_blocked...............: avg=658.11µs min=1.83µs   med=3.5µs   max=27.24ms  p(90)=653.36µs p(95)=5.87ms 
     http_req_connecting............: avg=618.95µs min=0s       med=0s      max=17.66ms  p(90)=548.19µs p(95)=5.77ms 
     http_req_duration..............: avg=3.69s    min=11.82ms  med=3.68s   max=7.77s    p(90)=4.53s    p(95)=5.38s  
       { expected_response:true }...: avg=3.69s    min=11.82ms  med=3.68s   max=7.77s    p(90)=4.53s    p(95)=5.38s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2491 
     http_req_receiving.............: avg=5.39ms   min=40.9µs   med=98.48µs max=378.43ms p(90)=335.1µs  p(95)=2.39ms 
     http_req_sending...............: avg=119.21µs min=8.71µs   med=19.13µs max=10.32ms  p(90)=229.68µs p(95)=572.8µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s      max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=3.68s    min=11.67ms  med=3.68s   max=7.77s    p(90)=4.53s    p(95)=5.38s  
     http_reqs......................: 2491    78.051649/s
     iteration_duration.............: avg=3.75s    min=416.29ms med=3.71s   max=7.78s    p(90)=4.54s    p(95)=5.43s  
     iterations.....................: 2471    77.42498/s
     vus............................: 223     min=223     max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

Overview for: federation/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 2000 concurrent VUs over 60s

Comparison

Comparison

Gateway duration(p95)⬇️ RPS Requests Durations Notes
apollo-router 5310ms 165 11639 total, 616 failed avg: 2545ms, p95: 5310ms, max: 14259ms, med: 2313ms ❌ 616 failed requests, 616 non-200 responses, 616 unexpected GraphQL errors
cosmo 5373ms 181 12732 total, 0 failed avg: 2409ms, p95: 5374ms, max: 10552ms, med: 2078ms
grafbase 9293ms 171 12174 total, 0 failed avg: 2697ms, p95: 9294ms, max: 20018ms, med: 2228ms
hive-gateway-bun 27989ms 94 7688 total, 0 failed avg: 11098ms, p95: 27989ms, max: 39170ms, med: 9832ms
mercurius 45754ms 39 3769 total, 405 failed avg: 17167ms, p95: 45755ms, max: 55811ms, med: 13355ms ❌ 405 failed requests, 396 non-200 responses, 396 unexpected GraphQL errors
hive-gateway 51166ms 88 7699 total, 0 failed avg: 11985ms, p95: 51166ms, max: 58133ms, med: 3362ms
apollo-server 59999ms 84 7849 total, 502 failed avg: 11839ms, p95: 60000ms, max: 60187ms, med: 2202ms ❌ 502 failed requests, 502 non-200 responses, 502 unexpected GraphQL errors
Summary for: `apollo-router`

K6 Output

     ✗ response code was 200
      ↳  94% — ✓ 11003 / ✗ 616
     ✗ no graphql errors
      ↳  94% — ✓ 11003 / ✗ 616
     ✓ valid response structure

     █ setup

     checks.........................: 96.40% ✓ 33009      ✗ 1232  
     data_received..................: 967 MB 14 MB/s
     data_sent......................: 14 MB  196 kB/s
     http_req_blocked...............: avg=566.51ms min=1.85µs  med=4.5µs   max=12.86s p(90)=2.54s    p(95)=3.86s   
     http_req_connecting............: avg=520.77ms min=0s      med=0s      max=12.63s p(90)=2.51s    p(95)=3.73s   
     http_req_duration..............: avg=2.54s    min=6.81ms  med=2.31s   max=14.25s p(90)=4.66s    p(95)=5.31s   
       { expected_response:true }...: avg=2.53s    min=6.81ms  med=2.31s   max=14.25s p(90)=4.66s    p(95)=5.3s    
     http_req_failed................: 5.29%  ✓ 616        ✗ 11023 
     http_req_receiving.............: avg=134.17ms min=0s      med=84.38µs max=6.16s  p(90)=332.58ms p(95)=965.53ms
     http_req_sending...............: avg=126.24ms min=8.18µs  med=24.58µs max=9.96s  p(90)=349.33ms p(95)=842.58ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=2.28s    min=6.71ms  med=2.02s   max=13.36s p(90)=4.37s    p(95)=4.87s   
     http_reqs......................: 11639  165.208598/s
     iteration_duration.............: avg=6.29s    min=22.43ms med=5.63s   max=28.22s p(90)=12.18s   p(95)=14.31s  
     iterations.....................: 11619  164.92471/s
     vus............................: 493    min=67       max=1981
     vus_max........................: 2000   min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 38136      ✗ 0     
     data_received..................: 1.1 GB  16 MB/s
     data_sent......................: 15 MB   216 kB/s
     http_req_blocked...............: avg=214.97ms min=1.49µs  med=3.48µs  max=10.04s p(90)=775.62ms p(95)=1.78s  
     http_req_connecting............: avg=212.56ms min=0s      med=0s      max=10.04s p(90)=773.9ms  p(95)=1.74s  
     http_req_duration..............: avg=2.4s     min=3.38ms  med=2.07s   max=10.55s p(90)=4.77s    p(95)=5.37s  
       { expected_response:true }...: avg=2.4s     min=3.38ms  med=2.07s   max=10.55s p(90)=4.77s    p(95)=5.37s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 12732 
     http_req_receiving.............: avg=195.87ms min=30.52µs med=78.68µs max=7.07s  p(90)=611.05ms p(95)=1.46s  
     http_req_sending...............: avg=82.33ms  min=7.36µs  med=16.36µs max=7.31s  p(90)=210.85ms p(95)=562.2ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=2.13s    min=3.29ms  med=1.88s   max=8.93s  p(90)=4.38s    p(95)=4.98s  
     http_reqs......................: 12732   181.536132/s
     iteration_duration.............: avg=5.38s    min=8.92ms  med=4.64s   max=25.34s p(90)=11.28s   p(95)=13.32s 
     iterations.....................: 12712   181.250967/s
     vus............................: 5       min=5        max=1936
     vus_max........................: 2000    min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 36462      ✗ 0     
     data_received..................: 1.1 GB  15 MB/s
     data_sent......................: 15 MB   204 kB/s
     http_req_blocked...............: avg=299.06ms min=1.48µs  med=3.49µs  max=13.8s  p(90)=1.01s   p(95)=2.44s   
     http_req_connecting............: avg=284.71ms min=0s      med=0s      max=13.8s  p(90)=1s      p(95)=2.42s   
     http_req_duration..............: avg=2.69s    min=2.91ms  med=2.22s   max=20.01s p(90)=5.16s   p(95)=9.29s   
       { expected_response:true }...: avg=2.69s    min=2.91ms  med=2.22s   max=20.01s p(90)=5.16s   p(95)=9.29s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 12174 
     http_req_receiving.............: avg=634.32ms min=30.7µs  med=79.39µs max=9.96s  p(90)=1.69s   p(95)=5.94s   
     http_req_sending...............: avg=146.26ms min=8.19µs  med=15.54µs max=10.71s p(90)=221.4ms p(95)=749.09ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s      p(95)=0s      
     http_req_waiting...............: avg=1.91s    min=2.85ms  med=1.88s   max=9.36s  p(90)=3.73s   p(95)=4.31s   
     http_reqs......................: 12174   171.619245/s
     iteration_duration.............: avg=5.98s    min=16.92ms med=4.83s   max=36.36s p(90)=13.02s  p(95)=16.12s  
     iterations.....................: 12154   171.337301/s
     vus............................: 153     min=71       max=1853
     vus_max........................: 2000    min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 23004     ✗ 0     
     data_received..................: 675 MB  8.3 MB/s
     data_sent......................: 9.1 MB  113 kB/s
     http_req_blocked...............: avg=15.64ms  min=1.84µs  med=3.95µs  max=1.02s   p(90)=28.2ms  p(95)=111.25ms
     http_req_connecting............: avg=15.38ms  min=0s      med=0s      max=791.1ms p(90)=27.72ms p(95)=110.6ms 
     http_req_duration..............: avg=11.09s   min=14.57ms med=9.83s   max=39.17s  p(90)=23.34s  p(95)=27.98s  
       { expected_response:true }...: avg=11.09s   min=14.57ms med=9.83s   max=39.17s  p(90)=23.34s  p(95)=27.98s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 7688  
     http_req_receiving.............: avg=171.46ms min=34.59µs med=99.25µs max=8.26s   p(90)=21.17ms p(95)=989.76ms
     http_req_sending...............: avg=12.46ms  min=9.39µs  med=23.42µs max=1.06s   p(90)=14.61ms p(95)=50.52ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s      p(90)=0s      p(95)=0s      
     http_req_waiting...............: avg=10.91s   min=14.32ms med=9.74s   max=39.15s  p(90)=23.32s  p(95)=27.7s   
     http_reqs......................: 7688    94.81418/s
     iteration_duration.............: avg=11.47s   min=77.25ms med=9.94s   max=40.37s  p(90)=23.56s  p(95)=28.55s  
     iterations.....................: 7668    94.567525/s
     vus............................: 71      min=59      max=1999
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✗ response code was 200
      ↳  89% — ✓ 3344 / ✗ 396
     ✗ no graphql errors
      ↳  89% — ✓ 3344 / ✗ 396
     ✓ valid response structure

     █ setup

     checks.........................: 92.68% ✓ 10032     ✗ 792   
     data_received..................: 295 MB 3.1 MB/s
     data_sent......................: 6.0 MB 64 kB/s
     http_req_blocked...............: avg=233.26µs min=1.67µs   med=4.18µs   max=48.4ms  p(90)=477.95µs p(95)=652.94µs
     http_req_connecting............: avg=204.06µs min=0s       med=0s       max=48.32ms p(90)=409.83µs p(95)=576.27µs
     http_req_duration..............: avg=17.16s   min=14.03ms  med=13.35s   max=55.81s  p(90)=38.28s   p(95)=45.75s  
       { expected_response:true }...: avg=13.92s   min=14.03ms  med=11.78s   max=45.8s   p(90)=29.02s   p(95)=34.04s  
     http_req_failed................: 10.74% ✓ 405       ✗ 3364  
     http_req_receiving.............: avg=176.29µs min=0s       med=103.67µs max=5.51ms  p(90)=253.02µs p(95)=458.68µs
     http_req_sending...............: avg=59.56µs  min=9.15µs   med=24.87µs  max=18.12ms p(90)=67.18µs  p(95)=92.21µs 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=17.16s   min=13.94ms  med=13.35s   max=55.81s  p(90)=38.28s   p(95)=45.75s  
     http_reqs......................: 3769   39.859963/s
     iteration_duration.............: avg=17.23s   min=228.65ms med=13.39s   max=55.91s  p(90)=38.38s   p(95)=45.83s  
     iterations.....................: 3740   39.553266/s
     vus............................: 617    min=57      max=2000
     vus_max........................: 2000   min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 23037     ✗ 0     
     data_received..................: 676 MB  7.7 MB/s
     data_sent......................: 9.1 MB  105 kB/s
     http_req_blocked...............: avg=7.49ms min=1.73µs  med=4.1µs   max=392.69ms p(90)=14.42ms  p(95)=49.76ms
     http_req_connecting............: avg=7.35ms min=0s      med=0s      max=356.37ms p(90)=13.93ms  p(95)=48.69ms
     http_req_duration..............: avg=11.98s min=13.62ms med=3.36s   max=58.13s   p(90)=44.26s   p(95)=51.16s 
       { expected_response:true }...: avg=11.98s min=13.62ms med=3.36s   max=58.13s   p(90)=44.26s   p(95)=51.16s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 7699  
     http_req_receiving.............: avg=6.46ms min=41.35µs med=96.96µs max=939.65ms p(90)=959.16µs p(95)=4.32ms 
     http_req_sending...............: avg=5.05ms min=9.13µs  med=23.05µs max=870.42ms p(90)=3.15ms   p(95)=23.33ms
     http_req_tls_handshaking.......: avg=0s     min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=11.97s min=13.5ms  med=3.35s   max=57.62s   p(90)=44.26s   p(95)=51.16s 
     http_reqs......................: 7699    88.08559/s
     iteration_duration.............: avg=12.1s  min=51.79ms med=3.44s   max=58.21s   p(90)=44.33s   p(95)=51.31s 
     iterations.....................: 7679    87.856766/s
     vus............................: 115     min=57      max=2000
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✗ response code was 200
      ↳  93% — ✓ 7327 / ✗ 502
     ✗ no graphql errors
      ↳  93% — ✓ 7327 / ✗ 502
     ✓ valid response structure

     █ setup

     checks.........................: 95.63% ✓ 21981     ✗ 1004  
     data_received..................: 646 MB 7.0 MB/s
     data_sent......................: 9.4 MB 101 kB/s
     http_req_blocked...............: avg=431.94µs min=1.51µs  med=3.6µs    max=64.89ms  p(90)=327.51µs p(95)=524.61µs
     http_req_connecting............: avg=405.58µs min=0s      med=0s       max=64.81ms  p(90)=253.86µs p(95)=433.66µs
     http_req_duration..............: avg=11.83s   min=10.56ms med=2.2s     max=1m0s     p(90)=55.27s   p(95)=59.99s  
       { expected_response:true }...: avg=8.54s    min=10.56ms med=2.13s    max=59.98s   p(90)=37.42s   p(95)=46.64s  
     http_req_failed................: 6.39%  ✓ 502       ✗ 7347  
     http_req_receiving.............: avg=220.39µs min=0s      med=107.25µs max=132.03ms p(90)=215.86µs p(95)=327.78µs
     http_req_sending...............: avg=171.98µs min=8.12µs  med=18.01µs  max=50.7ms   p(90)=61.25µs  p(95)=105.1µs 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=11.83s   min=10.28ms med=2.2s     max=1m0s     p(90)=55.27s   p(95)=59.99s  
     http_reqs......................: 7849   84.688656/s
     iteration_duration.............: avg=11.88s   min=58.96ms med=2.21s    max=1m0s     p(90)=55.34s   p(95)=1m0s    
     iterations.....................: 7829   84.472862/s
     vus............................: 51     min=51      max=2000
     vus_max........................: 2000   min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependencies Pull requests that update a dependency file
Projects
None yet
Development

Successfully merging this pull request may close these issues.

0 participants