Skip to content

Lock file maintenance #745

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Aug 11, 2025

This PR contains the following updates:

Update Change
lockFileMaintenance All locks refreshed

🔧 This Pull Request updates lock files to use the latest dependency versions.


Configuration

📅 Schedule: Branch creation - "before 4am on monday" (UTC), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

👻 Immortal: This PR will be recreated if closed unmerged. Get config help if that's undesired.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Aug 11, 2025
Copy link

Overview for: federation/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 178 5609 total, 0 failed avg: 1221ms, p95: 2889ms
grafbase 167 5277 total, 0 failed avg: 1391ms, p95: 3337ms
apollo-router 155 4876 total, 4 failed avg: 1480ms, p95: 3103ms ❌ 4 failed requests, 4 non-200 responses, 4 unexpected GraphQL errors
hive-gateway 92 3234 total, 0 failed avg: 4921ms, p95: 32928ms
apollo-server 89 3132 total, 0 failed avg: 5118ms, p95: 33025ms
hive-gateway-bun 86 2999 total, 0 failed avg: 5057ms, p95: 9370ms
mercurius 70 2332 total, 0 failed avg: 6718ms, p95: 11838ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 16767      ✗ 0    
     data_received..................: 492 MB  16 MB/s
     data_sent......................: 6.7 MB  212 kB/s
     http_req_blocked...............: avg=3.86ms   min=1.58µs  med=3.16µs   max=2.42s  p(90)=15.93µs p(95)=21.34ms
     http_req_connecting............: avg=3.21ms   min=0s      med=0s       max=2.42s  p(90)=0s      p(95)=20.28ms
     http_req_duration..............: avg=1.22s    min=3.39ms  med=1.05s    max=5.47s  p(90)=2.41s   p(95)=2.88s  
       { expected_response:true }...: avg=1.22s    min=3.39ms  med=1.05s    max=5.47s  p(90)=2.41s   p(95)=2.88s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 5609 
     http_req_receiving.............: avg=465.63ms min=31.92µs med=115.77µs max=3.87s  p(90)=1.65s   p(95)=2.02s  
     http_req_sending...............: avg=33.94ms  min=7.84µs  med=14.25µs  max=3.25s  p(90)=14.97ms p(95)=59.25ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s      p(95)=0s     
     http_req_waiting...............: avg=721.55ms min=3.23ms  med=683.64ms max=3.16s  p(90)=1.34s   p(95)=1.6s   
     http_reqs......................: 5609    178.831484/s
     iteration_duration.............: avg=2.7s     min=29ms    med=2.37s    max=11.65s p(90)=5.26s   p(95)=6.06s  
     iterations.....................: 5589    178.193825/s
     vus............................: 211     min=211      max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15771      ✗ 0    
     data_received..................: 464 MB  15 MB/s
     data_sent......................: 6.3 MB  199 kB/s
     http_req_blocked...............: avg=2.75ms   min=1.39µs  med=3.32µs   max=1.41s  p(90)=40.15µs  p(95)=11.24ms
     http_req_connecting............: avg=2.43ms   min=0s      med=0s       max=1.41s  p(90)=0s       p(95)=10.87ms
     http_req_duration..............: avg=1.39s    min=3.25ms  med=1.21s    max=6.38s  p(90)=2.69s    p(95)=3.33s  
       { expected_response:true }...: avg=1.39s    min=3.25ms  med=1.21s    max=6.38s  p(90)=2.69s    p(95)=3.33s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 5277 
     http_req_receiving.............: avg=395.8ms  min=33.18µs med=84.1µs   max=5.01s  p(90)=1.51s    p(95)=2.24s  
     http_req_sending...............: avg=27.56ms  min=7.8µs   med=14.83µs  max=3.3s   p(90)=744.51µs p(95)=6.05ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=967.16ms min=3.19ms  med=956.05ms max=5.42s  p(90)=1.81s    p(95)=1.84s  
     http_reqs......................: 5277    167.97875/s
     iteration_duration.............: avg=2.85s    min=20.98ms med=2.5s     max=12.96s p(90)=5.59s    p(95)=6.8s   
     iterations.....................: 5257    167.342105/s
     vus............................: 196     min=196      max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✗ response code was 200
      ↳  99% — ✓ 4852 / ✗ 4
     ✗ no graphql errors
      ↳  99% — ✓ 4852 / ✗ 4
     ✓ valid response structure

     █ setup

     checks.........................: 99.94% ✓ 14556      ✗ 8    
     data_received..................: 428 MB 14 MB/s
     data_sent......................: 5.8 MB 184 kB/s
     http_req_blocked...............: avg=8.04ms   min=1.72µs med=3.96µs  max=2.96s  p(90)=1.48ms   p(95)=18.24ms
     http_req_connecting............: avg=6.93ms   min=0s     med=0s      max=2.95s  p(90)=680.15µs p(95)=17.69ms
     http_req_duration..............: avg=1.48s    min=7.24ms med=1.26s   max=5.31s  p(90)=2.73s    p(95)=3.1s   
       { expected_response:true }...: avg=1.48s    min=7.24ms med=1.26s   max=5.31s  p(90)=2.73s    p(95)=3.1s   
     http_req_failed................: 0.08%  ✓ 4          ✗ 4872 
     http_req_receiving.............: avg=369.46ms min=0s     med=94.26µs max=4.57s  p(90)=1.49s    p(95)=2.18s  
     http_req_sending...............: avg=36.79ms  min=8.36µs med=19.45µs max=2.9s   p(90)=1.19ms   p(95)=69.9ms 
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s      max=0s     p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=1.07s    min=7.15ms med=1.01s   max=3.02s  p(90)=1.83s    p(95)=2.15s  
     http_reqs......................: 4876   155.133081/s
     iteration_duration.............: avg=3.12s    min=71.5ms med=2.8s    max=11.15s p(90)=5.65s    p(95)=6.52s  
     iterations.....................: 4856   154.496768/s
     vus............................: 193    min=193      max=500
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 9642      ✗ 0    
     data_received..................: 284 MB  8.1 MB/s
     data_sent......................: 3.8 MB  109 kB/s
     http_req_blocked...............: avg=3.39ms min=2.05µs   med=3.98µs  max=48.82ms  p(90)=17.79ms p(95)=28.93ms
     http_req_connecting............: avg=3.3ms  min=0s       med=0s      max=48.68ms  p(90)=17.66ms p(95)=28.32ms
     http_req_duration..............: avg=4.92s  min=11.31ms  med=2.15s   max=34.63s   p(90)=12.06s  p(95)=32.92s 
       { expected_response:true }...: avg=4.92s  min=11.31ms  med=2.15s   max=34.63s   p(90)=12.06s  p(95)=32.92s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 3234 
     http_req_receiving.............: avg=7.89ms min=40.22µs  med=87.83µs max=493.64ms p(90)=2.2ms   p(95)=21.06ms
     http_req_sending...............: avg=1.1ms  min=9.12µs   med=21.62µs max=134.23ms p(90)=1.51ms  p(95)=3.98ms 
     http_req_tls_handshaking.......: avg=0s     min=0s       med=0s      max=0s       p(90)=0s      p(95)=0s     
     http_req_waiting...............: avg=4.91s  min=11.22ms  med=2.14s   max=34.63s   p(90)=12.05s  p(95)=32.92s 
     http_reqs......................: 3234    92.153171/s
     iteration_duration.............: avg=5.04s  min=247.03ms med=2.23s   max=34.65s   p(90)=12.33s  p(95)=33.02s 
     iterations.....................: 3214    91.583269/s
     vus............................: 18      min=18      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 9336      ✗ 0    
     data_received..................: 275 MB  7.9 MB/s
     data_sent......................: 3.7 MB  106 kB/s
     http_req_blocked...............: avg=2.36ms   min=1.47µs   med=3.04µs   max=37.2ms   p(90)=12.88ms  p(95)=19.66ms 
     http_req_connecting............: avg=2.29ms   min=0s       med=0s       max=32.15ms  p(90)=12.41ms  p(95)=19.42ms 
     http_req_duration..............: avg=5.11s    min=10.46ms  med=1.54s    max=34.51s   p(90)=31.46s   p(95)=33.02s  
       { expected_response:true }...: avg=5.11s    min=10.46ms  med=1.54s    max=34.51s   p(90)=31.46s   p(95)=33.02s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 3132 
     http_req_receiving.............: avg=683.97µs min=40.05µs  med=100.43µs max=185.89ms p(90)=219.62µs p(95)=361.14µs
     http_req_sending...............: avg=412.29µs min=8.79µs   med=15.47µs  max=48.63ms  p(90)=856.66µs p(95)=2.05ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=5.11s    min=10.39ms  med=1.54s    max=34.51s   p(90)=31.46s   p(95)=33.02s  
     http_reqs......................: 3132    89.58383/s
     iteration_duration.............: avg=5.17s    min=381.27ms med=1.56s    max=34.52s   p(90)=31.51s   p(95)=33.05s  
     iterations.....................: 3112    89.011775/s
     vus............................: 1       min=1       max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8937      ✗ 0    
     data_received..................: 263 MB  7.6 MB/s
     data_sent......................: 3.6 MB  103 kB/s
     http_req_blocked...............: avg=3.03ms   min=2.06µs   med=3.83µs  max=43.34ms p(90)=18.29ms  p(95)=24.16ms
     http_req_connecting............: avg=2.95ms   min=0s       med=0s      max=43.31ms p(90)=17.57ms  p(95)=23.93ms
     http_req_duration..............: avg=5.05s    min=16.86ms  med=4.43s   max=11.01s  p(90)=8.01s    p(95)=9.37s  
       { expected_response:true }...: avg=5.05s    min=16.86ms  med=4.43s   max=11.01s  p(90)=8.01s    p(95)=9.37s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2999 
     http_req_receiving.............: avg=138.46ms min=38.41µs  med=94.87µs max=4.24s   p(90)=371.31ms p(95)=1.25s  
     http_req_sending...............: avg=4.24ms   min=9.69µs   med=19.31µs max=1.02s   p(90)=2.09ms   p(95)=6.18ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s      max=0s      p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=4.91s    min=16.6ms   med=4.23s   max=10.55s  p(90)=7.94s    p(95)=9.24s  
     http_reqs......................: 2999    86.618779/s
     iteration_duration.............: avg=5.41s    min=252.61ms med=4.78s   max=11.21s  p(90)=8.42s    p(95)=10.17s 
     iterations.....................: 2979    86.041128/s
     vus............................: 83      min=83      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 6936      ✗ 0    
     data_received..................: 205 MB  6.2 MB/s
     data_sent......................: 2.8 MB  84 kB/s
     http_req_blocked...............: avg=2.8ms    min=2.03µs   med=5.19µs   max=34.46ms p(90)=16.29ms  p(95)=19.25ms 
     http_req_connecting............: avg=2.74ms   min=0s       med=0s       max=24.53ms p(90)=16.13ms  p(95)=19.2ms  
     http_req_duration..............: avg=6.71s    min=11.77ms  med=6.75s    max=13.48s  p(90)=8.8s     p(95)=11.83s  
       { expected_response:true }...: avg=6.71s    min=11.77ms  med=6.75s    max=13.48s  p(90)=8.8s     p(95)=11.83s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2332 
     http_req_receiving.............: avg=46.51ms  min=41.41µs  med=118.12µs max=1.37s   p(90)=782.88µs p(95)=267.62ms
     http_req_sending...............: avg=359.38µs min=9.84µs   med=30.01µs  max=13.05ms p(90)=1.01ms   p(95)=1.7ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=6.67s    min=11.66ms  med=6.75s    max=13.48s  p(90)=8.8s     p(95)=11.83s  
     http_reqs......................: 2332    70.520174/s
     iteration_duration.............: avg=6.83s    min=450.88ms med=6.82s    max=13.51s  p(90)=8.82s    p(95)=11.87s  
     iterations.....................: 2312    69.91537/s
     vus............................: 38      min=38      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

Overview for: federation/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 300 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 180 5548 total, 0 failed avg: 805ms, p95: 2077ms
grafbase 171 5299 total, 0 failed avg: 927ms, p95: 2331ms
apollo-router 156 4841 total, 1 failed avg: 914ms, p95: 2941ms ❌ 1 failed requests, 1 non-200 responses, 1 unexpected GraphQL errors
apollo-server 89 2948 total, 0 failed avg: 3177ms, p95: 23111ms
hive-gateway 88 2922 total, 0 failed avg: 3179ms, p95: 16023ms
hive-gateway-bun 83 2739 total, 0 failed avg: 3374ms, p95: 5856ms
mercurius 77 2476 total, 0 failed avg: 3708ms, p95: 6158ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 16584      ✗ 0    
     data_received..................: 487 MB  16 MB/s
     data_sent......................: 6.6 MB  214 kB/s
     http_req_blocked...............: avg=2.07ms   min=1.52µs  med=3.22µs   max=2.58s p(90)=5.49µs   p(95)=638.46µs
     http_req_connecting............: avg=1.59ms   min=0s      med=0s       max=1.49s p(90)=0s       p(95)=497.99µs
     http_req_duration..............: avg=804.55ms min=3.15ms  med=678.4ms  max=4.67s p(90)=1.71s    p(95)=2.07s   
       { expected_response:true }...: avg=804.55ms min=3.15ms  med=678.4ms  max=4.67s p(90)=1.71s    p(95)=2.07s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5548 
     http_req_receiving.............: avg=237.12ms min=34.71µs med=83.39µs  max=3.94s p(90)=1.06s    p(95)=1.53s   
     http_req_sending...............: avg=36.27ms  min=8.25µs  med=14.58µs  max=3.52s p(90)=507.64µs p(95)=51.87ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=531.14ms min=3.07ms  med=480.32ms max=3.24s p(90)=968.19ms p(95)=1.1s    
     http_reqs......................: 5548    180.237539/s
     iteration_duration.............: avg=1.62s    min=20.69ms med=1.38s    max=8.77s p(90)=3.21s    p(95)=3.95s   
     iterations.....................: 5528    179.5878/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15837      ✗ 0    
     data_received..................: 466 MB  15 MB/s
     data_sent......................: 6.3 MB  204 kB/s
     http_req_blocked...............: avg=1.36ms   min=1.47µs  med=3.13µs   max=1.15s   p(90)=5.06µs  p(95)=274.84µs
     http_req_connecting............: avg=917.49µs min=0s      med=0s       max=937.8ms p(90)=0s      p(95)=165.16µs
     http_req_duration..............: avg=926.51ms min=2.96ms  med=750.58ms max=7.36s   p(90)=1.86s   p(95)=2.33s   
       { expected_response:true }...: avg=926.51ms min=2.96ms  med=750.58ms max=7.36s   p(90)=1.86s   p(95)=2.33s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5299 
     http_req_receiving.............: avg=301.47ms min=31.88µs med=79.28µs  max=6.36s   p(90)=1.22s   p(95)=1.68s   
     http_req_sending...............: avg=19.21ms  min=7.68µs  med=14.46µs  max=3.51s   p(90)=192.2µs p(95)=1.8ms   
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s      p(95)=0s      
     http_req_waiting...............: avg=605.82ms min=2.89ms  med=584.66ms max=2.82s   p(90)=1s      p(95)=1.13s   
     http_reqs......................: 5299    171.75029/s
     iteration_duration.............: avg=1.72s    min=32.33ms med=1.49s    max=10.05s  p(90)=3.33s   p(95)=4.05s   
     iterations.....................: 5279    171.102053/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✗ response code was 200
      ↳  99% — ✓ 4820 / ✗ 1
     ✗ no graphql errors
      ↳  99% — ✓ 4820 / ✗ 1
     ✓ valid response structure

     █ setup

     checks.........................: 99.98% ✓ 14460      ✗ 2    
     data_received..................: 425 MB 14 MB/s
     data_sent......................: 5.7 MB 185 kB/s
     http_req_blocked...............: avg=2.58ms   min=1.41µs  med=3.43µs   max=3.17s p(90)=5.98µs  p(95)=515.61µs
     http_req_connecting............: avg=2.53ms   min=0s      med=0s       max=3.17s p(90)=0s      p(95)=457.73µs
     http_req_duration..............: avg=913.87ms min=6.45ms  med=668.4ms  max=6.08s p(90)=2.13s   p(95)=2.94s   
       { expected_response:true }...: avg=913.37ms min=6.45ms  med=668.39ms max=6.08s p(90)=2.13s   p(95)=2.93s   
     http_req_failed................: 0.02%  ✓ 1          ✗ 4840 
     http_req_receiving.............: avg=369.88ms min=0s      med=88.71µs  max=4.89s p(90)=1.54s   p(95)=2.26s   
     http_req_sending...............: avg=22.25ms  min=7.75µs  med=16.28µs  max=2.78s p(90)=250.7µs p(95)=7.53ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s      p(95)=0s      
     http_req_waiting...............: avg=521.74ms min=6.39ms  med=470.32ms max=3.32s p(90)=1s      p(95)=1.19s   
     http_reqs......................: 4841   156.026913/s
     iteration_duration.............: avg=1.87s    min=32.14ms med=1.52s    max=9.89s p(90)=4s      p(95)=4.96s   
     iterations.....................: 4821   155.382307/s
     vus............................: 33     min=33       max=300
     vus_max........................: 300    min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8784      ✗ 0    
     data_received..................: 259 MB  7.8 MB/s
     data_sent......................: 3.5 MB  106 kB/s
     http_req_blocked...............: avg=606.97µs min=1.59µs   med=3.53µs   max=16.58ms p(90)=106.47µs p(95)=5.24ms  
     http_req_connecting............: avg=591.43µs min=0s       med=0s       max=16.55ms p(90)=73.67µs  p(95)=5.18ms  
     http_req_duration..............: avg=3.17s    min=10.21ms  med=1.44s    max=32.7s   p(90)=2.06s    p(95)=23.11s  
       { expected_response:true }...: avg=3.17s    min=10.21ms  med=1.44s    max=32.7s   p(90)=2.06s    p(95)=23.11s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2948 
     http_req_receiving.............: avg=378.25µs min=43.5µs   med=101.43µs max=66.47ms p(90)=223.1µs  p(95)=359.02µs
     http_req_sending...............: avg=313.44µs min=8.93µs   med=18.34µs  max=60.88ms p(90)=139.39µs p(95)=2.79ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.17s    min=10.12ms  med=1.44s    max=32.7s   p(90)=2.06s    p(95)=23.1s   
     http_reqs......................: 2948    89.037132/s
     iteration_duration.............: avg=3.21s    min=334.51ms med=1.46s    max=32.71s  p(90)=2.08s    p(95)=23.52s  
     iterations.....................: 2928    88.43308/s
     vus............................: 15      min=15      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8706      ✗ 0    
     data_received..................: 257 MB  7.7 MB/s
     data_sent......................: 3.5 MB  105 kB/s
     http_req_blocked...............: avg=861.88µs min=2.11µs   med=4.42µs   max=42.01ms  p(90)=361.12µs p(95)=7.84ms
     http_req_connecting............: avg=804.47µs min=0s       med=0s       max=27.11ms  p(90)=176.57µs p(95)=7.54ms
     http_req_duration..............: avg=3.17s    min=13.34ms  med=1.73s    max=32.66s   p(90)=2.87s    p(95)=16.02s
       { expected_response:true }...: avg=3.17s    min=13.34ms  med=1.73s    max=32.66s   p(90)=2.87s    p(95)=16.02s
     http_req_failed................: 0.00%   ✓ 0         ✗ 2922 
     http_req_receiving.............: avg=1.97ms   min=45.76µs  med=102.75µs max=282.63ms p(90)=664.41µs p(95)=2.92ms
     http_req_sending...............: avg=779.96µs min=10.57µs  med=24.36µs  max=204.66ms p(90)=243.08µs p(95)=1.17ms
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s    
     http_req_waiting...............: avg=3.17s    min=13.24ms  med=1.73s    max=32.66s   p(90)=2.87s    p(95)=15.99s
     http_reqs......................: 2922    88.194936/s
     iteration_duration.............: avg=3.24s    min=133.66ms med=1.77s    max=32.7s    p(90)=2.92s    p(95)=16.32s
     iterations.....................: 2902    87.591274/s
     vus............................: 18      min=18      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8157      ✗ 0    
     data_received..................: 240 MB  7.3 MB/s
     data_sent......................: 3.3 MB  99 kB/s
     http_req_blocked...............: avg=754.44µs min=2.29µs   med=5.01µs  max=155.18ms p(90)=263.97µs p(95)=6.92ms 
     http_req_connecting............: avg=672.69µs min=0s       med=0s      max=19.58ms  p(90)=193.24µs p(95)=6.63ms 
     http_req_duration..............: avg=3.37s    min=15.88ms  med=3.08s   max=7.33s    p(90)=5.06s    p(95)=5.85s  
       { expected_response:true }...: avg=3.37s    min=15.88ms  med=3.08s   max=7.33s    p(90)=5.06s    p(95)=5.85s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2739 
     http_req_receiving.............: avg=73.55ms  min=41.5µs   med=173.3µs max=1.88s    p(90)=20.24ms  p(95)=756.8ms
     http_req_sending...............: avg=806.61µs min=9.86µs   med=28.84µs max=165.57ms p(90)=338.34µs p(95)=1.4ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s      max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=3.29s    min=15.71ms  med=3.05s   max=7.33s    p(90)=5.04s    p(95)=5.85s  
     http_reqs......................: 2739    83.097154/s
     iteration_duration.............: avg=3.44s    min=462.06ms med=3.13s   max=7.64s    p(90)=5.17s    p(95)=5.9s   
     iterations.....................: 2719    82.490384/s
     vus............................: 119     min=119     max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7368      ✗ 0    
     data_received..................: 217 MB  6.8 MB/s
     data_sent......................: 2.9 MB  92 kB/s
     http_req_blocked...............: avg=816.1µs  min=1.79µs   med=3.83µs   max=17.96ms  p(90)=944.03µs p(95)=9.41ms
     http_req_connecting............: avg=790.52µs min=0s       med=0s       max=14.38ms  p(90)=842.21µs p(95)=9.22ms
     http_req_duration..............: avg=3.7s     min=11.58ms  med=3.75s    max=8.38s    p(90)=4.65s    p(95)=6.15s 
       { expected_response:true }...: avg=3.7s     min=11.58ms  med=3.75s    max=8.38s    p(90)=4.65s    p(95)=6.15s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 2476 
     http_req_receiving.............: avg=9.71ms   min=35.12µs  med=100.46µs max=716.95ms p(90)=322.32µs p(95)=1.14ms
     http_req_sending...............: avg=375.97µs min=8.33µs   med=21.18µs  max=123.02ms p(90)=224.4µs  p(95)=2.55ms
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s    
     http_req_waiting...............: avg=3.69s    min=11.49ms  med=3.74s    max=8.38s    p(90)=4.65s    p(95)=6.15s 
     http_reqs......................: 2476    77.491886/s
     iteration_duration.............: avg=3.77s    min=309.77ms med=3.77s    max=8.41s    p(90)=4.67s    p(95)=6.19s 
     iterations.....................: 2456    76.865942/s
     vus............................: 240     min=240     max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

Overview for: federation/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 300 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 175 5401 total, 0 failed avg: 773ms, p95: 2093ms
grafbase 166 5166 total, 0 failed avg: 889ms, p95: 2465ms
apollo-router 150 4656 total, 0 failed avg: 975ms, p95: 2476ms
hive-gateway 91 3033 total, 0 failed avg: 3053ms, p95: 14374ms
apollo-server 90 2989 total, 0 failed avg: 3134ms, p95: 24646ms
hive-gateway-bun 89 2982 total, 0 failed avg: 3112ms, p95: 4897ms
mercurius 78 2497 total, 0 failed avg: 3688ms, p95: 6031ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 16143      ✗ 0    
     data_received..................: 474 MB  15 MB/s
     data_sent......................: 6.4 MB  209 kB/s
     http_req_blocked...............: avg=1.63ms   min=1.61µs  med=3.85µs   max=2.77s  p(90)=6.45µs   p(95)=252.28µs
     http_req_connecting............: avg=1.52ms   min=0s      med=0s       max=2.77s  p(90)=0s       p(95)=159.95µs
     http_req_duration..............: avg=772.77ms min=3.23ms  med=633.27ms max=4.33s  p(90)=1.71s    p(95)=2.09s   
       { expected_response:true }...: avg=772.77ms min=3.23ms  med=633.27ms max=4.33s  p(90)=1.71s    p(95)=2.09s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5401 
     http_req_receiving.............: avg=260.37ms min=32.09µs med=95.18µs  max=4.05s  p(90)=1.07s    p(95)=1.61s   
     http_req_sending...............: avg=18.37ms  min=8.87µs  med=18.56µs  max=2.98s  p(90)=186.13µs p(95)=12.66ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=494.03ms min=3.1ms   med=417.24ms max=2.6s   p(90)=951.94ms p(95)=1.13s   
     http_reqs......................: 5401    175.947544/s
     iteration_duration.............: avg=1.66s    min=18.02ms med=1.36s    max=12.18s p(90)=3.53s    p(95)=4.32s   
     iterations.....................: 5381    175.296007/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15438      ✗ 0    
     data_received..................: 454 MB  15 MB/s
     data_sent......................: 6.1 MB  198 kB/s
     http_req_blocked...............: avg=1.37ms   min=1.42µs  med=3.47µs   max=2.51s p(90)=5.85µs   p(95)=1.3ms  
     http_req_connecting............: avg=1.35ms   min=0s      med=0s       max=2.51s p(90)=0s       p(95)=1.22ms 
     http_req_duration..............: avg=888.93ms min=3.16ms  med=729.18ms max=5.61s p(90)=1.86s    p(95)=2.46s  
       { expected_response:true }...: avg=888.93ms min=3.16ms  med=729.18ms max=5.61s p(90)=1.86s    p(95)=2.46s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 5166 
     http_req_receiving.............: avg=300.26ms min=29.36µs med=85.13µs  max=4.73s p(90)=1.28s    p(95)=1.81s  
     http_req_sending...............: avg=19.98ms  min=7.07µs  med=15.78µs  max=2.98s p(90)=411.97µs p(95)=10.91ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=568.68ms min=3.09ms  med=546.41ms max=3.6s  p(90)=1.06s    p(95)=1.25s  
     http_reqs......................: 5166    166.959587/s
     iteration_duration.............: avg=1.75s    min=16.73ms med=1.47s    max=8.86s p(90)=3.56s    p(95)=4.17s  
     iterations.....................: 5146    166.313209/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 13908      ✗ 0    
     data_received..................: 409 MB  13 MB/s
     data_sent......................: 5.5 MB  179 kB/s
     http_req_blocked...............: avg=3.41ms   min=1.54µs  med=4.07µs   max=2.94s p(90)=7.81µs   p(95)=2.32ms
     http_req_connecting............: avg=3.13ms   min=0s      med=0s       max=2.62s p(90)=0s       p(95)=2.07ms
     http_req_duration..............: avg=975.43ms min=7.04ms  med=780.01ms max=6.32s p(90)=2.01s    p(95)=2.47s 
       { expected_response:true }...: avg=975.43ms min=7.04ms  med=780.01ms max=6.32s p(90)=2.01s    p(95)=2.47s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 4656 
     http_req_receiving.............: avg=410.22ms min=33.26µs med=157.37µs max=5.31s p(90)=1.45s    p(95)=1.9s  
     http_req_sending...............: avg=15.9ms   min=8.05µs  med=21.18µs  max=3.07s p(90)=224.31µs p(95)=3.56ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s    
     http_req_waiting...............: avg=549.3ms  min=6.96ms  med=514.03ms max=2.11s p(90)=1s       p(95)=1.11s 
     http_reqs......................: 4656    150.81074/s
     iteration_duration.............: avg=1.95s    min=31.99ms med=1.7s     max=9.24s p(90)=3.83s    p(95)=4.55s 
     iterations.....................: 4636    150.162928/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 9039      ✗ 0    
     data_received..................: 266 MB  8.1 MB/s
     data_sent......................: 3.6 MB  109 kB/s
     http_req_blocked...............: avg=673.08µs min=1.87µs   med=4.38µs   max=25.13ms  p(90)=108.35µs p(95)=7.24ms
     http_req_connecting............: avg=647.66µs min=0s       med=0s       max=14.65ms  p(90)=0s       p(95)=6.87ms
     http_req_duration..............: avg=3.05s    min=12.04ms  med=1.64s    max=32.61s   p(90)=2.83s    p(95)=14.37s
       { expected_response:true }...: avg=3.05s    min=12.04ms  med=1.64s    max=32.61s   p(90)=2.83s    p(95)=14.37s
     http_req_failed................: 0.00%   ✓ 0         ✗ 3033 
     http_req_receiving.............: avg=777.65µs min=42.26µs  med=103.17µs max=105.14ms p(90)=577.93µs p(95)=1.77ms
     http_req_sending...............: avg=417.91µs min=8.86µs   med=25.42µs  max=50.53ms  p(90)=241.89µs p(95)=1.51ms
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s    
     http_req_waiting...............: avg=3.05s    min=11.92ms  med=1.64s    max=32.61s   p(90)=2.83s    p(95)=14.37s
     http_reqs......................: 3033    91.750509/s
     iteration_duration.............: avg=3.11s    min=213.69ms med=1.69s    max=32.64s   p(90)=2.91s    p(95)=14.53s
     iterations.....................: 3013    91.145494/s
     vus............................: 16      min=16      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8907      ✗ 0    
     data_received..................: 263 MB  7.9 MB/s
     data_sent......................: 3.5 MB  107 kB/s
     http_req_blocked...............: avg=507.98µs min=1.54µs   med=3.17µs max=16.6ms  p(90)=185.94µs p(95)=4.94ms  
     http_req_connecting............: avg=482.66µs min=0s       med=0s     max=11.77ms p(90)=73.44µs  p(95)=4.82ms  
     http_req_duration..............: avg=3.13s    min=10.68ms  med=1.34s  max=32.62s  p(90)=2.31s    p(95)=24.64s  
       { expected_response:true }...: avg=3.13s    min=10.68ms  med=1.34s  max=32.62s  p(90)=2.31s    p(95)=24.64s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2989 
     http_req_receiving.............: avg=216.06µs min=43.19µs  med=99.9µs max=43.87ms p(90)=193.77µs p(95)=295.65µs
     http_req_sending...............: avg=273.23µs min=8.29µs   med=15.8µs max=22.03ms p(90)=114.31µs p(95)=1.96ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s     max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.13s    min=10.57ms  med=1.34s  max=32.62s  p(90)=2.31s    p(95)=24.64s  
     http_reqs......................: 2989    90.489144/s
     iteration_duration.............: avg=3.16s    min=234.81ms med=1.36s  max=32.65s  p(90)=2.32s    p(95)=25.09s  
     iterations.....................: 2969    89.883663/s
     vus............................: 6       min=6       max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8886      ✗ 0    
     data_received..................: 262 MB  7.9 MB/s
     data_sent......................: 3.5 MB  106 kB/s
     http_req_blocked...............: avg=486.24µs min=2.01µs   med=3.96µs   max=24.52ms p(90)=125.2µs  p(95)=4.52ms  
     http_req_connecting............: avg=450.09µs min=0s       med=0s       max=15.98ms p(90)=66.61µs  p(95)=4.31ms  
     http_req_duration..............: avg=3.11s    min=15.91ms  med=2.83s    max=7.65s   p(90)=4.42s    p(95)=4.89s   
       { expected_response:true }...: avg=3.11s    min=15.91ms  med=2.83s    max=7.65s   p(90)=4.42s    p(95)=4.89s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2982 
     http_req_receiving.............: avg=69.06ms  min=39.09µs  med=150.47µs max=2.22s   p(90)=75.29ms  p(95)=625.55ms
     http_req_sending...............: avg=728.83µs min=9.76µs   med=20.3µs   max=168.3ms p(90)=214.33µs p(95)=1.09ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.04s    min=15.66ms  med=2.78s    max=7.37s   p(90)=4.38s    p(95)=4.77s   
     http_reqs......................: 2982    89.553273/s
     iteration_duration.............: avg=3.2s     min=139.94ms med=2.87s    max=7.67s   p(90)=4.57s    p(95)=4.95s   
     iterations.....................: 2962    88.952648/s
     vus............................: 48      min=48      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7431      ✗ 0    
     data_received..................: 219 MB  6.9 MB/s
     data_sent......................: 3.0 MB  93 kB/s
     http_req_blocked...............: avg=424.82µs min=1.67µs   med=4.07µs   max=16.58ms  p(90)=433.14µs p(95)=3.56ms
     http_req_connecting............: avg=405.41µs min=0s       med=0s       max=16.28ms  p(90)=349.78µs p(95)=3.5ms 
     http_req_duration..............: avg=3.68s    min=11.26ms  med=3.73s    max=8.6s     p(90)=4.57s    p(95)=6.03s 
       { expected_response:true }...: avg=3.68s    min=11.26ms  med=3.73s    max=8.6s     p(90)=4.57s    p(95)=6.03s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 2497 
     http_req_receiving.............: avg=9.76ms   min=39.23µs  med=103.83µs max=880.39ms p(90)=288.82µs p(95)=1.06ms
     http_req_sending...............: avg=198.2µs  min=9.21µs   med=23.6µs   max=42.73ms  p(90)=143.01µs p(95)=1.19ms
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s    
     http_req_waiting...............: avg=3.67s    min=11.17ms  med=3.73s    max=8.6s     p(90)=4.57s    p(95)=6.02s 
     http_reqs......................: 2497    78.093662/s
     iteration_duration.............: avg=3.75s    min=203.44ms med=3.75s    max=8.64s    p(90)=4.59s    p(95)=6.06s 
     iterations.....................: 2477    77.468162/s
     vus............................: 232     min=232     max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

Overview for: federation/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 2000 concurrent VUs over 60s

Comparison

Comparison

Gateway duration(p95)⬇️ RPS Requests Durations Notes
apollo-router 5160ms 164 11608 total, 582 failed avg: 2346ms, p95: 5160ms, max: 12097ms, med: 2099ms ❌ 582 failed requests, 582 non-200 responses, 583 unexpected GraphQL errors, non-compatible response structure (1)
cosmo 7064ms 178 13014 total, 0 failed avg: 2642ms, p95: 7065ms, max: 18469ms, med: 2167ms
grafbase 7946ms 167 13234 total, 0 failed avg: 2960ms, p95: 7946ms, max: 24986ms, med: 2345ms
hive-gateway-bun 28408ms 91 7466 total, 0 failed avg: 11585ms, p95: 28409ms, max: 38135ms, med: 10079ms
mercurius 45359ms 40 3833 total, 364 failed avg: 18014ms, p95: 45359ms, max: 53717ms, med: 13923ms ❌ 364 failed requests, 364 non-200 responses, 364 unexpected GraphQL errors
hive-gateway 50037ms 93 8034 total, 0 failed avg: 11275ms, p95: 50037ms, max: 57526ms, med: 3236ms
apollo-server 59999ms 86 8026 total, 489 failed avg: 11350ms, p95: 59999ms, max: 60113ms, med: 2155ms ❌ 489 failed requests, 489 non-200 responses, 489 unexpected GraphQL errors
Summary for: `apollo-router`

K6 Output

     ✗ response code was 200
      ↳  94% — ✓ 11006 / ✗ 582
     ✗ no graphql errors
      ↳  94% — ✓ 11005 / ✗ 583
     ✗ valid response structure
      ↳  99% — ✓ 11006 / ✗ 1

     █ setup

     checks.........................: 96.58% ✓ 33017     ✗ 1166  
     data_received..................: 968 MB 14 MB/s
     data_sent......................: 14 MB  196 kB/s
     http_req_blocked...............: avg=459.7ms  min=1.52µs  med=4.27µs  max=9.86s  p(90)=1.96s    p(95)=3.1s    
     http_req_connecting............: avg=451.67ms min=0s      med=0s      max=8.36s  p(90)=1.92s    p(95)=3.07s   
     http_req_duration..............: avg=2.34s    min=6.79ms  med=2.09s   max=12.09s p(90)=4.41s    p(95)=5.16s   
       { expected_response:true }...: avg=2.35s    min=6.79ms  med=2.1s    max=12.09s p(90)=4.41s    p(95)=5.14s   
     http_req_failed................: 5.01%  ✓ 582       ✗ 11026 
     http_req_receiving.............: avg=152.79ms min=0s      med=81.86µs max=6.69s  p(90)=486.08ms p(95)=1.35s   
     http_req_sending...............: avg=155.72ms min=8.16µs  med=23.43µs max=12.07s p(90)=463.75ms p(95)=867.11ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=2.03s    min=6.68ms  med=1.79s   max=8.52s  p(90)=4.09s    p(95)=4.7s    
     http_reqs......................: 11608  164.85672/s
     iteration_duration.............: avg=6.05s    min=22.43ms med=5.44s   max=24.39s p(90)=11.76s   p(95)=13.82s  
     iterations.....................: 11588  164.57268/s
     vus............................: 328    min=68      max=1953
     vus_max........................: 2000   min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 38982      ✗ 0     
     data_received..................: 1.1 GB  16 MB/s
     data_sent......................: 15 MB   212 kB/s
     http_req_blocked...............: avg=347.59ms min=1.48µs  med=3.59µs  max=13.31s p(90)=481.64ms p(95)=2.29s   
     http_req_connecting............: avg=306.99ms min=0s      med=0s      max=13.31s p(90)=477.03ms p(95)=2.29s   
     http_req_duration..............: avg=2.64s    min=3.22ms  med=2.16s   max=18.46s p(90)=4.97s    p(95)=7.06s   
       { expected_response:true }...: avg=2.64s    min=3.22ms  med=2.16s   max=18.46s p(90)=4.97s    p(95)=7.06s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 13014 
     http_req_receiving.............: avg=544.77ms min=33.28µs med=87.48µs max=14.4s  p(90)=1.36s    p(95)=3.4s    
     http_req_sending...............: avg=181.21ms min=8.08µs  med=16.36µs max=9.28s  p(90)=309.67ms p(95)=918.44ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=1.91s    min=3.1ms   med=1.81s   max=8.55s  p(90)=3.67s    p(95)=4.39s   
     http_reqs......................: 13014   178.900834/s
     iteration_duration.............: avg=5.84s    min=24.96ms med=4.84s   max=28.97s p(90)=12.2s    p(95)=14.65s  
     iterations.....................: 12994   178.625899/s
     vus............................: 385     min=72       max=1999
     vus_max........................: 2000    min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 39642      ✗ 0     
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   199 kB/s
     http_req_blocked...............: avg=337.48ms min=1.53µs  med=3.99µs  max=18.7s  p(90)=959.26ms p(95)=2.69s   
     http_req_connecting............: avg=333.79ms min=0s      med=0s      max=18.7s  p(90)=933.34ms p(95)=2.66s   
     http_req_duration..............: avg=2.95s    min=3.53ms  med=2.34s   max=24.98s p(90)=5.29s    p(95)=7.94s   
       { expected_response:true }...: avg=2.95s    min=3.53ms  med=2.34s   max=24.98s p(90)=5.29s    p(95)=7.94s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 13234 
     http_req_receiving.............: avg=400.02ms min=33.06µs med=82.38µs max=15.47s p(90)=146.03ms p(95)=1.52s   
     http_req_sending...............: avg=143.12ms min=8.39µs  med=19.54µs max=20.59s p(90)=251.85ms p(95)=673.54ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=2.41s    min=3.45ms  med=2.04s   max=13.74s p(90)=4.73s    p(95)=5.17s   
     http_reqs......................: 13234   167.387959/s
     iteration_duration.............: avg=6.8s     min=55.68ms med=5.34s   max=43.91s p(90)=14.14s   p(95)=18.38s  
     iterations.....................: 13214   167.134992/s
     vus............................: 230     min=70       max=1865
     vus_max........................: 2000    min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 22338     ✗ 0     
     data_received..................: 655 MB  8.0 MB/s
     data_sent......................: 8.9 MB  109 kB/s
     http_req_blocked...............: avg=19.1ms   min=1.55µs  med=4.36µs   max=1.9s     p(90)=26.78ms p(95)=147.38ms
     http_req_connecting............: avg=18.65ms  min=0s      med=0s       max=785.83ms p(90)=25.9ms  p(95)=146.99ms
     http_req_duration..............: avg=11.58s   min=16.27ms med=10.07s   max=38.13s   p(90)=25.25s  p(95)=28.4s   
       { expected_response:true }...: avg=11.58s   min=16.27ms med=10.07s   max=38.13s   p(90)=25.25s  p(95)=28.4s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 7466  
     http_req_receiving.............: avg=129.03ms min=38.7µs  med=112.55µs max=7.22s    p(90)=17.31ms p(95)=670.44ms
     http_req_sending...............: avg=13.22ms  min=9.73µs  med=26.37µs  max=1.72s    p(90)=17.44ms p(95)=62.09ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s      
     http_req_waiting...............: avg=11.44s   min=16.05ms med=9.87s    max=36.95s   p(90)=25.18s  p(95)=28.37s  
     http_reqs......................: 7466    91.573626/s
     iteration_duration.............: avg=11.94s   min=59.53ms med=10.33s   max=40.52s   p(90)=25.6s   p(95)=29.5s   
     iterations.....................: 7446    91.328317/s
     vus............................: 197     min=59      max=2000
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✗ response code was 200
      ↳  90% — ✓ 3449 / ✗ 364
     ✗ no graphql errors
      ↳  90% — ✓ 3449 / ✗ 364
     ✓ valid response structure

     █ setup

     checks.........................: 93.42% ✓ 10347     ✗ 728   
     data_received..................: 305 MB 3.2 MB/s
     data_sent......................: 6.0 MB 63 kB/s
     http_req_blocked...............: avg=220.84µs min=1.77µs   med=4.77µs   max=10.82ms p(90)=520.82µs p(95)=769.87µs
     http_req_connecting............: avg=187.12µs min=0s       med=0s       max=10.76ms p(90)=444.16µs p(95)=670.42µs
     http_req_duration..............: avg=18.01s   min=12.04ms  med=13.92s   max=53.71s  p(90)=42.45s   p(95)=45.35s  
       { expected_response:true }...: avg=15.42s   min=12.04ms  med=12.21s   max=46.03s  p(90)=33.09s   p(95)=45.02s  
     http_req_failed................: 9.49%  ✓ 364       ✗ 3469  
     http_req_receiving.............: avg=285.41µs min=0s       med=109.67µs max=95.92ms p(90)=295.53µs p(95)=605.5µs 
     http_req_sending...............: avg=68.16µs  min=9.36µs   med=29.2µs   max=15.74ms p(90)=71.49µs  p(95)=97.5µs  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=18.01s   min=11.66ms  med=13.92s   max=53.71s  p(90)=42.45s   p(95)=45.35s  
     http_reqs......................: 3833   40.608066/s
     iteration_duration.............: avg=18.12s   min=218.52ms med=14.02s   max=53.77s  p(90)=42.59s   p(95)=45.62s  
     iterations.....................: 3813   40.396179/s
     vus............................: 555    min=59      max=2000
     vus_max........................: 2000   min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 24042     ✗ 0     
     data_received..................: 706 MB  8.2 MB/s
     data_sent......................: 9.5 MB  111 kB/s
     http_req_blocked...............: avg=9.58ms min=2.01µs  med=4.84µs  max=477.61ms p(90)=26.62ms  p(95)=68.54ms
     http_req_connecting............: avg=9.42ms min=0s      med=0s      max=477.54ms p(90)=25.85ms  p(95)=66.51ms
     http_req_duration..............: avg=11.27s min=12.76ms med=3.23s   max=57.52s   p(90)=42.58s   p(95)=50.03s 
       { expected_response:true }...: avg=11.27s min=12.76ms med=3.23s   max=57.52s   p(90)=42.58s   p(95)=50.03s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 8034  
     http_req_receiving.............: avg=6.22ms min=40.42µs med=99.59µs max=963.72ms p(90)=872.23µs p(95)=4.66ms 
     http_req_sending...............: avg=5.16ms min=10.02µs med=27.69µs max=491.23ms p(90)=12.11ms  p(95)=28.37ms
     http_req_tls_handshaking.......: avg=0s     min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=11.26s min=12.65ms med=3.22s   max=56.93s   p(90)=42.57s   p(95)=50.03s 
     http_reqs......................: 8034    93.672524/s
     iteration_duration.............: avg=11.4s  min=67.72ms med=3.35s   max=57.65s   p(90)=42.64s   p(95)=50.14s 
     iterations.....................: 8014    93.439334/s
     vus............................: 16      min=16      max=2000
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✗ response code was 200
      ↳  93% — ✓ 7517 / ✗ 489
     ✗ no graphql errors
      ↳  93% — ✓ 7517 / ✗ 489
     ✓ valid response structure

     █ setup

     checks.........................: 95.84% ✓ 22551     ✗ 978   
     data_received..................: 662 MB 7.1 MB/s
     data_sent......................: 9.6 MB 104 kB/s
     http_req_blocked...............: avg=476.8µs  min=1.44µs  med=3.29µs  max=75.12ms  p(90)=349.32µs p(95)=590.68µs
     http_req_connecting............: avg=454.89µs min=0s      med=0s      max=75.06ms  p(90)=283.78µs p(95)=497.08µs
     http_req_duration..............: avg=11.35s   min=10.55ms med=2.15s   max=1m0s     p(90)=52.26s   p(95)=59.99s  
       { expected_response:true }...: avg=8.34s    min=10.55ms med=2.08s   max=59.99s   p(90)=36.2s    p(95)=48.46s  
     http_req_failed................: 6.09%  ✓ 489       ✗ 7537  
     http_req_receiving.............: avg=348.33µs min=0s      med=99.88µs max=364.27ms p(90)=217.08µs p(95)=344.43µs
     http_req_sending...............: avg=201.11µs min=8.78µs  med=15.89µs max=53.48ms  p(90)=63.01µs  p(95)=120.02µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=11.34s   min=10.45ms med=2.15s   max=1m0s     p(90)=52.26s   p(95)=59.99s  
     http_reqs......................: 8026   86.577975/s
     iteration_duration.............: avg=11.39s   min=60.68ms med=2.17s   max=1m0s     p(90)=52.43s   p(95)=1m0s    
     iterations.....................: 8006   86.362232/s
     vus............................: 78     min=62      max=2000
     vus_max........................: 2000   min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependencies Pull requests that update a dependency file
Projects
None yet
Development

Successfully merging this pull request may close these issues.

0 participants