Skip to content

No jit no fork for Hive Gateway #718

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 2 commits into
base: main
Choose a base branch
from
Draft

No jit no fork for Hive Gateway #718

wants to merge 2 commits into from

Conversation

enisdenjo
Copy link
Member

In light of latest feedback from users using Hive Gateway in production.

Copy link

github-actions bot commented Jul 2, 2025

Overview for: federation/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 300 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 185 5713 total, 0 failed avg: 749ms, p95: 2113ms
grafbase 168 5191 total, 0 failed avg: 936ms, p95: 2250ms
apollo-router 154 4766 total, 0 failed avg: 977ms, p95: 2403ms
apollo-server 88 2912 total, 0 failed avg: 3209ms, p95: 21433ms
hive-gateway-bun 77 2617 total, 0 failed avg: 3670ms, p95: 5534ms
mercurius 75 2432 total, 0 failed avg: 3787ms, p95: 5316ms
hive-gateway 73 2475 total, 0 failed avg: 3800ms, p95: 31704ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 17079      ✗ 0    
     data_received..................: 501 MB  16 MB/s
     data_sent......................: 6.8 MB  220 kB/s
     http_req_blocked...............: avg=2.4ms    min=1.44µs  med=3.16µs   max=4.48s p(90)=5.45µs   p(95)=2.6ms   
     http_req_connecting............: avg=2.14ms   min=0s      med=0s       max=4.48s p(90)=0s       p(95)=1.97ms  
     http_req_duration..............: avg=748.58ms min=3.29ms  med=559.97ms max=4.43s p(90)=1.72s    p(95)=2.11s   
       { expected_response:true }...: avg=748.58ms min=3.29ms  med=559.97ms max=4.43s p(90)=1.72s    p(95)=2.11s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5713 
     http_req_receiving.............: avg=278.16ms min=32.78µs med=90.28µs  max=3.86s p(90)=1.19s    p(95)=1.6s    
     http_req_sending...............: avg=17.8ms   min=8.16µs  med=14.76µs  max=2.99s p(90)=307.16µs p(95)=14.26ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=452.6ms  min=3.14ms  med=405.74ms max=2.37s p(90)=864.8ms  p(95)=970.19ms
     http_reqs......................: 5713    185.190781/s
     iteration_duration.............: avg=1.57s    min=17.74ms med=1.27s    max=8.46s p(90)=3.28s    p(95)=3.9s    
     iterations.....................: 5693    184.542467/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15513      ✗ 0    
     data_received..................: 456 MB  15 MB/s
     data_sent......................: 6.2 MB  200 kB/s
     http_req_blocked...............: avg=2.03ms   min=1.34µs  med=3.19µs   max=2.31s p(90)=5.73µs   p(95)=931.25µs
     http_req_connecting............: avg=1.67ms   min=0s      med=0s       max=2.31s p(90)=0s       p(95)=678.28µs
     http_req_duration..............: avg=935.84ms min=3.45ms  med=772.86ms max=5.3s  p(90)=1.74s    p(95)=2.25s   
       { expected_response:true }...: avg=935.84ms min=3.45ms  med=772.86ms max=5.3s  p(90)=1.74s    p(95)=2.25s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5191 
     http_req_receiving.............: avg=219.62ms min=33.6µs  med=81.57µs  max=4.39s p(90)=879.8ms  p(95)=1.44s   
     http_req_sending...............: avg=22.3ms   min=8µs     med=14.98µs  max=2.99s p(90)=353.62µs p(95)=45.4ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=693.91ms min=3.35ms  med=669.52ms max=2.69s p(90)=1.13s    p(95)=1.29s   
     http_reqs......................: 5191    168.762355/s
     iteration_duration.............: avg=1.75s    min=22.35ms med=1.51s    max=8.44s p(90)=3.29s    p(95)=3.93s   
     iterations.....................: 5171    168.112144/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 14238      ✗ 0    
     data_received..................: 418 MB  14 MB/s
     data_sent......................: 5.7 MB  183 kB/s
     http_req_blocked...............: avg=4.22ms   min=1.87µs  med=4µs      max=3.13s p(90)=7.36µs   p(95)=2.63ms
     http_req_connecting............: avg=3.68ms   min=0s      med=0s       max=2.71s p(90)=0s       p(95)=2.44ms
     http_req_duration..............: avg=976.83ms min=7.51ms  med=801.34ms max=6.45s p(90)=2.03s    p(95)=2.4s  
       { expected_response:true }...: avg=976.83ms min=7.51ms  med=801.34ms max=6.45s p(90)=2.03s    p(95)=2.4s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 4766 
     http_req_receiving.............: avg=320.62ms min=35.33µs med=102.16µs max=4.69s p(90)=1.37s    p(95)=1.81s 
     http_req_sending...............: avg=21.02ms  min=8.82µs  med=19.57µs  max=2.64s p(90)=171.19µs p(95)=2.89ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s    
     http_req_waiting...............: avg=635.18ms min=7.38ms  med=618.37ms max=2.99s p(90)=1.07s    p(95)=1.22s 
     http_reqs......................: 4766    154.513112/s
     iteration_duration.............: avg=1.91s    min=34.65ms med=1.71s    max=8.74s p(90)=3.59s    p(95)=4.3s  
     iterations.....................: 4746    153.864714/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8676      ✗ 0    
     data_received..................: 256 MB  7.7 MB/s
     data_sent......................: 3.5 MB  105 kB/s
     http_req_blocked...............: avg=2.28ms   min=1.6µs    med=3.59µs   max=74.03ms p(90)=225.93µs p(95)=17.47ms 
     http_req_connecting............: avg=2.17ms   min=0s       med=0s       max=68.5ms  p(90)=91.22µs  p(95)=17.18ms 
     http_req_duration..............: avg=3.2s     min=11.48ms  med=1.56s    max=32.61s  p(90)=2.1s     p(95)=21.43s  
       { expected_response:true }...: avg=3.2s     min=11.48ms  med=1.56s    max=32.61s  p(90)=2.1s     p(95)=21.43s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2912 
     http_req_receiving.............: avg=248.32µs min=41.91µs  med=105.52µs max=42.81ms p(90)=206.79µs p(95)=324.47µs
     http_req_sending...............: avg=977.37µs min=9.2µs    med=19.06µs  max=71.34ms p(90)=141.75µs p(95)=10.71ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.2s     min=11.36ms  med=1.56s    max=32.61s  p(90)=2.1s     p(95)=21.42s  
     http_reqs......................: 2912    88.028637/s
     iteration_duration.............: avg=3.24s    min=372.52ms med=1.57s    max=32.63s  p(90)=2.12s    p(95)=21.75s  
     iterations.....................: 2892    87.424045/s
     vus............................: 13      min=13      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7791      ✗ 0    
     data_received..................: 230 MB  6.8 MB/s
     data_sent......................: 3.1 MB  92 kB/s
     http_req_blocked...............: avg=1.12ms   min=1.56µs   med=3.04µs   max=39.34ms p(90)=2.24ms   p(95)=10.33ms 
     http_req_connecting............: avg=1.09ms   min=0s       med=0s       max=39.31ms p(90)=2.04ms   p(95)=9.92ms  
     http_req_duration..............: avg=3.66s    min=15.33ms  med=3.39s    max=8.04s   p(90)=5.07s    p(95)=5.53s   
       { expected_response:true }...: avg=3.66s    min=15.33ms  med=3.39s    max=8.04s   p(90)=5.07s    p(95)=5.53s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2617 
     http_req_receiving.............: avg=92.33ms  min=39.28µs  med=253.52µs max=2.24s   p(90)=5.55ms   p(95)=923.31ms
     http_req_sending...............: avg=723.39µs min=8.75µs   med=15.26µs  max=57.85ms p(90)=318.33µs p(95)=3.69ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.57s    min=15.15ms  med=3.36s    max=8.04s   p(90)=5.01s    p(95)=5.48s   
     http_reqs......................: 2617    77.743961/s
     iteration_duration.............: avg=3.71s    min=112.15ms med=3.41s    max=8.05s   p(90)=5.09s    p(95)=5.54s   
     iterations.....................: 2597    77.149815/s
     vus............................: 101     min=101     max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7236      ✗ 0    
     data_received..................: 214 MB  6.7 MB/s
     data_sent......................: 2.9 MB  90 kB/s
     http_req_blocked...............: avg=2.94ms min=1.89µs   med=4.62µs   max=86.54ms  p(90)=7.89ms   p(95)=25.02ms 
     http_req_connecting............: avg=2.83ms min=0s       med=0s       max=66.63ms  p(90)=6.72ms   p(95)=24.6ms  
     http_req_duration..............: avg=3.78s  min=10.83ms  med=3.83s    max=7.74s    p(90)=4.49s    p(95)=5.31s   
       { expected_response:true }...: avg=3.78s  min=10.83ms  med=3.83s    max=7.74s    p(90)=4.49s    p(95)=5.31s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2432 
     http_req_receiving.............: avg=1.67ms min=43.5µs   med=104.05µs max=439.22ms p(90)=274.07µs p(95)=642.07µs
     http_req_sending...............: avg=1.15ms min=9.53µs   med=25.74µs  max=69.26ms  p(90)=777.54µs p(95)=7.21ms  
     http_req_tls_handshaking.......: avg=0s     min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.78s  min=10.74ms  med=3.83s    max=7.74s    p(90)=4.49s    p(95)=5.29s   
     http_reqs......................: 2432    75.944036/s
     iteration_duration.............: avg=3.85s  min=403.27ms med=3.85s    max=7.81s    p(90)=4.53s    p(95)=5.37s   
     iterations.....................: 2412    75.319496/s
     vus............................: 12      min=12      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7365      ✗ 0    
     data_received..................: 217 MB  6.4 MB/s
     data_sent......................: 2.9 MB  87 kB/s
     http_req_blocked...............: avg=1.6ms    min=1.89µs   med=4.37µs   max=64.35ms  p(90)=3.59ms   p(95)=14.39ms 
     http_req_connecting............: avg=1.51ms   min=0s       med=0s       max=63.13ms  p(90)=3.18ms   p(95)=14.02ms 
     http_req_duration..............: avg=3.8s     min=13.12ms  med=1.65s    max=33.28s   p(90)=2.84s    p(95)=31.7s   
       { expected_response:true }...: avg=3.8s     min=13.12ms  med=1.65s    max=33.28s   p(90)=2.84s    p(95)=31.7s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2475 
     http_req_receiving.............: avg=448.69µs min=45.38µs  med=113.59µs max=130.19ms p(90)=198.46µs p(95)=300.57µs
     http_req_sending...............: avg=2.21ms   min=10.74µs  med=25.06µs  max=52.58ms  p(90)=2.49ms   p(95)=23.03ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.79s    min=13ms     med=1.65s    max=33.28s   p(90)=2.84s    p(95)=31.66s  
     http_reqs......................: 2475    73.31902/s
     iteration_duration.............: avg=3.84s    min=388.39ms med=1.67s    max=33.29s   p(90)=2.88s    p(95)=31.73s  
     iterations.....................: 2455    72.726543/s
     vus............................: 58      min=58      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Jul 2, 2025

Overview for: federation/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 300 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 177 5504 total, 0 failed avg: 826ms, p95: 2109ms
grafbase 162 5022 total, 0 failed avg: 947ms, p95: 2785ms
apollo-router 156 4838 total, 0 failed avg: 989ms, p95: 3152ms
apollo-server 85 2874 total, 0 failed avg: 3288ms, p95: 27155ms
hive-gateway 80 2691 total, 0 failed avg: 3487ms, p95: 31440ms
mercurius 78 2523 total, 0 failed avg: 3662ms, p95: 4753ms
hive-gateway-bun 77 2600 total, 0 failed avg: 3694ms, p95: 5600ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 16452      ✗ 0    
     data_received..................: 483 MB  16 MB/s
     data_sent......................: 6.5 MB  211 kB/s
     http_req_blocked...............: avg=1.95ms   min=1.6µs   med=3.28µs   max=1.16s p(90)=5.82µs   p(95)=2.12ms 
     http_req_connecting............: avg=1.72ms   min=0s      med=0s       max=1.16s p(90)=0s       p(95)=1.76ms 
     http_req_duration..............: avg=825.74ms min=3.34ms  med=659.19ms max=6.12s p(90)=1.72s    p(95)=2.1s   
       { expected_response:true }...: avg=825.74ms min=3.34ms  med=659.19ms max=6.12s p(90)=1.72s    p(95)=2.1s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5504 
     http_req_receiving.............: avg=344.87ms min=35.94µs med=115.45µs max=5.85s p(90)=1.16s    p(95)=1.61s  
     http_req_sending...............: avg=19.27ms  min=8.51µs  med=14.72µs  max=2.38s p(90)=215.21µs p(95)=22.42ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=461.58ms min=3.17ms  med=431.25ms max=2.55s p(90)=856.25ms p(95)=1.01s  
     http_reqs......................: 5504    177.519485/s
     iteration_duration.............: avg=1.64s    min=21.36ms med=1.37s    max=7.81s p(90)=3.43s    p(95)=4.19s  
     iterations.....................: 5484    176.874429/s
     vus............................: 13      min=13       max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15006      ✗ 0    
     data_received..................: 441 MB  14 MB/s
     data_sent......................: 6.0 MB  193 kB/s
     http_req_blocked...............: avg=1.73ms   min=1.69µs  med=4.37µs   max=948.74ms p(90)=7.32µs   p(95)=1.74ms 
     http_req_connecting............: avg=1.3ms    min=0s      med=0s       max=945.57ms p(90)=0s       p(95)=1.11ms 
     http_req_duration..............: avg=946.69ms min=3.51ms  med=703.9ms  max=5.44s    p(90)=2.27s    p(95)=2.78s  
       { expected_response:true }...: avg=946.69ms min=3.51ms  med=703.9ms  max=5.44s    p(90)=2.27s    p(95)=2.78s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 5022 
     http_req_receiving.............: avg=407.7ms  min=35.61µs med=118.73µs max=4.78s    p(90)=1.57s    p(95)=2.06s  
     http_req_sending...............: avg=19.82ms  min=8.25µs  med=21.82µs  max=3.31s    p(90)=379.72µs p(95)=11.54ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=519.15ms min=3.43ms  med=445.42ms max=2.44s    p(90)=1.04s    p(95)=1.37s  
     http_reqs......................: 5022    162.649223/s
     iteration_duration.............: avg=1.81s    min=20.24ms med=1.51s    max=7.88s    p(90)=3.8s     p(95)=4.48s  
     iterations.....................: 5002    162.001476/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 14454      ✗ 0    
     data_received..................: 425 MB  14 MB/s
     data_sent......................: 5.7 MB  186 kB/s
     http_req_blocked...............: avg=1.72ms   min=1.53µs  med=3.51µs   max=1.24s p(90)=6.05µs   p(95)=2.42ms
     http_req_connecting............: avg=1.56ms   min=0s      med=0s       max=1.24s p(90)=0s       p(95)=2.01ms
     http_req_duration..............: avg=989.17ms min=6.46ms  med=590.27ms max=6.46s p(90)=2.62s    p(95)=3.15s 
       { expected_response:true }...: avg=989.17ms min=6.46ms  med=590.27ms max=6.46s p(90)=2.62s    p(95)=3.15s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 4838 
     http_req_receiving.............: avg=512.24ms min=33.63µs med=97.46µs  max=6.34s p(90)=2.06s    p(95)=2.6s  
     http_req_sending...............: avg=17.72ms  min=8.55µs  med=16.78µs  max=3s    p(90)=189.53µs p(95)=4.45ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s    
     http_req_waiting...............: avg=459.2ms  min=6.37ms  med=400.51ms max=1.89s p(90)=869.13ms p(95)=1.03s 
     http_reqs......................: 4838    156.771112/s
     iteration_duration.............: avg=1.89s    min=22.68ms med=1.38s    max=9.78s p(90)=4.26s    p(95)=5.17s 
     iterations.....................: 4818    156.12303/s
     vus............................: 298     min=298      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8562      ✗ 0    
     data_received..................: 252 MB  7.5 MB/s
     data_sent......................: 3.4 MB  102 kB/s
     http_req_blocked...............: avg=705.36µs min=1.52µs   med=3.8µs    max=17.91ms p(90)=191.36µs p(95)=6.1ms   
     http_req_connecting............: avg=678.16µs min=0s       med=0s       max=17.88ms p(90)=120.43µs p(95)=5.79ms  
     http_req_duration..............: avg=3.28s    min=11.49ms  med=1.42s    max=33.05s  p(90)=2.07s    p(95)=27.15s  
       { expected_response:true }...: avg=3.28s    min=11.49ms  med=1.42s    max=33.05s  p(90)=2.07s    p(95)=27.15s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2874 
     http_req_receiving.............: avg=387.6µs  min=45.13µs  med=110.57µs max=67.17ms p(90)=225.22µs p(95)=393.39µs
     http_req_sending...............: avg=260.72µs min=9.18µs   med=19.27µs  max=24.85ms p(90)=142.24µs p(95)=2.57ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.28s    min=11.4ms   med=1.42s    max=33.05s  p(90)=2.07s    p(95)=27.15s  
     http_reqs......................: 2874    85.858656/s
     iteration_duration.............: avg=3.32s    min=375.56ms med=1.44s    max=33.06s  p(90)=2.09s    p(95)=27.45s  
     iterations.....................: 2854    85.261171/s
     vus............................: 51      min=51      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8013      ✗ 0    
     data_received..................: 236 MB  7.1 MB/s
     data_sent......................: 3.2 MB  96 kB/s
     http_req_blocked...............: avg=586.69µs min=1.58µs   med=3.34µs   max=13.17ms  p(90)=211.99µs p(95)=5.33ms  
     http_req_connecting............: avg=571.45µs min=0s       med=0s       max=13.14ms  p(90)=155.63µs p(95)=5.22ms  
     http_req_duration..............: avg=3.48s    min=11.67ms  med=1.4s     max=33.05s   p(90)=2.02s    p(95)=31.43s  
       { expected_response:true }...: avg=3.48s    min=11.67ms  med=1.4s     max=33.05s   p(90)=2.02s    p(95)=31.43s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2691 
     http_req_receiving.............: avg=242.12µs min=42.62µs  med=101.46µs max=108.69ms p(90)=193.23µs p(95)=292.7µs 
     http_req_sending...............: avg=119.44µs min=8.83µs   med=16.9µs   max=25.23ms  p(90)=143.76µs p(95)=663.92µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.48s    min=11.53ms  med=1.4s     max=33.05s   p(90)=2.02s    p(95)=31.43s  
     http_reqs......................: 2691    80.468011/s
     iteration_duration.............: avg=3.52s    min=330.98ms med=1.42s    max=33.06s   p(90)=2.07s    p(95)=31.48s  
     iterations.....................: 2671    79.869958/s
     vus............................: 38      min=38      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7509      ✗ 0    
     data_received..................: 222 MB  6.9 MB/s
     data_sent......................: 3.0 MB  93 kB/s
     http_req_blocked...............: avg=3.72ms   min=1.66µs   med=3.66µs  max=77.92ms p(90)=1.82ms   p(95)=34.3ms 
     http_req_connecting............: avg=3.61ms   min=0s       med=0s      max=73.11ms p(90)=1.27ms   p(95)=33.69ms
     http_req_duration..............: avg=3.66s    min=13.25ms  med=3.65s   max=7.45s   p(90)=4.34s    p(95)=4.75s  
       { expected_response:true }...: avg=3.66s    min=13.25ms  med=3.65s   max=7.45s   p(90)=4.34s    p(95)=4.75s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2523 
     http_req_receiving.............: avg=14.52ms  min=38.26µs  med=98.75µs max=1.2s    p(90)=339.91µs p(95)=1.97ms 
     http_req_sending...............: avg=947.79µs min=9.26µs   med=19.54µs max=41.36ms p(90)=888.61µs p(95)=8.73ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s      max=0s      p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=3.64s    min=13.17ms  med=3.64s   max=7.45s   p(90)=4.33s    p(95)=4.75s  
     http_reqs......................: 2523    78.248048/s
     iteration_duration.............: avg=3.72s    min=491.25ms med=3.68s   max=7.47s   p(90)=4.36s    p(95)=4.77s  
     iterations.....................: 2503    77.62777/s
     vus............................: 94      min=94      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7740      ✗ 0    
     data_received..................: 228 MB  6.8 MB/s
     data_sent......................: 3.1 MB  92 kB/s
     http_req_blocked...............: avg=1.9ms    min=1.51µs  med=3.13µs   max=56.01ms p(90)=2.08ms   p(95)=18.9ms  
     http_req_connecting............: avg=1.82ms   min=0s      med=0s       max=43.14ms p(90)=1.37ms   p(95)=18.69ms 
     http_req_duration..............: avg=3.69s    min=14.9ms  med=3.4s     max=8.25s   p(90)=5.2s     p(95)=5.6s    
       { expected_response:true }...: avg=3.69s    min=14.9ms  med=3.4s     max=8.25s   p(90)=5.2s     p(95)=5.6s    
     http_req_failed................: 0.00%   ✓ 0         ✗ 2600 
     http_req_receiving.............: avg=91.22ms  min=43.35µs med=254.31µs max=2.25s   p(90)=5.78ms   p(95)=971.45ms
     http_req_sending...............: avg=353.16µs min=8.78µs  med=15.29µs  max=41.65ms p(90)=192.08µs p(95)=1.81ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.6s     min=14.64ms med=3.37s    max=7.86s   p(90)=5.06s    p(95)=5.55s   
     http_reqs......................: 2600    77.087923/s
     iteration_duration.............: avg=3.74s    min=79.33ms med=3.41s    max=8.26s   p(90)=5.24s    p(95)=5.61s   
     iterations.....................: 2580    76.494939/s
     vus............................: 105     min=105     max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Jul 2, 2025

Overview for: federation/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 176 5570 total, 0 failed avg: 1422ms, p95: 3480ms
apollo-router 158 4975 total, 12 failed avg: 1586ms, p95: 4023ms ❌ 12 failed requests, 12 non-200 responses, 12 unexpected GraphQL errors
grafbase 153 4827 total, 0 failed avg: 1472ms, p95: 3592ms
apollo-server 84 2998 total, 0 failed avg: 5376ms, p95: 33256ms
hive-gateway 79 2861 total, 0 failed avg: 5684ms, p95: 33723ms
hive-gateway-bun 78 2714 total, 0 failed avg: 5820ms, p95: 9187ms
mercurius 75 2485 total, 0 failed avg: 6275ms, p95: 10955ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 16650      ✗ 0    
     data_received..................: 489 MB  16 MB/s
     data_sent......................: 6.6 MB  210 kB/s
     http_req_blocked...............: avg=4.3ms    min=1.61µs  med=3.49µs   max=2.32s  p(90)=14.4µs p(95)=31.61ms
     http_req_connecting............: avg=3.12ms   min=0s      med=0s       max=1.41s  p(90)=0s     p(95)=30.87ms
     http_req_duration..............: avg=1.42s    min=3.74ms  med=1.13s    max=5.55s  p(90)=3.02s  p(95)=3.48s  
       { expected_response:true }...: avg=1.42s    min=3.74ms  med=1.13s    max=5.55s  p(90)=3.02s  p(95)=3.48s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 5570 
     http_req_receiving.............: avg=510.14ms min=30.36µs med=94.24µs  max=5.06s  p(90)=1.93s  p(95)=2.51s  
     http_req_sending...............: avg=21.72ms  min=8.42µs  med=16.15µs  max=4.51s  p(90)=1.03ms p(95)=8.04ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s     p(95)=0s     
     http_req_waiting...............: avg=890.08ms min=3.58ms  med=868.44ms max=3.71s  p(90)=1.54s  p(95)=1.68s  
     http_reqs......................: 5570    176.746331/s
     iteration_duration.............: avg=2.73s    min=27.83ms med=2.31s    max=12.13s p(90)=5.23s  p(95)=6.1s   
     iterations.....................: 5550    176.111694/s
     vus............................: 218     min=218      max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✗ response code was 200
      ↳  99% — ✓ 4943 / ✗ 12
     ✗ no graphql errors
      ↳  99% — ✓ 4943 / ✗ 12
     ✓ valid response structure

     █ setup

     checks.........................: 99.83% ✓ 14829      ✗ 24   
     data_received..................: 436 MB 14 MB/s
     data_sent......................: 5.9 MB 188 kB/s
     http_req_blocked...............: avg=14.98ms  min=1.43µs med=3.78µs   max=4.28s  p(90)=858.06µs p(95)=30.86ms
     http_req_connecting............: avg=14.1ms   min=0s     med=0s       max=4.28s  p(90)=449.95µs p(95)=30.49ms
     http_req_duration..............: avg=1.58s    min=7.03ms med=1.23s    max=8.63s  p(90)=3.42s    p(95)=4.02s  
       { expected_response:true }...: avg=1.58s    min=7.03ms med=1.23s    max=8.63s  p(90)=3.42s    p(95)=4.03s  
     http_req_failed................: 0.24%  ✓ 12         ✗ 4963 
     http_req_receiving.............: avg=690.94ms min=0s     med=420.25µs max=7.4s   p(90)=2.42s    p(95)=3.05s  
     http_req_sending...............: avg=36.2ms   min=7.25µs med=19.46µs  max=4.16s  p(90)=4.2ms    p(95)=15.76ms
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s       max=0s     p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=859.16ms min=6.89ms med=804.89ms max=2.73s  p(90)=1.53s    p(95)=1.86s  
     http_reqs......................: 4975   158.633302/s
     iteration_duration.............: avg=3.07s    min=43.1ms med=2.58s    max=15.47s p(90)=6.18s    p(95)=7.42s  
     iterations.....................: 4955   157.995581/s
     vus............................: 198    min=198      max=500
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 14421      ✗ 0    
     data_received..................: 424 MB  13 MB/s
     data_sent......................: 5.7 MB  182 kB/s
     http_req_blocked...............: avg=5.06ms   min=1.79µs  med=5.06µs   max=1.98s  p(90)=123.4µs p(95)=32.81ms
     http_req_connecting............: avg=4.21ms   min=0s      med=0s       max=1.62s  p(90)=78.01µs p(95)=25.86ms
     http_req_duration..............: avg=1.47s    min=3.7ms   med=1.32s    max=10.96s p(90)=2.73s   p(95)=3.59s  
       { expected_response:true }...: avg=1.47s    min=3.7ms   med=1.32s    max=10.96s p(90)=2.73s   p(95)=3.59s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 4827 
     http_req_receiving.............: avg=454.43ms min=35.25µs med=126.3µs  max=9.2s   p(90)=1.61s   p(95)=2.13s  
     http_req_sending...............: avg=24.72ms  min=7.96µs  med=27.88µs  max=4.43s  p(90)=13.3ms  p(95)=41.71ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s      p(95)=0s     
     http_req_waiting...............: avg=992.58ms min=3.52ms  med=971.18ms max=2.97s  p(90)=1.81s   p(95)=2.06s  
     http_reqs......................: 4827    153.044859/s
     iteration_duration.............: avg=3.18s    min=33.31ms med=2.84s    max=15.14s p(90)=5.8s    p(95)=7.09s  
     iterations.....................: 4807    152.410739/s
     vus............................: 269     min=269      max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8934      ✗ 0    
     data_received..................: 263 MB  7.5 MB/s
     data_sent......................: 3.6 MB  101 kB/s
     http_req_blocked...............: avg=2.27ms   min=1.78µs   med=4.34µs   max=36.38ms  p(90)=10.45ms p(95)=19.67ms
     http_req_connecting............: avg=2.23ms   min=0s       med=0s       max=27.2ms   p(90)=10.29ms p(95)=19.48ms
     http_req_duration..............: avg=5.37s    min=11.82ms  med=1.62s    max=34.89s   p(90)=31.71s  p(95)=33.25s 
       { expected_response:true }...: avg=5.37s    min=11.82ms  med=1.62s    max=34.89s   p(90)=31.71s  p(95)=33.25s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 2998 
     http_req_receiving.............: avg=444.87µs min=43.06µs  med=110.79µs max=119.78ms p(90)=240.5µs p(95)=415.3µs
     http_req_sending...............: avg=355.26µs min=9.19µs   med=23.82µs  max=43.25ms  p(90)=771.1µs p(95)=2.04ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s      p(95)=0s     
     http_req_waiting...............: avg=5.37s    min=11.66ms  med=1.62s    max=34.89s   p(90)=31.71s  p(95)=33.25s 
     http_reqs......................: 2998    84.874735/s
     iteration_duration.............: avg=5.43s    min=384.25ms med=1.64s    max=34.91s   p(90)=31.74s  p(95)=33.27s 
     iterations.....................: 2978    84.308526/s
     vus............................: 34      min=34      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8523      ✗ 0    
     data_received..................: 251 MB  7.0 MB/s
     data_sent......................: 3.4 MB  95 kB/s
     http_req_blocked...............: avg=2.94ms   min=1.52µs   med=3.08µs   max=38.49ms p(90)=11.69ms  p(95)=25.68ms 
     http_req_connecting............: avg=2.88ms   min=0s       med=0s       max=34.41ms p(90)=11.37ms  p(95)=25.27ms 
     http_req_duration..............: avg=5.68s    min=12.53ms  med=1.76s    max=35.44s  p(90)=32.07s   p(95)=33.72s  
       { expected_response:true }...: avg=5.68s    min=12.53ms  med=1.76s    max=35.44s  p(90)=32.07s   p(95)=33.72s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2861 
     http_req_receiving.............: avg=490.83µs min=40.47µs  med=104.12µs max=94.36ms p(90)=219.04µs p(95)=407.95µs
     http_req_sending...............: avg=298.34µs min=8.87µs   med=15.06µs  max=30.35ms p(90)=746.37µs p(95)=1.45ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=5.68s    min=12.44ms  med=1.76s    max=35.43s  p(90)=32.07s   p(95)=33.72s  
     http_reqs......................: 2861    79.720238/s
     iteration_duration.............: avg=5.74s    min=255.64ms med=1.78s    max=35.45s  p(90)=32.12s   p(95)=33.75s  
     iterations.....................: 2841    79.162948/s
     vus............................: 86      min=86      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8082      ✗ 0    
     data_received..................: 238 MB  6.9 MB/s
     data_sent......................: 3.2 MB  94 kB/s
     http_req_blocked...............: avg=7.16ms   min=1.36µs   med=3.03µs   max=156.61ms p(90)=25.92ms p(95)=63.04ms
     http_req_connecting............: avg=6.82ms   min=0s       med=0s       max=156.59ms p(90)=23.91ms p(95)=62.41ms
     http_req_duration..............: avg=5.82s    min=17.69ms  med=5.78s    max=12.3s    p(90)=8.66s   p(95)=9.18s  
       { expected_response:true }...: avg=5.82s    min=17.69ms  med=5.78s    max=12.3s    p(90)=8.66s   p(95)=9.18s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2714 
     http_req_receiving.............: avg=159.84ms min=36.69µs  med=257.47µs max=3.42s    p(90)=17.66ms p(95)=1.71s  
     http_req_sending...............: avg=2.6ms    min=8.46µs   med=15.19µs  max=96.61ms  p(90)=11.3ms  p(95)=22.35ms
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s      p(95)=0s     
     http_req_waiting...............: avg=5.65s    min=17.6ms   med=5.66s    max=12.3s    p(90)=8.56s   p(95)=9.18s  
     http_reqs......................: 2714    78.909125/s
     iteration_duration.............: avg=5.88s    min=600.56ms med=5.8s     max=12.31s   p(90)=8.7s    p(95)=9.19s  
     iterations.....................: 2694    78.327628/s
     vus............................: 80      min=80      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7395      ✗ 0    
     data_received..................: 218 MB  6.6 MB/s
     data_sent......................: 2.9 MB  89 kB/s
     http_req_blocked...............: avg=4.92ms min=1.56µs   med=4.03µs   max=96.13ms  p(90)=22.17ms  p(95)=30.3ms 
     http_req_connecting............: avg=4.82ms min=0s       med=0s       max=77.02ms  p(90)=22.03ms  p(95)=30.21ms
     http_req_duration..............: avg=6.27s  min=10.61ms  med=6.23s    max=12.92s   p(90)=8.3s     p(95)=10.95s 
       { expected_response:true }...: avg=6.27s  min=10.61ms  med=6.23s    max=12.92s   p(90)=8.3s     p(95)=10.95s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 2485 
     http_req_receiving.............: avg=9.69ms min=39.71µs  med=103.48µs max=838.77ms p(90)=412.17µs p(95)=3.09ms 
     http_req_sending...............: avg=1.32ms min=9.55µs   med=23.76µs  max=54.89ms  p(90)=1.24ms   p(95)=8.67ms 
     http_req_tls_handshaking.......: avg=0s     min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=6.26s  min=10.54ms  med=6.23s    max=12.92s   p(90)=8.3s     p(95)=10.93s 
     http_reqs......................: 2485    75.136711/s
     iteration_duration.............: avg=6.39s  min=500.86ms med=6.25s    max=12.94s   p(90)=8.32s    p(95)=11.04s 
     iterations.....................: 2465    74.531989/s
     vus............................: 90      min=90      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Jul 2, 2025

Overview for: federation/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 2000 concurrent VUs over 60s

Comparison

Comparison

Gateway duration(p95)⬇️ RPS Requests Durations Notes
apollo-router 5193ms 163 11471 total, 655 failed avg: 2542ms, p95: 5194ms, max: 12444ms, med: 2409ms ❌ 655 failed requests, 655 non-200 responses, 655 unexpected GraphQL errors
cosmo 5515ms 173 12196 total, 0 failed avg: 2342ms, p95: 5516ms, max: 10181ms, med: 1980ms
grafbase 7952ms 163 11484 total, 0 failed avg: 2772ms, p95: 7952ms, max: 12997ms, med: 2080ms
hive-gateway-bun 35831ms 77 6803 total, 0 failed avg: 14018ms, p95: 35832ms, max: 42615ms, med: 11717ms
mercurius 43639ms 52 4862 total, 0 failed avg: 21771ms, p95: 43640ms, max: 44622ms, med: 18894ms
apollo-server 59999ms 82 7686 total, 485 failed avg: 11834ms, p95: 60000ms, max: 60078ms, med: 2225ms ❌ 485 failed requests, 485 non-200 responses, 485 unexpected GraphQL errors
hive-gateway 60000ms 77 7226 total, 644 failed avg: 12908ms, p95: 60000ms, max: 60152ms, med: 2035ms ❌ 644 failed requests, 644 non-200 responses, 643 unexpected GraphQL errors
Summary for: `apollo-router`

K6 Output

     ✗ response code was 200
      ↳  94% — ✓ 10796 / ✗ 655
     ✗ no graphql errors
      ↳  94% — ✓ 10796 / ✗ 655
     ✓ valid response structure

     █ setup

     checks.........................: 96.11% ✓ 32388      ✗ 1310  
     data_received..................: 949 MB 14 MB/s
     data_sent......................: 14 MB  194 kB/s
     http_req_blocked...............: avg=541.43ms min=1.46µs  med=4.36µs  max=12.31s p(90)=2.37s    p(95)=3.4s    
     http_req_connecting............: avg=530.52ms min=0s      med=0s      max=11.71s p(90)=2.36s    p(95)=3.39s   
     http_req_duration..............: avg=2.54s    min=6.73ms  med=2.4s    max=12.44s p(90)=4.47s    p(95)=5.19s   
       { expected_response:true }...: avg=2.52s    min=6.73ms  med=2.38s   max=12.44s p(90)=4.45s    p(95)=5.15s   
     http_req_failed................: 5.71%  ✓ 655        ✗ 10816 
     http_req_receiving.............: avg=216.58ms min=0s      med=86.01µs max=7.21s  p(90)=754.21ms p(95)=1.62s   
     http_req_sending...............: avg=145.58ms min=8.43µs  med=23.84µs max=10.09s p(90)=437.07ms p(95)=855.56ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=2.17s    min=6.65ms  med=2.11s   max=11.64s p(90)=4.07s    p(95)=4.45s   
     http_reqs......................: 11471  163.50447/s
     iteration_duration.............: avg=6.1s     min=12.51ms med=5.65s   max=27.13s p(90)=11.84s   p(95)=14.07s  
     iterations.....................: 11451  163.219395/s
     vus............................: 5      min=5        max=1978
     vus_max........................: 2000   min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 36528      ✗ 0     
     data_received..................: 1.1 GB  15 MB/s
     data_sent......................: 15 MB   206 kB/s
     http_req_blocked...............: avg=245.79ms min=1.43µs med=4.04µs  max=8.17s  p(90)=905.88ms p(95)=1.67s   
     http_req_connecting............: avg=240.94ms min=0s     med=0s      max=8.17s  p(90)=895.52ms p(95)=1.66s   
     http_req_duration..............: avg=2.34s    min=3.24ms med=1.98s   max=10.18s p(90)=5.02s    p(95)=5.51s   
       { expected_response:true }...: avg=2.34s    min=3.24ms med=1.98s   max=10.18s p(90)=5.02s    p(95)=5.51s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 12196 
     http_req_receiving.............: avg=196.07ms min=32.5µs med=85.59µs max=7.75s  p(90)=812.71ms p(95)=1.71s   
     http_req_sending...............: avg=121.91ms min=8.31µs med=20.62µs max=5.94s  p(90)=320.1ms  p(95)=865.52ms
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s      max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=2.02s    min=3.15ms med=1.6s    max=7.97s  p(90)=4.79s    p(95)=5.37s   
     http_reqs......................: 12196   173.865497/s
     iteration_duration.............: avg=5.82s    min=9.07ms med=5.2s    max=23.88s p(90)=11.52s   p(95)=13.88s  
     iterations.....................: 12176   173.580378/s
     vus............................: 5       min=5        max=1955
     vus_max........................: 2000    min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 34392      ✗ 0     
     data_received..................: 1.0 GB  14 MB/s
     data_sent......................: 14 MB   194 kB/s
     http_req_blocked...............: avg=249.74ms min=1.45µs  med=4.14µs  max=11.29s p(90)=523.23ms p(95)=1.47s   
     http_req_connecting............: avg=244.92ms min=0s      med=0s      max=11.29s p(90)=513.86ms p(95)=1.44s   
     http_req_duration..............: avg=2.77s    min=3.34ms  med=2.07s   max=12.99s p(90)=5.88s    p(95)=7.95s   
       { expected_response:true }...: avg=2.77s    min=3.34ms  med=2.07s   max=12.99s p(90)=5.88s    p(95)=7.95s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 11484 
     http_req_receiving.............: avg=612.8ms  min=32.66µs med=89.81µs max=11.06s p(90)=2.14s    p(95)=4.88s   
     http_req_sending...............: avg=158.05ms min=7.55µs  med=21.05µs max=10.09s p(90)=167.65ms p(95)=742.69ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=2s       min=3.21ms  med=1.29s   max=12.85s p(90)=4.95s    p(95)=5.42s   
     http_reqs......................: 11484   163.529816/s
     iteration_duration.............: avg=6.41s    min=24.59ms med=5.22s   max=32.76s p(90)=14.09s   p(95)=16.72s  
     iterations.....................: 11464   163.24502/s
     vus............................: 146     min=70       max=1955
     vus_max........................: 2000    min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 20349     ✗ 0     
     data_received..................: 597 MB  6.8 MB/s
     data_sent......................: 8.1 MB  92 kB/s
     http_req_blocked...............: avg=1.71ms   min=1.48µs   med=3.62µs   max=130.03ms p(90)=427.26µs p(95)=2.37ms  
     http_req_connecting............: avg=1.64ms   min=0s       med=0s       max=124.91ms p(90)=352.95µs p(95)=2.14ms  
     http_req_duration..............: avg=14.01s   min=15.47ms  med=11.71s   max=42.61s   p(90)=32.21s   p(95)=35.83s  
       { expected_response:true }...: avg=14.01s   min=15.47ms  med=11.71s   max=42.61s   p(90)=32.21s   p(95)=35.83s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 6803  
     http_req_receiving.............: avg=236.71ms min=39.28µs  med=273.71µs max=13.63s   p(90)=2.41ms   p(95)=1.92s   
     http_req_sending...............: avg=819.27µs min=8.8µs    med=19.99µs  max=121.64ms p(90)=91.65µs  p(95)=675.67µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=13.78s   min=15.29ms  med=11.67s   max=42.61s   p(90)=32.21s   p(95)=35.83s  
     http_reqs......................: 6803    77.78179/s
     iteration_duration.............: avg=14.08s   min=201.75ms med=11.73s   max=42.62s   p(90)=32.26s   p(95)=35.85s  
     iterations.....................: 6783    77.553121/s
     vus............................: 104     min=61      max=2000
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 14494     ✗ 0     
     data_received..................: 427 MB  4.6 MB/s
     data_sent......................: 6.0 MB  65 kB/s
     http_req_blocked...............: avg=211.17µs min=1.6µs    med=4.29µs   max=38.52ms p(90)=511.8µs  p(95)=674.47µs
     http_req_connecting............: avg=176.38µs min=0s       med=0s       max=38.44ms p(90)=432.86µs p(95)=574.75µs
     http_req_duration..............: avg=21.77s   min=10.64ms  med=18.89s   max=44.62s  p(90)=42.66s   p(95)=43.63s  
       { expected_response:true }...: avg=21.77s   min=10.64ms  med=18.89s   max=44.62s  p(90)=42.66s   p(95)=43.63s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 4862  
     http_req_receiving.............: avg=11.51ms  min=40.46µs  med=105.93µs max=1.02s   p(90)=448.28µs p(95)=1.58ms  
     http_req_sending...............: avg=58.35µs  min=9.27µs   med=26.87µs  max=12.77ms p(90)=68.49µs  p(95)=86.55µs 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=21.75s   min=10.54ms  med=18.89s   max=44.25s  p(90)=42.6s    p(95)=43.54s  
     http_reqs......................: 4862    52.411252/s
     iteration_duration.............: avg=21.92s   min=155.14ms med=18.8s    max=45.27s  p(90)=43.19s   p(95)=43.79s  
     iterations.....................: 4810    51.850704/s
     vus............................: 1       min=1       max=2000
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✗ response code was 200
      ↳  93% — ✓ 7181 / ✗ 485
     ✗ no graphql errors
      ↳  93% — ✓ 7181 / ✗ 485
     ✓ valid response structure

     █ setup

     checks.........................: 95.69% ✓ 21543     ✗ 970   
     data_received..................: 633 MB 6.8 MB/s
     data_sent......................: 9.2 MB 99 kB/s
     http_req_blocked...............: avg=558.67µs min=1.66µs  med=4.61µs   max=117.03ms p(90)=390.6µs  p(95)=711.94µs
     http_req_connecting............: avg=526.45µs min=0s      med=0s       max=116.88ms p(90)=309.67µs p(95)=575.08µs
     http_req_duration..............: avg=11.83s   min=11.88ms med=2.22s    max=1m0s     p(90)=53.88s   p(95)=59.99s  
       { expected_response:true }...: avg=8.63s    min=11.88ms med=2.14s    max=59.97s   p(90)=37.23s   p(95)=50.48s  
     http_req_failed................: 6.31%  ✓ 485       ✗ 7201  
     http_req_receiving.............: avg=251.57µs min=0s      med=110.55µs max=113.31ms p(90)=234.08µs p(95)=345.24µs
     http_req_sending...............: avg=217.11µs min=9.17µs  med=25.57µs  max=45.11ms  p(90)=72.56µs  p(95)=134.28µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=11.83s   min=11.67ms med=2.22s    max=1m0s     p(90)=53.88s   p(95)=59.99s  
     http_reqs......................: 7686   82.858456/s
     iteration_duration.............: avg=11.87s   min=62.08ms med=2.24s    max=1m0s     p(90)=54.33s   p(95)=1m0s    
     iterations.....................: 7666   82.642847/s
     vus............................: 23     min=23      max=1999
     vus_max........................: 2000   min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✗ response code was 200
      ↳  91% — ✓ 6562 / ✗ 644
     ✗ no graphql errors
      ↳  91% — ✓ 6562 / ✗ 643
     ✓ valid response structure

     █ setup

     checks.........................: 93.86% ✓ 19686     ✗ 1287  
     data_received..................: 578 MB 6.2 MB/s
     data_sent......................: 8.7 MB 93 kB/s
     http_req_blocked...............: avg=273.2µs  min=1.43µs  med=3.9µs    max=46.75ms  p(90)=323.46µs p(95)=470.66µs
     http_req_connecting............: avg=249µs    min=0s      med=0s       max=46.67ms  p(90)=246.94µs p(95)=387.27µs
     http_req_duration..............: avg=12.9s    min=15.57ms med=2.03s    max=1m0s     p(90)=58.59s   p(95)=1m0s    
       { expected_response:true }...: avg=8.3s     min=15.57ms med=1.94s    max=59.97s   p(90)=37.39s   p(95)=42.05s  
     http_req_failed................: 8.91%  ✓ 644       ✗ 6582  
     http_req_receiving.............: avg=257.77µs min=0s      med=110.39µs max=238.78ms p(90)=191.64µs p(95)=268.11µs
     http_req_sending...............: avg=104.36µs min=8.9µs   med=19.84µs  max=40.5ms   p(90)=60.67µs  p(95)=84.85µs 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=12.9s    min=15.37ms med=2.03s    max=1m0s     p(90)=58.59s   p(95)=1m0s    
     http_reqs......................: 7226   77.826108/s
     iteration_duration.............: avg=12.94s   min=72.42ms med=2.05s    max=1m0s     p(90)=58.61s   p(95)=1m0s    
     iterations.....................: 7205   77.599932/s
     vus............................: 34     min=34      max=2000
     vus_max........................: 2000   min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

@enisdenjo enisdenjo marked this pull request as draft July 2, 2025 16:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant