Skip to content

Try incoming alpha #696

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 1 commit into
base: main
Choose a base branch
from
Draft

Try incoming alpha #696

wants to merge 1 commit into from

Conversation

ardatan
Copy link
Member

@ardatan ardatan commented May 20, 2025

No description provided.

Copy link

github-actions bot commented May 20, 2025

Overview for: federation/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 300 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 180 5596 total, 0 failed avg: 812ms, p95: 2188ms
grafbase 168 5207 total, 0 failed avg: 811ms, p95: 2380ms
apollo-router 156 4849 total, 0 failed avg: 885ms, p95: 2732ms
hive-gateway 91 3036 total, 0 failed avg: 3062ms, p95: 14839ms
hive-gateway-bun 91 3015 total, 0 failed avg: 3048ms, p95: 5132ms
apollo-server 89 2948 total, 0 failed avg: 3171ms, p95: 24098ms
mercurius 75 2425 total, 0 failed avg: 3802ms, p95: 5936ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 16728      ✗ 0    
     data_received..................: 491 MB  16 MB/s
     data_sent......................: 6.6 MB  214 kB/s
     http_req_blocked...............: avg=993.93µs min=1.47µs  med=3.1µs    max=1.41s p(90)=5.1µs    p(95)=346.92µs
     http_req_connecting............: avg=805.67µs min=0s      med=0s       max=1.41s p(90)=0s       p(95)=244.08µs
     http_req_duration..............: avg=811.91ms min=3.15ms  med=623.59ms max=5.92s p(90)=1.77s    p(95)=2.18s   
       { expected_response:true }...: avg=811.91ms min=3.15ms  med=623.59ms max=5.92s p(90)=1.77s    p(95)=2.18s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5596 
     http_req_receiving.............: avg=350.07ms min=33.39µs med=115.8µs  max=5.32s p(90)=1.16s    p(95)=1.75s   
     http_req_sending...............: avg=13.94ms  min=8.01µs  med=14.22µs  max=3.27s p(90)=148.63µs p(95)=2.97ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=447.89ms min=3.06ms  med=418.87ms max=1.97s p(90)=804.13ms p(95)=911.5ms 
     http_reqs......................: 5596    180.302968/s
     iteration_duration.............: avg=1.63s    min=23.77ms med=1.32s    max=9.48s p(90)=3.45s    p(95)=4.15s   
     iterations.....................: 5576    179.658569/s
     vus............................: 59      min=59       max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15561      ✗ 0    
     data_received..................: 458 MB  15 MB/s
     data_sent......................: 6.2 MB  200 kB/s
     http_req_blocked...............: avg=1.76ms   min=1.49µs  med=3.35µs   max=645.27ms p(90)=5.56µs   p(95)=9.31ms 
     http_req_connecting............: avg=1.47ms   min=0s      med=0s       max=256.16ms p(90)=0s       p(95)=7.76ms 
     http_req_duration..............: avg=810.51ms min=3.22ms  med=604.44ms max=5.65s    p(90)=1.8s     p(95)=2.38s  
       { expected_response:true }...: avg=810.51ms min=3.22ms  med=604.44ms max=5.65s    p(90)=1.8s     p(95)=2.38s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 5207 
     http_req_receiving.............: avg=290.89ms min=33.44µs med=88.58µs  max=5.61s    p(90)=1.18s    p(95)=1.7s   
     http_req_sending...............: avg=19.98ms  min=7.46µs  med=15.37µs  max=2.74s    p(90)=332.48µs p(95)=17.96ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=499.63ms min=3.15ms  med=413.12ms max=2.9s     p(90)=971.92ms p(95)=1.09s  
     http_reqs......................: 5207    168.500867/s
     iteration_duration.............: avg=1.73s    min=19.79ms med=1.35s    max=8.83s    p(90)=3.69s    p(95)=4.7s   
     iterations.....................: 5187    167.853658/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 14487      ✗ 0    
     data_received..................: 426 MB  14 MB/s
     data_sent......................: 5.8 MB  186 kB/s
     http_req_blocked...............: avg=2.31ms   min=1.84µs  med=3.96µs   max=1.31s  p(90)=8.07µs   p(95)=4.01ms 
     http_req_connecting............: avg=1.98ms   min=0s      med=0s       max=1.31s  p(90)=0s       p(95)=3.44ms 
     http_req_duration..............: avg=885.34ms min=7.43ms  med=594.56ms max=6.05s  p(90)=2.27s    p(95)=2.73s  
       { expected_response:true }...: avg=885.34ms min=7.43ms  med=594.56ms max=6.05s  p(90)=2.27s    p(95)=2.73s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 4849 
     http_req_receiving.............: avg=434.5ms  min=33.06µs med=111.69µs max=5.78s  p(90)=1.83s    p(95)=2.16s  
     http_req_sending...............: avg=16.65ms  min=7.53µs  med=19.61µs  max=3.38s  p(90)=1.25ms   p(95)=21.51ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=434.19ms min=7.3ms   med=368.9ms  max=2.17s  p(90)=909.61ms p(95)=1.02s  
     http_reqs......................: 4849    156.74294/s
     iteration_duration.............: avg=1.87s    min=25.33ms med=1.49s    max=12.26s p(90)=4.27s    p(95)=5.16s  
     iterations.....................: 4829    156.096444/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 9048      ✗ 0    
     data_received..................: 267 MB  8.1 MB/s
     data_sent......................: 3.6 MB  109 kB/s
     http_req_blocked...............: avg=638.18µs min=2.01µs  med=4.31µs   max=18.23ms  p(90)=105.25µs p(95)=5.48ms
     http_req_connecting............: avg=613.19µs min=0s      med=0s       max=18.18ms  p(90)=0s       p(95)=5.33ms
     http_req_duration..............: avg=3.06s    min=13.02ms med=1.66s    max=32.58s   p(90)=2.96s    p(95)=14.83s
       { expected_response:true }...: avg=3.06s    min=13.02ms med=1.66s    max=32.58s   p(90)=2.96s    p(95)=14.83s
     http_req_failed................: 0.00%   ✓ 0         ✗ 3036 
     http_req_receiving.............: avg=1.19ms   min=43.59µs med=100.26µs max=124.08ms p(90)=605.97µs p(95)=2.39ms
     http_req_sending...............: avg=440.38µs min=9.79µs  med=23.77µs  max=96.26ms  p(90)=203.16µs p(95)=1.52ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s    
     http_req_waiting...............: avg=3.05s    min=12.91ms med=1.66s    max=32.58s   p(90)=2.96s    p(95)=14.83s
     http_reqs......................: 3036    91.902979/s
     iteration_duration.............: avg=3.12s    min=83.2ms  med=1.7s     max=32.59s   p(90)=3.03s    p(95)=14.97s
     iterations.....................: 3016    91.297557/s
     vus............................: 8       min=8       max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8985      ✗ 0    
     data_received..................: 265 MB  8.0 MB/s
     data_sent......................: 3.6 MB  108 kB/s
     http_req_blocked...............: avg=531.28µs min=1.89µs   med=3.72µs   max=33.03ms  p(90)=114.1µs  p(95)=4.71ms  
     http_req_connecting............: avg=493.6µs  min=0s       med=0s       max=13.32ms  p(90)=0s       p(95)=4.49ms  
     http_req_duration..............: avg=3.04s    min=14.67ms  med=2.83s    max=7.18s    p(90)=4.52s    p(95)=5.13s   
       { expected_response:true }...: avg=3.04s    min=14.67ms  med=2.83s    max=7.18s    p(90)=4.52s    p(95)=5.13s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 3015 
     http_req_receiving.............: avg=65.08ms  min=41.23µs  med=122.95µs max=1.96s    p(90)=106.39ms p(95)=559.69ms
     http_req_sending...............: avg=1.49ms   min=8.75µs   med=19.17µs  max=489.82ms p(90)=244.89µs p(95)=717.29µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=2.98s    min=14.48ms  med=2.8s     max=7.18s    p(90)=4.46s    p(95)=5.1s    
     http_reqs......................: 3015    91.009628/s
     iteration_duration.............: avg=3.17s    min=125.48ms med=2.9s     max=7.2s     p(90)=4.71s    p(95)=5.22s   
     iterations.....................: 2995    90.405916/s
     vus............................: 57      min=57      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8784      ✗ 0    
     data_received..................: 259 MB  7.8 MB/s
     data_sent......................: 3.5 MB  106 kB/s
     http_req_blocked...............: avg=426.31µs min=1.55µs   med=3.28µs   max=28.65ms p(90)=151.5µs  p(95)=4.27ms  
     http_req_connecting............: avg=394.31µs min=0s       med=0s       max=10.69ms p(90)=90.18µs  p(95)=4.12ms  
     http_req_duration..............: avg=3.17s    min=10.36ms  med=1.41s    max=32.68s  p(90)=1.97s    p(95)=24.09s  
       { expected_response:true }...: avg=3.17s    min=10.36ms  med=1.41s    max=32.68s  p(90)=1.97s    p(95)=24.09s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2948 
     http_req_receiving.............: avg=329.11µs min=41.66µs  med=102.23µs max=73.1ms  p(90)=223.77µs p(95)=360.41µs
     http_req_sending...............: avg=151.85µs min=8.47µs   med=17.03µs  max=42.08ms p(90)=122.9µs  p(95)=458.44µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.17s    min=10.25ms  med=1.41s    max=32.68s  p(90)=1.97s    p(95)=24.09s  
     http_reqs......................: 2948    89.086876/s
     iteration_duration.............: avg=3.2s     min=280.16ms med=1.43s    max=32.69s  p(90)=1.99s    p(95)=24.48s  
     iterations.....................: 2928    88.482487/s
     vus............................: 15      min=15      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7215      ✗ 0    
     data_received..................: 213 MB  6.6 MB/s
     data_sent......................: 2.9 MB  90 kB/s
     http_req_blocked...............: avg=561.97µs min=1.71µs   med=3.84µs   max=17.95ms p(90)=509.68µs p(95)=5.68ms  
     http_req_connecting............: avg=459.8µs  min=0s       med=0s       max=11.84ms p(90)=399.94µs p(95)=3.9ms   
     http_req_duration..............: avg=3.8s     min=11.18ms  med=3.84s    max=8.41s   p(90)=4.65s    p(95)=5.93s   
       { expected_response:true }...: avg=3.8s     min=11.18ms  med=3.84s    max=8.41s   p(90)=4.65s    p(95)=5.93s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2425 
     http_req_receiving.............: avg=17.26ms  min=41.99µs  med=105.35µs max=1.15s   p(90)=316.7µs  p(95)=1.75ms  
     http_req_sending...............: avg=195.66µs min=9.54µs   med=21.86µs  max=12.94ms p(90)=212.13µs p(95)=655.01µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.78s    min=11.05ms  med=3.84s    max=8.4s    p(90)=4.65s    p(95)=5.93s   
     http_reqs......................: 2425    75.574944/s
     iteration_duration.............: avg=3.87s    min=420.75ms med=3.87s    max=8.42s   p(90)=4.67s    p(95)=5.98s   
     iterations.....................: 2405    74.951646/s
     vus............................: 49      min=49      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented May 20, 2025

Overview for: federation/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 300 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 179 5504 total, 0 failed avg: 888ms, p95: 2458ms
grafbase 170 5251 total, 0 failed avg: 826ms, p95: 2243ms
apollo-router 155 4834 total, 1 failed avg: 935ms, p95: 2451ms ❌ 1 failed requests, 1 non-200 responses, 1 unexpected GraphQL errors, non-compatible response structure (1)
hive-gateway 92 3060 total, 0 failed avg: 3032ms, p95: 13997ms
apollo-server 87 2911 total, 0 failed avg: 3230ms, p95: 24620ms
hive-gateway-bun 86 2871 total, 0 failed avg: 3226ms, p95: 5245ms
mercurius 76 2439 total, 0 failed avg: 3768ms, p95: 5824ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 16452      ✗ 0    
     data_received..................: 483 MB  16 MB/s
     data_sent......................: 6.5 MB  213 kB/s
     http_req_blocked...............: avg=2.58ms   min=1.49µs  med=3.09µs   max=1.76s  p(90)=5.17µs   p(95)=3.76ms 
     http_req_connecting............: avg=2.35ms   min=0s      med=0s       max=1.76s  p(90)=0s       p(95)=3.48ms 
     http_req_duration..............: avg=888.01ms min=3.26ms  med=675.22ms max=7.67s  p(90)=1.91s    p(95)=2.45s  
       { expected_response:true }...: avg=888.01ms min=3.26ms  med=675.22ms max=7.67s  p(90)=1.91s    p(95)=2.45s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 5504 
     http_req_receiving.............: avg=374.41ms min=36.47µs med=102.19µs max=6.98s  p(90)=1.43s    p(95)=1.96s  
     http_req_sending...............: avg=19.82ms  min=8.6µs   med=14.61µs  max=3.35s  p(90)=1.55ms   p(95)=15.77ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=493.77ms min=3.16ms  med=492.1ms  max=2.22s  p(90)=869.96ms p(95)=998.7ms
     http_reqs......................: 5504    179.099689/s
     iteration_duration.............: avg=1.65s    min=23.71ms med=1.34s    max=12.31s p(90)=3.43s    p(95)=4.24s  
     iterations.....................: 5484    178.44889/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15693      ✗ 0    
     data_received..................: 461 MB  15 MB/s
     data_sent......................: 6.2 MB  202 kB/s
     http_req_blocked...............: avg=1.46ms   min=1.42µs  med=3.24µs   max=1.45s p(90)=5.15µs   p(95)=1.81ms 
     http_req_connecting............: avg=1.36ms   min=0s      med=0s       max=1.45s p(90)=0s       p(95)=1.54ms 
     http_req_duration..............: avg=826.18ms min=3.06ms  med=641.55ms max=6.17s p(90)=1.75s    p(95)=2.24s  
       { expected_response:true }...: avg=826.18ms min=3.06ms  med=641.55ms max=6.17s p(90)=1.75s    p(95)=2.24s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 5251 
     http_req_receiving.............: avg=248.59ms min=34.11µs med=79.65µs  max=5.51s p(90)=991.28ms p(95)=1.52s  
     http_req_sending...............: avg=18.39ms  min=7.93µs  med=14.87µs  max=2.9s  p(90)=321.8µs  p(95)=22.36ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=559.19ms min=3.01ms  med=512.14ms max=2.62s p(90)=988.64ms p(95)=1.23s  
     http_reqs......................: 5251    170.349767/s
     iteration_duration.............: avg=1.72s    min=22.67ms med=1.41s    max=10s   p(90)=3.49s    p(95)=4.39s  
     iterations.....................: 5231    169.700939/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✗ response code was 200
      ↳  99% — ✓ 4813 / ✗ 1
     ✗ no graphql errors
      ↳  99% — ✓ 4813 / ✗ 1
     ✗ valid response structure
      ↳  99% — ✓ 4813 / ✗ 1

     █ setup

     checks.........................: 99.97% ✓ 14439      ✗ 3    
     data_received..................: 424 MB 14 MB/s
     data_sent......................: 5.7 MB 185 kB/s
     http_req_blocked...............: avg=1.31ms   min=1.43µs  med=3.72µs   max=879.11ms p(90)=7.11µs   p(95)=217.44µs
     http_req_connecting............: avg=1.14ms   min=0s      med=0s       max=879.04ms p(90)=0s       p(95)=94.21µs 
     http_req_duration..............: avg=934.66ms min=6.25ms  med=674.28ms max=8.88s    p(90)=2.01s    p(95)=2.45s   
       { expected_response:true }...: avg=934.84ms min=6.25ms  med=674.38ms max=8.88s    p(90)=2.01s    p(95)=2.45s   
     http_req_failed................: 0.02%  ✓ 1          ✗ 4833 
     http_req_receiving.............: avg=373.59ms min=36.03µs med=104.01µs max=8.17s    p(90)=1.38s    p(95)=1.8s    
     http_req_sending...............: avg=22.6ms   min=8.56µs  med=18.53µs  max=7.26s    p(90)=297.41µs p(95)=22.57ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=538.46ms min=6.18ms  med=491.88ms max=2.68s    p(90)=1.02s    p(95)=1.17s   
     http_reqs......................: 4834   155.946924/s
     iteration_duration.............: avg=1.88s    min=32.11ms med=1.56s    max=12.63s   p(90)=3.78s    p(95)=4.67s   
     iterations.....................: 4814   155.301715/s
     vus............................: 12     min=12       max=300
     vus_max........................: 300    min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 9120      ✗ 0    
     data_received..................: 269 MB  8.1 MB/s
     data_sent......................: 3.6 MB  110 kB/s
     http_req_blocked...............: avg=1.82ms   min=1.89µs   med=4.15µs  max=31.05ms  p(90)=96.05µs  p(95)=19.83ms 
     http_req_connecting............: avg=1.79ms   min=0s       med=0s      max=31ms     p(90)=0s       p(95)=19.73ms 
     http_req_duration..............: avg=3.03s    min=13.97ms  med=1.66s   max=32.66s   p(90)=2.72s    p(95)=13.99s  
       { expected_response:true }...: avg=3.03s    min=13.97ms  med=1.66s   max=32.66s   p(90)=2.72s    p(95)=13.99s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 3060 
     http_req_receiving.............: avg=2.07ms   min=44.87µs  med=97.81µs max=420.05ms p(90)=601.12µs p(95)=2.31ms  
     http_req_sending...............: avg=314.73µs min=9.19µs   med=22.27µs max=81.8ms   p(90)=228µs    p(95)=864.69µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s      max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.02s    min=13.85ms  med=1.66s   max=32.66s   p(90)=2.7s     p(95)=13.99s  
     http_reqs......................: 3060    92.418923/s
     iteration_duration.............: avg=3.09s    min=317.02ms med=1.7s    max=32.67s   p(90)=2.8s     p(95)=14.05s  
     iterations.....................: 3040    91.814878/s
     vus............................: 16      min=16      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8673      ✗ 0    
     data_received..................: 256 MB  7.7 MB/s
     data_sent......................: 3.5 MB  104 kB/s
     http_req_blocked...............: avg=652.23µs min=1.53µs   med=3.41µs   max=36.2ms   p(90)=124.59µs p(95)=6.02ms  
     http_req_connecting............: avg=599.67µs min=0s       med=0s       max=13.61ms  p(90)=72.22µs  p(95)=5.78ms  
     http_req_duration..............: avg=3.22s    min=11.04ms  med=1.44s    max=32.83s   p(90)=2.1s     p(95)=24.62s  
       { expected_response:true }...: avg=3.22s    min=11.04ms  med=1.44s    max=32.83s   p(90)=2.1s     p(95)=24.62s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2911 
     http_req_receiving.............: avg=570.1µs  min=44.37µs  med=105.23µs max=191.19ms p(90)=240.94µs p(95)=463.38µs
     http_req_sending...............: avg=390.75µs min=9.44µs   med=17.68µs  max=61.3ms   p(90)=127.71µs p(95)=513.69µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.22s    min=10.95ms  med=1.44s    max=32.83s   p(90)=2.1s     p(95)=24.61s  
     http_reqs......................: 2911    87.551561/s
     iteration_duration.............: avg=3.26s    min=370.25ms med=1.45s    max=32.84s   p(90)=2.13s    p(95)=24.98s  
     iterations.....................: 2891    86.950038/s
     vus............................: 30      min=30      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8553      ✗ 0    
     data_received..................: 252 MB  7.6 MB/s
     data_sent......................: 3.4 MB  103 kB/s
     http_req_blocked...............: avg=942.41µs min=1.67µs  med=4.62µs   max=26.58ms  p(90)=144.22µs p(95)=10.38ms 
     http_req_connecting............: avg=869.4µs  min=0s      med=0s       max=22.59ms  p(90)=106.43µs p(95)=9.25ms  
     http_req_duration..............: avg=3.22s    min=16.36ms med=2.9s     max=7.69s    p(90)=4.75s    p(95)=5.24s   
       { expected_response:true }...: avg=3.22s    min=16.36ms med=2.9s     max=7.69s    p(90)=4.75s    p(95)=5.24s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2871 
     http_req_receiving.............: avg=59.8ms   min=43.93µs med=259.82µs max=1.58s    p(90)=7.35ms   p(95)=588.17ms
     http_req_sending...............: avg=573.68µs min=9.36µs  med=26.5µs   max=158.64ms p(90)=246.45µs p(95)=1.22ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.16s    min=16.17ms med=2.87s    max=7.69s    p(90)=4.71s    p(95)=5.24s   
     http_reqs......................: 2871    86.982553/s
     iteration_duration.............: avg=3.29s    min=88.34ms med=2.94s    max=7.71s    p(90)=4.84s    p(95)=5.28s   
     iterations.....................: 2851    86.376614/s
     vus............................: 7       min=7       max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7257      ✗ 0    
     data_received..................: 214 MB  6.7 MB/s
     data_sent......................: 2.9 MB  91 kB/s
     http_req_blocked...............: avg=725.08µs min=1.75µs   med=4.05µs   max=13.92ms p(90)=2.43ms   p(95)=6.1ms   
     http_req_connecting............: avg=703.78µs min=0s       med=0s       max=13.89ms p(90)=2.29ms   p(95)=5.99ms  
     http_req_duration..............: avg=3.76s    min=12.06ms  med=3.75s    max=8.72s   p(90)=4.92s    p(95)=5.82s   
       { expected_response:true }...: avg=3.76s    min=12.06ms  med=3.75s    max=8.72s   p(90)=4.92s    p(95)=5.82s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2439 
     http_req_receiving.............: avg=12.56ms  min=40.67µs  med=102.71µs max=1.12s   p(90)=321µs    p(95)=880.68µs
     http_req_sending...............: avg=159.92µs min=9.39µs   med=22.25µs  max=14.22ms p(90)=337.98µs p(95)=928.92µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.75s    min=11.95ms  med=3.75s    max=8.72s   p(90)=4.92s    p(95)=5.82s   
     http_reqs......................: 2439    76.333134/s
     iteration_duration.............: avg=3.83s    min=275.58ms med=3.77s    max=8.73s   p(90)=4.94s    p(95)=5.92s   
     iterations.....................: 2419    75.707196/s
     vus............................: 229     min=229     max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented May 20, 2025

Overview for: federation/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 171 5413 total, 0 failed avg: 1344ms, p95: 2858ms
apollo-router 161 5109 total, 5 failed avg: 1524ms, p95: 3769ms ❌ 5 failed requests, 5 non-200 responses, 5 unexpected GraphQL errors, non-compatible response structure (1)
grafbase 159 4999 total, 0 failed avg: 1598ms, p95: 3892ms
hive-gateway 91 3222 total, 0 failed avg: 4923ms, p95: 32808ms
apollo-server 87 3104 total, 0 failed avg: 5205ms, p95: 33308ms
hive-gateway-bun 87 3051 total, 0 failed avg: 5181ms, p95: 9424ms
mercurius 73 2424 total, 0 failed avg: 6435ms, p95: 11372ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 16179      ✗ 0    
     data_received..................: 475 MB  15 MB/s
     data_sent......................: 6.4 MB  204 kB/s
     http_req_blocked...............: avg=3.58ms   min=1.79µs  med=4.22µs   max=2.1s   p(90)=28.32µs  p(95)=17.58ms
     http_req_connecting............: avg=2.75ms   min=0s      med=0s       max=2.1s   p(90)=0s       p(95)=16.76ms
     http_req_duration..............: avg=1.34s    min=4.1ms   med=1.19s    max=9.07s  p(90)=2.26s    p(95)=2.85s  
       { expected_response:true }...: avg=1.34s    min=4.1ms   med=1.19s    max=9.07s  p(90)=2.26s    p(95)=2.85s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 5413 
     http_req_receiving.............: avg=284.41ms min=34.27µs med=95.29µs  max=4.31s  p(90)=1.19s    p(95)=1.61s  
     http_req_sending...............: avg=32.69ms  min=8.04µs  med=21.83µs  max=4.43s  p(90)=879.16µs p(95)=4.17ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=1.02s    min=3.95ms  med=909.27ms max=4.3s   p(90)=1.77s    p(95)=2.11s  
     http_reqs......................: 5413    171.93731/s
     iteration_duration.............: avg=2.82s    min=46.93ms med=2.54s    max=11.42s p(90)=5.19s    p(95)=6.12s  
     iterations.....................: 5393    171.302034/s
     vus............................: 223     min=223      max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✗ response code was 200
      ↳  99% — ✓ 5084 / ✗ 5
     ✗ no graphql errors
      ↳  99% — ✓ 5084 / ✗ 5
     ✗ valid response structure
      ↳  99% — ✓ 5084 / ✗ 1

     █ setup

     checks.........................: 99.92% ✓ 15252      ✗ 11   
     data_received..................: 448 MB 14 MB/s
     data_sent......................: 6.1 MB 192 kB/s
     http_req_blocked...............: avg=9.69ms   min=1.42µs  med=3.48µs   max=4.44s  p(90)=1.17ms   p(95)=32.3ms
     http_req_connecting............: avg=9.02ms   min=0s      med=0s       max=4.44s  p(90)=347.63µs p(95)=31.8ms
     http_req_duration..............: avg=1.52s    min=6.55ms  med=1.3s     max=10.26s p(90)=3.25s    p(95)=3.76s 
       { expected_response:true }...: avg=1.52s    min=6.55ms  med=1.3s     max=10.26s p(90)=3.25s    p(95)=3.76s 
     http_req_failed................: 0.09%  ✓ 5          ✗ 5104 
     http_req_receiving.............: avg=502.36ms min=0s      med=109.51µs max=8.07s  p(90)=1.75s    p(95)=2.91s 
     http_req_sending...............: avg=22.5ms   min=8.15µs  med=16.2µs   max=4.01s  p(90)=1.27ms   p(95)=4.04ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s    
     http_req_waiting...............: avg=998.82ms min=6.46ms  med=965.48ms max=3.66s  p(90)=1.86s    p(95)=2.21s 
     http_reqs......................: 5109   161.718749/s
     iteration_duration.............: avg=2.99s    min=45.81ms med=2.63s    max=15.5s  p(90)=5.89s    p(95)=6.99s 
     iterations.....................: 5089   161.085675/s
     vus............................: 307    min=307      max=500
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 14937      ✗ 0    
     data_received..................: 439 MB  14 MB/s
     data_sent......................: 5.9 MB  189 kB/s
     http_req_blocked...............: avg=5.41ms   min=1.74µs  med=4.06µs   max=2.45s   p(90)=115.71µs p(95)=40.97ms
     http_req_connecting............: avg=4.14ms   min=0s      med=0s       max=157.4ms p(90)=56.02µs  p(95)=38.79ms
     http_req_duration..............: avg=1.59s    min=3.26ms  med=1.3s     max=10.38s  p(90)=2.89s    p(95)=3.89s  
       { expected_response:true }...: avg=1.59s    min=3.26ms  med=1.3s     max=10.38s  p(90)=2.89s    p(95)=3.89s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 4999 
     http_req_receiving.............: avg=558.11ms min=35.38µs med=141.65µs max=7.87s   p(90)=1.89s    p(95)=2.6s   
     http_req_sending...............: avg=24.4ms   min=9.06µs  med=19.82µs  max=3.71s   p(90)=3.19ms   p(95)=27.44ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=1.01s    min=3.19ms  med=927.56ms max=3.05s   p(90)=1.89s    p(95)=2.44s  
     http_reqs......................: 4999    159.532421/s
     iteration_duration.............: avg=3.05s    min=23.76ms med=2.67s    max=15s     p(90)=5.71s    p(95)=6.84s  
     iterations.....................: 4979    158.894163/s
     vus............................: 179     min=179      max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 9606      ✗ 0    
     data_received..................: 283 MB  8.1 MB/s
     data_sent......................: 3.8 MB  109 kB/s
     http_req_blocked...............: avg=5.65ms min=1.75µs   med=4.14µs  max=105.65ms p(90)=31.87ms p(95)=47.5ms 
     http_req_connecting............: avg=5.49ms min=0s       med=0s      max=78.19ms  p(90)=31.18ms p(95)=47.07ms
     http_req_duration..............: avg=4.92s  min=12.65ms  med=2.13s   max=34.52s   p(90)=12.51s  p(95)=32.8s  
       { expected_response:true }...: avg=4.92s  min=12.65ms  med=2.13s   max=34.52s   p(90)=12.51s  p(95)=32.8s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 3222 
     http_req_receiving.............: avg=4.23ms min=40.56µs  med=89.56µs max=347.97ms p(90)=1.63ms  p(95)=7.85ms 
     http_req_sending...............: avg=3.61ms min=9.61µs   med=21.24µs max=320.89ms p(90)=7.7ms   p(95)=32.42ms
     http_req_tls_handshaking.......: avg=0s     min=0s       med=0s      max=0s       p(90)=0s      p(95)=0s     
     http_req_waiting...............: avg=4.91s  min=12.54ms  med=2.12s   max=34.52s   p(90)=12.5s   p(95)=32.78s 
     http_reqs......................: 3222    91.958107/s
     iteration_duration.............: avg=5.03s  min=376.75ms med=2.2s    max=34.58s   p(90)=13.11s  p(95)=32.87s 
     iterations.....................: 3202    91.387294/s
     vus............................: 13      min=13      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 9252      ✗ 0    
     data_received..................: 273 MB  7.7 MB/s
     data_sent......................: 3.7 MB  104 kB/s
     http_req_blocked...............: avg=3.19ms   min=1.6µs    med=3.58µs   max=52.56ms p(90)=17.15ms  p(95)=26.99ms 
     http_req_connecting............: avg=3.14ms   min=0s       med=0s       max=52.51ms p(90)=16.76ms  p(95)=26.81ms 
     http_req_duration..............: avg=5.2s     min=11.05ms  med=1.63s    max=34.95s  p(90)=31.63s   p(95)=33.3s   
       { expected_response:true }...: avg=5.2s     min=11.05ms  med=1.63s    max=34.95s  p(90)=31.63s   p(95)=33.3s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 3104 
     http_req_receiving.............: avg=201.35µs min=42.72µs  med=103.63µs max=24.84ms p(90)=211.09µs p(95)=354.59µs
     http_req_sending...............: avg=479.28µs min=9.14µs   med=19.29µs  max=42.51ms p(90)=673.11µs p(95)=1.94ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=5.2s     min=10.91ms  med=1.63s    max=34.95s  p(90)=31.63s   p(95)=33.3s   
     http_reqs......................: 3104    87.619932/s
     iteration_duration.............: avg=5.25s    min=403.91ms med=1.65s    max=34.97s  p(90)=31.7s    p(95)=33.36s  
     iterations.....................: 3084    87.055371/s
     vus............................: 48      min=48      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 9093      ✗ 0    
     data_received..................: 268 MB  7.7 MB/s
     data_sent......................: 3.6 MB  104 kB/s
     http_req_blocked...............: avg=6.29ms   min=1.73µs   med=4.35µs   max=218.16ms p(90)=35.98ms  p(95)=43ms    
     http_req_connecting............: avg=6.08ms   min=0s       med=0s       max=81.19ms  p(90)=35.32ms  p(95)=42.55ms 
     http_req_duration..............: avg=5.18s    min=17.2ms   med=4.71s    max=10.93s   p(90)=8.39s    p(95)=9.42s   
       { expected_response:true }...: avg=5.18s    min=17.2ms   med=4.71s    max=10.93s   p(90)=8.39s    p(95)=9.42s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 3051 
     http_req_receiving.............: avg=101.79ms min=35.78µs  med=119.78µs max=3.19s    p(90)=261.49ms p(95)=813.61ms
     http_req_sending...............: avg=3.03ms   min=9.47µs   med=23.62µs  max=1s       p(90)=4.99ms   p(95)=10.64ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=5.07s    min=16.97ms  med=4.59s    max=10.93s   p(90)=8.38s    p(95)=9.12s   
     http_reqs......................: 3051    87.597294/s
     iteration_duration.............: avg=5.4s     min=476.62ms med=4.93s    max=11.18s   p(90)=8.48s    p(95)=9.97s   
     iterations.....................: 3031    87.023074/s
     vus............................: 145     min=145     max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7212      ✗ 0    
     data_received..................: 213 MB  6.5 MB/s
     data_sent......................: 2.9 MB  87 kB/s
     http_req_blocked...............: avg=3.54ms  min=1.79µs   med=4.69µs   max=43.34ms p(90)=19.15ms  p(95)=25.2ms 
     http_req_connecting............: avg=3.45ms  min=0s       med=0s       max=39.9ms  p(90)=18.74ms  p(95)=25.01ms
     http_req_duration..............: avg=6.43s   min=11.1ms   med=6.5s     max=13.33s  p(90)=8.35s    p(95)=11.37s 
       { expected_response:true }...: avg=6.43s   min=11.1ms   med=6.5s     max=13.33s  p(90)=8.35s    p(95)=11.37s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 2424 
     http_req_receiving.............: avg=21.34ms min=38.42µs  med=106.52µs max=1.7s    p(90)=377.92µs p(95)=1.55ms 
     http_req_sending...............: avg=368.7µs min=9.51µs   med=26.91µs  max=11.09ms p(90)=1.14ms   p(95)=2.5ms  
     http_req_tls_handshaking.......: avg=0s      min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=6.41s   min=10.99ms  med=6.49s    max=13.33s  p(90)=8.35s    p(95)=11.37s 
     http_reqs......................: 2424    73.546328/s
     iteration_duration.............: avg=6.55s   min=429.33ms med=6.55s    max=13.34s  p(90)=8.44s    p(95)=11.44s 
     iterations.....................: 2404    72.93951/s
     vus............................: 5       min=5       max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented May 20, 2025

Overview for: federation/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 2000 concurrent VUs over 60s

Comparison

Comparison

Gateway duration(p95)⬇️ RPS Requests Durations Notes
apollo-router 4759ms 168 11856 total, 719 failed avg: 2356ms, p95: 4759ms, max: 11334ms, med: 2368ms ❌ 719 failed requests, 719 non-200 responses, 719 unexpected GraphQL errors
cosmo 5544ms 175 12277 total, 0 failed avg: 2542ms, p95: 5545ms, max: 13861ms, med: 2157ms
grafbase 9537ms 167 13498 total, 0 failed avg: 3508ms, p95: 9538ms, max: 25044ms, med: 3117ms
hive-gateway-bun 27120ms 88 7244 total, 0 failed avg: 12035ms, p95: 27121ms, max: 34122ms, med: 10057ms
mercurius 43341ms 53 4908 total, 0 failed avg: 21547ms, p95: 43342ms, max: 44198ms, med: 18382ms
hive-gateway 49750ms 93 7982 total, 0 failed avg: 11284ms, p95: 49750ms, max: 58439ms, med: 3251ms
apollo-server 59999ms 85 7930 total, 473 failed avg: 11641ms, p95: 59999ms, max: 60126ms, med: 2179ms ❌ 473 failed requests, 473 non-200 responses, 473 unexpected GraphQL errors
Summary for: `apollo-router`

K6 Output

     ✗ response code was 200
      ↳  93% — ✓ 11117 / ✗ 719
     ✗ no graphql errors
      ↳  93% — ✓ 11117 / ✗ 719
     ✓ valid response structure

     █ setup

     checks.........................: 95.86% ✓ 33351     ✗ 1438  
     data_received..................: 977 MB 14 MB/s
     data_sent......................: 14 MB  200 kB/s
     http_req_blocked...............: avg=588.44ms min=1.66µs  med=3.83µs  max=9.17s  p(90)=2.76s    p(95)=3.8s    
     http_req_connecting............: avg=580.31ms min=0s      med=0s      max=8.72s  p(90)=2.73s    p(95)=3.76s   
     http_req_duration..............: avg=2.35s    min=0s      med=2.36s   max=11.33s p(90)=4.15s    p(95)=4.75s   
       { expected_response:true }...: avg=2.33s    min=7.15ms  med=2.36s   max=11.33s p(90)=4.13s    p(95)=4.7s    
     http_req_failed................: 6.06%  ✓ 719       ✗ 11137 
     http_req_receiving.............: avg=263.96ms min=0s      med=81.81µs max=7.36s  p(90)=1.16s    p(95)=1.9s    
     http_req_sending...............: avg=170.48ms min=0s      med=20.15µs max=8.99s  p(90)=552.31ms p(95)=908.02ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=1.92s    min=0s      med=1.76s   max=9.2s   p(90)=3.69s    p(95)=4.12s   
     http_reqs......................: 11856  168.81182/s
     iteration_duration.............: avg=6.07s    min=33.96ms med=5.73s   max=26.44s p(90)=11.54s   p(95)=13.54s  
     iterations.....................: 11836  168.52705/s
     vus............................: 246    min=71      max=1897
     vus_max........................: 2000   min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 36771      ✗ 0     
     data_received..................: 1.1 GB  15 MB/s
     data_sent......................: 15 MB   208 kB/s
     http_req_blocked...............: avg=337.92ms min=1.73µs  med=3.82µs  max=10.65s p(90)=976.21ms p(95)=3.11s   
     http_req_connecting............: avg=330.01ms min=0s      med=0s      max=10.65s p(90)=928.32ms p(95)=3.09s   
     http_req_duration..............: avg=2.54s    min=3.29ms  med=2.15s   max=13.86s p(90)=4.78s    p(95)=5.54s   
       { expected_response:true }...: avg=2.54s    min=3.29ms  med=2.15s   max=13.86s p(90)=4.78s    p(95)=5.54s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 12277 
     http_req_receiving.............: avg=194.42ms min=32.05µs med=84.08µs max=7.87s  p(90)=617.05ms p(95)=1.44s   
     http_req_sending...............: avg=122.04ms min=8.03µs  med=19.1µs  max=7.22s  p(90)=402.39ms p(95)=822.79ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=2.22s    min=3.12ms  med=1.77s   max=12.42s p(90)=4.53s    p(95)=4.88s   
     http_reqs......................: 12277   175.112707/s
     iteration_duration.............: avg=5.88s    min=11.93ms med=5.02s   max=26.51s p(90)=12.01s   p(95)=13.93s  
     iterations.....................: 12257   174.827437/s
     vus............................: 4       min=4        max=1994
     vus_max........................: 2000    min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 40434      ✗ 0     
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   198 kB/s
     http_req_blocked...............: avg=335.99ms min=1.59µs  med=3.74µs  max=19.37s p(90)=536.37ms p(95)=2.93s   
     http_req_connecting............: avg=330.36ms min=0s      med=0s      max=19.37s p(90)=515.16ms p(95)=2.89s   
     http_req_duration..............: avg=3.5s     min=3.23ms  med=3.11s   max=25.04s p(90)=6.67s    p(95)=9.53s   
       { expected_response:true }...: avg=3.5s     min=3.23ms  med=3.11s   max=25.04s p(90)=6.67s    p(95)=9.53s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 13498 
     http_req_receiving.............: avg=826.69ms min=32.27µs med=92.26µs max=19.06s p(90)=2.43s    p(95)=4.99s   
     http_req_sending...............: avg=134.26ms min=8.48µs  med=18.2µs  max=14.16s p(90)=227.3ms  p(95)=773.16ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=2.54s    min=3.13ms  med=2.27s   max=13.91s p(90)=4.9s     p(95)=5.42s   
     http_reqs......................: 13498   167.009675/s
     iteration_duration.............: avg=6.93s    min=26.63ms med=5.57s   max=33.95s p(90)=14.31s   p(95)=18.58s  
     iterations.....................: 13478   166.762217/s
     vus............................: 89      min=70       max=1906
     vus_max........................: 2000    min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 21672     ✗ 0     
     data_received..................: 636 MB  7.7 MB/s
     data_sent......................: 8.6 MB  105 kB/s
     http_req_blocked...............: avg=33.06ms  min=1.98µs  med=5.22µs   max=1.77s  p(90)=64.35ms  p(95)=188.78ms
     http_req_connecting............: avg=32.58ms  min=0s      med=0s       max=1.77s  p(90)=61.73ms  p(95)=185.72ms
     http_req_duration..............: avg=12.03s   min=16.6ms  med=10.05s   max=34.12s p(90)=24.91s   p(95)=27.12s  
       { expected_response:true }...: avg=12.03s   min=16.6ms  med=10.05s   max=34.12s p(90)=24.91s   p(95)=27.12s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 7244  
     http_req_receiving.............: avg=197.97ms min=39.82µs med=122.25µs max=9.36s  p(90)=139.25ms p(95)=989.36ms
     http_req_sending...............: avg=15.75ms  min=8.62µs  med=32.34µs  max=2.27s  p(90)=26.44ms  p(95)=73.65ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=11.82s   min=16.43ms med=9.95s    max=34.12s p(90)=24.82s   p(95)=26.84s  
     http_reqs......................: 7244    88.202423/s
     iteration_duration.............: avg=12.55s   min=125.2ms med=10.38s   max=38.79s p(90)=25.99s   p(95)=28.57s  
     iterations.....................: 7224    87.958904/s
     vus............................: 185     min=58      max=2000
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 14614     ✗ 0     
     data_received..................: 431 MB  4.7 MB/s
     data_sent......................: 6.0 MB  66 kB/s
     http_req_blocked...............: avg=236.92µs min=1.43µs   med=4.3µs   max=32.37ms  p(90)=498.18µs p(95)=692.92µs
     http_req_connecting............: avg=204.61µs min=0s       med=0s      max=32.29ms  p(90)=425.09µs p(95)=567.46µs
     http_req_duration..............: avg=21.54s   min=10.84ms  med=18.38s  max=44.19s   p(90)=41.67s   p(95)=43.34s  
       { expected_response:true }...: avg=21.54s   min=10.84ms  med=18.38s  max=44.19s   p(90)=41.67s   p(95)=43.34s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 4908  
     http_req_receiving.............: avg=3.79ms   min=37.74µs  med=99.66µs max=750.02ms p(90)=327.53µs p(95)=656.9µs 
     http_req_sending...............: avg=64.36µs  min=8.61µs   med=27.31µs max=16.55ms  p(90)=67.84µs  p(95)=93.21µs 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s      max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=21.54s   min=10.73ms  med=18.38s  max=44.19s   p(90)=41.67s   p(95)=43.34s  
     http_reqs......................: 4908    53.518952/s
     iteration_duration.............: avg=21.55s   min=174.67ms med=18.34s  max=44.49s   p(90)=42.16s   p(95)=43.39s  
     iterations.....................: 4839    52.766546/s
     vus............................: 534     min=61      max=2000
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 23886     ✗ 0     
     data_received..................: 701 MB  8.2 MB/s
     data_sent......................: 9.5 MB  111 kB/s
     http_req_blocked...............: avg=9.41ms  min=1.81µs   med=4.84µs  max=390.36ms p(90)=24.97ms p(95)=68.01ms
     http_req_connecting............: avg=9.23ms  min=0s       med=0s      max=339.56ms p(90)=24.73ms p(95)=67.19ms
     http_req_duration..............: avg=11.28s  min=12.84ms  med=3.25s   max=58.43s   p(90)=42.22s  p(95)=49.75s 
       { expected_response:true }...: avg=11.28s  min=12.84ms  med=3.25s   max=58.43s   p(90)=42.22s  p(95)=49.75s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 7982  
     http_req_receiving.............: avg=10.26ms min=41.39µs  med=99.45µs max=1.6s     p(90)=1.17ms  p(95)=5.74ms 
     http_req_sending...............: avg=5.09ms  min=9.8µs    med=28.29µs max=597.83ms p(90)=11.47ms p(95)=26.91ms
     http_req_tls_handshaking.......: avg=0s      min=0s       med=0s      max=0s       p(90)=0s      p(95)=0s     
     http_req_waiting...............: avg=11.26s  min=12.72ms  med=3.24s   max=57.09s   p(90)=42.21s  p(95)=49.74s 
     http_reqs......................: 7982    93.455455/s
     iteration_duration.............: avg=11.42s  min=198.15ms med=3.34s   max=59.18s   p(90)=42.39s  p(95)=49.83s 
     iterations.....................: 7962    93.22129/s
     vus............................: 54      min=54      max=2000
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✗ response code was 200
      ↳  94% — ✓ 7437 / ✗ 473
     ✗ no graphql errors
      ↳  94% — ✓ 7437 / ✗ 473
     ✓ valid response structure

     █ setup

     checks.........................: 95.93% ✓ 22311     ✗ 946   
     data_received..................: 655 MB 7.1 MB/s
     data_sent......................: 9.5 MB 102 kB/s
     http_req_blocked...............: avg=515.73µs min=1.44µs  med=3.82µs   max=119.34ms p(90)=370.43µs p(95)=593.8µs 
     http_req_connecting............: avg=490.34µs min=0s      med=0s       max=119.25ms p(90)=300.63µs p(95)=490.85µs
     http_req_duration..............: avg=11.64s   min=10.38ms med=2.17s    max=1m0s     p(90)=53.13s   p(95)=59.99s  
       { expected_response:true }...: avg=8.61s    min=10.38ms med=2.09s    max=59.98s   p(90)=37.43s   p(95)=50.53s  
     http_req_failed................: 5.96%  ✓ 473       ✗ 7457  
     http_req_receiving.............: avg=208.39µs min=0s      med=106.25µs max=106.61ms p(90)=214.21µs p(95)=317.88µs
     http_req_sending...............: avg=226.72µs min=8.92µs  med=20.11µs  max=58.82ms  p(90)=65.81µs  p(95)=124.09µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=11.64s   min=10.28ms med=2.17s    max=1m0s     p(90)=53.12s   p(95)=59.99s  
     http_reqs......................: 7930   85.562593/s
     iteration_duration.............: avg=11.68s   min=59.69ms med=2.19s    max=1m0s     p(90)=53.3s    p(95)=1m0s    
     iterations.....................: 7910   85.346799/s
     vus............................: 67     min=62      max=2000
     vus_max........................: 2000   min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant