Populate entity's external fields in inventory subgraph by enisdenjo · Pull Request #894 · graphql-hive/graphql-gateways-benchmark

enisdenjo · 2025-12-08T14:04:35Z

The shippingEstimate was always returning null even though it should not. Could lead to false-negatives in tests.

https://async-graphql.github.io/async-graphql/en/apollo_federation.html#requires

Also

~~Changed the CI to leave comments on PRs also when running the benchmarks on the hosted runner~~ Not working ATM.

github-actions · 2025-12-08T14:05:57Z

💻 Website Preview

The latest changes are available as preview in: https://712c0679.federation-gateway-benchmark.pages.dev

github-actions · 2025-12-08T14:10:37Z

Overview for: `ramping-vus`

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Gateway	RPS ⬇️	Requests	Duration	Notes
hive-router	1662	103941 total, 0 failed	avg: 134ms, p95: 326ms	✅
grafbase	1404	91636 total, 0 failed	avg: 152ms, p95: 352ms	✅
cosmo	666	42623 total, 0 failed	avg: 329ms, p95: 736ms	✅
hive-gateway-router-runtime	564	37160 total, 0 failed	avg: 377ms, p95: 875ms	❌ 105 unexpected GraphQL errors, non-compatible response structure (2)
apollo-router	252	17264 total, 0 failed	avg: 776ms, p95: 1643ms	❌ 16258 unexpected GraphQL errors, non-compatible response structure (474)
hive-gateway	162	11315 total, 0 failed	avg: 1178ms, p95: 3213ms	❌ 1983 unexpected GraphQL errors, non-compatible response structure (87)
apollo-gateway	116	8327 total, 0 failed	avg: 1485ms, p95: 3021ms	❌ 7327 unexpected GraphQL errors, non-compatible response structure (332)

Summary for: hive-router

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 308823      ✗ 0     
     data_received..................: 9.1 GB  145 MB/s
     data_sent......................: 121 MB  1.9 MB/s
     http_req_blocked...............: avg=508.12µs min=1.23µs  med=2.82µs   max=352.11ms p(90)=4.49µs   p(95)=5.44µs   p(99.9)=175.26ms
     http_req_connecting............: avg=504.15µs min=0s      med=0s       max=352ms    p(90)=0s       p(95)=0s       p(99.9)=175.21ms
     http_req_duration..............: avg=133.99ms min=1.78ms  med=119.4ms  max=504.16ms p(90)=272.74ms p(95)=326.02ms p(99.9)=440.07ms
       { expected_response:true }...: avg=133.99ms min=1.78ms  med=119.4ms  max=504.16ms p(90)=272.74ms p(95)=326.02ms p(99.9)=440.07ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 103941
     http_req_receiving.............: avg=573.38µs min=25.52µs med=44.83µs  max=152.27ms p(90)=165.37µs p(95)=435.43µs p(99.9)=82.77ms 
     http_req_sending...............: avg=469.08µs min=5.51µs  med=10.73µs  max=153.18ms p(90)=30.78µs  p(95)=140.03µs p(99.9)=76.87ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=132.94ms min=1.72ms  med=118.44ms max=493.99ms p(90)=270.53ms p(95)=324.07ms p(99.9)=436.52ms
     http_reqs......................: 103941  1662.397636/s
     iteration_duration.............: avg=136.13ms min=2.04ms  med=121.2ms  max=790.74ms p(90)=275.11ms p(95)=328.5ms  p(99.9)=465.27ms
     iterations.....................: 102941  1646.40397/s
     success_rate...................: 100.00% ✓ 102941      ✗ 0     
     vus............................: 84      min=0         max=498 
     vus_max........................: 500     min=500       max=500

Performance Overview

HTTP Overview

Summary for: grafbase

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 271908      ✗ 0    
     data_received..................: 8.0 GB  123 MB/s
     data_sent......................: 107 MB  1.6 MB/s
     http_req_blocked...............: avg=717.53µs min=1.2µs   med=2.91µs   max=411.48ms p(90)=4.56µs   p(95)=5.83µs   p(99.9)=230.82ms
     http_req_connecting............: avg=713.39µs min=0s      med=0s       max=411.42ms p(90)=0s       p(95)=0s       p(99.9)=230.71ms
     http_req_duration..............: avg=151.84ms min=2.5ms   med=140.64ms max=716.11ms p(90)=300.5ms  p(95)=352.11ms p(99.9)=462.04ms
       { expected_response:true }...: avg=151.84ms min=2.5ms   med=140.64ms max=716.11ms p(90)=300.5ms  p(95)=352.11ms p(99.9)=462.04ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 91636
     http_req_receiving.............: avg=663.73µs min=25.47µs med=48.15µs  max=154.43ms p(90)=150.37µs p(95)=459.32µs p(99.9)=89.37ms 
     http_req_sending...............: avg=614.84µs min=5.34µs  med=11.6µs   max=150.58ms p(90)=33.58µs  p(95)=148.29µs p(99.9)=86.08ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=150.56ms min=2.46ms  med=139.33ms max=716.05ms p(90)=298ms    p(95)=349.49ms p(99.9)=458.9ms 
     http_reqs......................: 91636   1404.594743/s
     iteration_duration.............: avg=154.65ms min=3.47ms  med=142.85ms max=1s       p(90)=303.3ms  p(95)=356.6ms  p(99.9)=544.07ms
     iterations.....................: 90636   1389.266763/s
     success_rate...................: 100.00% ✓ 90636       ✗ 0    
     vus............................: 73      min=0         max=494
     vus_max........................: 500     min=500       max=500

Performance Overview

HTTP Overview

Summary for: cosmo

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 124869     ✗ 0    
     data_received..................: 3.7 GB  58 MB/s
     data_sent......................: 50 MB   777 kB/s
     http_req_blocked...............: avg=132.24µs min=1.27µs  med=2.95µs   max=168.93ms p(90)=4.84µs   p(95)=6.96µs   p(99.9)=38.36ms
     http_req_connecting............: avg=125.43µs min=0s      med=0s       max=168.72ms p(90)=0s       p(95)=0s       p(99.9)=37.81ms
     http_req_duration..............: avg=329.45ms min=2.86ms  med=311.71ms max=1.29s    p(90)=645.67ms p(95)=736.17ms p(99.9)=1.11s  
       { expected_response:true }...: avg=329.45ms min=2.86ms  med=311.71ms max=1.29s    p(90)=645.67ms p(95)=736.17ms p(99.9)=1.11s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 42623
     http_req_receiving.............: avg=453.7µs  min=29.29µs med=63.49µs  max=195.08ms p(90)=198.41µs p(95)=512.06µs p(99.9)=64.19ms
     http_req_sending...............: avg=187.57µs min=5.8µs   med=11.56µs  max=123.11ms p(90)=33.84µs  p(95)=139.38µs p(99.9)=36.7ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=328.81ms min=2.8ms   med=310.95ms max=1.29s    p(90)=644.56ms p(95)=735.17ms p(99.9)=1.1s   
     http_reqs......................: 42623   666.822207/s
     iteration_duration.............: avg=337.96ms min=3.24ms  med=321.64ms max=1.29s    p(90)=650.02ms p(95)=740.95ms p(99.9)=1.11s  
     iterations.....................: 41623   651.17755/s
     success_rate...................: 100.00% ✓ 41623      ✗ 0    
     vus............................: 58      min=0        max=498
     vus_max........................: 500     min=500      max=500

Performance Overview

HTTP Overview

Summary for: hive-gateway-router-runtime

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 36055 / ✗ 105
     ✗ valid response structure
      ↳  99% — ✓ 36156 / ✗ 2

     checks.........................: 99.90% ✓ 108371     ✗ 107  
     data_received..................: 3.3 GB 49 MB/s
     data_sent......................: 43 MB  658 kB/s
     http_req_blocked...............: avg=362.35µs min=1.31µs  med=2.75µs   max=478.4ms  p(90)=4.33µs   p(95)=6.13µs   p(99.9)=96.5ms 
     http_req_connecting............: avg=357.69µs min=0s      med=0s       max=478.34ms p(90)=0s       p(95)=0s       p(99.9)=96.42ms
     http_req_duration..............: avg=376.89ms min=4.69ms  med=330.54ms max=1.35s    p(90)=770.06ms p(95)=874.56ms p(99.9)=1.18s  
       { expected_response:true }...: avg=376.89ms min=4.69ms  med=330.54ms max=1.35s    p(90)=770.06ms p(95)=874.56ms p(99.9)=1.18s  
     http_req_failed................: 0.00%  ✓ 0          ✗ 37160
     http_req_receiving.............: avg=334.23µs min=26.34µs med=44.76µs  max=227.8ms  p(90)=101.56µs p(95)=397.76µs p(99.9)=55.91ms
     http_req_sending...............: avg=367.84µs min=5.71µs  med=11.03µs  max=198.51ms p(90)=31.03µs  p(95)=134.06µs p(99.9)=63.72ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=376.19ms min=4.64ms  med=329.96ms max=1.31s    p(90)=768.88ms p(95)=872.03ms p(99.9)=1.18s  
     http_reqs......................: 37160  564.71325/s
     iteration_duration.............: avg=389.19ms min=5.03ms  med=339.11ms max=1.57s    p(90)=776.75ms p(95)=888.05ms p(99.9)=1.29s  
     iterations.....................: 36158  549.486052/s
     success_rate...................: 99.70% ✓ 36051      ✗ 107  
     vus............................: 31     min=0        max=500
     vus_max........................: 500    min=500      max=500

Performance Overview

HTTP Overview

Summary for: apollo-router

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  0% — ✓ 0 / ✗ 16258
     ✗ valid response structure
      ↳  97% — ✓ 15783 / ✗ 474

     checks.........................: 65.69% ✓ 32047      ✗ 16732
     data_received..................: 1.8 GB 26 MB/s
     data_sent......................: 20 MB  295 kB/s
     http_req_blocked...............: avg=17.22ms  min=1.74µs  med=3.39µs   max=1.59s    p(90)=6.15µs   p(95)=10.58µs  p(99.9)=1.29s   
     http_req_connecting............: avg=17.19ms  min=0s      med=0s       max=1.48s    p(90)=0s       p(95)=0s       p(99.9)=1.29s   
     http_req_duration..............: avg=776.35ms min=6.7ms   med=759.16ms max=2.12s    p(90)=1.51s    p(95)=1.64s    p(99.9)=2.01s   
       { expected_response:true }...: avg=776.35ms min=6.7ms   med=759.16ms max=2.12s    p(90)=1.51s    p(95)=1.64s    p(99.9)=2.01s   
     http_req_failed................: 0.00%  ✓ 0          ✗ 17264
     http_req_receiving.............: avg=2.94ms   min=30.97µs med=56.3µs   max=660.91ms p(90)=113.51µs p(95)=543.98µs p(99.9)=415.36ms
     http_req_sending...............: avg=16.61ms  min=7.41µs  med=13.6µs   max=643.75ms p(90)=6.69ms   p(95)=134.06ms p(99.9)=555.05ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=756.79ms min=6.63ms  med=723.78ms max=2.01s    p(90)=1.48s    p(95)=1.6s     p(99.9)=1.92s   
     http_reqs......................: 17264  252.290473/s
     iteration_duration.............: avg=865.46ms min=8.26ms  med=835.01ms max=6.71s    p(90)=1.55s    p(95)=1.71s    p(99.9)=4.97s   
     iterations.....................: 16257  237.574503/s
     success_rate...................: 0.00%  ✓ 0          ✗ 16257
     vus............................: 88     min=0        max=500
     vus_max........................: 500    min=500      max=500

Performance Overview

HTTP Overview

Summary for: hive-gateway

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  80% — ✓ 8332 / ✗ 1983
     ✗ valid response structure
      ↳  99% — ✓ 10227 / ✗ 87

     checks.........................: 93.31% ✓ 28874      ✗ 2070 
     data_received..................: 1.0 GB 15 MB/s
     data_sent......................: 14 MB  194 kB/s
     http_req_blocked...............: avg=1.19ms   min=1.64µs med=3.2µs    max=541ms    p(90)=6.4µs    p(95)=12.6µs   p(99.9)=229.57ms
     http_req_connecting............: avg=1.15ms   min=0s     med=0s       max=540.92ms p(90)=0s       p(95)=0s       p(99.9)=218.77ms
     http_req_duration..............: avg=1.17s    min=6.24ms med=914.97ms max=11.81s   p(90)=2.77s    p(95)=3.21s    p(99.9)=10.9s   
       { expected_response:true }...: avg=1.17s    min=6.24ms med=914.97ms max=11.81s   p(90)=2.77s    p(95)=3.21s    p(99.9)=10.9s   
     http_req_failed................: 0.00%  ✓ 0          ✗ 11315
     http_req_receiving.............: avg=603.72µs min=32µs   med=55.16µs  max=497.07ms p(90)=152.22µs p(95)=583.69µs p(99.9)=100.64ms
     http_req_sending...............: avg=1.82ms   min=7.23µs med=12.56µs  max=536.96ms p(90)=111.37µs p(95)=391.55µs p(99.9)=192.16ms
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=1.17s    min=6.18ms med=912.44ms max=11.81s   p(90)=2.77s    p(95)=3.19s    p(99.9)=10.9s   
     http_reqs......................: 11315  162.312799/s
     iteration_duration.............: avg=1.29s    min=8.23ms med=1.07s    max=11.99s   p(90)=2.91s    p(95)=3.31s    p(99.9)=11.01s  
     iterations.....................: 10314  147.953531/s
     success_rate...................: 80.77% ✓ 8331       ✗ 1983 
     vus............................: 74     min=0        max=499
     vus_max........................: 500    min=500      max=500

Performance Overview

HTTP Overview

Summary for: apollo-gateway

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  0% — ✓ 0 / ✗ 7327
     ✗ valid response structure
      ↳  95% — ✓ 6995 / ✗ 332

     checks.........................: 65.15% ✓ 14322      ✗ 7659 
     data_received..................: 732 MB 10 MB/s
     data_sent......................: 10 MB  141 kB/s
     http_req_blocked...............: avg=238.88µs min=2µs     med=4.15µs  max=96.93ms p(90)=7.08µs   p(95)=26.02µs  p(99.9)=50.81ms
     http_req_connecting............: avg=230.68µs min=0s      med=0s      max=94.28ms p(90)=0s       p(95)=0s       p(99.9)=50.75ms
     http_req_duration..............: avg=1.48s    min=8.26ms  med=1.46s   max=19.51s  p(90)=2.55s    p(95)=3.02s    p(99.9)=18.16s 
       { expected_response:true }...: avg=1.48s    min=8.26ms  med=1.46s   max=19.51s  p(90)=2.55s    p(95)=3.02s    p(99.9)=18.16s 
     http_req_failed................: 0.00%  ✓ 0          ✗ 8327 
     http_req_receiving.............: avg=131.64µs min=34.64µs med=66.7µs  max=22.77ms p(90)=125.4µs  p(95)=186.11µs p(99.9)=10.26ms
     http_req_sending...............: avg=452.67µs min=8.62µs  med=17.33µs max=65.57ms p(90)=121.75µs p(95)=1.29ms   p(99.9)=38.92ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s      p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=1.48s    min=8.2ms   med=1.46s   max=19.51s  p(90)=2.55s    p(95)=3.02s    p(99.9)=18.16s 
     http_reqs......................: 8327   116.288024/s
     iteration_duration.............: avg=1.68s    min=10.18ms med=1.61s   max=19.53s  p(90)=2.62s    p(95)=3.11s    p(99.9)=18.32s 
     iterations.....................: 7327   102.322848/s
     success_rate...................: 0.00%  ✓ 0          ✗ 7327 
     vus............................: 112    min=0        max=500
     vus_max........................: 500    min=500      max=500

Performance Overview

HTTP Overview

github-actions · 2025-12-08T14:10:48Z

Overview for: `constant-vus-over-time`

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Gateway	RPS ⬇️	Requests	Duration	Notes
hive-router	1685	101548 total, 0 failed	avg: 29ms, p95: 51ms	✅
grafbase	1475	89159 total, 0 failed	avg: 33ms, p95: 57ms	✅
cosmo	605	36647 total, 0 failed	avg: 82ms, p95: 121ms	✅
hive-gateway-router-runtime	580	35286 total, 0 failed	avg: 85ms, p95: 114ms	❌ 1 unexpected GraphQL errors
apollo-router	272	16618 total, 0 failed	avg: 177ms, p95: 288ms	❌ 16518 unexpected GraphQL errors, non-compatible response structure (50)
hive-gateway	209	12842 total, 0 failed	avg: 233ms, p95: 526ms	❌ 1422 unexpected GraphQL errors
apollo-gateway	114	7014 total, 0 failed	avg: 427ms, p95: 526ms	❌ 6914 unexpected GraphQL errors, non-compatible response structure (50)

Summary for: hive-router

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 304344      ✗ 0     
     data_received..................: 8.9 GB  147 MB/s
     data_sent......................: 118 MB  2.0 MB/s
     http_req_blocked...............: avg=5.33µs   min=1.18µs med=2.57µs  max=9.51ms   p(90)=3.73µs   p(95)=4.47µs   p(99.9)=93.96µs
     http_req_connecting............: avg=2.27µs   min=0s     med=0s      max=9.48ms   p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_duration..............: avg=29.28ms  min=1.91ms med=26.9ms  max=434.04ms p(90)=44.6ms   p(95)=51.09ms  p(99.9)=90.41ms
       { expected_response:true }...: avg=29.28ms  min=1.91ms med=26.9ms  max=434.04ms p(90)=44.6ms   p(95)=51.09ms  p(99.9)=90.41ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 101548
     http_req_receiving.............: avg=118.24µs min=24.6µs med=43.71µs max=174.65ms p(90)=104.75µs p(95)=337.18µs p(99.9)=12.26ms
     http_req_sending...............: avg=102.69µs min=5.2µs  med=10.33µs max=236.75ms p(90)=31.42µs  p(95)=126.02µs p(99.9)=13.62ms
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=29.06ms  min=1.87ms med=26.74ms max=416.78ms p(90)=44.22ms  p(95)=50.68ms  p(99.9)=89.43ms
     http_reqs......................: 101548  1685.460024/s
     iteration_duration.............: avg=29.56ms  min=3.64ms med=27.15ms max=448.89ms p(90)=44.86ms  p(95)=51.35ms  p(99.9)=91.09ms
     iterations.....................: 101448  1683.800258/s
     success_rate...................: 100.00% ✓ 101448      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50

Performance Overview

HTTP Overview

Summary for: grafbase

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 267177      ✗ 0    
     data_received..................: 7.8 GB  129 MB/s
     data_sent......................: 104 MB  1.7 MB/s
     http_req_blocked...............: avg=11.2µs   min=1.21µs med=2.96µs  max=18.77ms  p(90)=4.25µs   p(95)=5.2µs    p(99.9)=122.7µs
     http_req_connecting............: avg=7.49µs   min=0s     med=0s      max=18.74ms  p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_duration..............: avg=33.33ms  min=3.03ms med=30.29ms max=534.19ms p(90)=50.53ms  p(95)=57.26ms  p(99.9)=94.38ms
       { expected_response:true }...: avg=33.33ms  min=3.03ms med=30.29ms max=534.19ms p(90)=50.53ms  p(95)=57.26ms  p(99.9)=94.38ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 89159
     http_req_receiving.............: avg=157.6µs  min=26.9µs med=48.98µs max=302.49ms p(90)=158.55µs p(95)=406.2µs  p(99.9)=16.5ms 
     http_req_sending...............: avg=139.46µs min=5.62µs med=11.81µs max=468.52ms p(90)=49.68µs  p(95)=143.98µs p(99.9)=18.3ms 
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=33.04ms  min=2.97ms med=30.08ms max=511.4ms  p(90)=50.03ms  p(95)=56.8ms   p(99.9)=90.64ms
     http_reqs......................: 89159   1475.488736/s
     iteration_duration.............: avg=33.68ms  min=6.4ms  med=30.58ms max=596.41ms p(90)=50.82ms  p(95)=57.56ms  p(99.9)=96.43ms
     iterations.....................: 89059   1473.83384/s
     success_rate...................: 100.00% ✓ 89059       ✗ 0    
     vus............................: 50      min=50        max=50 
     vus_max........................: 50      min=50        max=50

Performance Overview

HTTP Overview

Summary for: cosmo

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 109641     ✗ 0    
     data_received..................: 3.2 GB  53 MB/s
     data_sent......................: 43 MB   704 kB/s
     http_req_blocked...............: avg=20.81µs  min=1.45µs  med=2.88µs  max=23.04ms  p(90)=4.42µs   p(95)=5.52µs   p(99.9)=7.65ms  
     http_req_connecting............: avg=16.38µs  min=0s      med=0s      max=23.02ms  p(90)=0s       p(95)=0s       p(99.9)=7.4ms   
     http_req_duration..............: avg=81.53ms  min=3.04ms  med=79.95ms max=605.83ms p(90)=110.99ms p(95)=121ms    p(99.9)=361.55ms
       { expected_response:true }...: avg=81.53ms  min=3.04ms  med=79.95ms max=605.83ms p(90)=110.99ms p(95)=121ms    p(99.9)=361.55ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 36647
     http_req_receiving.............: avg=185.28µs min=33.22µs med=78.28µs max=378.27ms p(90)=161.88µs p(95)=421.01µs p(99.9)=16.34ms 
     http_req_sending...............: avg=67.19µs  min=6.73µs  med=11.67µs max=369.89ms p(90)=32.14µs  p(95)=135.62µs p(99.9)=4.07ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=81.28ms  min=2.96ms  med=79.68ms max=594.45ms p(90)=110.74ms p(95)=120.77ms p(99.9)=354.23ms
     http_reqs......................: 36647   605.138558/s
     iteration_duration.............: avg=82.08ms  min=5.32ms  med=80.31ms max=638.1ms  p(90)=111.34ms p(95)=121.41ms p(99.9)=389.73ms
     iterations.....................: 36547   603.487295/s
     success_rate...................: 100.00% ✓ 36547      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50

Performance Overview

HTTP Overview

Summary for: hive-gateway-router-runtime

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 35185 / ✗ 1
     ✓ valid response structure

     checks.........................: 99.99% ✓ 105557     ✗ 1    
     data_received..................: 3.1 GB 51 MB/s
     data_sent......................: 41 MB  675 kB/s
     http_req_blocked...............: avg=25.23µs  min=1.24µs  med=3.01µs  max=21.62ms  p(90)=4.64µs   p(95)=5.91µs   p(99.9)=12.97ms 
     http_req_connecting............: avg=20.56µs  min=0s      med=0s      max=21.06ms  p(90)=0s       p(95)=0s       p(99.9)=12.53ms 
     http_req_duration..............: avg=84.72ms  min=5.21ms  med=82.35ms max=600.11ms p(90)=104.79ms p(95)=113.51ms p(99.9)=385.54ms
       { expected_response:true }...: avg=84.72ms  min=5.21ms  med=82.35ms max=600.11ms p(90)=104.79ms p(95)=113.51ms p(99.9)=385.54ms
     http_req_failed................: 0.00%  ✓ 0          ✗ 35286
     http_req_receiving.............: avg=114.54µs min=26.96µs med=55.85µs max=19.8ms   p(90)=122.67µs p(95)=318.62µs p(99.9)=6.89ms  
     http_req_sending...............: avg=112.12µs min=5.7µs   med=11.71µs max=462.63ms p(90)=32.91µs  p(95)=135.22µs p(99.9)=7.29ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=84.49ms  min=5.16ms  med=82.2ms  max=599.18ms p(90)=104.54ms p(95)=113.27ms p(99.9)=358.23ms
     http_reqs......................: 35286  580.782168/s
     iteration_duration.............: avg=85.32ms  min=13.45ms med=82.68ms max=658.6ms  p(90)=105.16ms p(95)=113.91ms p(99.9)=405.86ms
     iterations.....................: 35186  579.13624/s
     success_rate...................: 99.99% ✓ 35185      ✗ 1    
     vus............................: 50     min=50       max=50 
     vus_max........................: 50     min=50       max=50

Performance Overview

HTTP Overview

Summary for: apollo-router

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  0% — ✓ 0 / ✗ 16518
     ✗ valid response structure
      ↳  99% — ✓ 16468 / ✗ 50

     checks.........................: 66.56% ✓ 32986      ✗ 16568
     data_received..................: 1.7 GB 28 MB/s
     data_sent......................: 19 MB  317 kB/s
     http_req_blocked...............: avg=20.2µs   min=1.88µs  med=3.79µs   max=10.15ms  p(90)=6.32µs   p(95)=7.78µs   p(99.9)=6.81ms  
     http_req_connecting............: avg=15.13µs  min=0s      med=0s       max=10.11ms  p(90)=0s       p(95)=0s       p(99.9)=6.76ms  
     http_req_duration..............: avg=177.17ms min=6.86ms  med=168.7ms  max=557.38ms p(90)=248.36ms p(95)=287.94ms p(99.9)=462.5ms 
       { expected_response:true }...: avg=177.17ms min=6.86ms  med=168.7ms  max=557.38ms p(90)=248.36ms p(95)=287.94ms p(99.9)=462.5ms 
     http_req_failed................: 0.00%  ✓ 0          ✗ 16618
     http_req_receiving.............: avg=289.36µs min=29.53µs med=60.29µs  max=99.96ms  p(90)=118.08µs p(95)=332.28µs p(99.9)=37.57ms 
     http_req_sending...............: avg=1.41ms   min=8.07µs  med=15.1µs   max=154.82ms p(90)=1.84ms   p(95)=6.44ms   p(99.9)=80.61ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=175.46ms min=6.81ms  med=167.39ms max=556.98ms p(90)=245.62ms p(95)=285.62ms p(99.9)=461.84ms
     http_reqs......................: 16618  272.229403/s
     iteration_duration.............: avg=181.82ms min=64.31ms med=171.59ms max=864.13ms p(90)=252.54ms p(95)=292.68ms p(99.9)=738.13ms
     iterations.....................: 16518  270.591243/s
     success_rate...................: 0.00%  ✓ 0          ✗ 16518
     vus............................: 25     min=25       max=50 
     vus_max........................: 50     min=50       max=50

Performance Overview

HTTP Overview

Summary for: hive-gateway

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  88% — ✓ 11320 / ✗ 1422
     ✓ valid response structure

     checks.........................: 96.28% ✓ 36804      ✗ 1422 
     data_received..................: 1.2 GB 19 MB/s
     data_sent......................: 15 MB  244 kB/s
     http_req_blocked...............: avg=66.23µs  min=1.23µs  med=3.03µs   max=22.89ms  p(90)=5.21µs   p(95)=6.71µs   p(99.9)=20.29ms
     http_req_connecting............: avg=61.01µs  min=0s      med=0s       max=22.83ms  p(90)=0s       p(95)=0s       p(99.9)=20.21ms
     http_req_duration..............: avg=232.95ms min=7.22ms  med=170.22ms max=2.08s    p(90)=408.04ms p(95)=525.92ms p(99.9)=2.05s  
       { expected_response:true }...: avg=232.95ms min=7.22ms  med=170.22ms max=2.08s    p(90)=408.04ms p(95)=525.92ms p(99.9)=2.05s  
     http_req_failed................: 0.00%  ✓ 0          ✗ 12842
     http_req_receiving.............: avg=147.07µs min=29.23µs med=66.88µs  max=51.48ms  p(90)=149.75µs p(95)=364.13µs p(99.9)=8.51ms 
     http_req_sending...............: avg=306.31µs min=5.45µs  med=12.18µs  max=389.12ms p(90)=45.07µs  p(95)=240.57µs p(99.9)=40.21ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=232.5ms  min=7.1ms   med=169.91ms max=2.08s    p(90)=407.32ms p(95)=525.48ms p(99.9)=2.05s  
     http_reqs......................: 12842  209.651245/s
     iteration_duration.............: avg=235.93ms min=35.72ms med=171.1ms  max=2.08s    p(90)=411.65ms p(95)=533.93ms p(99.9)=2.05s  
     iterations.....................: 12742  208.018701/s
     success_rate...................: 88.84% ✓ 11320      ✗ 1422 
     vus............................: 50     min=0        max=50 
     vus_max........................: 50     min=50       max=50

Performance Overview

HTTP Overview

Summary for: apollo-gateway

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  0% — ✓ 0 / ✗ 6914
     ✗ valid response structure
      ↳  99% — ✓ 6864 / ✗ 50

     checks.........................: 66.42% ✓ 13778      ✗ 6964
     data_received..................: 617 MB 10 MB/s
     data_sent......................: 8.2 MB 133 kB/s
     http_req_blocked...............: avg=37.43µs  min=1.34µs  med=4.12µs   max=9.23ms   p(90)=6.23µs   p(95)=7.07µs   p(99.9)=7.72ms  
     http_req_connecting............: avg=32.65µs  min=0s      med=0s       max=9.19ms   p(90)=0s       p(95)=0s       p(99.9)=7.69ms  
     http_req_duration..............: avg=426.62ms min=7.44ms  med=423.29ms max=915.77ms p(90)=499.31ms p(95)=525.59ms p(99.9)=815.85ms
       { expected_response:true }...: avg=426.62ms min=7.44ms  med=423.29ms max=915.77ms p(90)=499.31ms p(95)=525.59ms p(99.9)=815.85ms
     http_req_failed................: 0.00%  ✓ 0          ✗ 7014
     http_req_receiving.............: avg=75.61µs  min=32.33µs med=64.35µs  max=6.95ms   p(90)=104.67µs p(95)=120.73µs p(99.9)=1.06ms  
     http_req_sending...............: avg=164.68µs min=6.39µs  med=15.99µs  max=209.01ms p(90)=37.24µs  p(95)=694.26µs p(99.9)=5.14ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=426.38ms min=7.32ms  med=422.99ms max=914.65ms p(90)=499.1ms  p(95)=525.2ms  p(99.9)=814.64ms
     http_reqs......................: 7014   114.656608/s
     iteration_duration.............: avg=435.07ms min=97.7ms  med=425.74ms max=992.26ms p(90)=502.51ms p(95)=530.54ms p(99.9)=834.3ms 
     iterations.....................: 6914   113.021926/s
     success_rate...................: 0.00%  ✓ 0          ✗ 6914
     vus............................: 38     min=38       max=50
     vus_max........................: 50     min=50       max=50

Performance Overview

HTTP Overview

enisdenjo added 2 commits December 8, 2025 15:03

yes sir

ad8ab66

expected response

77544bc

enisdenjo mentioned this pull request Dec 8, 2025

test: Populate entity's external fields in E2E inventory subgraph graphql-hive/router#603

Merged

github-actions bot deployed to preview December 8, 2025 14:05 View deployment

publish report comment on pull request always

4eeaf68

github-actions bot deployed to preview December 8, 2025 15:22 View deployment

enisdenjo marked this pull request as draft December 8, 2025 15:45

github-actions and others added 3 commits December 8, 2025 15:56

Update results for scenario: ramping-vus

e686ecb

Update results for scenario: constant-vus-over-time

1b80fd1

lets see

5df45df

github-actions bot deployed to preview December 8, 2025 16:17 View deployment

make sure logs are accurate

539f7d6

github-actions bot deployed to preview December 8, 2025 16:33 View deployment

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Populate entity's external fields in inventory subgraph#894

Populate entity's external fields in inventory subgraph#894
enisdenjo wants to merge 7 commits intomainfrom
ok-resolve

enisdenjo commented Dec 8, 2025 •

edited

Loading

Uh oh!

github-actions bot commented Dec 8, 2025 •

edited

Loading

Uh oh!

github-actions bot commented Dec 8, 2025 •

edited

Loading

Uh oh!

github-actions bot commented Dec 8, 2025 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Conversation

enisdenjo commented Dec 8, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Also

Uh oh!

github-actions bot commented Dec 8, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

💻 Website Preview

Uh oh!

github-actions bot commented Dec 8, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Overview for: ramping-vus

Comparison

Uh oh!

github-actions bot commented Dec 8, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Overview for: constant-vus-over-time

Comparison

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

enisdenjo commented Dec 8, 2025 •

edited

Loading

github-actions bot commented Dec 8, 2025 •

edited

Loading

github-actions bot commented Dec 8, 2025 •

edited

Loading

Overview for: `ramping-vus`

github-actions bot commented Dec 8, 2025 •

edited

Loading

Overview for: `constant-vus-over-time`