Conversation
💻 Website PreviewThe latest changes are available as preview in: https://32ec42c7.federation-gateway-benchmark.pages.dev |
Overview for:
|
| Gateway | RPS ⬇️ | Requests | Duration | Notes |
|---|---|---|---|---|
| hive-router | 1853 | 115814 total, 0 failed | avg: 120ms, p95: 299ms | ✅ |
| grafbase | 1586 | 100520 total, 0 failed | avg: 138ms, p95: 332ms | ✅ |
| cosmo | 694 | 44393 total, 0 failed | avg: 316ms, p95: 692ms | ✅ |
| hive-gateway-router-runtime | 566 | 37492 total, 0 failed | avg: 375ms, p95: 776ms | ❌ non-compatible response structure (2) |
| apollo-router | 392 | 26255 total, 0 failed | avg: 537ms, p95: 1235ms | ❌ 26 unexpected GraphQL errors |
| hive-gateway | 281 | 19207 total, 0 failed | avg: 732ms, p95: 1609ms | ✅ |
| apollo-gateway | 123 | 8732 total, 0 failed | avg: 1421ms, p95: 2722ms | ✅ |
Summary for: hive-router
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
checks.........................: 100.00% ✓ 344442 ✗ 0
data_received..................: 10 GB 163 MB/s
data_sent......................: 135 MB 2.2 MB/s
http_req_blocked...............: avg=355.96µs min=1.23µs med=2.69µs max=319.95ms p(90)=4.19µs p(95)=4.99µs p(99.9)=133.51ms
http_req_connecting............: avg=351.27µs min=0s med=0s max=302.96ms p(90)=0s p(95)=0s p(99.9)=133.46ms
http_req_duration..............: avg=120.38ms min=1.96ms med=106.63ms max=454.49ms p(90)=248.67ms p(95)=299.08ms p(99.9)=413.48ms
{ expected_response:true }...: avg=120.38ms min=1.96ms med=106.63ms max=454.49ms p(90)=248.67ms p(95)=299.08ms p(99.9)=413.48ms
http_req_failed................: 0.00% ✓ 0 ✗ 115814
http_req_receiving.............: avg=454.44µs min=24.33µs med=43.01µs max=139.7ms p(90)=160.45µs p(95)=408.77µs p(99.9)=69.16ms
http_req_sending...............: avg=345.61µs min=5.36µs med=10.37µs max=148.25ms p(90)=30.07µs p(95)=131.65µs p(99.9)=65.36ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=119.58ms min=1.91ms med=105.99ms max=454.44ms p(90)=246.49ms p(95)=297.45ms p(99.9)=411ms
http_reqs......................: 115814 1853.18832/s
iteration_duration.............: avg=122.04ms min=2.08ms med=107.97ms max=748.51ms p(90)=250.88ms p(95)=301.19ms p(99.9)=431.16ms
iterations.....................: 114814 1837.186901/s
success_rate...................: 100.00% ✓ 114814 ✗ 0
vus............................: 84 min=0 max=497
vus_max........................: 500 min=500 max=500
Performance Overview
HTTP Overview
Summary for: grafbase
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
checks.........................: 100.00% ✓ 298560 ✗ 0
data_received..................: 8.8 GB 139 MB/s
data_sent......................: 117 MB 1.8 MB/s
http_req_blocked...............: avg=585.11µs min=1.33µs med=3.12µs max=403.55ms p(90)=4.69µs p(95)=5.76µs p(99.9)=196.95ms
http_req_connecting............: avg=576.83µs min=0s med=0s max=373.87ms p(90)=0s p(95)=0s p(99.9)=195.7ms
http_req_duration..............: avg=138.47ms min=2.64ms med=124.96ms max=515.27ms p(90)=279.7ms p(95)=332.31ms p(99.9)=425.35ms
{ expected_response:true }...: avg=138.47ms min=2.64ms med=124.96ms max=515.27ms p(90)=279.7ms p(95)=332.31ms p(99.9)=425.35ms
http_req_failed................: 0.00% ✓ 0 ✗ 100520
http_req_receiving.............: avg=610.75µs min=26.44µs med=49.82µs max=136.39ms p(90)=258.28µs p(95)=475.04µs p(99.9)=81.65ms
http_req_sending...............: avg=495.28µs min=5.45µs med=11.86µs max=172.67ms p(90)=34.95µs p(95)=149.12µs p(99.9)=81.96ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=137.36ms min=2.6ms med=123.87ms max=485.02ms p(90)=277.2ms p(95)=330.23ms p(99.9)=420.23ms
http_reqs......................: 100520 1586.689419/s
iteration_duration.............: avg=140.82ms min=3.39ms med=126.95ms max=1.23s p(90)=282.66ms p(95)=334.81ms p(99.9)=494.38ms
iterations.....................: 99520 1570.904606/s
success_rate...................: 100.00% ✓ 99520 ✗ 0
vus............................: 75 min=0 max=494
vus_max........................: 500 min=500 max=500
Performance Overview
HTTP Overview
Summary for: cosmo
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
checks.........................: 100.00% ✓ 130179 ✗ 0
data_received..................: 3.9 GB 61 MB/s
data_sent......................: 52 MB 809 kB/s
http_req_blocked...............: avg=95.82µs min=1.31µs med=2.79µs max=181.4ms p(90)=4.35µs p(95)=6.42µs p(99.9)=27.99ms
http_req_connecting............: avg=88.33µs min=0s med=0s max=181.34ms p(90)=0s p(95)=0s p(99.9)=26.47ms
http_req_duration..............: avg=316.34ms min=2.92ms med=300.82ms max=1.16s p(90)=619.39ms p(95)=691.71ms p(99.9)=981.2ms
{ expected_response:true }...: avg=316.34ms min=2.92ms med=300.82ms max=1.16s p(90)=619.39ms p(95)=691.71ms p(99.9)=981.2ms
http_req_failed................: 0.00% ✓ 0 ✗ 44393
http_req_receiving.............: avg=489.83µs min=28.21µs med=62.17µs max=195.37ms p(90)=190.03µs p(95)=464.52µs p(99.9)=71.53ms
http_req_sending...............: avg=144.3µs min=5.76µs med=11.15µs max=151.3ms p(90)=30.55µs p(95)=128.62µs p(99.9)=28.32ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=315.7ms min=2.83ms med=300.12ms max=1.15s p(90)=618.67ms p(95)=690.68ms p(99.9)=978.33ms
http_reqs......................: 44393 694.709002/s
iteration_duration.............: avg=324.1ms min=3.21ms med=309.01ms max=1.16s p(90)=622.52ms p(95)=694.94ms p(99.9)=988.83ms
iterations.....................: 43393 679.059936/s
success_rate...................: 100.00% ✓ 43393 ✗ 0
vus............................: 58 min=0 max=498
vus_max........................: 500 min=500 max=500
Performance Overview
HTTP Overview
Summary for: hive-gateway-router-runtime
K6 Output
✓ response code was 200
✓ no graphql errors
✗ valid response structure
↳ 99% — ✓ 36490 / ✗ 2
checks.........................: 99.99% ✓ 109474 ✗ 2
data_received..................: 3.3 GB 50 MB/s
data_sent......................: 44 MB 660 kB/s
http_req_blocked...............: avg=169.11µs min=1.3µs med=2.89µs max=190.71ms p(90)=4.69µs p(95)=6.71µs p(99.9)=52.86ms
http_req_connecting............: avg=163.93µs min=0s med=0s max=190.53ms p(90)=0s p(95)=0s p(99.9)=52.72ms
http_req_duration..............: avg=375ms min=4.93ms med=362.84ms max=1.25s p(90)=718.15ms p(95)=775.9ms p(99.9)=1.07s
{ expected_response:true }...: avg=375ms min=4.93ms med=362.84ms max=1.25s p(90)=718.15ms p(95)=775.9ms p(99.9)=1.07s
http_req_failed................: 0.00% ✓ 0 ✗ 37492
http_req_receiving.............: avg=259.33µs min=27.32µs med=47.62µs max=154.96ms p(90)=101.11µs p(95)=338.27µs p(99.9)=50.96ms
http_req_sending...............: avg=259.89µs min=5.64µs med=11.3µs max=178.01ms p(90)=29.35µs p(95)=128.7µs p(99.9)=45.58ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=374.48ms min=4.88ms med=362.05ms max=1.25s p(90)=717.58ms p(95)=775.16ms p(99.9)=1.06s
http_reqs......................: 37492 566.696374/s
iteration_duration.............: avg=385.84ms min=5.69ms med=374.4ms max=1.33s p(90)=721.13ms p(95)=778.29ms p(99.9)=1.07s
iterations.....................: 36492 551.581246/s
success_rate...................: 99.99% ✓ 36490 ✗ 2
vus............................: 71 min=0 max=495
vus_max........................: 500 min=500 max=500
Performance Overview
HTTP Overview
Summary for: apollo-router
K6 Output
✓ response code was 200
✗ no graphql errors
↳ 99% — ✓ 25229 / ✗ 26
✓ valid response structure
checks.........................: 99.96% ✓ 75739 ✗ 26
data_received..................: 2.3 GB 35 MB/s
data_sent......................: 31 MB 458 kB/s
http_req_blocked...............: avg=59.44µs min=1.3µs med=3.05µs max=73.07ms p(90)=4.58µs p(95)=5.98µs p(99.9)=18.24ms
http_req_connecting............: avg=54.25µs min=0s med=0s max=73.02ms p(90)=0s p(95)=0s p(99.9)=18.19ms
http_req_duration..............: avg=537.18ms min=5.98ms med=492.11ms max=1.82s p(90)=1.09s p(95)=1.23s p(99.9)=1.68s
{ expected_response:true }...: avg=537.18ms min=5.98ms med=492.11ms max=1.82s p(90)=1.09s p(95)=1.23s p(99.9)=1.68s
http_req_failed................: 0.00% ✓ 0 ✗ 26255
http_req_receiving.............: avg=89.78µs min=24.21µs med=50.02µs max=41.36ms p(90)=85.55µs p(95)=139.7µs p(99.9)=4.03ms
http_req_sending...............: avg=72.1µs min=4.64µs med=10.78µs max=53.55ms p(90)=20.63µs p(95)=85.22µs p(99.9)=11.92ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=537.02ms min=5.92ms med=492.01ms max=1.82s p(90)=1.08s p(95)=1.23s p(99.9)=1.68s
http_reqs......................: 26255 392.807315/s
iteration_duration.............: avg=558.76ms min=6.39ms med=518.34ms max=1.82s p(90)=1.09s p(95)=1.24s p(99.9)=1.68s
iterations.....................: 25255 377.846076/s
success_rate...................: 99.89% ✓ 25229 ✗ 26
vus............................: 57 min=0 max=499
vus_max........................: 500 min=500 max=500
Performance Overview
HTTP Overview
Summary for: hive-gateway
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
checks.........................: 100.00% ✓ 54621 ✗ 0
data_received..................: 1.7 GB 25 MB/s
data_sent......................: 23 MB 330 kB/s
http_req_blocked...............: avg=122.87µs min=1.3µs med=2.72µs max=152.52ms p(90)=4.61µs p(95)=7.03µs p(99.9)=33.41ms
http_req_connecting............: avg=117.53µs min=0s med=0s max=152.47ms p(90)=0s p(95)=0s p(99.9)=33.35ms
http_req_duration..............: avg=731.5ms min=6.02ms med=653.1ms max=3.93s p(90)=1.46s p(95)=1.6s p(99.9)=3.26s
{ expected_response:true }...: avg=731.5ms min=6.02ms med=653.1ms max=3.93s p(90)=1.46s p(95)=1.6s p(99.9)=3.26s
http_req_failed................: 0.00% ✓ 0 ✗ 19207
http_req_receiving.............: avg=218.66µs min=25.02µs med=44.32µs max=175.91ms p(90)=96.38µs p(95)=214.12µs p(99.9)=36.34ms
http_req_sending...............: avg=188.24µs min=5.48µs med=10.75µs max=108.71ms p(90)=30.11µs p(95)=118.47µs p(99.9)=34.9ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=731.1ms min=5.97ms med=652.81ms max=3.93s p(90)=1.46s p(95)=1.6s p(99.9)=3.26s
http_reqs......................: 19207 281.736589/s
iteration_duration.............: avg=772.1ms min=7.75ms med=719.22ms max=3.94s p(90)=1.48s p(95)=1.61s p(99.9)=3.31s
iterations.....................: 18207 267.068157/s
success_rate...................: 100.00% ✓ 18207 ✗ 0
vus............................: 74 min=0 max=500
vus_max........................: 500 min=500 max=500
Performance Overview
HTTP Overview
Summary for: apollo-gateway
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
checks.........................: 100.00% ✓ 23196 ✗ 0
data_received..................: 767 MB 11 MB/s
data_sent......................: 11 MB 150 kB/s
http_req_blocked...............: avg=24.47µs min=1.34µs med=3.05µs max=21.76ms p(90)=4.61µs p(95)=8.6µs p(99.9)=3.52ms
http_req_connecting............: avg=19.06µs min=0s med=0s max=21.71ms p(90)=0s p(95)=0s p(99.9)=3.46ms
http_req_duration..............: avg=1.42s min=9.1ms med=1.39s max=18.99s p(90)=2.43s p(95)=2.72s p(99.9)=17.67s
{ expected_response:true }...: avg=1.42s min=9.1ms med=1.39s max=18.99s p(90)=2.43s p(95)=2.72s p(99.9)=17.67s
http_req_failed................: 0.00% ✓ 0 ✗ 8732
http_req_receiving.............: avg=64.36µs min=27.63µs med=50.04µs max=3.01ms p(90)=89.09µs p(95)=107.75µs p(99.9)=1.04ms
http_req_sending...............: avg=32.48µs min=5.91µs med=11.72µs max=26.24ms p(90)=23.01µs p(95)=42.37µs p(99.9)=5.8ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=1.42s min=9.06ms med=1.39s max=18.99s p(90)=2.43s p(95)=2.72s p(99.9)=17.67s
http_reqs......................: 8732 123.849004/s
iteration_duration.............: avg=1.6s min=10.26ms med=1.59s max=19s p(90)=2.47s p(95)=2.8s p(99.9)=17.82s
iterations.....................: 7732 109.665655/s
success_rate...................: 100.00% ✓ 7732 ✗ 0
vus............................: 106 min=0 max=500
vus_max........................: 500 min=500 max=500
Performance Overview
HTTP Overview
This PR contains the following updates:
24.13→24.14Release Notes
actions/node-versions (node)
v24.14.0: 24.14.0Compare Source
Node.js 24.14.0
Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Enabled.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this PR and you won't be reminded about this update again.
This PR was generated by Mend Renovate. View the repository job log.