-
Notifications
You must be signed in to change notification settings - Fork 8
No jit no fork for Hive Gateway #718
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
Overview for:
|
Gateway | RPS ⬇️ | Requests | Duration | Notes |
---|---|---|---|---|
cosmo | 177 | 5504 total, 0 failed | avg: 826ms, p95: 2109ms | ✅ |
grafbase | 162 | 5022 total, 0 failed | avg: 947ms, p95: 2785ms | ✅ |
apollo-router | 156 | 4838 total, 0 failed | avg: 989ms, p95: 3152ms | ✅ |
apollo-server | 85 | 2874 total, 0 failed | avg: 3288ms, p95: 27155ms | ✅ |
hive-gateway | 80 | 2691 total, 0 failed | avg: 3487ms, p95: 31440ms | ✅ |
mercurius | 78 | 2523 total, 0 failed | avg: 3662ms, p95: 4753ms | ✅ |
hive-gateway-bun | 77 | 2600 total, 0 failed | avg: 3694ms, p95: 5600ms | ✅ |
Summary for: `cosmo`
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
█ setup
checks.........................: 100.00% ✓ 16452 ✗ 0
data_received..................: 483 MB 16 MB/s
data_sent......................: 6.5 MB 211 kB/s
http_req_blocked...............: avg=1.95ms min=1.6µs med=3.28µs max=1.16s p(90)=5.82µs p(95)=2.12ms
http_req_connecting............: avg=1.72ms min=0s med=0s max=1.16s p(90)=0s p(95)=1.76ms
http_req_duration..............: avg=825.74ms min=3.34ms med=659.19ms max=6.12s p(90)=1.72s p(95)=2.1s
{ expected_response:true }...: avg=825.74ms min=3.34ms med=659.19ms max=6.12s p(90)=1.72s p(95)=2.1s
http_req_failed................: 0.00% ✓ 0 ✗ 5504
http_req_receiving.............: avg=344.87ms min=35.94µs med=115.45µs max=5.85s p(90)=1.16s p(95)=1.61s
http_req_sending...............: avg=19.27ms min=8.51µs med=14.72µs max=2.38s p(90)=215.21µs p(95)=22.42ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=461.58ms min=3.17ms med=431.25ms max=2.55s p(90)=856.25ms p(95)=1.01s
http_reqs......................: 5504 177.519485/s
iteration_duration.............: avg=1.64s min=21.36ms med=1.37s max=7.81s p(90)=3.43s p(95)=4.19s
iterations.....................: 5484 176.874429/s
vus............................: 13 min=13 max=300
vus_max........................: 300 min=300 max=300
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `grafbase`
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
█ setup
checks.........................: 100.00% ✓ 15006 ✗ 0
data_received..................: 441 MB 14 MB/s
data_sent......................: 6.0 MB 193 kB/s
http_req_blocked...............: avg=1.73ms min=1.69µs med=4.37µs max=948.74ms p(90)=7.32µs p(95)=1.74ms
http_req_connecting............: avg=1.3ms min=0s med=0s max=945.57ms p(90)=0s p(95)=1.11ms
http_req_duration..............: avg=946.69ms min=3.51ms med=703.9ms max=5.44s p(90)=2.27s p(95)=2.78s
{ expected_response:true }...: avg=946.69ms min=3.51ms med=703.9ms max=5.44s p(90)=2.27s p(95)=2.78s
http_req_failed................: 0.00% ✓ 0 ✗ 5022
http_req_receiving.............: avg=407.7ms min=35.61µs med=118.73µs max=4.78s p(90)=1.57s p(95)=2.06s
http_req_sending...............: avg=19.82ms min=8.25µs med=21.82µs max=3.31s p(90)=379.72µs p(95)=11.54ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=519.15ms min=3.43ms med=445.42ms max=2.44s p(90)=1.04s p(95)=1.37s
http_reqs......................: 5022 162.649223/s
iteration_duration.............: avg=1.81s min=20.24ms med=1.51s max=7.88s p(90)=3.8s p(95)=4.48s
iterations.....................: 5002 162.001476/s
vus............................: 300 min=300 max=300
vus_max........................: 300 min=300 max=300
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `apollo-router`
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
█ setup
checks.........................: 100.00% ✓ 14454 ✗ 0
data_received..................: 425 MB 14 MB/s
data_sent......................: 5.7 MB 186 kB/s
http_req_blocked...............: avg=1.72ms min=1.53µs med=3.51µs max=1.24s p(90)=6.05µs p(95)=2.42ms
http_req_connecting............: avg=1.56ms min=0s med=0s max=1.24s p(90)=0s p(95)=2.01ms
http_req_duration..............: avg=989.17ms min=6.46ms med=590.27ms max=6.46s p(90)=2.62s p(95)=3.15s
{ expected_response:true }...: avg=989.17ms min=6.46ms med=590.27ms max=6.46s p(90)=2.62s p(95)=3.15s
http_req_failed................: 0.00% ✓ 0 ✗ 4838
http_req_receiving.............: avg=512.24ms min=33.63µs med=97.46µs max=6.34s p(90)=2.06s p(95)=2.6s
http_req_sending...............: avg=17.72ms min=8.55µs med=16.78µs max=3s p(90)=189.53µs p(95)=4.45ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=459.2ms min=6.37ms med=400.51ms max=1.89s p(90)=869.13ms p(95)=1.03s
http_reqs......................: 4838 156.771112/s
iteration_duration.............: avg=1.89s min=22.68ms med=1.38s max=9.78s p(90)=4.26s p(95)=5.17s
iterations.....................: 4818 156.12303/s
vus............................: 298 min=298 max=300
vus_max........................: 300 min=300 max=300
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `apollo-server`
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
█ setup
checks.........................: 100.00% ✓ 8562 ✗ 0
data_received..................: 252 MB 7.5 MB/s
data_sent......................: 3.4 MB 102 kB/s
http_req_blocked...............: avg=705.36µs min=1.52µs med=3.8µs max=17.91ms p(90)=191.36µs p(95)=6.1ms
http_req_connecting............: avg=678.16µs min=0s med=0s max=17.88ms p(90)=120.43µs p(95)=5.79ms
http_req_duration..............: avg=3.28s min=11.49ms med=1.42s max=33.05s p(90)=2.07s p(95)=27.15s
{ expected_response:true }...: avg=3.28s min=11.49ms med=1.42s max=33.05s p(90)=2.07s p(95)=27.15s
http_req_failed................: 0.00% ✓ 0 ✗ 2874
http_req_receiving.............: avg=387.6µs min=45.13µs med=110.57µs max=67.17ms p(90)=225.22µs p(95)=393.39µs
http_req_sending...............: avg=260.72µs min=9.18µs med=19.27µs max=24.85ms p(90)=142.24µs p(95)=2.57ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=3.28s min=11.4ms med=1.42s max=33.05s p(90)=2.07s p(95)=27.15s
http_reqs......................: 2874 85.858656/s
iteration_duration.............: avg=3.32s min=375.56ms med=1.44s max=33.06s p(90)=2.09s p(95)=27.45s
iterations.....................: 2854 85.261171/s
vus............................: 51 min=51 max=300
vus_max........................: 300 min=300 max=300
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `hive-gateway`
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
█ setup
checks.........................: 100.00% ✓ 8013 ✗ 0
data_received..................: 236 MB 7.1 MB/s
data_sent......................: 3.2 MB 96 kB/s
http_req_blocked...............: avg=586.69µs min=1.58µs med=3.34µs max=13.17ms p(90)=211.99µs p(95)=5.33ms
http_req_connecting............: avg=571.45µs min=0s med=0s max=13.14ms p(90)=155.63µs p(95)=5.22ms
http_req_duration..............: avg=3.48s min=11.67ms med=1.4s max=33.05s p(90)=2.02s p(95)=31.43s
{ expected_response:true }...: avg=3.48s min=11.67ms med=1.4s max=33.05s p(90)=2.02s p(95)=31.43s
http_req_failed................: 0.00% ✓ 0 ✗ 2691
http_req_receiving.............: avg=242.12µs min=42.62µs med=101.46µs max=108.69ms p(90)=193.23µs p(95)=292.7µs
http_req_sending...............: avg=119.44µs min=8.83µs med=16.9µs max=25.23ms p(90)=143.76µs p(95)=663.92µs
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=3.48s min=11.53ms med=1.4s max=33.05s p(90)=2.02s p(95)=31.43s
http_reqs......................: 2691 80.468011/s
iteration_duration.............: avg=3.52s min=330.98ms med=1.42s max=33.06s p(90)=2.07s p(95)=31.48s
iterations.....................: 2671 79.869958/s
vus............................: 38 min=38 max=300
vus_max........................: 300 min=300 max=300
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `mercurius`
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
█ setup
checks.........................: 100.00% ✓ 7509 ✗ 0
data_received..................: 222 MB 6.9 MB/s
data_sent......................: 3.0 MB 93 kB/s
http_req_blocked...............: avg=3.72ms min=1.66µs med=3.66µs max=77.92ms p(90)=1.82ms p(95)=34.3ms
http_req_connecting............: avg=3.61ms min=0s med=0s max=73.11ms p(90)=1.27ms p(95)=33.69ms
http_req_duration..............: avg=3.66s min=13.25ms med=3.65s max=7.45s p(90)=4.34s p(95)=4.75s
{ expected_response:true }...: avg=3.66s min=13.25ms med=3.65s max=7.45s p(90)=4.34s p(95)=4.75s
http_req_failed................: 0.00% ✓ 0 ✗ 2523
http_req_receiving.............: avg=14.52ms min=38.26µs med=98.75µs max=1.2s p(90)=339.91µs p(95)=1.97ms
http_req_sending...............: avg=947.79µs min=9.26µs med=19.54µs max=41.36ms p(90)=888.61µs p(95)=8.73ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=3.64s min=13.17ms med=3.64s max=7.45s p(90)=4.33s p(95)=4.75s
http_reqs......................: 2523 78.248048/s
iteration_duration.............: avg=3.72s min=491.25ms med=3.68s max=7.47s p(90)=4.36s p(95)=4.77s
iterations.....................: 2503 77.62777/s
vus............................: 94 min=94 max=300
vus_max........................: 300 min=300 max=300
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `hive-gateway-bun`
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
█ setup
checks.........................: 100.00% ✓ 7740 ✗ 0
data_received..................: 228 MB 6.8 MB/s
data_sent......................: 3.1 MB 92 kB/s
http_req_blocked...............: avg=1.9ms min=1.51µs med=3.13µs max=56.01ms p(90)=2.08ms p(95)=18.9ms
http_req_connecting............: avg=1.82ms min=0s med=0s max=43.14ms p(90)=1.37ms p(95)=18.69ms
http_req_duration..............: avg=3.69s min=14.9ms med=3.4s max=8.25s p(90)=5.2s p(95)=5.6s
{ expected_response:true }...: avg=3.69s min=14.9ms med=3.4s max=8.25s p(90)=5.2s p(95)=5.6s
http_req_failed................: 0.00% ✓ 0 ✗ 2600
http_req_receiving.............: avg=91.22ms min=43.35µs med=254.31µs max=2.25s p(90)=5.78ms p(95)=971.45ms
http_req_sending...............: avg=353.16µs min=8.78µs med=15.29µs max=41.65ms p(90)=192.08µs p(95)=1.81ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=3.6s min=14.64ms med=3.37s max=7.86s p(90)=5.06s p(95)=5.55s
http_reqs......................: 2600 77.087923/s
iteration_duration.............: avg=3.74s min=79.33ms med=3.41s max=8.26s p(90)=5.24s p(95)=5.61s
iterations.....................: 2580 76.494939/s
vus............................: 105 min=105 max=300
vus_max........................: 300 min=300 max=300
Performance Overview
Subgraphs Overview
HTTP Overview
Overview for:
|
Gateway | RPS ⬇️ | Requests | Duration | Notes |
---|---|---|---|---|
cosmo | 176 | 5570 total, 0 failed | avg: 1422ms, p95: 3480ms | ✅ |
apollo-router | 158 | 4975 total, 12 failed | avg: 1586ms, p95: 4023ms | ❌ 12 failed requests, 12 non-200 responses, 12 unexpected GraphQL errors |
grafbase | 153 | 4827 total, 0 failed | avg: 1472ms, p95: 3592ms | ✅ |
apollo-server | 84 | 2998 total, 0 failed | avg: 5376ms, p95: 33256ms | ✅ |
hive-gateway | 79 | 2861 total, 0 failed | avg: 5684ms, p95: 33723ms | ✅ |
hive-gateway-bun | 78 | 2714 total, 0 failed | avg: 5820ms, p95: 9187ms | ✅ |
mercurius | 75 | 2485 total, 0 failed | avg: 6275ms, p95: 10955ms | ✅ |
Summary for: `cosmo`
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
█ setup
checks.........................: 100.00% ✓ 16650 ✗ 0
data_received..................: 489 MB 16 MB/s
data_sent......................: 6.6 MB 210 kB/s
http_req_blocked...............: avg=4.3ms min=1.61µs med=3.49µs max=2.32s p(90)=14.4µs p(95)=31.61ms
http_req_connecting............: avg=3.12ms min=0s med=0s max=1.41s p(90)=0s p(95)=30.87ms
http_req_duration..............: avg=1.42s min=3.74ms med=1.13s max=5.55s p(90)=3.02s p(95)=3.48s
{ expected_response:true }...: avg=1.42s min=3.74ms med=1.13s max=5.55s p(90)=3.02s p(95)=3.48s
http_req_failed................: 0.00% ✓ 0 ✗ 5570
http_req_receiving.............: avg=510.14ms min=30.36µs med=94.24µs max=5.06s p(90)=1.93s p(95)=2.51s
http_req_sending...............: avg=21.72ms min=8.42µs med=16.15µs max=4.51s p(90)=1.03ms p(95)=8.04ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=890.08ms min=3.58ms med=868.44ms max=3.71s p(90)=1.54s p(95)=1.68s
http_reqs......................: 5570 176.746331/s
iteration_duration.............: avg=2.73s min=27.83ms med=2.31s max=12.13s p(90)=5.23s p(95)=6.1s
iterations.....................: 5550 176.111694/s
vus............................: 218 min=218 max=500
vus_max........................: 500 min=500 max=500
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `apollo-router`
K6 Output
✗ response code was 200
↳ 99% — ✓ 4943 / ✗ 12
✗ no graphql errors
↳ 99% — ✓ 4943 / ✗ 12
✓ valid response structure
█ setup
checks.........................: 99.83% ✓ 14829 ✗ 24
data_received..................: 436 MB 14 MB/s
data_sent......................: 5.9 MB 188 kB/s
http_req_blocked...............: avg=14.98ms min=1.43µs med=3.78µs max=4.28s p(90)=858.06µs p(95)=30.86ms
http_req_connecting............: avg=14.1ms min=0s med=0s max=4.28s p(90)=449.95µs p(95)=30.49ms
http_req_duration..............: avg=1.58s min=7.03ms med=1.23s max=8.63s p(90)=3.42s p(95)=4.02s
{ expected_response:true }...: avg=1.58s min=7.03ms med=1.23s max=8.63s p(90)=3.42s p(95)=4.03s
http_req_failed................: 0.24% ✓ 12 ✗ 4963
http_req_receiving.............: avg=690.94ms min=0s med=420.25µs max=7.4s p(90)=2.42s p(95)=3.05s
http_req_sending...............: avg=36.2ms min=7.25µs med=19.46µs max=4.16s p(90)=4.2ms p(95)=15.76ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=859.16ms min=6.89ms med=804.89ms max=2.73s p(90)=1.53s p(95)=1.86s
http_reqs......................: 4975 158.633302/s
iteration_duration.............: avg=3.07s min=43.1ms med=2.58s max=15.47s p(90)=6.18s p(95)=7.42s
iterations.....................: 4955 157.995581/s
vus............................: 198 min=198 max=500
vus_max........................: 500 min=500 max=500
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `grafbase`
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
█ setup
checks.........................: 100.00% ✓ 14421 ✗ 0
data_received..................: 424 MB 13 MB/s
data_sent......................: 5.7 MB 182 kB/s
http_req_blocked...............: avg=5.06ms min=1.79µs med=5.06µs max=1.98s p(90)=123.4µs p(95)=32.81ms
http_req_connecting............: avg=4.21ms min=0s med=0s max=1.62s p(90)=78.01µs p(95)=25.86ms
http_req_duration..............: avg=1.47s min=3.7ms med=1.32s max=10.96s p(90)=2.73s p(95)=3.59s
{ expected_response:true }...: avg=1.47s min=3.7ms med=1.32s max=10.96s p(90)=2.73s p(95)=3.59s
http_req_failed................: 0.00% ✓ 0 ✗ 4827
http_req_receiving.............: avg=454.43ms min=35.25µs med=126.3µs max=9.2s p(90)=1.61s p(95)=2.13s
http_req_sending...............: avg=24.72ms min=7.96µs med=27.88µs max=4.43s p(90)=13.3ms p(95)=41.71ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=992.58ms min=3.52ms med=971.18ms max=2.97s p(90)=1.81s p(95)=2.06s
http_reqs......................: 4827 153.044859/s
iteration_duration.............: avg=3.18s min=33.31ms med=2.84s max=15.14s p(90)=5.8s p(95)=7.09s
iterations.....................: 4807 152.410739/s
vus............................: 269 min=269 max=500
vus_max........................: 500 min=500 max=500
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `apollo-server`
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
█ setup
checks.........................: 100.00% ✓ 8934 ✗ 0
data_received..................: 263 MB 7.5 MB/s
data_sent......................: 3.6 MB 101 kB/s
http_req_blocked...............: avg=2.27ms min=1.78µs med=4.34µs max=36.38ms p(90)=10.45ms p(95)=19.67ms
http_req_connecting............: avg=2.23ms min=0s med=0s max=27.2ms p(90)=10.29ms p(95)=19.48ms
http_req_duration..............: avg=5.37s min=11.82ms med=1.62s max=34.89s p(90)=31.71s p(95)=33.25s
{ expected_response:true }...: avg=5.37s min=11.82ms med=1.62s max=34.89s p(90)=31.71s p(95)=33.25s
http_req_failed................: 0.00% ✓ 0 ✗ 2998
http_req_receiving.............: avg=444.87µs min=43.06µs med=110.79µs max=119.78ms p(90)=240.5µs p(95)=415.3µs
http_req_sending...............: avg=355.26µs min=9.19µs med=23.82µs max=43.25ms p(90)=771.1µs p(95)=2.04ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=5.37s min=11.66ms med=1.62s max=34.89s p(90)=31.71s p(95)=33.25s
http_reqs......................: 2998 84.874735/s
iteration_duration.............: avg=5.43s min=384.25ms med=1.64s max=34.91s p(90)=31.74s p(95)=33.27s
iterations.....................: 2978 84.308526/s
vus............................: 34 min=34 max=500
vus_max........................: 500 min=500 max=500
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `hive-gateway`
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
█ setup
checks.........................: 100.00% ✓ 8523 ✗ 0
data_received..................: 251 MB 7.0 MB/s
data_sent......................: 3.4 MB 95 kB/s
http_req_blocked...............: avg=2.94ms min=1.52µs med=3.08µs max=38.49ms p(90)=11.69ms p(95)=25.68ms
http_req_connecting............: avg=2.88ms min=0s med=0s max=34.41ms p(90)=11.37ms p(95)=25.27ms
http_req_duration..............: avg=5.68s min=12.53ms med=1.76s max=35.44s p(90)=32.07s p(95)=33.72s
{ expected_response:true }...: avg=5.68s min=12.53ms med=1.76s max=35.44s p(90)=32.07s p(95)=33.72s
http_req_failed................: 0.00% ✓ 0 ✗ 2861
http_req_receiving.............: avg=490.83µs min=40.47µs med=104.12µs max=94.36ms p(90)=219.04µs p(95)=407.95µs
http_req_sending...............: avg=298.34µs min=8.87µs med=15.06µs max=30.35ms p(90)=746.37µs p(95)=1.45ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=5.68s min=12.44ms med=1.76s max=35.43s p(90)=32.07s p(95)=33.72s
http_reqs......................: 2861 79.720238/s
iteration_duration.............: avg=5.74s min=255.64ms med=1.78s max=35.45s p(90)=32.12s p(95)=33.75s
iterations.....................: 2841 79.162948/s
vus............................: 86 min=86 max=500
vus_max........................: 500 min=500 max=500
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `hive-gateway-bun`
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
█ setup
checks.........................: 100.00% ✓ 8082 ✗ 0
data_received..................: 238 MB 6.9 MB/s
data_sent......................: 3.2 MB 94 kB/s
http_req_blocked...............: avg=7.16ms min=1.36µs med=3.03µs max=156.61ms p(90)=25.92ms p(95)=63.04ms
http_req_connecting............: avg=6.82ms min=0s med=0s max=156.59ms p(90)=23.91ms p(95)=62.41ms
http_req_duration..............: avg=5.82s min=17.69ms med=5.78s max=12.3s p(90)=8.66s p(95)=9.18s
{ expected_response:true }...: avg=5.82s min=17.69ms med=5.78s max=12.3s p(90)=8.66s p(95)=9.18s
http_req_failed................: 0.00% ✓ 0 ✗ 2714
http_req_receiving.............: avg=159.84ms min=36.69µs med=257.47µs max=3.42s p(90)=17.66ms p(95)=1.71s
http_req_sending...............: avg=2.6ms min=8.46µs med=15.19µs max=96.61ms p(90)=11.3ms p(95)=22.35ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=5.65s min=17.6ms med=5.66s max=12.3s p(90)=8.56s p(95)=9.18s
http_reqs......................: 2714 78.909125/s
iteration_duration.............: avg=5.88s min=600.56ms med=5.8s max=12.31s p(90)=8.7s p(95)=9.19s
iterations.....................: 2694 78.327628/s
vus............................: 80 min=80 max=500
vus_max........................: 500 min=500 max=500
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `mercurius`
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
█ setup
checks.........................: 100.00% ✓ 7395 ✗ 0
data_received..................: 218 MB 6.6 MB/s
data_sent......................: 2.9 MB 89 kB/s
http_req_blocked...............: avg=4.92ms min=1.56µs med=4.03µs max=96.13ms p(90)=22.17ms p(95)=30.3ms
http_req_connecting............: avg=4.82ms min=0s med=0s max=77.02ms p(90)=22.03ms p(95)=30.21ms
http_req_duration..............: avg=6.27s min=10.61ms med=6.23s max=12.92s p(90)=8.3s p(95)=10.95s
{ expected_response:true }...: avg=6.27s min=10.61ms med=6.23s max=12.92s p(90)=8.3s p(95)=10.95s
http_req_failed................: 0.00% ✓ 0 ✗ 2485
http_req_receiving.............: avg=9.69ms min=39.71µs med=103.48µs max=838.77ms p(90)=412.17µs p(95)=3.09ms
http_req_sending...............: avg=1.32ms min=9.55µs med=23.76µs max=54.89ms p(90)=1.24ms p(95)=8.67ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=6.26s min=10.54ms med=6.23s max=12.92s p(90)=8.3s p(95)=10.93s
http_reqs......................: 2485 75.136711/s
iteration_duration.............: avg=6.39s min=500.86ms med=6.25s max=12.94s p(90)=8.32s p(95)=11.04s
iterations.....................: 2465 74.531989/s
vus............................: 90 min=90 max=500
vus_max........................: 500 min=500 max=500
Performance Overview
Subgraphs Overview
HTTP Overview
Overview for:
|
Gateway | duration(p95)⬇️ | RPS | Requests | Durations | Notes |
---|---|---|---|---|---|
apollo-router | 5193ms | 163 | 11471 total, 655 failed | avg: 2542ms, p95: 5194ms, max: 12444ms, med: 2409ms | ❌ 655 failed requests, 655 non-200 responses, 655 unexpected GraphQL errors |
cosmo | 5515ms | 173 | 12196 total, 0 failed | avg: 2342ms, p95: 5516ms, max: 10181ms, med: 1980ms | ✅ |
grafbase | 7952ms | 163 | 11484 total, 0 failed | avg: 2772ms, p95: 7952ms, max: 12997ms, med: 2080ms | ✅ |
hive-gateway-bun | 35831ms | 77 | 6803 total, 0 failed | avg: 14018ms, p95: 35832ms, max: 42615ms, med: 11717ms | ✅ |
mercurius | 43639ms | 52 | 4862 total, 0 failed | avg: 21771ms, p95: 43640ms, max: 44622ms, med: 18894ms | ✅ |
apollo-server | 59999ms | 82 | 7686 total, 485 failed | avg: 11834ms, p95: 60000ms, max: 60078ms, med: 2225ms | ❌ 485 failed requests, 485 non-200 responses, 485 unexpected GraphQL errors |
hive-gateway | 60000ms | 77 | 7226 total, 644 failed | avg: 12908ms, p95: 60000ms, max: 60152ms, med: 2035ms | ❌ 644 failed requests, 644 non-200 responses, 643 unexpected GraphQL errors |
Summary for: `apollo-router`
K6 Output
✗ response code was 200
↳ 94% — ✓ 10796 / ✗ 655
✗ no graphql errors
↳ 94% — ✓ 10796 / ✗ 655
✓ valid response structure
█ setup
checks.........................: 96.11% ✓ 32388 ✗ 1310
data_received..................: 949 MB 14 MB/s
data_sent......................: 14 MB 194 kB/s
http_req_blocked...............: avg=541.43ms min=1.46µs med=4.36µs max=12.31s p(90)=2.37s p(95)=3.4s
http_req_connecting............: avg=530.52ms min=0s med=0s max=11.71s p(90)=2.36s p(95)=3.39s
http_req_duration..............: avg=2.54s min=6.73ms med=2.4s max=12.44s p(90)=4.47s p(95)=5.19s
{ expected_response:true }...: avg=2.52s min=6.73ms med=2.38s max=12.44s p(90)=4.45s p(95)=5.15s
http_req_failed................: 5.71% ✓ 655 ✗ 10816
http_req_receiving.............: avg=216.58ms min=0s med=86.01µs max=7.21s p(90)=754.21ms p(95)=1.62s
http_req_sending...............: avg=145.58ms min=8.43µs med=23.84µs max=10.09s p(90)=437.07ms p(95)=855.56ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=2.17s min=6.65ms med=2.11s max=11.64s p(90)=4.07s p(95)=4.45s
http_reqs......................: 11471 163.50447/s
iteration_duration.............: avg=6.1s min=12.51ms med=5.65s max=27.13s p(90)=11.84s p(95)=14.07s
iterations.....................: 11451 163.219395/s
vus............................: 5 min=5 max=1978
vus_max........................: 2000 min=2000 max=2000
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `cosmo`
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
█ setup
checks.........................: 100.00% ✓ 36528 ✗ 0
data_received..................: 1.1 GB 15 MB/s
data_sent......................: 15 MB 206 kB/s
http_req_blocked...............: avg=245.79ms min=1.43µs med=4.04µs max=8.17s p(90)=905.88ms p(95)=1.67s
http_req_connecting............: avg=240.94ms min=0s med=0s max=8.17s p(90)=895.52ms p(95)=1.66s
http_req_duration..............: avg=2.34s min=3.24ms med=1.98s max=10.18s p(90)=5.02s p(95)=5.51s
{ expected_response:true }...: avg=2.34s min=3.24ms med=1.98s max=10.18s p(90)=5.02s p(95)=5.51s
http_req_failed................: 0.00% ✓ 0 ✗ 12196
http_req_receiving.............: avg=196.07ms min=32.5µs med=85.59µs max=7.75s p(90)=812.71ms p(95)=1.71s
http_req_sending...............: avg=121.91ms min=8.31µs med=20.62µs max=5.94s p(90)=320.1ms p(95)=865.52ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=2.02s min=3.15ms med=1.6s max=7.97s p(90)=4.79s p(95)=5.37s
http_reqs......................: 12196 173.865497/s
iteration_duration.............: avg=5.82s min=9.07ms med=5.2s max=23.88s p(90)=11.52s p(95)=13.88s
iterations.....................: 12176 173.580378/s
vus............................: 5 min=5 max=1955
vus_max........................: 2000 min=2000 max=2000
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `grafbase`
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
█ setup
checks.........................: 100.00% ✓ 34392 ✗ 0
data_received..................: 1.0 GB 14 MB/s
data_sent......................: 14 MB 194 kB/s
http_req_blocked...............: avg=249.74ms min=1.45µs med=4.14µs max=11.29s p(90)=523.23ms p(95)=1.47s
http_req_connecting............: avg=244.92ms min=0s med=0s max=11.29s p(90)=513.86ms p(95)=1.44s
http_req_duration..............: avg=2.77s min=3.34ms med=2.07s max=12.99s p(90)=5.88s p(95)=7.95s
{ expected_response:true }...: avg=2.77s min=3.34ms med=2.07s max=12.99s p(90)=5.88s p(95)=7.95s
http_req_failed................: 0.00% ✓ 0 ✗ 11484
http_req_receiving.............: avg=612.8ms min=32.66µs med=89.81µs max=11.06s p(90)=2.14s p(95)=4.88s
http_req_sending...............: avg=158.05ms min=7.55µs med=21.05µs max=10.09s p(90)=167.65ms p(95)=742.69ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=2s min=3.21ms med=1.29s max=12.85s p(90)=4.95s p(95)=5.42s
http_reqs......................: 11484 163.529816/s
iteration_duration.............: avg=6.41s min=24.59ms med=5.22s max=32.76s p(90)=14.09s p(95)=16.72s
iterations.....................: 11464 163.24502/s
vus............................: 146 min=70 max=1955
vus_max........................: 2000 min=2000 max=2000
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `hive-gateway-bun`
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
█ setup
checks.........................: 100.00% ✓ 20349 ✗ 0
data_received..................: 597 MB 6.8 MB/s
data_sent......................: 8.1 MB 92 kB/s
http_req_blocked...............: avg=1.71ms min=1.48µs med=3.62µs max=130.03ms p(90)=427.26µs p(95)=2.37ms
http_req_connecting............: avg=1.64ms min=0s med=0s max=124.91ms p(90)=352.95µs p(95)=2.14ms
http_req_duration..............: avg=14.01s min=15.47ms med=11.71s max=42.61s p(90)=32.21s p(95)=35.83s
{ expected_response:true }...: avg=14.01s min=15.47ms med=11.71s max=42.61s p(90)=32.21s p(95)=35.83s
http_req_failed................: 0.00% ✓ 0 ✗ 6803
http_req_receiving.............: avg=236.71ms min=39.28µs med=273.71µs max=13.63s p(90)=2.41ms p(95)=1.92s
http_req_sending...............: avg=819.27µs min=8.8µs med=19.99µs max=121.64ms p(90)=91.65µs p(95)=675.67µs
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=13.78s min=15.29ms med=11.67s max=42.61s p(90)=32.21s p(95)=35.83s
http_reqs......................: 6803 77.78179/s
iteration_duration.............: avg=14.08s min=201.75ms med=11.73s max=42.62s p(90)=32.26s p(95)=35.85s
iterations.....................: 6783 77.553121/s
vus............................: 104 min=61 max=2000
vus_max........................: 2000 min=2000 max=2000
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `mercurius`
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
█ setup
checks.........................: 100.00% ✓ 14494 ✗ 0
data_received..................: 427 MB 4.6 MB/s
data_sent......................: 6.0 MB 65 kB/s
http_req_blocked...............: avg=211.17µs min=1.6µs med=4.29µs max=38.52ms p(90)=511.8µs p(95)=674.47µs
http_req_connecting............: avg=176.38µs min=0s med=0s max=38.44ms p(90)=432.86µs p(95)=574.75µs
http_req_duration..............: avg=21.77s min=10.64ms med=18.89s max=44.62s p(90)=42.66s p(95)=43.63s
{ expected_response:true }...: avg=21.77s min=10.64ms med=18.89s max=44.62s p(90)=42.66s p(95)=43.63s
http_req_failed................: 0.00% ✓ 0 ✗ 4862
http_req_receiving.............: avg=11.51ms min=40.46µs med=105.93µs max=1.02s p(90)=448.28µs p(95)=1.58ms
http_req_sending...............: avg=58.35µs min=9.27µs med=26.87µs max=12.77ms p(90)=68.49µs p(95)=86.55µs
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=21.75s min=10.54ms med=18.89s max=44.25s p(90)=42.6s p(95)=43.54s
http_reqs......................: 4862 52.411252/s
iteration_duration.............: avg=21.92s min=155.14ms med=18.8s max=45.27s p(90)=43.19s p(95)=43.79s
iterations.....................: 4810 51.850704/s
vus............................: 1 min=1 max=2000
vus_max........................: 2000 min=2000 max=2000
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `apollo-server`
K6 Output
✗ response code was 200
↳ 93% — ✓ 7181 / ✗ 485
✗ no graphql errors
↳ 93% — ✓ 7181 / ✗ 485
✓ valid response structure
█ setup
checks.........................: 95.69% ✓ 21543 ✗ 970
data_received..................: 633 MB 6.8 MB/s
data_sent......................: 9.2 MB 99 kB/s
http_req_blocked...............: avg=558.67µs min=1.66µs med=4.61µs max=117.03ms p(90)=390.6µs p(95)=711.94µs
http_req_connecting............: avg=526.45µs min=0s med=0s max=116.88ms p(90)=309.67µs p(95)=575.08µs
http_req_duration..............: avg=11.83s min=11.88ms med=2.22s max=1m0s p(90)=53.88s p(95)=59.99s
{ expected_response:true }...: avg=8.63s min=11.88ms med=2.14s max=59.97s p(90)=37.23s p(95)=50.48s
http_req_failed................: 6.31% ✓ 485 ✗ 7201
http_req_receiving.............: avg=251.57µs min=0s med=110.55µs max=113.31ms p(90)=234.08µs p(95)=345.24µs
http_req_sending...............: avg=217.11µs min=9.17µs med=25.57µs max=45.11ms p(90)=72.56µs p(95)=134.28µs
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=11.83s min=11.67ms med=2.22s max=1m0s p(90)=53.88s p(95)=59.99s
http_reqs......................: 7686 82.858456/s
iteration_duration.............: avg=11.87s min=62.08ms med=2.24s max=1m0s p(90)=54.33s p(95)=1m0s
iterations.....................: 7666 82.642847/s
vus............................: 23 min=23 max=1999
vus_max........................: 2000 min=2000 max=2000
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `hive-gateway`
K6 Output
✗ response code was 200
↳ 91% — ✓ 6562 / ✗ 644
✗ no graphql errors
↳ 91% — ✓ 6562 / ✗ 643
✓ valid response structure
█ setup
checks.........................: 93.86% ✓ 19686 ✗ 1287
data_received..................: 578 MB 6.2 MB/s
data_sent......................: 8.7 MB 93 kB/s
http_req_blocked...............: avg=273.2µs min=1.43µs med=3.9µs max=46.75ms p(90)=323.46µs p(95)=470.66µs
http_req_connecting............: avg=249µs min=0s med=0s max=46.67ms p(90)=246.94µs p(95)=387.27µs
http_req_duration..............: avg=12.9s min=15.57ms med=2.03s max=1m0s p(90)=58.59s p(95)=1m0s
{ expected_response:true }...: avg=8.3s min=15.57ms med=1.94s max=59.97s p(90)=37.39s p(95)=42.05s
http_req_failed................: 8.91% ✓ 644 ✗ 6582
http_req_receiving.............: avg=257.77µs min=0s med=110.39µs max=238.78ms p(90)=191.64µs p(95)=268.11µs
http_req_sending...............: avg=104.36µs min=8.9µs med=19.84µs max=40.5ms p(90)=60.67µs p(95)=84.85µs
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=12.9s min=15.37ms med=2.03s max=1m0s p(90)=58.59s p(95)=1m0s
http_reqs......................: 7226 77.826108/s
iteration_duration.............: avg=12.94s min=72.42ms med=2.05s max=1m0s p(90)=58.61s p(95)=1m0s
iterations.....................: 7205 77.599932/s
vus............................: 34 min=34 max=2000
vus_max........................: 2000 min=2000 max=2000
Performance Overview
Subgraphs Overview
HTTP Overview
In light of latest feedback from users using Hive Gateway in production.