-
Notifications
You must be signed in to change notification settings - Fork 8
Try incoming alpha #696
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Try incoming alpha #696
Conversation
Overview for:
|
Gateway | RPS ⬇️ | Requests | Duration | Notes |
---|---|---|---|---|
cosmo | 179 | 5504 total, 0 failed | avg: 888ms, p95: 2458ms | ✅ |
grafbase | 170 | 5251 total, 0 failed | avg: 826ms, p95: 2243ms | ✅ |
apollo-router | 155 | 4834 total, 1 failed | avg: 935ms, p95: 2451ms | ❌ 1 failed requests, 1 non-200 responses, 1 unexpected GraphQL errors, non-compatible response structure (1) |
hive-gateway | 92 | 3060 total, 0 failed | avg: 3032ms, p95: 13997ms | ✅ |
apollo-server | 87 | 2911 total, 0 failed | avg: 3230ms, p95: 24620ms | ✅ |
hive-gateway-bun | 86 | 2871 total, 0 failed | avg: 3226ms, p95: 5245ms | ✅ |
mercurius | 76 | 2439 total, 0 failed | avg: 3768ms, p95: 5824ms | ✅ |
Summary for: `cosmo`
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
█ setup
checks.........................: 100.00% ✓ 16452 ✗ 0
data_received..................: 483 MB 16 MB/s
data_sent......................: 6.5 MB 213 kB/s
http_req_blocked...............: avg=2.58ms min=1.49µs med=3.09µs max=1.76s p(90)=5.17µs p(95)=3.76ms
http_req_connecting............: avg=2.35ms min=0s med=0s max=1.76s p(90)=0s p(95)=3.48ms
http_req_duration..............: avg=888.01ms min=3.26ms med=675.22ms max=7.67s p(90)=1.91s p(95)=2.45s
{ expected_response:true }...: avg=888.01ms min=3.26ms med=675.22ms max=7.67s p(90)=1.91s p(95)=2.45s
http_req_failed................: 0.00% ✓ 0 ✗ 5504
http_req_receiving.............: avg=374.41ms min=36.47µs med=102.19µs max=6.98s p(90)=1.43s p(95)=1.96s
http_req_sending...............: avg=19.82ms min=8.6µs med=14.61µs max=3.35s p(90)=1.55ms p(95)=15.77ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=493.77ms min=3.16ms med=492.1ms max=2.22s p(90)=869.96ms p(95)=998.7ms
http_reqs......................: 5504 179.099689/s
iteration_duration.............: avg=1.65s min=23.71ms med=1.34s max=12.31s p(90)=3.43s p(95)=4.24s
iterations.....................: 5484 178.44889/s
vus............................: 300 min=300 max=300
vus_max........................: 300 min=300 max=300
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `grafbase`
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
█ setup
checks.........................: 100.00% ✓ 15693 ✗ 0
data_received..................: 461 MB 15 MB/s
data_sent......................: 6.2 MB 202 kB/s
http_req_blocked...............: avg=1.46ms min=1.42µs med=3.24µs max=1.45s p(90)=5.15µs p(95)=1.81ms
http_req_connecting............: avg=1.36ms min=0s med=0s max=1.45s p(90)=0s p(95)=1.54ms
http_req_duration..............: avg=826.18ms min=3.06ms med=641.55ms max=6.17s p(90)=1.75s p(95)=2.24s
{ expected_response:true }...: avg=826.18ms min=3.06ms med=641.55ms max=6.17s p(90)=1.75s p(95)=2.24s
http_req_failed................: 0.00% ✓ 0 ✗ 5251
http_req_receiving.............: avg=248.59ms min=34.11µs med=79.65µs max=5.51s p(90)=991.28ms p(95)=1.52s
http_req_sending...............: avg=18.39ms min=7.93µs med=14.87µs max=2.9s p(90)=321.8µs p(95)=22.36ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=559.19ms min=3.01ms med=512.14ms max=2.62s p(90)=988.64ms p(95)=1.23s
http_reqs......................: 5251 170.349767/s
iteration_duration.............: avg=1.72s min=22.67ms med=1.41s max=10s p(90)=3.49s p(95)=4.39s
iterations.....................: 5231 169.700939/s
vus............................: 300 min=300 max=300
vus_max........................: 300 min=300 max=300
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `apollo-router`
K6 Output
✗ response code was 200
↳ 99% — ✓ 4813 / ✗ 1
✗ no graphql errors
↳ 99% — ✓ 4813 / ✗ 1
✗ valid response structure
↳ 99% — ✓ 4813 / ✗ 1
█ setup
checks.........................: 99.97% ✓ 14439 ✗ 3
data_received..................: 424 MB 14 MB/s
data_sent......................: 5.7 MB 185 kB/s
http_req_blocked...............: avg=1.31ms min=1.43µs med=3.72µs max=879.11ms p(90)=7.11µs p(95)=217.44µs
http_req_connecting............: avg=1.14ms min=0s med=0s max=879.04ms p(90)=0s p(95)=94.21µs
http_req_duration..............: avg=934.66ms min=6.25ms med=674.28ms max=8.88s p(90)=2.01s p(95)=2.45s
{ expected_response:true }...: avg=934.84ms min=6.25ms med=674.38ms max=8.88s p(90)=2.01s p(95)=2.45s
http_req_failed................: 0.02% ✓ 1 ✗ 4833
http_req_receiving.............: avg=373.59ms min=36.03µs med=104.01µs max=8.17s p(90)=1.38s p(95)=1.8s
http_req_sending...............: avg=22.6ms min=8.56µs med=18.53µs max=7.26s p(90)=297.41µs p(95)=22.57ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=538.46ms min=6.18ms med=491.88ms max=2.68s p(90)=1.02s p(95)=1.17s
http_reqs......................: 4834 155.946924/s
iteration_duration.............: avg=1.88s min=32.11ms med=1.56s max=12.63s p(90)=3.78s p(95)=4.67s
iterations.....................: 4814 155.301715/s
vus............................: 12 min=12 max=300
vus_max........................: 300 min=300 max=300
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `hive-gateway`
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
█ setup
checks.........................: 100.00% ✓ 9120 ✗ 0
data_received..................: 269 MB 8.1 MB/s
data_sent......................: 3.6 MB 110 kB/s
http_req_blocked...............: avg=1.82ms min=1.89µs med=4.15µs max=31.05ms p(90)=96.05µs p(95)=19.83ms
http_req_connecting............: avg=1.79ms min=0s med=0s max=31ms p(90)=0s p(95)=19.73ms
http_req_duration..............: avg=3.03s min=13.97ms med=1.66s max=32.66s p(90)=2.72s p(95)=13.99s
{ expected_response:true }...: avg=3.03s min=13.97ms med=1.66s max=32.66s p(90)=2.72s p(95)=13.99s
http_req_failed................: 0.00% ✓ 0 ✗ 3060
http_req_receiving.............: avg=2.07ms min=44.87µs med=97.81µs max=420.05ms p(90)=601.12µs p(95)=2.31ms
http_req_sending...............: avg=314.73µs min=9.19µs med=22.27µs max=81.8ms p(90)=228µs p(95)=864.69µs
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=3.02s min=13.85ms med=1.66s max=32.66s p(90)=2.7s p(95)=13.99s
http_reqs......................: 3060 92.418923/s
iteration_duration.............: avg=3.09s min=317.02ms med=1.7s max=32.67s p(90)=2.8s p(95)=14.05s
iterations.....................: 3040 91.814878/s
vus............................: 16 min=16 max=300
vus_max........................: 300 min=300 max=300
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `apollo-server`
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
█ setup
checks.........................: 100.00% ✓ 8673 ✗ 0
data_received..................: 256 MB 7.7 MB/s
data_sent......................: 3.5 MB 104 kB/s
http_req_blocked...............: avg=652.23µs min=1.53µs med=3.41µs max=36.2ms p(90)=124.59µs p(95)=6.02ms
http_req_connecting............: avg=599.67µs min=0s med=0s max=13.61ms p(90)=72.22µs p(95)=5.78ms
http_req_duration..............: avg=3.22s min=11.04ms med=1.44s max=32.83s p(90)=2.1s p(95)=24.62s
{ expected_response:true }...: avg=3.22s min=11.04ms med=1.44s max=32.83s p(90)=2.1s p(95)=24.62s
http_req_failed................: 0.00% ✓ 0 ✗ 2911
http_req_receiving.............: avg=570.1µs min=44.37µs med=105.23µs max=191.19ms p(90)=240.94µs p(95)=463.38µs
http_req_sending...............: avg=390.75µs min=9.44µs med=17.68µs max=61.3ms p(90)=127.71µs p(95)=513.69µs
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=3.22s min=10.95ms med=1.44s max=32.83s p(90)=2.1s p(95)=24.61s
http_reqs......................: 2911 87.551561/s
iteration_duration.............: avg=3.26s min=370.25ms med=1.45s max=32.84s p(90)=2.13s p(95)=24.98s
iterations.....................: 2891 86.950038/s
vus............................: 30 min=30 max=300
vus_max........................: 300 min=300 max=300
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `hive-gateway-bun`
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
█ setup
checks.........................: 100.00% ✓ 8553 ✗ 0
data_received..................: 252 MB 7.6 MB/s
data_sent......................: 3.4 MB 103 kB/s
http_req_blocked...............: avg=942.41µs min=1.67µs med=4.62µs max=26.58ms p(90)=144.22µs p(95)=10.38ms
http_req_connecting............: avg=869.4µs min=0s med=0s max=22.59ms p(90)=106.43µs p(95)=9.25ms
http_req_duration..............: avg=3.22s min=16.36ms med=2.9s max=7.69s p(90)=4.75s p(95)=5.24s
{ expected_response:true }...: avg=3.22s min=16.36ms med=2.9s max=7.69s p(90)=4.75s p(95)=5.24s
http_req_failed................: 0.00% ✓ 0 ✗ 2871
http_req_receiving.............: avg=59.8ms min=43.93µs med=259.82µs max=1.58s p(90)=7.35ms p(95)=588.17ms
http_req_sending...............: avg=573.68µs min=9.36µs med=26.5µs max=158.64ms p(90)=246.45µs p(95)=1.22ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=3.16s min=16.17ms med=2.87s max=7.69s p(90)=4.71s p(95)=5.24s
http_reqs......................: 2871 86.982553/s
iteration_duration.............: avg=3.29s min=88.34ms med=2.94s max=7.71s p(90)=4.84s p(95)=5.28s
iterations.....................: 2851 86.376614/s
vus............................: 7 min=7 max=300
vus_max........................: 300 min=300 max=300
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `mercurius`
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
█ setup
checks.........................: 100.00% ✓ 7257 ✗ 0
data_received..................: 214 MB 6.7 MB/s
data_sent......................: 2.9 MB 91 kB/s
http_req_blocked...............: avg=725.08µs min=1.75µs med=4.05µs max=13.92ms p(90)=2.43ms p(95)=6.1ms
http_req_connecting............: avg=703.78µs min=0s med=0s max=13.89ms p(90)=2.29ms p(95)=5.99ms
http_req_duration..............: avg=3.76s min=12.06ms med=3.75s max=8.72s p(90)=4.92s p(95)=5.82s
{ expected_response:true }...: avg=3.76s min=12.06ms med=3.75s max=8.72s p(90)=4.92s p(95)=5.82s
http_req_failed................: 0.00% ✓ 0 ✗ 2439
http_req_receiving.............: avg=12.56ms min=40.67µs med=102.71µs max=1.12s p(90)=321µs p(95)=880.68µs
http_req_sending...............: avg=159.92µs min=9.39µs med=22.25µs max=14.22ms p(90)=337.98µs p(95)=928.92µs
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=3.75s min=11.95ms med=3.75s max=8.72s p(90)=4.92s p(95)=5.82s
http_reqs......................: 2439 76.333134/s
iteration_duration.............: avg=3.83s min=275.58ms med=3.77s max=8.73s p(90)=4.94s p(95)=5.92s
iterations.....................: 2419 75.707196/s
vus............................: 229 min=229 max=300
vus_max........................: 300 min=300 max=300
Performance Overview
Subgraphs Overview
HTTP Overview
Overview for:
|
Gateway | RPS ⬇️ | Requests | Duration | Notes |
---|---|---|---|---|
cosmo | 171 | 5413 total, 0 failed | avg: 1344ms, p95: 2858ms | ✅ |
apollo-router | 161 | 5109 total, 5 failed | avg: 1524ms, p95: 3769ms | ❌ 5 failed requests, 5 non-200 responses, 5 unexpected GraphQL errors, non-compatible response structure (1) |
grafbase | 159 | 4999 total, 0 failed | avg: 1598ms, p95: 3892ms | ✅ |
hive-gateway | 91 | 3222 total, 0 failed | avg: 4923ms, p95: 32808ms | ✅ |
apollo-server | 87 | 3104 total, 0 failed | avg: 5205ms, p95: 33308ms | ✅ |
hive-gateway-bun | 87 | 3051 total, 0 failed | avg: 5181ms, p95: 9424ms | ✅ |
mercurius | 73 | 2424 total, 0 failed | avg: 6435ms, p95: 11372ms | ✅ |
Summary for: `cosmo`
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
█ setup
checks.........................: 100.00% ✓ 16179 ✗ 0
data_received..................: 475 MB 15 MB/s
data_sent......................: 6.4 MB 204 kB/s
http_req_blocked...............: avg=3.58ms min=1.79µs med=4.22µs max=2.1s p(90)=28.32µs p(95)=17.58ms
http_req_connecting............: avg=2.75ms min=0s med=0s max=2.1s p(90)=0s p(95)=16.76ms
http_req_duration..............: avg=1.34s min=4.1ms med=1.19s max=9.07s p(90)=2.26s p(95)=2.85s
{ expected_response:true }...: avg=1.34s min=4.1ms med=1.19s max=9.07s p(90)=2.26s p(95)=2.85s
http_req_failed................: 0.00% ✓ 0 ✗ 5413
http_req_receiving.............: avg=284.41ms min=34.27µs med=95.29µs max=4.31s p(90)=1.19s p(95)=1.61s
http_req_sending...............: avg=32.69ms min=8.04µs med=21.83µs max=4.43s p(90)=879.16µs p(95)=4.17ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=1.02s min=3.95ms med=909.27ms max=4.3s p(90)=1.77s p(95)=2.11s
http_reqs......................: 5413 171.93731/s
iteration_duration.............: avg=2.82s min=46.93ms med=2.54s max=11.42s p(90)=5.19s p(95)=6.12s
iterations.....................: 5393 171.302034/s
vus............................: 223 min=223 max=500
vus_max........................: 500 min=500 max=500
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `apollo-router`
K6 Output
✗ response code was 200
↳ 99% — ✓ 5084 / ✗ 5
✗ no graphql errors
↳ 99% — ✓ 5084 / ✗ 5
✗ valid response structure
↳ 99% — ✓ 5084 / ✗ 1
█ setup
checks.........................: 99.92% ✓ 15252 ✗ 11
data_received..................: 448 MB 14 MB/s
data_sent......................: 6.1 MB 192 kB/s
http_req_blocked...............: avg=9.69ms min=1.42µs med=3.48µs max=4.44s p(90)=1.17ms p(95)=32.3ms
http_req_connecting............: avg=9.02ms min=0s med=0s max=4.44s p(90)=347.63µs p(95)=31.8ms
http_req_duration..............: avg=1.52s min=6.55ms med=1.3s max=10.26s p(90)=3.25s p(95)=3.76s
{ expected_response:true }...: avg=1.52s min=6.55ms med=1.3s max=10.26s p(90)=3.25s p(95)=3.76s
http_req_failed................: 0.09% ✓ 5 ✗ 5104
http_req_receiving.............: avg=502.36ms min=0s med=109.51µs max=8.07s p(90)=1.75s p(95)=2.91s
http_req_sending...............: avg=22.5ms min=8.15µs med=16.2µs max=4.01s p(90)=1.27ms p(95)=4.04ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=998.82ms min=6.46ms med=965.48ms max=3.66s p(90)=1.86s p(95)=2.21s
http_reqs......................: 5109 161.718749/s
iteration_duration.............: avg=2.99s min=45.81ms med=2.63s max=15.5s p(90)=5.89s p(95)=6.99s
iterations.....................: 5089 161.085675/s
vus............................: 307 min=307 max=500
vus_max........................: 500 min=500 max=500
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `grafbase`
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
█ setup
checks.........................: 100.00% ✓ 14937 ✗ 0
data_received..................: 439 MB 14 MB/s
data_sent......................: 5.9 MB 189 kB/s
http_req_blocked...............: avg=5.41ms min=1.74µs med=4.06µs max=2.45s p(90)=115.71µs p(95)=40.97ms
http_req_connecting............: avg=4.14ms min=0s med=0s max=157.4ms p(90)=56.02µs p(95)=38.79ms
http_req_duration..............: avg=1.59s min=3.26ms med=1.3s max=10.38s p(90)=2.89s p(95)=3.89s
{ expected_response:true }...: avg=1.59s min=3.26ms med=1.3s max=10.38s p(90)=2.89s p(95)=3.89s
http_req_failed................: 0.00% ✓ 0 ✗ 4999
http_req_receiving.............: avg=558.11ms min=35.38µs med=141.65µs max=7.87s p(90)=1.89s p(95)=2.6s
http_req_sending...............: avg=24.4ms min=9.06µs med=19.82µs max=3.71s p(90)=3.19ms p(95)=27.44ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=1.01s min=3.19ms med=927.56ms max=3.05s p(90)=1.89s p(95)=2.44s
http_reqs......................: 4999 159.532421/s
iteration_duration.............: avg=3.05s min=23.76ms med=2.67s max=15s p(90)=5.71s p(95)=6.84s
iterations.....................: 4979 158.894163/s
vus............................: 179 min=179 max=500
vus_max........................: 500 min=500 max=500
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `hive-gateway`
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
█ setup
checks.........................: 100.00% ✓ 9606 ✗ 0
data_received..................: 283 MB 8.1 MB/s
data_sent......................: 3.8 MB 109 kB/s
http_req_blocked...............: avg=5.65ms min=1.75µs med=4.14µs max=105.65ms p(90)=31.87ms p(95)=47.5ms
http_req_connecting............: avg=5.49ms min=0s med=0s max=78.19ms p(90)=31.18ms p(95)=47.07ms
http_req_duration..............: avg=4.92s min=12.65ms med=2.13s max=34.52s p(90)=12.51s p(95)=32.8s
{ expected_response:true }...: avg=4.92s min=12.65ms med=2.13s max=34.52s p(90)=12.51s p(95)=32.8s
http_req_failed................: 0.00% ✓ 0 ✗ 3222
http_req_receiving.............: avg=4.23ms min=40.56µs med=89.56µs max=347.97ms p(90)=1.63ms p(95)=7.85ms
http_req_sending...............: avg=3.61ms min=9.61µs med=21.24µs max=320.89ms p(90)=7.7ms p(95)=32.42ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=4.91s min=12.54ms med=2.12s max=34.52s p(90)=12.5s p(95)=32.78s
http_reqs......................: 3222 91.958107/s
iteration_duration.............: avg=5.03s min=376.75ms med=2.2s max=34.58s p(90)=13.11s p(95)=32.87s
iterations.....................: 3202 91.387294/s
vus............................: 13 min=13 max=500
vus_max........................: 500 min=500 max=500
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `apollo-server`
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
█ setup
checks.........................: 100.00% ✓ 9252 ✗ 0
data_received..................: 273 MB 7.7 MB/s
data_sent......................: 3.7 MB 104 kB/s
http_req_blocked...............: avg=3.19ms min=1.6µs med=3.58µs max=52.56ms p(90)=17.15ms p(95)=26.99ms
http_req_connecting............: avg=3.14ms min=0s med=0s max=52.51ms p(90)=16.76ms p(95)=26.81ms
http_req_duration..............: avg=5.2s min=11.05ms med=1.63s max=34.95s p(90)=31.63s p(95)=33.3s
{ expected_response:true }...: avg=5.2s min=11.05ms med=1.63s max=34.95s p(90)=31.63s p(95)=33.3s
http_req_failed................: 0.00% ✓ 0 ✗ 3104
http_req_receiving.............: avg=201.35µs min=42.72µs med=103.63µs max=24.84ms p(90)=211.09µs p(95)=354.59µs
http_req_sending...............: avg=479.28µs min=9.14µs med=19.29µs max=42.51ms p(90)=673.11µs p(95)=1.94ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=5.2s min=10.91ms med=1.63s max=34.95s p(90)=31.63s p(95)=33.3s
http_reqs......................: 3104 87.619932/s
iteration_duration.............: avg=5.25s min=403.91ms med=1.65s max=34.97s p(90)=31.7s p(95)=33.36s
iterations.....................: 3084 87.055371/s
vus............................: 48 min=48 max=500
vus_max........................: 500 min=500 max=500
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `hive-gateway-bun`
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
█ setup
checks.........................: 100.00% ✓ 9093 ✗ 0
data_received..................: 268 MB 7.7 MB/s
data_sent......................: 3.6 MB 104 kB/s
http_req_blocked...............: avg=6.29ms min=1.73µs med=4.35µs max=218.16ms p(90)=35.98ms p(95)=43ms
http_req_connecting............: avg=6.08ms min=0s med=0s max=81.19ms p(90)=35.32ms p(95)=42.55ms
http_req_duration..............: avg=5.18s min=17.2ms med=4.71s max=10.93s p(90)=8.39s p(95)=9.42s
{ expected_response:true }...: avg=5.18s min=17.2ms med=4.71s max=10.93s p(90)=8.39s p(95)=9.42s
http_req_failed................: 0.00% ✓ 0 ✗ 3051
http_req_receiving.............: avg=101.79ms min=35.78µs med=119.78µs max=3.19s p(90)=261.49ms p(95)=813.61ms
http_req_sending...............: avg=3.03ms min=9.47µs med=23.62µs max=1s p(90)=4.99ms p(95)=10.64ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=5.07s min=16.97ms med=4.59s max=10.93s p(90)=8.38s p(95)=9.12s
http_reqs......................: 3051 87.597294/s
iteration_duration.............: avg=5.4s min=476.62ms med=4.93s max=11.18s p(90)=8.48s p(95)=9.97s
iterations.....................: 3031 87.023074/s
vus............................: 145 min=145 max=500
vus_max........................: 500 min=500 max=500
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `mercurius`
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
█ setup
checks.........................: 100.00% ✓ 7212 ✗ 0
data_received..................: 213 MB 6.5 MB/s
data_sent......................: 2.9 MB 87 kB/s
http_req_blocked...............: avg=3.54ms min=1.79µs med=4.69µs max=43.34ms p(90)=19.15ms p(95)=25.2ms
http_req_connecting............: avg=3.45ms min=0s med=0s max=39.9ms p(90)=18.74ms p(95)=25.01ms
http_req_duration..............: avg=6.43s min=11.1ms med=6.5s max=13.33s p(90)=8.35s p(95)=11.37s
{ expected_response:true }...: avg=6.43s min=11.1ms med=6.5s max=13.33s p(90)=8.35s p(95)=11.37s
http_req_failed................: 0.00% ✓ 0 ✗ 2424
http_req_receiving.............: avg=21.34ms min=38.42µs med=106.52µs max=1.7s p(90)=377.92µs p(95)=1.55ms
http_req_sending...............: avg=368.7µs min=9.51µs med=26.91µs max=11.09ms p(90)=1.14ms p(95)=2.5ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=6.41s min=10.99ms med=6.49s max=13.33s p(90)=8.35s p(95)=11.37s
http_reqs......................: 2424 73.546328/s
iteration_duration.............: avg=6.55s min=429.33ms med=6.55s max=13.34s p(90)=8.44s p(95)=11.44s
iterations.....................: 2404 72.93951/s
vus............................: 5 min=5 max=500
vus_max........................: 500 min=500 max=500
Performance Overview
Subgraphs Overview
HTTP Overview
Overview for:
|
Gateway | duration(p95)⬇️ | RPS | Requests | Durations | Notes |
---|---|---|---|---|---|
apollo-router | 4759ms | 168 | 11856 total, 719 failed | avg: 2356ms, p95: 4759ms, max: 11334ms, med: 2368ms | ❌ 719 failed requests, 719 non-200 responses, 719 unexpected GraphQL errors |
cosmo | 5544ms | 175 | 12277 total, 0 failed | avg: 2542ms, p95: 5545ms, max: 13861ms, med: 2157ms | ✅ |
grafbase | 9537ms | 167 | 13498 total, 0 failed | avg: 3508ms, p95: 9538ms, max: 25044ms, med: 3117ms | ✅ |
hive-gateway-bun | 27120ms | 88 | 7244 total, 0 failed | avg: 12035ms, p95: 27121ms, max: 34122ms, med: 10057ms | ✅ |
mercurius | 43341ms | 53 | 4908 total, 0 failed | avg: 21547ms, p95: 43342ms, max: 44198ms, med: 18382ms | ✅ |
hive-gateway | 49750ms | 93 | 7982 total, 0 failed | avg: 11284ms, p95: 49750ms, max: 58439ms, med: 3251ms | ✅ |
apollo-server | 59999ms | 85 | 7930 total, 473 failed | avg: 11641ms, p95: 59999ms, max: 60126ms, med: 2179ms | ❌ 473 failed requests, 473 non-200 responses, 473 unexpected GraphQL errors |
Summary for: `apollo-router`
K6 Output
✗ response code was 200
↳ 93% — ✓ 11117 / ✗ 719
✗ no graphql errors
↳ 93% — ✓ 11117 / ✗ 719
✓ valid response structure
█ setup
checks.........................: 95.86% ✓ 33351 ✗ 1438
data_received..................: 977 MB 14 MB/s
data_sent......................: 14 MB 200 kB/s
http_req_blocked...............: avg=588.44ms min=1.66µs med=3.83µs max=9.17s p(90)=2.76s p(95)=3.8s
http_req_connecting............: avg=580.31ms min=0s med=0s max=8.72s p(90)=2.73s p(95)=3.76s
http_req_duration..............: avg=2.35s min=0s med=2.36s max=11.33s p(90)=4.15s p(95)=4.75s
{ expected_response:true }...: avg=2.33s min=7.15ms med=2.36s max=11.33s p(90)=4.13s p(95)=4.7s
http_req_failed................: 6.06% ✓ 719 ✗ 11137
http_req_receiving.............: avg=263.96ms min=0s med=81.81µs max=7.36s p(90)=1.16s p(95)=1.9s
http_req_sending...............: avg=170.48ms min=0s med=20.15µs max=8.99s p(90)=552.31ms p(95)=908.02ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=1.92s min=0s med=1.76s max=9.2s p(90)=3.69s p(95)=4.12s
http_reqs......................: 11856 168.81182/s
iteration_duration.............: avg=6.07s min=33.96ms med=5.73s max=26.44s p(90)=11.54s p(95)=13.54s
iterations.....................: 11836 168.52705/s
vus............................: 246 min=71 max=1897
vus_max........................: 2000 min=2000 max=2000
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `cosmo`
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
█ setup
checks.........................: 100.00% ✓ 36771 ✗ 0
data_received..................: 1.1 GB 15 MB/s
data_sent......................: 15 MB 208 kB/s
http_req_blocked...............: avg=337.92ms min=1.73µs med=3.82µs max=10.65s p(90)=976.21ms p(95)=3.11s
http_req_connecting............: avg=330.01ms min=0s med=0s max=10.65s p(90)=928.32ms p(95)=3.09s
http_req_duration..............: avg=2.54s min=3.29ms med=2.15s max=13.86s p(90)=4.78s p(95)=5.54s
{ expected_response:true }...: avg=2.54s min=3.29ms med=2.15s max=13.86s p(90)=4.78s p(95)=5.54s
http_req_failed................: 0.00% ✓ 0 ✗ 12277
http_req_receiving.............: avg=194.42ms min=32.05µs med=84.08µs max=7.87s p(90)=617.05ms p(95)=1.44s
http_req_sending...............: avg=122.04ms min=8.03µs med=19.1µs max=7.22s p(90)=402.39ms p(95)=822.79ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=2.22s min=3.12ms med=1.77s max=12.42s p(90)=4.53s p(95)=4.88s
http_reqs......................: 12277 175.112707/s
iteration_duration.............: avg=5.88s min=11.93ms med=5.02s max=26.51s p(90)=12.01s p(95)=13.93s
iterations.....................: 12257 174.827437/s
vus............................: 4 min=4 max=1994
vus_max........................: 2000 min=2000 max=2000
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `grafbase`
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
█ setup
checks.........................: 100.00% ✓ 40434 ✗ 0
data_received..................: 1.2 GB 15 MB/s
data_sent......................: 16 MB 198 kB/s
http_req_blocked...............: avg=335.99ms min=1.59µs med=3.74µs max=19.37s p(90)=536.37ms p(95)=2.93s
http_req_connecting............: avg=330.36ms min=0s med=0s max=19.37s p(90)=515.16ms p(95)=2.89s
http_req_duration..............: avg=3.5s min=3.23ms med=3.11s max=25.04s p(90)=6.67s p(95)=9.53s
{ expected_response:true }...: avg=3.5s min=3.23ms med=3.11s max=25.04s p(90)=6.67s p(95)=9.53s
http_req_failed................: 0.00% ✓ 0 ✗ 13498
http_req_receiving.............: avg=826.69ms min=32.27µs med=92.26µs max=19.06s p(90)=2.43s p(95)=4.99s
http_req_sending...............: avg=134.26ms min=8.48µs med=18.2µs max=14.16s p(90)=227.3ms p(95)=773.16ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=2.54s min=3.13ms med=2.27s max=13.91s p(90)=4.9s p(95)=5.42s
http_reqs......................: 13498 167.009675/s
iteration_duration.............: avg=6.93s min=26.63ms med=5.57s max=33.95s p(90)=14.31s p(95)=18.58s
iterations.....................: 13478 166.762217/s
vus............................: 89 min=70 max=1906
vus_max........................: 2000 min=2000 max=2000
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `hive-gateway-bun`
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
█ setup
checks.........................: 100.00% ✓ 21672 ✗ 0
data_received..................: 636 MB 7.7 MB/s
data_sent......................: 8.6 MB 105 kB/s
http_req_blocked...............: avg=33.06ms min=1.98µs med=5.22µs max=1.77s p(90)=64.35ms p(95)=188.78ms
http_req_connecting............: avg=32.58ms min=0s med=0s max=1.77s p(90)=61.73ms p(95)=185.72ms
http_req_duration..............: avg=12.03s min=16.6ms med=10.05s max=34.12s p(90)=24.91s p(95)=27.12s
{ expected_response:true }...: avg=12.03s min=16.6ms med=10.05s max=34.12s p(90)=24.91s p(95)=27.12s
http_req_failed................: 0.00% ✓ 0 ✗ 7244
http_req_receiving.............: avg=197.97ms min=39.82µs med=122.25µs max=9.36s p(90)=139.25ms p(95)=989.36ms
http_req_sending...............: avg=15.75ms min=8.62µs med=32.34µs max=2.27s p(90)=26.44ms p(95)=73.65ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=11.82s min=16.43ms med=9.95s max=34.12s p(90)=24.82s p(95)=26.84s
http_reqs......................: 7244 88.202423/s
iteration_duration.............: avg=12.55s min=125.2ms med=10.38s max=38.79s p(90)=25.99s p(95)=28.57s
iterations.....................: 7224 87.958904/s
vus............................: 185 min=58 max=2000
vus_max........................: 2000 min=2000 max=2000
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `mercurius`
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
█ setup
checks.........................: 100.00% ✓ 14614 ✗ 0
data_received..................: 431 MB 4.7 MB/s
data_sent......................: 6.0 MB 66 kB/s
http_req_blocked...............: avg=236.92µs min=1.43µs med=4.3µs max=32.37ms p(90)=498.18µs p(95)=692.92µs
http_req_connecting............: avg=204.61µs min=0s med=0s max=32.29ms p(90)=425.09µs p(95)=567.46µs
http_req_duration..............: avg=21.54s min=10.84ms med=18.38s max=44.19s p(90)=41.67s p(95)=43.34s
{ expected_response:true }...: avg=21.54s min=10.84ms med=18.38s max=44.19s p(90)=41.67s p(95)=43.34s
http_req_failed................: 0.00% ✓ 0 ✗ 4908
http_req_receiving.............: avg=3.79ms min=37.74µs med=99.66µs max=750.02ms p(90)=327.53µs p(95)=656.9µs
http_req_sending...............: avg=64.36µs min=8.61µs med=27.31µs max=16.55ms p(90)=67.84µs p(95)=93.21µs
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=21.54s min=10.73ms med=18.38s max=44.19s p(90)=41.67s p(95)=43.34s
http_reqs......................: 4908 53.518952/s
iteration_duration.............: avg=21.55s min=174.67ms med=18.34s max=44.49s p(90)=42.16s p(95)=43.39s
iterations.....................: 4839 52.766546/s
vus............................: 534 min=61 max=2000
vus_max........................: 2000 min=2000 max=2000
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `hive-gateway`
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
█ setup
checks.........................: 100.00% ✓ 23886 ✗ 0
data_received..................: 701 MB 8.2 MB/s
data_sent......................: 9.5 MB 111 kB/s
http_req_blocked...............: avg=9.41ms min=1.81µs med=4.84µs max=390.36ms p(90)=24.97ms p(95)=68.01ms
http_req_connecting............: avg=9.23ms min=0s med=0s max=339.56ms p(90)=24.73ms p(95)=67.19ms
http_req_duration..............: avg=11.28s min=12.84ms med=3.25s max=58.43s p(90)=42.22s p(95)=49.75s
{ expected_response:true }...: avg=11.28s min=12.84ms med=3.25s max=58.43s p(90)=42.22s p(95)=49.75s
http_req_failed................: 0.00% ✓ 0 ✗ 7982
http_req_receiving.............: avg=10.26ms min=41.39µs med=99.45µs max=1.6s p(90)=1.17ms p(95)=5.74ms
http_req_sending...............: avg=5.09ms min=9.8µs med=28.29µs max=597.83ms p(90)=11.47ms p(95)=26.91ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=11.26s min=12.72ms med=3.24s max=57.09s p(90)=42.21s p(95)=49.74s
http_reqs......................: 7982 93.455455/s
iteration_duration.............: avg=11.42s min=198.15ms med=3.34s max=59.18s p(90)=42.39s p(95)=49.83s
iterations.....................: 7962 93.22129/s
vus............................: 54 min=54 max=2000
vus_max........................: 2000 min=2000 max=2000
Performance Overview
Subgraphs Overview
HTTP Overview
Summary for: `apollo-server`
K6 Output
✗ response code was 200
↳ 94% — ✓ 7437 / ✗ 473
✗ no graphql errors
↳ 94% — ✓ 7437 / ✗ 473
✓ valid response structure
█ setup
checks.........................: 95.93% ✓ 22311 ✗ 946
data_received..................: 655 MB 7.1 MB/s
data_sent......................: 9.5 MB 102 kB/s
http_req_blocked...............: avg=515.73µs min=1.44µs med=3.82µs max=119.34ms p(90)=370.43µs p(95)=593.8µs
http_req_connecting............: avg=490.34µs min=0s med=0s max=119.25ms p(90)=300.63µs p(95)=490.85µs
http_req_duration..............: avg=11.64s min=10.38ms med=2.17s max=1m0s p(90)=53.13s p(95)=59.99s
{ expected_response:true }...: avg=8.61s min=10.38ms med=2.09s max=59.98s p(90)=37.43s p(95)=50.53s
http_req_failed................: 5.96% ✓ 473 ✗ 7457
http_req_receiving.............: avg=208.39µs min=0s med=106.25µs max=106.61ms p(90)=214.21µs p(95)=317.88µs
http_req_sending...............: avg=226.72µs min=8.92µs med=20.11µs max=58.82ms p(90)=65.81µs p(95)=124.09µs
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
http_req_waiting...............: avg=11.64s min=10.28ms med=2.17s max=1m0s p(90)=53.12s p(95)=59.99s
http_reqs......................: 7930 85.562593/s
iteration_duration.............: avg=11.68s min=59.69ms med=2.19s max=1m0s p(90)=53.3s p(95)=1m0s
iterations.....................: 7910 85.346799/s
vus............................: 67 min=62 max=2000
vus_max........................: 2000 min=2000 max=2000
Performance Overview
Subgraphs Overview
HTTP Overview
No description provided.