Conversation
💻 Website PreviewThe latest changes are available as preview in: https://edf646ba.federation-gateway-benchmark.pages.dev |
Overview for:
|
| Gateway | RPS ⬇️ | Requests | Duration | Notes |
|---|---|---|---|---|
| hive-router | 1881 | 117399 total, 0 failed | avg: 119ms, p95: 292ms | ✅ |
| grafbase | 1645 | 104097 total, 0 failed | avg: 134ms, p95: 320ms | ✅ |
| cosmo | 700 | 44716 total, 0 failed | avg: 314ms, p95: 702ms | ✅ |
| hive-gateway-router-runtime | 585 | 38655 total, 0 failed | avg: 364ms, p95: 754ms | ❌ non-compatible response structure (1) |
| apollo-router | 385 | 25903 total, 0 failed | avg: 545ms, p95: 1239ms | ❌ 24 unexpected GraphQL errors |
| hive-gateway | 262 | 18090 total, 0 failed | avg: 776ms, p95: 1726ms | ✅ |
| apollo-gateway | 125 | 8862 total, 0 failed | avg: 1407ms, p95: 2690ms | ✅ |
Summary for: hive-router
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
checks.........................: 100.00% ✓ 349197 ✗ 0
data_received..................: 10 GB 165 MB/s
data_sent......................: 137 MB 2.2 MB/s
http_req_blocked...............: avg=347.53µs min=1.17µs med=2.46µs max=286.89ms p(90)=3.82µs p(95)=4.47µs p(99.9)=131.86ms
http_req_connecting............: avg=343.89µs min=0s med=0s max=286.84ms p(90)=0s p(95)=0s p(99.9)=131.79ms
http_req_duration..............: avg=118.72ms min=1.88ms med=106.08ms max=470.67ms p(90)=244.07ms p(95)=292.48ms p(99.9)=390.15ms
{ expected_response:true }...: avg=118.72ms min=1.88ms med=106.08ms max=470.67ms p(90)=244.07ms p(95)=292.48ms p(99.9)=390.15ms
http_req_failed................: 0.00% ✓ 0 ✗ 117399
http_req_receiving.............: avg=440.4µs min=22.67µs med=42.88µs max=131.49ms p(90)=191.57µs p(95)=403.52µs p(99.9)=65.67ms
http_req_sending...............: avg=333µs min=5.17µs med=10.23µs max=136.82ms p(90)=29.77µs p(95)=129.96µs p(99.9)=59.16ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=117.94ms min=1.83ms med=105.41ms max=441.8ms p(90)=242.16ms p(95)=290.8ms p(99.9)=389.2ms
http_reqs......................: 117399 1881.574387/s
iteration_duration.............: avg=120.35ms min=2.03ms med=107.38ms max=663.65ms p(90)=246.1ms p(95)=294.56ms p(99.9)=412.71ms
iterations.....................: 116399 1865.547212/s
success_rate...................: 100.00% ✓ 116399 ✗ 0
vus............................: 79 min=0 max=493
vus_max........................: 500 min=500 max=500
Performance Overview
HTTP Overview
Summary for: grafbase
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
checks.........................: 100.00% ✓ 309291 ✗ 0
data_received..................: 9.1 GB 145 MB/s
data_sent......................: 121 MB 1.9 MB/s
http_req_blocked...............: avg=549.66µs min=1.32µs med=3.03µs max=376.7ms p(90)=4.47µs p(95)=5.52µs p(99.9)=185.45ms
http_req_connecting............: avg=541.81µs min=0s med=0s max=376.6ms p(90)=0s p(95)=0s p(99.9)=183.1ms
http_req_duration..............: avg=133.73ms min=2.63ms med=122.7ms max=476.22ms p(90)=269.36ms p(95)=320.14ms p(99.9)=418.02ms
{ expected_response:true }...: avg=133.73ms min=2.63ms med=122.7ms max=476.22ms p(90)=269.36ms p(95)=320.14ms p(99.9)=418.02ms
http_req_failed................: 0.00% ✓ 0 ✗ 104097
http_req_receiving.............: avg=561.11µs min=23.33µs med=47.67µs max=142.22ms p(90)=169.85µs p(95)=448.46µs p(99.9)=75.15ms
http_req_sending...............: avg=482.92µs min=5.23µs med=11.57µs max=135.3ms p(90)=31.78µs p(95)=142.92µs p(99.9)=79.34ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=132.68ms min=2.59ms med=121.74ms max=454.04ms p(90)=266.6ms p(95)=318.16ms p(99.9)=415.7ms
http_reqs......................: 104097 1645.514774/s
iteration_duration.............: avg=135.91ms min=2.82ms med=124.41ms max=866.02ms p(90)=272.33ms p(95)=323.16ms p(99.9)=474.18ms
iterations.....................: 103097 1629.70726/s
success_rate...................: 100.00% ✓ 103097 ✗ 0
vus............................: 72 min=0 max=495
vus_max........................: 500 min=500 max=500
Performance Overview
HTTP Overview
Summary for: cosmo
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
checks.........................: 100.00% ✓ 131148 ✗ 0
data_received..................: 3.9 GB 62 MB/s
data_sent......................: 52 MB 816 kB/s
http_req_blocked...............: avg=94.59µs min=1.29µs med=2.77µs max=183.31ms p(90)=4.23µs p(95)=5.94µs p(99.9)=28.61ms
http_req_connecting............: avg=90.06µs min=0s med=0s max=183.25ms p(90)=0s p(95)=0s p(99.9)=28.29ms
http_req_duration..............: avg=314.11ms min=2.94ms med=295.91ms max=1.18s p(90)=619.44ms p(95)=702.26ms p(99.9)=970.83ms
{ expected_response:true }...: avg=314.11ms min=2.94ms med=295.91ms max=1.18s p(90)=619.44ms p(95)=702.26ms p(99.9)=970.83ms
http_req_failed................: 0.00% ✓ 0 ✗ 44716
http_req_receiving.............: avg=759.64µs min=27.11µs med=63µs max=164.43ms p(90)=204.75µs p(95)=513.18µs p(99.9)=96.35ms
http_req_sending...............: avg=142.91µs min=5.53µs med=11.09µs max=116.83ms p(90)=29.29µs p(95)=126.33µs p(99.9)=25.25ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=313.2ms min=2.87ms med=294.69ms max=1.18s p(90)=618.16ms p(95)=701.44ms p(99.9)=968.92ms
http_reqs......................: 44716 700.36647/s
iteration_duration.............: avg=321.74ms min=3.14ms med=304.22ms max=1.18s p(90)=623.9ms p(95)=706.45ms p(99.9)=971.42ms
iterations.....................: 43716 684.703923/s
success_rate...................: 100.00% ✓ 43716 ✗ 0
vus............................: 56 min=0 max=499
vus_max........................: 500 min=500 max=500
Performance Overview
HTTP Overview
Summary for: hive-gateway-router-runtime
K6 Output
✓ response code was 200
✓ no graphql errors
✗ valid response structure
↳ 99% — ✓ 37654 / ✗ 1
checks.........................: 99.99% ✓ 112964 ✗ 1
data_received..................: 3.4 GB 51 MB/s
data_sent......................: 45 MB 682 kB/s
http_req_blocked...............: avg=151.75µs min=1.33µs med=2.99µs max=204.12ms p(90)=4.82µs p(95)=6.71µs p(99.9)=47.5ms
http_req_connecting............: avg=145.69µs min=0s med=0s max=204.07ms p(90)=0s p(95)=0s p(99.9)=45.39ms
http_req_duration..............: avg=363.59ms min=4.82ms med=355.09ms max=1.28s p(90)=685.27ms p(95)=754.12ms p(99.9)=1.08s
{ expected_response:true }...: avg=363.59ms min=4.82ms med=355.09ms max=1.28s p(90)=685.27ms p(95)=754.12ms p(99.9)=1.08s
http_req_failed................: 0.00% ✓ 0 ✗ 38655
http_req_receiving.............: avg=259.05µs min=26.67µs med=46.47µs max=158.86ms p(90)=104.27µs p(95)=410.05µs p(99.9)=40.76ms
http_req_sending...............: avg=279.76µs min=5.68µs med=11.26µs max=189.53ms p(90)=31.69µs p(95)=134.35µs p(99.9)=55.95ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=363.05ms min=4.77ms med=354.46ms max=1.28s p(90)=684.54ms p(95)=752.99ms p(99.9)=1.08s
http_reqs......................: 38655 585.809192/s
iteration_duration.............: avg=373.79ms min=5.43ms med=368.2ms max=1.3s p(90)=689.52ms p(95)=757.29ms p(99.9)=1.09s
iterations.....................: 37655 570.654381/s
success_rate...................: 99.99% ✓ 37654 ✗ 1
vus............................: 63 min=0 max=497
vus_max........................: 500 min=500 max=500
Performance Overview
HTTP Overview
Summary for: apollo-router
K6 Output
✓ response code was 200
✗ no graphql errors
↳ 99% — ✓ 24879 / ✗ 24
✓ valid response structure
checks.........................: 99.96% ✓ 74685 ✗ 24
data_received..................: 2.3 GB 34 MB/s
data_sent......................: 30 MB 449 kB/s
http_req_blocked...............: avg=86.61µs min=1.76µs med=3.02µs max=117.77ms p(90)=5.05µs p(95)=7.53µs p(99.9)=23.44ms
http_req_connecting............: avg=79.87µs min=0s med=0s max=117.69ms p(90)=0s p(95)=0s p(99.9)=19.24ms
http_req_duration..............: avg=544.5ms min=6.2ms med=498.47ms max=2.58s p(90)=1.12s p(95)=1.23s p(99.9)=1.63s
{ expected_response:true }...: avg=544.5ms min=6.2ms med=498.47ms max=2.58s p(90)=1.12s p(95)=1.23s p(99.9)=1.63s
http_req_failed................: 0.00% ✓ 0 ✗ 25903
http_req_receiving.............: avg=120.46µs min=29.4µs med=55.1µs max=88.62ms p(90)=110.92µs p(95)=189.29µs p(99.9)=8.44ms
http_req_sending...............: avg=114.48µs min=5.84µs med=11.75µs max=80.47ms p(90)=30.04µs p(95)=118.16µs p(99.9)=21.26ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=544.26ms min=6.15ms med=498.21ms max=2.58s p(90)=1.12s p(95)=1.23s p(99.9)=1.62s
http_reqs......................: 25903 385.076266/s
iteration_duration.............: avg=566.76ms min=6.45ms med=524.14ms max=2.58s p(90)=1.13s p(95)=1.24s p(99.9)=1.63s
iterations.....................: 24903 370.210179/s
success_rate...................: 99.90% ✓ 24879 ✗ 24
vus............................: 76 min=0 max=498
vus_max........................: 500 min=500 max=500
Performance Overview
HTTP Overview
Summary for: hive-gateway
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
checks.........................: 100.00% ✓ 51270 ✗ 0
data_received..................: 1.6 GB 23 MB/s
data_sent......................: 21 MB 308 kB/s
http_req_blocked...............: avg=114.34µs min=1.3µs med=3.04µs max=82.15ms p(90)=5.43µs p(95)=8.11µs p(99.9)=29.36ms
http_req_connecting............: avg=106.21µs min=0s med=0s max=82.08ms p(90)=0s p(95)=0s p(99.9)=29.28ms
http_req_duration..............: avg=775.52ms min=6.07ms med=707.16ms max=5.43s p(90)=1.5s p(95)=1.72s p(99.9)=4.11s
{ expected_response:true }...: avg=775.52ms min=6.07ms med=707.16ms max=5.43s p(90)=1.5s p(95)=1.72s p(99.9)=4.11s
http_req_failed................: 0.00% ✓ 0 ✗ 18090
http_req_receiving.............: avg=200.64µs min=26.97µs med=48.61µs max=99.78ms p(90)=103.8µs p(95)=161.81µs p(99.9)=29.42ms
http_req_sending...............: avg=213.73µs min=5.9µs med=11.71µs max=83.91ms p(90)=31.7µs p(95)=110.17µs p(99.9)=41.28ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=775.11ms min=6.01ms med=706.79ms max=5.43s p(90)=1.5s p(95)=1.72s p(99.9)=4.11s
http_reqs......................: 18090 262.770427/s
iteration_duration.............: avg=821.2ms min=7.33ms med=782.7ms max=5.47s p(90)=1.51s p(95)=1.73s p(99.9)=4.15s
iterations.....................: 17090 248.244699/s
success_rate...................: 100.00% ✓ 17090 ✗ 0
vus............................: 59 min=0 max=500
vus_max........................: 500 min=500 max=500
Performance Overview
HTTP Overview
Summary for: apollo-gateway
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
checks.........................: 100.00% ✓ 23586 ✗ 0
data_received..................: 778 MB 11 MB/s
data_sent......................: 11 MB 152 kB/s
http_req_blocked...............: avg=38.71µs min=1.37µs med=3.13µs max=37.94ms p(90)=5.25µs p(95)=12.99µs p(99.9)=7.25ms
http_req_connecting............: avg=32.87µs min=0s med=0s max=37.88ms p(90)=0s p(95)=0s p(99.9)=7.21ms
http_req_duration..............: avg=1.4s min=9.18ms med=1.35s max=19.32s p(90)=2.5s p(95)=2.69s p(99.9)=17.92s
{ expected_response:true }...: avg=1.4s min=9.18ms med=1.35s max=19.32s p(90)=2.5s p(95)=2.69s p(99.9)=17.92s
http_req_failed................: 0.00% ✓ 0 ✗ 8862
http_req_receiving.............: avg=70.45µs min=28.28µs med=52.58µs max=11.36ms p(90)=96.27µs p(95)=118.37µs p(99.9)=951.72µs
http_req_sending...............: avg=45.3µs min=5.96µs med=12.28µs max=29.59ms p(90)=25.58µs p(95)=46.82µs p(99.9)=8.6ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=1.4s min=9.13ms med=1.35s max=19.32s p(90)=2.5s p(95)=2.69s p(99.9)=17.92s
http_reqs......................: 8862 125.666939/s
iteration_duration.............: avg=1.58s min=10.63ms med=1.57s max=19.33s p(90)=2.53s p(95)=2.77s p(99.9)=18.41s
iterations.....................: 7862 111.486513/s
success_rate...................: 100.00% ✓ 7862 ✗ 0
vus............................: 111 min=0 max=500
vus_max........................: 500 min=500 max=500
Performance Overview
HTTP Overview
18440d2 to
329dc70
Compare
This PR contains the following updates:
0.5.6→0.5.7Release Notes
cloudwego/sonic-rs (sonic-rs)
v0.5.7Compare Source
What's Changed
ryu->zmijfor float formatting by @cijiugechu in #199New Contributors
Full Changelog: cloudwego/sonic-rs@v0.5.6...v0.5.7
Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Enabled.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this PR and you won't be reminded about this update again.
This PR was generated by Mend Renovate. View the repository job log.