-
Notifications
You must be signed in to change notification settings - Fork 9
Lock file maintenance #876
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
💻 Website PreviewThe latest changes are available as preview in: https://fa4dd0ee.federation-gateway-benchmark.pages.dev |
Overview for:
|
| Gateway | RPS ⬇️ | Requests | Duration | Notes |
|---|---|---|---|---|
| hive-router | 1757 | 109523 total, 0 failed | avg: 127ms, p95: 307ms | ✅ |
| grafbase | 1547 | 97824 total, 0 failed | avg: 142ms, p95: 330ms | ✅ |
| cosmo | 712 | 45413 total, 0 failed | avg: 309ms, p95: 688ms | ✅ |
| hive-gateway-router-runtime | 602 | 39679 total, 0 failed | avg: 354ms, p95: 722ms | ❌ non-compatible response structure (1) |
| apollo-router | 394 | 26439 total, 0 failed | avg: 533ms, p95: 1229ms | ❌ 19 unexpected GraphQL errors |
| hive-gateway | 270 | 18487 total, 0 failed | avg: 759ms, p95: 1706ms | ✅ |
| apollo-gateway | 158 | 10920 total, 0 failed | avg: 1197ms, p95: 2624ms | ✅ |
Summary for: hive-router
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
checks.........................: 100.00% ✓ 325569 ✗ 0
data_received..................: 9.6 GB 154 MB/s
data_sent......................: 127 MB 2.0 MB/s
http_req_blocked...............: avg=502.78µs min=1.19µs med=2.64µs max=366.95ms p(90)=4.13µs p(95)=4.95µs p(99.9)=175.54ms
http_req_connecting............: avg=499.15µs min=0s med=0s max=366.88ms p(90)=0s p(95)=0s p(99.9)=175.5ms
http_req_duration..............: avg=127.13ms min=1.92ms med=113.46ms max=497.76ms p(90)=258.09ms p(95)=307ms p(99.9)=400.8ms
{ expected_response:true }...: avg=127.13ms min=1.92ms med=113.46ms max=497.76ms p(90)=258.09ms p(95)=307ms p(99.9)=400.8ms
http_req_failed................: 0.00% ✓ 0 ✗ 109523
http_req_receiving.............: avg=537.3µs min=24.01µs med=42.9µs max=146.74ms p(90)=108.77µs p(95)=406.21µs p(99.9)=78.55ms
http_req_sending...............: avg=465.48µs min=5.37µs med=10.33µs max=129.28ms p(90)=28.63µs p(95)=131.28µs p(99.9)=74.33ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=126.13ms min=1.87ms med=112.33ms max=451.85ms p(90)=255.89ms p(95)=304.85ms p(99.9)=397.87ms
http_reqs......................: 109523 1757.268843/s
iteration_duration.............: avg=129.12ms min=2.07ms med=115.17ms max=869.92ms p(90)=260.41ms p(95)=309.54ms p(99.9)=441.19ms
iterations.....................: 108523 1741.224095/s
success_rate...................: 100.00% ✓ 108523 ✗ 0
vus............................: 76 min=0 max=494
vus_max........................: 500 min=500 max=500
Performance Overview
HTTP Overview
Summary for: grafbase
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
checks.........................: 100.00% ✓ 290472 ✗ 0
data_received..................: 8.6 GB 136 MB/s
data_sent......................: 114 MB 1.8 MB/s
http_req_blocked...............: avg=677.2µs min=1.28µs med=2.87µs max=383.19ms p(90)=4.11µs p(95)=4.92µs p(99.9)=216.78ms
http_req_connecting............: avg=672.23µs min=0s med=0s max=383.15ms p(90)=0s p(95)=0s p(99.9)=216.71ms
http_req_duration..............: avg=142.22ms min=2.48ms med=130.75ms max=474.7ms p(90)=280.84ms p(95)=329.71ms p(99.9)=425.04ms
{ expected_response:true }...: avg=142.22ms min=2.48ms med=130.75ms max=474.7ms p(90)=280.84ms p(95)=329.71ms p(99.9)=425.04ms
http_req_failed................: 0.00% ✓ 0 ✗ 97824
http_req_receiving.............: avg=652.39µs min=24.41µs med=46.57µs max=159.03ms p(90)=147.88µs p(95)=425.15µs p(99.9)=86.26ms
http_req_sending...............: avg=596.85µs min=5.24µs med=11.65µs max=150.49ms p(90)=31.16µs p(95)=135.96µs p(99.9)=85.88ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=140.97ms min=2.44ms med=129.32ms max=442.6ms p(90)=277.96ms p(95)=326.91ms p(99.9)=420.36ms
http_reqs......................: 97824 1547.612497/s
iteration_duration.............: avg=144.74ms min=2.75ms med=132.8ms max=844.16ms p(90)=283.93ms p(95)=333.72ms p(99.9)=517.92ms
iterations.....................: 96824 1531.792121/s
success_rate...................: 100.00% ✓ 96824 ✗ 0
vus............................: 74 min=0 max=494
vus_max........................: 500 min=500 max=500
Performance Overview
HTTP Overview
Summary for: cosmo
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
checks.........................: 100.00% ✓ 133239 ✗ 0
data_received..................: 4.0 GB 63 MB/s
data_sent......................: 53 MB 830 kB/s
http_req_blocked...............: avg=106.45µs min=1.22µs med=2.73µs max=185.56ms p(90)=4.02µs p(95)=5.66µs p(99.9)=31.87ms
http_req_connecting............: avg=101.9µs min=0s med=0s max=185.4ms p(90)=0s p(95)=0s p(99.9)=31.78ms
http_req_duration..............: avg=309.11ms min=2.75ms med=291.21ms max=1.05s p(90)=610.17ms p(95)=687.64ms p(99.9)=939.16ms
{ expected_response:true }...: avg=309.11ms min=2.75ms med=291.21ms max=1.05s p(90)=610.17ms p(95)=687.64ms p(99.9)=939.16ms
http_req_failed................: 0.00% ✓ 0 ✗ 45413
http_req_receiving.............: avg=560.09µs min=27.35µs med=57.18µs max=185.65ms p(90)=171.46µs p(95)=447.02µs p(99.9)=74.6ms
http_req_sending...............: avg=164.01µs min=5.56µs med=10.91µs max=128.59ms p(90)=29.69µs p(95)=126.02µs p(99.9)=30.67ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=308.39ms min=2.69ms med=290.51ms max=1.05s p(90)=608.9ms p(95)=685.36ms p(99.9)=937.75ms
http_reqs......................: 45413 712.50142/s
iteration_duration.............: avg=316.59ms min=3.05ms med=300.28ms max=1.05s p(90)=612.81ms p(95)=690.14ms p(99.9)=945.82ms
iterations.....................: 44413 696.812049/s
success_rate...................: 100.00% ✓ 44413 ✗ 0
vus............................: 98 min=0 max=500
vus_max........................: 500 min=500 max=500
Performance Overview
HTTP Overview
Summary for: hive-gateway-router-runtime
K6 Output
✓ response code was 200
✓ no graphql errors
✗ valid response structure
↳ 99% — ✓ 38678 / ✗ 1
checks.........................: 99.99% ✓ 116036 ✗ 1
data_received..................: 3.5 GB 53 MB/s
data_sent......................: 46 MB 702 kB/s
http_req_blocked...............: avg=164.96µs min=1.27µs med=2.92µs max=163.61ms p(90)=4.56µs p(95)=6.28µs p(99.9)=51.38ms
http_req_connecting............: avg=159.1µs min=0s med=0s max=163.57ms p(90)=0s p(95)=0s p(99.9)=51.24ms
http_req_duration..............: avg=353.98ms min=4.69ms med=345.58ms max=1.25s p(90)=661.47ms p(95)=721.75ms p(99.9)=1.08s
{ expected_response:true }...: avg=353.98ms min=4.69ms med=345.58ms max=1.25s p(90)=661.47ms p(95)=721.75ms p(99.9)=1.08s
http_req_failed................: 0.00% ✓ 0 ✗ 39679
http_req_receiving.............: avg=240.08µs min=27.58µs med=45.96µs max=129.2ms p(90)=96.33µs p(95)=391.59µs p(99.9)=39.53ms
http_req_sending...............: avg=269.5µs min=5.62µs med=11.08µs max=178.42ms p(90)=29.56µs p(95)=131.88µs p(99.9)=52.24ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=353.47ms min=4.65ms med=345.23ms max=1.25s p(90)=660.77ms p(95)=720.51ms p(99.9)=1.08s
http_reqs......................: 39679 602.572694/s
iteration_duration.............: avg=363.77ms min=5.32ms med=353.73ms max=1.28s p(90)=664.78ms p(95)=724.58ms p(99.9)=1.08s
iterations.....................: 38679 587.386507/s
success_rate...................: 99.99% ✓ 38678 ✗ 1
vus............................: 56 min=0 max=499
vus_max........................: 500 min=500 max=500
Performance Overview
HTTP Overview
Summary for: apollo-router
K6 Output
✓ response code was 200
✗ no graphql errors
↳ 99% — ✓ 25420 / ✗ 19
✓ valid response structure
checks.........................: 99.97% ✓ 76298 ✗ 19
data_received..................: 2.3 GB 35 MB/s
data_sent......................: 31 MB 460 kB/s
http_req_blocked...............: avg=82.83µs min=1.48µs med=3.06µs max=105.4ms p(90)=4.88µs p(95)=7.01µs p(99.9)=18.98ms
http_req_connecting............: avg=77.14µs min=0s med=0s max=105.23ms p(90)=0s p(95)=0s p(99.9)=18.87ms
http_req_duration..............: avg=533.14ms min=6.08ms med=481.04ms max=2.06s p(90)=1.09s p(95)=1.22s p(99.9)=1.91s
{ expected_response:true }...: avg=533.14ms min=6.08ms med=481.04ms max=2.06s p(90)=1.09s p(95)=1.22s p(99.9)=1.91s
http_req_failed................: 0.00% ✓ 0 ✗ 26439
http_req_receiving.............: avg=140.67µs min=29.52µs med=53.52µs max=119.93ms p(90)=105.39µs p(95)=176.49µs p(99.9)=13.44ms
http_req_sending...............: avg=131.47µs min=6.23µs med=11.73µs max=150.67ms p(90)=30.47µs p(95)=116.61µs p(99.9)=29.22ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=532.87ms min=6.03ms med=480.78ms max=2.06s p(90)=1.09s p(95)=1.22s p(99.9)=1.91s
http_reqs......................: 26439 394.647005/s
iteration_duration.............: avg=554.58ms min=6.47ms med=508.63ms max=2.06s p(90)=1.09s p(95)=1.23s p(99.9)=1.92s
iterations.....................: 25439 379.720306/s
success_rate...................: 99.92% ✓ 25420 ✗ 19
vus............................: 62 min=0 max=497
vus_max........................: 500 min=500 max=500
Performance Overview
HTTP Overview
Summary for: hive-gateway
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
checks.........................: 100.00% ✓ 52461 ✗ 0
data_received..................: 1.6 GB 24 MB/s
data_sent......................: 22 MB 317 kB/s
http_req_blocked...............: avg=98.62µs min=1.27µs med=2.81µs max=73.48ms p(90)=4.76µs p(95)=7.39µs p(99.9)=27.33ms
http_req_connecting............: avg=93.14µs min=0s med=0s max=73.42ms p(90)=0s p(95)=0s p(99.9)=27.26ms
http_req_duration..............: avg=758.76ms min=6.1ms med=699.61ms max=4.6s p(90)=1.55s p(95)=1.7s p(99.9)=3.67s
{ expected_response:true }...: avg=758.76ms min=6.1ms med=699.61ms max=4.6s p(90)=1.55s p(95)=1.7s p(99.9)=3.67s
http_req_failed................: 0.00% ✓ 0 ✗ 18487
http_req_receiving.............: avg=139.69µs min=28.38µs med=44.73µs max=44.55ms p(90)=89.71µs p(95)=137.44µs p(99.9)=16.92ms
http_req_sending...............: avg=179.99µs min=5.83µs med=10.89µs max=97.2ms p(90)=27.81µs p(95)=63.38µs p(99.9)=32.34ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=758.44ms min=6.05ms med=698.24ms max=4.6s p(90)=1.55s p(95)=1.7s p(99.9)=3.67s
http_reqs......................: 18487 270.207909/s
iteration_duration.............: avg=802.55ms min=7.85ms med=751.71ms max=4.61s p(90)=1.55s p(95)=1.71s p(99.9)=3.73s
iterations.....................: 17487 255.591806/s
success_rate...................: 100.00% ✓ 17487 ✗ 0
vus............................: 85 min=0 max=500
vus_max........................: 500 min=500 max=500
Performance Overview
HTTP Overview
Summary for: apollo-gateway
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
checks.........................: 100.00% ✓ 29760 ✗ 0
data_received..................: 959 MB 14 MB/s
data_sent......................: 13 MB 190 kB/s
http_req_blocked...............: avg=34.47µs min=1.36µs med=3.22µs max=38.74ms p(90)=5.29µs p(95)=11.49µs p(99.9)=5.57ms
http_req_connecting............: avg=28.34µs min=0s med=0s max=38.68ms p(90)=0s p(95)=0s p(99.9)=5.52ms
http_req_duration..............: avg=1.19s min=7.42ms med=1.14s max=15.03s p(90)=2.19s p(95)=2.62s p(99.9)=13.24s
{ expected_response:true }...: avg=1.19s min=7.42ms med=1.14s max=15.03s p(90)=2.19s p(95)=2.62s p(99.9)=13.24s
http_req_failed................: 0.00% ✓ 0 ✗ 10920
http_req_receiving.............: avg=79.46µs min=28.34µs med=55.13µs max=18.78ms p(90)=101.59µs p(95)=124.25µs p(99.9)=3.02ms
http_req_sending...............: avg=42.08µs min=5.98µs med=12.63µs max=19.82ms p(90)=29.54µs p(95)=45.29µs p(99.9)=6.14ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=1.19s min=7.37ms med=1.13s max=15.03s p(90)=2.19s p(95)=2.62s p(99.9)=13.24s
http_reqs......................: 10920 158.815375/s
iteration_duration.............: avg=1.31s min=7.82ms med=1.27s max=15.06s p(90)=2.24s p(95)=2.66s p(99.9)=13.34s
iterations.....................: 9920 144.271843/s
success_rate...................: 100.00% ✓ 9920 ✗ 0
vus............................: 115 min=0 max=500
vus_max........................: 500 min=500 max=500
Performance Overview
HTTP Overview
This PR contains the following updates:
🔧 This Pull Request updates lock files to use the latest dependency versions.
Configuration
📅 Schedule: Branch creation - "before 4am on monday" (UTC), Automerge - At any time (no schedule defined).
🚦 Automerge: Enabled.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
👻 Immortal: This PR will be recreated if closed unmerged. Get config help if that's undesired.
This PR was generated by Mend Renovate. View the repository job log.