-
Notifications
You must be signed in to change notification settings - Fork 9
Hive Gateway Rust QP without inflight request deduplication #869
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
💻 Website PreviewThe latest changes are available as preview in: https://bd3f2abc.federation-gateway-benchmark.pages.dev |
Overview for:
|
| Gateway | RPS ⬇️ | Requests | Duration | Notes |
|---|---|---|---|---|
| hive-router | 1690 | 101854 total, 0 failed | avg: 29ms, p95: 51ms | ✅ |
| grafbase | 1576 | 95211 total, 0 failed | avg: 31ms, p95: 54ms | ✅ |
| cosmo | 678 | 41015 total, 0 failed | avg: 73ms, p95: 107ms | ✅ |
| hive-gateway-router-runtime | 318 | 19358 total, 0 failed | avg: 155ms, p95: 199ms | ✅ |
| hive-gateway | 295 | 18033 total, 0 failed | avg: 166ms, p95: 289ms | ✅ |
| apollo-router | 252 | 15329 total, 0 failed | avg: 195ms, p95: 247ms | ✅ |
| apollo-gateway | 126 | 7730 total, 0 failed | avg: 389ms, p95: 457ms | ✅ |
Summary for: hive-router
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
checks.........................: 100.00% ✓ 305262 ✗ 0
data_received..................: 8.9 GB 148 MB/s
data_sent......................: 119 MB 2.0 MB/s
http_req_blocked...............: avg=5.25µs min=1.19µs med=2.55µs max=8.96ms p(90)=3.68µs p(95)=4.4µs p(99.9)=97.05µs
http_req_connecting............: avg=2.23µs min=0s med=0s max=8.92ms p(90)=0s p(95)=0s p(99.9)=0s
http_req_duration..............: avg=29.2ms min=1.91ms med=26.89ms max=438.75ms p(90)=44.52ms p(95)=50.65ms p(99.9)=94.09ms
{ expected_response:true }...: avg=29.2ms min=1.91ms med=26.89ms max=438.75ms p(90)=44.52ms p(95)=50.65ms p(99.9)=94.09ms
http_req_failed................: 0.00% ✓ 0 ✗ 101854
http_req_receiving.............: avg=122.35µs min=24.98µs med=43.84µs max=352.55ms p(90)=110.16µs p(95)=344.53µs p(99.9)=12.71ms
http_req_sending...............: avg=97.26µs min=5.14µs med=10.3µs max=390.51ms p(90)=32.05µs p(95)=125.85µs p(99.9)=13.25ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=28.98ms min=1.85ms med=26.72ms max=430.9ms p(90)=44.15ms p(95)=50.24ms p(99.9)=91.7ms
http_reqs......................: 101854 1690.092524/s
iteration_duration.............: avg=29.47ms min=4ms med=27.13ms max=461.46ms p(90)=44.77ms p(95)=50.9ms p(99.9)=94.88ms
iterations.....................: 101754 1688.433195/s
success_rate...................: 100.00% ✓ 101754 ✗ 0
vus............................: 50 min=50 max=50
vus_max........................: 50 min=50 max=50
Performance Overview
HTTP Overview
Summary for: grafbase
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
checks.........................: 100.00% ✓ 285333 ✗ 0
data_received..................: 8.4 GB 139 MB/s
data_sent......................: 111 MB 1.8 MB/s
http_req_blocked...............: avg=8.92µs min=1.21µs med=2.91µs max=23.13ms p(90)=4.07µs p(95)=4.85µs p(99.9)=112.35µs
http_req_connecting............: avg=5.42µs min=0s med=0s max=23.1ms p(90)=0s p(95)=0s p(99.9)=0s
http_req_duration..............: avg=31.22ms min=2.71ms med=28.06ms max=458.5ms p(90)=47.63ms p(95)=54.16ms p(99.9)=95.65ms
{ expected_response:true }...: avg=31.22ms min=2.71ms med=28.06ms max=458.5ms p(90)=47.63ms p(95)=54.16ms p(99.9)=95.65ms
http_req_failed................: 0.00% ✓ 0 ✗ 95211
http_req_receiving.............: avg=151.14µs min=27.86µs med=48.02µs max=47.79ms p(90)=144.06µs p(95)=386.15µs p(99.9)=18.43ms
http_req_sending...............: avg=125.21µs min=5.45µs med=11.66µs max=307.15ms p(90)=38.05µs p(95)=136.25µs p(99.9)=17.22ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=30.94ms min=2.64ms med=27.86ms max=449.52ms p(90)=47.13ms p(95)=53.63ms p(99.9)=92.18ms
http_reqs......................: 95211 1576.738369/s
iteration_duration.............: avg=31.53ms min=4.51ms med=28.35ms max=492.17ms p(90)=47.92ms p(95)=54.46ms p(99.9)=97.07ms
iterations.....................: 95111 1575.082323/s
success_rate...................: 100.00% ✓ 95111 ✗ 0
vus............................: 50 min=50 max=50
vus_max........................: 50 min=50 max=50
Performance Overview
HTTP Overview
Summary for: cosmo
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
checks.........................: 100.00% ✓ 122745 ✗ 0
data_received..................: 3.6 GB 60 MB/s
data_sent......................: 48 MB 789 kB/s
http_req_blocked...............: avg=17.53µs min=1.33µs med=2.88µs max=18.59ms p(90)=4.02µs p(95)=4.91µs p(99.9)=8ms
http_req_connecting............: avg=13.83µs min=0s med=0s max=18.56ms p(90)=0s p(95)=0s p(99.9)=7.44ms
http_req_duration..............: avg=72.86ms min=2.91ms med=71.82ms max=511.47ms p(90)=98.61ms p(95)=106.6ms p(99.9)=286.85ms
{ expected_response:true }...: avg=72.86ms min=2.91ms med=71.82ms max=511.47ms p(90)=98.61ms p(95)=106.6ms p(99.9)=286.85ms
http_req_failed................: 0.00% ✓ 0 ✗ 41015
http_req_receiving.............: avg=170.03µs min=29.37µs med=71.09µs max=301.1ms p(90)=145.55µs p(95)=384.3µs p(99.9)=15.7ms
http_req_sending...............: avg=62.53µs min=5.62µs med=11.2µs max=339ms p(90)=29.95µs p(95)=124.44µs p(99.9)=6.06ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=72.63ms min=2.83ms med=71.6ms max=489.55ms p(90)=98.37ms p(95)=106.32ms p(99.9)=279.35ms
http_reqs......................: 41015 678.537718/s
iteration_duration.............: avg=73.35ms min=6.7ms med=72.15ms max=564.61ms p(90)=98.92ms p(95)=106.93ms p(99.9)=301.47ms
iterations.....................: 40915 676.883353/s
success_rate...................: 100.00% ✓ 40915 ✗ 0
vus............................: 50 min=50 max=50
vus_max........................: 50 min=50 max=50
Performance Overview
HTTP Overview
Summary for: hive-gateway-router-runtime
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
checks.........................: 100.00% ✓ 57774 ✗ 0
data_received..................: 1.7 GB 28 MB/s
data_sent......................: 23 MB 371 kB/s
http_req_blocked...............: avg=42.31µs min=1.49µs med=3.92µs max=20.57ms p(90)=5.78µs p(95)=6.65µs p(99.9)=15.71ms
http_req_connecting............: avg=37.11µs min=0s med=0s max=20.51ms p(90)=0s p(95)=0s p(99.9)=15.65ms
http_req_duration..............: avg=154.63ms min=4.82ms med=151.06ms max=625.81ms p(90)=187.03ms p(95)=199.4ms p(99.9)=448.26ms
{ expected_response:true }...: avg=154.63ms min=4.82ms med=151.06ms max=625.81ms p(90)=187.03ms p(95)=199.4ms p(99.9)=448.26ms
http_req_failed................: 0.00% ✓ 0 ✗ 19358
http_req_receiving.............: avg=104.77µs min=35.24µs med=70.03µs max=273.73ms p(90)=121.01µs p(95)=151.68µs p(99.9)=2.2ms
http_req_sending...............: avg=94.84µs min=7.47µs med=15.38µs max=416.62ms p(90)=26.97µs p(95)=44.98µs p(99.9)=3.71ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=154.43ms min=4.72ms med=150.92ms max=611.54ms p(90)=186.91ms p(95)=199.19ms p(99.9)=429.25ms
http_reqs......................: 19358 318.961295/s
iteration_duration.............: avg=155.86ms min=35.88ms med=151.58ms max=665.24ms p(90)=187.49ms p(95)=199.93ms p(99.9)=513.52ms
iterations.....................: 19258 317.313598/s
success_rate...................: 100.00% ✓ 19258 ✗ 0
vus............................: 50 min=50 max=50
vus_max........................: 50 min=50 max=50
Performance Overview
HTTP Overview
Summary for: hive-gateway
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
checks.........................: 100.00% ✓ 53799 ✗ 0
data_received..................: 1.6 GB 26 MB/s
data_sent......................: 21 MB 344 kB/s
http_req_blocked...............: avg=54.19µs min=1.26µs med=2.76µs max=185.18ms p(90)=4.63µs p(95)=5.92µs p(99.9)=16.11ms
http_req_connecting............: avg=39.81µs min=0s med=0s max=20.35ms p(90)=0s p(95)=0s p(99.9)=15.7ms
http_req_duration..............: avg=165.99ms min=7.07ms med=149.8ms max=1.46s p(90)=181.02ms p(95)=289.04ms p(99.9)=1.45s
{ expected_response:true }...: avg=165.99ms min=7.07ms med=149.8ms max=1.46s p(90)=181.02ms p(95)=289.04ms p(99.9)=1.45s
http_req_failed................: 0.00% ✓ 0 ✗ 18033
http_req_receiving.............: avg=99.67µs min=26.09µs med=53.56µs max=19.86ms p(90)=120.35µs p(95)=235.66µs p(99.9)=4.42ms
http_req_sending...............: avg=95.02µs min=5.38µs med=11.26µs max=439.98ms p(90)=33.15µs p(95)=127.89µs p(99.9)=4.52ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=165.79ms min=6.98ms med=149.64ms max=1.46s p(90)=180.83ms p(95)=286.21ms p(99.9)=1.45s
http_reqs......................: 18033 295.83755/s
iteration_duration.............: avg=167.38ms min=37.87ms med=150.24ms max=1.46s p(90)=181.64ms p(95)=298.65ms p(99.9)=1.45s
iterations.....................: 17933 294.197015/s
success_rate...................: 100.00% ✓ 17933 ✗ 0
vus............................: 50 min=50 max=50
vus_max........................: 50 min=50 max=50
Performance Overview
HTTP Overview
Summary for: apollo-router
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
checks.........................: 100.00% ✓ 45687 ✗ 0
data_received..................: 1.3 GB 22 MB/s
data_sent......................: 18 MB 293 kB/s
http_req_blocked...............: avg=46.24µs min=1.86µs med=3.25µs max=18.18ms p(90)=4.82µs p(95)=5.61µs p(99.9)=14.58ms
http_req_connecting............: avg=41.61µs min=0s med=0s max=18.02ms p(90)=0s p(95)=0s p(99.9)=14.56ms
http_req_duration..............: avg=195.45ms min=5.56ms med=195.66ms max=619.05ms p(90)=235.45ms p(95)=247.43ms p(99.9)=472.66ms
{ expected_response:true }...: avg=195.45ms min=5.56ms med=195.66ms max=619.05ms p(90)=235.45ms p(95)=247.43ms p(99.9)=472.66ms
http_req_failed................: 0.00% ✓ 0 ✗ 15329
http_req_receiving.............: avg=122.36µs min=38.04µs med=64.21µs max=304.51ms p(90)=113.73µs p(95)=140.52µs p(99.9)=1.92ms
http_req_sending...............: avg=93.34µs min=7.56µs med=12.96µs max=256.02ms p(90)=22.16µs p(95)=37.57µs p(99.9)=5.33ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=195.23ms min=5.51ms med=195.56ms max=586.21ms p(90)=235.27ms p(95)=247.11ms p(99.9)=463.37ms
http_reqs......................: 15329 252.245918/s
iteration_duration.............: avg=197.17ms min=56.65ms med=196.19ms max=643.77ms p(90)=235.96ms p(95)=247.93ms p(99.9)=524.57ms
iterations.....................: 15229 250.600371/s
success_rate...................: 100.00% ✓ 15229 ✗ 0
vus............................: 50 min=50 max=50
vus_max........................: 50 min=50 max=50
Performance Overview
HTTP Overview
Summary for: apollo-gateway
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
checks.........................: 100.00% ✓ 22890 ✗ 0
data_received..................: 679 MB 11 MB/s
data_sent......................: 9.0 MB 147 kB/s
http_req_blocked...............: avg=31.55µs min=1.2µs med=2.92µs max=9.1ms p(90)=4.77µs p(95)=5.61µs p(99.9)=7.43ms
http_req_connecting............: avg=28.2µs min=0s med=0s max=9.07ms p(90)=0s p(95)=0s p(99.9)=7.4ms
http_req_duration..............: avg=388.54ms min=7.09ms med=388.36ms max=793.57ms p(90)=441.55ms p(95)=457.38ms p(99.9)=744.59ms
{ expected_response:true }...: avg=388.54ms min=7.09ms med=388.36ms max=793.57ms p(90)=441.55ms p(95)=457.38ms p(99.9)=744.59ms
http_req_failed................: 0.00% ✓ 0 ✗ 7730
http_req_receiving.............: avg=64.71µs min=27.94µs med=54.86µs max=10.54ms p(90)=90.57µs p(95)=101.84µs p(99.9)=642.42µs
http_req_sending...............: avg=148.9µs min=5.29µs med=11.43µs max=174ms p(90)=18.47µs p(95)=22.32µs p(99.9)=49.24ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=388.33ms min=7.03ms med=388.29ms max=792.88ms p(90)=441.47ms p(95)=457.14ms p(99.9)=743.9ms
http_reqs......................: 7730 126.589726/s
iteration_duration.............: avg=393.97ms min=72.63ms med=388.93ms max=823.71ms p(90)=442.2ms p(95)=458ms p(99.9)=764.77ms
iterations.....................: 7630 124.952084/s
success_rate...................: 100.00% ✓ 7630 ✗ 0
vus............................: 22 min=22 max=50
vus_max........................: 50 min=50 max=50
Performance Overview
HTTP Overview
No description provided.