Skip to content

Commit 0670f0d

Browse files
committed
NFR Test Results for NGF version edge
1 parent 17091ba commit 0670f0d

File tree

72 files changed

+582
-552
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

72 files changed

+582
-552
lines changed

tests/results/dp-perf/edge/edge-oss.md

Lines changed: 19 additions & 19 deletions
Original file line numberDiff line numberDiff line change
@@ -6,16 +6,16 @@ NGINX Plus: false
66

77
NGINX Gateway Fabric:
88

9-
- Commit: e7d217a8f01fb3c8fc4507ef6f0e7feead667f20
10-
- Date: 2024-11-14T18:42:55Z
9+
- Commit: 17091ba5d59ca6026f7610e3c2c6200e7ac5cd16
10+
- Date: 2024-12-18T16:52:33Z
1111
- Dirty: false
1212

1313
GKE Cluster:
1414

1515
- Node count: 12
16-
- k8s version: v1.30.5-gke.1443001
16+
- k8s version: v1.30.6-gke.1125000
1717
- vCPUs per node: 16
18-
- RAM per node: 65853972Ki
18+
- RAM per node: 65853980Ki
1919
- Max pods per node: 110
2020
- Zone: us-west1-b
2121
- Instance Type: n2d-standard-16
@@ -24,8 +24,8 @@ GKE Cluster:
2424

2525
```text
2626
Requests [total, rate, throughput] 30000, 1000.03, 1000.01
27-
Duration [total, attack, wait] 30s, 29.999s, 546.336µs
28-
Latencies [min, mean, 50, 90, 95, 99, max] 466.328µs, 652.455µs, 635.612µs, 733.819µs, 775.191µs, 898.404µs, 12.115ms
27+
Duration [total, attack, wait] 30s, 29.999s, 751.733µs
28+
Latencies [min, mean, 50, 90, 95, 99, max] 502.958µs, 778.73µs, 754.286µs, 871.965µs, 915.632µs, 1.057ms, 12.51ms
2929
Bytes In [total, mean] 4830000, 161.00
3030
Bytes Out [total, mean] 0, 0.00
3131
Success [ratio] 100.00%
@@ -37,8 +37,8 @@ Error Set:
3737

3838
```text
3939
Requests [total, rate, throughput] 30000, 1000.03, 1000.00
40-
Duration [total, attack, wait] 30s, 29.999s, 726.771µs
41-
Latencies [min, mean, 50, 90, 95, 99, max] 516.729µs, 667.447µs, 651.234µs, 748.002µs, 789.132µs, 912.936µs, 12.01ms
40+
Duration [total, attack, wait] 30s, 29.999s, 775.136µs
41+
Latencies [min, mean, 50, 90, 95, 99, max] 561.272µs, 795.757µs, 770.833µs, 885.231µs, 930.053µs, 1.067ms, 13.121ms
4242
Bytes In [total, mean] 4860000, 162.00
4343
Bytes Out [total, mean] 0, 0.00
4444
Success [ratio] 100.00%
@@ -49,22 +49,22 @@ Error Set:
4949
## Test3: Running coffee query based routing
5050

5151
```text
52-
Requests [total, rate, throughput] 29999, 1000.02, 1000.00
53-
Duration [total, attack, wait] 29.999s, 29.998s, 775.462µs
54-
Latencies [min, mean, 50, 90, 95, 99, max] 509.103µs, 675.843µs, 660.979µs, 753.464µs, 790.594µs, 915.896µs, 10.924ms
55-
Bytes In [total, mean] 5099830, 170.00
52+
Requests [total, rate, throughput] 30000, 1000.03, 1000.01
53+
Duration [total, attack, wait] 30s, 29.999s, 769.983µs
54+
Latencies [min, mean, 50, 90, 95, 99, max] 544.642µs, 818.202µs, 782.613µs, 910.949µs, 965.021µs, 1.141ms, 13.326ms
55+
Bytes In [total, mean] 5100000, 170.00
5656
Bytes Out [total, mean] 0, 0.00
5757
Success [ratio] 100.00%
58-
Status Codes [code:count] 200:29999
58+
Status Codes [code:count] 200:30000
5959
Error Set:
6060
```
6161

6262
## Test4: Running tea GET method based routing
6363

6464
```text
65-
Requests [total, rate, throughput] 30000, 1000.04, 1000.02
66-
Duration [total, attack, wait] 30s, 29.999s, 579.805µs
67-
Latencies [min, mean, 50, 90, 95, 99, max] 495.375µs, 663.275µs, 645.382µs, 747.059µs, 791.431µs, 925.516µs, 10.063ms
65+
Requests [total, rate, throughput] 30000, 1000.01, 999.98
66+
Duration [total, attack, wait] 30.001s, 30s, 922.656µs
67+
Latencies [min, mean, 50, 90, 95, 99, max] 541.539µs, 789.968µs, 766.062µs, 894.92µs, 943.868µs, 1.075ms, 12.825ms
6868
Bytes In [total, mean] 4770000, 159.00
6969
Bytes Out [total, mean] 0, 0.00
7070
Success [ratio] 100.00%
@@ -75,9 +75,9 @@ Error Set:
7575
## Test5: Running tea POST method based routing
7676

7777
```text
78-
Requests [total, rate, throughput] 30000, 1000.01, 999.99
79-
Duration [total, attack, wait] 30s, 30s, 604.093µs
80-
Latencies [min, mean, 50, 90, 95, 99, max] 499.363µs, 654.309µs, 639.452µs, 737.027µs, 777.872µs, 904.014µs, 8.053ms
78+
Requests [total, rate, throughput] 30000, 1000.02, 999.99
79+
Duration [total, attack, wait] 30s, 29.999s, 821.641µs
80+
Latencies [min, mean, 50, 90, 95, 99, max] 528.696µs, 784.021µs, 758.936µs, 882.673µs, 926.159µs, 1.06ms, 12.389ms
8181
Bytes In [total, mean] 4770000, 159.00
8282
Bytes Out [total, mean] 0, 0.00
8383
Success [ratio] 100.00%

tests/results/dp-perf/edge/edge-plus.md

Lines changed: 24 additions & 24 deletions
Original file line numberDiff line numberDiff line change
@@ -6,27 +6,27 @@ NGINX Plus: true
66

77
NGINX Gateway Fabric:
88

9-
- Commit: e7d217a8f01fb3c8fc4507ef6f0e7feead667f20
10-
- Date: 2024-11-14T18:42:55Z
9+
- Commit: 17091ba5d59ca6026f7610e3c2c6200e7ac5cd16
10+
- Date: 2024-12-18T16:52:33Z
1111
- Dirty: false
1212

1313
GKE Cluster:
1414

1515
- Node count: 12
16-
- k8s version: v1.30.5-gke.1443001
16+
- k8s version: v1.30.6-gke.1125000
1717
- vCPUs per node: 16
18-
- RAM per node: 65853972Ki
18+
- RAM per node: 65853984Ki
1919
- Max pods per node: 110
2020
- Zone: us-west1-b
2121
- Instance Type: n2d-standard-16
2222

2323
## Test1: Running latte path based routing
2424

2525
```text
26-
Requests [total, rate, throughput] 30000, 1000.01, 999.98
27-
Duration [total, attack, wait] 30.001s, 30s, 852.811µs
28-
Latencies [min, mean, 50, 90, 95, 99, max] 484.762µs, 663.414µs, 647.232µs, 739.971µs, 776.515µs, 867.279µs, 19.761ms
29-
Bytes In [total, mean] 4800000, 160.00
26+
Requests [total, rate, throughput] 30000, 1000.01, 999.99
27+
Duration [total, attack, wait] 30s, 30s, 634.387µs
28+
Latencies [min, mean, 50, 90, 95, 99, max] 556.824µs, 790.374µs, 774.114µs, 899.825µs, 947.466µs, 1.076ms, 11.134ms
29+
Bytes In [total, mean] 4830000, 161.00
3030
Bytes Out [total, mean] 0, 0.00
3131
Success [ratio] 100.00%
3232
Status Codes [code:count] 200:30000
@@ -36,10 +36,10 @@ Error Set:
3636
## Test2: Running coffee header based routing
3737

3838
```text
39-
Requests [total, rate, throughput] 30000, 1000.04, 1000.02
40-
Duration [total, attack, wait] 30s, 29.999s, 592.984µs
41-
Latencies [min, mean, 50, 90, 95, 99, max] 532.501µs, 697.491µs, 682.822µs, 782.979µs, 820.727µs, 919.977µs, 11.809ms
42-
Bytes In [total, mean] 4830000, 161.00
39+
Requests [total, rate, throughput] 30000, 1000.01, 999.98
40+
Duration [total, attack, wait] 30.001s, 30s, 821.625µs
41+
Latencies [min, mean, 50, 90, 95, 99, max] 580.185µs, 825.124µs, 807.498µs, 942.495µs, 992.13µs, 1.115ms, 11.269ms
42+
Bytes In [total, mean] 4860000, 162.00
4343
Bytes Out [total, mean] 0, 0.00
4444
Success [ratio] 100.00%
4545
Status Codes [code:count] 200:30000
@@ -49,10 +49,10 @@ Error Set:
4949
## Test3: Running coffee query based routing
5050

5151
```text
52-
Requests [total, rate, throughput] 30000, 1000.03, 1000.01
53-
Duration [total, attack, wait] 30s, 29.999s, 757.242µs
54-
Latencies [min, mean, 50, 90, 95, 99, max] 522.486µs, 706.577µs, 693.391µs, 796.96µs, 837.354µs, 944.635µs, 9.484ms
55-
Bytes In [total, mean] 5070000, 169.00
52+
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
53+
Duration [total, attack, wait] 30s, 29.999s, 831.445µs
54+
Latencies [min, mean, 50, 90, 95, 99, max] 586.372µs, 839.603µs, 820.061µs, 945.712µs, 994.204µs, 1.128ms, 12.904ms
55+
Bytes In [total, mean] 5100000, 170.00
5656
Bytes Out [total, mean] 0, 0.00
5757
Success [ratio] 100.00%
5858
Status Codes [code:count] 200:30000
@@ -62,10 +62,10 @@ Error Set:
6262
## Test4: Running tea GET method based routing
6363

6464
```text
65-
Requests [total, rate, throughput] 30000, 1000.00, 999.98
66-
Duration [total, attack, wait] 30.001s, 30s, 793.958µs
67-
Latencies [min, mean, 50, 90, 95, 99, max] 515.143µs, 694.579µs, 679.924µs, 783.488µs, 823.079µs, 935.749µs, 8.619ms
68-
Bytes In [total, mean] 4740000, 158.00
65+
Requests [total, rate, throughput] 30000, 1000.00, 999.97
66+
Duration [total, attack, wait] 30.001s, 30s, 927.681µs
67+
Latencies [min, mean, 50, 90, 95, 99, max] 579.176µs, 821.601µs, 804.632µs, 936.14µs, 986.749µs, 1.125ms, 8.856ms
68+
Bytes In [total, mean] 4770000, 159.00
6969
Bytes Out [total, mean] 0, 0.00
7070
Success [ratio] 100.00%
7171
Status Codes [code:count] 200:30000
@@ -75,10 +75,10 @@ Error Set:
7575
## Test5: Running tea POST method based routing
7676

7777
```text
78-
Requests [total, rate, throughput] 30000, 1000.02, 1000.00
79-
Duration [total, attack, wait] 30s, 29.999s, 755.564µs
80-
Latencies [min, mean, 50, 90, 95, 99, max] 524.265µs, 684.282µs, 671.402µs, 770.187µs, 806.135µs, 906.279µs, 9.069ms
81-
Bytes In [total, mean] 4740000, 158.00
78+
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
79+
Duration [total, attack, wait] 30s, 29.999s, 903.577µs
80+
Latencies [min, mean, 50, 90, 95, 99, max] 577.936µs, 828.521µs, 812.691µs, 947.089µs, 997.055µs, 1.122ms, 10.048ms
81+
Bytes In [total, mean] 4770000, 159.00
8282
Bytes Out [total, mean] 0, 0.00
8383
Success [ratio] 100.00%
8484
Status Codes [code:count] 200:30000

tests/results/ngf-upgrade/edge/edge-oss.md

Lines changed: 15 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -6,46 +6,46 @@ NGINX Plus: false
66

77
NGINX Gateway Fabric:
88

9-
- Commit: e7d217a8f01fb3c8fc4507ef6f0e7feead667f20
10-
- Date: 2024-11-14T18:42:55Z
9+
- Commit: 17091ba5d59ca6026f7610e3c2c6200e7ac5cd16
10+
- Date: 2024-12-18T16:52:33Z
1111
- Dirty: false
1212

1313
GKE Cluster:
1414

1515
- Node count: 12
16-
- k8s version: v1.30.5-gke.1443001
16+
- k8s version: v1.30.6-gke.1125000
1717
- vCPUs per node: 16
18-
- RAM per node: 65853972Ki
18+
- RAM per node: 65853980Ki
1919
- Max pods per node: 110
2020
- Zone: us-west1-b
2121
- Instance Type: n2d-standard-16
2222

23-
## Test: Send http /coffee traffic
23+
## Test: Send https /tea traffic
2424

2525
```text
26-
Requests [total, rate, throughput] 6000, 100.02, 100.02
27-
Duration [total, attack, wait] 59.991s, 59.99s, 587.326µs
28-
Latencies [min, mean, 50, 90, 95, 99, max] 439.889µs, 859.995µs, 849.253µs, 977.006µs, 1.024ms, 1.211ms, 15.355ms
29-
Bytes In [total, mean] 974028, 162.34
26+
Requests [total, rate, throughput] 6000, 100.02, 100.01
27+
Duration [total, attack, wait] 59.992s, 59.991s, 1.068ms
28+
Latencies [min, mean, 50, 90, 95, 99, max] 665.949µs, 967.617µs, 938.253µs, 1.101ms, 1.166ms, 1.373ms, 14.936ms
29+
Bytes In [total, mean] 936000, 156.00
3030
Bytes Out [total, mean] 0, 0.00
3131
Success [ratio] 100.00%
3232
Status Codes [code:count] 200:6000
3333
Error Set:
3434
```
3535

36-
![http-oss.png](http-oss.png)
36+
![https-oss.png](https-oss.png)
3737

38-
## Test: Send https /tea traffic
38+
## Test: Send http /coffee traffic
3939

4040
```text
4141
Requests [total, rate, throughput] 6000, 100.02, 100.01
42-
Duration [total, attack, wait] 59.991s, 59.99s, 792.386µs
43-
Latencies [min, mean, 50, 90, 95, 99, max] 664.1µs, 910.376µs, 874.685µs, 1.007ms, 1.063ms, 1.271ms, 16.146ms
44-
Bytes In [total, mean] 936000, 156.00
42+
Duration [total, attack, wait] 59.991s, 59.991s, 880.619µs
43+
Latencies [min, mean, 50, 90, 95, 99, max] 473.276µs, 886.771µs, 867.111µs, 1.036ms, 1.094ms, 1.28ms, 12.061ms
44+
Bytes In [total, mean] 969991, 161.67
4545
Bytes Out [total, mean] 0, 0.00
4646
Success [ratio] 100.00%
4747
Status Codes [code:count] 200:6000
4848
Error Set:
4949
```
5050

51-
![https-oss.png](https-oss.png)
51+
![http-oss.png](http-oss.png)

tests/results/ngf-upgrade/edge/edge-plus.md

Lines changed: 22 additions & 20 deletions
Original file line numberDiff line numberDiff line change
@@ -6,46 +6,48 @@ NGINX Plus: true
66

77
NGINX Gateway Fabric:
88

9-
- Commit: e7d217a8f01fb3c8fc4507ef6f0e7feead667f20
10-
- Date: 2024-11-14T18:42:55Z
9+
- Commit: 17091ba5d59ca6026f7610e3c2c6200e7ac5cd16
10+
- Date: 2024-12-18T16:52:33Z
1111
- Dirty: false
1212

1313
GKE Cluster:
1414

1515
- Node count: 12
16-
- k8s version: v1.30.5-gke.1443001
16+
- k8s version: v1.30.6-gke.1125000
1717
- vCPUs per node: 16
18-
- RAM per node: 65853972Ki
18+
- RAM per node: 65853984Ki
1919
- Max pods per node: 110
2020
- Zone: us-west1-b
2121
- Instance Type: n2d-standard-16
2222

23-
## Test: Send http /coffee traffic
23+
## Test: Send https /tea traffic
2424

2525
```text
26-
Requests [total, rate, throughput] 6000, 100.02, 100.02
27-
Duration [total, attack, wait] 59.991s, 59.99s, 772.721µs
28-
Latencies [min, mean, 50, 90, 95, 99, max] 596.14µs, 835.746µs, 798.892µs, 926.941µs, 975.553µs, 1.151ms, 14.047ms
29-
Bytes In [total, mean] 956060, 159.34
26+
Requests [total, rate, throughput] 6000, 100.02, 86.13
27+
Duration [total, attack, wait] 59.993s, 59.99s, 2.942ms
28+
Latencies [min, mean, 50, 90, 95, 99, max] 471.41µs, 1.25ms, 949.477µs, 2.838ms, 3.054ms, 3.539ms, 12.939ms
29+
Bytes In [total, mean] 955693, 159.28
3030
Bytes Out [total, mean] 0, 0.00
31-
Success [ratio] 100.00%
32-
Status Codes [code:count] 200:6000
31+
Success [ratio] 86.12%
32+
Status Codes [code:count] 200:5167 503:833
3333
Error Set:
34+
503 Service Temporarily Unavailable
3435
```
3536

36-
![http-plus.png](http-plus.png)
37+
![https-plus.png](https-plus.png)
3738

38-
## Test: Send https /tea traffic
39+
## Test: Send http /coffee traffic
3940

4041
```text
41-
Requests [total, rate, throughput] 6000, 100.02, 100.01
42-
Duration [total, attack, wait] 59.991s, 59.99s, 955.654µs
43-
Latencies [min, mean, 50, 90, 95, 99, max] 630.575µs, 856.057µs, 818.559µs, 939.26µs, 986.329µs, 1.177ms, 14.025ms
44-
Bytes In [total, mean] 918000, 153.00
42+
Requests [total, rate, throughput] 6000, 100.02, 86.13
43+
Duration [total, attack, wait] 59.991s, 59.99s, 739.811µs
44+
Latencies [min, mean, 50, 90, 95, 99, max] 607.774µs, 941.816µs, 923.315µs, 1.045ms, 1.092ms, 1.279ms, 12.42ms
45+
Bytes In [total, mean] 984990, 164.16
4546
Bytes Out [total, mean] 0, 0.00
46-
Success [ratio] 100.00%
47-
Status Codes [code:count] 200:6000
47+
Success [ratio] 86.12%
48+
Status Codes [code:count] 200:5167 503:833
4849
Error Set:
50+
503 Service Temporarily Unavailable
4951
```
5052

51-
![https-plus.png](https-plus.png)
53+
![http-plus.png](http-plus.png)
-2 Bytes
Loading
490 Bytes
Loading
-2 Bytes
Loading
543 Bytes
Loading

0 commit comments

Comments
 (0)