NFR Test Results for NGF version edge

tests/results/scale/edge/TestScale_HTTPSListeners/ngf-oss.log

@@ -0,0 +1 @@
+{"level":"debug","ts":"2024-09-03T19:13:54Z","logger":"statusUpdater","msg":"Encountered error updating status","error":"Operation cannot be fulfilled on gateways.gateway.networking.k8s.io \"gateway\": the object has been modified; please apply your changes to the latest version and try again","namespace":"scale","name":"gateway","kind":"Gateway"}

tests/results/scale/edge/TestScale_HTTPSListeners/ngf-plus.log

@@ -0,0 +1 @@
+{"level":"debug","ts":"2024-09-03T19:14:55Z","logger":"statusUpdater","msg":"Encountered error updating status","error":"Operation cannot be fulfilled on gateways.gateway.networking.k8s.io \"gateway\": the object has been modified; please apply your changes to the latest version and try again","namespace":"scale","name":"gateway","kind":"Gateway"}

tests/results/scale/edge/TestScale_Listeners/ngf-oss.log

@@ -0,0 +1,2 @@
+{"level":"debug","ts":"2024-09-03T19:08:43Z","logger":"controller-runtime.healthz","msg":"healthz check failed","checker":"readyz","error":"nginx has not yet become ready to accept traffic"}
+{"level":"debug","ts":"2024-09-03T19:09:58Z","logger":"statusUpdater","msg":"Encountered error updating status","error":"Operation cannot be fulfilled on gateways.gateway.networking.k8s.io \"gateway\": the object has been modified; please apply your changes to the latest version and try again","namespace":"scale","name":"gateway","kind":"Gateway"}

tests/results/scale/edge/TestScale_Listeners/ngf-plus.log

@@ -0,0 +1 @@
+{"level":"debug","ts":"2024-09-03T19:10:55Z","logger":"statusUpdater","msg":"Encountered error updating status","error":"Operation cannot be fulfilled on gateways.gateway.networking.k8s.io \"gateway\": the object has been modified; please apply your changes to the latest version and try again","namespace":"scale","name":"gateway","kind":"Gateway"}

tests/results/scale/edge/edge-oss.md

@@ -6,14 +6,14 @@ NGINX Plus: false
 
 NGINX Gateway Fabric:
 
-- Commit: 3c029b1417c1f89f2a29aeef07f47078640e28b2
-- Date: 2024-08-15T00:04:25Z
+- Commit: cba529e9b53cc011fc6f5e539164eefe779ab7c9
+- Date: 2024-09-03T18:57:20Z
 - Dirty: false
 
 GKE Cluster:
 
 - Node count: 12
-- k8s version: v1.29.6-gke.1326000
+- k8s version: v1.29.7-gke.1104000
 - vCPUs per node: 16
 - RAM per node: 65855012Ki
 - Max pods per node: 110
@@ -24,32 +24,32 @@ GKE Cluster:
 
 ### Reloads
 
-- Total: 128
+- Total: 127
 - Total Errors: 0
-- Average Time: 151ms
+- Average Time: 145ms
 - Reload distribution:
-	- 500ms: 128
-	- 1000ms: 128
-	- 5000ms: 128
-	- 10000ms: 128
-	- 30000ms: 128
-	- +Infms: 128
+	- 500ms: 127
+	- 1000ms: 127
+	- 5000ms: 127
+	- 10000ms: 127
+	- 30000ms: 127
+	- +Infms: 127
 
 ### Event Batch Processing
 
 - Total: 386
-- Average Time: 124ms
+- Average Time: 116ms
 - Event Batch Processing distribution:
-	- 500ms: 352
-	- 1000ms: 384
+	- 500ms: 353
+	- 1000ms: 386
 	- 5000ms: 386
 	- 10000ms: 386
 	- 30000ms: 386
 	- +Infms: 386
 
 ### Errors
 
-- NGF errors: 0
+- NGF errors: 2
 - NGF container restarts: 0
 - NGINX errors: 0
 - NGINX container restarts: 0
@@ -65,7 +65,7 @@ The logs are attached only if there are errors.
 
 - Total: 127
 - Total Errors: 0
-- Average Time: 177ms
+- Average Time: 165ms
 - Reload distribution:
 	- 500ms: 127
 	- 1000ms: 127
@@ -76,19 +76,19 @@ The logs are attached only if there are errors.
 
 ### Event Batch Processing
 
-- Total: 448
-- Average Time: 120ms
+- Total: 450
+- Average Time: 116ms
 - Event Batch Processing distribution:
-	- 500ms: 402
-	- 1000ms: 447
-	- 5000ms: 448
-	- 10000ms: 448
-	- 30000ms: 448
-	- +Infms: 448
+	- 500ms: 405
+	- 1000ms: 450
+	- 5000ms: 450
+	- 10000ms: 450
+	- 30000ms: 450
+	- +Infms: 450
 
 ### Errors
 
-- NGF errors: 0
+- NGF errors: 1
 - NGF container restarts: 0
 - NGINX errors: 0
 - NGINX container restarts: 0
@@ -104,9 +104,9 @@ The logs are attached only if there are errors.
 
 - Total: 1001
 - Total Errors: 0
-- Average Time: 394ms
+- Average Time: 347ms
 - Reload distribution:
-	- 500ms: 687
+	- 500ms: 835
 	- 1000ms: 1001
 	- 5000ms: 1001
 	- 10000ms: 1001
@@ -116,9 +116,9 @@ The logs are attached only if there are errors.
 ### Event Batch Processing
 
 - Total: 1008
-- Average Time: 444ms
+- Average Time: 404ms
 - Event Batch Processing distribution:
-	- 500ms: 613
+	- 500ms: 719
 	- 1000ms: 1008
 	- 5000ms: 1008
 	- 10000ms: 1008
@@ -141,28 +141,28 @@ The logs are attached only if there are errors.
 
 ### Reloads
 
-- Total: 107
+- Total: 144
 - Total Errors: 0
-- Average Time: 126ms
+- Average Time: 127ms
 - Reload distribution:
-	- 500ms: 107
-	- 1000ms: 107
-	- 5000ms: 107
-	- 10000ms: 107
-	- 30000ms: 107
-	- +Infms: 107
+	- 500ms: 144
+	- 1000ms: 144
+	- 5000ms: 144
+	- 10000ms: 144
+	- 30000ms: 144
+	- +Infms: 144
 
 ### Event Batch Processing
 
-- Total: 110
-- Average Time: 125ms
+- Total: 147
+- Average Time: 126ms
 - Event Batch Processing distribution:
-	- 500ms: 110
-	- 1000ms: 110
-	- 5000ms: 110
-	- 10000ms: 110
-	- 30000ms: 110
-	- +Infms: 110
+	- 500ms: 147
+	- 1000ms: 147
+	- 5000ms: 147
+	- 10000ms: 147
+	- 30000ms: 147
+	- +Infms: 147
 
 ### Errors
 
@@ -179,20 +179,20 @@ The logs are attached only if there are errors.
 ## Test TestScale_HTTPMatches
 
 ```text
-Requests      [total, rate, throughput]         30000, 1000.00, 999.98
-Duration      [total, attack, wait]             30.001s, 30s, 663.08µs
-Latencies     [min, mean, 50, 90, 95, 99, max]  518.253µs, 721.379µs, 690.364µs, 801.458µs, 846.06µs, 972.256µs, 12.432ms
-Bytes In      [total, mean]                     4830000, 161.00
+Requests      [total, rate, throughput]         30000, 1000.01, 999.99
+Duration      [total, attack, wait]             30s, 30s, 665.633µs
+Latencies     [min, mean, 50, 90, 95, 99, max]  537.484µs, 768.096µs, 734.32µs, 849.425µs, 893.692µs, 1.02ms, 20.405ms
+Bytes In      [total, mean]                     4770000, 159.00
 Bytes Out     [total, mean]                     0, 0.00
 Success       [ratio]                           100.00%
 Status Codes  [code:count]                      200:30000  
 Error Set:
 ```
 ```text
-Requests      [total, rate, throughput]         30000, 1000.01, 999.98
-Duration      [total, attack, wait]             30.001s, 30s, 775.127µs
-Latencies     [min, mean, 50, 90, 95, 99, max]  586.924µs, 794.034µs, 771.093µs, 911.524µs, 965.023µs, 1.086ms, 12.692ms
-Bytes In      [total, mean]                     4830000, 161.00
+Requests      [total, rate, throughput]         30000, 1000.00, 999.97
+Duration      [total, attack, wait]             30.001s, 30s, 966.342µs
+Latencies     [min, mean, 50, 90, 95, 99, max]  596.705µs, 861.342µs, 843.414µs, 991.162µs, 1.049ms, 1.168ms, 12.784ms
+Bytes In      [total, mean]                     4770000, 159.00
 Bytes Out     [total, mean]                     0, 0.00
 Success       [ratio]                           100.00%
 Status Codes  [code:count]                      200:30000  

tests/results/scale/edge/edge-plus.md

@@ -6,16 +6,16 @@ NGINX Plus: true
 
 NGINX Gateway Fabric:
 
-- Commit: 3c029b1417c1f89f2a29aeef07f47078640e28b2
-- Date: 2024-08-15T00:04:25Z
+- Commit: cba529e9b53cc011fc6f5e539164eefe779ab7c9
+- Date: 2024-09-03T18:57:20Z
 - Dirty: false
 
 GKE Cluster:
 
 - Node count: 12
-- k8s version: v1.29.6-gke.1326000
+- k8s version: v1.29.7-gke.1104000
 - vCPUs per node: 16
-- RAM per node: 65855012Ki
+- RAM per node: 65855004Ki
 - Max pods per node: 110
 - Zone: us-west1-b
 - Instance Type: n2d-standard-16
@@ -26,7 +26,7 @@ GKE Cluster:
 
 - Total: 127
 - Total Errors: 0
-- Average Time: 146ms
+- Average Time: 148ms
 - Reload distribution:
 	- 500ms: 127
 	- 1000ms: 127
@@ -37,19 +37,19 @@ GKE Cluster:
 
 ### Event Batch Processing
 
-- Total: 386
-- Average Time: 125ms
+- Total: 385
+- Average Time: 120ms
 - Event Batch Processing distribution:
-	- 500ms: 351
-	- 1000ms: 386
-	- 5000ms: 386
-	- 10000ms: 386
-	- 30000ms: 386
-	- +Infms: 386
+	- 500ms: 357
+	- 1000ms: 384
+	- 5000ms: 385
+	- 10000ms: 385
+	- 30000ms: 385
+	- +Infms: 385
 
 ### Errors
 
-- NGF errors: 0
+- NGF errors: 1
 - NGF container restarts: 0
 - NGINX errors: 0
 - NGINX container restarts: 0
@@ -65,7 +65,7 @@ The logs are attached only if there are errors.
 
 - Total: 127
 - Total Errors: 0
-- Average Time: 170ms
+- Average Time: 169ms
 - Reload distribution:
 	- 500ms: 127
 	- 1000ms: 127
@@ -76,19 +76,19 @@ The logs are attached only if there are errors.
 
 ### Event Batch Processing
 
-- Total: 450
-- Average Time: 120ms
+- Total: 449
+- Average Time: 114ms
 - Event Batch Processing distribution:
-	- 500ms: 410
-	- 1000ms: 449
-	- 5000ms: 450
-	- 10000ms: 450
-	- 30000ms: 450
-	- +Infms: 450
+	- 500ms: 407
+	- 1000ms: 448
+	- 5000ms: 449
+	- 10000ms: 449
+	- 30000ms: 449
+	- +Infms: 449
 
 ### Errors
 
-- NGF errors: 0
+- NGF errors: 1
 - NGF container restarts: 0
 - NGINX errors: 0
 - NGINX container restarts: 0
@@ -104,9 +104,9 @@ The logs are attached only if there are errors.
 
 - Total: 1001
 - Total Errors: 0
-- Average Time: 360ms
+- Average Time: 355ms
 - Reload distribution:
-	- 500ms: 776
+	- 500ms: 812
 	- 1000ms: 1001
 	- 5000ms: 1001
 	- 10000ms: 1001
@@ -116,9 +116,9 @@ The logs are attached only if there are errors.
 ### Event Batch Processing
 
 - Total: 1008
-- Average Time: 415ms
+- Average Time: 413ms
 - Event Batch Processing distribution:
-	- 500ms: 670
+	- 500ms: 686
 	- 1000ms: 1008
 	- 5000ms: 1008
 	- 10000ms: 1008
@@ -154,21 +154,21 @@ The logs are attached only if there are errors.
 
 ### Event Batch Processing
 
-- Total: 170
+- Total: 211
 - Average Time: 9ms
 - Event Batch Processing distribution:
-	- 500ms: 170
-	- 1000ms: 170
-	- 5000ms: 170
-	- 10000ms: 170
-	- 30000ms: 170
-	- +Infms: 170
+	- 500ms: 211
+	- 1000ms: 211
+	- 5000ms: 211
+	- 10000ms: 211
+	- 30000ms: 211
+	- +Infms: 211
 
 ### Errors
 
 - NGF errors: 1
 - NGF container restarts: 0
-- NGINX errors: 2
+- NGINX errors: 0
 - NGINX container restarts: 0
 
 ### Graphs and Logs
@@ -180,19 +180,19 @@ The logs are attached only if there are errors.
 
 ```text
 Requests      [total, rate, throughput]         30000, 1000.04, 1000.01
-Duration      [total, attack, wait]             30s, 29.999s, 783.45µs
-Latencies     [min, mean, 50, 90, 95, 99, max]  501.197µs, 745.893µs, 720.178µs, 843.83µs, 894.201µs, 1.029ms, 23.698ms
-Bytes In      [total, mean]                     4800000, 160.00
+Duration      [total, attack, wait]             30s, 29.999s, 757.713µs
+Latencies     [min, mean, 50, 90, 95, 99, max]  524.68µs, 731.517µs, 696.926µs, 796.652µs, 840.007µs, 993.099µs, 12.671ms
+Bytes In      [total, mean]                     4830000, 161.00
 Bytes Out     [total, mean]                     0, 0.00
 Success       [ratio]                           100.00%
 Status Codes  [code:count]                      200:30000  
 Error Set:
 ```
 ```text
-Requests      [total, rate, throughput]         30000, 1000.02, 999.99
-Duration      [total, attack, wait]             30s, 29.999s, 699.999µs
-Latencies     [min, mean, 50, 90, 95, 99, max]  599.544µs, 832.984µs, 805.272µs, 963.3µs, 1.033ms, 1.193ms, 14.793ms
-Bytes In      [total, mean]                     4800000, 160.00
+Requests      [total, rate, throughput]         30000, 1000.04, 1000.02
+Duration      [total, attack, wait]             29.999s, 29.999s, 691.701µs
+Latencies     [min, mean, 50, 90, 95, 99, max]  595.347µs, 787.552µs, 766.958µs, 904.208µs, 960.908µs, 1.075ms, 9.633ms
+Bytes In      [total, mean]                     4830000, 161.00
 Bytes Out     [total, mean]                     0, 0.00
 Success       [ratio]                           100.00%
 Status Codes  [code:count]                      200:30000