Skip to content

NFR Test Results for NGF version edge #4389

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
github-actions wants to merge 2 commits into
base: main
Choose a base branch
from
Open

NFR Test Results for NGF version edge #4389

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
f9a2026
NFR Test Results for NGF version edge
nginx-bot Dec 4, 2025
133d380
Merge branch 'main' into tests/nfr-tests-edge
sjberman Dec 5, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
44 changes: 22 additions & 22 deletions tests/results/dp-perf/edge/edge-oss.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,14 +6,14 @@ NGINX Plus: false

NGINX Gateway Fabric:

- Commit: b41c973c8399458984def3c2a8a268a237c864c8
- Date: 2025-10-30T03:04:40Z
- Commit: 76a2cea7c19f4aeb19d6610048db93fe3545dedc
- Date: 2025-12-03T19:53:07Z
- Dirty: false

GKE Cluster:

- Node count: 12
- k8s version: v1.33.5-gke.1162000
- k8s version: v1.33.5-gke.1201000
- vCPUs per node: 16
- RAM per node: 65851520Ki
- Max pods per node: 110
Expand All @@ -23,10 +23,10 @@ GKE Cluster:
## Test1: Running latte path based routing

```text
Requests [total, rate, throughput] 30000, 1000.01, 999.98
Duration [total, attack, wait] 30.001s, 30s, 878.426µs
Latencies [min, mean, 50, 90, 95, 99, max] 691.466µs, 925.511µs, 900.472µs, 1.032ms, 1.085ms, 1.259ms, 20.439ms
Bytes In [total, mean] 4770000, 159.00
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 838.332µs
Latencies [min, mean, 50, 90, 95, 99, max] 692.485µs, 865.674µs, 849.247µs, 942.06µs, 980.287µs, 1.102ms, 12.585ms
Bytes In [total, mean] 4800000, 160.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -36,10 +36,10 @@ Error Set:
## Test2: Running coffee header based routing

```text
Requests [total, rate, throughput] 30000, 1000.04, 1000.00
Duration [total, attack, wait] 30s, 29.999s, 969.607µs
Latencies [min, mean, 50, 90, 95, 99, max] 707.948µs, 975.218µs, 945.999µs, 1.072ms, 1.128ms, 1.308ms, 25.057ms
Bytes In [total, mean] 4800000, 160.00
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 930.164µs
Latencies [min, mean, 50, 90, 95, 99, max] 715.081µs, 933.802µs, 901.019µs, 1.005ms, 1.048ms, 1.246ms, 24.929ms
Bytes In [total, mean] 4830000, 161.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -50,9 +50,9 @@ Error Set:

```text
Requests [total, rate, throughput] 30000, 1000.04, 1000.00
Duration [total, attack, wait] 30s, 29.999s, 985.199µs
Latencies [min, mean, 50, 90, 95, 99, max] 742.731µs, 975.095µs, 950.844µs, 1.088ms, 1.15ms, 1.35ms, 18.942ms
Bytes In [total, mean] 5040000, 168.00
Duration [total, attack, wait] 30s, 29.999s, 973.811µs
Latencies [min, mean, 50, 90, 95, 99, max] 714.576µs, 928.334µs, 900.33µs, 1.003ms, 1.045ms, 1.265ms, 23.419ms
Bytes In [total, mean] 5070000, 169.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -62,10 +62,10 @@ Error Set:
## Test4: Running tea GET method based routing

```text
Requests [total, rate, throughput] 30000, 1000.01, 999.97
Duration [total, attack, wait] 30.001s, 30s, 1.013ms
Latencies [min, mean, 50, 90, 95, 99, max] 706.711µs, 978.996µs, 954.535µs, 1.081ms, 1.14ms, 1.306ms, 24.648ms
Bytes In [total, mean] 4710000, 157.00
Requests [total, rate, throughput] 30000, 1000.01, 999.98
Duration [total, attack, wait] 30.001s, 30s, 868.411µs
Latencies [min, mean, 50, 90, 95, 99, max] 724.995µs, 935.31µs, 907.468µs, 1.019ms, 1.064ms, 1.254ms, 24.206ms
Bytes In [total, mean] 4740000, 158.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -75,10 +75,10 @@ Error Set:
## Test5: Running tea POST method based routing

```text
Requests [total, rate, throughput] 30000, 1000.03, 1000.00
Duration [total, attack, wait] 30s, 29.999s, 954.887µs
Latencies [min, mean, 50, 90, 95, 99, max] 744.41µs, 974.612µs, 949.589µs, 1.088ms, 1.147ms, 1.325ms, 11.186ms
Bytes In [total, mean] 4710000, 157.00
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 796.165µs
Latencies [min, mean, 50, 90, 95, 99, max] 709.716µs, 908.982µs, 888.17µs, 990.493µs, 1.033ms, 1.183ms, 25.115ms
Bytes In [total, mean] 4740000, 158.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand Down
42 changes: 21 additions & 21 deletions tests/results/dp-perf/edge/edge-plus.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,16 +6,16 @@ NGINX Plus: true

NGINX Gateway Fabric:

- Commit: b41c973c8399458984def3c2a8a268a237c864c8
- Date: 2025-10-30T03:04:40Z
- Commit: 76a2cea7c19f4aeb19d6610048db93fe3545dedc
- Date: 2025-12-03T19:53:07Z
- Dirty: false

GKE Cluster:

- Node count: 12
- k8s version: v1.33.5-gke.1162000
- k8s version: v1.33.5-gke.1201000
- vCPUs per node: 16
- RAM per node: 65851520Ki
- RAM per node: 65851512Ki
- Max pods per node: 110
- Zone: us-west1-b
- Instance Type: n2d-standard-16
Expand All @@ -24,9 +24,9 @@ GKE Cluster:

```text
Requests [total, rate, throughput] 30000, 1000.01, 999.98
Duration [total, attack, wait] 30.001s, 30s, 833.602µs
Latencies [min, mean, 50, 90, 95, 99, max] 679.176µs, 908.167µs, 879.785µs, 1.011ms, 1.069ms, 1.306ms, 24.313ms
Bytes In [total, mean] 4830000, 161.00
Duration [total, attack, wait] 30.001s, 30s, 959.135µs
Latencies [min, mean, 50, 90, 95, 99, max] 663.558µs, 875.826µs, 845.323µs, 958.333µs, 1.007ms, 1.194ms, 23.064ms
Bytes In [total, mean] 4800000, 160.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -37,9 +37,9 @@ Error Set:

```text
Requests [total, rate, throughput] 29999, 1000.01, 999.98
Duration [total, attack, wait] 30s, 29.999s, 885.413µs
Latencies [min, mean, 50, 90, 95, 99, max] 735.321µs, 993.589µs, 965.051µs, 1.109ms, 1.179ms, 1.454ms, 26.207ms
Bytes In [total, mean] 4859838, 162.00
Duration [total, attack, wait] 30s, 29.999s, 860.551µs
Latencies [min, mean, 50, 90, 95, 99, max] 712.205µs, 923.729µs, 901.1µs, 1.02ms, 1.069ms, 1.227ms, 21.375ms
Bytes In [total, mean] 4829839, 161.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:29999
Expand All @@ -49,10 +49,10 @@ Error Set:
## Test3: Running coffee query based routing

```text
Requests [total, rate, throughput] 30000, 1000.04, 999.98
Duration [total, attack, wait] 30s, 29.999s, 1.588ms
Latencies [min, mean, 50, 90, 95, 99, max] 728.765µs, 995.743µs, 964.788µs, 1.12ms, 1.205ms, 1.515ms, 22.473ms
Bytes In [total, mean] 5100000, 170.00
Requests [total, rate, throughput] 30000, 1000.01, 999.98
Duration [total, attack, wait] 30.001s, 30s, 968.736µs
Latencies [min, mean, 50, 90, 95, 99, max] 737.91µs, 952.257µs, 928.142µs, 1.05ms, 1.105ms, 1.292ms, 21.593ms
Bytes In [total, mean] 5070000, 169.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -63,9 +63,9 @@ Error Set:

```text
Requests [total, rate, throughput] 30000, 1000.01, 999.98
Duration [total, attack, wait] 30.001s, 30s, 961.065µs
Latencies [min, mean, 50, 90, 95, 99, max] 717.726µs, 952.076µs, 925.718µs, 1.072ms, 1.146ms, 1.407ms, 20.945ms
Bytes In [total, mean] 4770000, 159.00
Duration [total, attack, wait] 30.001s, 30s, 870.48µs
Latencies [min, mean, 50, 90, 95, 99, max] 699.503µs, 896.1µs, 872.493µs, 987.672µs, 1.041ms, 1.214ms, 23.127ms
Bytes In [total, mean] 4740000, 158.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -75,10 +75,10 @@ Error Set:
## Test5: Running tea POST method based routing

```text
Requests [total, rate, throughput] 30000, 1000.04, 1000.00
Duration [total, attack, wait] 30s, 29.999s, 949.913µs
Latencies [min, mean, 50, 90, 95, 99, max] 718.639µs, 953.232µs, 922.53µs, 1.067ms, 1.144ms, 1.41ms, 20.724ms
Bytes In [total, mean] 4770000, 159.00
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 943.532µs
Latencies [min, mean, 50, 90, 95, 99, max] 681.741µs, 906.971µs, 887.005µs, 998.855µs, 1.046ms, 1.198ms, 11.182ms
Bytes In [total, mean] 4740000, 158.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand Down
32 changes: 17 additions & 15 deletions tests/results/ngf-upgrade/edge/edge-oss.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,14 +6,14 @@ NGINX Plus: false

NGINX Gateway Fabric:

- Commit: b41c973c8399458984def3c2a8a268a237c864c8
- Date: 2025-10-30T03:04:40Z
- Commit: 76a2cea7c19f4aeb19d6610048db93fe3545dedc
- Date: 2025-12-03T19:53:07Z
- Dirty: false

GKE Cluster:

- Node count: 12
- k8s version: v1.33.5-gke.1162000
- k8s version: v1.33.5-gke.1201000
- vCPUs per node: 16
- RAM per node: 65851520Ki
- Max pods per node: 110
Expand All @@ -23,29 +23,31 @@ GKE Cluster:
## Test: Send https /tea traffic

```text
Requests [total, rate, throughput] 6000, 100.02, 100.01
Duration [total, attack, wait] 59.991s, 59.99s, 1.098ms
Latencies [min, mean, 50, 90, 95, 99, max] 852.123µs, 1.151ms, 1.127ms, 1.302ms, 1.363ms, 1.583ms, 11.026ms
Bytes In [total, mean] 925971, 154.33
Requests [total, rate, throughput] 6000, 100.01, 99.80
Duration [total, attack, wait] 59.997s, 59.993s, 4.183ms
Latencies [min, mean, 50, 90, 95, 99, max] 519.547µs, 1.833s, 1.186ms, 8.79s, 11.649s, 13.963s, 14.52s
Bytes In [total, mean] 922152, 153.69
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:6000
Success [ratio] 99.80%
Status Codes [code:count] 0:12 200:5988
Error Set:
Get "https://cafe.example.com/tea": dial tcp 0.0.0.0:0->10.138.0.56:443: connect: connection refused
```

![https-oss.png](https-oss.png)

## Test: Send http /coffee traffic

```text
Requests [total, rate, throughput] 6000, 100.02, 100.01
Duration [total, attack, wait] 59.991s, 59.99s, 1.195ms
Latencies [min, mean, 50, 90, 95, 99, max] 616.849µs, 976.017µs, 987.768µs, 1.167ms, 1.223ms, 1.342ms, 12.457ms
Bytes In [total, mean] 961988, 160.33
Requests [total, rate, throughput] 6000, 100.01, 99.80
Duration [total, attack, wait] 59.997s, 59.993s, 4.518ms
Latencies [min, mean, 50, 90, 95, 99, max] 437.037µs, 1.822s, 1.135ms, 8.517s, 11.638s, 13.967s, 14.524s
Bytes In [total, mean] 958080, 159.68
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:6000
Success [ratio] 99.80%
Status Codes [code:count] 0:12 200:5988
Error Set:
Get "http://cafe.example.com/coffee": dial tcp 0.0.0.0:0->10.138.0.56:80: connect: connection refused
```

![http-oss.png](http-oss.png)
42 changes: 26 additions & 16 deletions tests/results/ngf-upgrade/edge/edge-plus.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,46 +6,56 @@ NGINX Plus: true

NGINX Gateway Fabric:

- Commit: b41c973c8399458984def3c2a8a268a237c864c8
- Date: 2025-10-30T03:04:40Z
- Commit: 76a2cea7c19f4aeb19d6610048db93fe3545dedc
- Date: 2025-12-03T19:53:07Z
- Dirty: false

GKE Cluster:

- Node count: 12
- k8s version: v1.33.5-gke.1162000
- k8s version: v1.33.5-gke.1201000
- vCPUs per node: 16
- RAM per node: 65851520Ki
- RAM per node: 65851512Ki
- Max pods per node: 110
- Zone: us-west1-b
- Instance Type: n2d-standard-16

## Test: Send http /coffee traffic

```text
Requests [total, rate, throughput] 6000, 100.02, 100.01
Duration [total, attack, wait] 59.991s, 59.99s, 1.067ms
Latencies [min, mean, 50, 90, 95, 99, max] 795.356µs, 1.082ms, 1.067ms, 1.203ms, 1.254ms, 1.38ms, 9.67ms
Bytes In [total, mean] 966000, 161.00
Requests [total, rate, throughput] 6000, 100.01, 99.78
Duration [total, attack, wait] 59.994s, 59.992s, 2.101ms
Latencies [min, mean, 50, 90, 95, 99, max] 507.107µs, 414.573ms, 1.114ms, 1.103s, 4.036s, 6.367s, 6.934s
Bytes In [total, mean] 961744, 160.29
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:6000
Success [ratio] 99.77%
Status Codes [code:count] 0:14 200:5986
Error Set:
Get "http://cafe.example.com/coffee": read tcp 10.138.0.103:53013->10.138.0.114:80: read: connection reset by peer
Get "http://cafe.example.com/coffee": read tcp 10.138.0.103:46203->10.138.0.114:80: read: connection reset by peer
Get "http://cafe.example.com/coffee": read tcp 10.138.0.103:47717->10.138.0.114:80: read: connection reset by peer
Get "http://cafe.example.com/coffee": read tcp 10.138.0.103:53217->10.138.0.114:80: read: connection reset by peer
Get "http://cafe.example.com/coffee": dial tcp 0.0.0.0:0->10.138.0.114:80: connect: connection refused
```

![http-plus.png](http-plus.png)

## Test: Send https /tea traffic

```text
Requests [total, rate, throughput] 6000, 100.02, 100.01
Duration [total, attack, wait] 59.991s, 59.99s, 985.482µs
Latencies [min, mean, 50, 90, 95, 99, max] 794.318µs, 1.163ms, 1.142ms, 1.285ms, 1.332ms, 1.432ms, 10.328ms
Bytes In [total, mean] 931950, 155.32
Requests [total, rate, throughput] 6000, 100.01, 99.78
Duration [total, attack, wait] 59.994s, 59.993s, 1.947ms
Latencies [min, mean, 50, 90, 95, 99, max] 600.657µs, 421.024ms, 1.175ms, 1.162s, 4.089s, 6.405s, 6.961s
Bytes In [total, mean] 923930, 153.99
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:6000
Success [ratio] 99.77%
Status Codes [code:count] 0:14 200:5986
Error Set:
Get "https://cafe.example.com/tea": read tcp 10.138.0.103:57081->10.138.0.114:443: read: connection reset by peer
Get "https://cafe.example.com/tea": read tcp 10.138.0.103:35237->10.138.0.114:443: read: connection reset by peer
Get "https://cafe.example.com/tea": read tcp 10.138.0.103:40395->10.138.0.114:443: read: connection reset by peer
Get "https://cafe.example.com/tea": write tcp 10.138.0.103:50087->10.138.0.114:443: write: connection reset by peer
Get "https://cafe.example.com/tea": dial tcp 0.0.0.0:0->10.138.0.114:443: connect: connection refused
```

![https-plus.png](https-plus.png)
Binary file modified tests/results/ngf-upgrade/edge/http-oss.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/ngf-upgrade/edge/http-plus.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/ngf-upgrade/edge/https-oss.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/ngf-upgrade/edge/https-plus.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Loading