Skip to content

Commit a42a2df

Browse files
author
Jill Grant
authored
Merge pull request #291347 from b-ahibbard/avs-benchmarks
avs benchmarks
2 parents ea10877 + 4aaeb23 commit a42a2df

File tree

8 files changed

+56
-20
lines changed

8 files changed

+56
-20
lines changed
64.7 KB
Loading
119 KB
Loading
Loading
131 KB
Loading
158 KB
Loading
204 KB
Loading
238 KB
Loading

articles/azure-netapp-files/performance-benchmarks-azure-vmware-solution.md

Lines changed: 56 additions & 20 deletions
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ services: azure-netapp-files
55
author: b-hchen
66
ms.service: azure-netapp-files
77
ms.topic: conceptual
8-
ms.date: 02/07/2024
8+
ms.date: 12/03/2024
99
ms.author: anfdocs
1010
---
1111
# Azure NetApp Files datastore performance benchmarks for Azure VMware Solution
@@ -21,44 +21,80 @@ The following `read:write` I/O ratios were tested for each scenario: `100:0, 75:
2121

2222
Benchmarks documented in this article were performed with sufficient volume throughput to prevent soft limits from affecting performance. Benchmarks can be achieved with Azure NetApp Files Premium and Ultra service levels, and in some cases with Standard service level. For more information on volume throughput, see [Performance considerations for Azure NetApp Files](azure-netapp-files-performance-considerations.md).
2323

24-
Refer to the [Azure NetApp Files datastore for Azure VMware Solution TCO Estimator](https://aka.ms/anfavscalc) to understand the sizing and associated cost benefits of Azure NetApp Files datastores.
24+
Consult the [Azure NetApp Files datastore for Azure VMware Solution TCO Estimator](https://aka.ms/anfavscalc) to understand the sizing and associated cost benefits of Azure NetApp Files datastores.
2525

26-
## Environment details
26+
## Latency
27+
28+
Traffic latency from AVS to Azure NetApp Files datastores varies from submillisecond (for environments under minimal load) up to 2-3 milliseconds (for environments under medium to heavy load). The latency is potentially higher for environments that attempt to push beyond the throughput limits of various components. Latency and throughput can vary depending on factors including I/O size, read/write ratios, competing network traffic, and others.
29+
30+
## Performance scaling
31+
32+
Each AVS Host connects to each Azure NetApp Files datastore with a fixed number of network flows which can limit an individual VM disk's (VMDK) or AVS host’s throughput to each datastore. Multiple datastores might be required depending on a given set of workloads and their performance demands. Overall storage performance for each AVS host can be increased by spreading workloads across multiple datastores. You can also increase performance by spreading workload to each datastore across AVS hosts. The following graph shows the relative performance scaling of additional datastores.
33+
34+
:::image type="content" source="./media/performance-benchmarks-azure-vmware-solution/performance-gains.png" alt-text="Graph of performance gains." lightbox="./media/performance-benchmarks-azure-vmware-solution/performance-gains.png":::
35+
36+
>[!NOTE]
37+
>Throughput ceiling for external datastores can be limited by other factors including network bandwidth, SKU limits, or service level ceilings for Azure NetApp Files volumes.
38+
39+
Throughput for each individual host can be affected by the selected AVS SKU. The AV64 SKU has 100-Gigabit Ethernet (GbE) network interface cards (NICs). The other SKUs have 25-GbE NICs. Individual network flows (such as NFS mounts) might be limited by the 25-GbE NICs.
40+
41+
## AV64 environment details
2742

2843
The results in this article were achieved using the following environment configuration:
2944

30-
* Azure VMware Solution host size: AV36
45+
* Azure VMware Solution host size: AV64 running VMware ESXi version 7u3
3146
* Azure VMware Solution private cloud connectivity: UltraPerformance gateway with FastPath
32-
* Guest virtual machine(s): Ubuntu 21.04, 16 vCPU, 64 GB Memory
33-
* Workload generator: `fio`
47+
* Guest virtual machines: Rocky Linux 9, 16 vCPU, 64 GB memory
48+
* Workload generator: `fio` 3.35
3449

35-
## Latency
50+
>[!NOTE]
51+
> The AV64 tests focus only on the evaluation of a single ESXi host. Scaling out the number of ESXi hosts is discussed in the [AV36 section](#av36-environment-details).
3652
37-
Traffic latency from AVS to Azure NetApp Files datastores varies from sub-millisecond (for environments under minimal load) up to 2-3 milliseconds (for environments under medium to heavy load). The latency is potentially higher for environments that attempt to push beyond the throughput limits of various components. Latency and throughput may vary depending on several factors, including I/O size, read/write ratios, competing network traffic, and so on.
53+
### One-to-multiple Azure NetApp Files datastores with a single AV64 host
3854

39-
## One-to-multiple virtual machines running on a single AVS host and a single Azure NetApp Files datastore
55+
The following graphs compare the throughput of a single virtual machine on a single Azure NetApp Files datastore with the aggregated throughput of eight VMs, each on their own Azure NetApp Files datastores. Similar throughput can be achieved by a smaller number of VMs with additional VMDKs spread across the same number of datastores.
4056

41-
In a single AVS host scenario, the AVS to Azure NetApp Files datastore I/O occurs over a single network flow. The following graphs compare the throughput and IOPs of a single virtual machine with the aggregated throughput and IOPs of four virtual machines. In the subsequent scenarios, the number of network flows increases as more hosts and datastores are added.
57+
:::image type="content" source="./media/performance-benchmarks-azure-vmware-solution/one-to-multiple-datastores-diagram.png" alt-text="Diagram comparing one Azure NetApp File datastore set up to multiple datastores." lightbox="./media/performance-benchmarks-azure-vmware-solution/one-to-multiple-datastores-diagram.png":::
4258

43-
:::image type="content" source="./media/performance-benchmarks-azure-vmware-solution/performance-vmware-single-datastore.png" alt-text="Graphs comparing a single virtual machine with four virtual machines over a single network flow." lightbox="./media/performance-benchmarks-azure-vmware-solution/performance-vmware-single-datastore.png":::
59+
This graph compares throughput:
4460

45-
## One-to-multiple Azure NetApp Files datastores with a single AVS host
61+
:::image type="content" source="./media/performance-benchmarks-azure-vmware-solution/total-throughput-64kb.png" alt-text="Charts comparing throughput on one and eight datastores." lightbox="./media/performance-benchmarks-azure-vmware-solution/total-throughput-64kb.png":::
4662

47-
The following graphs compare the throughput of a single virtual machine on a single Azure NetApp Files datastore with the aggregated throughput of four Azure NetApp Files datastores. In both scenarios, each virtual machine has a VMDK on each Azure NetApp Files datastore.
63+
This graph compares I/OPS:
4864

49-
:::image type="content" source="./media/performance-benchmarks-azure-vmware-solution/performance-vmware-one-host-four-datastores.png" alt-text="Graphs comparing a single virtual machine on a single datastore with four datastores." lightbox="./media/performance-benchmarks-azure-vmware-solution/performance-vmware-one-host-four-datastores.png":::
65+
:::image type="content" source="./media/performance-benchmarks-azure-vmware-solution/input-ouptut-one-eight.png" alt-text="Charts comparing I/OPS on one and eight datastores." lightbox="./media/performance-benchmarks-azure-vmware-solution/input-ouptut-one-eight.png":::
66+
67+
## AV36 environment details
68+
69+
These tests were conducted with an environment configuration using:
70+
71+
- Azure VMware Solution host size: AV36 running VMware ESXi version 7u3
72+
- Azure VMware Solution private cloud connectivity: UltraPerformance gateway with FastPath
73+
- Guest virtual machines: Ubuntu 21.04, 16 vCPU, 64-GB Memory
74+
- Workload generator: `fio`
75+
76+
### One-to-multiple virtual machines running on a single AV36 host and a single Azure NetApp Files datastore
77+
78+
In a single AVS host scenario, the AVS to Azure NetApp Files datastore I/O occurs over a single network flow. These graphs compare the throughput and I/OPs of a single virtual machine with the aggregated throughput and I/OPS of four virtual machines. In the subsequent scenarios, the number of network flows increases as more hosts and datastores are added.
79+
80+
:::image type="content" source="./media/performance-benchmarks-azure-vmware-solution/throughput-one-to-multiple.png" alt-text="Diagram comparing one-to-multiple virtual machines running on a single AV36 host and a single Azure NetApp Files datastore." lightbox="./media/performance-benchmarks-azure-vmware-solution/throughput-one-to-multiple.png":::
81+
82+
### One-to-multiple Azure NetApp Files datastores with a single AV36 host
83+
84+
The following graphs compare the throughput of a single virtual machine on a single Azure NetApp Files datastore with the aggregated throughput of four Azure NetApp Files datastores. In both scenarios, each virtual machine has a VMDK on each Azure NetApp Files datastore.
5085

51-
The following graphs compare the IOPs of a single virtual machine on a single Azure NetApp Files datastore with the aggregated IOPs of eight Azure NetApp Files datastores. In both scenarios, each virtual machine has a VMDK on each Azure NetApp Files datastore.
86+
:::image type="content" source="./media/performance-benchmarks-azure-vmware-solution/throughput-single-host.png" alt-text="Charts comparing throughput with a single AV36 host." lightbox="./media/performance-benchmarks-azure-vmware-solution/throughput-single-host.png":::
5287

53-
:::image type="content" source="./media/performance-benchmarks-azure-vmware-solution/performance-vmware-one-host-eight-datastores.png" alt-text="Graphs comparing a single virtual machine on a single datastore with eight datastores." lightbox="./media/performance-benchmarks-azure-vmware-solution/performance-vmware-one-host-eight-datastores.png":::
88+
The following graphs compare the I/OPS of a single virtual machine on a single Azure NetApp Files datastore with the aggregated I/OPS of eight Azure NetApp Files datastores. In both scenarios, each virtual machine has a VMDK on each Azure NetApp Files datastore.
5489

55-
## Scale-out Azure NetApp Files datastores with multiple AVS hosts
90+
:::image type="content" source="./media/performance-benchmarks-azure-vmware-solution/input-output-single-host.png" alt-text="Charts comparing I/OPS with a single AV36 host." lightbox="./media/performance-benchmarks-azure-vmware-solution/input-output-single-host.png":::
5691

57-
The following graph shows the aggregated throughput and IOPs of 16 virtual machines distributed across four AVS hosts. There are four virtual machines per AVS host, each on a different Azure NetApp Files datastore.
92+
### Scale-out Azure NetApp Files datastores with multiple AV36 hosts
5893

59-
Nearly identical results were achieved with a single virtual machine on each host with four VMDKs per virtual machine and each of those VMDKs on a separate datastore.
94+
The following graph shows the aggregated throughput and I/OPS of 16 virtual machines distributed across four AVS hosts. There are four virtual machines per AVS host, each on a different Azure NetApp Files datastore.
95+
Nearly identical results were achieved with a single virtual machine on each host with four VMDKs per virtual machine and each of those VMDKs on a separate datastore.
6096

61-
:::image type="content" source="./media/performance-benchmarks-azure-vmware-solution/performance-vmware-scale-out.png" alt-text="Graphs showing aggregated throughput and IOPs of 16 virtual machines distributed across four AVS hosts." lightbox="./media/performance-benchmarks-azure-vmware-solution/performance-vmware-scale-out.png":::
97+
:::image type="content" source="./media/performance-benchmarks-azure-vmware-solution/performance-vmware-scale-out.png" alt-text="Graphs showing aggregated throughput and I/OPS of 16 virtual machines distributed across four AVS hosts." lightbox="./media/performance-benchmarks-azure-vmware-solution/performance-vmware-scale-out.png":::
6298

6399
## Next steps
64100

0 commit comments

Comments
 (0)