|
| 1 | +--- |
| 2 | +title: Network Optimized Virtual Machines - Enhanced Performance and Connection Setup (Preview) |
| 3 | +description: Learn about the performance improvements, connection limits, and supported scenarios for Network Optimized Virtual Machines in Azure, including enhanced connection setup capabilities. |
| 4 | +author: asudbring |
| 5 | +ms.topic: concept-article |
| 6 | +ms.date: 05/13/2025 |
| 7 | +ms.author: allensu |
| 8 | +--- |
| 9 | + |
| 10 | +# Network Optimized Virtual Machines - Enhanced Performance and Connection Setup (Preview) |
| 11 | + |
| 12 | +Network Optimized Virtual Machines in Azure introduce advanced performance enhancements to networking, including accelerated connection setup, increased network bandwidth per vCPU, and support for more virtual network interfaces per vCPU. These improvements significantly reduce connection setup latency and enable higher connection creation rates, making them ideal for demanding workloads. |
| 13 | + |
| 14 | +Building on the foundation of [Accelerated Networking](../../virtual-network/accelerated-networking-overview?tabs=redhat), Network Optimized Virtual Machines offload initial connection setup to hardware using [SR-IOV](../../windows-hardware/drivers/network/overview-of-single-root-i-o-virtualization--sr-iov-). This enhancement reduces connection setup latency and enables virtual machines to manage more connections efficiently within application constraints. |
| 15 | + |
| 16 | +Network Optimized Virtual Machines feature updated network flow limits that scale with vCPU count, offering greater capacity compared to general-purpose Azure virtual machines. These capabilities make Network Optimized Virtual Machines a powerful choice for applications requiring high-performance networking and scalability. |
| 17 | + |
| 18 | +> [!IMPORTANT] |
| 19 | +> Network Optimized Virtual Machines - Enhanced Performance and Connection Setup is currently in PREVIEW. |
| 20 | +> See the [Supplemental Terms of Use for Microsoft Azure Previews](https://azure.microsoft.com/support/legal/preview-supplemental-terms/) for legal terms that apply to Azure features that are in beta, preview, or otherwise not yet released into general availability. |
| 21 | +
|
| 22 | +## Traffic and SDN features that currently support enhanced connection setup |
| 23 | + |
| 24 | +When using Network Optimized Virtual Machines, you can expect to see performance |
| 25 | +improvements for the following supported scenarios. |
| 26 | + |
| 27 | +- Virtual machine to virtual machine traffic within virtual network |
| 28 | + |
| 29 | +- Virtual machine to internal load balancer endpoint |
| 30 | + |
| 31 | +- Virtual network peering, within region |
| 32 | + |
| 33 | +- Virtual network peering, across region |
| 34 | + |
| 35 | +Additional virtual network configurations work as expected but lack enhanced connection setup performance, similar to general-purpose virtual machines. It's planned to expand scenario support for hardware connection setup acceleration in the future. |
| 36 | + |
| 37 | +## Supported virtual machine size families enablement |
| 38 | + |
| 39 | +You can take advantage of enhanced connection setup capabilities by utilizing a supported virtual machine type, no further enablement steps are required. |
| 40 | + |
| 41 | +- The following virtual machine size families support enhanced connection setup capabilities. |
| 42 | + |
| 43 | + - Dlnv6 |
| 44 | + |
| 45 | + - Dnsv6 |
| 46 | + |
| 47 | + - Ensv6 |
| 48 | + |
| 49 | +Virtual machines with **`n`** included in their includes enhanced connection setup capabilities. |
| 50 | + |
| 51 | +## Network connection limits for network optimized virtual machines |
| 52 | + |
| 53 | +Connection and flow limits for Network Optimized Virtual Machines have been adjusted to enhance scalability and ensure consistent performance. These limits are based on the vCPU count of the virtual machine. When the connection or flow limit is reached, any new packets attempting to create connections or flows beyond the limit will be dropped. |
| 54 | + |
| 55 | +For more details on the concepts and accounting for connection and flow limits, see [Azure virtual machine network throughput](virtual-machine-network-throughput.md). |
| 56 | + |
| 57 | +| **vCPU** | **Connection Limit** | |
| 58 | +|----------|----------------------| |
| 59 | +| 2-7 | 500,000 | |
| 60 | +| 8-15 | 600,000 | |
| 61 | +| 16-31 | 700,000 | |
| 62 | +| 32-47 | 800,000 | |
| 63 | +| 48-63 | 1,000,000 | |
| 64 | +| 64-95 | 2,000,000 | |
| 65 | +| 96-192 | 2,000,000 | |
| 66 | +| 192+ | 4,000,000 | |
| 67 | + |
| 68 | +> [!WARNING] |
| 69 | +> These limits are provided as guidance. Each application and guest operating system manages network flows and timeouts differently. Your actual maximum achievable connection limit will vary and will be fewer than the limits posted below. |
| 70 | +
|
| 71 | +## Connection setup performance (CPS) |
| 72 | + |
| 73 | +Network Optimized Virtual Machines reduce latency for connection creation and enable higher connection creation rates. The connection creation rate, also known as connections per second (CPS), depends on several factors. These factors include virtual machine performance, operating system configuration, application settings, network traffic type and behavior, and infrastructure load. By optimizing these elements, you can achieve improved CPS performance in supported scenarios. |
| 74 | + |
| 75 | +CPS throttling occurs for network optimized virtual machines based on the number of vCPUs in the virtual machine. If the workload creates connections at a rate exceeding the infrastructure limit, the system drops packets. Once the connection creation rate falls below the limit, the system allows additional connections to succeed. When testing CPS, consider that virtual machine connection limits and flow expiration directly affect the sustained testing of the maximum connection creation rate. |
| 76 | + |
| 77 | +| **vCPUs (#)** | **Connections per Second** | |
| 78 | +|----------------|----------------------------| |
| 79 | +| 2 | 62,500 | |
| 80 | +| 4 | 62,500 | |
| 81 | +| 8 | 75,000 | |
| 82 | +| 16 | 87,500 | |
| 83 | +| 32 | 100,000 | |
| 84 | +| 48 | 125,000 | |
| 85 | +| 64 | 250,000 | |
| 86 | +| 128 | 250,000 | |
| 87 | +| 192+ | 420,000+ | |
| 88 | + |
| 89 | +## Limitations |
| 90 | + |
| 91 | +- Virtual network and NSG flow logging is not supported for Network Optimized Virtual Machine |
| 92 | + sizes during preview |
| 93 | + |
| 94 | +- Live Migration is disabled for Network Optimized Virtual Machine sizes during |
| 95 | + preview |
| 96 | + |
| 97 | +- TCP Reset on idle timeout is currently enabled for all load balancing |
| 98 | + rules regardless of user configuration. This will result in TCP resets |
| 99 | + being set for idle connections at the default value of 4 minutes. |
| 100 | + |
| 101 | +- Azure Monitor Metrics for network flows and flow creation rate are not |
| 102 | + accurate. |
| 103 | + |
| 104 | +- Increased connection setup performance is not currently applicable to |
| 105 | + network traffic destined to private link endpoints. |
| 106 | + |
| 107 | +- Increased connection setup performance is not applicable to certain |
| 108 | + container networking scenarios. |
0 commit comments