Skip to content

Commit 0d89cbb

Browse files
committed
added new doc for preview for accelerated netowrking connection setup
1 parent 61cb707 commit 0d89cbb

File tree

1 file changed

+108
-0
lines changed

1 file changed

+108
-0
lines changed
Lines changed: 108 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,108 @@
1+
---
2+
title: Network Optimized Virtual Machines - Enhanced Performance and Connection Setup (Preview)
3+
description: Learn about the performance improvements, connection limits, and supported scenarios for Network Optimized Virtual Machines in Azure, including enhanced connection setup capabilities.
4+
author: asudbring
5+
ms.topic: concept-article
6+
ms.date: 05/13/2025
7+
ms.author: allensu
8+
---
9+
10+
# Network Optimized Virtual Machines - Enhanced Performance and Connection Setup (Preview)
11+
12+
Network Optimized Virtual Machines in Azure introduce advanced performance enhancements to networking, including accelerated connection setup, increased network bandwidth per vCPU, and support for more virtual network interfaces per vCPU. These improvements significantly reduce connection setup latency and enable higher connection creation rates, making them ideal for demanding workloads.
13+
14+
Building on the foundation of [Accelerated Networking](../../virtual-network/accelerated-networking-overview?tabs=redhat), Network Optimized Virtual Machines offload initial connection setup to hardware using [SR-IOV](../../windows-hardware/drivers/network/overview-of-single-root-i-o-virtualization--sr-iov-). This enhancement reduces connection setup latency and enables virtual machines to manage more connections efficiently within application constraints.
15+
16+
Network Optimized Virtual Machines feature updated network flow limits that scale with vCPU count, offering greater capacity compared to general-purpose Azure virtual machines. These capabilities make Network Optimized Virtual Machines a powerful choice for applications requiring high-performance networking and scalability.
17+
18+
> [!IMPORTANT]
19+
> Network Optimized Virtual Machines - Enhanced Performance and Connection Setup is currently in PREVIEW.
20+
> See the [Supplemental Terms of Use for Microsoft Azure Previews](https://azure.microsoft.com/support/legal/preview-supplemental-terms/) for legal terms that apply to Azure features that are in beta, preview, or otherwise not yet released into general availability.
21+
22+
## Traffic and SDN features that currently support enhanced connection setup
23+
24+
When using Network Optimized Virtual Machines, you can expect to see performance
25+
improvements for the following supported scenarios.
26+
27+
- Virtual machine to virtual machine traffic within virtual network
28+
29+
- Virtual machine to internal load balancer endpoint
30+
31+
- Virtual network peering, within region
32+
33+
- Virtual network peering, across region
34+
35+
Additional virtual network configurations work as expected but lack enhanced connection setup performance, similar to general-purpose virtual machines. It's planned to expand scenario support for hardware connection setup acceleration in the future.
36+
37+
## Supported virtual machine size families enablement
38+
39+
You can take advantage of enhanced connection setup capabilities by utilizing a supported virtual machine type, no further enablement steps are required.
40+
41+
- The following virtual machine size families support enhanced connection setup capabilities.
42+
43+
- Dlnv6
44+
45+
- Dnsv6
46+
47+
- Ensv6
48+
49+
Virtual machines with **`n`** included in their includes enhanced connection setup capabilities.
50+
51+
## Network connection limits for network optimized virtual machines
52+
53+
Connection and flow limits for Network Optimized Virtual Machines have been adjusted to enhance scalability and ensure consistent performance. These limits are based on the vCPU count of the virtual machine. When the connection or flow limit is reached, any new packets attempting to create connections or flows beyond the limit will be dropped.
54+
55+
For more details on the concepts and accounting for connection and flow limits, see [Azure virtual machine network throughput](virtual-machine-network-throughput.md).
56+
57+
| **vCPU** | **Connection Limit** |
58+
|----------|----------------------|
59+
| 2-7 | 500,000 |
60+
| 8-15 | 600,000 |
61+
| 16-31 | 700,000 |
62+
| 32-47 | 800,000 |
63+
| 48-63 | 1,000,000 |
64+
| 64-95 | 2,000,000 |
65+
| 96-192 | 2,000,000 |
66+
| 192+ | 4,000,000 |
67+
68+
> [!WARNING]
69+
> These limits are provided as guidance. Each application and guest operating system manages network flows and timeouts differently. Your actual maximum achievable connection limit will vary and will be fewer than the limits posted below.
70+
71+
## Connection setup performance (CPS)
72+
73+
Network Optimized Virtual Machines reduce latency for connection creation and enable higher connection creation rates. The connection creation rate, also known as connections per second (CPS), depends on several factors. These factors include virtual machine performance, operating system configuration, application settings, network traffic type and behavior, and infrastructure load. By optimizing these elements, you can achieve improved CPS performance in supported scenarios.
74+
75+
CPS throttling occurs for network optimized virtual machines based on the number of vCPUs in the virtual machine. If the workload creates connections at a rate exceeding the infrastructure limit, the system drops packets. Once the connection creation rate falls below the limit, the system allows additional connections to succeed. When testing CPS, consider that virtual machine connection limits and flow expiration directly affect the sustained testing of the maximum connection creation rate.
76+
77+
| **vCPUs (#)** | **Connections per Second** |
78+
|----------------|----------------------------|
79+
| 2 | 62,500 |
80+
| 4 | 62,500 |
81+
| 8 | 75,000 |
82+
| 16 | 87,500 |
83+
| 32 | 100,000 |
84+
| 48 | 125,000 |
85+
| 64 | 250,000 |
86+
| 128 | 250,000 |
87+
| 192+ | 420,000+ |
88+
89+
## Limitations
90+
91+
- Virtual network and NSG flow logging is not supported for Network Optimized Virtual Machine
92+
sizes during preview
93+
94+
- Live Migration is disabled for Network Optimized Virtual Machine sizes during
95+
preview
96+
97+
- TCP Reset on idle timeout is currently enabled for all load balancing
98+
rules regardless of user configuration. This will result in TCP resets
99+
being set for idle connections at the default value of 4 minutes.
100+
101+
- Azure Monitor Metrics for network flows and flow creation rate are not
102+
accurate.
103+
104+
- Increased connection setup performance is not currently applicable to
105+
network traffic destined to private link endpoints.
106+
107+
- Increased connection setup performance is not applicable to certain
108+
container networking scenarios.

0 commit comments

Comments
 (0)