You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/batch/batch-pool-cloud-service-to-virtual-machine-configuration.md
+4-4Lines changed: 4 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -9,7 +9,7 @@ ms.date: 09/03/2021
9
9
10
10
Currently, Batch pools can be created using either [virtualMachineConfiguration](/rest/api/batchservice/pool/add#virtualmachineconfiguration) or [cloudServiceConfiguration](/rest/api/batchservice/pool/add#cloudserviceconfiguration). We recommend using Virtual Machine Configuration only, as this configuration supports all Batch capabilities.
11
11
12
-
Cloud Services Configuration pools don't support some of the current Batch features, and won't support any newly-added features. You won't be able to create new 'CloudServiceConfiguration' pools or add new nodes to existing pools [after February 29, 2024](https://azure.microsoft.com/updates/azure-batch-cloudserviceconfiguration-pools-will-be-retired-on-29-february-2024/).
12
+
Cloud Services Configuration pools don't support some of the current Batch features, and won't support any newlyadded features. You won't be able to create new 'CloudServiceConfiguration' pools or add new nodes to existing pools [after February 29, 2024](https://azure.microsoft.com/updates/azure-batch-cloudserviceconfiguration-pools-will-be-retired-on-29-february-2024/).
13
13
14
14
If your Batch solutions currently use 'cloudServiceConfiguration' pools, we recommend changing to 'virtualMachineConfiguration' as soon as possible. This will enable you to benefit from all Batch capabilities, such as an expanded [selection of VM series](batch-pool-vm-sizes.md), Linux VMs, [containers](batch-docker-container-workloads.md), [Azure Resource Manager virtual networks](batch-virtual-network.md), and [node disk encryption](disk-encryption.md).
15
15
@@ -31,7 +31,7 @@ Some of the key differences between the two configurations include:
31
31
- 'virtualMachineConfiguration' pool nodes utilize managed OS disks. The [managed disk type](../virtual-machines/disks-types.md) that is used for each node depends on the VM size chosen for the pool. If a 's' VM size is specified for the pool, for example 'Standard_D2s_v3', then a premium SSD is used. If a 'non-s' VM size is specified, for example 'Standard_D2_v3', then a standard HDD is used.
32
32
33
33
> [!IMPORTANT]
34
-
> As with Virtual Machines and Virtual Machine Scale Sets, the OS managed disk used for each node incurs a cost, which is additional to the cost of the VMs. 'virtualMachineConfiguration' pools can use [ephemeral OS disks](create-pool-ephemeral-os-disk.md), which create the OS disk on the VM cache or temporary SSD, to avoid extra costs associated with managed disks.There is no OS disk cost for 'cloudServiceConfiguration' nodes, as the OS disk is created on the nodes local SSD.
34
+
> As with Virtual Machines and Virtual Machine Scale Sets, the OS managed disk used for each node incurs a cost, which is additional to the cost of the VMs. 'virtualMachineConfiguration' pools can use [ephemeral OS disks](create-pool-ephemeral-os-disk.md), which create the OS disk on the VM cache or temporary disk, to avoid extra costs associated with managed disks.There is no OS disk cost for 'cloudServiceConfiguration' nodes, as the OS disk is created on the node's local disk.
35
35
36
36
## Azure Data Factory custom activity pools
37
37
@@ -40,7 +40,7 @@ Azure Batch pools can be used to run Data Factory custom activities. Any 'cloudS
40
40
When creating your new pools to run Data Factory custom activities, follow these practices:
41
41
42
42
- Pause all pipelines before creating the new pools and deleting the old ones to ensure no executions will be interrupted.
43
-
- The same pool id can be used to avoid linked service configuration changes.
43
+
- The same pool ID can be used to avoid linked service configuration changes.
44
44
- Resume pipelines when new pools have been created.
45
45
46
46
For more information about using Azure Batch to run Data Factory custom activities, see [Azure Batch linked service](../data-factory/compute-linked-services.md#azure-batch-linked-service) and [Custom activities in a Data Factory pipeline](../data-factory/transform-data-using-dotnet-custom-activity.md)
@@ -49,4 +49,4 @@ For more information about using Azure Batch to run Data Factory custom activiti
49
49
50
50
- Learn more about [pool configurations](nodes-and-pools.md#configurations).
51
51
- Learn more about [pool best practices](best-practices.md#pools).
52
-
- See the REST API reference for [pool addition](/rest/api/batchservice/pool/add) and [virtualMachineConfiguration](/rest/api/batchservice/pool/add#virtualmachineconfiguration).
52
+
- See the REST API reference for [pool addition](/rest/api/batchservice/pool/add) and [virtualMachineConfiguration](/rest/api/batchservice/pool/add#virtualmachineconfiguration).
Copy file name to clipboardExpand all lines: articles/batch/batch-virtual-network.md
+6-6Lines changed: 6 additions & 6 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -2,7 +2,7 @@
2
2
title: Provision a pool in a virtual network
3
3
description: How to create a Batch pool in an Azure virtual network so that compute nodes can communicate securely with other VMs in the network, such as a file server.
4
4
ms.topic: how-to
5
-
ms.date: 11/14/2022
5
+
ms.date: 11/15/2022
6
6
ms.custom: seodec18
7
7
---
8
8
@@ -44,9 +44,9 @@ or `CloudServiceConfiguration`. `VirtualMachineConfiguration` for Batch pools is
44
44
pools are [deprecated](https://azure.microsoft.com/updates/azure-batch-cloudserviceconfiguration-pools-will-be-retired-on-29-february-2024/).
45
45
46
46
> [!IMPORTANT]
47
-
> Batch pools can be configured in one of two communication modes. `Classic`communication
48
-
> mode is where the Batch service initiates communication to the compute nodes.
49
-
> [`Simplified` communication mode](simplified-compute-node-communication.md)
47
+
> Batch pools can be configured in one of two node communication modes. Classic node communication mode is
48
+
> where the Batch service initiates communication to the compute nodes.
49
+
> [Simplified](simplified-compute-node-communication.md) node communication mode
50
50
> is where the compute nodes initiate communication to the Batch Service.
51
51
52
52
## Pools in Virtual Machine Configuration
@@ -93,8 +93,8 @@ NSG with at least the inbound and outbound security rules that are shown in the
93
93
94
94
> [!WARNING]
95
95
> Batch service IP addresses can change over time. Therefore, we highly recommend that you use the
96
-
> BatchNodeManagement.*region* service tag (or a regional variant) for the NSG rules indicated in the
97
-
> following tables. Avoid populating NSG rules with specific Batch service IP addresses.
96
+
> BatchNodeManagement.*region* service tag for the NSG rules indicated in the following tables. Avoid
97
+
> populating NSG rules with specific Batch service IP addresses.
Copy file name to clipboardExpand all lines: articles/batch/best-practices.md
+27-3Lines changed: 27 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,7 +1,7 @@
1
1
---
2
2
title: Best practices
3
3
description: Learn best practices and useful tips for developing your Azure Batch solutions.
4
-
ms.date: 11/14/2022
4
+
ms.date: 11/15/2022
5
5
ms.topic: conceptual
6
6
---
7
7
@@ -20,13 +20,37 @@ This article discusses best practices and useful tips for using the Azure Batch
20
20
21
21
-**Pool allocation mode:** When creating a Batch account, you can choose between two pool allocation modes: **Batch service** or **user subscription**. For most cases, you should use the default Batch service mode, in which pools are allocated behind the scenes in Batch-managed subscriptions. In the alternative user subscription mode, Batch VMs and other resources are created directly in your subscription when a pool is created. User subscription accounts are primarily used to enable a small but important subset of scenarios. For more information, see [configuration for user subscription mode](batch-account-create-portal.md#additional-configuration-for-user-subscription-mode).
22
22
23
-
-**'virtualMachineConfiguration' or 'cloudServiceConfiguration':** While you can currently create pools using either configuration, new pools should be configured using 'virtualMachineConfiguration' and not 'cloudServiceConfiguration'. All current and new Batch features will be supported by Virtual Machine Configuration pools. Cloud Services Configuration pools don't support all features and no new capabilities are planned. You won't be able to create new 'cloudServiceConfiguration' pools or add new nodes to existing pools [after February 29, 2024](https://azure.microsoft.com/updates/azure-batch-cloudserviceconfiguration-pools-will-be-retired-on-29-february-2024/). For more information, see [Migrate Batch pool configuration from Cloud Services to Virtual Machine](batch-pool-cloud-service-to-virtual-machine-configuration.md).
23
+
-**`virtualMachineConfiguration` or `cloudServiceConfiguration`:** While you can currently create pools using either
24
+
configuration, new pools should be configured using `virtualMachineConfiguration` and not `cloudServiceConfiguration`.
25
+
All current and new Batch features will be supported by Virtual Machine Configuration pools. Cloud Service Configuration
26
+
pools don't support all features and no new capabilities are planned. You won't be able to create new
27
+
`cloudServiceConfiguration` pools or add new nodes to existing pools
28
+
[after February 29, 2024](https://azure.microsoft.com/updates/azure-batch-cloudserviceconfiguration-pools-will-be-retired-on-29-february-2024/).
29
+
For more information, see
30
+
[Migrate Batch pool configuration from Cloud Services to Virtual Machine](batch-pool-cloud-service-to-virtual-machine-configuration.md).
31
+
32
+
-**`classic` or `simplified` node communication mode:** Pools can be configured in one of two node communication modes,
33
+
classic or [simplified](simplified-compute-node-communication.md). In the classic node communication model, the Batch service
34
+
initiates communication to the compute nodes, and compute nodes also require communicating to Azure Storage. In the simplified
35
+
node communication model, compute nodes initiate communication with the Batch service. Due to the reduced scope of
36
+
inbound/outbound connections required, and not requiring Azure Storage outbound access for baseline operation, the recommendation
37
+
is to use the simplified node communication model. Some future improvements to the Batch service will also require the simplified
38
+
node communication model.
24
39
25
40
-**Job and task run time considerations:** If you have jobs comprised primarily of short-running tasks, and the expected total task counts are small, so that the overall expected run time of the job isn't long, don't allocate a new pool for each job. The allocation time of the nodes will diminish the run time of the job.
26
41
27
42
-**Multiple compute nodes:** Individual nodes aren't guaranteed to always be available. While uncommon, hardware failures, operating system updates, and a host of other issues can cause individual nodes to be offline. If your Batch workload requires deterministic, guaranteed progress, you should allocate pools with multiple nodes.
28
43
29
-
-**Images with impending end-of-life (EOL) dates:** We strongly recommended avoiding images with impending Batch support end of life (EOL) dates. These dates can be discovered via the [`ListSupportedImages` API](/rest/api/batchservice/account/listsupportedimages), [PowerShell](/powershell/module/az.batch/get-azbatchsupportedimage), or [Azure CLI](/cli/azure/batch/pool/supported-images). It's your responsibility to periodically refresh your view of the EOL dates pertinent to your pools and migrate your workloads before the EOL date occurs. If you're using a custom image with a specified node agent, ensure that you follow Batch support end-of-life dates for the image for which your custom image is derived or aligned with. An image without a specified `batchSupportEndOfLife` date indicates that such a date has not been determined yet by the Batch service. Absence of a date does not indicate that the respective image will be supported indefinitely. An EOL date may be added or updated in the future at anytime.
44
+
-**Images with impending end-of-life (EOL) dates:** We strongly recommended avoiding images with impending Batch support
45
+
end of life (EOL) dates. These dates can be discovered via the
[PowerShell](/powershell/module/az.batch/get-azbatchsupportedimage), or
48
+
[Azure CLI](/cli/azure/batch/pool/supported-images). It's your responsibility to periodically refresh your view of the EOL
49
+
dates pertinent to your pools and migrate your workloads before the EOL date occurs. If you're using a custom image with a
50
+
specified node agent, ensure that you follow Batch support end-of-life dates for the image for which your custom image is
51
+
derived or aligned with. An image without a specified `batchSupportEndOfLife` date indicates that such a date hasn't been
52
+
determined yet by the Batch service. Absence of a date doesn't indicate that the respective image will be supported
53
+
indefinitely. An EOL date may be added or updated in the future at any time.
30
54
31
55
-**Unique resource names:** Batch resources (jobs, pools, etc.) often come and go over time. For example, you may create a pool on Monday, delete it on Tuesday, and then create another similar pool on Thursday. Each new resource you create should be given a unique name that you haven't used before. You can create uniqueness by using a GUID (either as the entire resource name, or as a part of it) or by embedding the date and time that the resource was created in the resource name. Batch supports [DisplayName](/dotnet/api/microsoft.azure.batch.jobspecification.displayname), which can give a resource a more readable name even if the actual resource ID is something that isn't human-friendly. Using unique names makes it easier for you to differentiate which particular resource did something in logs and metrics. It also removes ambiguity if you ever have to file a support case for a resource.
0 commit comments