Skip to content

Commit 61f5f05

Browse files
committed
Testing executable doc rendering
1 parent 216518b commit 61f5f05

File tree

1 file changed

+84
-50
lines changed

1 file changed

+84
-50
lines changed

articles/batch/quick-create-cli.md

Lines changed: 84 additions & 50 deletions
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@ title: 'Quickstart: Use the Azure CLI to create a Batch account and run a job'
33
description: Follow this quickstart to use the Azure CLI to create a Batch account, a pool of compute nodes, and a job that runs basic tasks on the pool.
44
ms.topic: quickstart
55
ms.date: 04/12/2023
6-
ms.custom: mvc, devx-track-azurecli, mode-api, linux-related-content
6+
ms.custom: mvc, devx-track-azurecli, mode-api, linux-related-content, innovation-engine
77
---
88

99
# Quickstart: Use the Azure CLI to create a Batch account and run a job
@@ -20,63 +20,91 @@ After you complete this quickstart, you understand the [key concepts of the Batc
2020

2121
You can run the Azure CLI commands in this quickstart interactively in Azure Cloud Shell. To run the commands in the Cloud Shell, select **Open Cloudshell** at the upper-right corner of a code block. Select **Copy** to copy the code, and paste it into Cloud Shell to run it. You can also [run Cloud Shell from within the Azure portal](https://shell.azure.com). Cloud Shell always uses the latest version of the Azure CLI.
2222

23-
Alternatively, you can [install Azure CLI locally](/cli/azure/install-azure-cli) to run the commands. The steps in this article require Azure CLI version 2.0.20 or later. Run [az version](/cli/azure/reference-index?#az-version) to see your installed version and dependent libraries, and run [az upgrade](/cli/azure/reference-index?#az-upgrade) to upgrade. If you use a local installation, sign in to Azure by using the [az login](/cli/azure/reference-index#az-login) command.
23+
Alternatively, you can [install Azure CLI locally](/cli/azure/install-azure-cli) to run the commands. The steps in this article require Azure CLI version 2.0.20 or later. Run [az version](/cli/azure/reference-index?#az-version) to see your installed version and dependent libraries, and run [az upgrade](/cli/azure/reference-index?#az-upgrade) to upgrade. If you use a local installation, sign in to Azure by using the appropriate command.
2424

2525
>[!NOTE]
2626
>For some regions and subscription types, quota restrictions might cause Batch account or node creation to fail or not complete. In this situation, you can request a quota increase at no charge. For more information, see [Batch service quotas and limits](batch-quota-limit.md).
2727
2828
## Create a resource group
2929

30-
Run the following [az group create](/cli/azure/group#az-group-create) command to create an Azure resource group named `qsBatch` in the `eastus2` Azure region. The resource group is a logical container that holds the Azure resources for this quickstart.
30+
Run the following [az group create](/cli/azure/group#az-group-create) command to create an Azure resource group. The resource group is a logical container that holds the Azure resources for this quickstart.
3131

3232
```azurecli-interactive
33+
export RANDOM_SUFFIX=$(openssl rand -hex 3)
34+
export REGION="canadacentral"
35+
export RESOURCE_GROUP="qsBatch$RANDOM_SUFFIX"
36+
3337
az group create \
34-
--name qsBatch \
35-
--location eastus2
38+
--name $RESOURCE_GROUP \
39+
--location $REGION
40+
```
41+
42+
Results:
43+
44+
<!-- expected_similarity=0.3 -->
45+
46+
```JSON
47+
{
48+
"id": "/subscriptions/xxxxx/resourceGroups/qsBatchxxx",
49+
"location": "eastus2",
50+
"managedBy": null,
51+
"name": "qsBatchxxx",
52+
"properties": {
53+
"provisioningState": "Succeeded"
54+
},
55+
"tags": null,
56+
"type": "Microsoft.Resources/resourceGroups"
57+
}
3658
```
3759

3860
## Create a storage account
3961

4062
Use the [az storage account create](/cli/azure/storage/account#az-storage-account-create) command to create an Azure Storage account to link to your Batch account. Although this quickstart doesn't use the storage account, most real-world Batch workloads use a linked storage account to deploy applications and store input and output data.
4163

42-
Run the following command to create a Standard_LRS SKU storage account named `mybatchstorage` in your resource group:
64+
Run the following command to create a Standard_LRS SKU storage account in your resource group:
4365

4466
```azurecli-interactive
67+
export STORAGE_ACCOUNT="mybatchstorage$RANDOM_SUFFIX"
68+
4569
az storage account create \
46-
--resource-group qsBatch \
47-
--name mybatchstorage \
48-
--location eastus2 \
70+
--resource-group $RESOURCE_GROUP \
71+
--name $STORAGE_ACCOUNT \
72+
--location $REGION \
4973
--sku Standard_LRS
5074
```
5175

5276
## Create a Batch account
5377

54-
Run the following [az batch account create](/cli/azure/batch/account#az-batch-account-create) command to create a Batch account named `mybatchaccount` in your resource group and link it with the `mybatchstorage` storage account.
78+
Run the following [az batch account create](/cli/azure/batch/account#az-batch-account-create) command to create a Batch account in your resource group and link it with the storage account.
5579

5680
```azurecli-interactive
81+
export BATCH_ACCOUNT="mybatchaccount$RANDOM_SUFFIX"
82+
5783
az batch account create \
58-
--name mybatchaccount \
59-
--storage-account mybatchstorage \
60-
--resource-group qsBatch \
61-
--location eastus2
84+
--name $BATCH_ACCOUNT \
85+
--storage-account $STORAGE_ACCOUNT \
86+
--resource-group $RESOURCE_GROUP \
87+
--location $REGION
6288
```
6389

6490
Sign in to the new Batch account by running the [az batch account login](/cli/azure/batch/account#az-batch-account-login) command. Once you authenticate your account with Batch, subsequent `az batch` commands in this session use this account context.
6591

6692
```azurecli-interactive
6793
az batch account login \
68-
--name mybatchaccount \
69-
--resource-group qsBatch \
94+
--name $BATCH_ACCOUNT \
95+
--resource-group $RESOURCE_GROUP \
7096
--shared-key-auth
7197
```
7298

7399
## Create a pool of compute nodes
74100

75-
Run the [az batch pool create](/cli/azure/batch/pool#az-batch-pool-create) command to create a pool of Linux compute nodes in your Batch account. The following example creates a pool named `myPool` that consists of two Standard_A1_v2 size VMs running Ubuntu 20.04 LTS OS. This node size offers a good balance of performance versus cost for this quickstart example.
101+
Run the [az batch pool create](/cli/azure/batch/pool#az-batch-pool-create) command to create a pool of Linux compute nodes in your Batch account. The following example creates a pool that consists of two Standard_A1_v2 size VMs running Ubuntu 20.04 LTS OS. This node size offers a good balance of performance versus cost for this quickstart example.
76102

77103
```azurecli-interactive
104+
export POOL_ID="myPool$RANDOM_SUFFIX"
105+
78106
az batch pool create \
79-
--id myPool \
107+
--id $POOL_ID \
80108
--image canonical:0001-com-ubuntu-server-focal:20_04-lts \
81109
--node-agent-sku-id "batch.node.ubuntu 20.04" \
82110
--target-dedicated-nodes 2 \
@@ -86,20 +114,32 @@ az batch pool create \
86114
Batch creates the pool immediately, but takes a few minutes to allocate and start the compute nodes. To see the pool status, use the [az batch pool show](/cli/azure/batch/pool#az-batch-pool-show) command. This command shows all the properties of the pool, and you can query for specific properties. The following command queries for the pool allocation state:
87115

88116
```azurecli-interactive
89-
az batch pool show --pool-id myPool \
90-
--query "allocationState"
117+
az batch pool show --pool-id $POOL_ID \
118+
--query "{allocationState: allocationState}"
119+
```
120+
121+
Results:
122+
123+
<!-- expected_similarity=0.3 -->
124+
125+
```JSON
126+
{
127+
"allocationState": "resizing"
128+
}
91129
```
92130

93131
While Batch allocates and starts the nodes, the pool is in the `resizing` state. You can create a job and tasks while the pool state is still `resizing`. The pool is ready to run tasks when the allocation state is `steady` and all the nodes are running.
94132

95133
## Create a job
96134

97-
Use the [az batch job create](/cli/azure/batch/job#az-batch-job-create) command to create a Batch job to run on your pool. A Batch job is a logical group of one or more tasks. The job includes settings common to the tasks, such as the pool to run on. The following example creates a job called `myJob` on `myPool` that initially has no tasks.
135+
Use the [az batch job create](/cli/azure/batch/job#az-batch-job-create) command to create a Batch job to run on your pool. A Batch job is a logical group of one or more tasks. The job includes settings common to the tasks, such as the pool to run on. The following example creates a job that initially has no tasks.
98136

99137
```azurecli-interactive
138+
export JOB_ID="myJob$RANDOM_SUFFIX"
139+
100140
az batch job create \
101-
--id myJob \
102-
--pool-id myPool
141+
--id $JOB_ID \
142+
--pool-id $POOL_ID
103143
```
104144

105145
## Create job tasks
@@ -113,22 +153,22 @@ for i in {1..4}
113153
do
114154
az batch task create \
115155
--task-id myTask$i \
116-
--job-id myJob \
156+
--job-id $JOB_ID \
117157
--command-line "/bin/bash -c 'printenv | grep AZ_BATCH; sleep 90s'"
118158
done
119159
```
120160

121-
The command output shows the settings for each task. Batch distributes the tasks to the compute nodes.
161+
Batch distributes the tasks to the compute nodes.
122162

123163
## View task status
124164

125-
After you create the task, Batch queues the task to run on the pool. Once a node is available, the task runs on the node.
165+
After you create the tasks, Batch queues them to run on the pool. Once a node is available, a task runs on the node.
126166

127167
Use the [az batch task show](/cli/azure/batch/task#az-batch-task-show) command to view the status of Batch tasks. The following example shows details about the status of `myTask1`:
128168

129169
```azurecli-interactive
130170
az batch task show \
131-
--job-id myJob \
171+
--job-id $JOB_ID \
132172
--task-id myTask1
133173
```
134174

@@ -139,29 +179,39 @@ The command output includes many details. For example, an `exitCode` of `0` indi
139179
Use the [az batch task file list](/cli/azure/batch/task#az-batch-task-file-show) command to list the files a task created on a node. The following command lists the files that `myTask1` created:
140180

141181
```azurecli-interactive
142-
az batch task file list \
143-
--job-id myJob \
144-
--task-id myTask1 \
145-
--output table
182+
# Wait for task to complete before downloading output
183+
echo "Waiting for task to complete..."
184+
while true; do
185+
STATUS=$(az batch task show --job-id $JOB_ID --task-id myTask1 --query "state" -o tsv)
186+
if [ "$STATUS" == "running" ]; then
187+
break
188+
fi
189+
sleep 10
190+
done
191+
192+
az batch task file list --job-id $JOB_ID --task-id myTask1 --output table
146193
```
147194

148195
Results are similar to the following output:
149196

197+
Results:
198+
199+
<!-- expected_similarity=0.3 -->
200+
150201
```output
151202
Name URL Is Directory Content Length
152203
---------- ---------------------------------------------------------------------------------------- -------------- ----------------
153204
stdout.txt https://mybatchaccount.eastus2.batch.azure.com/jobs/myJob/tasks/myTask1/files/stdout.txt False 695
154205
certs https://mybatchaccount.eastus2.batch.azure.com/jobs/myJob/tasks/myTask1/files/certs True
155206
wd https://mybatchaccount.eastus2.batch.azure.com/jobs/myJob/tasks/myTask1/files/wd True
156207
stderr.txt https://mybatchaccount.eastus2.batch.azure.com/jobs/myJob/tasks/myTask1/files/stderr.txt False 0
157-
158208
```
159209

160210
The [az batch task file download](/cli/azure/batch/task#az-batch-task-file-download) command downloads output files to a local directory. Run the following example to download the *stdout.txt* file:
161211

162212
```azurecli-interactive
163213
az batch task file download \
164-
--job-id myJob \
214+
--job-id $JOB_ID \
165215
--task-id myTask1 \
166216
--file-path stdout.txt \
167217
--destination ./stdout.txt
@@ -187,25 +237,9 @@ AZ_BATCH_ACCOUNT_NAME=mybatchaccount
187237
AZ_BATCH_TASK_USER_IDENTITY=PoolNonAdmin
188238
```
189239

190-
## Clean up resources
191-
192-
If you want to continue with Batch tutorials and samples, you can use the Batch account and linked storage account that you created in this quickstart. There's no charge for the Batch account itself.
193-
194-
Pools and nodes incur charges while the nodes are running, even if they aren't running jobs. When you no longer need a pool, use the [az batch pool delete](/cli/azure/batch/pool#az-batch-pool-delete) command to delete it. Deleting a pool deletes all task output on the nodes, and the nodes themselves.
195-
196-
```azurecli-interactive
197-
az batch pool delete --pool-id myPool
198-
```
199-
200-
When you no longer need any of the resources you created for this quickstart, you can use the [az group delete](/cli/azure/group#az-group-delete) command to delete the resource group and all its resources. To delete the resource group and the storage account, Batch account, node pools, and all related resources, run the following command:
201-
202-
```azurecli-interactive
203-
az group delete --name qsBatch
204-
```
205-
206240
## Next steps
207241

208242
In this quickstart, you created a Batch account and pool, created and ran a Batch job and tasks, and viewed task output from the nodes. Now that you understand the key concepts of the Batch service, you're ready to use Batch with more realistic, larger scale workloads. To learn more about Azure Batch, continue to the Azure Batch tutorials.
209243

210244
> [!div class="nextstepaction"]
211-
> [Tutorial: Run a parallel workload with Azure Batch](./tutorial-parallel-python.md)
245+
> [Tutorial: Run a parallel workload with Azure Batch](./tutorial-parallel-python.md)

0 commit comments

Comments
 (0)