Skip to content

Commit e720b7c

Browse files
committed
code links
1 parent 921bb60 commit e720b7c

File tree

1 file changed

+12
-11
lines changed

1 file changed

+12
-11
lines changed

articles/machine-learning/how-to-use-parallel-job-in-pipeline.md

Lines changed: 12 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -73,7 +73,8 @@ For example, you could set numbers to `mini_batch_size` to partition your data *
7373
# [Python](#tab/python)
7474

7575
Declare `job_data_path` as one of the inputs. Bind it to `input_data` attribute.
76-
[!notebook-python[] (/azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=parallel-job-for-file-data)]
76+
77+
[!notebook-python[] (~/azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=parallel-job-for-file-data)]
7778

7879
---
7980

@@ -101,7 +102,7 @@ Sample code to set two attributes:
101102

102103
[!INCLUDE [sdk v2](../../includes/machine-learning-sdk-v2.md)]
103104

104-
[!notebook-python[] (/azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=parallel-job-for-file-data)]
105+
[!notebook-python[] (~/azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=parallel-job-for-file-data)]
105106
---
106107

107108
> [!NOTE]
@@ -143,7 +144,7 @@ Sample code to set two attributes:
143144

144145
[!INCLUDE [sdk v2](../../includes/machine-learning-sdk-v2.md)]
145146

146-
[!notebook-python[] (/azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=parallel-job-for-file-data)]
147+
[!notebook-python[] (~/azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=parallel-job-for-file-data)]
147148
---
148149

149150
> [!IMPORTANT]
@@ -183,7 +184,7 @@ Sample code to update these settings:
183184

184185
[!INCLUDE [sdk v2](../../includes/machine-learning-sdk-v2.md)]
185186

186-
[!notebook-python[] (/azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=parallel-job-for-tabular-data)]
187+
[!notebook-python[] (~/azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=parallel-job-for-tabular-data)]
187188
---
188189

189190
## Create parallel job in pipeline
@@ -201,19 +202,19 @@ You can create your parallel job inline with your pipeline job:
201202

202203
First, you need to import the required libraries, initiate your ml_client with proper credential, and create/retrieve your computes:
203204

204-
[!notebook-python[] (/azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=required-library)]
205+
[!notebook-python[] (~/azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=required-library)]
205206

206-
[!notebook-python[] (/azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=credential)]
207+
[!notebook-python[] (~/azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=credential)]
207208

208-
[!notebook-python[] (/azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=workspace)]
209+
[!notebook-python[] (~/azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=workspace)]
209210

210211
Then implement your parallel job by filling `parallel_run_function`:
211212

212-
[!notebook-python[] (/azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=parallel-job-for-tabular-data)]
213-
213+
[!notebook-python[] (~/azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=parallel-job-for-tabular-data)]
214214

215215
Finally use your parallel job as a step in your pipeline and bind its inputs/outputs with other steps:
216-
[!notebook-python[] (/azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=build-pipeline)]
216+
217+
[!notebook-python[] (~/azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=build-pipeline)]
217218

218219
---
219220

@@ -235,7 +236,7 @@ az ml job create --file pipeline.yml
235236

236237
You can submit your pipeline job with parallel step by using `jobs.create_or_update` function of ml_client:
237238

238-
[!notebook-python[] (/azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=submit-pipeline)]
239+
[!notebook-python[] (~/azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=submit-pipeline)]
239240

240241
---
241242

0 commit comments

Comments
 (0)