@@ -73,7 +73,8 @@ For example, you could set numbers to `mini_batch_size` to partition your data *
73
73
# [ Python] ( #tab/python )
74
74
75
75
Declare ` job_data_path ` as one of the inputs. Bind it to ` input_data ` attribute.
76
- [ !notebook-python[ ] (/azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=parallel-job-for-file-data)]
76
+
77
+ [ !notebook-python[ ] (~ /azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=parallel-job-for-file-data)]
77
78
78
79
---
79
80
@@ -101,7 +102,7 @@ Sample code to set two attributes:
101
102
102
103
[ !INCLUDE [ sdk v2] ( ../../includes/machine-learning-sdk-v2.md )]
103
104
104
- [ !notebook-python[ ] (/azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=parallel-job-for-file-data)]
105
+ [ !notebook-python[ ] (~ /azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=parallel-job-for-file-data)]
105
106
---
106
107
107
108
> [ !NOTE]
@@ -143,7 +144,7 @@ Sample code to set two attributes:
143
144
144
145
[ !INCLUDE [ sdk v2] ( ../../includes/machine-learning-sdk-v2.md )]
145
146
146
- [ !notebook-python[ ] (/azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=parallel-job-for-file-data)]
147
+ [ !notebook-python[ ] (~ /azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=parallel-job-for-file-data)]
147
148
---
148
149
149
150
> [ !IMPORTANT]
@@ -183,7 +184,7 @@ Sample code to update these settings:
183
184
184
185
[ !INCLUDE [ sdk v2] ( ../../includes/machine-learning-sdk-v2.md )]
185
186
186
- [ !notebook-python[ ] (/azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=parallel-job-for-tabular-data)]
187
+ [ !notebook-python[ ] (~ /azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=parallel-job-for-tabular-data)]
187
188
---
188
189
189
190
## Create parallel job in pipeline
@@ -201,19 +202,19 @@ You can create your parallel job inline with your pipeline job:
201
202
202
203
First, you need to import the required libraries, initiate your ml_client with proper credential, and create/retrieve your computes:
203
204
204
- [ !notebook-python[ ] (/azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=required-library)]
205
+ [ !notebook-python[ ] (~ /azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=required-library)]
205
206
206
- [ !notebook-python[ ] (/azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=credential)]
207
+ [ !notebook-python[ ] (~ /azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=credential)]
207
208
208
- [ !notebook-python[ ] (/azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=workspace)]
209
+ [ !notebook-python[ ] (~ /azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=workspace)]
209
210
210
211
Then implement your parallel job by filling ` parallel_run_function ` :
211
212
212
- [ !notebook-python[ ] (/azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=parallel-job-for-tabular-data)]
213
-
213
+ [ !notebook-python[ ] (~ /azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=parallel-job-for-tabular-data)]
214
214
215
215
Finally use your parallel job as a step in your pipeline and bind its inputs/outputs with other steps:
216
- [ !notebook-python[ ] (/azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=build-pipeline)]
216
+
217
+ [ !notebook-python[ ] (~ /azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=build-pipeline)]
217
218
218
219
---
219
220
@@ -235,7 +236,7 @@ az ml job create --file pipeline.yml
235
236
236
237
You can submit your pipeline job with parallel step by using ` jobs.create_or_update ` function of ml_client:
237
238
238
- [ !notebook-python[ ] (/azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=submit-pipeline)]
239
+ [ !notebook-python[ ] (~ /azureml-examples-v2samplesreorg/sdk/python/jobs/pipelines/1g_pipeline_with_parallel_nodes/pipeline_with_parallel_nodes.ipynb?name=submit-pipeline)]
239
240
240
241
---
241
242
0 commit comments