Skip to content

Commit eab920e

Browse files
authored
Merge pull request GoogleCloudPlatform#151 from GoogleCloudPlatform/ajayhemnani-patch-1
Update multiple_frameworks_kubeflow.ipynb
2 parents 1f4d574 + e65c791 commit eab920e

File tree

2 files changed

+73
-0
lines changed

2 files changed

+73
-0
lines changed

continuous_training/kubeflow/labs/multiple_frameworks_lab.ipynb

Lines changed: 37 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1022,6 +1022,38 @@
10221022
"!head census_training_pipeline.yaml"
10231023
]
10241024
},
1025+
{
1026+
"cell_type": "markdown",
1027+
"metadata": {},
1028+
"source": [
1029+
"#### Set the command fields in the pipeline YAML"
1030+
]
1031+
},
1032+
{
1033+
"cell_type": "code",
1034+
"execution_count": null,
1035+
"metadata": {},
1036+
"outputs": [],
1037+
"source": [
1038+
"!sed -i 's/\\\"command\\\": \\[\\]/\\\"command\\\": \\[python, -u, -m, kfp_component.launcher\\]/g' census_training_pipeline.yaml"
1039+
]
1040+
},
1041+
{
1042+
"cell_type": "code",
1043+
"execution_count": null,
1044+
"metadata": {},
1045+
"outputs": [],
1046+
"source": [
1047+
"!cat census_training_pipeline.yaml | grep \"component.launcher\""
1048+
]
1049+
},
1050+
{
1051+
"cell_type": "markdown",
1052+
"metadata": {},
1053+
"source": [
1054+
"You should see 6 lines in the output that were modified by the sed command."
1055+
]
1056+
},
10251057
{
10261058
"cell_type": "markdown",
10271059
"metadata": {},
@@ -1064,6 +1096,11 @@
10641096
"* For **Run Type** select **One-Off**\n",
10651097
"* Enter your **Project ID** and hit **Start**. You can now monitor your pipeline run in the UI (it will take about **10 minutes** to complete the run).\n",
10661098
"\n",
1099+
"\n",
1100+
"\n",
1101+
"**NOTE that your pipeline run may fail due to the bug in a BigQuery component that does not handle certain race conditions. If you observe the pipeline failure, submit another pipeline run using the KFP UI using the steps above**\n",
1102+
"\n",
1103+
"\n",
10671104
"Now let's set up a recurring run:\n",
10681105
"* Select **Pipelines** then **census_trainer_multiple_models** and click **Create Run**\n",
10691106
"* In the **Experiement** field select **Default**\n",

continuous_training/kubeflow/solutions/multiple_frameworks_kubeflow.ipynb

Lines changed: 36 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1020,6 +1020,38 @@
10201020
"!head census_training_pipeline.yaml"
10211021
]
10221022
},
1023+
{
1024+
"cell_type": "markdown",
1025+
"metadata": {},
1026+
"source": [
1027+
"#### Set the command fields in the pipeline YAML"
1028+
]
1029+
},
1030+
{
1031+
"cell_type": "code",
1032+
"execution_count": null,
1033+
"metadata": {},
1034+
"outputs": [],
1035+
"source": [
1036+
"!sed -i 's/\\\"command\\\": \\[\\]/\\\"command\\\": \\[python, -u, -m, kfp_component.launcher\\]/g' census_training_pipeline.yaml"
1037+
]
1038+
},
1039+
{
1040+
"cell_type": "code",
1041+
"execution_count": null,
1042+
"metadata": {},
1043+
"outputs": [],
1044+
"source": [
1045+
"!cat census_training_pipeline.yaml | grep \"component.launcher\""
1046+
]
1047+
},
1048+
{
1049+
"cell_type": "markdown",
1050+
"metadata": {},
1051+
"source": [
1052+
"You should see 6 lines in the output that were modified by the sed command."
1053+
]
1054+
},
10231055
{
10241056
"cell_type": "markdown",
10251057
"metadata": {},
@@ -1062,6 +1094,10 @@
10621094
"* For **Run Type** select **One-Off**\n",
10631095
"* Enter your **Project ID** and hit **Start**. You can now monitor your pipeline run in the UI (it will take about **10 minutes** to complete the run).\n",
10641096
"\n",
1097+
"\n",
1098+
"**NOTE that your pipeline run may fail due to the bug in a BigQuery component that does not handle certain race conditions. If you observe the pipeline failure, submit another pipeline run using the KFP UI using the steps above**\n",
1099+
"\n",
1100+
"\n",
10651101
"Now let's set up a recurring run:\n",
10661102
"* Select **Pipelines** then census_trainer_multiple_models and click **Create Run**\n",
10671103
"* In the **Experiement** field select **Default**\n",

0 commit comments

Comments
 (0)