@@ -36,7 +36,6 @@ The solution consists in #1 a Google Spreadsheet (template) in which all rules a
3636 - ** Billing** enabled
3737 - ** BigQuery** enabled
3838 - ** Dataflow** enabled
39- - ** Datastore** enabled
4039 - ** Cloud storage** enabled
4140 - ** Cloud scheduler** enabled
4241- At least one of:
@@ -93,15 +92,15 @@ This bucket will hold the deployed code for this solution. To create it, navigat
9392To deploy, use the following command:
9493` ./deploy_cloud.sh project_id bucket_name region_name `
9594
96- ## Manually executing pipeline
95+ #### Manually executing pipeline using Dataflow UI
9796To execute the pipeline, use the following steps:
9897- Go to ** Dataflow** on GCP console
9998- Click on * Create job from template*
10099- On the template selection dropdown, select * Custom template*
101100- Find the * megalist* file on the bucket you've created, on the templates folder
102101- Fill in the parameters required and execute
103102
104- ## Scheduling pipeline
103+ ### Scheduling pipeline
105104To schedule daily/hourly runs, go to ** Cloud Scheduler** :
106105- Click on * create job*
107106- Add a name and frequency as desired
@@ -111,7 +110,7 @@ To schedule daily/hourly runs, go to **Cloud Scheduler**:
111110- Add OAuth Headers
112111- Scope: https://www.googleapis.com/auth/cloud-platform
113112
114- ## Creating a Service Account
113+ #### Creating a Service Account
115114It's recommended to create a new Service Account to be used with the Cloud Scheduler
116115- Go to IAM & Admin > Service Accounts
117116- Create a new Service Account with the following roles:
0 commit comments