Skip to content

Commit b0c0196

Browse files
authored
Merge pull request #2071 from LBHackney-IT/increase-tascomi-snapshot-memory
Add 8 workers to snapshot job
2 parents 831dcb6 + 37a07ec commit b0c0196

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

terraform/etl/24-aws-glue-tascomi-data.tf

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -264,7 +264,7 @@ module "tascomi_create_daily_snapshot" {
264264
job_name = "${local.short_identifier_prefix}tascomi_create_daily_snapshot_planning"
265265
glue_version = "2.0"
266266
glue_job_worker_type = "G.2X"
267-
number_of_workers_for_glue_job = 8
267+
number_of_workers_for_glue_job = 12
268268
helper_module_key = data.aws_s3_object.helpers.key
269269
pydeequ_zip_key = data.aws_s3_object.pydeequ.key
270270
spark_ui_output_storage_id = module.spark_ui_output_storage_data_source.bucket_id

0 commit comments

Comments
 (0)