Glue Operator - Update Job and Tags issue

[niroam]

airflow/providers/amazon/src/airflow/providers/amazon/aws/hooks/glue.py

Line 463 in 3c21637

def update_job(self, **job_kwargs) -> bool:

Hi Team,

When creating and running a new Glue Job via this operator
e.g
GlueJobOperator_1765238188320 = GlueJobOperator(
task_id='job-task',
job_name='mygluejob,
script_location='test.py',
s3_bucket='mys3bucket',
create_job_kwargs={
'GlueVersion': GLUE_JOB_CONFIG['GlueVersion'],
'NumberOfWorkers': GLUE_JOB_CONFIG['NumberOfWorkers'],
'WorkerType': GLUE_JOB_CONFIG['WorkerType'],
'Timeout': GLUE_JOB_CONFIG['Timeout'],
'MaxRetries': GLUE_JOB_CONFIG['MaxRetries'],
'ExecutionClass': GLUE_JOB_CONFIG['ExecutionClass'],
'Command': GLUE_JOB_CONFIG['Command'],
'DefaultArguments': GLUE_JOB_CONFIG['DefaultArguments'],
'Connections': GLUE_JOB_CONFIG['Connections'],
'Tags': GLUE_JOB_CONFIG['Tags']
},
iam_role_arn=project.iam_role,
update_config=True
)

the boto3 create_job supports Tags, however update_job does not

should we be removing these from the args in our update job method in the airflow operator ? do we need a seperate check on tags changing here ?

[boring-cyborg[bot]]

Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.

[potiuk]

This is not an issue, more of a question - converted it to a discussion (as all such questions should be) - hopefully someone will be able to answer