Skip to content

Commit ac96ac9

Browse files
committed
Remove reference to dimension map and import day,month,year.
1 parent 1da1d3a commit ac96ac9

File tree

1 file changed

+0
-6
lines changed

1 file changed

+0
-6
lines changed

scripts/jobs/housing/housing_nec_migration_apply_gx_dq_tests.py

Lines changed: 0 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -90,9 +90,6 @@ def main():
9090

9191
results_df = pd.concat(table_results_df_list)
9292

93-
# map DQ dimension type
94-
results_df['dq_dimension_type'] = results_df['expectation_config.type'].map(dq_dimensions_map)
95-
9693
# add clean dataset name
9794
results_df['dataset_name'] = results_df['expectation_config.kwargs.batch_id'].map(
9895
lambda x: x.removeprefix('pandas-').removesuffix('_df_asset'))
@@ -118,9 +115,6 @@ def main():
118115
'expectation_config.kwargs.regex': 'string',
119116
'expectation_config.kwargs.value_set': 'string',
120117
'expectation_config.kwargs.column_list': 'string',
121-
'import_year': 'string',
122-
'import_month': 'string',
123-
'import_day': 'string',
124118
'import_date': 'string'}
125119

126120
# write to s3

0 commit comments

Comments
 (0)