GTS: EC2: Run the continuous Auto Deletes

[krisstanton]

Draft

• Get a Granule and S3 File count from MCP before running this
• IMPORTANT: Verify with Management before running
• Use the sqlite db to delete the redundant, already ingested and verified granules from the source delivery MCP bucket.
  • Note: get the list of files to delete by reading off the Dynamo DB Granule ID (and it's columns which represent each file -- only for the verified already ingested granules)
  • Note: May need to run this in batches or by Dataset Type, or even DatasetType and Year
• Monitor the progress.
• Get a Granule and S3 File count after the process is done