GTS: EC2: Process NGAP Manifests on EC2

[krisstanton]

• Complete Ticket GTS: EC2: Local Storage Setup and DynamoDB interface #506
• Complete Ticket GTS: EC2: Transfer Data from DynamoDB to Local EC2 #521
• Note: Moved the checkboxes for Data Transfer to their own ticket (GTS: EC2: Transfer Data from DynamoDB to Local EC2 #521)
• Couple of missed DB Interaction functions
  • Update Local SQLite DB from DynamoDB Scan (Only tries to insert a new row if one is not found)
• Script to process NGAP Prod Manifests
  • Write Workflow interface control code
  • Script to read the manifests and process them down to only their CMR files
  • Code to Update Local DB files for all manifest items found
  • (Still converting draft to steps)
    DRAFT
    -Process NGAP Prod Manifests (Prod and Orca) - Script to read the manifests and process them down to only their CMR files (the CMR files represent a single granule in it's entirety, this reduces the size of the storage and processing by nearly 85%!)
    -- The NGAP Manifests for PROD and ORCA are both being sent to MCP - so they should be able to be read locally from this EC2 instance with relative ease.
    -Sync Manifests to local datastore - Script to Read the Manifest CMR files list and update the local database (by finding the record) - Updating the checkbox