Performance: Load loop needs to be parallelized somehow

[Riskjuggler]

Single threading the load to the DB makes the system running the script as the constraint.

Need to figure out how to create parallel processing somewhere to bring down the time to run.

[Riskjuggler]

Save for v 1.2

[Riskjuggler]

Cache the log lines and don't write till you can also write the timeDiff to save 2nd loop of reads and updates.

[Riskjuggler]

Use nested dict to create a short dictionary by timestamp and then pop to doc content (dict) to remove when loaded to DB to save space and keep cost down .