The bash in zip-and-upload.sh could be substantially reduced by implementing functions and loops. Much of the copy-paste is left over from POC during development of the snapshot engine. Our velocity has been towards incremental features and not so much about tech-debt/improvements so that is why this is still the way it is.
Specifically there could be a metadata, LZ4/upload functions and loops that would reduce the lines of code by the 100s.