zipped dv5-large log

[JinZhou5042]

Now files under 100MB are uploaded as is and those larger than 100MB are zipped by gzip -9.

If the zipped file is still larger than 100MB, it will be chunked into a series of smaller files.

For example, this is the directory view under dv5-large:

(dv5) [jzhou24@condorfe vine-logs]$ l
total 383M
-rw-r--r--+ 1 jzhou24 jzhou24 98M Oct  8 14:01 debug_00.gz
-rw-r--r--+ 1 jzhou24 jzhou24 74M Oct  8 14:01 debug_01.gz
-rw-r--r--+ 1 jzhou24 jzhou24 70M Oct  8 13:57 performance
-rw-r--r--+ 1 jzhou24 jzhou24 84M Oct  8 13:57 taskgraph
-rw-r--r--+ 1 jzhou24 jzhou24 57M Oct  8 14:02 transactions.gz
-rw-r--r--+ 1 jzhou24 jzhou24 587 Oct  8 13:57 workflow.json