show progress on preprocessing jobs? #4
Description
Consider adding a counter and displaying e.g. "13 out of 50" to show current progress through zip jobs -- in log file or terminal or both.
Could (also) compute total estimated bytes by getting the size of each zip e.g. with bytecount = os.path.getsize(zipfile), adding them up, and then keeping a running progress of how much of the total bytecount has been worked through that is updated each time a zip completed. This would address the issue that some zips are hundreds or thousands of times larger than others.
https://stackoverflow.com/questions/6591931/getting-file-size-in-python