http://www.perlmonks.org?node_id=11136719


in reply to Re: Automatic zip and delete
in thread Automatic zip and delete

It is a local copy of a file that is archived elsewhere. these files are all plain text, so they compress to about 10% of the original size.
there are dozens of jobs that were written to download these files, extract the relevant data out of them, and then they just leave the original file behind, hence the need for a bulk zip/delete.
I want to keep some of the original files (1 file out of every 8), as the system they are downloaded from purges them on a schedule, so a small sampling of the files gives a history as to how the data has changed over time.