Re: Best Practices for Uncompressing/Recompressing Files?

[coreolyn]

Just to make sure the obvious wasn't overlooked; Make sure you are running gzip silently. The overhead created by STDOUT on the zip/unzip process is significant

coreolyn

[sauoq]

Make sure you are running gzip silently. The overhead created by STDOUT on the zip/unzip process is significant

Uhh . . . huh?

Even with --verbose, gzip only prints one line for every file it processes. That's hardly what I'd call significant. Especially not in a case like this where each file averages 200M of uncompressed data!

-sauoq
"My two cents aren't worth a dime.";

[coreolyn]

Unfortunatley I don't have time to write a benchmark but can only speak from expirience. On one large tar & zip routine that we run here in production we shaved 15 seconds off the operation just by going silent

coreolyn