Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl Monk, Perl Meditation
 
PerlMonks  

Re: system "gzip $full_name" is taking more time

by taint (Chaplain)
on Dec 08, 2013 at 10:53 UTC ( #1066204=note: print w/ replies, xml ) Need Help??


in reply to system "gzip $full_name" is taking more time

Something else occurred to me, after making my last response. That I think will help you greatly in more ways than one.

Consider "batching" the jobs/tasks. For example, concat a list of the files that will be processed; for tests for timing, and, more importantly, within your current script. You should end up with a much more efficient process, overall. This way, you can batch the tar command -- concat the file names, and dump the list on tar. The same goes for the rest. Slurping up a list should be pretty easy, and pretty quick. In short attempt to consolidate as much as possible.

Best wishes.

--Chris

Hey. I'm not completely useless. I can be used as a bad example.


Comment on Re: system "gzip $full_name" is taking more time

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1066204]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others exploiting the Monastery: (6)
As of 2015-07-29 05:36 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    The top three priorities of my open tasks are (in descending order of likelihood to be worked on) ...









    Results (260 votes), past polls