Beefy Boxes and Bandwidth Generously Provided by pair Networks
Pathologically Eclectic Rubbish Lister

Re: Performance Question

by jsegal (Friar)
on May 08, 2002 at 15:26 UTC ( #165067=note: print w/replies, xml ) Need Help??

in reply to Performance Question

I will second the notion that this is really more a systems issue than a perl issue.
Others have mentioned pre-sizing your destination file (which could help guarantee contiguous spacing on disk for the file), splitting the file into pieces and processing in parallel.
But what caught my eye that no one else has responded to (yet) is that you are reading and writing the file from the same disk. This means that for every physical read and write (which will depend on O/S-level buffering) your disk needs to seek. If there is any way you can read from one disk and write to another you should see some speedup there, too.
Best of luck,


Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://165067]
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others pondering the Monastery: (6)
As of 2020-04-01 18:17 GMT
Find Nodes?
    Voting Booth?
    The most amusing oxymoron is:

    Results (18 votes). Check out past polls.