Beefy Boxes and Bandwidth Generously Provided by pair Networks
laziness, impatience, and hubris
 
PerlMonks  

Re: Can Perl write multiple files at the same time? Yes of course, but...

by Discipulus (Canon)
on Oct 21, 2014 at 06:51 UTC ( [id://1104523]=note: print w/replies, xml ) Need Help??


in reply to Can Perl write multiple files at the same time?

as said you can but, if i understand well you are experiencing low performance writing to an USB drive: this is quite normal i dont think that multiple threads can resolve the slowness.

A decent write speed can be around 4Mb/s (and up to 46Mb/s) but for large files. If you are writing many little files performance drop down drastically. Maybe multiple threads for small files can result in less speed then sequential write.

You can find more numbers here and here too

HtH
L*
There are no rules, there are no thumbs..
Reinvent the wheel, then learn The Wheel; may be one day you reinvent one of THE WHEELS.

Replies are listed 'Best First'.
Re^2: Can Perl write multiple files at the same time? Yes of course, but...
by no_slogan (Deacon) on Oct 21, 2014 at 07:13 UTC
    I assumed the OP was writing several different files to several different USB drives, in which case you might be able to get an improvement.

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://1104523]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others examining the Monastery: (5)
As of 2024-03-29 12:15 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found