Beefy Boxes and Bandwidth Generously Provided by pair Networks
Keep It Simple, Stupid
 
PerlMonks  

Re^2: How do you parallelize STDIN for large file processing?

by weismat (Friar)
on Feb 06, 2009 at 09:05 UTC ( #741836=note: print w/ replies, xml ) Need Help??


in reply to Re: How do you parallelize STDIN for large file processing?
in thread How do you parallelize STDIN for large file processing?

The problem is that every worker writes to the file.
As written before you should bundle the writting in one seperate thread so that you need no symchronisation for the file.


Comment on Re^2: How do you parallelize STDIN for large file processing?
Re^3: How do you parallelize STDIN for large file processing?
by sagarika (Novice) on Aug 30, 2011 at 09:28 UTC

    Hi,

    I have kind of similar need. Can you please paste some sample and easy (as I am not a pro in perl) code; how can I bundle the writing in one separate thread ?

      This is not a code writing service. You will have to show the relevant parts of your existing Perl code and tell us how it does not work and where the bottleneck is.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://741836]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others exploiting the Monastery: (3)
As of 2014-10-22 03:50 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    For retirement, I am banking on:










    Results (112 votes), past polls