Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl-Sensitive Sunglasses
 
PerlMonks  

Re^2: How do you parallelize STDIN for large file processing?

by weismat (Friar)
on Feb 06, 2009 at 09:05 UTC ( #741836=note: print w/ replies, xml ) Need Help??


in reply to Re: How do you parallelize STDIN for large file processing?
in thread How do you parallelize STDIN for large file processing?

The problem is that every worker writes to the file.
As written before you should bundle the writting in one seperate thread so that you need no symchronisation for the file.


Comment on Re^2: How do you parallelize STDIN for large file processing?
Re^3: How do you parallelize STDIN for large file processing?
by sagarika (Novice) on Aug 30, 2011 at 09:28 UTC

    Hi,

    I have kind of similar need. Can you please paste some sample and easy (as I am not a pro in perl) code; how can I bundle the writing in one separate thread ?

      This is not a code writing service. You will have to show the relevant parts of your existing Perl code and tell us how it does not work and where the bottleneck is.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://741836]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others making s'mores by the fire in the courtyard of the Monastery: (5)
As of 2014-07-29 00:16 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    My favorite superfluous repetitious redundant duplicative phrase is:









    Results (210 votes), past polls