Beefy Boxes and Bandwidth Generously Provided by pair Networks
There's more than one way to do things
 
PerlMonks  

Re^2: How do you parallelize STDIN for large file processing?

by weismat (Friar)
on Feb 06, 2009 at 09:05 UTC ( #741836=note: print w/replies, xml ) Need Help??


in reply to Re: How do you parallelize STDIN for large file processing?
in thread How do you parallelize STDIN for large file processing?

The problem is that every worker writes to the file.
As written before you should bundle the writting in one seperate thread so that you need no symchronisation for the file.
  • Comment on Re^2: How do you parallelize STDIN for large file processing?

Replies are listed 'Best First'.
Re^3: How do you parallelize STDIN for large file processing?
by sagarika (Novice) on Aug 30, 2011 at 09:28 UTC

    Hi,

    I have kind of similar need. Can you please paste some sample and easy (as I am not a pro in perl) code; how can I bundle the writing in one separate thread ?

      This is not a code writing service. You will have to show the relevant parts of your existing Perl code and tell us how it does not work and where the bottleneck is.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://741836]
help
Chatterbox?
and all is quiet...

How do I use this? | Other CB clients
Other Users?
Others meditating upon the Monastery: (4)
As of 2016-12-03 16:55 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    On a regular basis, I'm most likely to spy upon:













    Results (56 votes). Check out past polls.