Beefy Boxes and Bandwidth Generously Provided by pair Networks
more useful options
 
PerlMonks  

Re: Splitting large array for threads.

by biohisham (Priest)
on Jun 15, 2014 at 04:22 UTC ( #1089917=note: print w/ replies, xml ) Need Help??


in reply to Splitting large array for threads.

Chunking will definitely reduce the IPC overhead. If you are sure that none of the 4 million entries in the array is causing an error that makes your program stall then you can consider chunking.

The MCE module has a direct chukning implementation you might want to explore




Comment on Re: Splitting large array for threads.
Download Code
Re^2: Splitting large array for threads.
by marioroy (Monk) on Dec 13, 2014 at 03:35 UTC
    Here is the link https://metacpan.org/pod/MCE

    MCE 1.513 was moved to backpan some time back.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1089917]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others having an uproarious good time at the Monastery: (5)
As of 2015-07-07 01:52 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    The top three priorities of my open tasks are (in descending order of likelihood to be worked on) ...









    Results (86 votes), past polls