Beefy Boxes and Bandwidth Generously Provided by pair Networks
Syntactic Confectionery Delight
 
PerlMonks  

Re: fetchall_arrayref batches and forking

by NetWallah (Abbot)
on May 07, 2013 at 22:58 UTC ( #1032540=note: print w/ replies, xml ) Need Help??


in reply to fetchall_arrayref batches and forking

It looks like you want to process a large set of database chunks, in sets of 14.

This fits the "single queue, multiple server" model, and BrowserUk has a thread-based implementation that can help. Please see the discussion in dynamic number of threads based on CPU utilization. Look for his code for his "threads::Q implementation".

             "I'm fairly sure if they took porn off the Internet, there'd only be one website left, and it'd be called 'Bring Back the Porn!'"
        -- Dr. Cox, Scrubs


Comment on Re: fetchall_arrayref batches and forking
Replies are listed 'Best First'.
Re^2: fetchall_arrayref batches and forking
by mogmismo (Novice) on May 14, 2013 at 13:48 UTC
    Thanks, I'll take a look at those resource.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1032540]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others meditating upon the Monastery: (18)
As of 2015-07-30 13:35 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    The top three priorities of my open tasks are (in descending order of likelihood to be worked on) ...









    Results (271 votes), past polls