Beefy Boxes and Bandwidth Generously Provided by pair Networks
XP is just a number
 
PerlMonks  

Re: fetchall_arrayref batches and forking

by NetWallah (Abbot)
on May 07, 2013 at 22:58 UTC ( #1032540=note: print w/ replies, xml ) Need Help??


in reply to fetchall_arrayref batches and forking

It looks like you want to process a large set of database chunks, in sets of 14.

This fits the "single queue, multiple server" model, and BrowserUk has a thread-based implementation that can help. Please see the discussion in dynamic number of threads based on CPU utilization. Look for his code for his "threads::Q implementation".

             "I'm fairly sure if they took porn off the Internet, there'd only be one website left, and it'd be called 'Bring Back the Porn!'"
        -- Dr. Cox, Scrubs


Comment on Re: fetchall_arrayref batches and forking
Re^2: fetchall_arrayref batches and forking
by mogmismo (Novice) on May 14, 2013 at 13:48 UTC
    Thanks, I'll take a look at those resource.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1032540]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others browsing the Monastery: (13)
As of 2014-11-21 16:46 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    My preferred Perl binaries come from:














    Results (114 votes), past polls