Beefy Boxes and Bandwidth Generously Provided by pair Networks kudra
Perl Monk, Perl Meditation
 
PerlMonks  

Re: Parallel::ForkManager - machine way tooo slow - need a quad-core machine

by flexvault (Vicar)
on Oct 26, 2012 at 14:14 UTC ( #1001088=note: print w/ replies, xml ) Need Help??


in reply to Parallel::ForkManager - machine way tooo slow - need a quad-core machine

Perlbeginner1,

Only you know what size machine you need. I have never used 'Parallel::ForkManager', but I have used 'fork' on a lot of different *nix machines. So I'll give you some ideas to look at:

  • What does 'top' tell you when you run (1..10) scripts.
  • How are you connected to the Internet. If you don't have enough bandwidth you can add 1024 cores and it won't help.
  • How often do you have to check the URLs? Too often and you may be bounced by the URL's admins.

I've found that adding more than 4 forks per core starts slowing things down. But only you will know that after testing current performance.

Now if you really want that new 4-core machine, and you want our premission, then I'm all for it :-)

Good Luck!

"Well done is better than well said." - Benjamin Franklin


Comment on Re: Parallel::ForkManager - machine way tooo slow - need a quad-core machine

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1001088]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others drinking their drinks and smoking their pipes about the Monastery: (6)
As of 2014-04-16 23:47 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    April first is:







    Results (436 votes), past polls