Beefy Boxes and Bandwidth Generously Provided by pair Networks
No such thing as a small change
 
PerlMonks  

Re: Parallel::ForkManager - machine way tooo slow - need a quad-core machine

by flexvault (Prior)
on Oct 26, 2012 at 14:14 UTC ( #1001088=note: print w/ replies, xml ) Need Help??


in reply to Parallel::ForkManager - machine way tooo slow - need a quad-core machine

Perlbeginner1,

Only you know what size machine you need. I have never used 'Parallel::ForkManager', but I have used 'fork' on a lot of different *nix machines. So I'll give you some ideas to look at:

  • What does 'top' tell you when you run (1..10) scripts.
  • How are you connected to the Internet. If you don't have enough bandwidth you can add 1024 cores and it won't help.
  • How often do you have to check the URLs? Too often and you may be bounced by the URL's admins.

I've found that adding more than 4 forks per core starts slowing things down. But only you will know that after testing current performance.

Now if you really want that new 4-core machine, and you want our premission, then I'm all for it :-)

Good Luck!

"Well done is better than well said." - Benjamin Franklin


Comment on Re: Parallel::ForkManager - machine way tooo slow - need a quad-core machine

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1001088]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others chilling in the Monastery: (7)
As of 2015-08-01 00:47 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    The top three priorities of my open tasks are (in descending order of likelihood to be worked on) ...









    Results (285 votes), past polls