Beefy Boxes and Bandwidth Generously Provided by pair Networks
Do you know where your variables are?
 
PerlMonks  

Re: Parallel::ForkManager - machine way tooo slow - need a quad-core machine

by flexvault (Monsignor)
on Oct 26, 2012 at 14:14 UTC ( #1001088=note: print w/ replies, xml ) Need Help??


in reply to Parallel::ForkManager - machine way tooo slow - need a quad-core machine

Perlbeginner1,

Only you know what size machine you need. I have never used 'Parallel::ForkManager', but I have used 'fork' on a lot of different *nix machines. So I'll give you some ideas to look at:

  • What does 'top' tell you when you run (1..10) scripts.
  • How are you connected to the Internet. If you don't have enough bandwidth you can add 1024 cores and it won't help.
  • How often do you have to check the URLs? Too often and you may be bounced by the URL's admins.

I've found that adding more than 4 forks per core starts slowing things down. But only you will know that after testing current performance.

Now if you really want that new 4-core machine, and you want our premission, then I'm all for it :-)

Good Luck!

"Well done is better than well said." - Benjamin Franklin

  • Comment on Re: Parallel::ForkManager - machine way tooo slow - need a quad-core machine

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1001088]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others cooling their heels in the Monastery: (12)
As of 2016-06-28 15:28 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    My preferred method of making French fries (chips) is in a ...











    Results (359 votes). Check out past polls.