Beefy Boxes and Bandwidth Generously Provided by pair Networks
Pathologically Eclectic Rubbish Lister
 
PerlMonks  

Re: Forking and running all child processes at the same time

by robartes (Priest)
on Jun 06, 2005 at 12:30 UTC ( #463890=note: print w/ replies, xml ) Need Help??


in reply to Forking and running all child processes at the same time

As an aside -- why do you think processing the log files in parallel will increase throughput? If the log parsing is I/O bound, you'll only generate more I/O contention and possibly even increase overall execution times. If the process is CPU bound, you will need to run this on a multi processor machine (of whatever flavour is available) to benefit. If it's a single processor machine, you'll only benefit if the parsing is just the right combination of I/O vs CPU bound, and then only if you keep the number of concurrent processes quite low.

So, in short, if you're not running on a multiprocessor machine, make sure that this is not a case of premature optimisation.

CU
Robartes-


Comment on Re: Forking and running all child processes at the same time

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://463890]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others scrutinizing the Monastery: (3)
As of 2015-07-05 09:42 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    The top three priorities of my open tasks are (in descending order of likelihood to be worked on) ...









    Results (61 votes), past polls