Re^3: No Performance gain with Parallel::ForkManager


P is for Practical
	PerlMonks

Re^3: No Performance gain with Parallel::ForkManager

by RichardK (Parson)

on Feb 23, 2014 at 17:59 UTC ( [id://1075899]=note: print w/replies, xml )

Need Help??

in reply to Re^2: No Performance gain with Parallel::ForkManager
in thread No Performance gain with Parallel::ForkManager

There's no need to be quite that verbose as Parallel::ForkManager handles the number of processes for you. So you can write that as :-

...
my $pm = Parallel::ForkManager->new($num_of_cores);
for my mp3 (@mp3s) {
   $pm->start and next;
   do_work($mp3);
   $pm->finish;
}
$pm->wait_all_children;
[download]

Comment on Re^3: No Performance gain with Parallel::ForkManager Download Code

Replies are listed 'Best First'.

Re^4: No Performance gain with Parallel::ForkManager
by McA (Priest) on Feb 23, 2014 at 18:29 UTC

Hi Richard,

am I wrong or does your solution fork a child per file found?

I wanted to give walto a snippet where I show how to spawn as many subprocesses as cores are available and the subprocesses working on a subqueue.

The verbose code tries to show that the subprocesses iterate over the initially created array in a way that they can "share" (*) this array without doing work twice. Have I overseen something?

UPDATE: It was an answer to the question "I can not find a simple way to split the loop into 2 (my no of cores) independent subprocesses...".

Best regards
McA

(*) It's a copy in the subprocess.

[reply]

In Section Seekers of Perl Wisdom