Beefy Boxes and Bandwidth Generously Provided by pair Networks
Keep It Simple, Stupid

Re: Perl Threads and multi-core CPUs

by jbert (Priest)
on Sep 10, 2008 at 13:43 UTC ( #710355=note: print w/replies, xml ) Need Help??

in reply to Perl Threads and multi-core CPUs

Obviously the first things that come to mind are threads and forking. I wrote a version based on forking and it works fine but it is a RAM hog b/c when you fork, every new process is a copy of the parent and the parent in my case is quite large b/c it loads an AI model that consumes about 1GB of RAM.

You might want to check whether each child process has it's own copy of that 1Gbyte of data.

Have a look at the 'SHR' column in top to see how much memory is shared.

Otherwise, if the children don't need the AI model, you could try forking them before you load the model.

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://710355]
[Tanktalus]: Does anyone have a link to somewhere that explains why it's a bad idea to spit out text on stdout/stderr in the login scripts when it's a non-interactive shell?

How do I use this? | Other CB clients
Other Users?
Others having an uproarious good time at the Monastery: (7)
As of 2017-04-25 21:15 GMT
Find Nodes?
    Voting Booth?
    I'm a fool:

    Results (464 votes). Check out past polls.