Beefy Boxes and Bandwidth Generously Provided by pair Networks
go ahead... be a heretic

Re: Perl Threads and multi-core CPUs

by jbert (Priest)
on Sep 10, 2008 at 13:43 UTC ( #710355=note: print w/replies, xml ) Need Help??

in reply to Perl Threads and multi-core CPUs

Obviously the first things that come to mind are threads and forking. I wrote a version based on forking and it works fine but it is a RAM hog b/c when you fork, every new process is a copy of the parent and the parent in my case is quite large b/c it loads an AI model that consumes about 1GB of RAM.

You might want to check whether each child process has it's own copy of that 1Gbyte of data.

Have a look at the 'SHR' column in top to see how much memory is shared.

Otherwise, if the children don't need the AI model, you could try forking them before you load the model.

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://710355]
[ambrus]: must be this earthquake
[ambrus]: (It's convenient that I live in a place with no earthquakes or hurricanes. One less bad thing to look out for.)

How do I use this? | Other CB clients
Other Users?
Others pondering the Monastery: (5)
As of 2017-01-18 12:46 GMT
Find Nodes?
    Voting Booth?
    Do you watch meteor showers?

    Results (161 votes). Check out past polls.