Beefy Boxes and Bandwidth Generously Provided by pair Networks
Just another Perl shrine
 
PerlMonks  

Re: Perl Threads and multi-core CPUs

by jbert (Priest)
on Sep 10, 2008 at 13:43 UTC ( [id://710355]=note: print w/replies, xml ) Need Help??


in reply to Perl Threads and multi-core CPUs

Obviously the first things that come to mind are threads and forking. I wrote a version based on forking and it works fine but it is a RAM hog b/c when you fork, every new process is a copy of the parent and the parent in my case is quite large b/c it loads an AI model that consumes about 1GB of RAM.

You might want to check whether each child process has it's own copy of that 1Gbyte of data.

Have a look at the 'SHR' column in top to see how much memory is shared.

Otherwise, if the children don't need the AI model, you could try forking them before you load the model.

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://710355]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others contemplating the Monastery: (6)
As of 2024-04-16 09:44 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found