Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl Monk, Perl Meditation
 
PerlMonks  

Re^2: Hashing Memory Usage

by awkmonk (Monk)
on Jul 14, 2006 at 10:26 UTC ( #561192=note: print w/ replies, xml ) Need Help??


in reply to Re: Hashing Memory Usage
in thread Hashing Memory Usage

I've come to that conclusion myself. The keys to my main hash are stupidly big, so as a quick fix I'm writing them to disk as individual files, containing just a unique number. I'm then using that number as the key. It has reduced the memory usage, but not by as much as I'd hoped.

Thanks one and all for your help on this.


'I think the problem lies in the fact that your data doesn't fit my program'.


Comment on Re^2: Hashing Memory Usage
Re^3: Hashing Memory Usage
by Anonymous Monk on Jul 14, 2006 at 19:30 UTC
    If you're dropping 256MB core files (the segment size in AIX), then you're essentially growing past the segment size and the -bmaxdata flag should fix the issue. I've been experiencing this recently and have not yet recompiled, but I am making many efficiency changes (true iterators have come in very handy) to combat the problem right now.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://561192]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others wandering the Monastery: (6)
As of 2014-07-30 04:09 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    My favorite superfluous repetitious redundant duplicative phrase is:









    Results (229 votes), past polls