Beefy Boxes and Bandwidth Generously Provided by pair Networks
Problems? Is your data what you think it is?
 
PerlMonks  

Re^2: Hash key or value string reuse?

by QM (Vicar)
on Jun 16, 2009 at 21:11 UTC ( #772141=note: print w/ replies, xml ) Need Help??


in reply to Re: Hash key or value string reuse?
in thread Hash key or value string reuse?

How big is yours and why do you think you need to reduce its size?
I have a hash on disk that exceeds 42GB. I use a hash to avoid duplicates. Walking the hash through DBM::Deep takes about 5x longer than the equivalent memory hash. Of course, I haven't tried it on one this big, so it's much likely worse.

There isn't any super tricky thing that "re-uses" strings via a pointer to that string.
Thanks. I was just wondering if Perl already did this for me. Since that's not the case, it might be worth a try.

-QM
--
Quantum Mechanics: The dreams stuff is made of


Comment on Re^2: Hash key or value string reuse?

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://772141]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others perusing the Monastery: (5)
As of 2015-07-03 03:34 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    The top three priorities of my open tasks are (in descending order of likelihood to be worked on) ...









    Results (48 votes), past polls