Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl: the Markov chain saw
 
PerlMonks  

Re: memory issues

by Anonymous Monk
on Jan 28, 2013 at 09:08 UTC ( #1015647=note: print w/replies, xml ) Need Help??


in reply to memory issues

Why is this happening?

You wrote it that way, you're storing that much data in memory

Observe

$ perl -MDevel::Size=:all -le " @F = 1 .. (5 * 30 * 1024 ); @F{@F}=@F +; print total_size($_) for \@F, \%F " 6758436 13225503

5 files, 30k lines each, stored in hash, and stored in array, 6.5MiB and 13MiB respectively ( 19.5MiB combined)

You actually store three times as much data, mostly duplicated

The solution, store less data, store data on disk, get a better system, or lift ulimits on your account

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1015647]
help
Chatterbox?
[Corion]: :-D
[Corion]: I look forward to your chat client - that should be an interesting example of HTTP / asynchronous stuff

How do I use this? | Other CB clients
Other Users?
Others cooling their heels in the Monastery: (4)
As of 2017-09-24 14:35 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    During the recent solar eclipse, I:









    Results (274 votes). Check out past polls.

    Notices?