Beefy Boxes and Bandwidth Generously Provided by pair Networks Joe
Perl-Sensitive Sunglasses
 
PerlMonks  

Re: How to save memory, parsing a big file.

by dragonchild (Archbishop)
on Mar 01, 2006 at 10:17 UTC ( [id://533667]=note: print w/replies, xml ) Need Help??

This is an archived low-energy page for bots and other anonmyous visitors. Please sign up if you are a human and want to interact.


in reply to How to save memory, parsing a big file.

use DBM::Deep;
tie my %total, 'DBM::Deep', $filename;

[download]

Now, you're limited to disk size, not RAM size.

My criteria for good software:
  1. Does it work?
  2. Can someone else come in, make a change, and be reasonably certain no bugs were introduced?

Replies are listed 'Best First'.
Re^2: How to save memory, parsing a big file.
by perl_devel (Friar) on Mar 02, 2006 at 06:07 UTC
    Is there a way to hold the entire log contents itself in to some hash or array without utilising much memmory ,since the file size is too large
[reply]
      The node you replied to is the answer to your question. DBM::Deep is exactly the way to have a hash use disk instead of RAM.
      My criteria for good software:
      1. Does it work?
      2. Can someone else come in, make a change, and be reasonably certain no bugs were introduced?
[reply]

In Section Seekers of Perl Wisdom

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?

www.com | www.net | www.org
Node Status?
node history
Node Type: note [id://533667]
help
Sections?
Information?
Find Nodes?
Leftovers?
    Notices?
    • hippo‥ epoptai's answer Re: how do I set a cookie and redirect was blessed by hippo!
    • erzuuli‥ Anonymous Monks are no longer allowed to use Super Search, due to an excessive use of this resource by robots.