Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl Monk, Perl Meditation

Re: Help performing "random" access on very very large file

by Moron (Curate)
on Jul 16, 2007 at 15:48 UTC ( #626867=note: print w/replies, xml ) Need Help??

in reply to Help performing "random" access on very very large file

Where the information exceeds what can be stored in memory, the most usual solution is some kind of DBMS. Relational databases are only semi-infeasible for this kind of data structure in the sense you could store say 100000 lines in a BLOB and index those - an approach talked about but I have never seen tried.

The most common custom DBMS structure is indeed flat-file-based as has been mentioned.

But the most useful Perl implementations of non-relational database architecture are probably going to be the DBM family of modules. In particular, DBM::Deep (which has an underlying flat-file storage) looks perfect for your requirement.


^M Free your mind!

  • Comment on Re: Help performing "random" access on very very large file

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://626867]
and all is quiet...

How do I use this? | Other CB clients
Other Users?
Others exploiting the Monastery: (4)
As of 2018-05-23 06:58 GMT
Find Nodes?
    Voting Booth?