Beefy Boxes and Bandwidth Generously Provided by pair Networks
more useful options
 
PerlMonks  

Re: DB_File size limitations?

by archen (Pilgrim)
on Sep 21, 2004 at 14:01 UTC ( #392644=note: print w/ replies, xml ) Need Help??


in reply to DB_File size limitations?

If your system can't handle a file over 2Gb then what tilly says is probably going to be your only problem. Berkely DB should be able to handle a database into the terabytes, with key/values limited to 1-2 gigabytes. So realistically you will hit size restrictions on the hard drive before the database.

I created a utility to edit berkely db files and I was experiencing a similar issue. I'd add keys, then try to get a list of keys from 'keys %db' but I wasn't getting new keys, or sometimes I'd get ones that were deleted. Eventually I resolved this by doing a sync.

my $bdb = tie my %db .... $db{'new'} = 'stuff'; $bdb->sync();
Give that a try and see if it helps.


Comment on Re: DB_File size limitations?
Download Code
Re^2: DB_File size limitations?
by skazat (Hermit) on Sep 22, 2004 at 01:23 UTC

    That sounds like a great idea; and may relieve my problem. Hopefully I can get it to work on this program, since it's indirectly using the DB_File module via AnyDBM_File. I'm guessing I can wrap this call into a eval(), so if you try to run this code using a different DB file type (other than Berkeley DB) it won't produce an error.

    Still very weird how this is topping out at 10 megs instead of say, 2 gigs. I checked to see if this was an account quota issue (it wasn't)

     

    -justin simoni
    !skazat!

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://392644]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others contemplating the Monastery: (11)
As of 2014-10-31 21:02 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    For retirement, I am banking on:










    Results (224 votes), past polls