Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl: the Markov chain saw
 
PerlMonks  

Re^5: Store a huge amount of data on disk

by zentara (Archbishop)
on Oct 19, 2011 at 16:34 UTC ( #932444=note: print w/ replies, xml ) Need Help??


in reply to Re^4: Store a huge amount of data on disk
in thread Store a huge amount of data on disk

but I'm curious if our filesystem will deal with this number of files an still stay maintainable.

See maximum number of files in an ext4 linux filesystem.

The limit is around 4 billion, 2^32 - 3, if the posts are correct, and maintaining usablility is a matter of handling sub-directory structure properly, setting ionode size, and other filesystem details. It seems doable for you. listing directories with 8 million files may interest you.


I'm not really a human, but I play one on earth.
Old Perl Programmer Haiku ................... flash japh


Comment on Re^5: Store a huge amount of data on disk

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://932444]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others about the Monastery: (7)
As of 2015-09-01 05:06 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    The oldest computer book still on my shelves (or on my digital media) is ...













    Results (367 votes), past polls