Beefy Boxes and Bandwidth Generously Provided by pair Networks
Don't ask to ask, just ask
 
PerlMonks  

Re^5: Store a huge amount of data on disk

by zentara (Archbishop)
on Oct 19, 2011 at 16:34 UTC ( #932444=note: print w/ replies, xml ) Need Help??


in reply to Re^4: Store a huge amount of data on disk
in thread Store a huge amount of data on disk

but I'm curious if our filesystem will deal with this number of files an still stay maintainable.

See maximum number of files in an ext4 linux filesystem.

The limit is around 4 billion, 2^32 - 3, if the posts are correct, and maintaining usablility is a matter of handling sub-directory structure properly, setting ionode size, and other filesystem details. It seems doable for you. listing directories with 8 million files may interest you.


I'm not really a human, but I play one on earth.
Old Perl Programmer Haiku ................... flash japh


Comment on Re^5: Store a huge amount of data on disk

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://932444]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others meditating upon the Monastery: (8)
As of 2014-08-27 10:52 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    The best computer themed movie is:











    Results (237 votes), past polls