Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl Monk, Perl Meditation
 
PerlMonks  

Re^5: Store a huge amount of data on disk

by zentara (Archbishop)
on Oct 19, 2011 at 16:34 UTC ( #932444=note: print w/replies, xml ) Need Help??


in reply to Re^4: Store a huge amount of data on disk
in thread Store a huge amount of data on disk

but I'm curious if our filesystem will deal with this number of files an still stay maintainable.

See maximum number of files in an ext4 linux filesystem.

The limit is around 4 billion, 2^32 - 3, if the posts are correct, and maintaining usablility is a matter of handling sub-directory structure properly, setting ionode size, and other filesystem details. It seems doable for you. listing directories with 8 million files may interest you.


I'm not really a human, but I play one on earth.
Old Perl Programmer Haiku ................... flash japh
  • Comment on Re^5: Store a huge amount of data on disk

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://932444]
help
Chatterbox?
[marto]: Corion, not bringing the kids would make it ideal :P
[marto]: a suggestion, have one project in the list that isn't programming/perl related
[Corion]: marto: Yeah, things are more parent-friendly the way they are ;))
[marto]: some hardware/makey thing
[Corion]: marto: Ah, I'm currently drifting to that again, over"painting" (well with Inkscape) one of my photographs and thinking about vectorizing some other images ...
[marto]: Corion, yes something 'artistic', so that or some music. Even combine some things, build a musical instrument :)
[Corion]: marto: Naah, I'm avoiding that rabbit hole ;) Sometimes I think of using Perl to create MIDI to generate music, or at least the harmonies to which I could jam, but then that would eat even more into available time ;-))

How do I use this? | Other CB clients
Other Users?
Others exploiting the Monastery: (4)
As of 2017-07-27 07:47 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    I came, I saw, I ...
























    Results (404 votes). Check out past polls.