but I'm curious if our filesystem will deal with this number of files an still stay maintainable.
in reply to Re^4: Store a huge amount of data on disk
in thread Store a huge amount of data on disk
See maximum number of files in an ext4 linux filesystem.
The limit is around 4 billion, 2^32 - 3, if the posts are correct, and maintaining usablility is a matter of handling sub-directory structure properly, setting ionode size, and other filesystem details. It seems doable for you.
listing directories with 8 million files may interest you.