s what Hadoop gives you for free.
It isn't free if you don't already have the cluster set up to use it.
And once you've gone through the cluster set-up process, just in order to deliver a couple of hundred k of filenames to the clients, they still have to get access to each of the huge image files, which they cannot do in-situ, they would have to be shipped to the local HDFS filesystem. And then Hadoop has nothing whatsoever to offer in the processing of that file.
And if you can think of some legitimate reason for going through all of that in order to distribute a few thousand filenames...
Let's face it. Your suggestion is a crock.
|Comment on Re^19: randomising file order returned by File::Find|
|Re^20: randomising file order returned by File::Find|
by jeffa (Chancellor) on Mar 02, 2011 at 04:35 UTC