Beefy Boxes and Bandwidth Generously Provided by pair Networks
No such thing as a small change
 
PerlMonks  

Re^11: randomising file order returned by File::Find

by BrowserUk (Pope)
on Mar 02, 2011 at 00:25 UTC ( #890871=note: print w/ replies, xml ) Need Help??


in reply to Re^10: randomising file order returned by File::Find
in thread randomising file order returned by File::Find

even though you have not studied or tried Hadoop

I never said that. I said: "not so much".

You assumed that just because Hadoop is Java-based, you cannot use other languages within it.

I never said that, and certainly did not assume it. The monoculture--as I clearly said--is the filesystem, not the language it is written in.

What I do know--from experience--is that problems of scaling the largely IO-bound processing of huge volumes of small text records, is entirely different to that of scaling the largely CPU-bound processing of relatively small numbers of large to huge binary datasets. Ie. The OPs 3D brain images.

Your interpretation of my posts reflects your own assumptions more than mine.


Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
"Science is about questioning the status quo. Questioning authority".
In the absence of evidence, opinion is indistinguishable from prejudice.


Comment on Re^11: randomising file order returned by File::Find
Re^12: randomising file order returned by File::Find
by jeffa (Chancellor) on Mar 02, 2011 at 01:32 UTC

    Have you even tried Hadoop? Again, just because you claim that you have done similar things -- that is no substitute. Sorry if i upset you or something, but you really let your vanity show. I simply wanted to show that Hadoop is out there, free to use ... and you are rejecting it with your assumptions that your past experiences still apply. That is the mind set of an old dinosaur that is quickly becoming deprecated.

    Have you used Hadoop in production? Yes or no?

    jeffa

    L-LL-L--L-LL-L--L-LL-L--
    -R--R-RR-R--R-RR-R--R-RR
    B--B--B--B--B--B--B--B--
    H---H---H---H---H---H---
    (the triplet paradiddle with high-hat)
    
      Have you used Hadoop in production? Yes or no?

      Have you used Hadoop to process 3D image files in production is a far more relevant question?

      Even YouTube (Google) do not use Hadoop (map/reduce) for image processing. I'm simply countering your suggestion that Hadoop is a one-size-fits-all solution. It isn't. Hadoop is perfect for some things, but not the OPs task. It is all about choosing the right tool for the job.

      I'd remind you that you didn't "bring Hadoop to the OPs attention". You responded to my post and told me about it. All I've done is respond to your more and more intransigent assertions. The only vanity being displayed here is yours.


      Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
      "Science is about questioning the status quo. Questioning authority".
      In the absence of evidence, opinion is indistinguishable from prejudice.

        "I'm simply countering your suggestion that Hadoop is a one-size-fits-all solution."

        Oh i never said that. But since you did not answer "yes" nor "no" ... we can conclude that no, you have never used Hadoop in production.

        By the way ... did the OP ever specify exactly what kind of processing was needed? No. Not all image processing has to be CPU bound, after all. ;)

        jeffa

        L-LL-L--L-LL-L--L-LL-L--
        -R--R-RR-R--R-RR-R--R-RR
        B--B--B--B--B--B--B--B--
        H---H---H---H---H---H---
        (the triplet paradiddle with high-hat)
        

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://890871]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others contemplating the Monastery: (9)
As of 2014-08-22 07:21 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    The best computer themed movie is:











    Results (148 votes), past polls