Beefy Boxes and Bandwidth Generously Provided by pair Networks
Think about Loose Coupling
 
PerlMonks  

Re^10: randomising file order returned by File::Find

by jeffa (Chancellor)
on Mar 01, 2011 at 23:48 UTC ( #890869=note: print w/ replies, xml ) Need Help??


in reply to Re^9: randomising file order returned by File::Find
in thread randomising file order returned by File::Find

"Who's assuming here?"

Surely we both are, but you seem to act like even though you have not studied or tried Hadoop, you know everything about it. You assumed that just because Hadoop is Java-based, you cannot use other languages within it. You also seem to assume that you know better than Hadoop, and, if true, that is just being vain. Cheers! :)

Update: I guess my mistake was assuming you actually cared about new technology that Perl can be a part of.

jeffa

L-LL-L--L-LL-L--L-LL-L--
-R--R-RR-R--R-RR-R--R-RR
B--B--B--B--B--B--B--B--
H---H---H---H---H---H---
(the triplet paradiddle with high-hat)


Comment on Re^10: randomising file order returned by File::Find
Select or Download Code
Re^11: randomising file order returned by File::Find
by BrowserUk (Pope) on Mar 02, 2011 at 00:25 UTC
    even though you have not studied or tried Hadoop

    I never said that. I said: "not so much".

    You assumed that just because Hadoop is Java-based, you cannot use other languages within it.

    I never said that, and certainly did not assume it. The monoculture--as I clearly said--is the filesystem, not the language it is written in.

    What I do know--from experience--is that problems of scaling the largely IO-bound processing of huge volumes of small text records, is entirely different to that of scaling the largely CPU-bound processing of relatively small numbers of large to huge binary datasets. Ie. The OPs 3D brain images.

    Your interpretation of my posts reflects your own assumptions more than mine.


    Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
    "Science is about questioning the status quo. Questioning authority".
    In the absence of evidence, opinion is indistinguishable from prejudice.

      Have you even tried Hadoop? Again, just because you claim that you have done similar things -- that is no substitute. Sorry if i upset you or something, but you really let your vanity show. I simply wanted to show that Hadoop is out there, free to use ... and you are rejecting it with your assumptions that your past experiences still apply. That is the mind set of an old dinosaur that is quickly becoming deprecated.

      Have you used Hadoop in production? Yes or no?

      jeffa

      L-LL-L--L-LL-L--L-LL-L--
      -R--R-RR-R--R-RR-R--R-RR
      B--B--B--B--B--B--B--B--
      H---H---H---H---H---H---
      (the triplet paradiddle with high-hat)
      
        Have you used Hadoop in production? Yes or no?

        Have you used Hadoop to process 3D image files in production is a far more relevant question?

        Even YouTube (Google) do not use Hadoop (map/reduce) for image processing. I'm simply countering your suggestion that Hadoop is a one-size-fits-all solution. It isn't. Hadoop is perfect for some things, but not the OPs task. It is all about choosing the right tool for the job.

        I'd remind you that you didn't "bring Hadoop to the OPs attention". You responded to my post and told me about it. All I've done is respond to your more and more intransigent assertions. The only vanity being displayed here is yours.


        Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
        "Science is about questioning the status quo. Questioning authority".
        In the absence of evidence, opinion is indistinguishable from prejudice.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://890869]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others lurking in the Monastery: (9)
As of 2014-12-27 19:54 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    Is guessing a good strategy for surviving in the IT business?





    Results (177 votes), past polls