Beefy Boxes and Bandwidth Generously Provided by pair Networks
Welcome to the Monastery
 
PerlMonks  

Re^14: randomising file order returned by File::Find

by jeffa (Chancellor)
on Mar 02, 2011 at 02:51 UTC ( #890886=note: print w/ replies, xml ) Need Help??


in reply to Re^13: randomising file order returned by File::Find
in thread randomising file order returned by File::Find

"I'm simply countering your suggestion that Hadoop is a one-size-fits-all solution."

Oh i never said that. But since you did not answer "yes" nor "no" ... we can conclude that no, you have never used Hadoop in production.

By the way ... did the OP ever specify exactly what kind of processing was needed? No. Not all image processing has to be CPU bound, after all. ;)

jeffa

L-LL-L--L-LL-L--L-LL-L--
-R--R-RR-R--R-RR-R--R-RR
B--B--B--B--B--B--B--B--
H---H---H---H---H---H---
(the triplet paradiddle with high-hat)


Comment on Re^14: randomising file order returned by File::Find
Select or Download Code
Re^15: randomising file order returned by File::Find
by BrowserUk (Pope) on Mar 02, 2011 at 03:02 UTC
    But since you did not answer "yes" nor "no" ... we can conclude that no, you have never used Hadoop in production.

    And since you've completely failed to respond to any of the reasons why Hadoop is inappropriate for the task at hand we can conclude that you don't have a clue about image processing.

    Simply a case of the hammer wielder seeing everything as a nail. Last year it was "use a database"; this year "ooh, ooh, ooh, Hadoop" regardless of the problem, and next year it'll no doubt be Node:js.


    Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
    "Science is about questioning the status quo. Questioning authority".
    In the absence of evidence, opinion is indistinguishable from prejudice.

      "Last year it was "use a database"; this year "ooh, ooh, ooh, Hadoop""

      Just pointing out that you are rejecting technology unfairly. Without even having tried it. Which you have not, even though you tailor your language to imply that you have.

      jeffa

      L-LL-L--L-LL-L--L-LL-L--
      -R--R-RR-R--R-RR-R--R-RR
      B--B--B--B--B--B--B--B--
      H---H---H---H---H---H---
      (the triplet paradiddle with high-hat)
      

        I've not rejected Hadoop. I even suggested it here a couple of weeks ago.

        I'm simply not recommending it for this as it is inappropriate. To summarise: You cannot force fit variable size and (typically huge) 3D image files into fix-sized aggregated packets; nor can you process images line-by-line from STDIN as is required by Hadoop streaming.

        I'm not rejecting the tool; I'm reject the suggestion for mis-application of that tool. The OP reads and makes up his own mind on the matter.


        Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
        "Science is about questioning the status quo. Questioning authority".
        In the absence of evidence, opinion is indistinguishable from prejudice.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://890886]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others cooling their heels in the Monastery: (16)
As of 2014-10-23 19:42 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    For retirement, I am banking on:










    Results (128 votes), past polls