Beefy Boxes and Bandwidth Generously Provided by pair Networks
We don't bite newbies here... much
 
PerlMonks  

Hadoop and perl

by InfiniteLoop (Hermit)
on May 08, 2008 at 17:16 UTC ( #685510=perlquestion: print w/replies, xml ) Need Help??
InfiniteLoop has asked for the wisdom of the Perl Monks concerning the following question:

Greetings Monks,
 This having been a boring week, I was catching up on http://hadoop.apache.org. A brief google search for perl interface(s) to hadoop came up with naught.
 My questions are: have you used hadoop ? Do you know of any way to use perl with hadoop ?

Replies are listed 'Best First'.
Re: Hadoop and perl
by jasonk (Parson) on May 08, 2008 at 18:01 UTC
      I've been looking into the same question (and the perl monks discussion ranks pretty high according to Google when you search for perl hadoop).

      The following ranks higher, and seems somewhat new (as of .20 of Hadoop...?)

      Hadoop Streaming

      Seems plausible to me, anyone have any experience using the streaming approach?

      Thanks!

      Ted

        I've added Hadoop::Streaming to cpan. This module aims to simplify the Streaming interface to Hadoop, by automating the input/output mapping. I found the initial module on github, then extended it with new features and tests and pushed it to CPAN.

        Please take a look and let me know how to make it more useful, especially to the new-to-hadoop and new-to-hadoop-streaming user! Specifically I've added new documentation to the root level Hadoop::Streaming, and I'd love feedback.

        Thank you,
        --spazm

Re: Hadoop and perl
by Anonymous Monk on May 09, 2008 at 02:30 UTC

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: perlquestion [id://685510]
Approved by Corion
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others examining the Monastery: (5)
As of 2019-03-22 16:51 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    How do you Carpe diem?





    Results (114 votes). Check out past polls.

    Notices?