Beefy Boxes and Bandwidth Generously Provided by pair Networks
laziness, impatience, and hubris
 
PerlMonks  

Re: search a large text file

by tilly (Archbishop)
on Feb 08, 2011 at 15:36 UTC ( #886998=note: print w/ replies, xml ) Need Help??


in reply to search a large text file

For previous discussion of this problem see statistics of a large text and Reaped: a large text file into hash.

As I pointed out to you in the previous discussions, this is likely to be slow. The next step that I suggested is to parallelize work with Hadoop. Have you tried that yet?


Comment on Re: search a large text file
Replies are listed 'Best First'.
Re^2: search a large text file
by BrowserUk (Pope) on Feb 08, 2011 at 17:31 UTC

    Doesn't hadoop require a cluster of servers and extensive software setup?

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://886998]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others examining the Monastery: (20)
As of 2015-07-31 14:02 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    The top three priorities of my open tasks are (in descending order of likelihood to be worked on) ...









    Results (278 votes), past polls