Beefy Boxes and Bandwidth Generously Provided by pair Networks
"be consistent"
 
PerlMonks  

Re^2: statistics of a large text

by perl_lover_always (Acolyte)
on Feb 08, 2011 at 11:05 UTC ( #886922=note: print w/replies, xml ) Need Help??


in reply to Re: statistics of a large text
in thread statistics of a large text

Hi Is there anyway to skip the sort part! linux sort (with -d and -f) options takes a long time to run! how could I scape that?

Replies are listed 'Best First'.
Re^3: statistics of a large text
by tilly (Archbishop) on Feb 08, 2011 at 15:32 UTC
    No, there isn't. Sorting does the actual work, and therefore takes the bulk of the time. If it is too slow, then it is time for you to look into distributing (and parallelizing) the work with Hadoop.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://886922]
help
Chatterbox?
[Discipulus]: Lady_Aleena use Great::Flood really, start some little project with new eyes (and a DB)
[Discipulus]: 'unless it rains' => 'a meno che NON piova'
erix is always in favour of code-revolutions
[Lady_Aleena]: Well, right now, I"m looking at modules where I put randomness that aren't in my RolePlaying/Random dir, like RolePlaying:: Character:: Alignment that is mostly about random_alignment than expand_alignment.

How do I use this? | Other CB clients
Other Users?
Others drinking their drinks and smoking their pipes about the Monastery: (4)
As of 2017-05-27 20:32 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?