Beefy Boxes and Bandwidth Generously Provided by pair Networks
The stupid question is the question not asked

Re^3: Sorting Numbers & Text

by johngg (Abbot)
on Jul 12, 2012 at 22:25 UTC ( #981522=note: print w/ replies, xml ) Need Help??

in reply to Re^2: Sorting Numbers & Text
in thread Sorting Numbers & Text

Another approach might be to read chunks of your very large database, perhaps 100k to 500k records at a time, and sort each chunk into its own temporary file. Once you have read and sorted all of the data, do a sort/merge of the temporary files into a final sorted file. My gut feeling is that this would be more efficient than the "two at a time" approach you are taking.



Comment on Re^3: Sorting Numbers & Text

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://981522]
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others cooling their heels in the Monastery: (4)
As of 2015-11-26 05:43 GMT
Find Nodes?
    Voting Booth?

    What would be the most significant thing to happen if a rope (or wire) tied the Earth and the Moon together?

    Results (696 votes), past polls