Beefy Boxes and Bandwidth Generously Provided by pair Networks
We don't bite newbies here... much

Re: "Out of memory" problem

by kennethk (Abbot)
on Nov 30, 2012 at 21:49 UTC ( #1006524=note: print w/ replies, xml ) Need Help??

in reply to "Out of memory" problem

I assume that by citing merge sort, you are using native sort -- it will certainly have a smaller footprint than a homebrew solution. If you can't do it all in memory, have you considering using the divide and conquer algorithm that underlies merge sort and start by breaking the file into chunks, interleaving the final rounds with explicit file read/writes? As well, you may consider loading the data into an actual database for handling it. See Sorting data that don't fit in memory.

#11929 First ask yourself `How would I do this without a computer?' Then have the computer do it the same way.

Comment on Re: "Out of memory" problem

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1006524]
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others taking refuge in the Monastery: (3)
As of 2015-11-28 22:56 GMT
Find Nodes?
    Voting Booth?

    What would be the most significant thing to happen if a rope (or wire) tied the Earth and the Moon together?

    Results (746 votes), past polls