Beefy Boxes and Bandwidth Generously Provided by pair Networks
Your skill will accomplish
what the force of many cannot

Re^3: Reading HUGE file multiple times

by BrowserUk (Pope)
on Apr 28, 2013 at 10:45 UTC ( #1031052=note: print w/ replies, xml ) Need Help??

in reply to Re^2: Reading HUGE file multiple times
in thread Reading HUGE file multiple times

On my system, the code above indexed a 6.4 million record, 5GB file in 57 seconds.

1367141700 1367141757 6348909

Once indexed, accessing the records randomly runs at 1 second per thousand.

With the rise and rise of 'Social' network sites: 'Computers are making people easier to use everyday'
Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
"Science is about questioning the status quo. Questioning authority".
In the absence of evidence, opinion is indistinguishable from prejudice.

Comment on Re^3: Reading HUGE file multiple times
Download Code

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1031052]
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others making s'mores by the fire in the courtyard of the Monastery: (11)
As of 2015-10-13 08:34 GMT
Find Nodes?
    Voting Booth?

    Does Humor Belong in Programming?

    Results (296 votes), past polls