Beefy Boxes and Bandwidth Generously Provided by pair Networks
Problems? Is your data what you think it is?
 
PerlMonks  

Re^3: Reading HUGE file multiple times

by BrowserUk (Pope)
on Apr 28, 2013 at 10:45 UTC ( #1031052=note: print w/ replies, xml ) Need Help??


in reply to Re^2: Reading HUGE file multiple times
in thread Reading HUGE file multiple times

On my system, the code above indexed a 6.4 million record, 5GB file in 57 seconds.

1367141700 1367141757 6348909

Once indexed, accessing the records randomly runs at 1 second per thousand.


With the rise and rise of 'Social' network sites: 'Computers are making people easier to use everyday'
Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
"Science is about questioning the status quo. Questioning authority".
In the absence of evidence, opinion is indistinguishable from prejudice.


Comment on Re^3: Reading HUGE file multiple times
Download Code

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1031052]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others lurking in the Monastery: (16)
As of 2014-08-27 18:29 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    The best computer themed movie is:











    Results (248 votes), past polls