Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl: the Markov chain saw
 
PerlMonks  

Re^3: Reading HUGE file multiple times

by BrowserUk (Pope)
on Apr 28, 2013 at 10:45 UTC ( #1031052=note: print w/ replies, xml ) Need Help??


in reply to Re^2: Reading HUGE file multiple times
in thread Reading HUGE file multiple times

On my system, the code above indexed a 6.4 million record, 5GB file in 57 seconds.

1367141700 1367141757 6348909

Once indexed, accessing the records randomly runs at 1 second per thousand.


With the rise and rise of 'Social' network sites: 'Computers are making people easier to use everyday'
Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
"Science is about questioning the status quo. Questioning authority".
In the absence of evidence, opinion is indistinguishable from prejudice.


Comment on Re^3: Reading HUGE file multiple times
Download Code

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1031052]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others having an uproarious good time at the Monastery: (11)
As of 2014-09-30 18:36 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    How do you remember the number of days in each month?











    Results (381 votes), past polls