Beefy Boxes and Bandwidth Generously Provided by pair Networks
P is for Practical
 
PerlMonks  

Re^3: Reading HUGE file multiple times

by BrowserUk (Pope)
on Apr 28, 2013 at 10:45 UTC ( #1031052=note: print w/replies, xml ) Need Help??


in reply to Re^2: Reading HUGE file multiple times
in thread Reading HUGE file multiple times

On my system, the code above indexed a 6.4 million record, 5GB file in 57 seconds.

1367141700 1367141757 6348909

Once indexed, accessing the records randomly runs at 1 second per thousand.


With the rise and rise of 'Social' network sites: 'Computers are making people easier to use everyday'
Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
"Science is about questioning the status quo. Questioning authority".
In the absence of evidence, opinion is indistinguishable from prejudice.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1031052]
help
Chatterbox?
[Lady_Aleena]: Ratazong, you didn't know about Cookies?
[Lady_Aleena]: shmem, jedikaiti would appreciate that. 8)

How do I use this? | Other CB clients
Other Users?
Others meditating upon the Monastery: (5)
As of 2017-04-26 10:07 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    I'm a fool:











    Results (471 votes). Check out past polls.