Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl Monk, Perl Meditation
 
PerlMonks  

Re: Reading HUGE file multiple times

by dsheroh (Parson)
on Apr 28, 2013 at 10:46 UTC ( #1031053=note: print w/ replies, xml ) Need Help??


in reply to Reading HUGE file multiple times

Depending on what you're doing with the data, another option might be to do one pass over it to pre-process the data (extracting individual fields, etc.) and insert it into a database, then use the database for later operations.


Comment on Re: Reading HUGE file multiple times

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1031053]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others pondering the Monastery: (18)
As of 2015-07-02 17:00 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    The top three priorities of my open tasks are (in descending order of likelihood to be worked on) ...









    Results (44 votes), past polls