Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl: the Markov chain saw
 
PerlMonks  

Re: Reduce CPU utilization time in reading file using perl

by talexb (Canon)
on Sep 27, 2013 at 17:11 UTC ( #1056028=note: print w/replies, xml ) Need Help??


in reply to Reduce CPU utilization time in reading file using perl

I'd say your best bet is to process the file one line at a time, as has already been suggested, and put the relevant information into a database. Once it's there, you can gather and extract the information you need -- and let the database engine worry about figuring out the best way to store it all.

Alex / talexb / Toronto

Thanks PJ. We owe you so much. Groklaw -- RIP -- 2003 to 2013.

  • Comment on Re: Reduce CPU utilization time in reading file using perl

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1056028]
help
Chatterbox?
thezip switches the jolokia powder with Folgers Crystals...
[Michael W]: So i can read ok from this how do i put data back inmy @Variables = ( $Map_Request_Date, $Map_Due_Date,$Map _Cutover_Date,$Map _Complete_Date,$Ma p_Approved_Date);
[Corion]: Michael_W: $Variables[0] = $Map_Request_Date; $Variables[1] = $Map_Due_Date; ...
[choroba]: ( $Map_Request_Date, $Map_Due_Date,$Map _Cutover_Date,$Map _Complete_Date,$Ma p_Approved_Date) = @Variables;?
[thezip]: something like: $Map_Request = <value>; etc. should work
[Corion]: Duh - I read it backwards. I shouldn't code today I guess ;)

How do I use this? | Other CB clients
Other Users?
Others musing on the Monastery: (11)
As of 2017-04-27 15:33 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    I'm a fool:











    Results (509 votes). Check out past polls.