Beefy Boxes and Bandwidth Generously Provided by pair Networks
Just another Perl shrine
 
PerlMonks  

Re^4: Read Some lines in Tera byte file

by ikegami (Pope)
on Oct 13, 2010 at 15:56 UTC ( #865110=note: print w/ replies, xml ) Need Help??


in reply to Re^3: Read Some lines in Tera byte file
in thread Read Some lines in Tera byte file

Tie::File remembers the position of the lines it has encountered. Not problem if you want to read lines 100 to 200.


Comment on Re^4: Read Some lines in Tera byte file
Re^5: Read Some lines in Tera byte file
by BrowserUk (Pope) on Oct 13, 2010 at 16:24 UTC

    ...just be sure not to reference $#array or scalar @array, otherwise you have to wait for the whole file to have been shuffled through memory.

    Consuming 1.5GB of ram in the process on my 40e6 line, 3.6GB file. On a Terabyte size file?

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://865110]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others surveying the Monastery: (6)
As of 2015-07-07 01:48 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    The top three priorities of my open tasks are (in descending order of likelihood to be worked on) ...









    Results (86 votes), past polls