Beefy Boxes and Bandwidth Generously Provided by pair Networks
Think about Loose Coupling
 
PerlMonks  

Re^4: Read Some lines in Tera byte file

by ikegami (Pope)
on Oct 13, 2010 at 15:56 UTC ( #865110=note: print w/ replies, xml ) Need Help??


in reply to Re^3: Read Some lines in Tera byte file
in thread Read Some lines in Tera byte file

Tie::File remembers the position of the lines it has encountered. Not problem if you want to read lines 100 to 200.


Comment on Re^4: Read Some lines in Tera byte file
Re^5: Read Some lines in Tera byte file
by BrowserUk (Pope) on Oct 13, 2010 at 16:24 UTC

    ...just be sure not to reference $#array or scalar @array, otherwise you have to wait for the whole file to have been shuffled through memory.

    Consuming 1.5GB of ram in the process on my 40e6 line, 3.6GB file. On a Terabyte size file?

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://865110]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others scrutinizing the Monastery: (4)
As of 2014-09-22 07:14 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    How do you remember the number of days in each month?











    Results (182 votes), past polls