Re^2: Read Some lines in Tera byte file

use something like Tie::File,

Please try this yourself--say read the middle line in a 1 or 2GB file--before suggesting it to others.

Comment on Re^2: Read Some lines in Tera byte file

Replies are listed 'Best First'.
Re^3: Read Some lines in Tera byte file by marto (Cardinal) on Oct 13, 2010 at 08:43 UTC
I posted from my phone, I couldn't realistically try this at the time. It is, as I suppose you're suggesting, pretty darn slow. I'd used Tie::File in the past, but not with files this large. Cheers	[reply]
Re^4: Read Some lines in Tera byte file by ikegami (Patriarch) on Oct 13, 2010 at 15:56 UTC
Tie::File remembers the position of the lines it has encountered. Not problem if you want to read lines 100 to 200.	[reply]
Re^5: Read Some lines in Tera byte file by BrowserUk (Patriarch) on Oct 13, 2010 at 16:24 UTC
...just be sure not to reference `$#array` or `scalar @array`, otherwise you have to wait for the whole file to have been shuffled through memory. Consuming 1.5GB of ram in the process on my 40e6 line, 3.6GB file. On a Terabyte size file?	[reply] [d/l] [select]