http://www.perlmonks.org?node_id=1013771


in reply to Going through a big file [solved]

Aside from the excellent advice above about using while rather than for, you may also want to consider looking at the File::SortedSeek module.

It's not directly applicable to what you're doing, but you could use it for inspiration - if your XML is in any kind of sorted order, you can save ENORMOUS amounts of time by doing binary searches if you only need to process a small subset of the file.


Mike

Replies are listed 'Best First'.
Re^2: Going through a big file
by Chuma (Scribe) on Jan 17, 2013 at 14:10 UTC
    Thanks, I do actually need to process the whole thing, but I'll keep that in mind for later anyway.