No qualms at all, I'm trying to get some existing data
into a database, and I've got a lot of it. The file structure
is a bit odd, and I need to read in N lines of header,
then M lines of secondary data, before looping through
line by line for a while and then going back to the
header structure.
I don't want to read it all into memory because
the file is about 160Mb with about 8 million lines. The
header is always a fixed number of lines, the secondary
data is optional but a fixed number of lines and the
bulk of the data is usually somewhere between 100 and
10,000 lines.
I was just surprised that this wasn't as easy / neat
to do as I expected. I'm quite pleased with my original
map one liner, but nobody has really commented on whether
it was really all that bad.
Have fun,
rdw