http://www.perlmonks.org?node_id=1221295


in reply to About text file parsing

Have you timed how fast you can read the file at all? Maybe reading the file is what limits your speed?

Do you have enough RAM to keep all the data you are extracting in arrays? Maybe writing the output into separate files immediately makes things faster. At least it makes certain that your program uses far less RAM.