Re: Need help to fine tune perl script to make it faster( currently taking more than 30 minutes)

[roboticus]

anujajoseph:

I'd suggest not shelling out to sed to print a line. Instead, read the file into an array and print the appropriate line. That would be better than rescanning the file over and over. Or build an array of lines to print, then after the while loop, scan the file once, printing each line in your array.

...roboticus

When your only tool is a hammer, all problems look like your thumb.

[anujajoseph]

thanks for your suggestion , but the concern is since the source file is huge wont it cause memory issues if i open the file for reading the rows?

[roboticus]

anujajoseph:

If the source file is too large to fit into memory, then the second suggestion might be better. But since computers tend to have so much RAM nowadays, most files will fit into memory.

Update: On rereading the thread, I realize that in my first post I left out a word in the second suggestion. It should be an array of line numbers.

...roboticus

When your only tool is a hammer, all problems look like your thumb.