in reply to Using less memory with BIG files
There are a number of things you can improve. The two most important are:
1. If you do foreach $unit(<PFAMDB>) { } it reads the whole file into memory first, then iterates over it. If you instead write while ($unit = <PFAMDB>) { ... }, the file is read line by line.
2.Instead of doing a nested loop, read the IDs into a hash first, and then extract the IDs from the second file, and look them up in the hash. That will greatly speed up things.
|
---|
Replies are listed 'Best First'. | |
---|---|
Re^2: Using less memory with BIG files
by jemswira (Novice) on Feb 02, 2012 at 12:11 UTC |
In Section
Seekers of Perl Wisdom