Your skill will accomplish what the force of many cannot |
|
PerlMonks |
Re: Memory Efficient Alternatives to Hash of Arrayby baxy77bax (Deacon) |
on Dec 27, 2008 at 11:11 UTC ( [id://732774]=note: print w/replies, xml ) | Need Help?? |
well, i don't know if you are familiar with SQLite (or MySQL), i often get stuck with processing large amount of data, at first i also tried to do it through hashes and arrays, but then i just gave up on it. my advise would be to use one of the freely available databases like SQLite or MySQL. just import data, sort it (order by), and when processing it retrieve line by line of data and do what ever you want to do with it. this is memory efficient, but certainly slower way to do it example on how to use it through DBI and it would be usfull to check out DBD::SQLite plus there are tons of concrete examples on perlmonks !!!
In Section
Seekers of Perl Wisdom
|
|