|Just another Perl shrine|
Re: search a large text fileby erix (Priest)
|on Feb 08, 2011 at 17:27 UTC||Need Help??|
I put together an example in case you want to use PostgreSQL:
The file I used is available here:
It's similar to yours; but it has three columns.
I unzipped it, and put it into postgres, in a table t; there are more than 223-million rows.
Searches are now around a tenth of a millisecond:
Just showing the timings of five searches:
Of course, performance depends on the hardware used.
(a similar problem/solution here: Re^3: sorting very large text files (slander))