This is what I get on an Atom eee pc (1.6Ghz), after I removed
use v5.16.0;
and changed
say "Total time: ", (time - $start); # 180 seconds
to
print "Total time: ", (time - $start); # 180 seconds
time perl db.pl
Total time: 5
real 0m5.348s
user 0m0.360s
sys 0m0.820s
marica.fr : Gestion des contrats, des dossiers contentieux et des sinistres d'assurance
| [reply] [d/l] [select] |
I've never heard reports that 5.16.0 will significantly slow a program, or that say is so much slower. What's going on here?
| [reply] |
Well, 200 millions records at a rate of 2000 per second, that's still 100,000 seconds, or almost 28 hours. That's still pretty long, isn't-it? Having said that, you may be able to live with that, a full day of processing is still manageable for a number of cases. Beware, though, that the rate might slow down as you database grows larger.
If you are really only looking for filtering out duplicates, the ideas discussed by BrowserUk are probably much better than using a database.
| [reply] |