Re: Uniq and sort in perl

[thargas]

in reply to Uniq and sort in perl

You might want to consider whether the SQL is correct or not. If it's supposed to return unique info, the fact that it doesn't sounds suspicious to me. While the various other answers may allow you to see only unique info, this may be covering up a more basic problem.

[Utilitarian]

This is a very valid point, selecting only the fields you are interested in would improve performance as well as being the "correct" way to achieve this

[slayedbylucifer]

No. the SQL query is not giving me the duplicate entries. They look duplicate only after I run the "split" function inside my while loop. Thanks for your time.

[CountZero]

The recordset you retrieve indeed will not contain duplicate records, but that is only because you retrieve more fields and data than you use in your final results.

You do nothing with the second field and you discard all the data after the first ":" delimiter in the third field. And perhaps there are many other fields you do not use at all.

Try to rewrite your SQL so it only gives you exactly what you need.

If that is not possible, then perhaps you should revise your database scheme. If you regularly need the dotted quad as a result, then perhaps that should be a separate field (rather than hidden inside another field) so you can index it and increase the retrieval speed many times.