in reply to Trying to identify unique lines in a log file
Is there any timestamp in the log? If not, can you add one? Or even, Why not cycle the log first (copy and truncate) and then parse the "static" recycled log?
In Section Seekers of Perl Wisdom