Beefy Boxes and Bandwidth Generously Provided by pair Networks
No such thing as a small change
 
PerlMonks  

Re: Remove duplicate entries

by aquarium (Curate)
on Nov 16, 2010 at 23:47 UTC ( #871870=note: print w/ replies, xml ) Need Help??


in reply to Remove duplicate entries

if you're on unix/linux or have windows with cygwin installed..a combination of the usual suspects (utilities like sort, unix, join, diff) combined in a short pipeline would most likely achieve the desired outcome. it's not a perl solution, but then I don't like to code (and debug the code) when the result is easily achievable without even touching scripting.

the hardest line to type correctly is: stty erase ^H


Comment on Re: Remove duplicate entries
Replies are listed 'Best First'.
Re^2: Remove duplicate entries
by aquarium (Curate) on Nov 17, 2010 at 02:52 UTC
    and if there's dodgy input as indicated by someone, e.g. Group-One is equivalent to Group One and GroupOne...then just run it thru "sed" with a regex to make them all conform to a desired one form, before the de-dupe.
    the hardest line to type correctly is: stty erase ^H

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://871870]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others exploiting the Monastery: (12)
As of 2015-07-29 17:13 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    The top three priorities of my open tasks are (in descending order of likelihood to be worked on) ...









    Results (266 votes), past polls