Beefy Boxes and Bandwidth Generously Provided by pair Networks
Your skill will accomplish
what the force of many cannot
 
PerlMonks  

Re: Remove duplicate data from text file

by dragonchild (Archbishop)
on Nov 28, 2001 at 00:35 UTC ( #127903=note: print w/replies, xml ) Need Help??


in reply to Remove duplicate data from text file

  1. Read the file into an array
  2. Create a hash whose keys are the values in the array
  3. Create an array from the keys of the hash
  4. Print the array out to a file
The details are left as an exercise for the reader.

------
We are the carpenters and bricklayers of the Information Age.

Don't go borrowing trouble. For programmers, this means Worry only about what you need to implement.

  • Comment on Re: Remove duplicate data from text file

Replies are listed 'Best First'.
Code
by ggoebel (Sexton) on Nov 28, 2001 at 01:31 UTC
    my $filename = ...; local $/; open IN, $filename; $text = <IN>; @words{split /\s+/, $text} = undef; @words = keys %words;

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://127903]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others studying the Monastery: (4)
As of 2022-06-29 04:01 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    My most frequent journeys are powered by:









    Results (94 votes). Check out past polls.

    Notices?