Re: Remove duplicate data from text file


There's more than one way to do things
	PerlMonks

Re: Remove duplicate data from text file

by CharlesClarkson (Curate)

on Nov 28, 2001 at 09:02 UTC ( [id://128002]=note: print w/replies, xml )

Need Help??

in reply to Remove duplicate data from text file

If you need to maintain the original order and delete subsequent duplicates, you could try this.

{
    my %seen;
    my ($in_file, $out_file) = qw| in.txt out.txt|;
    open my $in_fh, $in_file or die "$in_file: $!";
    open my $out_fh, '>', $out_file or die "$in_file: $!";
    while ( <$in_fh> ) {
        print $out_fh $_ unless $seen{$_}++;
    }
}
[download]

HTH,
Charles K. Clarkson

Why isn't phonetic spelled the way it sounds?