Beefy Boxes and Bandwidth Generously Provided by pair Networks
Clear questions and runnable code
get the best and fastest answer
 
PerlMonks  

Re^2: how to speed up dupe checking of arrays

by ultibuzz (Monk)
on Jul 31, 2007 at 10:25 UTC ( #629789=note: print w/ replies, xml ) Need Help??


in reply to Re: how to speed up dupe checking of arrays
in thread how to speed up dupe checking of arrays

i need them in an array so i adjusted ur code like this

my @rows; my %seen; while (<IN>) { chomp; my ($ele0, $ele1, undef) = split ';', $_, 3; push @rows,"$ele0;$ele1;$file_date" if !$seen{"$ele0;$ele1 +;$file_date"}++; } close(IN);

and waht shoud i say AWSOME, from 203 seconds down do around 11 seconds,great so no over hours in office needed ;)
thx alot.

kd ultibuzz


Comment on Re^2: how to speed up dupe checking of arrays
Download Code
Re^3: how to speed up dupe checking of arrays
by oha (Friar) on Jul 31, 2007 at 10:46 UTC
    you already have them in array.
    $seen{"$ele0;$ele1;$file_data"}++;
    then if you need the data you can, for example:
    foreach (keys %seen) { .... }
    and the value of the hash is the number of times the string is repeated

    Oha

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://629789]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others romping around the Monastery: (16)
As of 2015-07-06 13:01 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    The top three priorities of my open tasks are (in descending order of likelihood to be worked on) ...









    Results (74 votes), past polls