Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl Monk, Perl Meditation

Re: selecting N random lines from a file in one pass

by boo_radley (Parson)
on Dec 22, 2004 at 17:02 UTC ( #416825=note: print w/ replies, xml ) Need Help??

Comment on Re: selecting N random lines from a file in one pass
Replies are listed 'Best First'.
Re^2: selecting N random lines from a file in one pass
by seuratt (Novice) on Dec 22, 2004 at 17:39 UTC
    Your self-promotion requires reading the entire file into memory before it can be passed to the module, which makes it kind of inapplicable to problem.

    However, if you do have the entire data set in memory, there's a simpler approach than the math theory you use in your module. Rather than iterate the array, consider just drawing at random. If there's a duplicate, then redraw. The larger the set, the less the odds of a duplicate. This scales a lot better than your module, but I admit that does trip up more on sets close to sample size.

    It's a lot like how, in gaming, you can fake a d12 by rolling a d20 until you've got a number in range.

    use strict; use Data::Dumper; my @set = ('a'..'z'); my $size = 3; my @sample; my %seen; while( @sample < $size ){ my $elt; do{ $elt = int rand(@set); }while( $seen{$elt} ); push @sample, $set[$elt]; $seen{$elt}++; } print Dumper \@sample;

    This example should really have a check, too, to see if the sample size is in the bounds of the set, to avoid looping.

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://416825]
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others surveying the Monastery: (6)
As of 2016-02-10 07:49 GMT
Find Nodes?
    Voting Booth?

    How many photographs, souvenirs, artworks, trophies or other decorative objects are displayed in your home?

    Results (336 votes), past polls