Beefy Boxes and Bandwidth Generously Provided by pair Networks
Your skill will accomplish
what the force of many cannot

Re^6: Serializing a large object

by daverave (Scribe)
on Oct 09, 2010 at 14:58 UTC ( #864390=note: print w/replies, xml ) Need Help??

in reply to Re^5: Serializing a large object
in thread Serializing a large object

use strict; use warnings; use 5.012; use FastBioRanges; # use PerlIO::gzip; # I just noticed I forgot this 'use' but it worked + fine... how? use Storable qw (retrieve_fd); use Time::HiRes qw(gettimeofday tv_interval); my $time = [gettimeofday]; open( my $fastbioranges_fh, "<:gzip", '') or die; my $fastbioranges = retrieve_fd($fastbioranges_fh) or die; close($fastbioranges_fh); say "loaded in ", tv_interval($time), " seconds"; my $n = 1000; $time = [gettimeofday]; #say "start\tend\tcover"; for ( 1 .. $n ) { my $start = int rand(877878); my $size = int rand(7000); my $end = ( $start + $size ) % 877879 + 1; my $cover = $fastbioranges->num_ranges_containing( $start, $end ); # say "$start\t$end\t$cover"; } say "$n queries in ", tv_interval($time), " seconds";

loaded in 0.385292 seconds 1000 queries in 0.005204 seconds
Recall usually my objects are 5-10 time larger and the number of queries is in the millions. The querying is not optimized (all the 'my $...', 'rand' etc.) but still it's very fast.

Replies are listed 'Best First'.
Re^7: Serializing a large object
by BrowserUk (Pope) on Oct 09, 2010 at 15:04 UTC
    # use PerlIO::gzip; # I just noticed I forgot this 'use' but it worked fine... how?

    Because using ':gzip' causes perl to look for and load the appropriate module.

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://864390]
and all is quiet...

How do I use this? | Other CB clients
Other Users?
Others imbibing at the Monastery: (5)
As of 2017-04-30 08:02 GMT
Find Nodes?
    Voting Booth?
    I'm a fool:

    Results (534 votes). Check out past polls.