Beefy Boxes and Bandwidth Generously Provided by pair Networks
Pathologically Eclectic Rubbish Lister

Re: FileHandles and threads

by Anonymous Monk
on Apr 20, 2013 at 18:12 UTC ( #1029672=note: print w/replies, xml ) Need Help??

in reply to FileHandles and threads


i have used the code and comment, because my problem was a little similar. i need to access to a big file (6Go / 12M protein records) to search for fuzzy similary

so i give my solution, it's a good start and maybe it will be useful to someone



#! perl -slw use strict; use warnings; use threads; use Thread::Queue; my $file="/path_to_the_file" ; our $file_handler ; our $ref_file_handler ; my ( $process_1 , $process_2 , $process_3 ) ; my $flag_on_file = Thread::Queue->new ; # main open $file_handler, '<', $file or warn "$file : $!" and die; $flag_on_file->enqueue(fileno($file_handler)); # threads creation $process_1 = threads->new( \&my_sub ); $process_2 = threads->new( \&my_sub ); $process_3 = threads->new( \&my_sub ); # waiting for all threads to stop before exit $process_1->join; $process_2->join; $process_3->join; # end main # sub sub my_sub { my( $fileno ) = $flag_on_file->dequeue ; open $ref_file_handler, "<&=$fileno" or warn $! and die; for ( 1..10 ) { # do something with the file # exemple print threads->self->tid.": ".scalar <$ref_file_handler> ; } close $ref_file_handler; $flag_on_file->enqueue(fileno($file_handler)); # do something with data } exit;

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1029672]
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others chanting in the Monastery: (10)
As of 2016-10-21 14:08 GMT
Find Nodes?
    Voting Booth?
    How many different varieties (color, size, etc) of socks do you have in your sock drawer?

    Results (289 votes). Check out past polls.