Re^4: Fetch Mysql huge database


good chemistry is complicated, and a little bit messy -LW
	PerlMonks

Re^4: Fetch Mysql huge database

by ym_chaitu (Initiate)

on Sep 30, 2011 at 05:31 UTC ( [id://928703]=note: print w/replies, xml )

Need Help??

in reply to Re^3: Fetch Mysql huge database
in thread Fetch Mysql huge database

Hai Thank you again for your reply. i have modified your script and this worked out for me. Here is the script that i have used. partNames.pl

while( <> ) {
    my $c =  substr $_ ,0, 1;
    #print "C value --> ".$c."\n";
    $file = "names".$c;
    &file_write($file,$_);
}

sub file_write(){
 $_file = shift;
 $_data = shift;
 open (DATA_FILE,">>$_file") or die("Cannot open a file $_file ->$!\n"
+);
 print DATA_FILE "$_data";
 close(DATA_FILE);
}
[download]

uniqNames.pl

for my $fname ( glob 'names*' ) {
    my %uniq;
    open my $fh, '<', $fname or die $!;
    while( <$fh> ) {
        print unless exists $uniq{ $_ };
        $uniq{ $_ } =  1;
    }
}
[download]

Thank you once again for your help.

Replies are listed 'Best First'.

Re^5: Fetch Mysql huge database
by BrowserUk (Patriarch) on Sep 30, 2011 at 07:59 UTC

. i have modified your script and this worked out for me.

Be aware. Whilst what you've posted will work, re-opening and closeing your files for every line you write to them will make your program run 100 times more slowly. And it is completely unnecessary.

Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.

"Science is about questioning the status quo. Questioning authority".

In the absence of evidence, opinion is indistinguishable from prejudice.

[reply]

In Section Seekers of Perl Wisdom