Beefy Boxes and Bandwidth Generously Provided by pair Networks
Just another Perl shrine

(ar0n) Re: Faster Flat File

by ar0n (Priest)
on Feb 03, 2002 at 04:39 UTC ( #143022=note: print w/replies, xml ) Need Help??

in reply to Faster Flat File

I'd probably try something like this (untested):
#!/usr/bin/perl -w use strict; use IO::File; use Text::CSV_XS; { my $fh = new IO::File ("<$path/$database") or die "Can't open file: $!\n"; my $csv = new Text::CSV_XS ({ sep_char => '|' }); while ( my ($a,$b,$c,$d,$e,$f) = @{$csv->getline($fh)} ) { if ( -1 != index($s, $d) && -1 != index($r, $e) && -1 != index($m, + $f) ){ print "$b\n"; if ($c eq "Y"){ print "$a - tal\n"; } elsif ($p eq "Y"){ print "$e"; } } } }

I used index, since it's faster than a regex, generally, and you seemed to be simply searching for a substring, not an actual regex. Also, Text::CSV_XS is XS (compiled C) which is usually quite fast (faster than Perl, at any rate).

Update: As merlyn pointed out recently, index need not be faster than a regex (thanks for pointing that out, blakem).

[ ar0n -- want job (boston) ]

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://143022]
[LanX]: and this Re^2: extract column data
[Lady_Aleena]: I have two sub recurse { my ($directory, $other_var) = @_; my @files = file_list($directo ry); for my $file (@files) { if (-f $file) { do "stuff"; } if (-d $file) { recurse(" $directory/$file" , $other_var); } } } This was when I hated File::Find.
[tobyink]: 1nickt: your code?
[LanX]: pryrt: yeah, that's why I didn't consider, but the last >10 anonymous posts are from the same troll-person
[jdporter]: is there a module for expanding tabs in text?
[jdporter]: A: yes.
[Lady_Aleena]: I don't know how hard it will be to get out of that mess.
[LanX]: M-x untabify
[choroba]: I don't think they're multiple people. I was told "he or she" sounds old-fashioned and "they" is the way to say it
[pryrt]: Those others were definitely offensive or unequivocably rude, I agree.

How do I use this? | Other CB clients
Other Users?
Others pondering the Monastery: (17)
As of 2017-05-24 20:18 GMT
Find Nodes?
    Voting Booth?