Beefy Boxes and Bandwidth Generously Provided by pair Networks
more useful options

Re: Unpredictable output form Text::ExtractWords

by epoptai (Curate)
on Aug 16, 2005 at 15:37 UTC ( #484174=note: print w/replies, xml ) Need Help??

in reply to Unpredictable output from Text::ExtractWords

Lingua::EN::Splitter to the rescue:
#!/usr/bin/perl use strict; use warnings; use Lingua::EN::Splitter; my @strings = ( q|one two 'three'|, q|yes I am 'me'|, ); my %config = ( minlen => 3, maxlen => 32, locale => "en_US.ISO_8859-1", ); my $split = Lingua::EN::Splitter->new; my %count; for my $str (@strings){ print "$str\n"; my $words = $split->words($str); $count{$_}++ for @$words; for my $word (sort @$words) { $_ = length $word; next if $_ < $config{minlen} or $_ > $config{maxlen}; print $word, ' -> ', $count{$word}, "\n" } print '-' x 10, "\n"; } __END__ Output: one two 'three' one -> 1 three -> 1 two -> 1 ---------- yes I am 'me' yes -> 1

perl -MO=Deparse -e"u j t S n a t o e h r , e p l r a h k c r e"

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://484174]
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others cooling their heels in the Monastery: (3)
As of 2021-05-16 00:39 GMT
Find Nodes?
    Voting Booth?
    Perl 7 will be out ...

    Results (151 votes). Check out past polls.