Beefy Boxes and Bandwidth Generously Provided by pair Networks
Clear questions and runnable code
get the best and fastest answer

Re: Unpredictable output form Text::ExtractWords

by epoptai (Curate)
on Aug 16, 2005 at 15:37 UTC ( #484174=note: print w/replies, xml ) Need Help??

in reply to Unpredictable output from Text::ExtractWords

Lingua::EN::Splitter to the rescue:
#!/usr/bin/perl use strict; use warnings; use Lingua::EN::Splitter; my @strings = ( q|one two 'three'|, q|yes I am 'me'|, ); my %config = ( minlen => 3, maxlen => 32, locale => "en_US.ISO_8859-1", ); my $split = Lingua::EN::Splitter->new; my %count; for my $str (@strings){ print "$str\n"; my $words = $split->words($str); $count{$_}++ for @$words; for my $word (sort @$words) { $_ = length $word; next if $_ < $config{minlen} or $_ > $config{maxlen}; print $word, ' -> ', $count{$word}, "\n" } print '-' x 10, "\n"; } __END__ Output: one two 'three' one -> 1 three -> 1 two -> 1 ---------- yes I am 'me' yes -> 1

perl -MO=Deparse -e"u j t S n a t o e h r , e p l r a h k c r e"

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://484174]
[mark4]: ...And some of my confusion is that "PAR-Packer" is not available in the default repository for the 64 bit active-state perl

How do I use this? | Other CB clients
Other Users?
Others cooling their heels in the Monastery: (4)
As of 2018-01-19 21:39 GMT
Find Nodes?
    Voting Booth?
    How did you see in the new year?

    Results (223 votes). Check out past polls.