Re^4: Problem getting Russian stopwords

map decode("KOI8-R", $_), keys %$stopwords;

The problem is that your stopwords are left undecoded in the hash. You should produce a new hash containing transformed keys instead of throwing the results of decode out:

my %stopwords;
undef @stopwords{
 map decode("KOI8-R", $_), keys %{getStopWords('ru')}
};
[download]

Also, the stop words are in lower case, which means that you should lowercase your text too before checking whether it's a stopword or not.

say join ' ', grep { ! exists $stopwords{lc $_} } @words;
[download]

You may want to split your text on /\W+/ to get the words in one operation.

Успехов,

Comment on Re^4: Problem getting Russian stopwords Select or Download Code

Replies are listed 'Best First'.
Re^5: Problem getting Russian stopwords by Your Mother (Archbishop) on Sep 19, 2018 at 08:08 UTC
`undef @stopwords{ map decode("KOI8-R", $_), keys %{getStopWords("ru")} + };` [download] That’s a really interesting hash slice trick. I like it. Haven’t learned a new Perl idiom in a long time. Thanks. I don’t know anything about Cyrillic alphabets. Would `fc` be preferable to `lc` here or is it irrelevant given the character set?	[reply] [d/l] [select]
Re^6: Problem getting Russian stopwords by Anonymous Monk on Sep 19, 2018 at 20:02 UTC
Thank you, in turn, for reminding me of `fc`! It seems to me that for Cyrillic alphabet as it is used in Russian, `fc` and `lc` are equivalent: `use v5.16; use charnames ':full'; use List::Util 'all'; say all { fc eq lc } map chr, ord("\N{CYRILLIC CAPITAL LETTER A}")..ord("\N{CYRILLIC SMALL LETTER Y +A}") __END__ 1` [download]	[reply] [d/l] [select]
Re^7: Problem getting Russian stopwords by Your Mother (Archbishop) on Sep 20, 2018 at 07:47 UTC
That appears to be absolutely classic, terse, ideal test code for this case and I think you deserve more ++s than the apparently single you got from me. I wish you would sign-in and participate with a username to bank the credibility and goodwill and perhaps develop friendships here. I have a fair amount of animosity for and mistrust of anonymous monks at this point. Love to see you leave that stable. For the interested, I added this to visualize what’s going on– `$ perl -Mfeature=fc -Mcharnames=:full -Mv5.16 binmode STDOUT, ":encoding(UTF-8)"; say join " ", $_, lc, fc, uc for map chr, ord("\N{CYRILLIC CAPITAL LETTER A}")..ord("\N{CYRILLIC SMALL LETTE +R YA}");` [download] Came across this again and added the command line invocation to support the character names and the use of `fc` and `say`.	[reply] [d/l] [select]


"be consistent"
	PerlMonks