in reply to Re: sorting Chinese characters
in thread sorting Chinese characters
I found and tried Unicode::Collate::Locale->new(locale => 'en-US')->sort() instead of regular Perl sort() and that has improved the ratio of reachable to unreachable keys in the index. Now there are only 126 unreachable (compared to 188, earlier) out of a total of ~166k entries.
It's good, but not good enough. I could live with 0.1% droppage from the index except that one of the dropped keys is '⼀' which is the Chinese character meaning 'one'. That's a noddy mistake in a Chinese-English dictionary application so I need to still fix it.
Problem is that I think I'm almost at the this must be a subtle difference in the Unicode tables of Perl and C# stage, so perhaps you have some specific experience sorting Unicode, or were you just suggesting I look at this package of libraries?
larryk perl -le "s,,reverse killer,e,y,rifle,lycra,,print"
|
---|
Replies are listed 'Best First'. | |
---|---|
Re^3: sorting Chinese characters
by choroba (Cardinal) on Feb 02, 2013 at 09:31 UTC | |
by larryk (Friar) on Feb 12, 2013 at 05:31 UTC |
In Section
Seekers of Perl Wisdom