note
Jim
<p>Contents of a Unicode (UTF-8) text file named DriedMangos.txt:</p>
<table>
<tr><td width="30"></td><td>dried mangos</td></tr>
<tr><td width="30"></td><td>mangues séchées</td></tr>
<tr><td width="30"></td><td>芒果幹</td></tr>
<tr><td width="30"></td><td>doraido mangōsu</td></tr>
<tr><td width="30"></td><td>ドライドマンゴス</td></tr>
<tr><td width="30"></td><td>ドライドマンゴス</td></tr>
<tr><td width="30"></td><td>ト"ライト"マンコ"ス</td></tr>
</table>
<p>Perl script to demonstrate matching Unicode [href://http://unicode.org/glossary/#grapheme_cluster|grapheme clusters] using the regular expression backslash sequence [doc://perlrebackslash#Misc|\X]:</p>
<code>
#!perl
use strict;
use warnings;
use autodie;
open my $input_fh, '<:encoding(UTF-8)', 'DriedMangos.txt';
open my $output_fh, '>:encoding(UTF-8)', 'Graphemes.txt';
while (my $line = <$input_fh>) {
chomp $line;
while ($line =~ m/(\X)/g) {
print $output_fh "[$1]";
}
print $output_fh "\n";
}
close $input_fh;
close $output_fh;
</code>
<p>Contents of the output text file named Graphemes.txt:</p>
<table>
<tr><td width="30"></td><td>[d][r][i][e][d][ ][m][a][n][g][o][s]</td></tr>
<tr><td width="30"></td><td>[m][a][n][g][u][e][s][ ][s][é][c][h][é][e][s]</td></tr>
<tr><td width="30"></td><td>[芒][果][幹]</td></tr>
<tr><td width="30"></td><td>[d][o][r][a][i][d][o][ ][m][a][n][g][ō][s][u]</td></tr>
<tr><td width="30"></td><td>[ド][ラ][イ][ド][マ][ン][ゴ][ス]</td></tr>
<tr><td width="30"></td><td>[ド][ラ][イ][ド][マ][ン][ゴ][ス]</td></tr>
<tr><td width="30"></td><td>[ト]["][ラ][イ][ト]["][マ][ン][コ]["][ス]</td></tr>
</table>
<p>(See [href://http://ameblo.jp/gucciman-ikkob/entry-10317490092.html] for an explanation of the peculiar last line of the file named DriedMangos.txt.)</p>
871088
871173