Re: Sorting Vietnamese text

[Atacama]

Given the file is large, you can try using Sort::External supplied with the following sortsub: sub { $index{$Sort::External::a} <=> $index{$Sort::External::b} } Where %index is a hash with letters from the vietnamese alphabet as its keys and their corresponding positions in the alphabet as its values.

[pdenisowski]

Thanks - could you post a small code example? I've not quite sure how to create and reference the index.

[Atacama]

moritz basically implemented a similar idea (that I formulated incorrectly in my message, btw). I think it will be better to use the unicode collation module advised above.

#!/usr/bin/env perl

use warnings;
use strict;
use Sort::External;
use Unicode::Collate::Locale;

my $in  = shift // 'large-unsorted.txt';
my $out = shift // 'sorted.txt';

my $comparator = Unicode::Collate::Locale->new(locale =>'vi');

my $sorter = Sort::External->new
(
  sortsub => sub { $comparator->cmp($Sort::External::a, $Sort::Externa
+l::b) }
);

open my $unsorted, '<', $in or die $!;

$sorter->feed($_) while <$unsorted>;
$sorter->finish(outfile => $out);