Re: incremental reading of utf8 input handles

[Khen1950fx]

Here's a test that I tried. The first two tests fail as they should. The last 2 tests succeed.

#!/usr/bin/perl -l

BEGIN {
    $|  = 1;
    $^W = 1;
    $ENV{'TEST_VERBOSE'} = 1;
}

use strict;
use warnings;
use Test::utf8;
use Test::More tests => 4;
use Encode qw/:all/;

my $invalid = "\x{e9}";
Encode::_utf8_on($invalid);
ok(is_valid_string($invalid));

my ($buffer, $string) = ('', '');
while (read $invalid, $buffer, 256, length $string) {
    $invalid .= decode(
        'utf-8-strict', $buffer, Encode::FB_QUIET
    );
} 
Encode::_utf8_on($string);
ok(is_valid_string($string));

The $buffer should hold any partial incrementation.

[Tanktalus]

This looks very interesting. Thanks. Unfortunately, your test doesn't seem to work here. I added a diag "[", explain($string), "]"; to the end, and I get no output. (i.e., an empty []). Also, I tried adding a "diag '.';" inside the while loop to see how many times it loops, and nothing came out. You're also not reading from $invalid, you need to open my $fh, '<', \$invalid; and then you can read from $fh. But though it now reads one time, the length of the ouput still seems to be zero. I'll see if I can adapt this test to actually have valid utf8 after multiple reads and see what comes of it. Somewhere to start from anyway :-)