IO::File and use open qw(:std :utf8)

[coolmichael]

IO::File->open() doesn't seem to respect use open() in the following program, which is odd to me and seems to be against the documentation. Or maybe I'm doing it wrong. Rewriting my code to not use IO::File shouldn't be difficult.

Perlmonks is displaying the unicode character U+0213 as &#513 below, but it really is the correct unicode character in the source file.

I expect the output to be

$VAR1 = \"Hello \x{213} (r-caret)";

Hello ȓ (r-caret)
Hello ȓ (r-caret)
Hello ȓ (r-caret)

But I'm getting this error: "Oops: Malformed UTF-8 character (unexpected end of string) in print at ./run.pl line 33."

That doesn't seem right to me at all.

#!/usr/local/bin/perl

use utf8;
use v5.16;
use strict;
use warnings;
use warnings qw(FATAL utf8);
use diagnostics;
use open qw(:std :utf8);
use charnames qw(:full :short);

use File::Basename;
my $application = basename $0;

use Data::Dumper;
$Data::Dumper::Indent = 1;

use Try::Tiny;

my $str = "Hello ȓ (r-caret)";

say Dumper(\$str);

open(my $fh, '<', \$str);
print while ($_ = $fh->getc());
close($fh);
print "\n";

try {
  use IO::File;
  my $fh = IO::File->new();
  $fh->open(\$str, '<');
  print while ($_ = $fh->getc());
  $fh->close();
  print "\n";
}
catch {
  say "\nOops: $_";
};

try {
  use IO::File;
  my $fh = IO::File->new();
  $fh->open(\$str, '<:encoding(UTF-8)');
  print while ($_ = $fh->getc());
  $fh->close();
  print "\n";
}
catch {
  say "\nOops: $_";
};

[mbethke]

The open pragma is lexically scoped so its effect doesn't extend to the open() performed internally by IO::File. Unfortunately I don't know if there's a way to make this effect global, short of "insert these opcodes on top of every loaded module"-style hacks.

Edit: hum, should've read Stackoverflow first ...

[Anonymous Monk]

how to make lexical pragma global, hints ( pl_hints $^H %^H ), taint::all

[Kenosis]

Cross-posted at stackoverflow.

[choroba]

Maybe related to [Already reported Perl Bug] Confusion over utf8 and in-memory filehandles?