Re^4: Using encoding

in reply to Re^3: Using encoding
in thread Using encoding

try to import the text as UTF16LE or check Mixed character encoding issues and my answers for a relevant workaround

Comment on Re^4: Using encoding

Replies are listed 'Best First'.
Re^5: Using encoding by MorayJ (Beadle) on Jan 14, 2013 at 18:03 UTC
I tried the UTF16LE and it was producing the error "UTF-16LE:Partial character", so it wouldn't work Taking all encoding off the input file (presumably letting it read as ASCII) allowed me to substitute `$col =~ s/\x{B6}\x{9C}/\x{A3}/g;` as long as my output file was encoded with ISO-8859-1 That encoding (ISO-8859-1) works for the input file as well. So I guess I was leading people astray by suggesting using utf8. I now have Ł signs appearing in the finished file. However, it also contains little squares which seem to be from return markers the users have put in. I would have thought that with this file able to be input without encoding that it would be a case of `s/\r\n/\n/`, but this doesn't seem to work Alternatively, is there a way to say "Perl, if you don't recognise the character, blitz it!"? I've read quite a few web pages about the whole thing, but I don't seem to be quite getting it. Any further help much appreciated	[reply] [d/l] [select]

Replies are listed 'Best First'.

Re^5: Using encoding
by MorayJ (Beadle) on Jan 14, 2013 at 18:03 UTC

I tried the UTF16LE and it was producing the error "UTF-16LE:Partial character", so it wouldn't work

Taking all encoding off the input file (presumably letting it read as ASCII) allowed me to substitute

$col =~ s/\x{B6}\x{9C}/\x{A3}/g;

as long as my output file was encoded with ISO-8859-1

That encoding (ISO-8859-1) works for the input file as well. So I guess I was leading people astray by suggesting using utf8.

I now have Ł signs appearing in the finished file. However, it also contains little squares which seem to be from return markers the users have put in.

I would have thought that with this file able to be input without encoding that it would be a case of s/\r\n/\n/, but this doesn't seem to work

Alternatively, is there a way to say "Perl, if you don't recognise the character, blitz it!"?

I've read quite a few web pages about the whole thing, but I don't seem to be quite getting it.

Any further help much appreciated

[reply]
[d/l]
[select]

In Section Seekers of Perl Wisdom