Beefy Boxes and Bandwidth Generously Provided by pair Networks
No such thing as a small change
 
PerlMonks  

Re^2: Chicanery Needed to Handle Unicode Text on Microsoft Windows

by brxnd (Initiate)
on Sep 26, 2012 at 03:07 UTC ( #995682=note: print w/ replies, xml ) Need Help??


in reply to Re: Chicanery Needed to Handle Unicode Text on Microsoft Windows
in thread Chicanery Needed to Handle Unicode Text on Microsoft Windows

This thread is refreshing to read!!! As a Windows user that is somewhat new to Perl, I spent the past few hours trying to figure out why one of my supplied 193 xml files would keep outputting as a bunch of Chinese (?) characters. Jim described exactly what I kept trying.

I finished my script. Everything else works - it does all my replaces beautifully. I have maybe spent 8 hours total on my script and it will save me about 3 days of work.

But, for now, I have to go to that specific XML file, open it in Notepad, and save it as 'ANSI' instead of 'Unicode' before my script will work right.

I have tried adding the use ' $string' supplied in this thread, but I get this error:

Unknown PerlIO layer 'raw:perlio:encoding(UTF-16LE):crlf:utf8'

I really would like to create re-usable code out of my script, but I have yet to find the answer.


Comment on Re^2: Chicanery Needed to Handle Unicode Text on Microsoft Windows
Download Code
Replies are listed 'Best First'.
Re^3: Chicanery Needed to Handle Unicode Text on Microsoft Windows
by Anonymous Monk on Sep 26, 2012 at 18:38 UTC

    I have tried adding the use ' $string' supplied in this thread, but I get this error:

    Which perl version do you have?

Re^3: Chicanery Needed to Handle Unicode Text on Microsoft Windows
by Anonymous Monk on Sep 26, 2012 at 18:44 UTC

    open it in Notepad, and save it as 'ANSI' instead of 'Unicode' before my script will work right.

    You probably shouldn't do that :) save as UTF-8 instead

    iconv -f UTF-16 -t UTF-8 < in > out

    piconv -f UTF-16LE -t UTF-8 < in > out

Re^3: Chicanery Needed to Handle Unicode Text on Microsoft Windows
by Anonymous Monk on Sep 26, 2012 at 18:52 UTC

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://995682]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others contemplating the Monastery: (7)
As of 2015-07-31 03:11 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    The top three priorities of my open tasks are (in descending order of likelihood to be worked on) ...









    Results (274 votes), past polls