Beefy Boxes and Bandwidth Generously Provided by pair Networks
laziness, impatience, and hubris

XML::Smart and UTF-8

by Kyshtynbai (Sexton)
on Jun 07, 2014 at 14:39 UTC ( #1089139=perlquestion: print w/replies, xml ) Need Help??

Kyshtynbai has asked for the wisdom of the Perl Monks concerning the following question:

Hi Monks! I have the following problem with CGI and XML::Smart. The short description: I get two parameters from GET request and pass them to XML::Smart methods to put them into xml file. The parameters I send are in Russian, so I use UTF-8 encoding. But when I do "cat xml/newfile.xml", all the info in tags is encoded to something weird. Like this:
cat xml/newfile.xml <?xml version="1.0" encoding="UTF-8" ?> <?meta name="GENERATOR" content="XML::Smart/1.78 Perl/5.014002 [linux] +" ?> <quotes> <txt>English text is fine</txt> <play>Really fine </play> <txt dt:dt="binary.base64">0KbQuNGC0LDRgtCwDQoK</txt> <play dt:dt="binary.base64">0J/QvtC/0L7QsdCw0LLQsAo=</play> </quotes>
I really don't know how to handle it. Here's some code of the script which adds this xml info:
#!/usr/bin/perl use strict; use XML::Smart; use CGI; use HTML::Template; use lib ('../'); use MySite; my $q = CGI->new(); my %params = MySite::get_params($q); my $add_quote_success= HTML::Template->new(filename =>'../templates/ad +d_quote_success.tmpl'); my $add_quote_error= HTML::Template->new(filename =>'../templates/add_ +quote_error.tmpl'); if ($ENV{REQUEST_METHOD} ne 'POST') { print "Content-type: text/html\n\n"; print "Stop wgetting this script."; } else { if (($params{txt} eq '') or ($params{play} eq '')) { print $q->header(-charset => 'utf-8'); print $add_quote_error->output; } else { my $XML = XML::Smart->new('../xml/newfile.xml'); my $counter = @{$XML->{quotes}{txt}}; $XML->{quotes}{txt}[$counter] = "$params{txt}\n"; $XML->{quotes}{play}[$counter] = "$params{play}\n"; $XML->save('../xml/newfile.xml'); print $q->header(-charset => 'utf-8'); print $add_quote_success->output; } }

Replies are listed 'Best First'.
Re: XML::Smart and UTF-8
by choroba (Archbishop) on Jun 07, 2014 at 14:53 UTC
    I don't work with XML::Smart. However, its documentation says, that this kind of encoding happens for binary data. Are you sure Perl knows your incoming data are UTF-8 encoded? (Is the data really Цитата and Попобава?)

    You can also try to directly specify you don't want to encode binary data by set_binary(0).

    لսႽ† ᥲᥒ⚪⟊Ⴙᘓᖇ Ꮅᘓᖇ⎱ Ⴙᥲ𝇋ƙᘓᖇ
      I'm not actually sure (but it is text, not binary data; it comes from common input type=text html field). And the data is as you've decoded.
Re: XML::Smart and UTF-8
by ikegami (Pope) on Jun 21, 2014 at 06:57 UTC

    1. It's so so wrong, but you need to encode the data before passing to to XML::Smart. You seem to be doing that already.

    2. You need to pass decode => 1 to save.

    use strict; use warnings; use Encode qw( encode_utf8 ); use XML::Smart qw( ); my $text = chr(0xC9); my $utf8 = encode_utf8($text); my $doc = XML::Smart->new('<?xml version="1.0" encoding="UTF-8"?><root +></root>'); $doc->{root}{node}{CONTENT} = $utf8; $doc->save('a.xml', decode=>1);

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: perlquestion [id://1089139]
Approved by vinoth.ree
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others exploiting the Monastery: (3)
As of 2020-09-26 02:29 GMT
Find Nodes?
    Voting Booth?
    If at first I don’t succeed, I …

    Results (141 votes). Check out past polls.