utf8 problems with Pod-ProjectDocs

I'm not sure if it's a bug or if I'm missing something...

My employer uses Pod::ProjectDocs for rendering CPAN like HTML for our modules.

But whatever I do German umlauts in UTF8 are rendered wrongly!

the HTML source shows

<p>
<p>Ã¤</p>

<p>Ã¶</p>

<p>Ã¼</p>


</div> 
[download]

while the POD has

=pod

=encoding utf8

ä

ö

ü

=cut
[download]

I've checked the meta-tag it shows content="text/html; charset=UTF-8" />

Adding or leaving =encoding utf8 doesn't help, the only result is a warning:

Unrecognized command 'encoding' skipped at /home/rolf/projects/cgi-bin
+/GLOBAL/DB/gedit_utf.pm line 1
[download]

Any ideas?

Cheers Rolf

Comment on utf8 problems with Pod-ProjectDocs Select or Download Code
Re: utf8 problems with Pod-ProjectDocs by sundialsvc4 (Monsignor) on Sep 24, 2012 at 23:05 UTC
Well, I admit that I might be shooting in the dark here, but ... In `perldoc perlpod` I read the following caveat: `And don’t forget, when using any command, that the command lasts up until the end of its paragraph, not its line. So in the examples below, you can see that every command needs the blank line after it, to end its paragraph.` (... which sure looks to me like one of those “doh-h-h!!” things that I am all too-familiar with.) I also notice from the documentation for Pod-ProjectDocs that the charset can also be specified there as a parameter. Now, my big question is (and it is one that I don’t know the answer to): does the UTF-8 character set support the German umlaut? Your quotation of the meta-tag ... well, I shall merely assume that there is a closing-quote after `text/html`. But, assuming this to be the case, I see that it does specify `UTF-8`, which rather makes me suspect that this encoding does not contain the character you seek. And if that be the case, then this is the real reason why the display is turning out wrongly.	[reply]
Re^2: utf8 problems with Pod-ProjectDocs by afoken (Parson) on Sep 25, 2012 at 05:42 UTC
Now, my big question is (and it is one that I don’t know the answer to): does the UTF-8 character set support the German umlaut? Sure it does. Unicode contains all characters available in ISO-8859-1, and ISO-8859-1 contains umlauts. I think it is quite safe to assume that Unicode supports nearly all written languages currently in use, and some ancient ones. Alexander -- Today I will gladly share my knowledge and experience, for there are no sweeter words than "I told you so". ;-)	[reply]
Re: utf8 problems with Pod-ProjectDocs by Anonymous Monk on Sep 25, 2012 at 00:32 UTC
It is a bug, Pod::ProjectDocs doesn't account for encoding, and it doesn't binmode input files	[reply]
Re: utf8 problems with Pod-ProjectDocs by remiah (Friar) on Sep 25, 2012 at 01:24 UTC
I couldn't fully trace this, nor understand all. If you are going to have some trial, 4 lines of dirty patch to ProjectDocs::Parse.pm seems to me work. 1. decode $self->{buffer} to character. Add 2 lines `use Encode qw/decode/; $self->{buffer}=decode('UTF-8', $self->{buffer});` [download] just after the line `$self->{buffer} = join "\n", qq[<div class="pod">], $self->{buffer}, " +</div>";` [download] ,which is in the "end_pos" sub. 2. encode $self->{buffer} back. Add 2 lines `use Encode(qw/encode/); $self->{buffer}=encode('UTF-8', $self->{buffer});` [download] just after `$self->SUPER::parse_from_file(@_);` [download] ,which is in "parse_from_file" sub. before SUPER::parse_from_file, it has no troble. after SUPER::parse_from_file, it is troubled. "end_pos" is callback from Pod::Parser.	[reply] [d/l] [select]
Re^2: utf8 problems with Pod-ProjectDocs by LanX (Monsignor) on Sep 25, 2012 at 11:02 UTC
Thanks! I recommended your patch to the maintainer of our installation. =) Cheers Rolf	[reply]


No such thing as a small change
	PerlMonks

utf8 problems with Pod-ProjectDocs

The best material for plates (tableware) is: