Beefy Boxes and Bandwidth Generously Provided by pair Networks
Problems? Is your data what you think it is?
 
PerlMonks  

Re^2: My PerlTidy utility is choking on non-ASCII characters, help me figure out why?

by perl-diddler (Chaplain)
on Aug 25, 2016 at 17:38 UTC ( #1170463=note: print w/replies, xml ) Need Help??


in reply to Re: My PerlTidy utility is choking on non-ASCII characters, help me figure out why?
in thread My PerlTidy utility is choking on non-ASCII characters, help me figure out why?

The patches are to convert UTF-8 to an 8-bit encoding, which doesn't work -- the real problem goes much deeper since Perl::Tidy breaks down line input into bytes and processes things byte-by-byte (using maps for the "known 256 chars).... Such maps don't scale so well when you move up to the number of chars in Unicode. It looked to be close to a rewrite of the core code.

It's been an open bug since 2008 and doesn't look easy to fix so it hasn't been.

Expect to see it handle unicode sometime right after perlmonks does. ;-)

  • Comment on Re^2: My PerlTidy utility is choking on non-ASCII characters, help me figure out why?

Replies are listed 'Best First'.
Re^3: My PerlTidy utility is choking on non-ASCII characters, help me figure out why?
by kcott (Bishop) on Aug 26, 2016 at 12:07 UTC

    ++ Thanks for the feedback.

    — Ken

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1170463]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others chilling in the Monastery: (6)
As of 2019-11-22 18:33 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    Strict and warnings: which comes first?



    Results (113 votes). Check out past polls.

    Notices?