Beefy Boxes and Bandwidth Generously Provided by pair Networks
Welcome to the Monastery
 
PerlMonks  

Re: Encoding issue after upgrade

by ikegami (Patriarch)
on May 06, 2024 at 22:20 UTC ( [id://11159310]=note: print w/replies, xml ) Need Help??


in reply to Encoding issue after upgrade

I think this issue is related to the change from Perl version from 5.16.3 to 5.36.0.

Unlikely.

Any suggestions where I should look to solve this issue.

Provide a demonstration, such as a minimal program that exhibits the problem.

Replies are listed 'Best First'.
Re^2: Encoding issue after upgrade
by Bod (Parson) on May 06, 2024 at 22:48 UTC
    Provide a demonstration, such as a minimal program that exhibits the problem.

    If I knew how to reproduce the problem, I wouldn't be asking for places to look for the problem!

    In changing from one server setup to another, transferring the data from one instance of MariaDB to another via SQL dumpfiles, and running the same Perl scripts albeit under a different version of Perl, we have gone from correctly rendering webpages to webpages containing numerous  characters.

    An example blog post on our test site. The  characters did not appear prior to the change.

      Compare the database data bytewise (old versus new). Log each function's input arguments, compare the logs on the old and new systems. Run each function on the old and new system, compare the returned data (should have been covered by tests).

      map{substr$_->[0],$_->[1]||0,1}[\*||{},3],[[]],[ref qr-1,-,-1],[{}],[sub{}^*ARGV,3]
        Compare the database data bytewise (old versus new)

        Got it! Thank you.
        **kicks self for not noticing sooner**

        The rogue characters are all present in the database. So the problem was introduced during copying the data between database tables.

        It probably needs to be manually cleaned up as there is more data added since the move...

      If I knew how to reproduce the problem

      You didn't say anything about the problem being intermittent. You made it sound like it was the opposite, that you always got the junk characters with previously-inserted data. Is this not the case? That would make the problem reproducible.

      And since it is reproducible, the request is very straight forward. Simply remove everything that's not relevant. You can cut down on huge swaths of code by determining if it's a problem with the data coming from the DB, or if it's a problem with the output.

      If it truly isn't reproducible, then please re-explain the problem more clearly.

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://11159310]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others taking refuge in the Monastery: (4)
As of 2024-07-13 06:40 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found

    Notices?
    erzuuli‥ 🛈The London Perl and Raku Workshop takes place on 26th Oct 2024. If your company depends on Perl, please consider sponsoring and/or attending.