Beefy Boxes and Bandwidth Generously Provided by pair Networks
XP is just a number
 
PerlMonks  

Re: Re: Invalid UTF8 data: namespace suggestion needed or wheel reinvented?

by liz (Monsignor)
on Mar 02, 2004 at 11:23 UTC ( #333220=note: print w/replies, xml ) Need Help??


in reply to Re: Invalid UTF8 data: namespace suggestion needed or wheel reinvented?
in thread Invalid UTF8 data: namespace suggestion needed or wheel reinvented?

How is the utf-8 usually being corrupted?

A good question. It's a system that has it roots in Perl 4 and which consists of hundreds of pages (CGI scripts) that are being used by many different people 24x7. And which is currently being migrated to a more manageable situation, so there is little point in trying to find out which users are doing what on which page causing the problem.

What exactly are you doing (are you just removing illegal characters? what else)?

Indeed. They're mostly free text entries of different sources in various languages.

Rules (is it configurable, or will it be, how)?

The only configuration that I see, would be the ability to list the tables to correct (defaulting to all). And how fields fixed are reported (either STDERR or calling a subroutine).

...it sounds like a script to me

Well, it is is a script now. But I dislike scripts as such, because you are never flexible enough. I'd rather have a simple script that calls a module, than that people start copying a script and start adapting it to their needs.

Liz

  • Comment on Re: Re: Invalid UTF8 data: namespace suggestion needed or wheel reinvented?

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://333220]
help
Chatterbox?
[perldigious]: Being the ignorant one, my initial reaction to that is, "that's sort of a dick move, a lot of people like me expect column names like that to stay the same, why the hell would you change them like that for seemingly no good reason?"
[perldigious]: Or is my irritation/ frustration well founded?
[Corion]: perldigious: That seems to be more the export and likely it's the recipients of that export that like the titles changes
[Corion]: ... "changed"
[Corion]: I usually expect fixed header names, but am sometimes lenient in the order of columns. But changing the report titles often sounds to me as if you are not the sole consument of the export ;)
[shmem]: perldigious: as always - if it ain't broke, don't fix it. Ther must be a very compelling reason for changing column names in a database. Those are rare.

How do I use this? | Other CB clients
Other Users?
Others cooling their heels in the Monastery: (8)
As of 2017-05-25 13:33 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?