comment on

I am writing a CGI to take requests from a user and poll an assortment of online resources to find a range of possible results (think of a Meta-search engine, and you're on the right track). It then proceeds to dissect the resulting HTML from each of these resources, and presents it to the user in a single, unified interface.

Most of it works quite smoothly, thanks to the magic of LWP::Parallel. There is one little snag, though. The result may span multiple languages and character sets, and I need to put everything in a character set that is capable of presenting everything from Western Latin to Shift JIS. I'm guessing that UTF8 (or UTF16) will work for that purpose.

Now that I've got the setup out of the way, it's time for the question itself:

Assuming I am able to determine a string's original encoding, how would I convert that string to UTF8 (or some other encoding)?

Any kind of information would be helpful, including pointers to modules and documentation for me to "RTFM" :)

Thanks,
webfiend

"All you need is ignorance and confidence; then success is sure." -- Mark Twain

In reply to Character sets: converting to UTF8 with Perl 5.6? by webfiend

Are you posting in the right place? Check out Where do I post X? to know for sure.
Posts may use any of the Perl Monks Approved HTML tags. Currently these include the following:
<code> <a> <b> <big> <blockquote> <br /> <dd> <dl> <dt> <em> <font> <h1> <h2> <h3> <h4> <h5> <h6> <hr /> <i> <li> <nbsp> <ol> <p> <small> <strike> <strong> <sub> <sup> <table> <td> <th> <tr> <tt> <u> <ul>
Snippets of code should be wrapped in <code> tags not <pre> tags. In fact, <pre> tags should generally be avoided. If they must be used, extreme care should be taken to ensure that their contents do not have long lines (<70 chars), in order to prevent horizontal scrolling (and possible janitor intervention).
Want more info? How to link or How to display code and escape characters are good places to start.


Don't ask to ask, just ask
	PerlMonks