No matter how good your list of words, it won't be good enough. However, it would be interesting to look at an AI approach that used the word lists along with some knowledge of grammer to implement an AI alg. I know a previous poster had said AI is a failure, but I think an AI approach may serve you well here. I'm thinking about some kind of neural network might actually do a decent job.
Between knowing that most will be German, having word lists, etc, I feel like you could put together a relatively successful neural net to guess the language of a word. Of course it won't be error free, but I bet whatever your solution is to this hum-dinger, it will contain some errors.
Good luck! This is a terrific problem and I'd love to know how you solve it.
Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
Read Where should I post X? if you're not absolutely sure you're posting in the right place.
Please read these before you post! —
Posts may use any of the Perl Monks Approved HTML tags:
You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
- a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
Link using PerlMonks shortcuts! What shortcuts can I use for linking?
See Writeup Formatting Tips and other pages linked from there for more info.
| & || & |
| < || < |
| > || > |
| [ || [ |
| ] || ] ||