Beefy Boxes and Bandwidth Generously Provided by pair Networks
laziness, impatience, and hubris
 
PerlMonks  

Re: Re: What are the monks doing with Perl and Linguistics?

by allolex (Curate)
on May 05, 2003 at 19:32 UTC ( #255730=note: print w/ replies, xml ) Need Help??


in reply to Re: What are the monks doing with Perl and Linguistics?
in thread What are the monks doing with Perl and Linguistics?

Sounds like interesting stuff.

Jon Kleinberg at Cornell is doing some research into topic "burst" identification in real-time text data streams. You can have a look at some of his preliminary results here. It might be interesting to compare whether your results match his. His stuff is all for English (of course).

I'd be curious to hear about how your doing your identification---I'm assuming a kind of basic separation of lexemes into categories (positive, negative, neutral), or do you have a level of abtraction there. If you'd like to share, you can reach me via e-mail from my homepage or /msg me.

Where the language modules are concerned, I really feel for you. Due to time constraints, we have kludged together a sentencizer for French because there was not one readily available to suit our needs, but due to everything else being prioritized above it, it is utter crap (does the job mostly right, but with unpredictable results).

--
Allolex


Comment on Re: Re: What are the monks doing with Perl and Linguistics?
Re: Re: Re: What are the monks doing with Perl and Linguistics?
by matsmats (Monk) on May 05, 2003 at 23:02 UTC

    I've kludged together a sentencizer for Norwegian (based on Text::Sentence) myself, so I know what you mean. It's not that bad, but the fact that some people are working at doing the same for audio streams is rather humbling.

    Kleinbergs work seems interesting. I vaguely remember reading about it in the news, so I look forward to looking into it.

    The negative/positive identifier is company work, so I'll probably be better of not elaborating on it for now.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://255730]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others browsing the Monastery: (8)
As of 2014-08-02 00:47 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    Who would be the most fun to work for?















    Results (53 votes), past polls