Beefy Boxes and Bandwidth Generously Provided by pair Networks
Problems? Is your data what you think it is?

Re: Information Retrieval - Segmenting DOM Trees (Static vs Dynamic content)

by lin0 (Curate)
on Jan 15, 2007 at 19:35 UTC ( #594799=note: print w/replies, xml ) Need Help??

in reply to Information Retrieval - Segmenting DOM Trees (Static vs Dynamic content)

Hi perlmonkey2

You are bringing up some very interesting points. However, I think you should include some links providing background information to better illustrate what you were talking about. In any case...

In the field of web based information retrieval, a common problem encountered is discerning the interesting text in a web page. A human decides this based on the formatting, location, and content of the text.

Yes, we tend to analyse the content to determine what concepts are described and how those concepts relate to our previous experiences. In that sense, marking a text as interesting will always depend on the person doing the evaluation. One research area that could help you deal with concepts is Granular Computing. Granular Computing will also allow you to deal with different levels of abstraction helping you control the level of accuracy required for each leaf in the DOM tree. One paper that could interest you is: Information Granulation for Web based Information Retrieval Support Systems. Finally, it is important that you consider different ways of grouping the data (or creating information granules in Granular Computing terms) to see which one is more suitable for your particular application. For that, I will recommend you to have a look at clustering methods like those in Algorithm::Cluster or in Re: module for cluster analysis.

perlmonkey2, good luck with this project. Please keep us posted on how it progresses


  • Comment on Re: Information Retrieval - Segmenting DOM Trees (Static vs Dynamic content)

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://594799]
and all is quiet...

How do I use this? | Other CB clients
Other Users?
Others exploiting the Monastery: (7)
As of 2017-10-23 07:05 GMT
Find Nodes?
    Voting Booth?
    My fridge is mostly full of:

    Results (277 votes). Check out past polls.