http://www.perlmonks.org?node_id=691683


in reply to Re: date of a web page
in thread date of a web page

Does the site provide rss-feeds? That might often give you more resonable data. How often do your script check these sites? If it checks reasonably often, you could maybe use your own time when the site lack something better?

Replies are listed 'Best First'.
Re^3: date of a web page
by Anonymous Monk on Jun 12, 2008 at 15:50 UTC
    no, unfortunatly not all sites offer rss yet, and even then, a lot don't contain dates. I don't want to run this all the time. Basically, I'd like to do a search on a particular topic on the site, get the results back, take those links and turn them into a date ordered list.