Beefy Boxes and Bandwidth Generously Provided by pair Networks
There's more than one way to do things

Re^2: date of a web page

by stiller (Friar)
on Jun 12, 2008 at 15:13 UTC ( #691683=note: print w/replies, xml ) Need Help??

in reply to Re: date of a web page
in thread date of a web page

Does the site provide rss-feeds? That might often give you more resonable data. How often do your script check these sites? If it checks reasonably often, you could maybe use your own time when the site lack something better?

Replies are listed 'Best First'.
Re^3: date of a web page
by Anonymous Monk on Jun 12, 2008 at 15:50 UTC
    no, unfortunatly not all sites offer rss yet, and even then, a lot don't contain dates. I don't want to run this all the time. Basically, I'd like to do a search on a particular topic on the site, get the results back, take those links and turn them into a date ordered list.

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://691683]
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others having an uproarious good time at the Monastery: (11)
As of 2016-10-25 14:05 GMT
Find Nodes?
    Voting Booth?
    How many different varieties (color, size, etc) of socks do you have in your sock drawer?

    Results (320 votes). Check out past polls.