Beefy Boxes and Bandwidth Generously Provided by pair Networks
XP is just a number
 
PerlMonks  

Re: questions concerning using perl to monitor webpages

by Abigail-II (Bishop)
on May 22, 2003 at 00:56 UTC ( #259955=note: print w/replies, xml ) Need Help??


in reply to questions concerning using perl to monitor webpages

The HTTP protocol helps, as there is a "If-Modified-Since" header. So, you could use LWP, create an user agent, and an HTTP Request object, set the "If-Modified-Since" header, do the request, and look at the return status of the response. If the status is 304, the content hasn't changed. If the status is 200, the content has changed. For any other status, see RFC 2068.

Abigail

  • Comment on Re: questions concerning using perl to monitor webpages

Replies are listed 'Best First'.
Re: Re: questions concerning using perl to monitor webpages
by Trimbach (Curate) on May 22, 2003 at 02:00 UTC
    This is great in principle for truly static pages, but for CGI output the "If-modified-since" is, like, now. So it depends on what kind of pages you're going to fetch if this particular trick will work.

    It's dead easy to use, though, when it works. :-)

    Gary Blackburn
    Trained Killer

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://259955]
help
Chatterbox?
[LanX]: did you spam before? :)
LanX has to go/
[ambrus]: I hope we didn't mess up the spam filter rules again.
[ambrus]: Our spam filter rules disallow links to certain domains, and some suspicious pharses that have appeared in previous spam advertising cheap online whatevers.
[LanX]: some servers were lagging today, so I suppose the root cause
[LanX]: ambrus no recent patches
[Petroza]: no i haven't posted anything before. It was a more or less long question with a specific issue. I did post a title and the links i added where only part of the element i was searching within the code (so no purpose other than the question itself).
[1nickt]: Petroza can you go back in your browser to the preview screen, redact the links, and try to submit again?
[LanX]: copy and paste the text into your Petroza's scratchpad please
[Petroza]: yes I'll do that. instead of the url I'll write "link"

How do I use this? | Other CB clients
Other Users?
Others about the Monastery: (11)
As of 2017-10-17 15:24 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    My fridge is mostly full of:

















    Results (233 votes). Check out past polls.

    Notices?