Beefy Boxes and Bandwidth Generously Provided by pair Networks
good chemistry is complicated,
and a little bit messy -LW
 
PerlMonks  

Re: Get valid url

by soonix (Curate)
on Jun 03, 2013 at 22:12 UTC ( #1036848=note: print w/ replies, xml ) Need Help??


in reply to Get valid url

Your definition of "invalid" is incomplete.

  • "Formally valid" is easy.
  • 404 is relatively easy.
  • What about temporary failures? "Site maintenance, please check back in 5 minutes"?
  • "Bandwidth exceeded" - invalid for the rest of the month, then valid again?
  • What about corporate intranets - valid inside, invalid outside?
  • "This content is not available in your country?"


Comment on Re: Get valid url

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1036848]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others scrutinizing the Monastery: (5)
As of 2014-09-20 19:02 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    How do you remember the number of days in each month?











    Results (160 votes), past polls