Beefy Boxes and Bandwidth Generously Provided by pair Networks
Your skill will accomplish
what the force of many cannot
 
PerlMonks  

Re: (OT) Robots disallow

by kyle (Abbot)
on Apr 01, 2009 at 15:24 UTC ( #754738=note: print w/ replies, xml ) Need Help??


in reply to (OT) Robots disallow

As others have noted, you're already doing the Right Thing to rid yourself of robots that play by the rules. You might be able to discourage badly behaved robots by creating a tar pit for it to wander into. The problems with this are many, and I'm not inclined to discuss them in any detail, but if you're in desperate times and looking for desperate measures, it's an idea worth consideration and probably rejection.


Comment on Re: (OT) Robots disallow

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://754738]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others wandering the Monastery: (11)
As of 2014-07-25 10:20 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    My favorite superfluous repetitious redundant duplicative phrase is:









    Results (170 votes), past polls