Beefy Boxes and Bandwidth Generously Provided by pair Networks
Pathologically Eclectic Rubbish Lister
 
PerlMonks  

Re^12: Super search use DuckDuckGo link broken (excluding special pages and noise)

by LanX (Saint)
on May 04, 2025 at 17:30 UTC ( [id://11164935]=note: print w/replies, xml ) Need Help??


in reply to Re^11: Super search use DuckDuckGo link broken (excluding special pages and noise)
in thread Super search use DuckDuckGo link broken

From my understanding one still needs a wildcard /* up front,( but I'm not sure)

Anyway you forgot ; as separator in searchstrings.

I'll suggest just /*displaytype= it should cover all cases and only searchstrings, since = is meta.

I thought I read that Google has a page for testing rules online, but I can't find it right now. *

FWIW: I read at Google that adbots are not covered by * and must be listed explicitly.

But I suppose those are not our biggest headache.

On a side note: adding rel='nofollow' to links posted by users should help frustrating spammers.

Edit

*) See https://support.google.com/webmasters/answer/6062598?hl=en

Couldn't test it since it requires a log in.

Update

Forgot to mention, I tried finding displaytype nodes with Google and DDG and the nofollow rules seem to be effective on site:www.perlmonks.org.

Other domains seem to show cached results.

Cheers Rolf
(addicted to the Perl Programming Language :)
see Wikisyntax for the Monastery

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://11164935]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others romping around the Monastery: (2)
As of 2026-02-08 04:50 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found

    Notices?
    hippoepoptai's answer Re: how do I set a cookie and redirect was blessed by hippo!
    erzuuliAnonymous Monks are no longer allowed to use Super Search, due to an excessive use of this resource by robots.