Beefy Boxes and Bandwidth Generously Provided by pair Networks
Clear questions and runnable code
get the best and fastest answer
 
PerlMonks  

Re^2: www.perlmonks.org vs. perlmonks.org

by lidden (Deacon)
on Oct 31, 2010 at 00:21 UTC ( #868528=note: print w/ replies, xml ) Need Help??


in reply to Re: www.perlmonks.org vs. perlmonks.org
in thread www.perlmonks.org vs. perlmonks.org

www.perlmonks.org has a different robots.txt from the other five. I guess that is a bug.


Comment on Re^2: www.perlmonks.org vs. perlmonks.org
Re^3: www.perlmonks.org vs. perlmonks.org
by ikegami (Pope) on Oct 31, 2010 at 00:23 UTC
    No, we don't want search engines indexing multiple version of the same page. It dilutes their usefulness and possibly the ranking of the pages.
      For SEO purposes I think it would be better to have a single live site and the rest should redirect to the same address.

      As it is now, some people will link to http://www.perlmonks.org/ others to http://perlmonks.org/ and the other addresses. That will divide the inbound links and reduce the page rank of each page. That's true for all the nodes.

      -- Weekend SEO expert

        As it is now, some people will link to http://www.perlmonks.org/ others to http://perlmonks.org/ and the other addresses.

        And they will promptly be told to use [id://] or [href://] for linking

Re^3: www.perlmonks.org vs. perlmonks.org
by BrowserUk (Pope) on Oct 31, 2010 at 00:29 UTC
    I guess that is a bug.

    Going by the comment in perlmonks.org/robots.txt, it is not a bug, but rather deliberate.

    Perhaps, www.perlmonks.org, serves only periodic, static snapshots, rather than server intensive, dynamic content?

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://868528]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others chanting in the Monastery: (5)
As of 2014-09-20 01:20 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    How do you remember the number of days in each month?











    Results (151 votes), past polls