Beefy Boxes and Bandwidth Generously Provided by pair Networks
XP is just a number
 
PerlMonks  

Re^2: www.perlmonks.org vs. perlmonks.org

by lidden (Deacon)
on Oct 31, 2010 at 00:21 UTC ( #868528=note: print w/ replies, xml ) Need Help??


in reply to Re: www.perlmonks.org vs. perlmonks.org
in thread www.perlmonks.org vs. perlmonks.org

www.perlmonks.org has a different robots.txt from the other five. I guess that is a bug.


Comment on Re^2: www.perlmonks.org vs. perlmonks.org
Re^3: www.perlmonks.org vs. perlmonks.org
by ikegami (Pope) on Oct 31, 2010 at 00:23 UTC
    No, we don't want search engines indexing multiple version of the same page. It dilutes their usefulness and possibly the ranking of the pages.
      For SEO purposes I think it would be better to have a single live site and the rest should redirect to the same address.

      As it is now, some people will link to http://www.perlmonks.org/ others to http://perlmonks.org/ and the other addresses. That will divide the inbound links and reduce the page rank of each page. That's true for all the nodes.

      -- Weekend SEO expert

        As it is now, some people will link to http://www.perlmonks.org/ others to http://perlmonks.org/ and the other addresses.

        And they will promptly be told to use [id://] or [href://] for linking

Re^3: www.perlmonks.org vs. perlmonks.org
by BrowserUk (Pope) on Oct 31, 2010 at 00:29 UTC
    I guess that is a bug.

    Going by the comment in perlmonks.org/robots.txt, it is not a bug, but rather deliberate.

    Perhaps, www.perlmonks.org, serves only periodic, static snapshots, rather than server intensive, dynamic content?

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://868528]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others pondering the Monastery: (5)
As of 2014-12-22 03:39 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    Is guessing a good strategy for surviving in the IT business?





    Results (110 votes), past polls