Beefy Boxes and Bandwidth Generously Provided by pair Networks
go ahead... be a heretic
 
PerlMonks  

Re^2: www.perlmonks.org vs. perlmonks.org

by lidden (Curate)
on Oct 31, 2010 at 00:21 UTC ( #868528=note: print w/ replies, xml ) Need Help??


in reply to Re: www.perlmonks.org vs. perlmonks.org
in thread www.perlmonks.org vs. perlmonks.org

www.perlmonks.org has a different robots.txt from the other five. I guess that is a bug.


Comment on Re^2: www.perlmonks.org vs. perlmonks.org
Re^3: www.perlmonks.org vs. perlmonks.org
by ikegami (Pope) on Oct 31, 2010 at 00:23 UTC
    No, we don't want search engines indexing multiple version of the same page. It dilutes their usefulness and possibly the ranking of the pages.
      For SEO purposes I think it would be better to have a single live site and the rest should redirect to the same address.

      As it is now, some people will link to http://www.perlmonks.org/ others to http://perlmonks.org/ and the other addresses. That will divide the inbound links and reduce the page rank of each page. That's true for all the nodes.

      -- Weekend SEO expert

        As it is now, some people will link to http://www.perlmonks.org/ others to http://perlmonks.org/ and the other addresses.

        And they will promptly be told to use [id://] or [href://] for linking

Re^3: www.perlmonks.org vs. perlmonks.org
by BrowserUk (Pope) on Oct 31, 2010 at 00:29 UTC
    I guess that is a bug.

    Going by the comment in perlmonks.org/robots.txt, it is not a bug, but rather deliberate.

    Perhaps, www.perlmonks.org, serves only periodic, static snapshots, rather than server intensive, dynamic content?

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://868528]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others romping around the Monastery: (5)
As of 2015-07-06 10:08 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    The top three priorities of my open tasks are (in descending order of likelihood to be worked on) ...









    Results (71 votes), past polls