Beefy Boxes and Bandwidth Generously Provided by pair Networks
There's more than one way to do things
 
PerlMonks  

Re^2: www.perlmonks.org vs. perlmonks.org

by lidden (Curate)
on Oct 31, 2010 at 00:21 UTC ( [id://868528]=note: print w/replies, xml ) Need Help??


in reply to Re: www.perlmonks.org vs. perlmonks.org
in thread www.perlmonks.org vs. perlmonks.org

www.perlmonks.org has a different robots.txt from the other five. I guess that is a bug.
  • Comment on Re^2: www.perlmonks.org vs. perlmonks.org

Replies are listed 'Best First'.
Re^3: www.perlmonks.org vs. perlmonks.org
by ikegami (Patriarch) on Oct 31, 2010 at 00:23 UTC
    No, we don't want search engines indexing multiple version of the same page. It dilutes their usefulness and possibly the ranking of the pages.
      For SEO purposes I think it would be better to have a single live site and the rest should redirect to the same address.

      As it is now, some people will link to http://www.perlmonks.org/ others to http://perlmonks.org/ and the other addresses. That will divide the inbound links and reduce the page rank of each page. That's true for all the nodes.

      -- Weekend SEO expert

        As it is now, some people will link to http://www.perlmonks.org/ others to http://perlmonks.org/ and the other addresses.

        And they will promptly be told to use [id://] or [href://] for linking

Re^3: www.perlmonks.org vs. perlmonks.org
by BrowserUk (Patriarch) on Oct 31, 2010 at 00:29 UTC
    I guess that is a bug.

    Going by the comment in perlmonks.org/robots.txt, it is not a bug, but rather deliberate.

    Perhaps, www.perlmonks.org, serves only periodic, static snapshots, rather than server intensive, dynamic content?

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://868528]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others drinking their drinks and smoking their pipes about the Monastery: (3)
As of 2024-04-19 23:18 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found