Beefy Boxes and Bandwidth Generously Provided by pair Networks
Syntactic Confectionery Delight
 
PerlMonks  

Re: PerlMonks and Google

by Hero Zzyzzx (Curate)
on Apr 01, 2001 at 00:16 UTC ( #68706=note: print w/ replies, xml ) Need Help??


in reply to PerlMonks and Google

Sorry, this is a little off-topic, and not completely original, but interesting (at least to me) nonetheless.

I've done something similar to this: make a dynamic site appear static for the purpose of search engine indexing.

The way I did it was with the creation of each item, output an SSI statement into a file with proper parameters to call the dynamic content:
Example: I have a directory called "/redir/" that has all my SSI files in it. Each file is tiny, and looks something like this:
<!--#include virtual="/cgi-bin/process.pl?action=viewitem&id=97"--> Then each link on my site calls this SSI directive with the name "/redir/97.html". All the links look static but are created when requested because of the SSI trickery.

The "caught in an infinite indexing loop" is important to think about, I don't know how it would be handled on the perlmonks site.

Obviously google does index some dynamic content, as evidenced by jeffa's search above. Do we know how google decides what dynamic content to index? This whole point may be moot.


Comment on Re: PerlMonks and Google
Download Code
Re: Re: PerlMonks and Google
by stefp (Vicar) on Apr 01, 2001 at 00:26 UTC
    I have checked the word perlmonks on Google and there is almost nothing. There must be many perllmonks pages talking about perlmonks! So I doubt google indexes any page but explicitely submitted ones

    Probably jeffa explicitely submitted his page.

    -- stefp

      I did indeed. Most of the links are not pointing to perlmonks but to pages from other sites speaking of perlmonks like paris.pm.org/meetings/2000/0906.html/

      I suspect links to perlmonks have been either explicitely submitted or reached by Google from other sites. Following CGI requests within a site can lead to infinite recursion so I doubt this is ever done by an indexing motor.

      Self referential note: material in italic was not present in the first edition of this node

      -- stefp

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://68706]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others chilling in the Monastery: (10)
As of 2014-07-25 11:45 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    My favorite superfluous repetitious redundant duplicative phrase is:









    Results (170 votes), past polls