Re: [Phpgedview-talk] Hiding PGV from spiders
Brought to you by:
canajun2eh,
yalnifj
From: Jonathan A. <jon...@he...> - 2007-07-15 17:56:54
|
Jane Ciosek wrote: I'd prefer to block spiders from indexing it. Is there any > way > to do this in the config settings? There used to be an html setting "no > follow" or something like that which I've used in the past and it seemed to > work, but do I have access to the raw html for phpgedview? > Thanks for any suggestions. > The instruction you are thinking of is: <meta name="robots" content="noindex,nofollow"> inserted in the Head part of your html pages. You could also try creating a robots.txt file containing just the following: User-agent: * Disallow: / This file goes in your documentroot. Of course, this being the Internet there is no guarantee that spiders will obey your requests, but I assume the site is password protected anyway :). The robots.txt file seems to work for me---Google at least doesn't index my site. Jon |