RE: [Phpgedview-talk] Google

[Joe T. <jo...@te...>]

I blocked google totally from my server. I don't worry about showing up on
them because they will pick up our site from all the other web crawlers,
they are pounding them too.

-----Original Message-----
From: php...@li...
[mailto:php...@li...]On Behalf Of Len
Sent: Saturday, August 27, 2005 2:00 PM
To: php...@li...
Subject: RE: [Phpgedview-talk] Google


Yeah, But much worse from inktomisearch
virtually all hits were from search engines

Finally killed them by putting robots.txt in the directory running
Phpgedview. in my case it was the "genealogy"

Len

-----Original Message-----
From: php...@li...
[mailto:php...@li...]On Behalf Of Ken
Lowther
Sent: Saturday, August 27, 2005 11:52 AM
To: php...@li...
Subject: [Phpgedview-talk] Google


Googlebot has been pounding my site.

http://genealogy.lowther.org/cgi-bin/awstats.pl

330 individuals on file:

http://genealogy.lowther.org/

Anyone else had this problem?  The only thing I can think is that is
chasing links around in circles.  Googlebot was connecte 24/7 using a
MINUMUM of 20% processor on a dual amd 64 2.3 ghz machine.  I was
experiencing times when the machine reponded to very litte so that is
what started me digging.

Ken


-------------------------------------------------------
SF.Net email is Sponsored by the Better Software Conference & EXPO
September 19-22, 2005 * San Francisco, CA * Development Lifecycle Practices
Agile & Plan-Driven Development * Managing Projects & Teams * Testing & QA
Security * Process Improvement & Measurement * http://www.sqe.com/bsce5sf
_______________________________________________
Phpgedview-talk mailing list
Php...@li...
https://lists.sourceforge.net/lists/listinfo/phpgedview-talk



-------------------------------------------------------
SF.Net email is Sponsored by the Better Software Conference & EXPO
September 19-22, 2005 * San Francisco, CA * Development Lifecycle Practices
Agile & Plan-Driven Development * Managing Projects & Teams * Testing & QA
Security * Process Improvement & Measurement * http://www.sqe.com/bsce5sf
_______________________________________________
Phpgedview-talk mailing list
Php...@li...
https://lists.sourceforge.net/lists/listinfo/phpgedview-talk