From: <sfo...@ea...> - 2003-02-13 23:05:39
|
Hi, I've been dutifully crawling my own site, installing the grub.txt, and periodically running the local scan from http://brainbug.grub.org/localcrawling/local_crawl.php, and still I see OTHER people's grub-clients crawling my site. What gives? What's the point of keeping my own site's database info updated if everybody else is just going to redo what I've done? Doesn't grub-client honor the presence of a grub.txt? Thanks in advance to anybody who can clarify this for me. Suzanne Forgach |