Search Results for "robots"

ahCrawler is a set to implement your own search on your website and an analyzer for your web content. It can be used on a shared hosting. It consists of * crawler (spider) and indexer * search for your website(s) * search statistics * website analyzer (http header, short titles and keywords, linkchecker, ...) You need to install it on your own server. So all crawled data stay in your environment. You never know when an external webspider updated your content. Trigger a rescan...

The GoodStat system is a web application, operating in the hosting environment, counting the statistics of entries, page views and much more. After downloading you will be able to install it yourself on your hosting. The data can be read as soon as the installation is completed and pasted into a monitored page on each subpage, a special JavaScript code. I would like to share with you the script I created called the GoodStat System. You will probably think that the name is a little bit...

osFaq is a dynamic FAQ (Frequently Asked Questions) module which can be quickly modified to suit a range of website systems. See the osFaq website for more information.

Adds a bottrap to the blog system b2evolution which can be simply installed and protects from adress crawlers and other robots which ignore the robots exclusion standard.

bot-trap is a small and simple package that uses PHP to ban web robots which ignore your robots.txt file. It also allows human users to unban themselves via a form.

PageCount is a kind of weblogger, logging either visits of real human or robots. In the log-details you get information about highly visited sites. Robots are marked in these statistics.

OpenAnonymity consists of a module for apache 2.0 Webserver and a framework that enables you to control search engine spider indexing on a word level, contrary to on file level as in Robots exclusion. OA could force Spiders to follow this rules.