Joe - 2011-01-15


Awstats statistics discerns between visitors listed under the yellow heading
"Number of visitors" (we'll call "regular visitors") and unknown bots,
collectively named "bot" and "bot".

I keep running into the problem where when programmers and I try to write
htaccess code to block all bots except for googlebot, bingbot, and msnbot ,
the code also blocks regular visitors.

The bots I want to allow we coded like this

RewriteCond %{HTTP_USER_AGENT} !(googlebot|bingbot|msnbot)
RewriteRule .? -

But how do I code to block all other bots without blocking regular visitors?

Thanks For The Help,