Learn how easy it is to sync an existing GitHub or Google Code repo to a SourceForge project! See Demo

Close

#849 Bots List Wrong

open
nobody
5
2014-09-15
2011-02-11
geneman
No

In my Bots list I get these four entries

Unknown robot (identified by 'bot') 232+75 1.20 MB 11 Feb 2011 - 00:33
Java (Often spam bot) 102 1.51 MB 06 Feb 2011 - 15:20
Unknown robot (identified by '
bot') 12+12 205.10 KB 09 Feb 2011 - 20:55
Unknown robot (identified by 'crawl') 18+3 73.96 KB 10 Feb 2011 - 20:22

I looked in my RAW stats files and there is nothing like any of these names in there.

What is in Raw Stats, that may be one of these is Bingbot which DOES NOT show up on the Bot list at all.

I see NOTHING in my raw stats that does not have a proper name. AWSTATS needs to be refined to read these names better.

Discussion


  • Anonymous
    2011-03-01

    It may be related to following problem I've discovered right now:

    1) Problems concerns robots with regex including '[_+ ]' pattern
    2) These robots are properly detected in log files and their regex is put into raw awstats datafile
    3) While generating static html files these entries are not included / translated ! ! ERROR !

    I think the problems lies in space that is in the regex. Datafile fields are space divided, so the data is shifted because of the space and ill-read.

    My proposed solution is to replace all occurences of '[_+ ]' to '[_+\s]'. With me it works great!

    Please test it and if it is the case please update robots.pm accordingly.

    Krzysiek Madejski

     
    Last edit: Anonymous 11 hours ago