Work at SourceForge, help us to make it a better place! We have an immediate need for a Support Technician in our San Francisco or Denver office.

Close

Having problem adding new robot to robots.pm

2013-11-06
2013-11-08
  • In my stats I see hits from:

    static-208-80-194-138.as13448.com

    (it's websense)

    I'd like to add that as a robot.

    In my robots.pm I tried adding:

    @RobotsSearchIDOrder_list2 = (
    ....etc...
    'as[0-9][0-9][0-9][0-9][0-9].com',

    and adding:

    %RobotsHashIDLib = (
    ....etc...
    'as[0-9][0-9][0-9][0-9][0-9].com', 'Websense',

    Now, I added those pretty low in the two lists, so maybe I just need to raise them, does the pattern matching make sense here? To me the docs are "weird" in that the "key" seems to be a pattern also (?).

    Just need some assurance that I'm going in the right direction.

     
  • I think that's the right direction, and that there is no problem if the "key" is a pattern, but: Where did you get "static-208-80-194-138.as13448.com" from? This has to be a part of the user agent string, as (according to my knowledge) AWStats applies the rules contained in robots.pm to the user agent string only.

     
  • Really, from the user agent string? Interesting. I'll look into that, thanks!