Having problem adding new robot to robots.pm

2013-11-06
2013-11-08
  • Christopher Cox

    Christopher Cox - 2013-11-06

    In my stats I see hits from:

    static-208-80-194-138.as13448.com

    (it's websense)

    I'd like to add that as a robot.

    In my robots.pm I tried adding:

    @RobotsSearchIDOrder_list2 = (
    ....etc...
    'as[0-9][0-9][0-9][0-9][0-9].com',

    and adding:

    %RobotsHashIDLib = (
    ....etc...
    'as[0-9][0-9][0-9][0-9][0-9].com', 'Websense',

    Now, I added those pretty low in the two lists, so maybe I just need to raise them, does the pattern matching make sense here? To me the docs are "weird" in that the "key" seems to be a pattern also (?).

    Just need some assurance that I'm going in the right direction.

     
  • Albrecht Mueller

    I think that's the right direction, and that there is no problem if the "key" is a pattern, but: Where did you get "static-208-80-194-138.as13448.com" from? This has to be a part of the user agent string, as (according to my knowledge) AWStats applies the rules contained in robots.pm to the user agent string only.

     
  • Christopher Cox

    Christopher Cox - 2013-11-08

    Really, from the user agent string? Interesting. I'll look into that, thanks!

     

Log in to post a comment.

Get latest updates about Open Source Projects, Conferences and News.

Sign up for the SourceForge newsletter:





No, thanks