All traffic showing "Not viewed traffic"

Developers
2009-08-18
2012-10-11
  • Satyanarayana Padhy

    Hi,

    I am new to AWStats. I am using awstat to produce report for IIS6 logs. The logs reports were getting generated correctly untill there was some modification in log formate. And after AWStats showing that all traffic is "Not viewed traffic".
    my logformate is as follow:
    2 - Old IIS log format (IIS W3C log format).
    one part of log is as follow:
    2009-03-14 00:00:21 W3SVC659895773 138.220.6.25 GET /ext/DDPQQ/images/arrow_blue.gif - 80 - 10.185.18.83 Opera/9.63+(Windows+NT+6.0;+U;+pl)+Presto/2.1.1 200
    0 0
    2009-03-14 00:00:25 W3SVC659895773 138.220.6.25 POST /ext/DDPQQ/member.do?method=getMembers - 80 - 10.185.18.83 Opera/9.63+(Windows+NT+6.0;+U;+pl)+Presto/2.1
    .1 200 0 0
    2009-03-14 00:00:29 W3SVC659895773 138.220.6.25 POST /ext/DDPQQ/member.do?method=getMembers - 80 - 10.185.18.83 Opera/9.63+(Windows+NT+6.0;+U;+pl)+Presto/2.1
    .1 200 0 0
    2009-03-14 00:00:30 W3SVC659895773 138.220.6.25 GET /ext/ddpreports/ViewDimensions?REPORT_ID=9147&REQUEST_TYPE=VIEWADVANCED&WSP=N&HF=N - 80 - 10.185.18.83 Mo
    zilla/5.0+(Windows;+U;+Windows+NT+5.1;+en-US;+rv:1.9.0.7)+Gecko/2009021910+Firefox/3.0.7 200 0 0
    2009-03-14 00:00:31 W3SVC659895773 138.220.6.25 GET /ext/ddpreports/ViewSharedReport?REPORT_ID=7136&REQUEST_TYPE=VIEWADVANCED&HF=N&WSP=N - 80 - 10.185.18.83
    Mozilla/5.0+(Windows;+U;+Windows+NT+5.1;+en-US;+rv:1.9.0.7)+Gecko/2009021910+Firefox/3.0.7 200 0 0
    2009-03-14 00:00:31 W3SVC659895773 138.220.6.25 GET /ext/ddpreports/html-jsp/images/ico_info_dot.gif - 80 - 10.185.18.83 Mozilla/5.0+(Windows;+U;+Windows+NT+
    5.1;+en-US;+rv:1.9.0.7)+Gecko/2009021910+Firefox/3.0.7 200 0 0
    2009-03-14 00:00:45 W3SVC659895773 138.220.6.25 POST /ext/DDPQQ/member.do?method=getMembers - 80 - 10.185.18.83 Opera/9.63+(Windows+NT+6.0;+U;+pl)+Presto/2.1
    .1 200 0 0
    2009-03-14 00:00:49 W3SVC659895773 138.220.6.25 GET /ext/DDPQQ/member.do?method=getMembers&userid=1&queryId=6 - 80 - 10.185.18.83 Mozilla/4.0+(compatible;+MS
    IE+7.0;+Windows+NT+5.1;+.NET+CLR+1.1.4322;+.NET+CLR+2.0.50727;+.NET+CLR+3.0.4506.2152;+.NET+CLR+3.5.30729) 200 0 0
    2009-03-14 00:00:49 W3SVC659895773 138.220.6.25 GET /ext/ddpreports/html-jsp/images/style.css - 80 - 10.185.18.83 Mozilla/5.0+(compatible;+Yahoo!+Slurp/3.0;+
    http://help.yahoo.com/help/us/ysearch/slurp) 304 0 0

    Please help me to find out why all traffic going to "Not viewed traffic" and how to fix it.

     
    • Jean-Luc

      Jean-Luc - 2009-08-19

      Hi,

      There are several known problems with LogFormat=2. Please paste here the line "#Fields:" line from your log file.

      Jean-Luc
      http://www.internetofficer.com/awstats/

       
      • Satyanarayana Padhy

        jean_luc,
        Thanks for trying to help me. The deatil you asked for is as follow.

        Fields: date time s-sitename s-ip cs-method cs-uri-stem cs-uri-query s-port cs-username c-ip cs(User-Agent) sc-status sc-substatus sc-win32-status

        Even I remove cs-uri-query column from log file and tried to generate but still same problem happening.

        I tried

         
    • Jean-Luc

      Jean-Luc - 2009-08-19

      Your log file is not compatible with AWStats because it does not contain the sc-bytes field (called %bytesd by AWStats). You can fool AWStats with this LogFormat definition :

      LogFormat = "%time2 %other %other %method %url %query %other %logname %host %ua %code %other %bytesd"

      Your reports will be valid except for the bandwidth and number of bytes.

      Jean-Luc
      http://www.internetofficer.com/awstats/

       
      • Satyanarayana Padhy

        Jean-Luc,

        Thank you very much.
        It worked as you said.
        Its great help to me.

        Regards
        Satya

         
  • Phil

    Phil - 2009-09-24

    Sorry if I enter in this thread.

    I have this fields:
    LogFormat="date time c-ip cs-username cs-method cs-uri-stem cs-uri-query
    sc-status sc-bytes cs-version cs(User-Agent) cs(Referer)"

    You know the keywords to put in the conf file?

    Thanks

    Phil

     
  • Jean-Luc

    Jean-Luc - 2009-09-24

    Hi,

    Try this :

    LogFormat="%time2 %host %logname %method %url %query %code %bytesd %other
    %ua %referer"

    I made a list that can help you convert IIS codes in AWStats codes at
    (http://www.internetofficer.com/awstats/log-
    format/)

    Jean-Luc, InternetOfficer

     
  • Phil

    Phil - 2009-09-24

    It drops all the records in the log file :(

     
  • Phil

    Phil - 2009-09-24

    Here an example line:

    2009-09-24 15:44:36 GET /image/travel/pagination_first.gif - - 94.143.103.164
    HTTP/1.1 Mozilla/4.0+(compatible;+MSIE+6.0;+Windows+NT+5.1;+SV1;+.NET+CLR+2.0.
    50727;+.NET+CLR+3.0.4506.2152;+.NET+CLR+3.5.30729) http://www.lets.it/it/Risu
    ltato.aspx?IdDestinazioni=Kenia
    106_107_108_109_111&IdAeroporti=Selezione+Multipla9377&
    DataDa=17/10/2009&DataA=31/10/2009 200 780

     
  • Jean-Luc

    Jean-Luc - 2009-09-24

    Please paste here the line starting with #Fields at the top of your log
    file.

    Jean-Luc, InternetOfficer - (http://www.internetofficer.com/awstats/)

     
  • Jean-Luc

    Jean-Luc - 2009-09-24

    This one should work :

    LogFormat="%time2 %method %url %query %other %host %other %ua %referer
    %code %bytesd"

    Jean-Luc, InternetOfficer - (http://www.internetofficer.com/awstats/)

     
  • Phil

    Phil - 2009-09-25

    Thank you Jean-Luc.. it works.. but I still have a lot of "not
    viewed" records.. any hints.

    If you want the log file you can find it here:
    http://nagios.tmind.com/jl.tar.bz

    Many thanks again

    Phil

     
  • Eric Villa Nova Orts

    Hi,

    I am triyng to get the stats from a nginx logs where all the requests cames
    from java client, and the problem is that awstats recognize this as robots or
    spiders.
    My logs format look like follow:

    10.0.3.1 - - "POST /whatever HTTP/1.1" 200 2446 "-" "Java/1.6.0_16" "-"

    Could someone help me with this please?

    Thanks in advance,

    Eric

     

Log in to post a comment.