Work at SourceForge, help us to make it a better place! We have an immediate need for a Support Technician in our San Francisco or Denver office.

Close

#676 doesn't recognize tabs between fields

closed
None
6
2012-10-11
2002-03-15
Anonymous
No

AWSTATS VERSION (no support for older versions than 3.0 and beta
versions):3.2
OS (Windows/Unix) + VERSION : windows 2000 SP1
WEB SERVER NAME (IIS/Apache/...) + VERSION : Weblogic server
PERL INTERPRETER NAME + VERSION (if known) :
If your site is online, give your awstats URL: ?

Your problem description :

AWSTATS can't process weblogic extended log format files.
as far as I can tell, the reason for this is because the separator between fields is
a TAB and not a SPACE.
I couldn't find any reference to this in your FAQ or on the web.

when I change all the tabs to spaces, it works just fine.

any information would be appreciated.

cheers

Wiley

PS I also put quotes around the user agent and referer when I took out the tabs.

Discussion

  • Logged In: YES
    user_id=53583

    You're quite correct... AWStats assumes that field separators are
    spaces, you won't be able to process your log files with tab separated
    fields with the current version. The easiest way to hack together a
    working system would be to globally replace all of the tabs with spaces
    before processing your logs with AWStats.

    As an alternative, you
    can modify AWStats to split on tabs instead of spaces. This obviously
    isn't an option unless you know some Perl and are familiar with regular
    expressions. As a place to start you'd need to track down where
    awstats.pl sets up the $PerlParsingFormat string for your particular
    LogFormat... since I'd assume you're using a custom LogFormat
    awstats.pl probably builds your $PerlParsingFormat on the fly and
    doesn't use one of the static lines.

    Basically you'd need to replace
    all of the single space references in the regular expression that the
    routine builds with \t or tab references.

    I'll pass this problem on
    to the group and see if we can implement a change in the next version of
    AWStats to address this.

     
  • Logged In: YES
    user_id=96898

    I can fix this if you send me a sample of Weblogic extended
    logformat.

     
  • Logged In: YES
    user_id=96898

    I can fix this if you send me a sample of Weblogic extended
    logformat.

     
  • Wiley Fuller
    Wiley Fuller
    2002-03-24

    Logged In: YES
    user_id=495466

    Hi This is a sample of the weblogic extended log file
    format, I can email the file if you would like, I don't
    seem to be able to attach files though.


    Version: 1.0

    Fields: c-ip x-au.gov.qld.des.elflogger.LogDateTime

    cs-method cs-uri sc-status bytes x-
    au.gov.qld.des.elflogger.LogReferer x-
    au.gov.qld.des.elflogger.LogUserAgent time-taken
    127.0.0.1 2002-03-15 15-44-10 GET / 302
    0 - Mozilla/4.0 (compatible; MSIE 5.01;
    Windows NT 5.0) 0.188
    127.0.0.1 2002-03-15 15-44-12 POST
    /loadProgramRegion.do 302 0
    http://127.0.0.1:7001/startPage.jsp Mozilla/4.0
    (compatible; MSIE 5.01; Windows NT 5.0) 0.515
    127.0.0.1 2002-03-15 15-44-13 GET
    /style/portal.css 304 0
    http://127.0.0.1:7001/index.jsp Mozilla/4.0
    (compatible; MSIE 5.01; Windows NT 5.0) 0.047
    127.0.0.1 2002-03-15 15-44-13 GET
    /news/files/2357036.bin/tomato.jpg 200 0
    http://127.0.0.1:7001/index.jsp Mozilla/4.0
    (compatible; MSIE 5.01; Windows NT 5.0) 0.047
    127.0.0.1 2002-03-15 15-44-13 GET /index.jsp
    200 0 http://127.0.0.1:7001/startPage.jsp
    Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0)
    0.938
    127.0.0.1 2002-03-15 15-44-21 GET
    /news/files/866674.bin/a13-rabbit-sm.jpg 200
    0 http://127.0.0.1:7001/news/viewArticle.do?
    id=50 Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0)
    0.016
    127.0.0.1 2002-03-15 15-44-23 GET
    /news/newsItem.jsp 200 0
    http://127.0.0.1:7001/index.jsp Mozilla/4.0
    (compatible; MSIE 5.01; Windows NT 5.0) 9.484
    127.0.0.1 2002-03-15 15-44-23 GET
    /news/images/otherNews.gif 200 252
    http://127.0.0.1:7001/news/viewArticle.do?id=50
    Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0)
    0.0
    127.0.0.1 2002-03-15 15-44-23 GET
    /news/images/previousNews.gif 200 260
    http://127.0.0.1:7001/news/viewArticle.do?id=50
    Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0)
    0.0
    127.0.0.1 2002-03-15 15-44-32 GET
    /news/newsItem.jsp 200 0
    http://127.0.0.1:7001/news/viewArticle.do?id=50
    Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0)
    0.344
    127.0.0.1 2002-03-15 15-44-34 GET
    /news/newsItem.jsp 200 0
    http://127.0.0.1:7001/news/viewArticle.do?id=60
    Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0)
    0.281
    127.0.0.1 2002-03-15 15-44-36 GET
    /policiesProcedures/index.jsp 200 0
    http://127.0.0.1:7001/news/viewArticle.do?id=20
    Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0)
    0.109

     
  • Logged In: YES
    user_id=96898

    I made some change in AWStats 4.0 version (in build 57) to
    manage TAB like SPACE.