Work at SourceForge, help us to make it a better place! We have an immediate need for a Support Technician in our San Francisco or Denver office.

Close

#1630 AWStats corrupting Apache Log?

closed
None
5
2012-10-11
2005-02-12
Jan Rasche
No

Advanced Web Statistics 6.3 (build 1.801)

Just reload AWStats very much and had none traffic from
outside once - next time Awstats found Apache2 log
corruped from its own GETs:

Update for config "/etc/awstats/awstats.foobar.com.conf"
With data in log file "/opt/csw/apache2/logs/access_log"...
Phase 1 : First bypass old records, searching new record...
Direct access after last parsed record (after line 1657347)
AWStats did not find any valid log lines that match
your LogFormat parameter, in the 50th first non
commented lines read of your log.
Your log file /opt/csw/apache2/logs/access_log must
have a bad format or LogFormat parameter setup does not
match this format.
Your AWStats LogFormat parameter is:
1
This means each line in your web server log file need
to have "combined log format" like this:
111.22.33.44 - - [10/Jan/2001:02:14:14 +0200] "GET /
HTTP/1.1" 200 1234 "http://www.fromserver.com/from.htm"
"Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0)"
And this is an example of records AWStats found in your
log file (the record number 50 in your log):
217.230.158.75 - rasche [12/Feb/2005:11:55:20 +0100]
"GET /awstatsicons/os/sunos.png HTTP/1.1" 304 -
Setup ('/etc/awstats/awstats.foobar.com.conf' file, web
server or permissions) may be wrong.
Check config file, permissions and AWStats
documentation (in 'docs' directory).

Then after having some outside good GETs after the
AWStat wrong GETs in the log - AWStats script is
running fine again:

bash-2.05# tail -f /usr/local/apache2/logs/access_log
217.230.158.75 - rasche [12/Feb/2005:11:55:20 +0100]
"GET /awstatsicons/browser/mozilla.png HTTP/1.1" 304 -
217.230.158.75 - rasche [12/Feb/2005:11:55:20 +0100]
"GET /awstatsicons/browser/safari.png HTTP/1.1" 304 -
217.230.158.75 - rasche [12/Feb/2005:11:55:20 +0100]
"GET /awstatsicons/browser/opera.png HTTP/1.1" 304 -
217.230.158.75 - rasche [12/Feb/2005:11:55:21 +0100]
"GET /awstatsicons/browser/konqueror.png HTTP/1.1" 304 -
217.230.158.75 - rasche [12/Feb/2005:11:55:21 +0100]
"GET /awstatsicons/browser/phoenix.png HTTP/1.1" 304 -
217.230.158.75 - rasche [12/Feb/2005:11:55:21 +0100]
"GET /awstatsicons/browser/notavailable.png HTTP/1.1" 304 -
68.142.251.34 - - [12/Feb/2005:11:56:09 +0100] "GET
/c/coolio/coolio_mysoul_knightfall.html HTTP/1.0" 200
16940 "-" "Mozilla/5.0 (compatible; Yahoo! Slurp;
http://help.yahoo.com/help/us/yse
rch/slurp)"
66.249.65.40 - - [12/Feb/2005:11:58:46 +0100] "GET
/images/foobar.jpg HTTP/1.1" 200 22356 "-"
"Googlebot-Image/1.0"
65.54.188.98 - - [12/Feb/2005:12:01:55 +0100] "GET
/robots.txt HTTP/1.0" 200 96 "-" "msnbot/1.0
(+http://search.msn.com/msnbot.htm)"
65.54.188.98 - - [12/Feb/2005:12:01:55 +0100] "GET
/f/foobar.html HTTP/1.0" 200 18452 "-" "msnbot/1.0
(+http://search.msn.com/m
nbot.htm)"
^C
bash-2.05# u
Update for config "/etc/awstats/awstats.foobar.com.conf"
With data in log file "/opt/csw/apache2/logs/access_log"...
Phase 1 : First bypass old records, searching new record...
Direct access to last remembered record has fallen on
another record.
So searching new records from beginning of log file...
Phase 2 : Now process new records (Flush history on
disk after 20000 hosts)...
Jumped lines in file: 0
Parsed lines in file: 1657439
Found 459 dropped records,
Found 53641 corrupted records,
Found 1603310 old records,
Found 29 new qualified records.

Discussion

  • Logged In: YES
    user_id=96898

    Your web server setup must be wrong because your log file
    contains not combined but common log records (The records on
    AWStats)..
    So your web server is configured to have combined but not
    for awstats alias urls, so change your web server setup to
    have combined for all virtual areas (See Apache setup manual).