By Mauro Perides <perides@cohab.sp.gov.br>:
There is any chance, in the future, that´s mySar work
with several squids running accross network like a
central log?
multiple logfiles can be done (as I've done with mlogimport,
it's just a matter of selecting a different logfile)
however, the data from multiple squid servers can't be told
apart from one to the next. also the current method of
importing traffic from the logfile involves keeping the
timestamp information stored in the configuration table.
which means as soon as you import the stamp information from
one logfile, any information in another logfile that's older
than that timestamp will automatically be ignored.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Using a more low level approach to track the latest import,
,like line number, could not only speed-up seeking in the
log file, but also allow this multi-log handling.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Logged In: YES
user_id=1466076
multiple logfiles can be done (as I've done with mlogimport,
it's just a matter of selecting a different logfile)
however, the data from multiple squid servers can't be told
apart from one to the next. also the current method of
importing traffic from the logfile involves keeping the
timestamp information stored in the configuration table.
which means as soon as you import the stamp information from
one logfile, any information in another logfile that's older
than that timestamp will automatically be ignored.
Logged In: YES
user_id=614087
Unless the log monitoring method changes.
Using a more low level approach to track the latest import,
,like line number, could not only speed-up seeking in the
log file, but also allow this multi-log handling.
Logged In: YES
user_id=1466076
with mlogimport, seeking a 150k+ logfile takes less than two
seconds, I see your point with the php importer because the
line processing is too slow.
unfortunately I havn't figured out how to store
file-line-seek information in C yet across different processes.