Thread: [Quickfix-developers] Datestamp in Log File names
Brought to you by:
orenmnero
Menu
▾
▴
quickfix-developers
|
From: David S. <Dav...@ig...> - 2006-08-15 14:54:54
|
Is there any way to have the log files date stamped? The log files for our Price feed can get in excess of 100MB per day. We would like to have separate log files for each day so that we can clean up on a regular basis. =20 Thanks Dave The information contained in this email is strictly confidential and for = the use of the addressee only, unless otherwise indicated. If you are not= the intended recipient, please do not read, copy, use or disclose to oth= ers this message or any attachment. Please also notify the sender by repl= ying to this email or by telephone +44 (0)20 7896 0011 and then delete th= e email and any copies of it. Opinions, conclusions (etc.) that do not re= late to the official business of this company shall be understood as neit= her given nor endorsed by it. IG Markets Limited and IG Index Plc are aut= horised and regulated by the Financial Services Authority and, in Austral= ia, by the Australian Securities and Investments Commission. |
|
From: Andrew M. <an...@nm...> - 2006-08-15 15:15:22
|
>Is there any way to have the log files date stamped? The log files
>for our Price feed can get in excess of 100MB per day. We would like
>to have separate log files for each day so that we can clean up on a
>regular basis.
Does your application stop each night? I'm doing something like this in
the batch file that starts my app daily... You could do something similar
in fewer lines if you're not running windows...
REM assign d to date without time
for /f "tokens=1,2" %%u in ('date /t') do set d=%%v
REM strip off century from year
set timestr=%d:~6,4%%d:~3,2%%d:~0,2%
for %%F in (store_prod) do (
for /F %%D in ("%%~tF") do (
set mdate=%%D
)
)
for /F "tokens=2" %%D in ('date/t') do set cdate=%%D
REM ---THIS IS NEEDED ON WIN2K TO STRIP 2003 DOWN TO 03.
for /f "tokens=3" %%q in ('ver') do set x=%%q
rem if "%x%"=="XP" GOTO XP
rem set cdate=%cdate:~0,6%%cdate:~8,2%
:XP
for /F "tokens=1,2,3 delims=: " %%i in ('time /t') do set q=%%i%%j%%k
set datetime=%timestr%_%q%
ren c:\oms\oms.log oms_log.%datetime%
if "%cdate%"=="%mdate%" GOTO OK
echo "OMS being run for first time today - resetting store"
mkdir c:\oms\store_prod_%timestr%
move c:\oms\store_prod\*.* c:\oms\store_prod_%timestr%
del /Q c:\oms\store_prod
:OK
..start your application
|
|
From: Joerg T. <Joe...@ma...> - 2006-08-15 15:22:12
|
Hi Dave, > Is there any way to have the log files date stamped? The log files for > our Price feed can get in excess of 100MB per day. We would like to hav= e > separate log files for each day so that we can clean up on a regular > basis. If you were using Java, I would say: take Log4J and use the DailyRollingF= ileAppender. Maybe you can check something like log4c/log4cpp: http://log4c.sourceforge.net http://log4cpp.sourceforge.net and implement your own LogFactory delegating to log4c/cpp? I did not check which appenders are available, though. Cheers, J=F6rg --=20 Joerg Thoennes http://macd.com Tel.: +49 (0)241 44597-24 Macdonald Associates GmbH Fax : +49 (0)241 44597-10 Lothringer Str. 52, D-52070 Aachen |
|
From: David S. <Dav...@ig...> - 2006-08-16 07:18:23
|
Unfortunately our processes don't restart daily. Is there a quick and easy way to configure quickfix to not log at all? By means of a config flag or something? Thanks Dave The information contained in this email is strictly confidential and for = the use of the addressee only, unless otherwise indicated. If you are not= the intended recipient, please do not read, copy, use or disclose to oth= ers this message or any attachment. Please also notify the sender by repl= ying to this email or by telephone +44 (0)20 7896 0011 and then delete th= e email and any copies of it. Opinions, conclusions (etc.) that do not re= late to the official business of this company shall be understood as neit= her given nor endorsed by it. IG Markets Limited and IG Index Plc are aut= horised and regulated by the Financial Services Authority and, in Austral= ia, by the Australian Securities and Investments Commission. |
|
From: Oren M. <or...@qu...> - 2006-08-17 05:05:16
|
Passing a LogStoreFactory is optional. If you do not pass one in, no log files will be created. --oren On Aug 16, 2006, at 2:18 AM, David Stewart wrote: > QuickFIX Documentation: http://www.quickfixengine.org/quickfix/doc/ > html/index.html > QuickFIX Support: http://www.quickfixengine.org/services.html > > Unfortunately our processes don't restart daily. Is there a quick and > easy way to configure quickfix to not log at all? By means of a config > flag or something? > > Thanks > Dave > > > > The information contained in this email is strictly confidential > and for the use of the addressee only, unless otherwise indicated. > If you are not the intended recipient, please do not read, copy, > use or disclose to others this message or any attachment. Please > also notify the sender by replying to this email or by telephone > +44 (0)20 7896 0011 and then delete the email and any copies of it. > Opinions, conclusions (etc.) that do not relate to the official > business of this company shall be understood as neither given nor > endorsed by it. IG Markets Limited and IG Index Plc are authorised > and regulated by the Financial Services Authority and, in > Australia, by the Australian Securities and Investments Commission. > > > ---------------------------------------------------------------------- > --- > Using Tomcat but need to do more? Need to support web services, > security? > Get stuff done quickly with pre-integrated technology to make your > job easier > Download IBM WebSphere Application Server v.1.0.1 based on Apache > Geronimo > http://sel.as-us.falkag.net/sel? > cmd=lnk&kid=120709&bid=263057&dat=121642 > _______________________________________________ > Quickfix-developers mailing list > Qui...@li... > https://lists.sourceforge.net/lists/listinfo/quickfix-developers > |
|
From: David S. <Dav...@ig...> - 2006-08-17 08:41:38
|
Thanks Oren. I have also noticed that our resend file (.body) is getting very large also. Is there a way I can tell quickfix to just gap-fill any resend requests and thereby avoid the overhead of cacheing all the messages? As the fix engine is used for a price feed we don't particularly want to resend stale prices anyway. Thanks Dave =20 -----Original Message----- From: Oren Miller [mailto:or...@qu...]=20 Sent: 17 August 2006 06:05 To: David Stewart Cc: qui...@li... Subject: Re: [Quickfix-developers] Datestamp in Log File names Passing a LogStoreFactory is optional. If you do not pass one in, no log files will be created. --oren On Aug 16, 2006, at 2:18 AM, David Stewart wrote: > QuickFIX Documentation: http://www.quickfixengine.org/quickfix/doc/ > html/index.html > QuickFIX Support: http://www.quickfixengine.org/services.html > > Unfortunately our processes don't restart daily. Is there a quick and=20= > easy way to configure quickfix to not log at all? By means of a config > flag or something? > > Thanks > Dave > > > > The information contained in this email is strictly confidential and=20= > for the use of the addressee only, unless otherwise indicated. > If you are not the intended recipient, please do not read, copy, use=20= > or disclose to others this message or any attachment. Please also=20 > notify the sender by replying to this email or by telephone > +44 (0)20 7896 0011 and then delete the email and any copies of it. =20= > Opinions, conclusions (etc.) that do not relate to the official=20 > business of this company shall be understood as neither given nor=20 > endorsed by it. IG Markets Limited and IG Index Plc are authorised and > regulated by the Financial Services Authority and, in Australia, by=20 > the Australian Securities and Investments Commission. > > > ---------------------------------------------------------------------- > --- > Using Tomcat but need to do more? Need to support web services,=20 > security? > Get stuff done quickly with pre-integrated technology to make your job > easier Download IBM WebSphere Application Server v.1.0.1 based on=20 > Apache Geronimo http://sel.as-us.falkag.net/sel? > cmd=3Dlnk&kid=3D120709&bid=3D263057&dat=3D121642 > _______________________________________________ > Quickfix-developers mailing list > Qui...@li... > https://lists.sourceforge.net/lists/listinfo/quickfix-developers > The information contained in this email is strictly confidential and for = the use of the addressee only, unless otherwise indicated. If you are not= the intended recipient, please do not read, copy, use or disclose to oth= ers this message or any attachment. Please also notify the sender by repl= ying to this email or by telephone +44 (0)20 7896 0011 and then delete th= e email and any copies of it. Opinions, conclusions (etc.) that do not re= late to the official business of this company shall be understood as neit= her given nor endorsed by it. IG Markets Limited and IG Index Plc are aut= horised and regulated by the Financial Services Authority and, in Austral= ia, by the Australian Securities and Investments Commission. |
|
From: Oren M. <or...@qu...> - 2006-08-17 19:21:05
|
David, There is something that can be done about this. One question though, it is important for you to maintain sequence numbers when reloading your application or do you always start at 1? --oren On Aug 17, 2006, at 3:41 AM, David Stewart wrote: > QuickFIX Documentation: http://www.quickfixengine.org/quickfix/doc/ > html/index.html > QuickFIX Support: http://www.quickfixengine.org/services.html > > Thanks Oren. I have also noticed that our resend file (.body) is > getting > very large also. > Is there a way I can tell quickfix to just gap-fill any resend > requests > and thereby avoid the overhead of cacheing all the messages? > As the fix engine is used for a price feed we don't particularly > want to > resend stale prices anyway. > > Thanks > Dave > > > -----Original Message----- > From: Oren Miller [mailto:or...@qu...] > Sent: 17 August 2006 06:05 > To: David Stewart > Cc: qui...@li... > Subject: Re: [Quickfix-developers] Datestamp in Log File names > > Passing a LogStoreFactory is optional. If you do not pass one in, no > log files will be created. > > --oren > > On Aug 16, 2006, at 2:18 AM, David Stewart wrote: > >> QuickFIX Documentation: http://www.quickfixengine.org/quickfix/doc/ >> html/index.html >> QuickFIX Support: http://www.quickfixengine.org/services.html >> >> Unfortunately our processes don't restart daily. Is there a quick and >> easy way to configure quickfix to not log at all? By means of a >> config > >> flag or something? >> >> Thanks >> Dave >> >> >> >> The information contained in this email is strictly confidential and >> for the use of the addressee only, unless otherwise indicated. >> If you are not the intended recipient, please do not read, copy, use >> or disclose to others this message or any attachment. Please also >> notify the sender by replying to this email or by telephone >> +44 (0)20 7896 0011 and then delete the email and any copies of it. >> Opinions, conclusions (etc.) that do not relate to the official >> business of this company shall be understood as neither given nor >> endorsed by it. IG Markets Limited and IG Index Plc are authorised >> and > >> regulated by the Financial Services Authority and, in Australia, by >> the Australian Securities and Investments Commission. >> >> >> --------------------------------------------------------------------- >> - >> --- >> Using Tomcat but need to do more? Need to support web services, >> security? >> Get stuff done quickly with pre-integrated technology to make your >> job > >> easier Download IBM WebSphere Application Server v.1.0.1 based on >> Apache Geronimo http://sel.as-us.falkag.net/sel? >> cmd=lnk&kid=120709&bid=263057&dat=121642 >> _______________________________________________ >> Quickfix-developers mailing list >> Qui...@li... >> https://lists.sourceforge.net/lists/listinfo/quickfix-developers >> > > > > > The information contained in this email is strictly confidential > and for the use of the addressee only, unless otherwise indicated. > If you are not the intended recipient, please do not read, copy, > use or disclose to others this message or any attachment. Please > also notify the sender by replying to this email or by telephone > +44 (0)20 7896 0011 and then delete the email and any copies of it. > Opinions, conclusions (etc.) that do not relate to the official > business of this company shall be understood as neither given nor > endorsed by it. IG Markets Limited and IG Index Plc are authorised > and regulated by the Financial Services Authority and, in > Australia, by the Australian Securities and Investments Commission. > > > ---------------------------------------------------------------------- > --- > Using Tomcat but need to do more? Need to support web services, > security? > Get stuff done quickly with pre-integrated technology to make your > job easier > Download IBM WebSphere Application Server v.1.0.1 based on Apache > Geronimo > http://sel.as-us.falkag.net/sel? > cmd=lnk&kid=120709&bid=263057&dat=121642 > _______________________________________________ > Quickfix-developers mailing list > Qui...@li... > https://lists.sourceforge.net/lists/listinfo/quickfix-developers > |
|
From: Oren M. <or...@qu...> - 2006-08-17 21:02:19
|
David, I checked into source control support for the PersistMessages configuration setting. If this is set to 'N', the session will not store or retrieve messages from the message store. Instead it will respond to all ResendRequests with a single gap fill message. Try this out and see if it works for you. --oren On Aug 17, 2006, at 3:41 AM, David Stewart wrote: > QuickFIX Documentation: http://www.quickfixengine.org/quickfix/doc/ > html/index.html > QuickFIX Support: http://www.quickfixengine.org/services.html > > Thanks Oren. I have also noticed that our resend file (.body) is > getting > very large also. > Is there a way I can tell quickfix to just gap-fill any resend > requests > and thereby avoid the overhead of cacheing all the messages? > As the fix engine is used for a price feed we don't particularly > want to > resend stale prices anyway. > > Thanks > Dave > > > -----Original Message----- > From: Oren Miller [mailto:or...@qu...] > Sent: 17 August 2006 06:05 > To: David Stewart > Cc: qui...@li... > Subject: Re: [Quickfix-developers] Datestamp in Log File names > > Passing a LogStoreFactory is optional. If you do not pass one in, no > log files will be created. > > --oren > > On Aug 16, 2006, at 2:18 AM, David Stewart wrote: > >> QuickFIX Documentation: http://www.quickfixengine.org/quickfix/doc/ >> html/index.html >> QuickFIX Support: http://www.quickfixengine.org/services.html >> >> Unfortunately our processes don't restart daily. Is there a quick and >> easy way to configure quickfix to not log at all? By means of a >> config > >> flag or something? >> >> Thanks >> Dave >> >> >> >> The information contained in this email is strictly confidential and >> for the use of the addressee only, unless otherwise indicated. >> If you are not the intended recipient, please do not read, copy, use >> or disclose to others this message or any attachment. Please also >> notify the sender by replying to this email or by telephone >> +44 (0)20 7896 0011 and then delete the email and any copies of it. >> Opinions, conclusions (etc.) that do not relate to the official >> business of this company shall be understood as neither given nor >> endorsed by it. IG Markets Limited and IG Index Plc are authorised >> and > >> regulated by the Financial Services Authority and, in Australia, by >> the Australian Securities and Investments Commission. >> >> >> --------------------------------------------------------------------- >> - >> --- >> Using Tomcat but need to do more? Need to support web services, >> security? >> Get stuff done quickly with pre-integrated technology to make your >> job > >> easier Download IBM WebSphere Application Server v.1.0.1 based on >> Apache Geronimo http://sel.as-us.falkag.net/sel? >> cmd=lnk&kid=120709&bid=263057&dat=121642 >> _______________________________________________ >> Quickfix-developers mailing list >> Qui...@li... >> https://lists.sourceforge.net/lists/listinfo/quickfix-developers >> > > > > > The information contained in this email is strictly confidential > and for the use of the addressee only, unless otherwise indicated. > If you are not the intended recipient, please do not read, copy, > use or disclose to others this message or any attachment. Please > also notify the sender by replying to this email or by telephone > +44 (0)20 7896 0011 and then delete the email and any copies of it. > Opinions, conclusions (etc.) that do not relate to the official > business of this company shall be understood as neither given nor > endorsed by it. IG Markets Limited and IG Index Plc are authorised > and regulated by the Financial Services Authority and, in > Australia, by the Australian Securities and Investments Commission. > > > ---------------------------------------------------------------------- > --- > Using Tomcat but need to do more? Need to support web services, > security? > Get stuff done quickly with pre-integrated technology to make your > job easier > Download IBM WebSphere Application Server v.1.0.1 based on Apache > Geronimo > http://sel.as-us.falkag.net/sel? > cmd=lnk&kid=120709&bid=263057&dat=121642 > _______________________________________________ > Quickfix-developers mailing list > Qui...@li... > https://lists.sourceforge.net/lists/listinfo/quickfix-developers > |
|
From: David S. <Dav...@ig...> - 2006-08-18 08:26:13
|
Awesome! Thank you mate. I will try it out next week. Thanks Dave -----Original Message----- From: Oren Miller [mailto:or...@qu...]=20 Sent: 17 August 2006 22:02 To: David Stewart Cc: Qui...@li... Subject: Re: [Quickfix-developers] Datestamp in Log File names David, I checked into source control support for the PersistMessages configuration setting. If this is set to 'N', the session will not store or retrieve messages from the message store. Instead it will respond to all ResendRequests with a single gap fill message. Try this out and see if it works for you. --oren On Aug 17, 2006, at 3:41 AM, David Stewart wrote: > QuickFIX Documentation: http://www.quickfixengine.org/quickfix/doc/ > html/index.html > QuickFIX Support: http://www.quickfixengine.org/services.html > > Thanks Oren. I have also noticed that our resend file (.body) is=20 > getting very large also. > Is there a way I can tell quickfix to just gap-fill any resend=20 > requests and thereby avoid the overhead of cacheing all the messages? > As the fix engine is used for a price feed we don't particularly want=20= > to resend stale prices anyway. > > Thanks > Dave > > > -----Original Message----- > From: Oren Miller [mailto:or...@qu...] > Sent: 17 August 2006 06:05 > To: David Stewart > Cc: qui...@li... > Subject: Re: [Quickfix-developers] Datestamp in Log File names > > Passing a LogStoreFactory is optional. If you do not pass one in, no > log files will be created. > > --oren > > On Aug 16, 2006, at 2:18 AM, David Stewart wrote: > >> QuickFIX Documentation: http://www.quickfixengine.org/quickfix/doc/ >> html/index.html >> QuickFIX Support: http://www.quickfixengine.org/services.html >> >> Unfortunately our processes don't restart daily. Is there a quick and >> easy way to configure quickfix to not log at all? By means of a =20 >> config > >> flag or something? >> >> Thanks >> Dave >> >> >> >> The information contained in this email is strictly confidential and >> for the use of the addressee only, unless otherwise indicated. >> If you are not the intended recipient, please do not read, copy, use >> or disclose to others this message or any attachment. Please also >> notify the sender by replying to this email or by telephone >> +44 (0)20 7896 0011 and then delete the email and any copies of it. >> Opinions, conclusions (etc.) that do not relate to the official >> business of this company shall be understood as neither given nor >> endorsed by it. IG Markets Limited and IG Index Plc are authorised =20= >> and > >> regulated by the Financial Services Authority and, in Australia, by >> the Australian Securities and Investments Commission. >> >> >> --------------------------------------------------------------------- >> - >> --- >> Using Tomcat but need to do more? Need to support web services, >> security? >> Get stuff done quickly with pre-integrated technology to make your =20= >> job > >> easier Download IBM WebSphere Application Server v.1.0.1 based on >> Apache Geronimo http://sel.as-us.falkag.net/sel? >> cmd=3Dlnk&kid=3D120709&bid=3D263057&dat=3D121642 >> _______________________________________________ >> Quickfix-developers mailing list >> Qui...@li... >> https://lists.sourceforge.net/lists/listinfo/quickfix-developers >> > > > > > The information contained in this email is strictly confidential =20 > and for the use of the addressee only, unless otherwise indicated. =20 > If you are not the intended recipient, please do not read, copy, =20 > use or disclose to others this message or any attachment. Please =20 > also notify the sender by replying to this email or by telephone =20 > +44 (0)20 7896 0011 and then delete the email and any copies of it. =20= > Opinions, conclusions (etc.) that do not relate to the official =20 > business of this company shall be understood as neither given nor =20 > endorsed by it. IG Markets Limited and IG Index Plc are authorised =20 > and regulated by the Financial Services Authority and, in =20 > Australia, by the Australian Securities and Investments Commission. > > > ---------------------------------------------------------------------- > --- > Using Tomcat but need to do more? Need to support web services, =20 > security? > Get stuff done quickly with pre-integrated technology to make your =20 > job easier > Download IBM WebSphere Application Server v.1.0.1 based on Apache =20 > Geronimo > http://sel.as-us.falkag.net/sel?=20 > cmd=3Dlnk&kid=3D120709&bid=3D263057&dat=3D121642 > _______________________________________________ > Quickfix-developers mailing list > Qui...@li... > https://lists.sourceforge.net/lists/listinfo/quickfix-developers > The information contained in this email is strictly confidential and for = the use of the addressee only, unless otherwise indicated. If you are not= the intended recipient, please do not read, copy, use or disclose to oth= ers this message or any attachment. Please also notify the sender by repl= ying to this email or by telephone +44 (0)20 7896 0011 and then delete th= e email and any copies of it. Opinions, conclusions (etc.) that do not re= late to the official business of this company shall be understood as neit= her given nor endorsed by it. IG Markets Limited and IG Index Plc are aut= horised and regulated by the Financial Services Authority and, in Austral= ia, by the Australian Securities and Investments Commission. |
|
From: David S. <Dav...@ig...> - 2006-08-18 16:38:02
|
Oren, I have tested the changes you made and they work fine. Thank you very much for such a speedy response.=20 Just for your information, I was testing our price feed today and after 2 hours it had generated a 1GB .body file and a 68MB .header file. That was subscribing to about 3600 instruments. Other feeds subscribe to over 10 thousand! I think this change could be a real life saver for anyone using QuickFIX for pricing ;-) Thanks for the great work. Have a good weekend. Cheers Dave -----Original Message----- From: Oren Miller [mailto:or...@qu...]=20 Sent: 17 August 2006 22:02 To: David Stewart Cc: Qui...@li... Subject: Re: [Quickfix-developers] Datestamp in Log File names David, I checked into source control support for the PersistMessages configuration setting. If this is set to 'N', the session will not store or retrieve messages from the message store. Instead it will respond to all ResendRequests with a single gap fill message. Try this out and see if it works for you. --oren The information contained in this email is strictly confidential and for = the use of the addressee only, unless otherwise indicated. If you are not= the intended recipient, please do not read, copy, use or disclose to oth= ers this message or any attachment. Please also notify the sender by repl= ying to this email or by telephone +44 (0)20 7896 0011 and then delete th= e email and any copies of it. Opinions, conclusions (etc.) that do not re= late to the official business of this company shall be understood as neit= her given nor endorsed by it. IG Markets Limited and IG Index Plc are aut= horised and regulated by the Financial Services Authority and, in Austral= ia, by the Australian Securities and Investments Commission. |
