quickfix-developers — QuickFIX developers forum

Re: [Quickfix-developers] **** VERY IMPORTANT ***** Crashes in QuickFIX compiled with MS VC++ 6.0

[Caleb E. <cal...@gm...>]

On Mon, 23 Aug 2004 13:40:40 -0500, Oren Miller <or...@qu...> wrote:
> Why not just use STLPort?  http://www.stlport.org/

Indeed.  Using the STL included with VC6 is like walking through a
mine-field.  Use STLPort (low impact) or upgrade to VS.NET.

Re: [Quickfix-developers] MS VC++ release builds

[Oren M. <or...@qu...>]

Also, at the Dinkumware page on VC fixes (VC6 uses an old version of 
dinkumware), they give a couple of suggestions for circumventing the 
problem, one of which is to disable reference counting: 
http://www.dinkumware.com/vc_fixes.html

See the section on Fixes to <xstring>.  This will of course likely 
affect performance.

--oren

On Aug 24, 2004, at 4:52 AM, Antonio Caroselli wrote:

> Hi, Yihu and Tim.
>
> As you might have seen from my colleage's email to this newsgroup: 
> "****
> VERY IMPORTANT ***** Crashes in QuickFIX compiled with MS VC++ 6.0" 
> sent out
> yesterday, the reason for memory corruption and random crashes is the 
> use of
> STL strings in the QuickFix library when running our application in a
> multithreading environment (see
> http://support.microsoft.com/default.aspx?scid=kb;en-us;813810 ).
>
> We have been using MS VC++ 6 - SP5 to compile and link our application,
> which has been deployed under Windows 2000 SP4 on a computer with two 
> XEON
> processors plus hyperthreading enabled.
>
> Both Oren and Microsoft suggest to try a different STL from different
> suppliers (www.stlport.org [FREE] and www.dinkumware.com [NOT FREE]), 
> which
> might be a good choice if we want to keep using MS VC++ 6. On the 
> contrary,
> we might compile our application with Visual Studio .NET which seems 
> to have
> a thread-safe STL. Probably we shall try both options and go through a 
> new
> set of stress tests before taking a final decision.
>
> Anyway, we would avoid those code manipulations suggested by Microsoft 
> since
> that might unearth new problems in other areas.
>
> Bye,
>
> Antonio Caroselli
> GATE T.I.
> www.gatelab.com
>
>
>
> ----- Original Message -----
> From: "Yihu Fang" <Yih...@re...>
> To: "Timothy Yates" <Tim...@pa...>; "Antonio Caroselli"
> <ant...@ga...>
> Cc: "Oren Miller" <or...@qu...>;
> <qui...@li...>
> Sent: Friday, August 20, 2004 9:10 PM
> Subject: RE: [Quickfix-developers] MS VC++ release builds
>
>
> QuickFIX Documentation:
> http://www.quickfixengine.org/quickfix/doc/html/index.html
> QuickFIX FAQ: 
> http://www.quickfixengine.org/wikifix/index.php?QuickFixFAQ
> QuickFIX Support: http://www.quickfixengine.org/services.html
>
> Hi Antonio and Tim,
>
> It would be interesting to see what the real cause of the problems.
>
> We have been using MS VC7 compiler (Visual Studio .NET 2003) on Windows
> 2003 and XP and did not see the corrupted fields and reject messages.
> Maybe we should examine them more carefully.
>
> A few questions: (1) if the QuickFIX log shows correct FIX messages
> while the application shows error and rejects message, does it imply
> something wrong in the implementation of the application? (2) Is the
> application using the same compiler options as the QuickFIX library,
> e.g. multiplethread dll settings etc? (3) Is there any memory leak seen
> in the application after a long period of time?
>
> Thanks.
>
> -Yihu
>
> -----Original Message-----
> From: qui...@li...
> [mailto:qui...@li...] On Behalf Of
> Timothy Yates
> Sent: Friday, August 20, 2004 9:21 AM
> To: 'Antonio Caroselli'
> Cc: 'Oren Miller'; qui...@li...
> Subject: RE: [Quickfix-developers] MS VC++ release builds
>
> QuickFIX Documentation:
> http://www.quickfixengine.org/quickfix/doc/html/index.html
> QuickFIX FAQ:
> http://www.quickfixengine.org/wikifix/index.php?QuickFixFAQ
> QuickFIX Support: http://www.quickfixengine.org/services.html
>
> Hi Antonio,
>
> I mentioned two distinct problems in my original email.
>
> The first of these related to random corruptions of field data in FIX
> messages, especially during periods of heavy traffic.  These problems
> occurred in an MS VC++ quickfix application.  Once or twice, we saw the
> same
> CompID error you refer to. Typically, the corrupted field data 
> contained
> parts of other FIX fields from the same message.
>
> We were never able to track down the cause of these corruptions -- we
> found
> the problem very hard to reproduce. However, turning off compiler
> optimizations did seem to improve the situation considerably.  If you
> can
> find out the cause of this probem, I would be very interested.
>
> The second problem related to the Java version of QuickFIX on Windows
> XP.
> This problem seems to be related to hyperthreading (possibly in
> combination
> with hot-spot compilation).  When I disabled hyperthreading on the host
> machine, this problem went away -- it doesn't seem to be related to the
> first problem as I initially thought.
>
> Tim
>
> -----Original Message-----
> From: Antonio Caroselli [mailto:ant...@ga...]
> Sent: Friday, August 20, 2004 3:53 AM
> To: Timothy Yates
> Cc: 'Oren Miller'; qui...@li...
> Subject: Re: [Quickfix-developers] MS VC++ release builds
>
>
> Dear Tim,
>
> We are experiencing the same problems described in your email dated 
> June
> 14/2004.
>
> We are using MS VC++ 6 SP5 with default compilation and link options 
> and
> QuickFix 1.7.1. The target application is being run under Windows 
> Server
> 2000 SP4.
>
> In most cases we detected memory errors on incoming messages: we often
> get
> the error "Message nn rejected: CompID problem" even if the FIX message
> logged in our log file via the QuickFix log function shows correct tags
> and
> values. It may happen that we have such a problem once or twice in a 
> day
> under heavy traffic conditions, mostly on incoming messages. In few
> cases
> this possible memory problem also caused outgoing messages to be
> truncated.
>
> At times (not always) this problem is followed by an application crash:
> we
> do not get any application fault window since the application simply
> disappears from the Task Manager.
>
> I have seen Oren's suggestion about the callstack. Did that help you
> solve
> your problem ? We might try and use QuickFix 1.8.0, but the release
> notes do
> not seem to address this problem.
>
> Any help will be greatly appreciated
>
> Bye,
>
> Antonio Caroselli
> GATE T.I.
> www.gatelab.com
>
>
>
> ----- Original Message -----
> From: "Timothy Yates" <Tim...@pa...>
> To: "'Oren Miller'" <or...@qu...>
> Cc: <qui...@li...>
> Sent: Monday, June 14, 2004 5:30 PM
> Subject: RE: [Quickfix-developers] MS VC++ release builds
>
>
>> QuickFIX Documentation:
> http://www.quickfixengine.org/quickfix/doc/html/index.html
>> QuickFIX FAQ: http://www.quickfixengine.org/quickfix/doc/html/FAQ.html
>>
>> The callstack is not enabled.
>>
>> Tim.
>>
>> -----Original Message-----
>> From: Oren Miller [mailto:or...@qu...]
>> Sent: Monday, June 14, 2004 9:32 AM
>> To: Timothy Yates
>> Cc: qui...@li...
>> Subject: Re: [Quickfix-developers] MS VC++ release builds
>>
>>
>> Do you have the callstack enabled?
>>
>> --oren
>>
>> On Jun 14, 2004, at 8:39 AM, Timothy Yates wrote:
>>
>>> QuickFIX Documentation:
>>> http://www.quickfixengine.org/quickfix/doc/html/index.html
>>> QuickFIX FAQ:
> http://www.quickfixengine.org/quickfix/doc/html/FAQ.html
>>>
>>> Has anyone else had problems with apparently random crashes and
> memory
>>> corruptions in quickfix when using MS VC++, specifically using the
>>> default
>>> release build options?
>>>
>>> We have a C++ production application that uses quickfix.  We have
> had
>>> to
>>> build quickfix with all optimizations turned off.  We were unable to
>>> track
>>> down the memory corruptions that occurred with a release build.
>>>
>>> Recently, I have been using the Java version of quickfix.  I have a
>>> test
>>> application that generates MarketDataSnapshotFullRefresh messages
> and
>>> populates them with essentially random price data.  The receiving
>>> application sends a subscribe message and the test application
> starts
>>> sending refresh messages at a rate of about 20 per second.  When
> using
>>> a
>>> release build of quickfix_jni.dll, the receiving application often
>>> crashes
>>> after several hundred messages due to an access violation.  This
>>> typically
>>> occurs in the destructor call from Message.finalize(), other times
> in
>>> Group.finalize(), and othertime some place else.   I do a session
> reset
>>> between test runs.  Sometimes the application does not crash at all.
>>> I
>>> have tried disabling all processing of refresh messages by the
>>> receiving
>>> application (so it just returns from fromApp without doing
> anything),
>>> and
>>> the crashes still happen.
>>>
>>> The random nature of the crashes leads me to suspect a threading
> issue.
>>>
>>> When I use a debug build of quickfix_jni.dll, I can never get it to
>>> crash.
>>> This might just be luck, or it might indicate a problem with
> compiler
>>> optimizations.
>>>
>>> I think this problem may have something to do with repeating groups
> as
>>> I
>>> have only started noticing it since implementing market data
> support.
>>> However, it could just be that I have started stressing quickfix
> more
>>> than
>>> before.
>>>
>>> Interestingly, the corruptions we were experiencing in our
> production
>>> C++
>>> application also occurred when there was a large amount of market
> data
>>> traffic.
>>>
>>> I am using quickfix 1.7.0.
>>>
>>> Tim Yates
>>> Lead Developer
>>> Patsystems (US) LLC
>>> 141 West Jackson Boulevard
>>> Chicago 60604, USA
>>> Tel +1 (312) 542-1336
>>> www.patsystems.com
>>>
>>>
>>>
>>>
>>>
>>> -------------------------------------------------------
>>> This SF.Net email is sponsored by the new InstallShield X.
>>> From Windows to Linux, servers to mobile, InstallShield X is the
>>> one installation-authoring solution that does it all. Learn more and
>>> evaluate today! http://www.installshield.com/Dev2Dev/0504
>>> _______________________________________________
>>> Quickfix-developers mailing list
>>> Qui...@li...
>>> https://lists.sourceforge.net/lists/listinfo/quickfix-developers
>>>
>>
>>
>> -------------------------------------------------------
>> This SF.Net email is sponsored by the new InstallShield X.
>>> From Windows to Linux, servers to mobile, InstallShield X is the
>> one installation-authoring solution that does it all. Learn more and
>> evaluate today! http://www.installshield.com/Dev2Dev/0504
>> _______________________________________________
>> Quickfix-developers mailing list
>> Qui...@li...
>> https://lists.sourceforge.net/lists/listinfo/quickfix-developers
>>
>
>
> -------------------------------------------------------
> SF.Net email is sponsored by Shop4tech.com-Lowest price on Blank Media
> 100pk Sonic DVD-R 4x for only $29 -100pk Sonic DVD+R for only $33
> Save 50% off Retail on Ink & Toner - Free Shipping and Free Gift.
> http://www.shop4tech.com/z/Inkjet_Cartridges/9_108_r285
> _______________________________________________
> Quickfix-developers mailing list
> Qui...@li...
> https://lists.sourceforge.net/lists/listinfo/quickfix-developers
>
>
>
> -----------------------------------------------------------------
>         Visit our Internet site at http://www.reuters.com
>
> Get closer to the financial markets with Reuters Messaging - for more
> information and to register, visit http://www.reuters.com/messaging
>
> Any views expressed in this message are those of  the  individual
> sender,  except  where  the sender specifically states them to be
> the views of Reuters Ltd.
>
>
>
> -------------------------------------------------------
> SF.Net email is sponsored by Shop4tech.com-Lowest price on Blank Media
> 100pk Sonic DVD-R 4x for only $29 -100pk Sonic DVD+R for only $33
> Save 50% off Retail on Ink & Toner - Free Shipping and Free Gift.
> http://www.shop4tech.com/z/Inkjet_Cartridges/9_108_r285
> _______________________________________________
> Quickfix-developers mailing list
> Qui...@li...
> https://lists.sourceforge.net/lists/listinfo/quickfix-developers
>
>
>

Re: [Quickfix-developers] MS VC++ release builds

[Antonio C. <ant...@ga...>]

Hi, Yihu and Tim.

As you might have seen from my colleage's email to this newsgroup: "****
VERY IMPORTANT ***** Crashes in QuickFIX compiled with MS VC++ 6.0" sent out
yesterday, the reason for memory corruption and random crashes is the use of
STL strings in the QuickFix library when running our application in a
multithreading environment (see
http://support.microsoft.com/default.aspx?scid=kb;en-us;813810 ).

We have been using MS VC++ 6 - SP5 to compile and link our application,
which has been deployed under Windows 2000 SP4 on a computer with two XEON
processors plus hyperthreading enabled.

Both Oren and Microsoft suggest to try a different STL from different
suppliers (www.stlport.org [FREE] and www.dinkumware.com [NOT FREE]), which
might be a good choice if we want to keep using MS VC++ 6. On the contrary,
we might compile our application with Visual Studio .NET which seems to have
a thread-safe STL. Probably we shall try both options and go through a new
set of stress tests before taking a final decision.

Anyway, we would avoid those code manipulations suggested by Microsoft since
that might unearth new problems in other areas.

Bye,

Antonio Caroselli
GATE T.I.
www.gatelab.com



----- Original Message -----
From: "Yihu Fang" <Yih...@re...>
To: "Timothy Yates" <Tim...@pa...>; "Antonio Caroselli"
<ant...@ga...>
Cc: "Oren Miller" <or...@qu...>;
<qui...@li...>
Sent: Friday, August 20, 2004 9:10 PM
Subject: RE: [Quickfix-developers] MS VC++ release builds


QuickFIX Documentation:
http://www.quickfixengine.org/quickfix/doc/html/index.html
QuickFIX FAQ: http://www.quickfixengine.org/wikifix/index.php?QuickFixFAQ
QuickFIX Support: http://www.quickfixengine.org/services.html

Hi Antonio and Tim,

It would be interesting to see what the real cause of the problems.

We have been using MS VC7 compiler (Visual Studio .NET 2003) on Windows
2003 and XP and did not see the corrupted fields and reject messages.
Maybe we should examine them more carefully.

A few questions: (1) if the QuickFIX log shows correct FIX messages
while the application shows error and rejects message, does it imply
something wrong in the implementation of the application? (2) Is the
application using the same compiler options as the QuickFIX library,
e.g. multiplethread dll settings etc? (3) Is there any memory leak seen
in the application after a long period of time?

Thanks.

-Yihu

-----Original Message-----
From: qui...@li...
[mailto:qui...@li...] On Behalf Of
Timothy Yates
Sent: Friday, August 20, 2004 9:21 AM
To: 'Antonio Caroselli'
Cc: 'Oren Miller'; qui...@li...
Subject: RE: [Quickfix-developers] MS VC++ release builds

QuickFIX Documentation:
http://www.quickfixengine.org/quickfix/doc/html/index.html
QuickFIX FAQ:
http://www.quickfixengine.org/wikifix/index.php?QuickFixFAQ
QuickFIX Support: http://www.quickfixengine.org/services.html

Hi Antonio,

I mentioned two distinct problems in my original email.

The first of these related to random corruptions of field data in FIX
messages, especially during periods of heavy traffic.  These problems
occurred in an MS VC++ quickfix application.  Once or twice, we saw the
same
CompID error you refer to. Typically, the corrupted field data contained
parts of other FIX fields from the same message.

We were never able to track down the cause of these corruptions -- we
found
the problem very hard to reproduce. However, turning off compiler
optimizations did seem to improve the situation considerably.  If you
can
find out the cause of this probem, I would be very interested.

The second problem related to the Java version of QuickFIX on Windows
XP.
This problem seems to be related to hyperthreading (possibly in
combination
with hot-spot compilation).  When I disabled hyperthreading on the host
machine, this problem went away -- it doesn't seem to be related to the
first problem as I initially thought.

Tim

-----Original Message-----
From: Antonio Caroselli [mailto:ant...@ga...]
Sent: Friday, August 20, 2004 3:53 AM
To: Timothy Yates
Cc: 'Oren Miller'; qui...@li...
Subject: Re: [Quickfix-developers] MS VC++ release builds


Dear Tim,

We are experiencing the same problems described in your email dated June
14/2004.

We are using MS VC++ 6 SP5 with default compilation and link options and
QuickFix 1.7.1. The target application is being run under Windows Server
2000 SP4.

In most cases we detected memory errors on incoming messages: we often
get
the error "Message nn rejected: CompID problem" even if the FIX message
logged in our log file via the QuickFix log function shows correct tags
and
values. It may happen that we have such a problem once or twice in a day
under heavy traffic conditions, mostly on incoming messages. In few
cases
this possible memory problem also caused outgoing messages to be
truncated.

At times (not always) this problem is followed by an application crash:
we
do not get any application fault window since the application simply
disappears from the Task Manager.

I have seen Oren's suggestion about the callstack. Did that help you
solve
your problem ? We might try and use QuickFix 1.8.0, but the release
notes do
not seem to address this problem.

Any help will be greatly appreciated

Bye,

Antonio Caroselli
GATE T.I.
www.gatelab.com



----- Original Message -----
From: "Timothy Yates" <Tim...@pa...>
To: "'Oren Miller'" <or...@qu...>
Cc: <qui...@li...>
Sent: Monday, June 14, 2004 5:30 PM
Subject: RE: [Quickfix-developers] MS VC++ release builds


> QuickFIX Documentation:
http://www.quickfixengine.org/quickfix/doc/html/index.html
> QuickFIX FAQ: http://www.quickfixengine.org/quickfix/doc/html/FAQ.html
>
> The callstack is not enabled.
>
> Tim.
>
> -----Original Message-----
> From: Oren Miller [mailto:or...@qu...]
> Sent: Monday, June 14, 2004 9:32 AM
> To: Timothy Yates
> Cc: qui...@li...
> Subject: Re: [Quickfix-developers] MS VC++ release builds
>
>
> Do you have the callstack enabled?
>
> --oren
>
> On Jun 14, 2004, at 8:39 AM, Timothy Yates wrote:
>
> > QuickFIX Documentation:
> > http://www.quickfixengine.org/quickfix/doc/html/index.html
> > QuickFIX FAQ:
http://www.quickfixengine.org/quickfix/doc/html/FAQ.html
> >
> > Has anyone else had problems with apparently random crashes and
memory
> > corruptions in quickfix when using MS VC++, specifically using the
> > default
> > release build options?
> >
> > We have a C++ production application that uses quickfix.  We have
had
> > to
> > build quickfix with all optimizations turned off.  We were unable to
> > track
> > down the memory corruptions that occurred with a release build.
> >
> > Recently, I have been using the Java version of quickfix.  I have a
> > test
> > application that generates MarketDataSnapshotFullRefresh messages
and
> > populates them with essentially random price data.  The receiving
> > application sends a subscribe message and the test application
starts
> > sending refresh messages at a rate of about 20 per second.  When
using
> > a
> > release build of quickfix_jni.dll, the receiving application often
> > crashes
> > after several hundred messages due to an access violation.  This
> > typically
> > occurs in the destructor call from Message.finalize(), other times
in
> > Group.finalize(), and othertime some place else.   I do a session
reset
> > between test runs.  Sometimes the application does not crash at all.
> > I
> > have tried disabling all processing of refresh messages by the
> > receiving
> > application (so it just returns from fromApp without doing
anything),
> > and
> > the crashes still happen.
> >
> > The random nature of the crashes leads me to suspect a threading
issue.
> >
> > When I use a debug build of quickfix_jni.dll, I can never get it to
> > crash.
> > This might just be luck, or it might indicate a problem with
compiler
> > optimizations.
> >
> > I think this problem may have something to do with repeating groups
as
> > I
> > have only started noticing it since implementing market data
support.
> > However, it could just be that I have started stressing quickfix
more
> > than
> > before.
> >
> > Interestingly, the corruptions we were experiencing in our
production
> > C++
> > application also occurred when there was a large amount of market
data
> > traffic.
> >
> > I am using quickfix 1.7.0.
> >
> > Tim Yates
> > Lead Developer
> > Patsystems (US) LLC
> > 141 West Jackson Boulevard
> > Chicago 60604, USA
> > Tel +1 (312) 542-1336
> > www.patsystems.com
> >
> >
> >
> >
> >
> > -------------------------------------------------------
> > This SF.Net email is sponsored by the new InstallShield X.
> > From Windows to Linux, servers to mobile, InstallShield X is the
> > one installation-authoring solution that does it all. Learn more and
> > evaluate today! http://www.installshield.com/Dev2Dev/0504
> > _______________________________________________
> > Quickfix-developers mailing list
> > Qui...@li...
> > https://lists.sourceforge.net/lists/listinfo/quickfix-developers
> >
>
>
> -------------------------------------------------------
> This SF.Net email is sponsored by the new InstallShield X.
> >From Windows to Linux, servers to mobile, InstallShield X is the
> one installation-authoring solution that does it all. Learn more and
> evaluate today! http://www.installshield.com/Dev2Dev/0504
> _______________________________________________
> Quickfix-developers mailing list
> Qui...@li...
> https://lists.sourceforge.net/lists/listinfo/quickfix-developers
>


-------------------------------------------------------
SF.Net email is sponsored by Shop4tech.com-Lowest price on Blank Media
100pk Sonic DVD-R 4x for only $29 -100pk Sonic DVD+R for only $33
Save 50% off Retail on Ink & Toner - Free Shipping and Free Gift.
http://www.shop4tech.com/z/Inkjet_Cartridges/9_108_r285
_______________________________________________
Quickfix-developers mailing list
Qui...@li...
https://lists.sourceforge.net/lists/listinfo/quickfix-developers



-----------------------------------------------------------------
        Visit our Internet site at http://www.reuters.com

Get closer to the financial markets with Reuters Messaging - for more
information and to register, visit http://www.reuters.com/messaging

Any views expressed in this message are those of  the  individual
sender,  except  where  the sender specifically states them to be
the views of Reuters Ltd.



-------------------------------------------------------
SF.Net email is sponsored by Shop4tech.com-Lowest price on Blank Media
100pk Sonic DVD-R 4x for only $29 -100pk Sonic DVD+R for only $33
Save 50% off Retail on Ink & Toner - Free Shipping and Free Gift.
http://www.shop4tech.com/z/Inkjet_Cartridges/9_108_r285
_______________________________________________
Quickfix-developers mailing list
Qui...@li...
https://lists.sourceforge.net/lists/listinfo/quickfix-developers

Re: [Quickfix-developers] **** VERY IMPORTANT ***** Crashes in QuickFIX compiled with MS VC++ 6.0

[Oren M. <or...@qu...>]

Why not just use STLPort?  http://www.stlport.org/

On Aug 23, 2004, at 10:51 AM, Pasquale d'Aloise wrote:

> My application (compiled using Visual Studio 6.0)=A0is affected by=20
> random corruptions of data as other developers have mentioned.
> =A0
> I found a recent Microsoft article about STL string use in=20
> multithreading environment:
> http://support.microsoft.com/default.aspx?scid=3Dkb;en-us;813810
> that can explain such a behaviour.
> =A0
> In QuickFIX, common fields data, such as BeginString, SenderCompID,=20
> TargetCompID, are filled in message by copying them from the original=20=

> values in Session::m_sessionID (see the function Session::fill() );=20
> concurrently, the same values are accessed by the incoming messages=20
> thread to make validity checks (see the functions=20
> Session::isCorrectCompID()=A0and Session::next(const Message& message)=20=

> ).
> =A0
> Sometimes, especially during periods of heavy traffic, the reference=20=

> counting of the strings stored=A0in Session::m_sessionID might be=20
> updated wrongly as the above article explains. In these cases, the=20
> strings stored in Session::m_sessionID might be released and following=20=

> accesses will cause memory corruptions and crashes.
> =A0
> I'm going to protect all the simultaneous reads to shared=20
> std::string's with a mutex.
> =A0
> What do you think about?
> =A0
> Regards.
> Pasquale d'Aloise
> =A0

[Quickfix-developers] **** VERY IMPORTANT ***** Crashes in QuickFIX compiled with MS VC++ 6.0

[Pasquale d'A. <pas...@ga...>]

My application (compiled using Visual Studio 6.0) is affected by random =
corruptions of data as other developers have mentioned.

I found a recent Microsoft article about STL string use in =
multithreading environment:
http://support.microsoft.com/default.aspx?scid=3Dkb;en-us;813810
that can explain such a behaviour.

In QuickFIX, common fields data, such as BeginString, SenderCompID, =
TargetCompID, are filled in message by copying them from the original =
values in Session::m_sessionID (see the function Session::fill() ); =
concurrently, the same values are accessed by the incoming messages =
thread to make validity checks (see the functions =
Session::isCorrectCompID() and Session::next(const Message& message) ).

Sometimes, especially during periods of heavy traffic, the reference =
counting of the strings stored in Session::m_sessionID might be updated =
wrongly as the above article explains. In these cases, the strings =
stored in Session::m_sessionID might be released and following accesses =
will cause memory corruptions and crashes.

I'm going to protect all the simultaneous reads to shared std::string's =
with a mutex.

What do you think about?

Regards.
Pasquale d'Aloise

Re: [Quickfix-developers] Linux Compile Problems - QF1.8.0

[Oren M. <or...@qu...>]

The MySQLStoreFactory uses the default settings if nothing is passed 
into the constructor.  Either pass in your settings to the constructor 
for the test object, or change the default settings in MySQLStore.cpp

--oren

On Aug 23, 2004, at 10:14 AM, James Wiggs wrote:

>
>  Oren,
>
>    I will keep this in mind for the next time I build it
> (hopefully not for a few days, at least).  I'm getting the
> MySQL database in place for use.  I can't find in the unit
> tests where to set the username and password to use when
> connecting, though.  Where should that go?  Environment
> variable?  No documentation I can find on this...
>
> best,
> Jim
>
> On Mon, 2004-08-23 at 11:00, Oren Miller wrote:
>> QuickFIX Documentation: 
>> http://www.quickfixengine.org/quickfix/doc/html/index.html
>> QuickFIX FAQ: 
>> http://www.quickfixengine.org/wikifix/index.php?QuickFixFAQ
>> QuickFIX Support: http://www.quickfixengine.org/services.html
>>
>> FYI, while doing development work with C++ under linux, setting your
>> CXXFLAGS to "-g -O0" is probably a good idea.  gcc is an extremely 
>> slow
>> C++ compiler, (though current versions are far better than say 3.04).
>> This will dramatically improve your build times and reduce memory
>> usage.  No need to notch it up to -O2 unless you are doing performance
>> testing or are ready to go into production.
>>
>> --oren
>>
>
>
>

Re: [Quickfix-developers] Linux Compile Problems - QF1.8.0

[James W. <wi...@wi...>]

 Oren,

   I will keep this in mind for the next time I build it
(hopefully not for a few days, at least).  I'm getting the
MySQL database in place for use.  I can't find in the unit
tests where to set the username and password to use when
connecting, though.  Where should that go?  Environment
variable?  No documentation I can find on this...

best,
Jim

On Mon, 2004-08-23 at 11:00, Oren Miller wrote:
> QuickFIX Documentation: http://www.quickfixengine.org/quickfix/doc/html/index.html
> QuickFIX FAQ: http://www.quickfixengine.org/wikifix/index.php?QuickFixFAQ
> QuickFIX Support: http://www.quickfixengine.org/services.html
> 
> FYI, while doing development work with C++ under linux, setting your 
> CXXFLAGS to "-g -O0" is probably a good idea.  gcc is an extremely slow 
> C++ compiler, (though current versions are far better than say 3.04).  
> This will dramatically improve your build times and reduce memory 
> usage.  No need to notch it up to -O2 unless you are doing performance 
> testing or are ready to go into production.
> 
> --oren
> 

Re: [Quickfix-developers] Linux Compile Problems - QF1.8.0

[Oren M. <or...@qu...>]

FYI, while doing development work with C++ under linux, setting your=20
CXXFLAGS to "-g -O0" is probably a good idea.  gcc is an extremely slow=20=

C++ compiler, (though current versions are far better than say 3.04). =20=

This will dramatically improve your build times and reduce memory=20
usage.  No need to notch it up to -O2 unless you are doing performance=20=

testing or are ready to go into production.

--oren

On Aug 23, 2004, at 8:57 AM, James Wiggs wrote:

> QuickFIX Documentation:=20
> http://www.quickfixengine.org/quickfix/doc/html/index.html
> QuickFIX FAQ:=20
> http://www.quickfixengine.org/wikifix/index.php?QuickFixFAQ
> QuickFIX Support: http://www.quickfixengine.org/services.html
>
> On Mon, 2004-08-23 at 01:57, Joerg Thoennes wrote:
>> Hi James,
>>
>>>    I eventually gave up and upgraded one of our servers to Debian
>>> Sarge; I was able to get it to compile on my Sid workstation, which
>>> is running gcc/g++ 3.3.4-7, and Sarge installs with 3.3.4-3, so I
>>> figured it was worth a try.  After a few attempts, I was finally
>>> able to get it to compile with the STLPorts 4.6 package that comes
>>> with Sarge and the MySQL library we have installed.
>>
>> I did not use any STLPorts 4.6 package to compile QF, at least I am=20=

>> not
>> aware of it. How is the package name in Debian? Maybe you should try=20=

>> it
>> without STLports?
>
>    I will try to do this later this week.  Since I've upgraded
> the development server to Sarge, the only machine I have now that
> is still running Woody and has enough resources to compile QF is
> a production server.  The compile takes more than 12 hours to run
> on that box, so I can only attempt it over a weekend.
>
>>> It fails two
>>> unit tests, however.  It passes all acceptance tests.
>>
>> All unit and acceptance tests work fine.
>
>    It appears the unit tests that failed were related to MySQL.
> I need to build the database tables required for QuickFIX.  This
> isn't covered in the current INSTALL documentation.  I'd be happy
> to write it up and send it in if you wish.  An added section into
> doc/html/install.html just above "Testing QuickFIX" seems logical;
> let me know if you want that.
>
>>>    I did not save out the compiler errors I got.  They weren't seg
>>> faults or out-of-memory errors.  One as I recall, came back as a
>>> floating point exception (?!).  I'm trying to compile it again on
>>> one of our other Woody boxes to see if I can get the error for you
>>> again.  So far, it's 39 minutes(!) into the compile of Session.cpp,
>>> using 384 MB of RAM.  Unbelievable.  Whenever the build dies, I'll
>>> send along the error messages.
>>
>> OK, the g++-3.0 is quite slow...
>
>    You ain't kiddin'.  I had to kill it.  It was down to the
> compile of the ordermatch Application.cpp file, and had used
> 95 minutes of CPU time and almost 1.5 GB!!! of memory, so I
> had to kill it.  The market was about to open and I couldn't
> have one full CPU and 75% of my RAM used by that build.  But
> it looks like this machine might make a liar out of me.  It
> clearly made it up to building the example apps, and I can
> see where the library files were created at 11:28 last night.
>
>    This machine is a dual P3/500 with 2GB of memory, running
> Debian Woody, totally stock except that I've upgraded libtools
> and the automake tools to Debian sarge to support our use of
> Anjuta as a development tool.
>
>>>
>>>    On a related note, how seriously is Linux *really* supported by
>>> the core QuickFIX group?  Having to install a whole new version of
>>> the operating system just to get QF to compile doesn't instill a
>>> lot of confidence.  I've got a *very* basic application I'm trying
>>> to get running with it, and I can't even get a SocketInitiator to
>>> instantiate properly.  The code segfaults when I try to do it.  I'm
>>> drafting a note on that problem separately.  Am I unique in having
>>> so much trouble with QF?  Most of the mailing list messages seem to
>>> be from Solaris or Windows developers coding in Java or .NET or VB.
>>> How many people are you aware of who are successfully using QF on
>>> Linux, coding in C/C++?
>>
>> At least we do. We had some problems with the JNI part nearly two=20
>> years
>> ago (we are using the Java API), but use QF in production for more=20
>> than
>> a year now. So I guess you are quite unique here.
>>
>> Please post more information, esp. which Debian package (version) you
>> use to compile QF.
>
>    Build was attempted on a single-CPU Athlon 1GHz with 1.5GB
> of RAM.  We tried with both GCC/G++'s from Debian Woody: 2.95.4
> and 3.0.4.  STLPort version was 4.5.3, standard install for Woody.
> I also downloaded and built STLPort 4.6.2 from source.  No go on
> that one either.  Using GLib 2.4.4 on the C side, compiled and
> installed from source.  The pthreads library is stock Woody, not
> sure of the exact version: 0.9.X.
>
>> Cheers, J=F6rg
>
>    At this point, since I've gotten the code built for our
> development work, I'm not so concerned with this problem.  I'd
> like to know, ultimately, what's going on, but since we're going
> to be upgrading all our servers to Sarge when it is declared the
> new stable later this fall, I'm not going to lose much sleep
> over it.
>
>    Again, let me know if you want that install documentation on
> MySQL configuration.  And thanks again for your replies!
>
> thanks,
> Jim Wiggs
>
>
>
>
> -------------------------------------------------------
> SF.Net email is sponsored by Shop4tech.com-Lowest price on Blank Media
> 100pk Sonic DVD-R 4x for only $29 -100pk Sonic DVD+R for only $33
> Save 50% off Retail on Ink & Toner - Free Shipping and Free Gift.
> http://www.shop4tech.com/z/Inkjet_Cartridges/9_108_r285
> _______________________________________________
> Quickfix-developers mailing list
> Qui...@li...
> https://lists.sourceforge.net/lists/listinfo/quickfix-developers
>

Re: [Quickfix-developers] Linux Compile Problems - QF1.8.0

[James W. <wi...@wi...>]

On Mon, 2004-08-23 at 01:57, Joerg Thoennes wrote:
> Hi James,
>=20
> >    I eventually gave up and upgraded one of our servers to Debian
> > Sarge; I was able to get it to compile on my Sid workstation, which
> > is running gcc/g++ 3.3.4-7, and Sarge installs with 3.3.4-3, so I
> > figured it was worth a try.  After a few attempts, I was finally
> > able to get it to compile with the STLPorts 4.6 package that comes
> > with Sarge and the MySQL library we have installed.
>=20
> I did not use any STLPorts 4.6 package to compile QF, at least I am not
> aware of it. How is the package name in Debian? Maybe you should try it
> without STLports?

   I will try to do this later this week.  Since I've upgraded
the development server to Sarge, the only machine I have now that
is still running Woody and has enough resources to compile QF is
a production server.  The compile takes more than 12 hours to run
on that box, so I can only attempt it over a weekend.

> > It fails two
> > unit tests, however.  It passes all acceptance tests.
>=20
> All unit and acceptance tests work fine.

   It appears the unit tests that failed were related to MySQL.
I need to build the database tables required for QuickFIX.  This
isn't covered in the current INSTALL documentation.  I'd be happy
to write it up and send it in if you wish.  An added section into
doc/html/install.html just above "Testing QuickFIX" seems logical;
let me know if you want that.

> >    I did not save out the compiler errors I got.  They weren't seg
> > faults or out-of-memory errors.  One as I recall, came back as a
> > floating point exception (?!).  I'm trying to compile it again on
> > one of our other Woody boxes to see if I can get the error for you
> > again.  So far, it's 39 minutes(!) into the compile of Session.cpp,
> > using 384 MB of RAM.  Unbelievable.  Whenever the build dies, I'll
> > send along the error messages.
>=20
> OK, the g++-3.0 is quite slow...

   You ain't kiddin'.  I had to kill it.  It was down to the
compile of the ordermatch Application.cpp file, and had used
95 minutes of CPU time and almost 1.5 GB!!! of memory, so I
had to kill it.  The market was about to open and I couldn't
have one full CPU and 75% of my RAM used by that build.  But
it looks like this machine might make a liar out of me.  It
clearly made it up to building the example apps, and I can
see where the library files were created at 11:28 last night.

   This machine is a dual P3/500 with 2GB of memory, running
Debian Woody, totally stock except that I've upgraded libtools
and the automake tools to Debian sarge to support our use of
Anjuta as a development tool.

> >=20
> >    On a related note, how seriously is Linux *really* supported by
> > the core QuickFIX group?  Having to install a whole new version of
> > the operating system just to get QF to compile doesn't instill a
> > lot of confidence.  I've got a *very* basic application I'm trying
> > to get running with it, and I can't even get a SocketInitiator to
> > instantiate properly.  The code segfaults when I try to do it.  I'm
> > drafting a note on that problem separately.  Am I unique in having
> > so much trouble with QF?  Most of the mailing list messages seem to
> > be from Solaris or Windows developers coding in Java or .NET or VB.
> > How many people are you aware of who are successfully using QF on
> > Linux, coding in C/C++?
>=20
> At least we do. We had some problems with the JNI part nearly two years
> ago (we are using the Java API), but use QF in production for more than
> a year now. So I guess you are quite unique here.
>=20
> Please post more information, esp. which Debian package (version) you
> use to compile QF.

   Build was attempted on a single-CPU Athlon 1GHz with 1.5GB
of RAM.  We tried with both GCC/G++'s from Debian Woody: 2.95.4
and 3.0.4.  STLPort version was 4.5.3, standard install for Woody.
I also downloaded and built STLPort 4.6.2 from source.  No go on
that one either.  Using GLib 2.4.4 on the C side, compiled and
installed from source.  The pthreads library is stock Woody, not
sure of the exact version: 0.9.X.

> Cheers, J=F6rg

   At this point, since I've gotten the code built for our
development work, I'm not so concerned with this problem.  I'd
like to know, ultimately, what's going on, but since we're going
to be upgrading all our servers to Sarge when it is declared the
new stable later this fall, I'm not going to lose much sleep
over it.

   Again, let me know if you want that install documentation on
MySQL configuration.  And thanks again for your replies!

thanks,
Jim Wiggs

Re: [Quickfix-developers] Linux Compile Problems - QF1.8.0

[Oren M. <or...@qu...>]

On this, he doesn't mention, but my guess would be these are the MySQL 
unit tests.  If you do not build the quickfix database, then yes, these 
two tests will fail.

>> It fails two
>> unit tests, however.  It passes all acceptance tests.
>
> All unit and acceptance tests work fine.

Re: [Quickfix-developers] Linux Compile Problems - QF1.8.0

[Joerg T. <Joe...@ma...>]

Hi James,

>    I eventually gave up and upgraded one of our servers to Debian
> Sarge; I was able to get it to compile on my Sid workstation, which
> is running gcc/g++ 3.3.4-7, and Sarge installs with 3.3.4-3, so I
> figured it was worth a try.  After a few attempts, I was finally
> able to get it to compile with the STLPorts 4.6 package that comes
> with Sarge and the MySQL library we have installed.

I did not use any STLPorts 4.6 package to compile QF, at least I am not
aware of it. How is the package name in Debian? Maybe you should try it
without STLports?

> It fails two
> unit tests, however.  It passes all acceptance tests.

All unit and acceptance tests work fine.

>    I did not save out the compiler errors I got.  They weren't seg
> faults or out-of-memory errors.  One as I recall, came back as a
> floating point exception (?!).  I'm trying to compile it again on
> one of our other Woody boxes to see if I can get the error for you
> again.  So far, it's 39 minutes(!) into the compile of Session.cpp,
> using 384 MB of RAM.  Unbelievable.  Whenever the build dies, I'll
> send along the error messages.

OK, the g++-3.0 is quite slow...

> 
>    On a related note, how seriously is Linux *really* supported by
> the core QuickFIX group?  Having to install a whole new version of
> the operating system just to get QF to compile doesn't instill a
> lot of confidence.  I've got a *very* basic application I'm trying
> to get running with it, and I can't even get a SocketInitiator to
> instantiate properly.  The code segfaults when I try to do it.  I'm
> drafting a note on that problem separately.  Am I unique in having
> so much trouble with QF?  Most of the mailing list messages seem to
> be from Solaris or Windows developers coding in Java or .NET or VB.
> How many people are you aware of who are successfully using QF on
> Linux, coding in C/C++?

At least we do. We had some problems with the JNI part nearly two years
ago (we are using the Java API), but use QF in production for more than
a year now. So I guess you are quite unique here.

Please post more information, esp. which Debian package (version) you
use to compile QF.

Cheers, Jörg

-- 
Joerg Thoennes
                                http://macd.com
Tel.: +49 (0)241 44597-24      Macdonald Associates GmbH
Fax : +49 (0)241 44597-10      Lothringer Str. 52, D-52070 Aachen

Re: [Quickfix-developers] Linux Compile Problems - QF1.8.0

[James W. <wi...@wi...>]

 Hello Joerg,

   Many thanks for the reply!

On Sun, 2004-08-22 at 17:03, Joerg Thoennes wrote:
> QuickFIX Documentation: http://www.quickfixengine.org/quickfix/doc/html/i=
ndex.html
> QuickFIX FAQ: http://www.quickfixengine.org/wikifix/index.php?QuickFixFAQ
> QuickFIX Support: http://www.quickfixengine.org/services.html
>=20
> Hi James,
>=20
> >    I am attempting to build QuickFIX 1.8.0 on a Linux box, Debian
> > Stable, fully up-to-date.  I have installed the latest stable version
> > of STLPort.  I get compiler errors when compiling with either gcc 2.95
> > or gcc 3.04, the only two stock compilers available for Debian stable.
> > I am willing to upgrade the machine to Debian Sarge, which will be the
> > new stable within a few months, but do *not* want to go down that road
> > if it won't solve the problem.  I am testing a build on one of our
> > workstations, which run Debian unstable (i.e. SID).  The compile has
> > not completed yet, but if it does, I'll at least know that gcc 3.3.4
> > will work.
> >=20
> >    So, the question: what versions of GCC have been used successfully
> > to build 1.8.0 on a Linux machine?  The errors I've been getting are
> > actual internal compiler errors, complete with a request to send a bug
> > report to GNU, not library or linking errors.  Neither are they out of
> > memory errors; there's plenty of RAM on the box.
>=20
> I did compile 1.8.0 both on Debian stable (woody) and testing (sarge)=20
> without any problems. Which kind of problems do you have?
>=20
> Cheers, J=F6rg

   I eventually gave up and upgraded one of our servers to Debian
Sarge; I was able to get it to compile on my Sid workstation, which
is running gcc/g++ 3.3.4-7, and Sarge installs with 3.3.4-3, so I
figured it was worth a try.  After a few attempts, I was finally
able to get it to compile with the STLPorts 4.6 package that comes
with Sarge and the MySQL library we have installed.  It fails two
unit tests, however.  It passes all acceptance tests.

   I did not save out the compiler errors I got.  They weren't seg
faults or out-of-memory errors.  One as I recall, came back as a
floating point exception (?!).  I'm trying to compile it again on
one of our other Woody boxes to see if I can get the error for you
again.  So far, it's 39 minutes(!) into the compile of Session.cpp,
using 384 MB of RAM.  Unbelievable.  Whenever the build dies, I'll
send along the error messages.

   On a related note, how seriously is Linux *really* supported by
the core QuickFIX group?  Having to install a whole new version of
the operating system just to get QF to compile doesn't instill a
lot of confidence.  I've got a *very* basic application I'm trying
to get running with it, and I can't even get a SocketInitiator to
instantiate properly.  The code segfaults when I try to do it.  I'm
drafting a note on that problem separately.  Am I unique in having
so much trouble with QF?  Most of the mailing list messages seem to
be from Solaris or Windows developers coding in Java or .NET or VB.
How many people are you aware of who are successfully using QF on
Linux, coding in C/C++?

thanks,
Jim Wiggs

Re: [Quickfix-developers] Linux Compile Problems - QF1.8.0

[Joerg T. <Joe...@ma...>]

Hi James,

>    I am attempting to build QuickFIX 1.8.0 on a Linux box, Debian
> Stable, fully up-to-date.  I have installed the latest stable version
> of STLPort.  I get compiler errors when compiling with either gcc 2.95
> or gcc 3.04, the only two stock compilers available for Debian stable.
> I am willing to upgrade the machine to Debian Sarge, which will be the
> new stable within a few months, but do *not* want to go down that road
> if it won't solve the problem.  I am testing a build on one of our
> workstations, which run Debian unstable (i.e. SID).  The compile has
> not completed yet, but if it does, I'll at least know that gcc 3.3.4
> will work.
> 
>    So, the question: what versions of GCC have been used successfully
> to build 1.8.0 on a Linux machine?  The errors I've been getting are
> actual internal compiler errors, complete with a request to send a bug
> report to GNU, not library or linking errors.  Neither are they out of
> memory errors; there's plenty of RAM on the box.

I did compile 1.8.0 both on Debian stable (woody) and testing (sarge) 
without any problems. Which kind of problems do you have?

Cheers, Jörg

-- 
Joerg Thoennes
                                http://macd.com
Tel.: +49 (0)241 44597-24      Macdonald Associates GmbH
Fax : +49 (0)241 44597-10      Lothringer Str. 52, D-52070 Aachen

[Quickfix-developers] Linux Compile Problems - QF1.8.0

[James W. <wi...@wi...>]

 Hello,

   I am attempting to build QuickFIX 1.8.0 on a Linux box, Debian
Stable, fully up-to-date.  I have installed the latest stable version
of STLPort.  I get compiler errors when compiling with either gcc 2.95
or gcc 3.04, the only two stock compilers available for Debian stable.
I am willing to upgrade the machine to Debian Sarge, which will be the
new stable within a few months, but do *not* want to go down that road
if it won't solve the problem.  I am testing a build on one of our
workstations, which run Debian unstable (i.e. SID).  The compile has
not completed yet, but if it does, I'll at least know that gcc 3.3.4
will work.

   So, the question: what versions of GCC have been used successfully
to build 1.8.0 on a Linux machine?  The errors I've been getting are
actual internal compiler errors, complete with a request to send a bug
report to GNU, not library or linking errors.  Neither are they out of
memory errors; there's plenty of RAM on the box.

thanks,
Jim Wiggs

RE: [Quickfix-developers] newbie mysql questions

[Gururaj K. <gkr...@ba...>]

The MySQL website has great documentation -
http://dev.mysql.com/doc/mysql/en/Privilege_system.html.
The access denied causes are listed here -
http://dev.mysql.com/doc/mysql/en/Access_denied.html

User authorization model is "user@host having privileges for a db" 

You can go in as "mysql -u root mysql", create a new user for the
quickfix database.

==========================
$ mysql -u root -p
Enter password:
... You're in......
mysql> GRANT ALL PRIVILEGES ON PStorage.* to tuser1@localhost
    -> IDENTIFIED BY 'tpass1';
Query OK, 0 rows affected (0.13 sec)

========================
$mysql -u tuser1 -ptpass1 mysql
ERROR 1044: Access denied for user: 'tuser1@localhost' to database
'mysql'
$mysql -u tuser1 -ptpass1 Pstorage
 .... Now goes in
=====================================

-----Original Message-----
From: qui...@li...
[mailto:qui...@li...] On Behalf Of
Clark Sims
Sent: Friday, August 20, 2004 12:08 PM
To: QuickFIX
Subject: Re: [Quickfix-developers] newbie mysql questions


QuickFIX Documentation:
http://www.quickfixengine.org/quickfix/doc/html/index.html
QuickFIX FAQ:
http://www.quickfixengine.org/wikifix/index.php?QuickFixFAQ
QuickFIX Support: http://www.quickfixengine.org/services.html

In order to access the databases I had to log in as
root. I typed "mysql -u root".  As a normal user I
got:
1044 error "access denied @localhost"

I probably ran into these problems, because I don't
understand how to grant users's access, and how to set passwords.

--- Oren Miller <or...@qu...> wrote:

> Clark,
> 
> You need to generate the database with the
> create_mysql script in the
> src/sql directory.  This will generate a database
> called quickfix.  If 
> you are running a newer version of quickfix you may
> need to add a '-u 
> root' right after the mysql call if it isn't already
> there.  This is 
> assuming that your root account has not password
> which is the default 
> installation.  If you have a password or are using
> another account, you 
> will need to supply them.  After running the script,
> you can run the 
> mysql client and type 'use quickfix', then type
> 'show tables' .  You 
> can use standard SQL commands to do whatever queries
> you like.
> 
> --oren
> 
> On Aug 18, 2004, at 1:58 PM, Clark Sims wrote:
> 
> > QuickFIX Documentation:
> >
>
http://www.quickfixengine.org/quickfix/doc/html/index.html
> > QuickFIX FAQ:
> >
>
http://www.quickfixengine.org/wikifix/index.php?QuickFixFAQ
> > QuickFIX Support:
> http://www.quickfixengine.org/services.html
> >
> > I conigured and compiled quickfix to use mysql. Do
> I
> > need to do anything else or are the fix messages automatically 
> > stored to a database on the hard
> drive?
> > What is the name of the database file?
> >
> > I have never used mysql before. How do I open the
> > database file of fix messages? I guess I should by
> a
> > book on mysql. Does anyone have a recomendation?
> >
> >
> > 		
> > __________________________________
> > Do you Yahoo!?
> > Take Yahoo! Mail with you! Get it on your mobile
> phone.
> > http://mobile.yahoo.com/maildemo
> >
> >
> >
>
-------------------------------------------------------
> > SF.Net email is sponsored by Shop4tech.com-Lowest
> price on Blank Media
> > 100pk Sonic DVD-R 4x for only $29 -100pk Sonic
> DVD+R for only $33
> > Save 50% off Retail on Ink & Toner - Free Shipping
> and Free Gift.
> >
>
http://www.shop4tech.com/z/Inkjet_Cartridges/9_108_r285
> > _______________________________________________
> > Quickfix-developers mailing list 
> > Qui...@li...
> >
>
https://lists.sourceforge.net/lists/listinfo/quickfix-developers
> >
> 
> 



	
		
__________________________________
Do you Yahoo!?
New and Improved Yahoo! Mail - 100MB free storage!
http://promotions.yahoo.com/new_mail 


-------------------------------------------------------
SF.Net email is sponsored by Shop4tech.com-Lowest price on Blank Media
100pk Sonic DVD-R 4x for only $29 -100pk Sonic DVD+R for only $33 Save
50% off Retail on Ink & Toner - Free Shipping and Free Gift.
http://www.shop4tech.com/z/Inkjet_Cartridges/9_108_r285
_______________________________________________
Quickfix-developers mailing list
Qui...@li...
https://lists.sourceforge.net/lists/listinfo/quickfix-developers

RE: [Quickfix-developers] MS VC++ release builds

[Yihu F. <Yih...@re...>]

Hi Antonio and Tim,

It would be interesting to see what the real cause of the problems.

We have been using MS VC7 compiler (Visual Studio .NET 2003) on Windows
2003 and XP and did not see the corrupted fields and reject messages.
Maybe we should examine them more carefully.

A few questions: (1) if the QuickFIX log shows correct FIX messages
while the application shows error and rejects message, does it imply
something wrong in the implementation of the application? (2) Is the
application using the same compiler options as the QuickFIX library,
e.g. multiplethread dll settings etc? (3) Is there any memory leak seen
in the application after a long period of time?

Thanks.

-Yihu

-----Original Message-----
From: qui...@li...
[mailto:qui...@li...] On Behalf Of
Timothy Yates
Sent: Friday, August 20, 2004 9:21 AM
To: 'Antonio Caroselli'
Cc: 'Oren Miller'; qui...@li...
Subject: RE: [Quickfix-developers] MS VC++ release builds

QuickFIX Documentation:
http://www.quickfixengine.org/quickfix/doc/html/index.html
QuickFIX FAQ:
http://www.quickfixengine.org/wikifix/index.php?QuickFixFAQ
QuickFIX Support: http://www.quickfixengine.org/services.html

Hi Antonio,

I mentioned two distinct problems in my original email.

The first of these related to random corruptions of field data in FIX
messages, especially during periods of heavy traffic.  These problems
occurred in an MS VC++ quickfix application.  Once or twice, we saw the
same
CompID error you refer to. Typically, the corrupted field data contained
parts of other FIX fields from the same message.

We were never able to track down the cause of these corruptions -- we
found
the problem very hard to reproduce. However, turning off compiler
optimizations did seem to improve the situation considerably.  If you
can
find out the cause of this probem, I would be very interested.

The second problem related to the Java version of QuickFIX on Windows
XP.
This problem seems to be related to hyperthreading (possibly in
combination
with hot-spot compilation).  When I disabled hyperthreading on the host
machine, this problem went away -- it doesn't seem to be related to the
first problem as I initially thought.

Tim

-----Original Message-----
From: Antonio Caroselli [mailto:ant...@ga...]
Sent: Friday, August 20, 2004 3:53 AM
To: Timothy Yates
Cc: 'Oren Miller'; qui...@li...
Subject: Re: [Quickfix-developers] MS VC++ release builds


Dear Tim,

We are experiencing the same problems described in your email dated June
14/2004.

We are using MS VC++ 6 SP5 with default compilation and link options and
QuickFix 1.7.1. The target application is being run under Windows Server
2000 SP4.

In most cases we detected memory errors on incoming messages: we often
get
the error "Message nn rejected: CompID problem" even if the FIX message
logged in our log file via the QuickFix log function shows correct tags
and
values. It may happen that we have such a problem once or twice in a day
under heavy traffic conditions, mostly on incoming messages. In few
cases
this possible memory problem also caused outgoing messages to be
truncated.

At times (not always) this problem is followed by an application crash:
we
do not get any application fault window since the application simply
disappears from the Task Manager.

I have seen Oren's suggestion about the callstack. Did that help you
solve
your problem ? We might try and use QuickFix 1.8.0, but the release
notes do
not seem to address this problem.

Any help will be greatly appreciated

Bye,

Antonio Caroselli
GATE T.I.
www.gatelab.com



----- Original Message -----
From: "Timothy Yates" <Tim...@pa...>
To: "'Oren Miller'" <or...@qu...>
Cc: <qui...@li...>
Sent: Monday, June 14, 2004 5:30 PM
Subject: RE: [Quickfix-developers] MS VC++ release builds


> QuickFIX Documentation:
http://www.quickfixengine.org/quickfix/doc/html/index.html
> QuickFIX FAQ: http://www.quickfixengine.org/quickfix/doc/html/FAQ.html
>
> The callstack is not enabled.
>
> Tim.
>
> -----Original Message-----
> From: Oren Miller [mailto:or...@qu...]
> Sent: Monday, June 14, 2004 9:32 AM
> To: Timothy Yates
> Cc: qui...@li...
> Subject: Re: [Quickfix-developers] MS VC++ release builds
>
>
> Do you have the callstack enabled?
>
> --oren
>
> On Jun 14, 2004, at 8:39 AM, Timothy Yates wrote:
>
> > QuickFIX Documentation:
> > http://www.quickfixengine.org/quickfix/doc/html/index.html
> > QuickFIX FAQ:
http://www.quickfixengine.org/quickfix/doc/html/FAQ.html
> >
> > Has anyone else had problems with apparently random crashes and
memory
> > corruptions in quickfix when using MS VC++, specifically using the
> > default
> > release build options?
> >
> > We have a C++ production application that uses quickfix.  We have
had
> > to
> > build quickfix with all optimizations turned off.  We were unable to
> > track
> > down the memory corruptions that occurred with a release build.
> >
> > Recently, I have been using the Java version of quickfix.  I have a
> > test
> > application that generates MarketDataSnapshotFullRefresh messages
and
> > populates them with essentially random price data.  The receiving
> > application sends a subscribe message and the test application
starts
> > sending refresh messages at a rate of about 20 per second.  When
using
> > a
> > release build of quickfix_jni.dll, the receiving application often
> > crashes
> > after several hundred messages due to an access violation.  This
> > typically
> > occurs in the destructor call from Message.finalize(), other times
in
> > Group.finalize(), and othertime some place else.   I do a session
reset
> > between test runs.  Sometimes the application does not crash at all.
> > I
> > have tried disabling all processing of refresh messages by the
> > receiving
> > application (so it just returns from fromApp without doing
anything),
> > and
> > the crashes still happen.
> >
> > The random nature of the crashes leads me to suspect a threading
issue.
> >
> > When I use a debug build of quickfix_jni.dll, I can never get it to
> > crash.
> > This might just be luck, or it might indicate a problem with
compiler
> > optimizations.
> >
> > I think this problem may have something to do with repeating groups
as
> > I
> > have only started noticing it since implementing market data
support.
> > However, it could just be that I have started stressing quickfix
more
> > than
> > before.
> >
> > Interestingly, the corruptions we were experiencing in our
production
> > C++
> > application also occurred when there was a large amount of market
data
> > traffic.
> >
> > I am using quickfix 1.7.0.
> >
> > Tim Yates
> > Lead Developer
> > Patsystems (US) LLC
> > 141 West Jackson Boulevard
> > Chicago 60604, USA
> > Tel +1 (312) 542-1336
> > www.patsystems.com
> >
> >
> >
> >
> >
> > -------------------------------------------------------
> > This SF.Net email is sponsored by the new InstallShield X.
> > From Windows to Linux, servers to mobile, InstallShield X is the
> > one installation-authoring solution that does it all. Learn more and
> > evaluate today! http://www.installshield.com/Dev2Dev/0504
> > _______________________________________________
> > Quickfix-developers mailing list
> > Qui...@li...
> > https://lists.sourceforge.net/lists/listinfo/quickfix-developers
> >
>
>
> -------------------------------------------------------
> This SF.Net email is sponsored by the new InstallShield X.
> >From Windows to Linux, servers to mobile, InstallShield X is the
> one installation-authoring solution that does it all. Learn more and
> evaluate today! http://www.installshield.com/Dev2Dev/0504
> _______________________________________________
> Quickfix-developers mailing list
> Qui...@li...
> https://lists.sourceforge.net/lists/listinfo/quickfix-developers
>


-------------------------------------------------------
SF.Net email is sponsored by Shop4tech.com-Lowest price on Blank Media
100pk Sonic DVD-R 4x for only $29 -100pk Sonic DVD+R for only $33
Save 50% off Retail on Ink & Toner - Free Shipping and Free Gift.
http://www.shop4tech.com/z/Inkjet_Cartridges/9_108_r285
_______________________________________________
Quickfix-developers mailing list
Qui...@li...
https://lists.sourceforge.net/lists/listinfo/quickfix-developers



-----------------------------------------------------------------
        Visit our Internet site at http://www.reuters.com

Get closer to the financial markets with Reuters Messaging - for more
information and to register, visit http://www.reuters.com/messaging

Any views expressed in this message are those of  the  individual
sender,  except  where  the sender specifically states them to be
the views of Reuters Ltd.

Re: [Quickfix-developers] Re: Solaris compile problems

[Oren M. <or...@qu...>]

Oh, yeah, I believe nanosleep is located in the rt library.  Try adding 
a -lrt

--oren

On Aug 20, 2004, at 1:40 PM, Tim Feeney wrote:

> QuickFIX Documentation: 
> http://www.quickfixengine.org/quickfix/doc/html/index.html
> QuickFIX FAQ: 
> http://www.quickfixengine.org/wikifix/index.php?QuickFixFAQ
> QuickFIX Support: http://www.quickfixengine.org/services.html
>
> Oren and Kristofer thanks for the help.
>
> I have gotten past all the lib problems but am now
> stuck on another issue.  When I do the make it fails with the 
> following:
> make[3]: Entering directory `/home/tim/quickfix/src'
> if g++ -DHAVE_CONFIG_H -I. -I. -I.. -IC++    -I/usr/include
> -I/usr/ccs/include -Wall   -I/usr/local/include/libxml2 -I/include
> -I/include/solaris  -MT at.o -MD -MP -MF ".deps/at.Tpo" -c -o at.o 
> at.cpp; \
> then mv -f ".deps/at.Tpo" ".deps/at.Po"; else rm -f ".deps/at.Tpo"; 
> exit
> 1; fi
> /bin/bash ../libtool --mode=link g++  -I/usr/include -I/usr/ccs/include
> -Wall   -I/usr/local/include/libxml2 -I/include -I/include/solaris    
> -o
> at  at.o C++/libquickfix.la -lpthread   -L/usr/local/lib
> -R/usr/local/lib -lxml2 -lz -lpthread -liconv -lm -lsocket -lnsl  
> -liberty
> mkdir .libs
> g++ -I/usr/include -I/usr/ccs/include -Wall 
> -I/usr/local/include/libxml2
> -I/include -I/include/solaris -o at at.o C++/.libs/libquickfix.a
> -lpthread -L/usr/local/lib -lxml2 -lz -lpthread -liconv -lm -lsocket
> -lnsl -liberty -lpthread -L/usr/local/lib -lxml2 -lz -lpthread -liconv
> -lm -lsocket -lnsl -liberty -R/usr/local/lib -R/usr/local/lib
> Undefined                       first referenced
> symbol                             in file
> nanosleep                           C++/.libs/libquickfix.a(Utility.o)
> ld: fatal: Symbol referencing errors. No output written to at
> collect2: ld returned 1 exit status
> make[3]: *** [at] Error 1
> make[3]: Leaving directory `/home/tim/quickfix/src'
> make[2]: *** [all-recursive] Error 1
> make[2]: Leaving directory `/home/tim/quickfix/src'
> make[1]: *** [all-recursive] Error 1
> make[1]: Leaving directory `/home/tim/quickfix'
> make: *** [all] Error 2
>
> I have tried to figure this out even explicitly doing a #include 
> "/usr/include/time.h" but no luck.  Any help?
>
> I did delete and create a new quickfix install, made the necessary 
> changes, installed libtool1.3.5, and ran configure with the 
> --disable-shared option.  Still no go.
>
> -- Timothy J. Feeney Financial Labs LLC Phone: (617) 354-0185
>
> -- 
> Timothy J. Feeney
> Financial Labs LLC
> Phone: (617) 354-0185
>
>
>
>
>
> -------------------------------------------------------
> SF.Net email is sponsored by Shop4tech.com-Lowest price on Blank Media
> 100pk Sonic DVD-R 4x for only $29 -100pk Sonic DVD+R for only $33
> Save 50% off Retail on Ink & Toner - Free Shipping and Free Gift.
> http://www.shop4tech.com/z/Inkjet_Cartridges/9_108_r285
> _______________________________________________
> Quickfix-developers mailing list
> Qui...@li...
> https://lists.sourceforge.net/lists/listinfo/quickfix-developers
>

[Quickfix-developers] Re: Solaris compile problems

[Tim F. <ti...@fi...>]

Oren and Kristofer thanks for the help.

I have gotten past all the lib problems but am now
stuck on another issue.  When I do the make it fails with the following:
make[3]: Entering directory `/home/tim/quickfix/src'
if g++ -DHAVE_CONFIG_H -I. -I. -I.. -IC++    -I/usr/include
-I/usr/ccs/include -Wall   -I/usr/local/include/libxml2 -I/include
-I/include/solaris  -MT at.o -MD -MP -MF ".deps/at.Tpo" -c -o at.o at.cpp; \
then mv -f ".deps/at.Tpo" ".deps/at.Po"; else rm -f ".deps/at.Tpo"; exit
1; fi
/bin/bash ../libtool --mode=link g++  -I/usr/include -I/usr/ccs/include
-Wall   -I/usr/local/include/libxml2 -I/include -I/include/solaris    -o
at  at.o C++/libquickfix.la -lpthread   -L/usr/local/lib
-R/usr/local/lib -lxml2 -lz -lpthread -liconv -lm -lsocket -lnsl  -liberty
mkdir .libs
g++ -I/usr/include -I/usr/ccs/include -Wall -I/usr/local/include/libxml2
-I/include -I/include/solaris -o at at.o C++/.libs/libquickfix.a
-lpthread -L/usr/local/lib -lxml2 -lz -lpthread -liconv -lm -lsocket
-lnsl -liberty -lpthread -L/usr/local/lib -lxml2 -lz -lpthread -liconv
-lm -lsocket -lnsl -liberty -R/usr/local/lib -R/usr/local/lib
Undefined                       first referenced
symbol                             in file
nanosleep                           C++/.libs/libquickfix.a(Utility.o)
ld: fatal: Symbol referencing errors. No output written to at
collect2: ld returned 1 exit status
make[3]: *** [at] Error 1
make[3]: Leaving directory `/home/tim/quickfix/src'
make[2]: *** [all-recursive] Error 1
make[2]: Leaving directory `/home/tim/quickfix/src'
make[1]: *** [all-recursive] Error 1
make[1]: Leaving directory `/home/tim/quickfix'
make: *** [all] Error 2

I have tried to figure this out even explicitly doing a #include 
"/usr/include/time.h" but no luck.  Any help?

I did delete and create a new quickfix install, made the necessary 
changes, installed libtool1.3.5, and ran configure with the 
--disable-shared option.  Still no go.

-- Timothy J. Feeney Financial Labs LLC Phone: (617) 354-0185

-- 
Timothy J. Feeney
Financial Labs LLC
Phone: (617) 354-0185

[Quickfix-developers] Bug in STL effects quickfix, gcc version 2.95.4

[Clark S. <cla...@ya...>]

To: qui...@li...
From: cla...@ya...
Subject: Bug in STL effects quickfix, gcc version 2.95.4
<   std::set <FIX::SessionID>::iterator ps;
<   FIX::Dictionary dictionary;
<   std::string NamingConvention;
<
<
<   for (ps=_session_settings->getSessions().begin();
<        ps!=_session_settings->getSessions().end();
<        ps++)
<     {
<       _session_settings->get( *ps);
<       dictionary = _session_settings->get( *ps);
 
This causes a sigsev. The sigsev is in the string comparision function
in the STL. I hacked around a bit, but I couldn't get string.cc to compile 
in the STL.
I fixed the problem by making adding a function get_m_settings() to class
SessionSettings:
  Dictionaries& get_m_settings() { return m_settings;}
I then iterate through that map explicitly:
void relay_server::put_session_settings( FIX::SessionSettings *ss)
  std::map < FIX::SessionID, FIX::Dictionary >::iterator pd;
  for (pd=ss->get_m_settings().begin();
       pd!=ss->get_m_settings().end();
       pd++)
    {
This is certainly not the most elegent fix, but it was all I could do without hacking a fix for the STL
HTH
Clark

		
---------------------------------
Do you Yahoo!?
New and Improved Yahoo! Mail - 100MB free storage!

Re: [Quickfix-developers] newbie mysql questions

[Clark S. <cla...@ya...>]

In order to access the databases I had to log in as
root. I typed "mysql -u root".  As a normal user I
got:
1044 error "access denied @localhost"

I probably ran into these problems, because I don't
understand how to grant users's access, and how to set
passwords.

--- Oren Miller <or...@qu...> wrote:

> Clark,
> 
> You need to generate the database with the
> create_mysql script in the 
> src/sql directory.  This will generate a database
> called quickfix.  If 
> you are running a newer version of quickfix you may
> need to add a '-u 
> root' right after the mysql call if it isn't already
> there.  This is 
> assuming that your root account has not password
> which is the default 
> installation.  If you have a password or are using
> another account, you 
> will need to supply them.  After running the script,
> you can run the 
> mysql client and type 'use quickfix', then type
> 'show tables' .  You 
> can use standard SQL commands to do whatever queries
> you like.
> 
> --oren
> 
> On Aug 18, 2004, at 1:58 PM, Clark Sims wrote:
> 
> > QuickFIX Documentation: 
> >
>
http://www.quickfixengine.org/quickfix/doc/html/index.html
> > QuickFIX FAQ: 
> >
>
http://www.quickfixengine.org/wikifix/index.php?QuickFixFAQ
> > QuickFIX Support:
> http://www.quickfixengine.org/services.html
> >
> > I conigured and compiled quickfix to use mysql. Do
> I
> > need to do anything else or are the fix messages
> > automatically stored to a database on the hard
> drive?
> > What is the name of the database file?
> >
> > I have never used mysql before. How do I open the
> > database file of fix messages? I guess I should by
> a
> > book on mysql. Does anyone have a recomendation?
> >
> >
> > 		
> > __________________________________
> > Do you Yahoo!?
> > Take Yahoo! Mail with you! Get it on your mobile
> phone.
> > http://mobile.yahoo.com/maildemo
> >
> >
> >
>
-------------------------------------------------------
> > SF.Net email is sponsored by Shop4tech.com-Lowest
> price on Blank Media
> > 100pk Sonic DVD-R 4x for only $29 -100pk Sonic
> DVD+R for only $33
> > Save 50% off Retail on Ink & Toner - Free Shipping
> and Free Gift.
> >
>
http://www.shop4tech.com/z/Inkjet_Cartridges/9_108_r285
> > _______________________________________________
> > Quickfix-developers mailing list
> > Qui...@li...
> >
>
https://lists.sourceforge.net/lists/listinfo/quickfix-developers
> >
> 
> 



	
		
__________________________________
Do you Yahoo!?
New and Improved Yahoo! Mail - 100MB free storage!
http://promotions.yahoo.com/new_mail 

Re: [Quickfix-developers] MS VC++ release builds

[Antonio C. <ant...@ga...>]

Dear Tim,

Thank you for your contribution. Even if you mentioned hyperthreading  for
the second problem only [related to the Java version of QuickFix], we
experienced the first problem under Windows 2000 SP4 on a computer with two
XEON processors plus hyperthreading (actually we see 4 processor performance
sub-windows when the Task Manager window is opened). We shall use your
suggestion about compiler optimizations, and also we shall run more tests on
different HW (both mono and dual processors) even if slower processors might
reduce the risk of concurrent access to memory.

Bye,

Antonio Caroselli
GATE T.I.
www.gatelab.com



----- Original Message -----
From: "Timothy Yates" <Tim...@pa...>
To: "'Antonio Caroselli'" <ant...@ga...>
Cc: "'Oren Miller'" <or...@qu...>;
<qui...@li...>
Sent: Friday, August 20, 2004 3:20 PM
Subject: RE: [Quickfix-developers] MS VC++ release builds


> QuickFIX Documentation:
http://www.quickfixengine.org/quickfix/doc/html/index.html
> QuickFIX FAQ: http://www.quickfixengine.org/wikifix/index.php?QuickFixFAQ
> QuickFIX Support: http://www.quickfixengine.org/services.html
>
> Hi Antonio,
>
> I mentioned two distinct problems in my original email.
>
> The first of these related to random corruptions of field data in FIX
> messages, especially during periods of heavy traffic.  These problems
> occurred in an MS VC++ quickfix application.  Once or twice, we saw the
same
> CompID error you refer to. Typically, the corrupted field data contained
> parts of other FIX fields from the same message.
>
> We were never able to track down the cause of these corruptions -- we
found
> the problem very hard to reproduce. However, turning off compiler
> optimizations did seem to improve the situation considerably.  If you can
> find out the cause of this probem, I would be very interested.
>
> The second problem related to the Java version of QuickFIX on Windows XP.
> This problem seems to be related to hyperthreading (possibly in
combination
> with hot-spot compilation).  When I disabled hyperthreading on the host
> machine, this problem went away -- it doesn't seem to be related to the
> first problem as I initially thought.
>
> Tim
>
> -----Original Message-----
> From: Antonio Caroselli [mailto:ant...@ga...]
> Sent: Friday, August 20, 2004 3:53 AM
> To: Timothy Yates
> Cc: 'Oren Miller'; qui...@li...
> Subject: Re: [Quickfix-developers] MS VC++ release builds
>
>
> Dear Tim,
>
> We are experiencing the same problems described in your email dated June
> 14/2004.
>
> We are using MS VC++ 6 SP5 with default compilation and link options and
> QuickFix 1.7.1. The target application is being run under Windows Server
> 2000 SP4.
>
> In most cases we detected memory errors on incoming messages: we often get
> the error "Message nn rejected: CompID problem" even if the FIX message
> logged in our log file via the QuickFix log function shows correct tags
and
> values. It may happen that we have such a problem once or twice in a day
> under heavy traffic conditions, mostly on incoming messages. In few cases
> this possible memory problem also caused outgoing messages to be
truncated.
>
> At times (not always) this problem is followed by an application crash: we
> do not get any application fault window since the application simply
> disappears from the Task Manager.
>
> I have seen Oren's suggestion about the callstack. Did that help you solve
> your problem ? We might try and use QuickFix 1.8.0, but the release notes
do
> not seem to address this problem.
>
> Any help will be greatly appreciated
>
> Bye,
>
> Antonio Caroselli
> GATE T.I.
> www.gatelab.com
>
>
>
> ----- Original Message -----
> From: "Timothy Yates" <Tim...@pa...>
> To: "'Oren Miller'" <or...@qu...>
> Cc: <qui...@li...>
> Sent: Monday, June 14, 2004 5:30 PM
> Subject: RE: [Quickfix-developers] MS VC++ release builds
>
>
> > QuickFIX Documentation:
> http://www.quickfixengine.org/quickfix/doc/html/index.html
> > QuickFIX FAQ: http://www.quickfixengine.org/quickfix/doc/html/FAQ.html
> >
> > The callstack is not enabled.
> >
> > Tim.
> >
> > -----Original Message-----
> > From: Oren Miller [mailto:or...@qu...]
> > Sent: Monday, June 14, 2004 9:32 AM
> > To: Timothy Yates
> > Cc: qui...@li...
> > Subject: Re: [Quickfix-developers] MS VC++ release builds
> >
> >
> > Do you have the callstack enabled?
> >
> > --oren
> >
> > On Jun 14, 2004, at 8:39 AM, Timothy Yates wrote:
> >
> > > QuickFIX Documentation:
> > > http://www.quickfixengine.org/quickfix/doc/html/index.html
> > > QuickFIX FAQ: http://www.quickfixengine.org/quickfix/doc/html/FAQ.html
> > >
> > > Has anyone else had problems with apparently random crashes and memory
> > > corruptions in quickfix when using MS VC++, specifically using the
> > > default
> > > release build options?
> > >
> > > We have a C++ production application that uses quickfix.  We have had
> > > to
> > > build quickfix with all optimizations turned off.  We were unable to
> > > track
> > > down the memory corruptions that occurred with a release build.
> > >
> > > Recently, I have been using the Java version of quickfix.  I have a
> > > test
> > > application that generates MarketDataSnapshotFullRefresh messages  and
> > > populates them with essentially random price data.  The receiving
> > > application sends a subscribe message and the test application starts
> > > sending refresh messages at a rate of about 20 per second.  When using
> > > a
> > > release build of quickfix_jni.dll, the receiving application often
> > > crashes
> > > after several hundred messages due to an access violation.  This
> > > typically
> > > occurs in the destructor call from Message.finalize(), other times in
> > > Group.finalize(), and othertime some place else.   I do a session
reset
> > > between test runs.  Sometimes the application does not crash at all.
> > > I
> > > have tried disabling all processing of refresh messages by the
> > > receiving
> > > application (so it just returns from fromApp without doing anything),
> > > and
> > > the crashes still happen.
> > >
> > > The random nature of the crashes leads me to suspect a threading
issue.
> > >
> > > When I use a debug build of quickfix_jni.dll, I can never get it to
> > > crash.
> > > This might just be luck, or it might indicate a problem with compiler
> > > optimizations.
> > >
> > > I think this problem may have something to do with repeating groups as
> > > I
> > > have only started noticing it since implementing market data support.
> > > However, it could just be that I have started stressing quickfix more
> > > than
> > > before.
> > >
> > > Interestingly, the corruptions we were experiencing in our production
> > > C++
> > > application also occurred when there was a large amount of market data
> > > traffic.
> > >
> > > I am using quickfix 1.7.0.
> > >
> > > Tim Yates
> > > Lead Developer
> > > Patsystems (US) LLC
> > > 141 West Jackson Boulevard
> > > Chicago 60604, USA
> > > Tel +1 (312) 542-1336
> > > www.patsystems.com
> > >
> > >
> > >
> > >
> > >
> > > -------------------------------------------------------
> > > This SF.Net email is sponsored by the new InstallShield X.
> > > From Windows to Linux, servers to mobile, InstallShield X is the
> > > one installation-authoring solution that does it all. Learn more and
> > > evaluate today! http://www.installshield.com/Dev2Dev/0504
> > > _______________________________________________
> > > Quickfix-developers mailing list
> > > Qui...@li...
> > > https://lists.sourceforge.net/lists/listinfo/quickfix-developers
> > >
> >
> >
> > -------------------------------------------------------
> > This SF.Net email is sponsored by the new InstallShield X.
> > >From Windows to Linux, servers to mobile, InstallShield X is the
> > one installation-authoring solution that does it all. Learn more and
> > evaluate today! http://www.installshield.com/Dev2Dev/0504
> > _______________________________________________
> > Quickfix-developers mailing list
> > Qui...@li...
> > https://lists.sourceforge.net/lists/listinfo/quickfix-developers
> >
>
>
> -------------------------------------------------------
> SF.Net email is sponsored by Shop4tech.com-Lowest price on Blank Media
> 100pk Sonic DVD-R 4x for only $29 -100pk Sonic DVD+R for only $33
> Save 50% off Retail on Ink & Toner - Free Shipping and Free Gift.
> http://www.shop4tech.com/z/Inkjet_Cartridges/9_108_r285
> _______________________________________________
> Quickfix-developers mailing list
> Qui...@li...
> https://lists.sourceforge.net/lists/listinfo/quickfix-developers
>

RE: [Quickfix-developers] MS VC++ release builds

[Timothy Y. <Tim...@pa...>]

Hi Antonio,

I mentioned two distinct problems in my original email.

The first of these related to random corruptions of field data in FIX
messages, especially during periods of heavy traffic.  These problems
occurred in an MS VC++ quickfix application.  Once or twice, we saw the same
CompID error you refer to. Typically, the corrupted field data contained
parts of other FIX fields from the same message.

We were never able to track down the cause of these corruptions -- we found
the problem very hard to reproduce. However, turning off compiler
optimizations did seem to improve the situation considerably.  If you can
find out the cause of this probem, I would be very interested.

The second problem related to the Java version of QuickFIX on Windows XP.
This problem seems to be related to hyperthreading (possibly in combination
with hot-spot compilation).  When I disabled hyperthreading on the host
machine, this problem went away -- it doesn't seem to be related to the
first problem as I initially thought.

Tim

-----Original Message-----
From: Antonio Caroselli [mailto:ant...@ga...]
Sent: Friday, August 20, 2004 3:53 AM
To: Timothy Yates
Cc: 'Oren Miller'; qui...@li...
Subject: Re: [Quickfix-developers] MS VC++ release builds


Dear Tim,

We are experiencing the same problems described in your email dated June
14/2004.

We are using MS VC++ 6 SP5 with default compilation and link options and
QuickFix 1.7.1. The target application is being run under Windows Server
2000 SP4.

In most cases we detected memory errors on incoming messages: we often get
the error "Message nn rejected: CompID problem" even if the FIX message
logged in our log file via the QuickFix log function shows correct tags and
values. It may happen that we have such a problem once or twice in a day
under heavy traffic conditions, mostly on incoming messages. In few cases
this possible memory problem also caused outgoing messages to be truncated.

At times (not always) this problem is followed by an application crash: we
do not get any application fault window since the application simply
disappears from the Task Manager.

I have seen Oren's suggestion about the callstack. Did that help you solve
your problem ? We might try and use QuickFix 1.8.0, but the release notes do
not seem to address this problem.

Any help will be greatly appreciated

Bye,

Antonio Caroselli
GATE T.I.
www.gatelab.com



----- Original Message -----
From: "Timothy Yates" <Tim...@pa...>
To: "'Oren Miller'" <or...@qu...>
Cc: <qui...@li...>
Sent: Monday, June 14, 2004 5:30 PM
Subject: RE: [Quickfix-developers] MS VC++ release builds


> QuickFIX Documentation:
http://www.quickfixengine.org/quickfix/doc/html/index.html
> QuickFIX FAQ: http://www.quickfixengine.org/quickfix/doc/html/FAQ.html
>
> The callstack is not enabled.
>
> Tim.
>
> -----Original Message-----
> From: Oren Miller [mailto:or...@qu...]
> Sent: Monday, June 14, 2004 9:32 AM
> To: Timothy Yates
> Cc: qui...@li...
> Subject: Re: [Quickfix-developers] MS VC++ release builds
>
>
> Do you have the callstack enabled?
>
> --oren
>
> On Jun 14, 2004, at 8:39 AM, Timothy Yates wrote:
>
> > QuickFIX Documentation:
> > http://www.quickfixengine.org/quickfix/doc/html/index.html
> > QuickFIX FAQ: http://www.quickfixengine.org/quickfix/doc/html/FAQ.html
> >
> > Has anyone else had problems with apparently random crashes and memory
> > corruptions in quickfix when using MS VC++, specifically using the
> > default
> > release build options?
> >
> > We have a C++ production application that uses quickfix.  We have had
> > to
> > build quickfix with all optimizations turned off.  We were unable to
> > track
> > down the memory corruptions that occurred with a release build.
> >
> > Recently, I have been using the Java version of quickfix.  I have a
> > test
> > application that generates MarketDataSnapshotFullRefresh messages  and
> > populates them with essentially random price data.  The receiving
> > application sends a subscribe message and the test application starts
> > sending refresh messages at a rate of about 20 per second.  When using
> > a
> > release build of quickfix_jni.dll, the receiving application often
> > crashes
> > after several hundred messages due to an access violation.  This
> > typically
> > occurs in the destructor call from Message.finalize(), other times in
> > Group.finalize(), and othertime some place else.   I do a session reset
> > between test runs.  Sometimes the application does not crash at all.
> > I
> > have tried disabling all processing of refresh messages by the
> > receiving
> > application (so it just returns from fromApp without doing anything),
> > and
> > the crashes still happen.
> >
> > The random nature of the crashes leads me to suspect a threading issue.
> >
> > When I use a debug build of quickfix_jni.dll, I can never get it to
> > crash.
> > This might just be luck, or it might indicate a problem with compiler
> > optimizations.
> >
> > I think this problem may have something to do with repeating groups as
> > I
> > have only started noticing it since implementing market data support.
> > However, it could just be that I have started stressing quickfix more
> > than
> > before.
> >
> > Interestingly, the corruptions we were experiencing in our production
> > C++
> > application also occurred when there was a large amount of market data
> > traffic.
> >
> > I am using quickfix 1.7.0.
> >
> > Tim Yates
> > Lead Developer
> > Patsystems (US) LLC
> > 141 West Jackson Boulevard
> > Chicago 60604, USA
> > Tel +1 (312) 542-1336
> > www.patsystems.com
> >
> >
> >
> >
> >
> > -------------------------------------------------------
> > This SF.Net email is sponsored by the new InstallShield X.
> > From Windows to Linux, servers to mobile, InstallShield X is the
> > one installation-authoring solution that does it all. Learn more and
> > evaluate today! http://www.installshield.com/Dev2Dev/0504
> > _______________________________________________
> > Quickfix-developers mailing list
> > Qui...@li...
> > https://lists.sourceforge.net/lists/listinfo/quickfix-developers
> >
>
>
> -------------------------------------------------------
> This SF.Net email is sponsored by the new InstallShield X.
> >From Windows to Linux, servers to mobile, InstallShield X is the
> one installation-authoring solution that does it all. Learn more and
> evaluate today! http://www.installshield.com/Dev2Dev/0504
> _______________________________________________
> Quickfix-developers mailing list
> Qui...@li...
> https://lists.sourceforge.net/lists/listinfo/quickfix-developers
>

[Quickfix-developers] Tag not defined for this message type:295

[Joy B. <jo...@cy...>]

I am trying to implement MassQuote message in Java using Quickfix 1.8.0  =
and FIX 44 version.
I am receiving the following error output:

<20040820-12:21:04, FIX.4.4:TW->CLIENT1, incoming>
(8=3DFIX.4.4=019=3D121=0135=3Di=0134=3D3=0143=3DY=0149=3DCLIENT1=0152=3D2=
0040820-12:21:04.599=0156=3DTW=01122=3D20040820-12:20:53=01117=3DIDq=0129=
5=3D1=01296=3D1=01299=3DIDe=01302=3DIDs=01304=3D1=0110=3D167=01)

<20040820-12:21:04, FIX.4.4:TW->CLIENT1, event>

(Message 3 Rejected: Tag not defined for this message type:295)

<20040820-12:21:04, FIX.4.4:TW->CLIENT1, outgoing>

(8=3DFIX.4.4=019=3D118=0135=3D3=0134=3D6=0149=3DTW=0152=3D20040820-12:21:=
04.700=0156=3DCLIENT1=0145=3D3=0158=3DTag not defined for this message =
type=01371=3D295=01372=3Di=01373=3D2=0110=3D138=01)



My Server side code is as follows :



public void onMessage( quickfix.fix44.MassQuote massquote, SessionID =
sessionID )

throws FieldNotFound, UnsupportedMessageType, IncorrectTagValue {=20


QuoteID quoteid =3D new QuoteID();=20

NoQuoteSets noquotesets =3D new NoQuoteSets();


massquote.get(quoteid);

massquote.get(noquotesets);


quickfix.fix44.MassQuote.NoQuoteSets group =3D new =
quickfix.fix44.MassQuote.NoQuoteSets();


QuoteSetID quotesetid =3D new QuoteSetID();

TotNoQuoteEntries totnoquoteentries =3D new TotNoQuoteEntries();

NoQuoteEntries noquoteentries =3D new NoQuoteEntries();


massquote.getGroup(1,group);

group.get(quotesetid);=20


        if( group.isSet(totnoquoteentries)){

                group.get(totnoquoteentries);=20

               }

        if( group.isSet( noquoteentries ) ){

                group.get(noquoteentries);

               }


quickfix.fix44.MassQuote.NoQuoteSets.NoQuoteEntries subGroup =3D new =
quickfix.fix44.MassQuote.NoQuoteSets.NoQuoteEntries();

QuoteEntryID quoteentryid =3D new QuoteEntryID();


group.getGroup(1,subGroup );


        if( subGroup.isSet( quoteentryid ) ){

              subGroup.get(quoteentryid);

            }



quickfix.fix44.MassQuoteAcknowledgement massquoteacknowledgement =3D new =
quickfix.fix44.MassQuoteAcknowledgement();


QuoteStatus quotestatus =3D new QuoteStatus();

massquoteacknowledgement.setField(quotestatus);

try{

Session.sendToTarget(massquoteacknowledgement,sessionID);

}=20

catch(SessionNotFound e) {}

}=20




My client side code is as follows :



private Message send44(quickfix.fix44.MassQuote massQuote) {


massQuote =3D

new quickfix.fix44.MassQuote(

new QuoteID(messageMap.get("QuoteID").toString()));


quickfix.fix44.MassQuote.NoQuoteSets noQuoteSetsGroup =3D new =
quickfix.fix44.MassQuote.NoQuoteSets();


noQuoteSetsGroup.set(new =
QuoteSetID(messageMap.get("QuoteSetID").toString()));

noQuoteSetsGroup.set(new TotNoQuoteEntries( Integer.parseInt(

messageMap.get("TotNoQuoteEntries").toString())));

quickfix.fix44.MassQuote.NoQuoteSets.NoQuoteEntries noQuoteEntriesGroup =
=3D new quickfix.fix44.MassQuote.NoQuoteSets.NoQuoteEntries();

noQuoteEntriesGroup.set(

new QuoteEntryID(messageMap.get("QuoteEntryID").toString()));


noQuoteSetsGroup.addGroup(noQuoteEntriesGroup);

massQuote.addGroup( noQuoteSetsGroup );

return massQuote;

}



Please advise me as to why i am getting a "Tag not defined for this =
message type: 295" . A similar implementation done in c++ seems to be =
working fine.

Joy

Re: [Quickfix-developers] MS VC++ release builds

[Antonio C. <ant...@ga...>]

Dear Tim,

We are experiencing the same problems described in your email dated June
14/2004.

We are using MS VC++ 6 SP5 with default compilation and link options and
QuickFix 1.7.1. The target application is being run under Windows Server
2000 SP4.

In most cases we detected memory errors on incoming messages: we often get
the error "Message nn rejected: CompID problem" even if the FIX message
logged in our log file via the QuickFix log function shows correct tags and
values. It may happen that we have such a problem once or twice in a day
under heavy traffic conditions, mostly on incoming messages. In few cases
this possible memory problem also caused outgoing messages to be truncated.

At times (not always) this problem is followed by an application crash: we
do not get any application fault window since the application simply
disappears from the Task Manager.

I have seen Oren's suggestion about the callstack. Did that help you solve
your problem ? We might try and use QuickFix 1.8.0, but the release notes do
not seem to address this problem.

Any help will be greatly appreciated

Bye,

Antonio Caroselli
GATE T.I.
www.gatelab.com



----- Original Message -----
From: "Timothy Yates" <Tim...@pa...>
To: "'Oren Miller'" <or...@qu...>
Cc: <qui...@li...>
Sent: Monday, June 14, 2004 5:30 PM
Subject: RE: [Quickfix-developers] MS VC++ release builds


> QuickFIX Documentation:
http://www.quickfixengine.org/quickfix/doc/html/index.html
> QuickFIX FAQ: http://www.quickfixengine.org/quickfix/doc/html/FAQ.html
>
> The callstack is not enabled.
>
> Tim.
>
> -----Original Message-----
> From: Oren Miller [mailto:or...@qu...]
> Sent: Monday, June 14, 2004 9:32 AM
> To: Timothy Yates
> Cc: qui...@li...
> Subject: Re: [Quickfix-developers] MS VC++ release builds
>
>
> Do you have the callstack enabled?
>
> --oren
>
> On Jun 14, 2004, at 8:39 AM, Timothy Yates wrote:
>
> > QuickFIX Documentation:
> > http://www.quickfixengine.org/quickfix/doc/html/index.html
> > QuickFIX FAQ: http://www.quickfixengine.org/quickfix/doc/html/FAQ.html
> >
> > Has anyone else had problems with apparently random crashes and memory
> > corruptions in quickfix when using MS VC++, specifically using the
> > default
> > release build options?
> >
> > We have a C++ production application that uses quickfix.  We have had
> > to
> > build quickfix with all optimizations turned off.  We were unable to
> > track
> > down the memory corruptions that occurred with a release build.
> >
> > Recently, I have been using the Java version of quickfix.  I have a
> > test
> > application that generates MarketDataSnapshotFullRefresh messages  and
> > populates them with essentially random price data.  The receiving
> > application sends a subscribe message and the test application starts
> > sending refresh messages at a rate of about 20 per second.  When using
> > a
> > release build of quickfix_jni.dll, the receiving application often
> > crashes
> > after several hundred messages due to an access violation.  This
> > typically
> > occurs in the destructor call from Message.finalize(), other times in
> > Group.finalize(), and othertime some place else.   I do a session reset
> > between test runs.  Sometimes the application does not crash at all.
> > I
> > have tried disabling all processing of refresh messages by the
> > receiving
> > application (so it just returns from fromApp without doing anything),
> > and
> > the crashes still happen.
> >
> > The random nature of the crashes leads me to suspect a threading issue.
> >
> > When I use a debug build of quickfix_jni.dll, I can never get it to
> > crash.
> > This might just be luck, or it might indicate a problem with compiler
> > optimizations.
> >
> > I think this problem may have something to do with repeating groups as
> > I
> > have only started noticing it since implementing market data support.
> > However, it could just be that I have started stressing quickfix more
> > than
> > before.
> >
> > Interestingly, the corruptions we were experiencing in our production
> > C++
> > application also occurred when there was a large amount of market data
> > traffic.
> >
> > I am using quickfix 1.7.0.
> >
> > Tim Yates
> > Lead Developer
> > Patsystems (US) LLC
> > 141 West Jackson Boulevard
> > Chicago 60604, USA
> > Tel +1 (312) 542-1336
> > www.patsystems.com
> >
> >
> >
> >
> >
> > -------------------------------------------------------
> > This SF.Net email is sponsored by the new InstallShield X.
> > From Windows to Linux, servers to mobile, InstallShield X is the
> > one installation-authoring solution that does it all. Learn more and
> > evaluate today! http://www.installshield.com/Dev2Dev/0504
> > _______________________________________________
> > Quickfix-developers mailing list
> > Qui...@li...
> > https://lists.sourceforge.net/lists/listinfo/quickfix-developers
> >
>
>
> -------------------------------------------------------
> This SF.Net email is sponsored by the new InstallShield X.
> >From Windows to Linux, servers to mobile, InstallShield X is the
> one installation-authoring solution that does it all. Learn more and
> evaluate today! http://www.installshield.com/Dev2Dev/0504
> _______________________________________________
> Quickfix-developers mailing list
> Qui...@li...
> https://lists.sourceforge.net/lists/listinfo/quickfix-developers
>

Re: [Quickfix-developers] TIB enable quickfix

[Oren M. <or...@qu...>]

Yeah, QuickFIX and OpenAdapter both had presentations at an SIMC 
conference in New York a while ago.  We chatted with them for a bit 
afterward and talked about a possible collaboration integrating 
QuickFIX with OpenAdapter, but we never followed up on it.

--oren

On Aug 18, 2004, at 4:52 PM, Richard wrote:

> QuickFIX Documentation: 
> http://www.quickfixengine.org/quickfix/doc/html/index.html
> QuickFIX FAQ: 
> http://www.quickfixengine.org/wikifix/index.php?QuickFixFAQ
> QuickFIX Support: http://www.quickfixengine.org/services.html
>
> Jon,
>
> Yes I have extensive experience in using TIBCO software from 
> programming  TIBCO into Java small programs to full blown Active 
> enterpise solutions using Integration manager and Business works. 
> Before Reuters put in his weight I used to do the MDDS solutions as 
> well. Why need any help ?
>
> On the release of the source, it's not an urgent matter I came along 
> this open source fix-engine and decided to have a look and it looks 
> mature enough to use in a serious production environment. I'm in favor 
> of using open source.
>
> Haven't used yet but will in the future the integration software from 
> www.openadapter.org. Also a great opensource project...
>
> Regards,
>
> Richard
>
> Jon Dahl wrote:
>
>> QuickFIX Documentation: 
>> http://www.quickfixengine.org/quickfix/doc/html/index.html
>> QuickFIX FAQ: 
>> http://www.quickfixengine.org/wikifix/index.php?QuickFixFAQ
>> QuickFIX Support: http://www.quickfixengine.org/services.html
>>> Jon,
>>>
>>> Are you willing to share your part in this extension to quickfix. I 
>>> need
>>>  a tibco-end on this fixengine to make it usefull for me. Now we are
>>> stuck with big expensive fix engines to do simple things just because
>>> they have a tib-adapter.
>>>
>>> It would be nice (haven't checked yet) isf there where just some
>>> standaard hooks or functions where one could plugin his/her own
>>> middleware messaging solution (like j2ee, /net, mq or rendezvous)
>>>
>>> Richard
>> Richard,
>> At this point, I can't divulge anything as of yet. Talks are in the 
>> works
>> to contribute to the QF source tree. Do you have any experience with
>> Tibco?
>> jd
>> -------------------------------------------------------
>> SF.Net email is sponsored by Shop4tech.com-Lowest price on Blank Media
>> 100pk Sonic DVD-R 4x for only $29 -100pk Sonic DVD+R for only $33
>> Save 50% off Retail on Ink & Toner - Free Shipping and Free Gift.
>> http://www.shop4tech.com/z/Inkjet_Cartridges/9_108_r285
>> _______________________________________________
>> Quickfix-developers mailing list
>> Qui...@li...
>> https://lists.sourceforge.net/lists/listinfo/quickfix-developers
>
>
>
> -------------------------------------------------------
> SF.Net email is sponsored by Shop4tech.com-Lowest price on Blank Media
> 100pk Sonic DVD-R 4x for only $29 -100pk Sonic DVD+R for only $33
> Save 50% off Retail on Ink & Toner - Free Shipping and Free Gift.
> http://www.shop4tech.com/z/Inkjet_Cartridges/9_108_r285
> _______________________________________________
> Quickfix-developers mailing list
> Qui...@li...
> https://lists.sourceforge.net/lists/listinfo/quickfix-developers
>