Re: [Quickfix-developers] FileStore crashes in .NET?

SourceForge Headquarters 225 Broadway Suite 1600 San Diego, CA 92101 +1 (858) 422-6466

Can it be because of windows file size limits (just guessing)? Do we handle
those in quickfix?

Rick,

Which file system is your FileStore using to store data?

thanks,
-- Sibte

On Tue, May 13, 2008 at 5:10 PM, <or...@qu...> wrote:

> QuickFIX Documentation:
> http://www.quickfixengine.org/quickfix/doc/html/index.html
> QuickFIX Support: http://www.quickfixengine.org/services.html
>
> Well, I know there were some fixes put it recently where unmanaged
> exceptions were not properly caught and propogated to the VM.  Maybe it
> has something to do with that.  Do your logs provide any insight on what
> was going on at the time of crash?
>
> --oren
>
> > -------- Original Message --------
> > Subject: Re: [Quickfix-developers] FileStore crashes in .NET?
> > From: Rick Lane <ric...@gm...>
> > Date: Tue, May 13, 2008 2:45 pm
> > To: or...@qu...
> > Cc: qui...@li...
> > QuickFIX Documentation:
> http://www.quickfixengine.org/quickfix/doc/html/index.html
> > QuickFIX Support: http://www.quickfixengine.org/services.html
> <hr>Greetings,
> > I brought up an issue 2 months ago where it seemed that my FileStore
> > might be crashing.  The issue somewhat went away and has now resurfaced
> > -- I'm no longer convinced this occurred from the FileStore, but I am
> > fairly convinced this is a QuickFix issue.
> > My trading application is built in C# .NET 2.0, and so I'm using the
> > quickfix_net and quickfix_net_messages DLLs.  From what I gather about
> > these DLLs, they are .NET wrappers around the native, unmanaged code.
> > The crashes I'm seeing are not of the friendly type -- in other words,
> > they don't give me the option to debug, and they give me no information
> > (they aren't the "You application has experienced an error and needs to
> > close" variety).  Rather, they are the "Runtime Error!!!" with the big
> > red "X" dialogs that signal a hard crash.  I believe this only ever
> > occurs with unmanaged native code, which tells me (because the quickfix
> > DLLs are the only such code) that this must be occurring within these
> > libraries.
> > My application processes /many /messages in a day -- it often processes
> > more than 1 million messages in any given day (I'm not sure if that's
> > common or on the high end, but something tells me it's on the high
> > end).  And so I have a very rapid messaging rate.  What I'm wondering is
> > if anyone has ever seen these types of "hard" application crashes before
> > and possibly any remedies or ideas as to what might be causing it.
> > The absolute worst part about all of this is that Dr Watson dump files
> > (.dmp) are not being generated.  They were generated the first few times
> > crashes occurred, but I installed Visual Studio and that, for some
> > reason, stopped the dump files from being generated.  So I have
> > absolutely no visibility into this error -- any help is greatly
> appreciated.
> > Thanks,
> > Rick
> > or...@qu... wrote:
> > > Never mind.  I can see it's VS8 from your post.  Might be able to do
> > > something about this by changing the build settings.  I don't think
> > > it's a coding error.  I'm looking into the microsoft knowledge base
> > > for possible solutions.
> > >
> > >     -------- Original Message --------
> > >     Subject: Re: [Quickfix-developers] FileStore crashes in .NET?
> > >     From: Rick Lane <ric...@gm...>
> > >     Date: Fri, March 14, 2008 2:41 pm
> > >     To: qui...@li...
> > >     <mailto:qui...@li...>
> > >
> > >     QuickFIX Documentation:
> > >     http://www.quickfixengine.org/quickfix/doc/html/index.html
> > >     QuickFIX Support: http://www.quickfixengine.org/services.html
> > >
> > >
> ------------------------------------------------------------------------
> > >     After some more digging, I'm attempting to load the .dmp file
> > >     generated at the application crash into Visual Studio.  There are
> > >     many entries for quickfix_net.dll (which, as you said, may not
> > >     mean there was a problem with quickfix), but it would be nice to
> > >     be able to load the .pdb file for QuickFix into Visual Studio so I
> > >     can see actual function names instead of just assembly mumbo
> jumbo.
> > >
> > >     I tried loading both the debug/vs8/quickfix_net.pdb and the
> > >     release/vs8/quickfix_net.pdb and for both it said it "did not
> > >     match the module."  Has anyone tried to load these pdb files into
> > >     studio for debugging purposes?  incidentally, the exception is:
> > >     "Unhandled exception at 0x77e4bee7 in user.dmp: 0xC0020001: The
> > >     string binding is invalid."  I've done some research on this and
> > >     in most cases it seems to occur when people are blending managed
> > >     and unmanaged code.  Outside of QuickFix, I do /not /have any
> > >     unmanaged code -- so is this looking more like it might be a
> > >     native issue (after all, isn't the .NET QuickFix library just a
> > >     wrapper around the unmanaged version?).
> > >
> > >     call stack at crash:
> > >
> > >     >    kernel32.dll!77e4bee7()
> > >          [Frames below may be incorrect and/or missing, no symbols
> > >     loaded for kernel32.dll]
> > >          kernel32.dll!77e4bee7()
> > >          quickfix_net.dll!10084f0c()
> > >          quickfix_net.dll!100938d5()
> > >          quickfix_net.dll!10093938()
> > >
> > >
> > >     or...@qu... <mailto:or...@qu...> wrote:
> > >>     I don't know of any outstanding bugs with the filestore.  Do you
> > >>     have any kind of stack trace.  Keep in mind that the
> > >>     quickfix_net.dll will pretty much always show up because events
> > >>     are being passed from quickfix to your application.  So crashes
> > >>     in your application will generally appear to start out in the
> > >>     quickfix dll.  12 MB is pretty big, but not outrageous and I've
> > >>     seen bigger.  None of it is kept in memory, it's only read in as
> > >>     needed for resend requests and such.  Any idea if one was being
> > >>     processed during your crash?
> > >>
> > >>     --oren
> > >>
> > >>         -------- Original Message --------
> > >>         Subject: [Quickfix-developers] FileStore crashes in .NET?
> > >>         From: Rick Lane <ric...@gm...>
> > >>         Date: Fri, March 14, 2008 11:39 am
> > >>         To: qui...@li...
> > >>         <mailto:qui...@li...>
> > >>
> > >>         QuickFIX Documentation:
> > >>         http://www.quickfixengine.org/quickfix/doc/html/index.html
> > >>         QuickFIX Support: http://www.quickfixengine.org/services.html
> > >>
> > >>         Greetings,
> > >>
> > >>         Have there been any documented instances of QuickFix causing
> an
> > >>         application crash in .NET related to the FileStore? My
> > >>         application was
> > >>         running along just fine, entering no orders (and with no
> > >>         orders, and
> > >>         therefore no execution reports) for a couple hours after a
> > >>         very busy
> > >>         morning. So for about an hour, the only traffic through
> QuickFix
> > >>         should've been heartbeats. I received an Application crash --
> > >>         not the
> > >>         good kind, the kind that pretty much doesn't let you do any
> > >>         sort of
> > >>         recovery -- for the first time (I've gotten many crashes due
> > >>         to a null
> > >>         pointer, etc., but these can be caught and therefore
> > >>         recovered from).
> > >>
> > >>         I'm not 100% sure QuickFix caused this -- I'm in the process
> > >>         of thumbing
> > >>         through the memory dump created by Dr Watson (I'm not very
> > >>         good at this)
> > >>         -- but the quickfix_net dll keeps popping up in the log, so I
> > >>         decided to
> > >>         go check out the FileStore file. I was surprised to see it
> > >>         was nearly
> > >>         12 MB (which I guess because of a busy morning, this is to be
> > >>         expected?). This crash could very well have been due to the
> > >>         market data
> > >>         portion of my app (which listens to the CME's FIX/FAST data
> > >>         stream) but
> > >>         I thought I was handling those types of errors better than
> > >>         this, so I
> > >>         just wanted to see if anyone else has seen unexpected crashes
> > >>         w/ the
> > >>         .NET quickfix library, possibly having something to do with
> > >>         the FileStore?
> > >>
> > >>         Thanks in advance,
> > >>         Rick
> > >>
> > >>
> -------------------------------------------------------------------------
> > >>         This SF.net <http://SF.net> email is sponsored by: Microsoft
> > >>         Defy all challenges. Microsoft(R) Visual Studio 2008.
> > >>         http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
> > >>         _______________________________________________
> > >>         Quickfix-developers mailing list
> > >>         Qui...@li...
> > >>         <mailto:Qui...@li...>
> > >>
> https://lists.sourceforge.net/lists/listinfo/quickfix-developers
> > >>
> > >
> ------------------------------------------------------------------------
> > >
> -------------------------------------------------------------------------
> > >     This SF.net <http://SF.net> email is sponsored by: Microsoft
> > >     Defy all challenges. Microsoft(R) Visual Studio 2008.
> > >     http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
> > >
> ------------------------------------------------------------------------
> > >     _______________________________________________
> > >     Quickfix-developers mailing list
> > >     Qui...@li... <#Compose>
> > >     https://lists.sourceforge.net/lists/listinfo/quickfix-developers
> >
> ><hr>-------------------------------------------------------------------------
> > This SF.net email is sponsored by: Microsoft
> > Defy all challenges. Microsoft(R) Visual Studio 2008.
> > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
> <hr>_______________________________________________
> > Quickfix-developers mailing list
> > Qui...@li...
> > https://lists.sourceforge.net/lists/listinfo/quickfix-developers
>
>
> -------------------------------------------------------------------------
> This SF.net email is sponsored by: Microsoft
> Defy all challenges. Microsoft(R) Visual Studio 2008.
> http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
> _______________________________________________
> Quickfix-developers mailing list
> Qui...@li...
> https://lists.sourceforge.net/lists/listinfo/quickfix-developers
>