Thread: Re: [Quickfix-developers] FileStore crashes in .NET?
Brought to you by:
orenmnero
Menu
▾
▴
quickfix-developers
|
From: <or...@qu...> - 2008-03-14 16:56:44
|
<html><body><div>I don't know of any outstanding bugs with the filestore. Do you have any kind of stack trace. Keep in mind that the quickfix_net.dll will pretty much always show up because events are being passed from quickfix to your application. So crashes in your application will generally appear to start out in the quickfix dll. 12 MB is pretty big, but not outrageous and I've seen bigger. None of it is kept in memory, it's only read in as needed for resend requests and such. Any idea if one was being processed during your crash?</div> <div> </div> <div>--oren</div> <BLOCKQUOTE style="PADDING-LEFT: 8px; MARGIN-LEFT: 8px; BORDER-LEFT: blue 2px solid" webmail="1">-------- Original Message --------<BR>Subject: [Quickfix-developers] FileStore crashes in .NET?<BR>From: Rick Lane <ric...@gm...><BR>Date: Fri, March 14, 2008 11:39 am<BR>To: <a href="mailto:qui...@li...">qui...@li...</a><BR><BR>QuickFIX Documentation: <a href="http://www.quickfixengine.org/quickfix/doc/html/index.html" target=_blank>http://www.quickfixengine.org/quickfix/doc/html/index.html</a><BR>QuickFIX Support: <a href="http://www.quickfixengine.org/services.html" target=_blank>http://www.quickfixengine.org/services.html</a><BR><BR>Greetings,<BR><BR>Have there been any documented instances of QuickFix causing an <BR>application crash in .NET related to the FileStore? My application was <BR>running along just fine, entering no orders (and with no orders, and <BR>therefore no execution reports) for a couple hours after a very busy <BR>morning. So for about an hour, the only traffic through QuickFix <BR>should've been heartbeats. I received an Application crash -- not the <BR>good kind, the kind that pretty much doesn't let you do any sort of <BR>recovery -- for the first time (I've gotten many crashes due to a null <BR>pointer, etc., but these can be caught and therefore recovered from).<BR><BR>I'm not 100% sure QuickFix caused this -- I'm in the process of thumbing <BR>through the memory dump created by Dr Watson (I'm not very good at this) <BR>-- but the quickfix_net dll keeps popping up in the log, so I decided to <BR>go check out the FileStore file. I was surprised to see it was nearly <BR>12 MB (which I guess because of a busy morning, this is to be <BR>expected?). This crash could very well have been due to the market data <BR>portion of my app (which listens to the CME's FIX/FAST data stream) but <BR>I thought I was handling those types of errors better than this, so I <BR>just wanted to see if anyone else has seen unexpected crashes w/ the <BR>.NET quickfix library, possibly having something to do with the FileStore?<BR><BR>Thanks in advance,<BR>Rick<BR><BR>-------------------------------------------------------------------------<BR>This <a href="http://SF.net">SF.net</a> email is sponsored by: Microsoft<BR>Defy all challenges. Microsoft(R) Visual Studio 2008.<BR><a href="http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/" target=_blank>http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/</a><BR>_______________________________________________<BR>Quickfix-developers mailing list<BR><a onclick="Popup.composeWindow('pcompose.php?sendto=Quickfix-developers%40lists.sourceforge.net'); return false;" href="#Compose">Quickfix-developers<B></B>@lists.sourceforge.net</A><BR><A href="https://lists.sourceforge.net/lists/listinfo/quickfix-developers" target=_blank>https://lists.sourceforge.net/lists/listinfo/quickfix-developers</a><BR></BLOCKQUOTE></body></html> |
|
From: <or...@qu...> - 2008-03-14 20:13:17
|
<html><body>Never mind. I can see it's VS8 from your post. Might be able to do something about this by changing the build settings. I don't think it's a coding error. I'm looking into the microsoft knowledge base for possible solutions.<BR><BR> <BLOCKQUOTE style="PADDING-LEFT: 8px; MARGIN-LEFT: 8px; BORDER-LEFT: blue 2px solid" webmail="1">-------- Original Message --------<BR>Subject: Re: [Quickfix-developers] FileStore crashes in .NET?<BR>From: Rick Lane <ric...@gm...><BR>Date: Fri, March 14, 2008 2:41 pm<BR>To: <a href="mailto:qui...@li...">qui...@li...</a><BR><BR>QuickFIX Documentation: <a href="http://www.quickfixengine.org/quickfix/doc/html/index.html" target=_blank>http://www.quickfixengine.org/quickfix/doc/html/index.html</a><BR>QuickFIX Support: <a href="http://www.quickfixengine.org/services.html" target=_blank>http://www.quickfixengine.org/services.html</a><BR><BR> <HR> After some more digging, I'm attempting to load the .dmp file generated at the application crash into Visual Studio. There are many entries for quickfix_net.dll (which, as you said, may not mean there was a problem with quickfix), but it would be nice to be able to load the .pdb file for QuickFix into Visual Studio so I can see actual function names instead of just assembly mumbo jumbo.<BR><BR>I tried loading both the debug/vs8/quickfix_net.pdb and the release/vs8/quickfix_net.pdb and for both it said it "did not match the module." Has anyone tried to load these pdb files into studio for debugging purposes? incidentally, the exception is: "<SPAN id=_ctl0_MainContent_PostFlatView><SPAN>Unhandled exception at 0x77e4bee7 in user.dmp: 0xC0020001: The string binding is invalid." I've done some research on this and in most cases it seems to occur when people are blending managed and unmanaged code. Outside of QuickFix, I do <I>not </I>have any unmanaged code -- so is this looking more like it might be a native issue (after all, isn't the .NET QuickFix library just a wrapper around the unmanaged version?).<BR><BR>call stack at crash:<BR><BR></SPAN></SPAN>> kernel32.dll!77e4bee7() <BR> [Frames below may be incorrect and/or missing, no symbols loaded for kernel32.dll] <BR> kernel32.dll!77e4bee7() <BR> quickfix_net.dll!10084f0c() <BR> quickfix_net.dll!100938d5() <BR> quickfix_net.dll!10093938() <BR><BR><BR><a class=moz-txt-link-abbreviated onclick="Popup.composeWindow('pcompose.php?sendto=oren%40quickfixengine.org');; return false;" href="mailto:or...@qu..." target=_blank><a href="mailto:or...@qu...">or...@qu...</a></A> wrote: <BLOCKQUOTE cite=mid:200...@em... type="cite"> <DIV>I don't know of any outstanding bugs with the filestore. Do you have any kind of stack trace. Keep in mind that the quickfix_net.dll will pretty much always show up because events are being passed from quickfix to your application. So crashes in your application will generally appear to start out in the quickfix dll. 12 MB is pretty big, but not outrageous and I've seen bigger. None of it is kept in memory, it's only read in as needed for resend requests and such. Any idea if one was being processed during your crash?</DIV> <DIV> </DIV> <DIV>--oren</DIV> <BLOCKQUOTE style="PADDING-LEFT: 8px; MARGIN-LEFT: 8px; BORDER-LEFT: blue 2px solid" webmail="1">-------- Original Message --------<BR>Subject: [Quickfix-developers] FileStore crashes in .NET?<BR>From: Rick Lane <A class=moz-txt-link-rfc2396E onclick="Popup.composeWindow('pcompose.php?sendto=rick.lane%40gmail.com');; return false;" href="mailto:ric...@gm..." target=_blank><ric...@gm...></A><BR>Date: Fri, March 14, 2008 11:39 am<BR>To: <A onclick="Popup.composeWindow('pcompose.php?sendto=quickfix-developers%40lists.sourceforge.net');; return false;" href="mailto:qui...@li..." target=_blank moz-do-not-send="true"><a href="mailto:qui...@li...">qui...@li...</a></A><BR><BR>QuickFIX Documentation: <A href="http://www.quickfixengine.org/quickfix/doc/html/index.html" target=_blank moz-do-not-send="true">http://www.quickfixengine.org/quickfix/doc/html/index.html</a><BR>QuickFIX Support: <a href="http://www.quickfixengine.org/services.html" target=_blank moz-do-not-send="true">http://www.quickfixengine.org/services.html</a><BR><BR>Greetings,<BR><BR>Have there been any documented instances of QuickFix causing an <BR>application crash in .NET related to the FileStore? My application was <BR>running along just fine, entering no orders (and with no orders, and <BR>therefore no execution reports) for a couple hours after a very busy <BR>morning. So for about an hour, the only traffic through QuickFix <BR>should've been heartbeats. I received an Application crash -- not the <BR>good kind, the kind that pretty much doesn't let you do any sort of <BR>recovery -- for the first time (I've gotten many crashes due to a null <BR>pointer, etc., but these can be caught and therefore recovered from).<BR><BR>I'm not 100% sure QuickFix caused this -- I'm in the process of thumbing <BR>through the memory dump created by Dr Watson (I'm not very good at this) <BR>-- but the quickfix_net dll keeps popping up in the log, so I decided to <BR>go check out the FileStore file. I was surprised to see it was nearly <BR>12 MB (which I guess because of a busy morning, this is to be <BR>expected?). This crash could very well have been due to the market data <BR>portion of my app (which listens to the CME's FIX/FAST data stream) but <BR>I thought I was handling those types of errors better than this, so I <BR>just wanted to see if anyone else has seen unexpected crashes w/ the <BR>.NET quickfix library, possibly having something to do with the FileStore?<BR><BR>Thanks in advance,<BR>Rick<BR><BR>-------------------------------------------------------------------------<BR>This <a href="http://sf.net/" target=_blank moz-do-not-send="true"><a href="http://SF.net">SF.net</a></A> email is sponsored by: Microsoft<BR>Defy all challenges. Microsoft(R) Visual Studio 2008.<BR><A href="http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/" target=_blank moz-do-not-send="true">http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/</a><BR>_______________________________________________<BR>Quickfix-developers mailing list<BR><a href="#Compose" target=_self moz-do-not-send="true" _onclick="Popup.composeWindow('pcompose.php?sendto=Quickfix-developers%40lists.sourceforge.net'); return false;"><a href="mailto:Qui...@li...">Qui...@li...</a></A><BR><A href="https://lists.sourceforge.net/lists/listinfo/quickfix-developers" target=_blank moz-do-not-send="true">https://lists.sourceforge.net/lists/listinfo/quickfix-developers</a><BR></BLOCKQUOTE></BLOCKQUOTE> <HR> -------------------------------------------------------------------------<BR>This <a href="http://SF.net">SF.net</a> email is sponsored by: Microsoft<BR>Defy all challenges. Microsoft(R) Visual Studio 2008.<BR><a href="http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/" target=_blank>http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/</a> <HR> _______________________________________________<BR>Quickfix-developers mailing list<BR><a onclick="Popup.composeWindow('pcompose.php?sendto=Quickfix-developers%40lists.sourceforge.net'); return false;" href="#Compose">Quickfix-developers<B></B>@lists.sourceforge.net</A><BR><A href="https://lists.sourceforge.net/lists/listinfo/quickfix-developers" target=_blank>https://lists.sourceforge.net/lists/listinfo/quickfix-developers</a> </BLOCKQUOTE></body></html> |
|
From: <Nil...@co...> - 2008-03-17 10:43:30
|
Hi I am working on Market Data Component for server side and client side. Application needs to provide the following information as Market Data, Top of the book, Price Depth, Order Depth, Price & Volume information and Ticker (Symbol and LTP). In this regard I have following questions, would appreciate if you can provide any pointer to solve this: a) I am able to provide the Price & Order Depth for one level, but when try to provide the information for multiple levels, say 5 level. The server reports the following error before send message, "Tag appears more than once". Its tag no 269, even though tag 268=5. b) What tags to use, to request/provide the price and volume information? c) How do I provide the Ticker information, I mean what type of message and tag to use? d) Does QF support multicasting? I understand that (please correct me if I am wrong any where) Market Data Request - Client can request for any of the market data as snapshot or snapshot + refresh. The refresh can be of two types, full refresh or incremental refresh. Client can request the market data for one symbol or set of symbols (is the max limit here) Market Data Snapshot/ Full Refresh: The server provides the snapshot of the market data or full refreshes using this message type. The server provides the market data for one or more symbols (based on the client request) I see that FIX specs don't talk about the refresh frequency. That means, the application needs to decide at frequency it wants to provide the refresh (every second or every five seconds etc..) Market Data - Incremental Refresh: The server provides the incremental refresh of the market data and not the full refresh. Refresh frequency to be decided by the application. Please correct me if I am wrong in my understanding of any of the above market data messages. Thanks in advance -Nilesh >-----Original Message----- >From: qui...@li... [mailto:quickfix- >dev...@li...] On Behalf Of >or...@qu... >Sent: Saturday, March 15, 2008 1:43 AM >To: Rick Lane >Cc: qui...@li... >Subject: Re: [Quickfix-developers] FileStore crashes in .NET? > >QuickFIX Documentation: >http://www.quickfixengine.org/quickfix/doc/html/index.html >QuickFIX Support: http://www.quickfixengine.org/services.html This e-mail and any files transmitted with it are for the sole use of the intended recipient(s) and may contain confidential and privileged information. If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message. Any unauthorised review, use, disclosure, dissemination, forwarding, printing or copying of this email or any action taken in reliance on this e-mail is strictly prohibited and may be unlawful. |
|
From: Rick L. <ric...@gm...> - 2008-05-13 19:45:35
|
Greetings, I brought up an issue 2 months ago where it seemed that my FileStore might be crashing. The issue somewhat went away and has now resurfaced -- I'm no longer convinced this occurred from the FileStore, but I am fairly convinced this is a QuickFix issue. My trading application is built in C# .NET 2.0, and so I'm using the quickfix_net and quickfix_net_messages DLLs. From what I gather about these DLLs, they are .NET wrappers around the native, unmanaged code. The crashes I'm seeing are not of the friendly type -- in other words, they don't give me the option to debug, and they give me no information (they aren't the "You application has experienced an error and needs to close" variety). Rather, they are the "Runtime Error!!!" with the big red "X" dialogs that signal a hard crash. I believe this only ever occurs with unmanaged native code, which tells me (because the quickfix DLLs are the only such code) that this must be occurring within these libraries. My application processes /many /messages in a day -- it often processes more than 1 million messages in any given day (I'm not sure if that's common or on the high end, but something tells me it's on the high end). And so I have a very rapid messaging rate. What I'm wondering is if anyone has ever seen these types of "hard" application crashes before and possibly any remedies or ideas as to what might be causing it. The absolute worst part about all of this is that Dr Watson dump files (.dmp) are not being generated. They were generated the first few times crashes occurred, but I installed Visual Studio and that, for some reason, stopped the dump files from being generated. So I have absolutely no visibility into this error -- any help is greatly appreciated. Thanks, Rick or...@qu... wrote: > Never mind. I can see it's VS8 from your post. Might be able to do > something about this by changing the build settings. I don't think > it's a coding error. I'm looking into the microsoft knowledge base > for possible solutions. > > -------- Original Message -------- > Subject: Re: [Quickfix-developers] FileStore crashes in .NET? > From: Rick Lane <ric...@gm...> > Date: Fri, March 14, 2008 2:41 pm > To: qui...@li... > <mailto:qui...@li...> > > QuickFIX Documentation: > http://www.quickfixengine.org/quickfix/doc/html/index.html > QuickFIX Support: http://www.quickfixengine.org/services.html > > ------------------------------------------------------------------------ > After some more digging, I'm attempting to load the .dmp file > generated at the application crash into Visual Studio. There are > many entries for quickfix_net.dll (which, as you said, may not > mean there was a problem with quickfix), but it would be nice to > be able to load the .pdb file for QuickFix into Visual Studio so I > can see actual function names instead of just assembly mumbo jumbo. > > I tried loading both the debug/vs8/quickfix_net.pdb and the > release/vs8/quickfix_net.pdb and for both it said it "did not > match the module." Has anyone tried to load these pdb files into > studio for debugging purposes? incidentally, the exception is: > "Unhandled exception at 0x77e4bee7 in user.dmp: 0xC0020001: The > string binding is invalid." I've done some research on this and > in most cases it seems to occur when people are blending managed > and unmanaged code. Outside of QuickFix, I do /not /have any > unmanaged code -- so is this looking more like it might be a > native issue (after all, isn't the .NET QuickFix library just a > wrapper around the unmanaged version?). > > call stack at crash: > > > kernel32.dll!77e4bee7() > [Frames below may be incorrect and/or missing, no symbols > loaded for kernel32.dll] > kernel32.dll!77e4bee7() > quickfix_net.dll!10084f0c() > quickfix_net.dll!100938d5() > quickfix_net.dll!10093938() > > > or...@qu... <mailto:or...@qu...> wrote: >> I don't know of any outstanding bugs with the filestore. Do you >> have any kind of stack trace. Keep in mind that the >> quickfix_net.dll will pretty much always show up because events >> are being passed from quickfix to your application. So crashes >> in your application will generally appear to start out in the >> quickfix dll. 12 MB is pretty big, but not outrageous and I've >> seen bigger. None of it is kept in memory, it's only read in as >> needed for resend requests and such. Any idea if one was being >> processed during your crash? >> >> --oren >> >> -------- Original Message -------- >> Subject: [Quickfix-developers] FileStore crashes in .NET? >> From: Rick Lane <ric...@gm...> >> Date: Fri, March 14, 2008 11:39 am >> To: qui...@li... >> <mailto:qui...@li...> >> >> QuickFIX Documentation: >> http://www.quickfixengine.org/quickfix/doc/html/index.html >> QuickFIX Support: http://www.quickfixengine.org/services.html >> >> Greetings, >> >> Have there been any documented instances of QuickFix causing an >> application crash in .NET related to the FileStore? My >> application was >> running along just fine, entering no orders (and with no >> orders, and >> therefore no execution reports) for a couple hours after a >> very busy >> morning. So for about an hour, the only traffic through QuickFix >> should've been heartbeats. I received an Application crash -- >> not the >> good kind, the kind that pretty much doesn't let you do any >> sort of >> recovery -- for the first time (I've gotten many crashes due >> to a null >> pointer, etc., but these can be caught and therefore >> recovered from). >> >> I'm not 100% sure QuickFix caused this -- I'm in the process >> of thumbing >> through the memory dump created by Dr Watson (I'm not very >> good at this) >> -- but the quickfix_net dll keeps popping up in the log, so I >> decided to >> go check out the FileStore file. I was surprised to see it >> was nearly >> 12 MB (which I guess because of a busy morning, this is to be >> expected?). This crash could very well have been due to the >> market data >> portion of my app (which listens to the CME's FIX/FAST data >> stream) but >> I thought I was handling those types of errors better than >> this, so I >> just wanted to see if anyone else has seen unexpected crashes >> w/ the >> .NET quickfix library, possibly having something to do with >> the FileStore? >> >> Thanks in advance, >> Rick >> >> ------------------------------------------------------------------------- >> This SF.net <http://SF.net> email is sponsored by: Microsoft >> Defy all challenges. Microsoft(R) Visual Studio 2008. >> http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ >> _______________________________________________ >> Quickfix-developers mailing list >> Qui...@li... >> <mailto:Qui...@li...> >> https://lists.sourceforge.net/lists/listinfo/quickfix-developers >> > ------------------------------------------------------------------------ > ------------------------------------------------------------------------- > This SF.net <http://SF.net> email is sponsored by: Microsoft > Defy all challenges. Microsoft(R) Visual Studio 2008. > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > ------------------------------------------------------------------------ > _______________________________________________ > Quickfix-developers mailing list > Qui...@li... <#Compose> > https://lists.sourceforge.net/lists/listinfo/quickfix-developers > |
|
From: Dale W. <wil...@oc...> - 2008-05-13 19:59:21
|
Rick Lane wrote: > The absolute worst part about all of this is that Dr Watson dump files > (.dmp) are not being generated. They were generated the first few > times crashes occurred, but I installed Visual Studio and that, for > some reason, stopped the dump files from being generated. So I have > absolutely no visibility into this error -- any help is greatly > appreciated. You might try to see if you can run the application in the debugger all day long. This may cause performance problems given your heavy load, but if it doesn't the debugger should catch the failure that is shutting you down and give you a chance to diagnose the problem. In fact, when the problem occurs you will probably be able to bring up a new copy of the application and finish the trading day -- leaving the failed copy hanging in the debugger waiting for your after-hours attention. Sounds like a nasty one. Good luck, Dale |
|
From: <or...@qu...> - 2008-05-13 21:10:41
|
Well, I know there were some fixes put it recently where unmanaged exceptions were not properly caught and propogated to the VM. Maybe it has something to do with that. Do your logs provide any insight on what was going on at the time of crash? --oren > -------- Original Message -------- > Subject: Re: [Quickfix-developers] FileStore crashes in .NET? > From: Rick Lane <ric...@gm...> > Date: Tue, May 13, 2008 2:45 pm > To: or...@qu... > Cc: qui...@li... > QuickFIX Documentation: http://www.quickfixengine.org/quickfix/doc/html/index.html > QuickFIX Support: http://www.quickfixengine.org/services.html<hr>Greetings, > I brought up an issue 2 months ago where it seemed that my FileStore > might be crashing. The issue somewhat went away and has now resurfaced > -- I'm no longer convinced this occurred from the FileStore, but I am > fairly convinced this is a QuickFix issue. > My trading application is built in C# .NET 2.0, and so I'm using the > quickfix_net and quickfix_net_messages DLLs. From what I gather about > these DLLs, they are .NET wrappers around the native, unmanaged code. > The crashes I'm seeing are not of the friendly type -- in other words, > they don't give me the option to debug, and they give me no information > (they aren't the "You application has experienced an error and needs to > close" variety). Rather, they are the "Runtime Error!!!" with the big > red "X" dialogs that signal a hard crash. I believe this only ever > occurs with unmanaged native code, which tells me (because the quickfix > DLLs are the only such code) that this must be occurring within these > libraries. > My application processes /many /messages in a day -- it often processes > more than 1 million messages in any given day (I'm not sure if that's > common or on the high end, but something tells me it's on the high > end). And so I have a very rapid messaging rate. What I'm wondering is > if anyone has ever seen these types of "hard" application crashes before > and possibly any remedies or ideas as to what might be causing it. > The absolute worst part about all of this is that Dr Watson dump files > (.dmp) are not being generated. They were generated the first few times > crashes occurred, but I installed Visual Studio and that, for some > reason, stopped the dump files from being generated. So I have > absolutely no visibility into this error -- any help is greatly appreciated. > Thanks, > Rick > or...@qu... wrote: > > Never mind. I can see it's VS8 from your post. Might be able to do > > something about this by changing the build settings. I don't think > > it's a coding error. I'm looking into the microsoft knowledge base > > for possible solutions. > > > > -------- Original Message -------- > > Subject: Re: [Quickfix-developers] FileStore crashes in .NET? > > From: Rick Lane <ric...@gm...> > > Date: Fri, March 14, 2008 2:41 pm > > To: qui...@li... > > <mailto:qui...@li...> > > > > QuickFIX Documentation: > > http://www.quickfixengine.org/quickfix/doc/html/index.html > > QuickFIX Support: http://www.quickfixengine.org/services.html > > > > ------------------------------------------------------------------------ > > After some more digging, I'm attempting to load the .dmp file > > generated at the application crash into Visual Studio. There are > > many entries for quickfix_net.dll (which, as you said, may not > > mean there was a problem with quickfix), but it would be nice to > > be able to load the .pdb file for QuickFix into Visual Studio so I > > can see actual function names instead of just assembly mumbo jumbo. > > > > I tried loading both the debug/vs8/quickfix_net.pdb and the > > release/vs8/quickfix_net.pdb and for both it said it "did not > > match the module." Has anyone tried to load these pdb files into > > studio for debugging purposes? incidentally, the exception is: > > "Unhandled exception at 0x77e4bee7 in user.dmp: 0xC0020001: The > > string binding is invalid." I've done some research on this and > > in most cases it seems to occur when people are blending managed > > and unmanaged code. Outside of QuickFix, I do /not /have any > > unmanaged code -- so is this looking more like it might be a > > native issue (after all, isn't the .NET QuickFix library just a > > wrapper around the unmanaged version?). > > > > call stack at crash: > > > > > kernel32.dll!77e4bee7() > > [Frames below may be incorrect and/or missing, no symbols > > loaded for kernel32.dll] > > kernel32.dll!77e4bee7() > > quickfix_net.dll!10084f0c() > > quickfix_net.dll!100938d5() > > quickfix_net.dll!10093938() > > > > > > or...@qu... <mailto:or...@qu...> wrote: > >> I don't know of any outstanding bugs with the filestore. Do you > >> have any kind of stack trace. Keep in mind that the > >> quickfix_net.dll will pretty much always show up because events > >> are being passed from quickfix to your application. So crashes > >> in your application will generally appear to start out in the > >> quickfix dll. 12 MB is pretty big, but not outrageous and I've > >> seen bigger. None of it is kept in memory, it's only read in as > >> needed for resend requests and such. Any idea if one was being > >> processed during your crash? > >> > >> --oren > >> > >> -------- Original Message -------- > >> Subject: [Quickfix-developers] FileStore crashes in .NET? > >> From: Rick Lane <ric...@gm...> > >> Date: Fri, March 14, 2008 11:39 am > >> To: qui...@li... > >> <mailto:qui...@li...> > >> > >> QuickFIX Documentation: > >> http://www.quickfixengine.org/quickfix/doc/html/index.html > >> QuickFIX Support: http://www.quickfixengine.org/services.html > >> > >> Greetings, > >> > >> Have there been any documented instances of QuickFix causing an > >> application crash in .NET related to the FileStore? My > >> application was > >> running along just fine, entering no orders (and with no > >> orders, and > >> therefore no execution reports) for a couple hours after a > >> very busy > >> morning. So for about an hour, the only traffic through QuickFix > >> should've been heartbeats. I received an Application crash -- > >> not the > >> good kind, the kind that pretty much doesn't let you do any > >> sort of > >> recovery -- for the first time (I've gotten many crashes due > >> to a null > >> pointer, etc., but these can be caught and therefore > >> recovered from). > >> > >> I'm not 100% sure QuickFix caused this -- I'm in the process > >> of thumbing > >> through the memory dump created by Dr Watson (I'm not very > >> good at this) > >> -- but the quickfix_net dll keeps popping up in the log, so I > >> decided to > >> go check out the FileStore file. I was surprised to see it > >> was nearly > >> 12 MB (which I guess because of a busy morning, this is to be > >> expected?). This crash could very well have been due to the > >> market data > >> portion of my app (which listens to the CME's FIX/FAST data > >> stream) but > >> I thought I was handling those types of errors better than > >> this, so I > >> just wanted to see if anyone else has seen unexpected crashes > >> w/ the > >> .NET quickfix library, possibly having something to do with > >> the FileStore? > >> > >> Thanks in advance, > >> Rick > >> > >> ------------------------------------------------------------------------- > >> This SF.net <http://SF.net> email is sponsored by: Microsoft > >> Defy all challenges. Microsoft(R) Visual Studio 2008. > >> http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > >> _______________________________________________ > >> Quickfix-developers mailing list > >> Qui...@li... > >> <mailto:Qui...@li...> > >> https://lists.sourceforge.net/lists/listinfo/quickfix-developers > >> > > ------------------------------------------------------------------------ > > ------------------------------------------------------------------------- > > This SF.net <http://SF.net> email is sponsored by: Microsoft > > Defy all challenges. Microsoft(R) Visual Studio 2008. > > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > > ------------------------------------------------------------------------ > > _______________________________________________ > > Quickfix-developers mailing list > > Qui...@li... <#Compose> > > https://lists.sourceforge.net/lists/listinfo/quickfix-developers > ><hr>------------------------------------------------------------------------- > This SF.net email is sponsored by: Microsoft > Defy all challenges. Microsoft(R) Visual Studio 2008. > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/<hr>_______________________________________________ > Quickfix-developers mailing list > Qui...@li... > https://lists.sourceforge.net/lists/listinfo/quickfix-developers |
|
From: Sibte A. <si...@gm...> - 2008-05-13 22:47:03
|
Can it be because of windows file size limits (just guessing)? Do we handle those in quickfix? Rick, Which file system is your FileStore using to store data? thanks, -- Sibte On Tue, May 13, 2008 at 5:10 PM, <or...@qu...> wrote: > QuickFIX Documentation: > http://www.quickfixengine.org/quickfix/doc/html/index.html > QuickFIX Support: http://www.quickfixengine.org/services.html > > Well, I know there were some fixes put it recently where unmanaged > exceptions were not properly caught and propogated to the VM. Maybe it > has something to do with that. Do your logs provide any insight on what > was going on at the time of crash? > > --oren > > > -------- Original Message -------- > > Subject: Re: [Quickfix-developers] FileStore crashes in .NET? > > From: Rick Lane <ric...@gm...> > > Date: Tue, May 13, 2008 2:45 pm > > To: or...@qu... > > Cc: qui...@li... > > QuickFIX Documentation: > http://www.quickfixengine.org/quickfix/doc/html/index.html > > QuickFIX Support: http://www.quickfixengine.org/services.html > <hr>Greetings, > > I brought up an issue 2 months ago where it seemed that my FileStore > > might be crashing. The issue somewhat went away and has now resurfaced > > -- I'm no longer convinced this occurred from the FileStore, but I am > > fairly convinced this is a QuickFix issue. > > My trading application is built in C# .NET 2.0, and so I'm using the > > quickfix_net and quickfix_net_messages DLLs. From what I gather about > > these DLLs, they are .NET wrappers around the native, unmanaged code. > > The crashes I'm seeing are not of the friendly type -- in other words, > > they don't give me the option to debug, and they give me no information > > (they aren't the "You application has experienced an error and needs to > > close" variety). Rather, they are the "Runtime Error!!!" with the big > > red "X" dialogs that signal a hard crash. I believe this only ever > > occurs with unmanaged native code, which tells me (because the quickfix > > DLLs are the only such code) that this must be occurring within these > > libraries. > > My application processes /many /messages in a day -- it often processes > > more than 1 million messages in any given day (I'm not sure if that's > > common or on the high end, but something tells me it's on the high > > end). And so I have a very rapid messaging rate. What I'm wondering is > > if anyone has ever seen these types of "hard" application crashes before > > and possibly any remedies or ideas as to what might be causing it. > > The absolute worst part about all of this is that Dr Watson dump files > > (.dmp) are not being generated. They were generated the first few times > > crashes occurred, but I installed Visual Studio and that, for some > > reason, stopped the dump files from being generated. So I have > > absolutely no visibility into this error -- any help is greatly > appreciated. > > Thanks, > > Rick > > or...@qu... wrote: > > > Never mind. I can see it's VS8 from your post. Might be able to do > > > something about this by changing the build settings. I don't think > > > it's a coding error. I'm looking into the microsoft knowledge base > > > for possible solutions. > > > > > > -------- Original Message -------- > > > Subject: Re: [Quickfix-developers] FileStore crashes in .NET? > > > From: Rick Lane <ric...@gm...> > > > Date: Fri, March 14, 2008 2:41 pm > > > To: qui...@li... > > > <mailto:qui...@li...> > > > > > > QuickFIX Documentation: > > > http://www.quickfixengine.org/quickfix/doc/html/index.html > > > QuickFIX Support: http://www.quickfixengine.org/services.html > > > > > > > ------------------------------------------------------------------------ > > > After some more digging, I'm attempting to load the .dmp file > > > generated at the application crash into Visual Studio. There are > > > many entries for quickfix_net.dll (which, as you said, may not > > > mean there was a problem with quickfix), but it would be nice to > > > be able to load the .pdb file for QuickFix into Visual Studio so I > > > can see actual function names instead of just assembly mumbo > jumbo. > > > > > > I tried loading both the debug/vs8/quickfix_net.pdb and the > > > release/vs8/quickfix_net.pdb and for both it said it "did not > > > match the module." Has anyone tried to load these pdb files into > > > studio for debugging purposes? incidentally, the exception is: > > > "Unhandled exception at 0x77e4bee7 in user.dmp: 0xC0020001: The > > > string binding is invalid." I've done some research on this and > > > in most cases it seems to occur when people are blending managed > > > and unmanaged code. Outside of QuickFix, I do /not /have any > > > unmanaged code -- so is this looking more like it might be a > > > native issue (after all, isn't the .NET QuickFix library just a > > > wrapper around the unmanaged version?). > > > > > > call stack at crash: > > > > > > > kernel32.dll!77e4bee7() > > > [Frames below may be incorrect and/or missing, no symbols > > > loaded for kernel32.dll] > > > kernel32.dll!77e4bee7() > > > quickfix_net.dll!10084f0c() > > > quickfix_net.dll!100938d5() > > > quickfix_net.dll!10093938() > > > > > > > > > or...@qu... <mailto:or...@qu...> wrote: > > >> I don't know of any outstanding bugs with the filestore. Do you > > >> have any kind of stack trace. Keep in mind that the > > >> quickfix_net.dll will pretty much always show up because events > > >> are being passed from quickfix to your application. So crashes > > >> in your application will generally appear to start out in the > > >> quickfix dll. 12 MB is pretty big, but not outrageous and I've > > >> seen bigger. None of it is kept in memory, it's only read in as > > >> needed for resend requests and such. Any idea if one was being > > >> processed during your crash? > > >> > > >> --oren > > >> > > >> -------- Original Message -------- > > >> Subject: [Quickfix-developers] FileStore crashes in .NET? > > >> From: Rick Lane <ric...@gm...> > > >> Date: Fri, March 14, 2008 11:39 am > > >> To: qui...@li... > > >> <mailto:qui...@li...> > > >> > > >> QuickFIX Documentation: > > >> http://www.quickfixengine.org/quickfix/doc/html/index.html > > >> QuickFIX Support: http://www.quickfixengine.org/services.html > > >> > > >> Greetings, > > >> > > >> Have there been any documented instances of QuickFix causing > an > > >> application crash in .NET related to the FileStore? My > > >> application was > > >> running along just fine, entering no orders (and with no > > >> orders, and > > >> therefore no execution reports) for a couple hours after a > > >> very busy > > >> morning. So for about an hour, the only traffic through > QuickFix > > >> should've been heartbeats. I received an Application crash -- > > >> not the > > >> good kind, the kind that pretty much doesn't let you do any > > >> sort of > > >> recovery -- for the first time (I've gotten many crashes due > > >> to a null > > >> pointer, etc., but these can be caught and therefore > > >> recovered from). > > >> > > >> I'm not 100% sure QuickFix caused this -- I'm in the process > > >> of thumbing > > >> through the memory dump created by Dr Watson (I'm not very > > >> good at this) > > >> -- but the quickfix_net dll keeps popping up in the log, so I > > >> decided to > > >> go check out the FileStore file. I was surprised to see it > > >> was nearly > > >> 12 MB (which I guess because of a busy morning, this is to be > > >> expected?). This crash could very well have been due to the > > >> market data > > >> portion of my app (which listens to the CME's FIX/FAST data > > >> stream) but > > >> I thought I was handling those types of errors better than > > >> this, so I > > >> just wanted to see if anyone else has seen unexpected crashes > > >> w/ the > > >> .NET quickfix library, possibly having something to do with > > >> the FileStore? > > >> > > >> Thanks in advance, > > >> Rick > > >> > > >> > ------------------------------------------------------------------------- > > >> This SF.net <http://SF.net> email is sponsored by: Microsoft > > >> Defy all challenges. Microsoft(R) Visual Studio 2008. > > >> http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > > >> _______________________________________________ > > >> Quickfix-developers mailing list > > >> Qui...@li... > > >> <mailto:Qui...@li...> > > >> > https://lists.sourceforge.net/lists/listinfo/quickfix-developers > > >> > > > > ------------------------------------------------------------------------ > > > > ------------------------------------------------------------------------- > > > This SF.net <http://SF.net> email is sponsored by: Microsoft > > > Defy all challenges. Microsoft(R) Visual Studio 2008. > > > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > > > > ------------------------------------------------------------------------ > > > _______________________________________________ > > > Quickfix-developers mailing list > > > Qui...@li... <#Compose> > > > https://lists.sourceforge.net/lists/listinfo/quickfix-developers > > > ><hr>------------------------------------------------------------------------- > > This SF.net email is sponsored by: Microsoft > > Defy all challenges. Microsoft(R) Visual Studio 2008. > > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > <hr>_______________________________________________ > > Quickfix-developers mailing list > > Qui...@li... > > https://lists.sourceforge.net/lists/listinfo/quickfix-developers > > > ------------------------------------------------------------------------- > This SF.net email is sponsored by: Microsoft > Defy all challenges. Microsoft(R) Visual Studio 2008. > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > _______________________________________________ > Quickfix-developers mailing list > Qui...@li... > https://lists.sourceforge.net/lists/listinfo/quickfix-developers > |
|
From: Rick L. <ric...@gm...> - 2008-05-14 17:03:42
|
Sibte, I'm using the NTFS file system in Windows Server 2003. Thanks, Rick Sibte Abbas wrote: > Can it be because of windows file size limits (just guessing)? Do we > handle those in quickfix? > > Rick, > > Which file system is your FileStore using to store data? > > thanks, > -- Sibte > > On Tue, May 13, 2008 at 5:10 PM, <or...@qu... > <mailto:or...@qu...>> wrote: > > QuickFIX Documentation: > http://www.quickfixengine.org/quickfix/doc/html/index.html > QuickFIX Support: http://www.quickfixengine.org/services.html > > Well, I know there were some fixes put it recently where unmanaged > exceptions were not properly caught and propogated to the VM. > Maybe it > has something to do with that. Do your logs provide any insight > on what > was going on at the time of crash? > > --oren > > > -------- Original Message -------- > > Subject: Re: [Quickfix-developers] FileStore crashes in .NET? > > From: Rick Lane <ric...@gm... <mailto:ric...@gm...>> > > Date: Tue, May 13, 2008 2:45 pm > > To: or...@qu... <mailto:or...@qu...> > > Cc: qui...@li... > <mailto:qui...@li...> > > QuickFIX Documentation: > http://www.quickfixengine.org/quickfix/doc/html/index.html > > QuickFIX Support: > http://www.quickfixengine.org/services.html<hr>Greetings, > > I brought up an issue 2 months ago where it seemed that my FileStore > > might be crashing. The issue somewhat went away and has now > resurfaced > > -- I'm no longer convinced this occurred from the FileStore, but > I am > > fairly convinced this is a QuickFix issue. > > My trading application is built in C# .NET 2.0, and so I'm using the > > quickfix_net and quickfix_net_messages DLLs. From what I gather > about > > these DLLs, they are .NET wrappers around the native, unmanaged > code. > > The crashes I'm seeing are not of the friendly type -- in other > words, > > they don't give me the option to debug, and they give me no > information > > (they aren't the "You application has experienced an error and > needs to > > close" variety). Rather, they are the "Runtime Error!!!" with > the big > > red "X" dialogs that signal a hard crash. I believe this only ever > > occurs with unmanaged native code, which tells me (because the > quickfix > > DLLs are the only such code) that this must be occurring within > these > > libraries. > > My application processes /many /messages in a day -- it often > processes > > more than 1 million messages in any given day (I'm not sure if > that's > > common or on the high end, but something tells me it's on the high > > end). And so I have a very rapid messaging rate. What I'm > wondering is > > if anyone has ever seen these types of "hard" application > crashes before > > and possibly any remedies or ideas as to what might be causing it. > > The absolute worst part about all of this is that Dr Watson dump > files > > (.dmp) are not being generated. They were generated the first > few times > > crashes occurred, but I installed Visual Studio and that, for some > > reason, stopped the dump files from being generated. So I have > > absolutely no visibility into this error -- any help is greatly > appreciated. > > Thanks, > > Rick > > or...@qu... <mailto:or...@qu...> wrote: > > > Never mind. I can see it's VS8 from your post. Might be able > to do > > > something about this by changing the build settings. I don't > think > > > it's a coding error. I'm looking into the microsoft knowledge > base > > > for possible solutions. > > > > > > -------- Original Message -------- > > > Subject: Re: [Quickfix-developers] FileStore crashes in .NET? > > > From: Rick Lane <ric...@gm... > <mailto:ric...@gm...>> > > > Date: Fri, March 14, 2008 2:41 pm > > > To: qui...@li... > <mailto:qui...@li...> > > > <mailto:qui...@li... > <mailto:qui...@li...>> > > > > > > QuickFIX Documentation: > > > http://www.quickfixengine.org/quickfix/doc/html/index.html > > > QuickFIX Support: http://www.quickfixengine.org/services.html > > > > > > > ------------------------------------------------------------------------ > > > After some more digging, I'm attempting to load the .dmp file > > > generated at the application crash into Visual Studio. > There are > > > many entries for quickfix_net.dll (which, as you said, may not > > > mean there was a problem with quickfix), but it would be > nice to > > > be able to load the .pdb file for QuickFix into Visual > Studio so I > > > can see actual function names instead of just assembly > mumbo jumbo. > > > > > > I tried loading both the debug/vs8/quickfix_net.pdb and the > > > release/vs8/quickfix_net.pdb and for both it said it "did not > > > match the module." Has anyone tried to load these pdb > files into > > > studio for debugging purposes? incidentally, the > exception is: > > > "Unhandled exception at 0x77e4bee7 in user.dmp: > 0xC0020001: The > > > string binding is invalid." I've done some research on > this and > > > in most cases it seems to occur when people are blending > managed > > > and unmanaged code. Outside of QuickFix, I do /not /have any > > > unmanaged code -- so is this looking more like it might be a > > > native issue (after all, isn't the .NET QuickFix library > just a > > > wrapper around the unmanaged version?). > > > > > > call stack at crash: > > > > > > > kernel32.dll!77e4bee7() > > > [Frames below may be incorrect and/or missing, no symbols > > > loaded for kernel32.dll] > > > kernel32.dll!77e4bee7() > > > quickfix_net.dll!10084f0c() > > > quickfix_net.dll!100938d5() > > > quickfix_net.dll!10093938() > > > > > > > > > or...@qu... <mailto:or...@qu...> > <mailto:or...@qu... <mailto:or...@qu...>> > wrote: > > >> I don't know of any outstanding bugs with the filestore. > Do you > > >> have any kind of stack trace. Keep in mind that the > > >> quickfix_net.dll will pretty much always show up because > events > > >> are being passed from quickfix to your application. So > crashes > > >> in your application will generally appear to start out in the > > >> quickfix dll. 12 MB is pretty big, but not outrageous > and I've > > >> seen bigger. None of it is kept in memory, it's only > read in as > > >> needed for resend requests and such. Any idea if one was > being > > >> processed during your crash? > > >> > > >> --oren > > >> > > >> -------- Original Message -------- > > >> Subject: [Quickfix-developers] FileStore crashes in .NET? > > >> From: Rick Lane <ric...@gm... > <mailto:ric...@gm...>> > > >> Date: Fri, March 14, 2008 11:39 am > > >> To: qui...@li... > <mailto:qui...@li...> > > >> <mailto:qui...@li... > <mailto:qui...@li...>> > > >> > > >> QuickFIX Documentation: > > >> > http://www.quickfixengine.org/quickfix/doc/html/index.html > > >> QuickFIX Support: > http://www.quickfixengine.org/services.html > > >> > > >> Greetings, > > >> > > >> Have there been any documented instances of QuickFix > causing an > > >> application crash in .NET related to the FileStore? My > > >> application was > > >> running along just fine, entering no orders (and with no > > >> orders, and > > >> therefore no execution reports) for a couple hours > after a > > >> very busy > > >> morning. So for about an hour, the only traffic > through QuickFix > > >> should've been heartbeats. I received an Application > crash -- > > >> not the > > >> good kind, the kind that pretty much doesn't let you > do any > > >> sort of > > >> recovery -- for the first time (I've gotten many > crashes due > > >> to a null > > >> pointer, etc., but these can be caught and therefore > > >> recovered from). > > >> > > >> I'm not 100% sure QuickFix caused this -- I'm in the > process > > >> of thumbing > > >> through the memory dump created by Dr Watson (I'm not > very > > >> good at this) > > >> -- but the quickfix_net dll keeps popping up in the > log, so I > > >> decided to > > >> go check out the FileStore file. I was surprised to > see it > > >> was nearly > > >> 12 MB (which I guess because of a busy morning, this > is to be > > >> expected?). This crash could very well have been due > to the > > >> market data > > >> portion of my app (which listens to the CME's > FIX/FAST data > > >> stream) but > > >> I thought I was handling those types of errors better > than > > >> this, so I > > >> just wanted to see if anyone else has seen unexpected > crashes > > >> w/ the > > >> .NET quickfix library, possibly having something to > do with > > >> the FileStore? > > >> > > >> Thanks in advance, > > >> Rick > > >> > > >> > ------------------------------------------------------------------------- > > >> This SF.net <http://SF.net> email is sponsored by: > Microsoft > > >> Defy all challenges. Microsoft(R) Visual Studio 2008. > > >> http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > > >> _______________________________________________ > > >> Quickfix-developers mailing list > > >> Qui...@li... > <mailto:Qui...@li...> > > >> <mailto:Qui...@li... > <mailto:Qui...@li...>> > > >> > https://lists.sourceforge.net/lists/listinfo/quickfix-developers > > >> > > > > ------------------------------------------------------------------------ > > > > ------------------------------------------------------------------------- > > > This SF.net <http://SF.net> email is sponsored by: Microsoft > > > Defy all challenges. Microsoft(R) Visual Studio 2008. > > > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > > > > ------------------------------------------------------------------------ > > > _______________________________________________ > > > Quickfix-developers mailing list > > > Qui...@li... > <mailto:Qui...@li...> <#Compose> > > > > https://lists.sourceforge.net/lists/listinfo/quickfix-developers > > > ><hr>------------------------------------------------------------------------- > > This SF.net email is sponsored by: Microsoft > > Defy all challenges. Microsoft(R) Visual Studio 2008. > > > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/<hr>_______________________________________________ > > Quickfix-developers mailing list > > Qui...@li... > <mailto:Qui...@li...> > > https://lists.sourceforge.net/lists/listinfo/quickfix-developers > > > ------------------------------------------------------------------------- > This SF.net email is sponsored by: Microsoft > Defy all challenges. Microsoft(R) Visual Studio 2008. > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > _______________________________________________ > Quickfix-developers mailing list > Qui...@li... > <mailto:Qui...@li...> > https://lists.sourceforge.net/lists/listinfo/quickfix-developers > > |
|
From: Rick L. <ric...@gm...> - 2008-05-14 17:02:03
|
Oren, ok, so do you suggest I get the latest code and build -- to include these fixes? Up until now, I've just been using the last "release" codeset. Unfortunately, I don't really have any logs -- for speed issues, I disabled the FileLogFactory, and I don't get any Windows crash logs, etc., because Windows isn't recognizing this as an Application Error (which is why, I believe, Dr Watson is never being called). Rick or...@qu... wrote: > Well, I know there were some fixes put it recently where unmanaged > exceptions were not properly caught and propogated to the VM. Maybe it > has something to do with that. Do your logs provide any insight on what > was going on at the time of crash? > > --oren > > >> -------- Original Message -------- >> Subject: Re: [Quickfix-developers] FileStore crashes in .NET? >> From: Rick Lane <ric...@gm...> >> Date: Tue, May 13, 2008 2:45 pm >> To: or...@qu... >> Cc: qui...@li... >> QuickFIX Documentation: http://www.quickfixengine.org/quickfix/doc/html/index.html >> QuickFIX Support: http://www.quickfixengine.org/services.html<hr>Greetings, >> I brought up an issue 2 months ago where it seemed that my FileStore >> might be crashing. The issue somewhat went away and has now resurfaced >> -- I'm no longer convinced this occurred from the FileStore, but I am >> fairly convinced this is a QuickFix issue. >> My trading application is built in C# .NET 2.0, and so I'm using the >> quickfix_net and quickfix_net_messages DLLs. From what I gather about >> these DLLs, they are .NET wrappers around the native, unmanaged code. >> The crashes I'm seeing are not of the friendly type -- in other words, >> they don't give me the option to debug, and they give me no information >> (they aren't the "You application has experienced an error and needs to >> close" variety). Rather, they are the "Runtime Error!!!" with the big >> red "X" dialogs that signal a hard crash. I believe this only ever >> occurs with unmanaged native code, which tells me (because the quickfix >> DLLs are the only such code) that this must be occurring within these >> libraries. >> My application processes /many /messages in a day -- it often processes >> more than 1 million messages in any given day (I'm not sure if that's >> common or on the high end, but something tells me it's on the high >> end). And so I have a very rapid messaging rate. What I'm wondering is >> if anyone has ever seen these types of "hard" application crashes before >> and possibly any remedies or ideas as to what might be causing it. >> The absolute worst part about all of this is that Dr Watson dump files >> (.dmp) are not being generated. They were generated the first few times >> crashes occurred, but I installed Visual Studio and that, for some >> reason, stopped the dump files from being generated. So I have >> absolutely no visibility into this error -- any help is greatly appreciated. >> Thanks, >> Rick >> or...@qu... wrote: >> >>> Never mind. I can see it's VS8 from your post. Might be able to do >>> something about this by changing the build settings. I don't think >>> it's a coding error. I'm looking into the microsoft knowledge base >>> for possible solutions. >>> >>> -------- Original Message -------- >>> Subject: Re: [Quickfix-developers] FileStore crashes in .NET? >>> From: Rick Lane <ric...@gm...> >>> Date: Fri, March 14, 2008 2:41 pm >>> To: qui...@li... >>> <mailto:qui...@li...> >>> >>> QuickFIX Documentation: >>> http://www.quickfixengine.org/quickfix/doc/html/index.html >>> QuickFIX Support: http://www.quickfixengine.org/services.html >>> >>> ------------------------------------------------------------------------ >>> After some more digging, I'm attempting to load the .dmp file >>> generated at the application crash into Visual Studio. There are >>> many entries for quickfix_net.dll (which, as you said, may not >>> mean there was a problem with quickfix), but it would be nice to >>> be able to load the .pdb file for QuickFix into Visual Studio so I >>> can see actual function names instead of just assembly mumbo jumbo. >>> >>> I tried loading both the debug/vs8/quickfix_net.pdb and the >>> release/vs8/quickfix_net.pdb and for both it said it "did not >>> match the module." Has anyone tried to load these pdb files into >>> studio for debugging purposes? incidentally, the exception is: >>> "Unhandled exception at 0x77e4bee7 in user.dmp: 0xC0020001: The >>> string binding is invalid." I've done some research on this and >>> in most cases it seems to occur when people are blending managed >>> and unmanaged code. Outside of QuickFix, I do /not /have any >>> unmanaged code -- so is this looking more like it might be a >>> native issue (after all, isn't the .NET QuickFix library just a >>> wrapper around the unmanaged version?). >>> >>> call stack at crash: >>> >>> > kernel32.dll!77e4bee7() >>> [Frames below may be incorrect and/or missing, no symbols >>> loaded for kernel32.dll] >>> kernel32.dll!77e4bee7() >>> quickfix_net.dll!10084f0c() >>> quickfix_net.dll!100938d5() >>> quickfix_net.dll!10093938() >>> >>> >>> or...@qu... <mailto:or...@qu...> wrote: >>> >>>> I don't know of any outstanding bugs with the filestore. Do you >>>> have any kind of stack trace. Keep in mind that the >>>> quickfix_net.dll will pretty much always show up because events >>>> are being passed from quickfix to your application. So crashes >>>> in your application will generally appear to start out in the >>>> quickfix dll. 12 MB is pretty big, but not outrageous and I've >>>> seen bigger. None of it is kept in memory, it's only read in as >>>> needed for resend requests and such. Any idea if one was being >>>> processed during your crash? >>>> >>>> --oren >>>> >>>> -------- Original Message -------- >>>> Subject: [Quickfix-developers] FileStore crashes in .NET? >>>> From: Rick Lane <ric...@gm...> >>>> Date: Fri, March 14, 2008 11:39 am >>>> To: qui...@li... >>>> <mailto:qui...@li...> >>>> >>>> QuickFIX Documentation: >>>> http://www.quickfixengine.org/quickfix/doc/html/index.html >>>> QuickFIX Support: http://www.quickfixengine.org/services.html >>>> >>>> Greetings, >>>> >>>> Have there been any documented instances of QuickFix causing an >>>> application crash in .NET related to the FileStore? My >>>> application was >>>> running along just fine, entering no orders (and with no >>>> orders, and >>>> therefore no execution reports) for a couple hours after a >>>> very busy >>>> morning. So for about an hour, the only traffic through QuickFix >>>> should've been heartbeats. I received an Application crash -- >>>> not the >>>> good kind, the kind that pretty much doesn't let you do any >>>> sort of >>>> recovery -- for the first time (I've gotten many crashes due >>>> to a null >>>> pointer, etc., but these can be caught and therefore >>>> recovered from). >>>> >>>> I'm not 100% sure QuickFix caused this -- I'm in the process >>>> of thumbing >>>> through the memory dump created by Dr Watson (I'm not very >>>> good at this) >>>> -- but the quickfix_net dll keeps popping up in the log, so I >>>> decided to >>>> go check out the FileStore file. I was surprised to see it >>>> was nearly >>>> 12 MB (which I guess because of a busy morning, this is to be >>>> expected?). This crash could very well have been due to the >>>> market data >>>> portion of my app (which listens to the CME's FIX/FAST data >>>> stream) but >>>> I thought I was handling those types of errors better than >>>> this, so I >>>> just wanted to see if anyone else has seen unexpected crashes >>>> w/ the >>>> .NET quickfix library, possibly having something to do with >>>> the FileStore? >>>> >>>> Thanks in advance, >>>> Rick >>>> >>>> ------------------------------------------------------------------------- >>>> This SF.net <http://SF.net> email is sponsored by: Microsoft >>>> Defy all challenges. Microsoft(R) Visual Studio 2008. >>>> http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ >>>> _______________________________________________ >>>> Quickfix-developers mailing list >>>> Qui...@li... >>>> <mailto:Qui...@li...> >>>> https://lists.sourceforge.net/lists/listinfo/quickfix-developers >>>> >>>> >>> ------------------------------------------------------------------------ >>> ------------------------------------------------------------------------- >>> This SF.net <http://SF.net> email is sponsored by: Microsoft >>> Defy all challenges. Microsoft(R) Visual Studio 2008. >>> http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ >>> ------------------------------------------------------------------------ >>> _______________________________________________ >>> Quickfix-developers mailing list >>> Qui...@li... <#Compose> >>> https://lists.sourceforge.net/lists/listinfo/quickfix-developers >>> <hr>------------------------------------------------------------------------- >>> >> This SF.net email is sponsored by: Microsoft >> Defy all challenges. Microsoft(R) Visual Studio 2008. >> http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/<hr>_______________________________________________ >> Quickfix-developers mailing list >> Qui...@li... >> https://lists.sourceforge.net/lists/listinfo/quickfix-developers >> > > |
|
From: Rick L. <ric...@gm...> - 2008-03-14 17:17:59
|
That's what I was afraid of -- I'm fairly certain now that it had to do w/ the market data.... No, looking at the .events file all I see is heartbeats for the hour or so prior to the crash. Unfortunately all I have for debugging purposes is a Dr Watson dump file, which isn't telling me much. Thanks anyway, Rick or...@qu... wrote: > I don't know of any outstanding bugs with the filestore. Do you have > any kind of stack trace. Keep in mind that the quickfix_net.dll will > pretty much always show up because events are being passed from > quickfix to your application. So crashes in your application will > generally appear to start out in the quickfix dll. 12 MB is pretty > big, but not outrageous and I've seen bigger. None of it is kept in > memory, it's only read in as needed for resend requests and such. Any > idea if one was being processed during your crash? > > --oren > > -------- Original Message -------- > Subject: [Quickfix-developers] FileStore crashes in .NET? > From: Rick Lane <ric...@gm...> > Date: Fri, March 14, 2008 11:39 am > To: qui...@li... > <mailto:qui...@li...> > > QuickFIX Documentation: > http://www.quickfixengine.org/quickfix/doc/html/index.html > QuickFIX Support: http://www.quickfixengine.org/services.html > > Greetings, > > Have there been any documented instances of QuickFix causing an > application crash in .NET related to the FileStore? My application > was > running along just fine, entering no orders (and with no orders, and > therefore no execution reports) for a couple hours after a very busy > morning. So for about an hour, the only traffic through QuickFix > should've been heartbeats. I received an Application crash -- not the > good kind, the kind that pretty much doesn't let you do any sort of > recovery -- for the first time (I've gotten many crashes due to a > null > pointer, etc., but these can be caught and therefore recovered from). > > I'm not 100% sure QuickFix caused this -- I'm in the process of > thumbing > through the memory dump created by Dr Watson (I'm not very good at > this) > -- but the quickfix_net dll keeps popping up in the log, so I > decided to > go check out the FileStore file. I was surprised to see it was nearly > 12 MB (which I guess because of a busy morning, this is to be > expected?). This crash could very well have been due to the market > data > portion of my app (which listens to the CME's FIX/FAST data > stream) but > I thought I was handling those types of errors better than this, so I > just wanted to see if anyone else has seen unexpected crashes w/ the > .NET quickfix library, possibly having something to do with the > FileStore? > > Thanks in advance, > Rick > > ------------------------------------------------------------------------- > This SF.net <http://SF.net> email is sponsored by: Microsoft > Defy all challenges. Microsoft(R) Visual Studio 2008. > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > _______________________________________________ > Quickfix-developers mailing list > Qui...@li... <#Compose> > https://lists.sourceforge.net/lists/listinfo/quickfix-developers > |
|
From: Rick L. <ric...@gm...> - 2008-03-17 18:23:46
|
I'm fairly certain the crash was occurring in the quickfix_net.DLL --
I'll repost my stack trace while debugging the .dmp file at the end of
this email.
Is there any way the .pdb file generated when the DLL was compiled
(sometime in 2006) can be found? It would help me determine where in
the quickfix code the error is occuring (right now I only have the
address of the function).
After looking at the .dmp file and generating a new .map file for
quickfix_net.DLL, I'm making an educated guess (based on the address in
this .dmp) that the exception is occurring at
ThreadedSocketConnection::readMessage(String)
Thanks,
Rick
> kernel32.dll!77e4bee7()
[Frames below may be incorrect and/or missing, no symbols loaded
for kernel32.dll]
kernel32.dll!77e4bee7()
quickfix_net.dll!10084f0c()
quickfix_net.dll!100938d5()
quickfix_net.dll!10093938()
msvcr80.dll!_EH_prolog() + 0x4e bytes
msvcr80.dll!_FindAndUnlinkFrame() + 0x9b bytes
msvcr80.dll!_is_exception_typeof() + 0x106 bytes
msvcr80.dll!__CxxExceptionFilter() + 0x19f bytes
msvcr80.dll!__CxxExceptionFilter() + 0x503 bytes
msvcr80.dll!__CxxExceptionFilter() + 0x6e8 bytes
msvcr80.dll!__CxxFrameHandler() + 0x26 bytes
ntdll.dll!7c828752()
kernel32.dll!77e4bee7()
kernel32.dll!77e4bee7()
kernel32.dll!77e4bee7()
*msvcr80.dll!_CxxThrowException() + 0x46 bytes *
quickfix_net.dll!10093879()
msvcp80.dll!std::basic_string<char,std::char_traits<char>,std::allocator<char>
>::assign() + 0x6a bytes
msvcr80.dll!free() + 0xec bytes
msvcp80.dll!std::basic_string<char,std::char_traits<char>,std::allocator<char>
>::_Tidy() + 0x33 bytes
msvcp80.dll!std::basic_string<char,std::char_traits<char>,std::allocator<char>
>::~basic_string<char,std::char_traits<char>,std::allocator<char> >()
+ 0x9 bytes
Rick Lane wrote:
> That's what I was afraid of -- I'm fairly certain now that it had to
> do w/ the market data.... No, looking at the .events file all I see
> is heartbeats for the hour or so prior to the crash. Unfortunately
> all I have for debugging purposes is a Dr Watson dump file, which
> isn't telling me much.
>
> Thanks anyway,
> Rick
>
> or...@qu... wrote:
>> I don't know of any outstanding bugs with the filestore. Do you have
>> any kind of stack trace. Keep in mind that the quickfix_net.dll will
>> pretty much always show up because events are being passed from
>> quickfix to your application. So crashes in your application will
>> generally appear to start out in the quickfix dll. 12 MB is pretty
>> big, but not outrageous and I've seen bigger. None of it is kept in
>> memory, it's only read in as needed for resend requests and such.
>> Any idea if one was being processed during your crash?
>>
>> --oren
>>
>> -------- Original Message --------
>> Subject: [Quickfix-developers] FileStore crashes in .NET?
>> From: Rick Lane <ric...@gm...>
>> Date: Fri, March 14, 2008 11:39 am
>> To: qui...@li...
>> <mailto:qui...@li...>
>>
>> QuickFIX Documentation:
>> http://www.quickfixengine.org/quickfix/doc/html/index.html
>> QuickFIX Support: http://www.quickfixengine.org/services.html
>>
>> Greetings,
>>
>> Have there been any documented instances of QuickFix causing an
>> application crash in .NET related to the FileStore? My
>> application was
>> running along just fine, entering no orders (and with no orders, and
>> therefore no execution reports) for a couple hours after a very busy
>> morning. So for about an hour, the only traffic through QuickFix
>> should've been heartbeats. I received an Application crash -- not
>> the
>> good kind, the kind that pretty much doesn't let you do any sort of
>> recovery -- for the first time (I've gotten many crashes due to a
>> null
>> pointer, etc., but these can be caught and therefore recovered from).
>>
>> I'm not 100% sure QuickFix caused this -- I'm in the process of
>> thumbing
>> through the memory dump created by Dr Watson (I'm not very good
>> at this)
>> -- but the quickfix_net dll keeps popping up in the log, so I
>> decided to
>> go check out the FileStore file. I was surprised to see it was
>> nearly
>> 12 MB (which I guess because of a busy morning, this is to be
>> expected?). This crash could very well have been due to the
>> market data
>> portion of my app (which listens to the CME's FIX/FAST data
>> stream) but
>> I thought I was handling those types of errors better than this,
>> so I
>> just wanted to see if anyone else has seen unexpected crashes w/ the
>> .NET quickfix library, possibly having something to do with the
>> FileStore?
>>
>> Thanks in advance,
>> Rick
>>
>> -------------------------------------------------------------------------
>> This SF.net <http://SF.net> email is sponsored by: Microsoft
>> Defy all challenges. Microsoft(R) Visual Studio 2008.
>> http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
>> _______________________________________________
>> Quickfix-developers mailing list
>> Qui...@li... <#Compose>
>> https://lists.sourceforge.net/lists/listinfo/quickfix-developers
>>
|
|
From: Rick L. <ric...@gm...> - 2008-03-14 19:41:54
|
After some more digging, I'm attempting to load the .dmp file generated
at the application crash into Visual Studio. There are many entries for
quickfix_net.dll (which, as you said, may not mean there was a problem
with quickfix), but it would be nice to be able to load the .pdb file
for QuickFix into Visual Studio so I can see actual function names
instead of just assembly mumbo jumbo.
I tried loading both the debug/vs8/quickfix_net.pdb and the
release/vs8/quickfix_net.pdb and for both it said it "did not match the
module." Has anyone tried to load these pdb files into studio for
debugging purposes? incidentally, the exception is: "Unhandled
exception at 0x77e4bee7 in user.dmp: 0xC0020001: The string binding is
invalid." I've done some research on this and in most cases it seems to
occur when people are blending managed and unmanaged code. Outside of
QuickFix, I do /not /have any unmanaged code -- so is this looking more
like it might be a native issue (after all, isn't the .NET QuickFix
library just a wrapper around the unmanaged version?).
call stack at crash:
> kernel32.dll!77e4bee7()
[Frames below may be incorrect and/or missing, no symbols loaded
for kernel32.dll]
kernel32.dll!77e4bee7()
quickfix_net.dll!10084f0c()
quickfix_net.dll!100938d5()
quickfix_net.dll!10093938()
or...@qu... wrote:
> I don't know of any outstanding bugs with the filestore. Do you have
> any kind of stack trace. Keep in mind that the quickfix_net.dll will
> pretty much always show up because events are being passed from
> quickfix to your application. So crashes in your application will
> generally appear to start out in the quickfix dll. 12 MB is pretty
> big, but not outrageous and I've seen bigger. None of it is kept in
> memory, it's only read in as needed for resend requests and such. Any
> idea if one was being processed during your crash?
>
> --oren
>
> -------- Original Message --------
> Subject: [Quickfix-developers] FileStore crashes in .NET?
> From: Rick Lane <ric...@gm...>
> Date: Fri, March 14, 2008 11:39 am
> To: qui...@li...
> <mailto:qui...@li...>
>
> QuickFIX Documentation:
> http://www.quickfixengine.org/quickfix/doc/html/index.html
> QuickFIX Support: http://www.quickfixengine.org/services.html
>
> Greetings,
>
> Have there been any documented instances of QuickFix causing an
> application crash in .NET related to the FileStore? My application
> was
> running along just fine, entering no orders (and with no orders, and
> therefore no execution reports) for a couple hours after a very busy
> morning. So for about an hour, the only traffic through QuickFix
> should've been heartbeats. I received an Application crash -- not the
> good kind, the kind that pretty much doesn't let you do any sort of
> recovery -- for the first time (I've gotten many crashes due to a
> null
> pointer, etc., but these can be caught and therefore recovered from).
>
> I'm not 100% sure QuickFix caused this -- I'm in the process of
> thumbing
> through the memory dump created by Dr Watson (I'm not very good at
> this)
> -- but the quickfix_net dll keeps popping up in the log, so I
> decided to
> go check out the FileStore file. I was surprised to see it was nearly
> 12 MB (which I guess because of a busy morning, this is to be
> expected?). This crash could very well have been due to the market
> data
> portion of my app (which listens to the CME's FIX/FAST data
> stream) but
> I thought I was handling those types of errors better than this, so I
> just wanted to see if anyone else has seen unexpected crashes w/ the
> .NET quickfix library, possibly having something to do with the
> FileStore?
>
> Thanks in advance,
> Rick
>
> -------------------------------------------------------------------------
> This SF.net <http://SF.net> email is sponsored by: Microsoft
> Defy all challenges. Microsoft(R) Visual Studio 2008.
> http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
> _______________________________________________
> Quickfix-developers mailing list
> Qui...@li... <#Compose>
> https://lists.sourceforge.net/lists/listinfo/quickfix-developers
>
|
|
From: Rick L. <ric...@gm...> - 2008-03-17 13:15:04
|
I should add that at first I thought I might need to register the new
DLL on the server, but the regsvr32 app gives me the following error
message:
LoadLibrary("quickfix_net.dll") failed -- this application has failed to
start because the application configuration is incorrect. reinstalling
the application may fix this problem.
Thanks,
Rick
Rick Lane wrote:
> After some more digging, I'm attempting to load the .dmp file
> generated at the application crash into Visual Studio. There are many
> entries for quickfix_net.dll (which, as you said, may not mean there
> was a problem with quickfix), but it would be nice to be able to load
> the .pdb file for QuickFix into Visual Studio so I can see actual
> function names instead of just assembly mumbo jumbo.
>
> I tried loading both the debug/vs8/quickfix_net.pdb and the
> release/vs8/quickfix_net.pdb and for both it said it "did not match
> the module." Has anyone tried to load these pdb files into studio for
> debugging purposes? incidentally, the exception is: "Unhandled
> exception at 0x77e4bee7 in user.dmp: 0xC0020001: The string binding is
> invalid." I've done some research on this and in most cases it seems
> to occur when people are blending managed and unmanaged code. Outside
> of QuickFix, I do /not /have any unmanaged code -- so is this looking
> more like it might be a native issue (after all, isn't the .NET
> QuickFix library just a wrapper around the unmanaged version?).
>
> call stack at crash:
>
> > kernel32.dll!77e4bee7()
> [Frames below may be incorrect and/or missing, no symbols loaded
> for kernel32.dll]
> kernel32.dll!77e4bee7()
> quickfix_net.dll!10084f0c()
> quickfix_net.dll!100938d5()
> quickfix_net.dll!10093938()
>
>
> or...@qu... wrote:
>> I don't know of any outstanding bugs with the filestore. Do you have
>> any kind of stack trace. Keep in mind that the quickfix_net.dll will
>> pretty much always show up because events are being passed from
>> quickfix to your application. So crashes in your application will
>> generally appear to start out in the quickfix dll. 12 MB is pretty
>> big, but not outrageous and I've seen bigger. None of it is kept in
>> memory, it's only read in as needed for resend requests and such.
>> Any idea if one was being processed during your crash?
>>
>> --oren
>>
>> -------- Original Message --------
>> Subject: [Quickfix-developers] FileStore crashes in .NET?
>> From: Rick Lane <ric...@gm...>
>> Date: Fri, March 14, 2008 11:39 am
>> To: qui...@li...
>> <mailto:qui...@li...>
>>
>> QuickFIX Documentation:
>> http://www.quickfixengine.org/quickfix/doc/html/index.html
>> QuickFIX Support: http://www.quickfixengine.org/services.html
>>
>> Greetings,
>>
>> Have there been any documented instances of QuickFix causing an
>> application crash in .NET related to the FileStore? My
>> application was
>> running along just fine, entering no orders (and with no orders, and
>> therefore no execution reports) for a couple hours after a very busy
>> morning. So for about an hour, the only traffic through QuickFix
>> should've been heartbeats. I received an Application crash -- not
>> the
>> good kind, the kind that pretty much doesn't let you do any sort of
>> recovery -- for the first time (I've gotten many crashes due to a
>> null
>> pointer, etc., but these can be caught and therefore recovered from).
>>
>> I'm not 100% sure QuickFix caused this -- I'm in the process of
>> thumbing
>> through the memory dump created by Dr Watson (I'm not very good
>> at this)
>> -- but the quickfix_net dll keeps popping up in the log, so I
>> decided to
>> go check out the FileStore file. I was surprised to see it was
>> nearly
>> 12 MB (which I guess because of a busy morning, this is to be
>> expected?). This crash could very well have been due to the
>> market data
>> portion of my app (which listens to the CME's FIX/FAST data
>> stream) but
>> I thought I was handling those types of errors better than this,
>> so I
>> just wanted to see if anyone else has seen unexpected crashes w/ the
>> .NET quickfix library, possibly having something to do with the
>> FileStore?
>>
>> Thanks in advance,
>> Rick
>>
>> -------------------------------------------------------------------------
>> This SF.net <http://SF.net> email is sponsored by: Microsoft
>> Defy all challenges. Microsoft(R) Visual Studio 2008.
>> http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
>> _______________________________________________
>> Quickfix-developers mailing list
>> Qui...@li... <#Compose>
>> https://lists.sourceforge.net/lists/listinfo/quickfix-developers
>>
|
×
Want the latest updates on software, tech news, and AI?
Get latest updates about software, tech news, and AI from SourceForge directly in your inbox once a month.
Thanks for helping keep SourceForge clean.
X