Re: [Quickfixj-users] Server going Out of Memory when fetching ICE Security Definitions for Financial Power

[Christoph J. <chr...@ma...>]

That case is about sending messages, i.e. a slow consumer. 
I thought you are receiving the messages? However, could you try with a newer QFJ version? 
What does your fromApp callback look like? 

Cheers 
Chris 

Am 18. August 2019 19:50:53 MESZ schrieb Abhishek Singh <atm...@gm...>:
>Hi Chris,
>
>my case looks similar to this -
>http://quickfix-j.364392.n2.nabble.com/Quickfix-taking-huge-memory-when-network-latency-is-high-td7579878.html#a7579894
>
>any thought ?
>
>On Sun, Aug 18, 2019 at 9:48 PM Abhishek Singh <atm...@gm...>
>wrote:
>
>> We are saving security definitions in our DB table.
>>
>> It looks like QFJ keeps whole string in memory, whenever we try to
>fetch
>> definitions for multiple markets ( e. g. - Oil, Power, Financial
>Power
>> etc.) simultaneously, heap dump shows a lots of memory is used by QFJ
>while
>> processing incoming definitions in string format.
>>
>> I am using QFJ 44 (version 1.6.4).
>>
>> On Sun, Aug 18, 2019 at 6:56 PM Christoph John
><chr...@ma...>
>> wrote:
>>
>>> I do not know how multithreading will improve your memory
>allocation?!
>>>
>>> What are you doing with the security definitions? I assume you store
>them
>>> in the same application that also uses QuickFIX/J? QFJ itself will
>not keep
>>> incoming messages in memory by itself.
>>>
>>> Cheers,
>>> Chris.
>>>
>>> Am 18. August 2019 13:23:30 MESZ schrieb imabhi
><atm...@gm...>:
>>>>
>>>> QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
>>>> QuickFIX/J Support: http://www.quickfixj.org/support/
>>>>
>>>>
>>>> We have implemented QuickFIX/J for Trade capture and fetching ICE
>security
>>>> definitions.
>>>>
>>>> We have allocated 2 GB memory to our ICE Adapter which is
>responsible for
>>>> connecting with ICE, flowing deals captured on ICE and fetching
>securities
>>>> from ICE for various markets.
>>>>
>>>> When we try to fetch ICE Security Definitions for Financial Power
>market,
>>>> ICE Adapter is going Out of Memory though we allocated 2 GB.
>>>> When we increased memory allocation to 3 GB then it worked fine
>without
>>>> going OOM.
>>>>
>>>> What we observe is, Quickfix engine is taking too much server
>memory while
>>>> processing incoming definitions from ICE. If less number of
>definitions are
>>>> coming then there is no issue.
>>>>
>>>> Do any one had similar issue in past ? If yes then how you fixed
>this. Is
>>>> there any option in FIX protocol to make it multi threaded or
>something like
>>>> that.
>>>>
>>>> Any information will be helpful, waiting for valuable feedback.
>>>>
>>>> Thanks,
>>>> Abhishek Singh
>>>>
>>>>
>>>>
>>>> --
>>>> Sent from: http://quickfix-j.364392.n2.nabble.com/
>>>> ------------------------------
>>>> Quickfixj-users mailing list
>>>> Qui...@li...
>>>> https://lists.sourceforge.net/lists/listinfo/quickfixj-users
>>>>
>>>>