Re: [Quickfixj-users] Server going Out of Memory when fetching ICE Security Definitions for Financial Power

[Abhishek S. <atm...@gm...>]

Yes, I am receiving messages.
Which version you are referring to? Is something fixed in newer version?

Didnot get your last que about fromApp callback ?

On Sun, 18 Aug 2019 at 11:45 PM, Christoph John <chr...@ma...>
wrote:

> That case is about sending messages, i.e. a slow consumer.
> I thought you are receiving the messages? However, could you try with a
> newer QFJ version?
> What does your fromApp callback look like?
>
> Cheers
> Chris
>
> Am 18. August 2019 19:50:53 MESZ schrieb Abhishek Singh <
> atm...@gm...>:
>>
>> Hi Chris,
>>
>> my case looks similar to this -
>> http://quickfix-j.364392.n2.nabble.com/Quickfix-taking-huge-memory-when-network-latency-is-high-td7579878.html#a7579894
>>
>> any thought ?
>>
>> On Sun, Aug 18, 2019 at 9:48 PM Abhishek Singh <atm...@gm...>
>> wrote:
>>
>>> We are saving security definitions in our DB table.
>>>
>>> It looks like QFJ keeps whole string in memory, whenever we try to fetch
>>> definitions for multiple markets ( e. g. - Oil, Power, Financial Power
>>> etc.) simultaneously, heap dump shows a lots of memory is used by QFJ while
>>> processing incoming definitions in string format.
>>>
>>> I am using QFJ 44 (version 1.6.4).
>>>
>>> On Sun, Aug 18, 2019 at 6:56 PM Christoph John <chr...@ma...>
>>> wrote:
>>>
>>>> I do not know how multithreading will improve your memory allocation?!
>>>>
>>>> What are you doing with the security definitions? I assume you store
>>>> them in the same application that also uses QuickFIX/J? QFJ itself will not
>>>> keep incoming messages in memory by itself.
>>>>
>>>> Cheers,
>>>> Chris.
>>>>
>>>> Am 18. August 2019 13:23:30 MESZ schrieb imabhi <atm...@gm...>:
>>>>>
>>>>> QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
>>>>> QuickFIX/J Support: http://www.quickfixj.org/support/
>>>>>
>>>>>
>>>>> We have implemented QuickFIX/J for Trade capture and fetching ICE security
>>>>> definitions.
>>>>>
>>>>> We have allocated 2 GB memory to our ICE Adapter which is responsible for
>>>>> connecting with ICE, flowing deals captured on ICE and fetching securities
>>>>> from ICE for various markets.
>>>>>
>>>>> When we try to fetch ICE Security Definitions for Financial Power market,
>>>>> ICE Adapter is going Out of Memory though we allocated 2 GB.
>>>>> When we increased memory allocation to 3 GB then it worked fine without
>>>>> going OOM.
>>>>>
>>>>> What we observe is, Quickfix engine is taking too much server memory while
>>>>> processing incoming definitions from ICE. If less number of definitions are
>>>>> coming then there is no issue.
>>>>>
>>>>> Do any one had similar issue in past ? If yes then how you fixed this. Is
>>>>> there any option in FIX protocol to make it multi threaded or something like
>>>>> that.
>>>>>
>>>>> Any information will be helpful, waiting for valuable feedback.
>>>>>
>>>>> Thanks,
>>>>> Abhishek Singh
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Sent from: http://quickfix-j.364392.n2.nabble.com/
>>>>> ------------------------------
>>>>> Quickfixj-users mailing list
>>>>> Qui...@li...
>>>>> https://lists.sourceforge.net/lists/listinfo/quickfixj-users
>>>>>
>>>>>