Re: [Quickfixj-users] Server going Out of Memory when fetching ICE Security Definitions for Financial Power

[Abhishek S. <atm...@gm...>]

Hi Chris,

my case looks similar to this -
http://quickfix-j.364392.n2.nabble.com/Quickfix-taking-huge-memory-when-network-latency-is-high-td7579878.html#a7579894

any thought ?

On Sun, Aug 18, 2019 at 9:48 PM Abhishek Singh <atm...@gm...> wrote:

> We are saving security definitions in our DB table.
>
> It looks like QFJ keeps whole string in memory, whenever we try to fetch
> definitions for multiple markets ( e. g. - Oil, Power, Financial Power
> etc.) simultaneously, heap dump shows a lots of memory is used by QFJ while
> processing incoming definitions in string format.
>
> I am using QFJ 44 (version 1.6.4).
>
> On Sun, Aug 18, 2019 at 6:56 PM Christoph John <chr...@ma...>
> wrote:
>
>> I do not know how multithreading will improve your memory allocation?!
>>
>> What are you doing with the security definitions? I assume you store them
>> in the same application that also uses QuickFIX/J? QFJ itself will not keep
>> incoming messages in memory by itself.
>>
>> Cheers,
>> Chris.
>>
>> Am 18. August 2019 13:23:30 MESZ schrieb imabhi <atm...@gm...>:
>>>
>>> QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
>>> QuickFIX/J Support: http://www.quickfixj.org/support/
>>>
>>>
>>> We have implemented QuickFIX/J for Trade capture and fetching ICE security
>>> definitions.
>>>
>>> We have allocated 2 GB memory to our ICE Adapter which is responsible for
>>> connecting with ICE, flowing deals captured on ICE and fetching securities
>>> from ICE for various markets.
>>>
>>> When we try to fetch ICE Security Definitions for Financial Power market,
>>> ICE Adapter is going Out of Memory though we allocated 2 GB.
>>> When we increased memory allocation to 3 GB then it worked fine without
>>> going OOM.
>>>
>>> What we observe is, Quickfix engine is taking too much server memory while
>>> processing incoming definitions from ICE. If less number of definitions are
>>> coming then there is no issue.
>>>
>>> Do any one had similar issue in past ? If yes then how you fixed this. Is
>>> there any option in FIX protocol to make it multi threaded or something like
>>> that.
>>>
>>> Any information will be helpful, waiting for valuable feedback.
>>>
>>> Thanks,
>>> Abhishek Singh
>>>
>>>
>>>
>>> --
>>> Sent from: http://quickfix-j.364392.n2.nabble.com/
>>> ------------------------------
>>> Quickfixj-users mailing list
>>> Qui...@li...
>>> https://lists.sourceforge.net/lists/listinfo/quickfixj-users
>>>
>>>