Re: [Quickfixj-users] Asking advice for the idea of broadcast the FIX messages using Kafka

[Felipe W. <fel...@gm...>]

Colin,

Thanks for your advice.

Regards,
Felipe Windmoller

Em ter, 12 de out de 2021 10:41, Colin DuPlantis <co...@ma...>
escreveu:

> QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
> QuickFIX/J <http://www.quickfixj.org/documentation/QuickFIX/J> Support:
> http://www.quickfixj.org/support/
>
>
> Just to add, don’t put too much effort into duplicating what QFJ already
> does. It’s fine to make sure your app processed all the messages without
> error, but, QFJ already makes sure that all messages have been sent by the
> counter, so, put your “we read the message” check after your business
> processes the message, not just after QFJ receives the message.
>
> On Oct 12, 2021, at 5:30 AM, Felipe Windmoller <fel...@gm...>
> wrote:
>
> QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
> QuickFIX/J Support: http://www.quickfixj.org/support/
>
>
> Hello Chris,
>
> Thanks a lot for your advices!
>
> I'll store the last read seqnum as you suggested.
>
> Regards,
> Felipe
>
> Em ter, 12 de out de 2021 09:06, Christoph John <chr...@ma...>
> escreveu:
>
>> Hi Felipe,
>>
>> IMHO if the one minute schedule is sufficient I'd avoid introducing more
>> complexity and go for the data base solution.
>> Maybe store the last read seqnum in your app so that you do not read the
>> whole table over and over every minute.
>>
>> Cheers,
>> Chris.
>>
>>
>> On 12.10.21 13:28, Felipe Windmoller wrote:
>>
>> Hello John!
>>
>> The initial idea was that the application would run after the market was
>> closed and then would read all messages of the day using the QFJ LOG table.
>>
>> But later the business team decided that they wanted the information
>> during the day.
>>
>> Your advice is excellent. It will make things much more simple.
>>
>> I think I'll configure one schedule, like every 1 minute, to run a task
>> that will read the QFJ LOG table and then update our business tables.
>>
>> Regards,
>> Felipe Windmoller
>>
>>
>>
>>
>> Em ter., 12 de out. de 2021 às 05:40, Christoph John <
>> chr...@ma...> escreveu:
>>
>>> Hi,
>>>
>>> just one thing that I am asking myself: why doesn't the other
>>> application read all messages from the table? ;)
>>> Please excuse if this is a dumb question, just was asking myself while
>>> reading this.
>>>
>>> Cheers,
>>> Chris.
>>>
>>>
>>> On 11.10.21 23:52, Felipe Windmoller wrote:
>>>
>>> QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
>>> QuickFIX/J Support: http://www.quickfixj.org/support/
>>>
>>>
>>> Hello everyone!
>>>
>>> I'll be happy if any of you could give me some advice about one idea!
>>>
>>> I have one drop copy session and I must interpret the FIX messages and
>>> translate them to business tables.
>>>
>>> We got a bit worried about doing this in the same application that does
>>> the FIX communication with QFJ help.
>>>
>>> Our worry is that this processing could overhead the application and
>>> even crash it in case of some error.
>>>
>>> The other application would be listening to the Kafka topic, checking
>>> the sequence number, and processing the messages. If this application
>>> identifies that one message is missing, it would read the FIX LOG table to
>>> fill the gap.
>>>
>>> So, what is your opinion? Is this a reasonable idea or perhaps there are
>>> problems here that I wasn't able to see.
>>>
>>> Thanks a lot,
>>> Felipe Henrique Gross Windmoller
>>>
>>>
>>> _______________________________________________
>>> Quickfixj-users mailing lis...@li...://lists.sourceforge.net/lists/listinfo/quickfixj-users
>>>
>>>
>>> --
>>> Christoph John
>>> Software Engineering
>>> T +49 241 557...@ma...
>>>
>>> MACD GmbH
>>> Oppenhoffallee 103
>>> 52066 Aachen, Germanywww.macd.com
>>>
>>> Amtsgericht Aachen: HRB 8151
>>> Ust.-Id: DE 813021663
>>> Geschäftsführer: George Macdonald
>>>
>>>
>> --
>> Christoph John
>> Software Engineering
>> T +49 241 557...@ma...
>>
>> MACD GmbH
>> Oppenhoffallee 103
>> 52066 Aachen, Germanywww.macd.com
>>
>> Amtsgericht Aachen: HRB 8151
>> Ust.-Id: DE 813021663
>> Geschäftsführer: George Macdonald
>>
>> _______________________________________________
> Quickfixj-users mailing list
> Qui...@li...
> https://lists.sourceforge.net/lists/listinfo/quickfixj-users
>
>
> Colin DuPlantis
> Chief Architect, Marketcetera
> Download, Run, Trade
> https://www.marketcetera.com
>
> _______________________________________________
> Quickfixj-users mailing list
> Qui...@li...
> https://lists.sourceforge.net/lists/listinfo/quickfixj-users
>