Re: [Quickfixj-users] Asking advice for the idea of broadcast the FIX messages using Kafka

[Christoph J. <chr...@ma...>]

Hi Felipe,

IMHO if the one minute schedule is sufficient I'd avoid introducing more complexity and go for the 
data base solution.
Maybe store the last read seqnum in your app so that you do not read the whole table over and over 
every minute.

Cheers,
Chris.


On 12.10.21 13:28, Felipe Windmoller wrote:
> Hello John!
>
> The initial idea was that the application would run after the market was closed and then would 
> read all messages of the day using the QFJ LOG table.
>
> But later the business team decided that they wanted the information during the day.
>
> Your advice is excellent. It will make things much more simple.
>
> I think I'll configure one schedule, like every 1 minute, to run a task that will read the QFJ LOG 
> table and then update our business tables.
>
> Regards,
> Felipe Windmoller
>
>
>
>
> Em ter., 12 de out. de 2021 às 05:40, Christoph John <chr...@ma... 
> <mailto:chr...@ma...>> escreveu:
>
>     Hi,
>
>     just one thing that I am asking myself: why doesn't the other application read all messages
>     from the table? ;)
>     Please excuse if this is a dumb question, just was asking myself while reading this.
>
>     Cheers,
>     Chris.
>
>
>     On 11.10.21 23:52, Felipe Windmoller wrote:
>>     QuickFIX/J Documentation:http://www.quickfixj.org/documentation/  <http://www.quickfixj.org/documentation/>
>>     QuickFIX/J Support:http://www.quickfixj.org/support/  <http://www.quickfixj.org/support/>
>>
>>
>>
>>     Hello everyone!
>>
>>     I'll be happy if any of you could give me some advice about one idea!
>>
>>     I have one drop copy session and I must interpret the FIX messages and translate them to
>>     business tables.
>>
>>     We got a bit worried about doing this in the same application that does the FIX communication
>>     with QFJ help.
>>
>>     Our worry is that this processing could overhead the application and even crash it in case of
>>     some error.
>>
>>     The other application would be listening to the Kafka topic, checking the sequence number,
>>     and processing the messages. If this application identifies that one message is missing, it
>>     would read the FIX LOG table to fill the gap.
>>
>>     So, what is your opinion? Is this a reasonable idea or perhaps there are problems here that I
>>     wasn't able to see.
>>
>>     Thanks a lot,
>>     Felipe Henrique Gross Windmoller
>>
>>
>>     _______________________________________________
>>     Quickfixj-users mailing list
>>     Qui...@li...  <mailto:Qui...@li...>
>>     https://lists.sourceforge.net/lists/listinfo/quickfixj-users  <https://lists.sourceforge.net/lists/listinfo/quickfixj-users>
>
>     -- 
>     Christoph John
>     Software Engineering
>     T +49 241 557080-28
>     chr...@ma...  <mailto:chr...@ma...>
>
>     MACD GmbH
>     Oppenhoffallee 103
>     52066 Aachen, Germany
>     www.macd.com  <http://www.macd.com>
>
>     Amtsgericht Aachen: HRB 8151
>     Ust.-Id: DE 813021663
>     Geschäftsführer: George Macdonald
>

-- 
Christoph John
Software Engineering
T +49 241 557080-28
chr...@ma...

MACD GmbH
Oppenhoffallee 103
52066 Aachen, Germany
www.macd.com

Amtsgericht Aachen: HRB 8151
Ust.-Id: DE 813021663
Geschäftsführer: George Macdonald