Thread: Re: [Quickfix-users] [Quickfix-developers] To database or not to database
Brought to you by:
orenmnero
From: Eranga S. <pe...@ri...> - 2007-02-16 04:53:00
|
Hi, Here are some of test results I got through my test. Testing environment not up to standard. I just use my working machine. I used Quickfix through the JNI. Machine 3 GHz processor 1GB DDR RAM. Both Quickfix and MySQL server running on same machine. Rds, Eranga File storage Number of Active sessions Number of messages Total time / s Messages per Second 1 10,000 156.2 64.02 1 25,000 391.3 63.88 1 50,000 783.6 63.80 10 10,000 156.5 63.89 10 25,000 391.4 63.87 10 50,000 783.6 63.80 MySQL storage Number of Active sessions Number of messages Total time / s Messages per Second 1 10,000 449.7 22.23 1 25,000 1146.2 21.81 1 50,000 2282.7 21.90 10 10,000 440.0 22.72 10 25,000 1074.1 23.27 10 50,000 2161.5 23.13 -----Original Message----- From: qui...@li... [mailto:qui...@li...] On Behalf Of Ronald StOnge Sent: Friday, February 16, 2007 8:49 AM To: qui...@li... Subject: [Quickfix-developers] To database or not to database QuickFIX Documentation: http://www.quickfixengine.org/quickfix/doc/html/index.html QuickFIX Support: http://www.quickfixengine.org/services.html I am working on a financial application and am planning to use QuickFIX. I got the project and example working just find (nice job putting this together!). My application will only need to process about 100 messages a second. What are the pros/cons of using a database such as PostgreSQL vs. a flat file for the message store (reliablility is a priority for me vs. speed)? Thanks, Ron ____________________________________________________________________________ ________ No need to miss a message. Get email on-the-go with Yahoo! Mail for Mobile. Get started. http://mobile.yahoo.com/mail ------------------------------------------------------------------------- Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV _______________________________________________ Quickfix-developers mailing list Qui...@li... https://lists.sourceforge.net/lists/listinfo/quickfix-developers |
From: Djalma R. d. S. F. <drs...@gm...> - 2007-02-16 13:03:46
|
Hi, I think that FileStore is good for the majority of the situations and with better performance than databases. But, anyone who intends to use it, should be aware that due to current implementation there is a limitation in the number of sessions QuickFIX can open when using FileStore. The maximum number of sessions I could create with QF using FileStore was 80 sessions (Windows 2003). The reason for this is that QuickFIX opens 4 files in exclusive mode for each session: .body .header .seqnums .session Certainly, there is a way to increase this number, I guess that maybe modifying an operating system variable to increase the number of available File Handles. By the way, does anyone knows how to do it in Windows? Anyway, I think that more sessions can be created with MySQL or PostgreSQL, although, I did not test it yet, but I saw in the source code that there is a connection pool implemented for both classes and I guess this should help a lot. Does anyone have experience with maximum number of sessions that can be created using these databases? Regards, Djalma On 2/16/07, Eranga Samararathna <pe...@ri...> wrote: > > QuickFIX Documentation: > http://www.quickfixengine.org/quickfix/doc/html/index.html > QuickFIX Support: http://www.quickfixengine.org/services.html > > Hi, > > Here are some of test results I got through my test. Testing environment > not > up to standard. I just use my working machine. > I used Quickfix through the JNI. > Machine 3 GHz processor 1GB DDR RAM. > Both Quickfix and MySQL server running on same machine. > > Rds, > > Eranga > > > > > File storage > Number of Active sessions Number of messages Total time / s > Messages per Second > 1 10,000 156.2 > 64.02 > 1 25,000 391.3 > 63.88 > 1 50,000 783.6 > 63.80 > 10 10,000 156.5 > 63.89 > 10 25,000 391.4 > 63.87 > 10 50,000 783.6 > 63.80 > > MySQL storage > > Number of Active sessions Number of messages Total time > / > s Messages per Second > 1 10,000 449.7 > 22.23 > 1 25,000 1146.2 > 21.81 > 1 50,000 2282.7 > 21.90 > 10 10,000 440.0 > 22.72 > 10 25,000 1074.1 > 23.27 > 10 50,000 2161.5 > 23.13 > > -----Original Message----- > From: qui...@li... > [mailto:qui...@li...] On Behalf Of > Ronald StOnge > Sent: Friday, February 16, 2007 8:49 AM > To: qui...@li... > Subject: [Quickfix-developers] To database or not to database > > QuickFIX Documentation: > http://www.quickfixengine.org/quickfix/doc/html/index.html > QuickFIX Support: http://www.quickfixengine.org/services.html > > I am working on a financial application and am > planning to use QuickFIX. I got the project and > example working just find (nice job putting this > together!). > > My application will only need to process about 100 > messages a second. What are the pros/cons of using a > database such as PostgreSQL vs. a flat file for the > message store (reliablility is a priority for me vs. > speed)? > > Thanks, > > Ron > > > > > > ____________________________________________________________________________ > ________ > No need to miss a message. Get email on-the-go > with Yahoo! Mail for Mobile. Get started. > http://mobile.yahoo.com/mail > > ------------------------------------------------------------------------- > Take Surveys. Earn Cash. Influence the Future of IT > Join SourceForge.net's Techsay panel and you'll get the chance to share > your > opinions on IT & business topics through brief surveys-and earn cash > http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV > _______________________________________________ > Quickfix-developers mailing list > Qui...@li... > https://lists.sourceforge.net/lists/listinfo/quickfix-developers > > > ------------------------------------------------------------------------- > Take Surveys. Earn Cash. Influence the Future of IT > Join SourceForge.net's Techsay panel and you'll get the chance to share > your > opinions on IT & business topics through brief surveys-and earn cash > http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV > _______________________________________________ > Quickfix-users mailing list > Qui...@li... > https://lists.sourceforge.net/lists/listinfo/quickfix-users > |