Thread: [Cppcms-users] Distributed data
Brought to you by:
artyom-beilis
Menu
▾
▴
cppcms-users
|
From: Shiv S. D. <shi...@gm...> - 2013-11-29 09:30:02
|
Hi, Suppose an app is running on multiple machines then how should they synchronize data? Should OpenMPI be used to do message passing to talk among each other because then thread_shared will not work? -- Respect, Shiv Shankar Dayal |
|
From: Eric G. <con...@gm...> - 2013-11-30 21:48:58
|
I'm not sure to understand... Maybe you need a file sharing somewhere or even a server? Samba... NFS... A simple windows share... Maybe you need a client/server system or SQL server? postgresql, mariaDB... Maybe you need P2P if so, take a look a ZeroMQ (0mq) it's a very good library. On Fri, Nov 29, 2013 at 4:29 AM, Shiv Shankar Dayal < shi...@gm...> wrote: > Hi, > > Suppose an app is running on multiple machines then how should they > synchronize data? Should OpenMPI be used to do message passing to talk > among each other because then thread_shared will not work? > > -- > Respect, > Shiv Shankar Dayal > > > ------------------------------------------------------------------------------ > Rapidly troubleshoot problems before they affect your business. Most IT > organizations don't have a clear picture of how application performance > affects their revenue. With AppDynamics, you get 100% visibility into your > Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics > Pro! > http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk > _______________________________________________ > Cppcms-users mailing list > Cpp...@li... > https://lists.sourceforge.net/lists/listinfo/cppcms-users > > |
|
From: Shiv S. D. <shi...@gm...> - 2013-11-30 23:40:38
|
I thought over it and I think it is better to share using a database layer to serve as an abstraction layer for storage mechanism. SQL servers do not cut job for a person like me who is alone. I have no resource to shard and maintain them. On Sun, Dec 1, 2013 at 3:18 AM, Eric Gendron <con...@gm...> wrote: > I'm not sure to understand... > > Maybe you need a file sharing somewhere or even a server? Samba... NFS... > A simple windows share... > Maybe you need a client/server system or SQL server? postgresql, > mariaDB... > Maybe you need P2P if so, take a look a ZeroMQ (0mq) it's a very good > library. > > > > > On Fri, Nov 29, 2013 at 4:29 AM, Shiv Shankar Dayal < > shi...@gm...> wrote: > >> Hi, >> >> Suppose an app is running on multiple machines then how should they >> synchronize data? Should OpenMPI be used to do message passing to talk >> among each other because then thread_shared will not work? >> >> -- >> Respect, >> Shiv Shankar Dayal >> >> >> ------------------------------------------------------------------------------ >> Rapidly troubleshoot problems before they affect your business. Most IT >> organizations don't have a clear picture of how application performance >> affects their revenue. With AppDynamics, you get 100% visibility into your >> Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics >> Pro! >> >> http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk >> _______________________________________________ >> Cppcms-users mailing list >> Cpp...@li... >> https://lists.sourceforge.net/lists/listinfo/cppcms-users >> >> > > > ------------------------------------------------------------------------------ > Rapidly troubleshoot problems before they affect your business. Most IT > organizations don't have a clear picture of how application performance > affects their revenue. With AppDynamics, you get 100% visibility into your > Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics > Pro! > http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk > _______________________________________________ > Cppcms-users mailing list > Cpp...@li... > https://lists.sourceforge.net/lists/listinfo/cppcms-users > > -- Respect, Shiv Shankar Dayal |
|
From: Eric G. <con...@gm...> - 2013-12-01 00:12:13
|
SQL is a database... It's almost easy to start using sql... for simple queries. Easy to share datas between multiple computers on a network. Setup connexion Open database... Select or update query... Close database even if you use read/write local files, I recommand using something like sqlite, doing sql queries on local database without server. For me, I found faster to dev with sql even on local database files than on manual read/write files... Le 2013-11-30 18:41, "Shiv Shankar Dayal" <shi...@gm...> a écrit : > I thought over it and I think it is better to share using a database layer > to serve as an abstraction layer for storage mechanism. SQL servers do not > cut job for a person like me who is alone. I have no resource to shard and > maintain them. > > > On Sun, Dec 1, 2013 at 3:18 AM, Eric Gendron <con...@gm...> wrote: > >> I'm not sure to understand... >> >> Maybe you need a file sharing somewhere or even a server? Samba... >> NFS... A simple windows share... >> Maybe you need a client/server system or SQL server? postgresql, >> mariaDB... >> Maybe you need P2P if so, take a look a ZeroMQ (0mq) it's a very good >> library. >> >> >> >> >> On Fri, Nov 29, 2013 at 4:29 AM, Shiv Shankar Dayal < >> shi...@gm...> wrote: >> >>> Hi, >>> >>> Suppose an app is running on multiple machines then how should they >>> synchronize data? Should OpenMPI be used to do message passing to talk >>> among each other because then thread_shared will not work? >>> >>> -- >>> Respect, >>> Shiv Shankar Dayal >>> >>> >>> ------------------------------------------------------------------------------ >>> Rapidly troubleshoot problems before they affect your business. Most IT >>> organizations don't have a clear picture of how application performance >>> affects their revenue. With AppDynamics, you get 100% visibility into >>> your >>> Java,.NET, & PHP application. Start your 15-day FREE TRIAL of >>> AppDynamics Pro! >>> >>> http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk >>> _______________________________________________ >>> Cppcms-users mailing list >>> Cpp...@li... >>> https://lists.sourceforge.net/lists/listinfo/cppcms-users >>> >>> >> >> >> ------------------------------------------------------------------------------ >> Rapidly troubleshoot problems before they affect your business. Most IT >> organizations don't have a clear picture of how application performance >> affects their revenue. With AppDynamics, you get 100% visibility into your >> Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics >> Pro! >> >> http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk >> _______________________________________________ >> Cppcms-users mailing list >> Cpp...@li... >> https://lists.sourceforge.net/lists/listinfo/cppcms-users >> >> > > > -- > Respect, > Shiv Shankar Dayal > > > ------------------------------------------------------------------------------ > Rapidly troubleshoot problems before they affect your business. Most IT > organizations don't have a clear picture of how application performance > affects their revenue. With AppDynamics, you get 100% visibility into your > Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics > Pro! > http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk > _______________________________________________ > Cppcms-users mailing list > Cpp...@li... > https://lists.sourceforge.net/lists/listinfo/cppcms-users > > |
|
From: Marcel H. <ke...@co...> - 2013-12-01 00:46:05
Attachments:
signature.asc
|
On 01.12.2013 01:12, Eric Gendron wrote: > > SQL is a database... > Wrong!!! [0] > > It's almost easy to start using sql... for simple queries. > Kind of wrong! In normal application you do not use simple queries like 'SELECT * FROM users;'. > > Easy to share datas between multiple computers on a network. > Wrong. It's not easy. You have so many details to be aware of and so many configuration settings. > > Setup connexion > Open database... > Select or update query... > Close database > You don't close the database, you close the connection! Please, be accurate in you statements. > > even if you use read/write local files, I recommand using something > like sqlite, doing sql queries on local database without server. > What?! There is a huge difference between reading/writing/serving local files and using a database. Also DBMSs are only useful if you have structured data and a lot of it. Files are better for a small amount of data (like 10-20 users with a password [.htaccess/.htpasswd], but if you have >100 of them, I would recommend a DBMS). And please, do not use SQLite in your productive environment. For >10k entries the performance is really bad! Use something better, like PgSQL. Also do not start with a certain DBMS and then change later to an other, because you use hacks and non SQL-Standard statements. Even if you use strict SQL(-99), there is not guaranty that you can use your statements on an other machine. Always use the same DBMS in enviroment and productiv. Setting up a PgSQL Server is not as hard, as you might think (at least under *nix). > > For me, I found faster to dev with sql even on local database files > than on manual read/write files... > See above! Regards, Marcel [0] http://en.wikipedia.org/wiki/SQL |
|
From: Eric G. <con...@gm...> - 2013-12-01 01:15:02
|
Maybe you should modulate your words/opinion a little bit around the context of the question at first, seems to be a small app and also the fact that a person able to use an api like cppcms sure have the ability to understand sql eazily. Telling me I'm wrong about sql is a database make me suspect you are just in a mood to throll in playing with words... of course I write sql is database for short... and that was enough for the purpose of this answer to the author in this context. The long answer is sql is query langage to access datas stored in database. Any good faith person understood that I made a really short answer to go fast only to have a general idea to interest someone to go further by himself. Sqlite is faster to dev yes for local files like with qt framework for example where a direct class can connect to data without even any coding... with a model table widget for example. But this is not a subject of this mailinglist. I won't take more time to justify my answers with you anymore. Le 2013-11-30 19:46, "Marcel Hellwig" <ke...@co...> a écrit : > On 01.12.2013 01:12, Eric Gendron wrote: > > > > SQL is a database... > > > Wrong!!! [0] > > > > It's almost easy to start using sql... for simple queries. > > > Kind of wrong! In normal application you do not use simple queries like > 'SELECT * FROM users;'. > > > > Easy to share datas between multiple computers on a network. > > > Wrong. It's not easy. You have so many details to be aware of and so > many configuration settings. > > > > Setup connexion > > Open database... > > Select or update query... > > Close database > > > You don't close the database, you close the connection! Please, be > accurate in you statements. > > > > even if you use read/write local files, I recommand using something > > like sqlite, doing sql queries on local database without server. > > > What?! There is a huge difference between reading/writing/serving local > files and using a database. Also DBMSs are only useful if you have > structured data and a lot of it. Files are better for a small amount of > data (like 10-20 users with a password [.htaccess/.htpasswd], but if you > have >100 of them, I would recommend a DBMS). > And please, do not use SQLite in your productive environment. For >10k > entries the performance is really bad! Use something better, like PgSQL. > Also do not start with a certain DBMS and then change later to an other, > because you use hacks and non SQL-Standard statements. Even if you use > strict SQL(-99), there is not guaranty that you can use your statements > on an other machine. > Always use the same DBMS in enviroment and productiv. Setting up a PgSQL > Server is not as hard, as you might think (at least under *nix). > > > > For me, I found faster to dev with sql even on local database files > > than on manual read/write files... > > > See above! > > Regards, > Marcel > > [0] http://en.wikipedia.org/wiki/SQL > > > > ------------------------------------------------------------------------------ > Rapidly troubleshoot problems before they affect your business. Most IT > organizations don't have a clear picture of how application performance > affects their revenue. With AppDynamics, you get 100% visibility into your > Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics > Pro! > http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk > _______________________________________________ > Cppcms-users mailing list > Cpp...@li... > https://lists.sourceforge.net/lists/listinfo/cppcms-users > > |
|
From: Shiv S. D. <shi...@gm...> - 2013-12-01 06:00:25
|
As I said data has to be distributed and SQL databases have to be sharded which is a pain. That is because I then need to do things which I should not be doing really. I will be doing databases' job. On Sun, Dec 1, 2013 at 6:44 AM, Eric Gendron <con...@gm...> wrote: > Maybe you should modulate your words/opinion a little bit around the > context of the question at first, seems to be a small app and also the fact > that a person able to use an api like cppcms sure have the ability to > understand sql eazily. > > Telling me I'm wrong about sql is a database make me suspect you are just > in a mood to throll in playing with words... of course I write sql is > database for short... and that was enough for the purpose of this answer to > the author in this context. The long answer is sql is query langage to > access datas stored in database. > > Any good faith person understood that I made a really short answer to go > fast only to have a general idea to interest someone to go further by > himself. > > Sqlite is faster to dev yes for local files like with qt framework for > example where a direct class can connect to data without even any > coding... with a model table widget for example. But this is not a > subject of this mailinglist. > > I won't take more time to justify my answers with you anymore. > Le 2013-11-30 19:46, "Marcel Hellwig" <ke...@co...> a écrit : > >> On 01.12.2013 01:12, Eric Gendron wrote: >> > >> > SQL is a database... >> > >> Wrong!!! [0] >> > >> > It's almost easy to start using sql... for simple queries. >> > >> Kind of wrong! In normal application you do not use simple queries like >> 'SELECT * FROM users;'. >> > >> > Easy to share datas between multiple computers on a network. >> > >> Wrong. It's not easy. You have so many details to be aware of and so >> many configuration settings. >> > >> > Setup connexion >> > Open database... >> > Select or update query... >> > Close database >> > >> You don't close the database, you close the connection! Please, be >> accurate in you statements. >> > >> > even if you use read/write local files, I recommand using something >> > like sqlite, doing sql queries on local database without server. >> > >> What?! There is a huge difference between reading/writing/serving local >> files and using a database. Also DBMSs are only useful if you have >> structured data and a lot of it. Files are better for a small amount of >> data (like 10-20 users with a password [.htaccess/.htpasswd], but if you >> have >100 of them, I would recommend a DBMS). >> And please, do not use SQLite in your productive environment. For >10k >> entries the performance is really bad! Use something better, like PgSQL. >> Also do not start with a certain DBMS and then change later to an other, >> because you use hacks and non SQL-Standard statements. Even if you use >> strict SQL(-99), there is not guaranty that you can use your statements >> on an other machine. >> Always use the same DBMS in enviroment and productiv. Setting up a PgSQL >> Server is not as hard, as you might think (at least under *nix). >> > >> > For me, I found faster to dev with sql even on local database files >> > than on manual read/write files... >> > >> See above! >> >> Regards, >> Marcel >> >> [0] http://en.wikipedia.org/wiki/SQL >> >> >> >> ------------------------------------------------------------------------------ >> Rapidly troubleshoot problems before they affect your business. Most IT >> organizations don't have a clear picture of how application performance >> affects their revenue. With AppDynamics, you get 100% visibility into your >> Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics >> Pro! >> >> http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk >> _______________________________________________ >> Cppcms-users mailing list >> Cpp...@li... >> https://lists.sourceforge.net/lists/listinfo/cppcms-users >> >> > > ------------------------------------------------------------------------------ > Rapidly troubleshoot problems before they affect your business. Most IT > organizations don't have a clear picture of how application performance > affects their revenue. With AppDynamics, you get 100% visibility into your > Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics > Pro! > http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk > _______________________________________________ > Cppcms-users mailing list > Cpp...@li... > https://lists.sourceforge.net/lists/listinfo/cppcms-users > > -- Respect, Shiv Shankar Dayal |
|
From: Artyom B. <art...@ya...> - 2013-12-01 10:59:23
|
Ok guys... For sharing distributed data... Yes database is needed whatever, SQL, NoSQL or anything else. Now to scale up you need to think about many things and database architecture. There are many methods for scaling stuff up like partitioning, caching etc. Now the second thing is caching. If for every small chunk of data you'll go to SQL you'll kill your application faster. You need to use caching. CppCMS provide distributed cache systems with triggers support that helps a lot to reduce the load. Ideally, you should keep almost everything in memory. What you can, like big tables, keep in optimized database. Consistency can be easily handled with cache system. And final note: it is always better to cache output (i.e. generated HTML) as you save both HTML "rendering" time and gzip compression. Artyom Beilis -------------- CppCMS - C++ Web Framework: http://cppcms.com/ CppDB - C++ SQL Connectivity: http://cppcms.com/sql/cppdb/ -------------------------------------------- On Sun, 12/1/13, Shiv Shankar Dayal <shi...@gm...> wrote: Subject: Re: [Cppcms-users] Distributed data To: cpp...@li... Date: Sunday, December 1, 2013, 8:00 AM As I said data has to be distributed and SQL databases have to be sharded which is a pain. That is because I then need to do things which I should not be doing really. I will be doing databases' job. On Sun, Dec 1, 2013 at 6:44 AM, Eric Gendron <con...@gm...> wrote: Maybe you should modulate your words/opinion a little bit around the context of the question at first, seems to be a small app and also the fact that a person able to use an api like cppcms sure have the ability to understand sql eazily. Telling me I'm wrong about sql is a database make me suspect you are just in a mood to throll in playing with words... of course I write sql is database for short... and that was enough for the purpose of this answer to the author in this context. The long answer is sql is query langage to access datas stored in database. Any good faith person understood that I made a really short answer to go fast only to have a general idea to interest someone to go further by himself. Sqlite is faster to dev yes for local files like with qt framework for example where a direct class can connect to data without even any coding... with a model table widget for example. But this is not a subject of this mailinglist. I won't take more time to justify my answers with you anymore. Le 2013-11-30 19:46, "Marcel Hellwig" <ke...@co...> a écrit : On 01.12.2013 01:12, Eric Gendron wrote: > > SQL is a database... > Wrong!!! [0] > > It's almost easy to start using sql... for simple queries. > Kind of wrong! In normal application you do not use simple queries like 'SELECT * FROM users;'. > > Easy to share datas between multiple computers on a network. > Wrong. It's not easy. You have so many details to be aware of and so many configuration settings. > > Setup connexion > Open database... > Select or update query... > Close database > You don't close the database, you close the connection! Please, be accurate in you statements. > > even if you use read/write local files, I recommand using something > like sqlite, doing sql queries on local database without server. > What?! There is a huge difference between reading/writing/serving local files and using a database. Also DBMSs are only useful if you have structured data and a lot of it. Files are better for a small amount of data (like 10-20 users with a password [.htaccess/.htpasswd], but if you have >100 of them, I would recommend a DBMS). And please, do not use SQLite in your productive environment. For >10k entries the performance is really bad! Use something better, like PgSQL. Also do not start with a certain DBMS and then change later to an other, because you use hacks and non SQL-Standard statements. Even if you use strict SQL(-99), there is not guaranty that you can use your statements on an other machine. Always use the same DBMS in enviroment and productiv. Setting up a PgSQL Server is not as hard, as you might think (at least under *nix). > > For me, I found faster to dev with sql even on local database files > than on manual read/write files... > See above! Regards, Marcel [0] http://en.wikipedia.org/wiki/SQL ------------------------------------------------------------------------------ Rapidly troubleshoot problems before they affect your business. Most IT organizations don't have a clear picture of how application performance affects their revenue. With AppDynamics, you get 100% visibility into your Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro! http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk _______________________________________________ Cppcms-users mailing list Cpp...@li... https://lists.sourceforge.net/lists/listinfo/cppcms-users ------------------------------------------------------------------------------ Rapidly troubleshoot problems before they affect your business. Most IT organizations don't have a clear picture of how application performance affects their revenue. With AppDynamics, you get 100% visibility into your Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro! http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk _______________________________________________ Cppcms-users mailing list Cpp...@li... https://lists.sourceforge.net/lists/listinfo/cppcms-users -- Respect, Shiv Shankar Dayal -----Inline Attachment Follows----- ------------------------------------------------------------------------------ Rapidly troubleshoot problems before they affect your business. Most IT organizations don't have a clear picture of how application performance affects their revenue. With AppDynamics, you get 100% visibility into your Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro! http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk -----Inline Attachment Follows----- _______________________________________________ Cppcms-users mailing list Cpp...@li... https://lists.sourceforge.net/lists/listinfo/cppcms-users |
|
From: Shiv S. D. <shi...@gm...> - 2013-12-01 11:01:36
|
We can put Varnish in front of CppCMS/webserver for caching. Varnish speeds up thing a lot. On Sun, Dec 1, 2013 at 4:29 PM, Artyom Beilis <art...@ya...> wrote: > Ok guys... > > For sharing distributed data... Yes database is needed whatever, SQL, > NoSQL or anything else. > > Now to scale up you need to think about many things and database > architecture. There are many > methods for scaling stuff up like partitioning, caching etc. > > Now the second thing is caching. > > If for every small chunk of data you'll go to SQL you'll kill your > application faster. You need to use > caching. CppCMS provide distributed cache systems with triggers support > that helps a lot > to reduce the load. > > Ideally, you should keep almost everything in memory. What you can, like > big tables, keep in optimized > database. Consistency can be easily handled with cache system. > > And final note: it is always better to cache output (i.e. generated HTML) > as you save > both HTML "rendering" time and gzip compression. > > > Artyom Beilis > > -------------- > > CppCMS - C++ Web Framework: http://cppcms.com/ > > CppDB - C++ SQL Connectivity: http://cppcms.com/sql/cppdb/ > > -------------------------------------------- > On Sun, 12/1/13, Shiv Shankar Dayal <shi...@gm...> wrote: > > Subject: Re: [Cppcms-users] Distributed data > To: cpp...@li... > Date: Sunday, December 1, 2013, 8:00 AM > > As I said data has to be > distributed and SQL databases have to be sharded which is a > pain. That is because I then need to do things which I > should not be doing really. I will be doing databases' > job. > > > > On Sun, Dec 1, 2013 at > 6:44 AM, Eric Gendron <con...@gm...> > wrote: > > Maybe you should modulate your words/opinion a > little bit around the context of the question at first, > seems to be a small app and also the fact that a person able > to use an api like cppcms sure have the ability to > understand sql eazily. > > > Telling me I'm wrong about sql is a > database make me suspect you are just in a mood to throll in > playing with words... of course I write sql is database > for short... and that was enough for the purpose of this > answer to the author in this context. The long answer is > sql is query langage to access datas stored in database. > > > Any good faith person understood that I made a > really short answer to go fast only to have a general idea > to interest someone to go further by himself. > Sqlite is faster to dev yes for local files > like with qt framework for example where a direct class can > connect to data without even any coding... with a model > table widget for example. But this is not a subject of > this mailinglist. > > > I won't take more time to justify my > answers with you anymore. > > > Le 2013-11-30 19:46, > "Marcel Hellwig" <ke...@co...> > a écrit : > > > On 01.12.2013 01:12, Eric Gendron wrote: > > > > > > SQL is a database... > > > > > Wrong!!! [0] > > > > > > It's almost easy to start using sql... for simple > queries. > > > > > Kind of wrong! In normal application you do not use simple > queries like > > 'SELECT * FROM users;'. > > > > > > Easy to share datas between multiple computers on a > network. > > > > > Wrong. It's not easy. You have so many details to be > aware of and so > > many configuration settings. > > > > > > Setup connexion > > > Open database... > > > Select or update query... > > > Close database > > > > > You don't close the database, you close the connection! > Please, be > > accurate in you statements. > > > > > > even if you use read/write local files, I recommand > using something > > > like sqlite, doing sql queries on local database > without server. > > > > > What?! There is a huge difference between > reading/writing/serving local > > files and using a database. Also DBMSs are only useful if > you have > > structured data and a lot of it. Files are better for a > small amount of > > data (like 10-20 users with a password > [.htaccess/.htpasswd], but if you > > have >100 of them, I would recommend a DBMS). > > And please, do not use SQLite in your productive > environment. For >10k > > entries the performance is really bad! Use something better, > like PgSQL. > > Also do not start with a certain DBMS and then change later > to an other, > > because you use hacks and non SQL-Standard statements. Even > if you use > > strict SQL(-99), there is not guaranty that you can use your > statements > > on an other machine. > > Always use the same DBMS in enviroment and productiv. > Setting up a PgSQL > > Server is not as hard, as you might think (at least under > *nix). > > > > > > For me, I found faster to dev with sql even on local > database files > > > than on manual read/write files... > > > > > See above! > > > > Regards, > > Marcel > > > > [0] http://en.wikipedia.org/wiki/SQL > > > > > > ------------------------------------------------------------------------------ > > Rapidly troubleshoot problems before they affect your > business. Most IT > > organizations don't have a clear picture of how > application performance > > affects their revenue. With AppDynamics, you get 100% > visibility into your > > Java,.NET, & PHP application. Start your 15-day FREE > TRIAL of AppDynamics Pro! > > > http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk > _______________________________________________ > > > > Cppcms-users mailing list > > Cpp...@li... > > https://lists.sourceforge.net/lists/listinfo/cppcms-users > > > > > > ------------------------------------------------------------------------------ > > Rapidly troubleshoot problems before they affect your > business. Most IT > > organizations don't have a clear picture of how > application performance > > affects their revenue. With AppDynamics, you get 100% > visibility into your > > Java,.NET, & PHP application. Start your 15-day FREE > TRIAL of AppDynamics Pro! > > > http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk > _______________________________________________ > > > Cppcms-users mailing list > > Cpp...@li... > > https://lists.sourceforge.net/lists/listinfo/cppcms-users > > > > > > -- > Respect, > Shiv Shankar Dayal > > > -----Inline Attachment Follows----- > > > ------------------------------------------------------------------------------ > Rapidly troubleshoot problems before they affect your > business. Most IT > organizations don't have a clear picture of how application > performance > affects their revenue. With AppDynamics, you get 100% > visibility into your > Java,.NET, & PHP application. Start your 15-day FREE > TRIAL of AppDynamics Pro! > > http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk > -----Inline Attachment Follows----- > > _______________________________________________ > Cppcms-users mailing list > Cpp...@li... > https://lists.sourceforge.net/lists/listinfo/cppcms-users > > > > ------------------------------------------------------------------------------ > Rapidly troubleshoot problems before they affect your business. Most IT > organizations don't have a clear picture of how application performance > affects their revenue. With AppDynamics, you get 100% visibility into your > Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics > Pro! > http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk > _______________________________________________ > Cppcms-users mailing list > Cpp...@li... > https://lists.sourceforge.net/lists/listinfo/cppcms-users > -- Respect, Shiv Shankar Dayal |
|
From: Artyom B. <art...@ya...> - 2013-12-01 11:05:15
|
The problem with most of caching systems that are not connected to the framework itself is "invalidation" problem. The cache system does not know when and what to drop. Internal CppCMS cache system works both very fast and smart enough to keep the data as consistent as if it wasn't cached at all (of course with some effort on your side) Artyom Beilis -------------- CppCMS - C++ Web Framework: http://cppcms.com/ CppDB - C++ SQL Connectivity: http://cppcms.com/sql/cppdb/ -------------------------------------------- On Sun, 12/1/13, Shiv Shankar Dayal <shi...@gm...> wrote: Subject: Re: [Cppcms-users] Distributed data To: cpp...@li... Date: Sunday, December 1, 2013, 1:01 PM We can put Varnish in front of CppCMS/webserver for caching. Varnish speeds up thing a lot. On Sun, Dec 1, 2013 at 4:29 PM, Artyom Beilis <art...@ya...> wrote: Ok guys... For sharing distributed data... Yes database is needed whatever, SQL, NoSQL or anything else. Now to scale up you need to think about many things and database architecture. There are many methods for scaling stuff up like partitioning, caching etc. Now the second thing is caching. If for every small chunk of data you'll go to SQL you'll kill your application faster. You need to use caching. CppCMS provide distributed cache systems with triggers support that helps a lot to reduce the load. Ideally, you should keep almost everything in memory. What you can, like big tables, keep in optimized database. Consistency can be easily handled with cache system. And final note: it is always better to cache output (i.e. generated HTML) as you save both HTML "rendering" time and gzip compression. Artyom Beilis -------------- CppCMS - C++ Web Framework: http://cppcms.com/ CppDB - C++ SQL Connectivity: http://cppcms.com/sql/cppdb/ -------------------------------------------- On Sun, 12/1/13, Shiv Shankar Dayal <shi...@gm...> wrote: Subject: Re: [Cppcms-users] Distributed data To: cpp...@li... Date: Sunday, December 1, 2013, 8:00 AM As I said data has to be distributed and SQL databases have to be sharded which is a pain. That is because I then need to do things which I should not be doing really. I will be doing databases' job. On Sun, Dec 1, 2013 at 6:44 AM, Eric Gendron <con...@gm...> wrote: Maybe you should modulate your words/opinion a little bit around the context of the question at first, seems to be a small app and also the fact that a person able to use an api like cppcms sure have the ability to understand sql eazily. Telling me I'm wrong about sql is a database make me suspect you are just in a mood to throll in playing with words... of course I write sql is database for short... and that was enough for the purpose of this answer to the author in this context. The long answer is sql is query langage to access datas stored in database. Any good faith person understood that I made a really short answer to go fast only to have a general idea to interest someone to go further by himself. Sqlite is faster to dev yes for local files like with qt framework for example where a direct class can connect to data without even any coding... with a model table widget for example. But this is not a subject of this mailinglist. I won't take more time to justify my answers with you anymore. Le 2013-11-30 19:46, "Marcel Hellwig" <ke...@co...> a écrit : On 01.12.2013 01:12, Eric Gendron wrote: > > SQL is a database... > Wrong!!! [0] > > It's almost easy to start using sql... for simple queries. > Kind of wrong! In normal application you do not use simple queries like 'SELECT * FROM users;'. > > Easy to share datas between multiple computers on a network. > Wrong. It's not easy. You have so many details to be aware of and so many configuration settings. > > Setup connexion > Open database... > Select or update query... > Close database > You don't close the database, you close the connection! Please, be accurate in you statements. > > even if you use read/write local files, I recommand using something > like sqlite, doing sql queries on local database without server. > What?! There is a huge difference between reading/writing/serving local files and using a database. Also DBMSs are only useful if you have structured data and a lot of it. Files are better for a small amount of data (like 10-20 users with a password [.htaccess/.htpasswd], but if you have >100 of them, I would recommend a DBMS). And please, do not use SQLite in your productive environment. For >10k entries the performance is really bad! Use something better, like PgSQL. Also do not start with a certain DBMS and then change later to an other, because you use hacks and non SQL-Standard statements. Even if you use strict SQL(-99), there is not guaranty that you can use your statements on an other machine. Always use the same DBMS in enviroment and productiv. Setting up a PgSQL Server is not as hard, as you might think (at least under *nix). > > For me, I found faster to dev with sql even on local database files > than on manual read/write files... > See above! Regards, Marcel [0] http://en.wikipedia.org/wiki/SQL ------------------------------------------------------------------------------ Rapidly troubleshoot problems before they affect your business. Most IT organizations don't have a clear picture of how application performance affects their revenue. With AppDynamics, you get 100% visibility into your Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro! http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk _______________________________________________ Cppcms-users mailing list Cpp...@li... https://lists.sourceforge.net/lists/listinfo/cppcms-users ------------------------------------------------------------------------------ Rapidly troubleshoot problems before they affect your business. Most IT organizations don't have a clear picture of how application performance affects their revenue. With AppDynamics, you get 100% visibility into your Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro! http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk _______________________________________________ Cppcms-users mailing list Cpp...@li... https://lists.sourceforge.net/lists/listinfo/cppcms-users -- Respect, Shiv Shankar Dayal -----Inline Attachment Follows----- ------------------------------------------------------------------------------ Rapidly troubleshoot problems before they affect your business. Most IT organizations don't have a clear picture of how application performance affects their revenue. With AppDynamics, you get 100% visibility into your Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro! http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk -----Inline Attachment Follows----- _______________________________________________ Cppcms-users mailing list Cpp...@li... https://lists.sourceforge.net/lists/listinfo/cppcms-users ------------------------------------------------------------------------------ Rapidly troubleshoot problems before they affect your business. Most IT organizations don't have a clear picture of how application performance affects their revenue. With AppDynamics, you get 100% visibility into your Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro! http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk _______________________________________________ Cppcms-users mailing list Cpp...@li... https://lists.sourceforge.net/lists/listinfo/cppcms-users -- Respect, Shiv Shankar Dayal -----Inline Attachment Follows----- ------------------------------------------------------------------------------ Rapidly troubleshoot problems before they affect your business. Most IT organizations don't have a clear picture of how application performance affects their revenue. With AppDynamics, you get 100% visibility into your Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro! http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk -----Inline Attachment Follows----- _______________________________________________ Cppcms-users mailing list Cpp...@li... https://lists.sourceforge.net/lists/listinfo/cppcms-users |
|
From: Shiv S. D. <shi...@gm...> - 2013-12-01 11:12:35
|
Agreed on that. Also varnish requires learning of Python little bit and one more software. For dynamic content for example a user profile should always be cached with CppCMS. But something like a login page can be cached with Varnish as that is static. On Sun, Dec 1, 2013 at 4:35 PM, Artyom Beilis <art...@ya...> wrote: > The problem with most of caching systems that are not connected to the > framework itself is "invalidation" problem. > > The cache system does not know when and what to drop. > > Internal CppCMS cache system works both very fast and smart enough to keep > the data as consistent as if it wasn't cached at all > (of course with some effort on your side) > > > Artyom Beilis > > -------------- > > CppCMS - C++ Web Framework: http://cppcms.com/ > > CppDB - C++ SQL Connectivity: http://cppcms.com/sql/cppdb/ > > -------------------------------------------- > On Sun, 12/1/13, Shiv Shankar Dayal <shi...@gm...> wrote: > > Subject: Re: [Cppcms-users] Distributed data > To: cpp...@li... > Date: Sunday, December 1, 2013, 1:01 PM > > We can put Varnish in front > of CppCMS/webserver for caching. Varnish speeds up thing a > lot. > > > On Sun, Dec 1, 2013 at > 4:29 PM, Artyom Beilis <art...@ya...> > wrote: > > Ok > guys... > > > > For sharing distributed data... Yes database is needed > whatever, SQL, NoSQL or anything else. > > > > Now to scale up you need to think about many things and > database architecture. There are many > > methods for scaling stuff up like partitioning, caching > etc. > > > > Now the second thing is caching. > > > > If for every small chunk of data you'll go to SQL > you'll kill your application faster. You need to use > > caching. CppCMS provide distributed cache systems with > triggers support that helps a lot > > to reduce the load. > > > > Ideally, you should keep almost everything in memory. What > you can, like big tables, keep in optimized > > database. Consistency can be easily handled with cache > system. > > > > And final note: it is always better to cache output (i.e. > generated HTML) as you save > > both HTML "rendering" time and gzip compression. > > > > > > Artyom Beilis > > > > -------------- > > > > CppCMS - C++ Web Framework: http://cppcms.com/ > > > > CppDB - C++ SQL Connectivity: http://cppcms.com/sql/cppdb/ > > > > -------------------------------------------- > > On Sun, 12/1/13, Shiv Shankar Dayal <shi...@gm...> > wrote: > > > > Subject: Re: [Cppcms-users] Distributed data > > To: cpp...@li... > > Date: Sunday, December 1, 2013, 8:00 AM > > > > As I said data has to be > > distributed and SQL databases have to be sharded which is > a > > pain. That is because I then need to do things which I > > should not be doing really. I will be doing > databases' > > job. > > > > > > > > On Sun, Dec 1, 2013 at > > 6:44 AM, Eric Gendron <con...@gm...> > > wrote: > > > > Maybe you should modulate your words/opinion a > > little bit around the context of the question at first, > > seems to be a small app and also the fact that a person > able > > to use an api like cppcms sure have the ability to > > understand sql eazily. > > > > > > Telling me I'm wrong about sql is a > > database make me suspect you are just in a mood to throll > in > > playing with words... of course I write sql is database > > for short... and that was enough for the purpose of this > > answer to the author in this context. The long answer > is > > sql is query langage to access datas stored in database. > > > > > > Any good faith person understood that I made a > > really short answer to go fast only to have a general > idea > > to interest someone to go further by himself. > > Sqlite is faster to dev yes for local files > > like with qt framework for example where a direct class > can > > connect to data without even any coding... with a model > > table widget for example. But this is not a subject of > > this mailinglist. > > > > > > I won't take more time to justify my > > answers with you anymore. > > > > > > Le 2013-11-30 19:46, > > "Marcel Hellwig" <ke...@co...> > > a écrit : > > > > > > On 01.12.2013 01:12, Eric Gendron wrote: > > > > > > > > > > SQL is a database... > > > > > > > > > Wrong!!! [0] > > > > > > > > > > It's almost easy to start using sql... for > simple > > queries. > > > > > > > > > Kind of wrong! In normal application you do not use > simple > > queries like > > > > 'SELECT * FROM users;'. > > > > > > > > > > Easy to share datas between multiple computers on a > > network. > > > > > > > > > Wrong. It's not easy. You have so many details to be > > aware of and so > > > > many configuration settings. > > > > > > > > > > Setup connexion > > > > > Open database... > > > > > Select or update query... > > > > > Close database > > > > > > > > > You don't close the database, you close the > connection! > > Please, be > > > > accurate in you statements. > > > > > > > > > > even if you use read/write local files, I recommand > > using something > > > > > like sqlite, doing sql queries on local database > > without server. > > > > > > > > > What?! There is a huge difference between > > reading/writing/serving local > > > > files and using a database. Also DBMSs are only useful if > > you have > > > > structured data and a lot of it. Files are better for a > > small amount of > > > > data (like 10-20 users with a password > > [.htaccess/.htpasswd], but if you > > > > have >100 of them, I would recommend a DBMS). > > > > And please, do not use SQLite in your productive > > environment. For >10k > > > > entries the performance is really bad! Use something > better, > > like PgSQL. > > > > Also do not start with a certain DBMS and then change > later > > to an other, > > > > because you use hacks and non SQL-Standard statements. > Even > > if you use > > > > strict SQL(-99), there is not guaranty that you can use > your > > statements > > > > on an other machine. > > > > Always use the same DBMS in enviroment and productiv. > > Setting up a PgSQL > > > > Server is not as hard, as you might think (at least under > > *nix). > > > > > > > > > > For me, I found faster to dev with sql even on local > > database files > > > > > than on manual read/write files... > > > > > > > > > See above! > > > > > > > > Regards, > > > > Marcel > > > > > > > > [0] http://en.wikipedia.org/wiki/SQL > > > > > > > > > > > ------------------------------------------------------------------------------ > > > > Rapidly troubleshoot problems before they affect your > > business. Most IT > > > > organizations don't have a clear picture of how > > application performance > > > > affects their revenue. With AppDynamics, you get 100% > > visibility into your > > > > Java,.NET, & PHP application. Start your 15-day FREE > > TRIAL of AppDynamics Pro! > > > > > http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk > > _______________________________________________ > > > > > > > > Cppcms-users mailing list > > > > Cpp...@li... > > > > https://lists.sourceforge.net/lists/listinfo/cppcms-users > > > > > > > > > > > ------------------------------------------------------------------------------ > > > > Rapidly troubleshoot problems before they affect your > > business. Most IT > > > > organizations don't have a clear picture of how > > application performance > > > > affects their revenue. With AppDynamics, you get 100% > > visibility into your > > > > Java,.NET, & PHP application. Start your 15-day FREE > > TRIAL of AppDynamics Pro! > > > > > http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk > > _______________________________________________ > > > > > > Cppcms-users mailing list > > > > Cpp...@li... > > > > https://lists.sourceforge.net/lists/listinfo/cppcms-users > > > > > > > > > > > > -- > > Respect, > > Shiv Shankar Dayal > > > > > > -----Inline Attachment Follows----- > > > > > ------------------------------------------------------------------------------ > > Rapidly troubleshoot problems before they affect your > > business. Most IT > > organizations don't have a clear picture of how > application > > performance > > affects their revenue. With AppDynamics, you get 100% > > visibility into your > > Java,.NET, & PHP application. Start your 15-day FREE > > TRIAL of AppDynamics Pro! > > > http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk > > -----Inline Attachment Follows----- > > > > _______________________________________________ > > Cppcms-users mailing list > > Cpp...@li... > > https://lists.sourceforge.net/lists/listinfo/cppcms-users > > > > > > > ------------------------------------------------------------------------------ > > Rapidly troubleshoot problems before they affect your > business. Most IT > > organizations don't have a clear picture of how > application performance > > affects their revenue. With AppDynamics, you get 100% > visibility into your > > Java,.NET, & PHP application. Start your 15-day FREE > TRIAL of AppDynamics Pro! > > > http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk > > _______________________________________________ > > Cppcms-users mailing list > > Cpp...@li... > > https://lists.sourceforge.net/lists/listinfo/cppcms-users > > > > > -- > Respect, > Shiv Shankar Dayal > > > -----Inline Attachment Follows----- > > > ------------------------------------------------------------------------------ > Rapidly troubleshoot problems before they affect your > business. Most IT > organizations don't have a clear picture of how application > performance > affects their revenue. With AppDynamics, you get 100% > visibility into your > Java,.NET, & PHP application. Start your 15-day FREE > TRIAL of AppDynamics Pro! > > http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk > -----Inline Attachment Follows----- > > _______________________________________________ > Cppcms-users mailing list > Cpp...@li... > https://lists.sourceforge.net/lists/listinfo/cppcms-users > > > > ------------------------------------------------------------------------------ > Rapidly troubleshoot problems before they affect your business. Most IT > organizations don't have a clear picture of how application performance > affects their revenue. With AppDynamics, you get 100% visibility into your > Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics > Pro! > http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk > _______________________________________________ > Cppcms-users mailing list > Cpp...@li... > https://lists.sourceforge.net/lists/listinfo/cppcms-users > -- Respect, Shiv Shankar Dayal |
