You can subscribe to this list here.
2010 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
|
Jul
|
Aug
|
Sep
|
Oct
(1) |
Nov
(4) |
Dec
|
---|---|---|---|---|---|---|---|---|---|---|---|---|
2011 |
Jan
(1) |
Feb
|
Mar
(1) |
Apr
|
May
|
Jun
|
Jul
|
Aug
(1) |
Sep
|
Oct
|
Nov
|
Dec
|
2012 |
Jan
|
Feb
|
Mar
(17) |
Apr
(3) |
May
|
Jun
|
Jul
(1) |
Aug
|
Sep
|
Oct
|
Nov
|
Dec
(1) |
2013 |
Jan
|
Feb
(2) |
Mar
(3) |
Apr
(1) |
May
|
Jun
(1) |
Jul
(8) |
Aug
|
Sep
|
Oct
(3) |
Nov
|
Dec
|
2014 |
Jan
(1) |
Feb
|
Mar
(4) |
Apr
(3) |
May
|
Jun
(6) |
Jul
|
Aug
(1) |
Sep
|
Oct
(3) |
Nov
|
Dec
(2) |
2015 |
Jan
|
Feb
(1) |
Mar
(3) |
Apr
|
May
|
Jun
(1) |
Jul
(2) |
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
2018 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
|
Jul
|
Aug
|
Sep
|
Oct
(1) |
Nov
|
Dec
|
From: Francois-Xavier B. <fra...@ce...> - 2012-04-11 12:59:44
|
Hi all, In EsiGate version 3.2, we had a regression on "Host" http header forwarding. I just fixed the issue. I reviewed most common http headers and added lots if integration tests in order to avoid this kind of issues in the future. I also replaced "blackListedHeaders" property with "forwardRequestHeaders", "discardRequestHeaders", "forwardRequestHeaders", "discardRequestHeaders". Everything is commited in the trunk. Please let me know if you still have any issue with http headers. Regards, FX |
From: François-Xavier B. <fra...@ce...> - 2012-03-22 09:59:52
|
Hi, * Forcing queries to run one after another will be too slow, you don't know in advance if a resource is cacheable or not so if you have a page from a CMS that takes 1 s and you run queries on after another, it isnot good. * Returning an old object while it is being refreshed is a very good idea, but you cannot do that in all cases for example when the server uses different Etag header value for different versions of the same resource and only the server can decide which resource to serve to the client (http://www.w3.org/Protocols/rfc2616/rfc2616-sec14.html#sec14.26). Anyway the idea is good and can probably improve a lot the performances for static resources, you just have to study under which conditions this rule can be applied. * Copying and replacing the HashMap / TreeSet is probably the most simple and secure solution to our current problem with almost no impact on performance. Francois-Xavier Le 21/03/2012 18:32, Nicolas Richeton a écrit : > Synchronizing slows down performance unit test which fails. > We are still investigating this solution. > > But I think that rather solving concurrent calls to this hashmap, we may prevent these call somewhere higher in the code : > > If several thread are updating the same cached response, this means that we have launched at the same time several update queries for the SAME content (url+headers). > > We may : > - force queries to run one after another. > - return an old object while it is being updated. > - copy& replace hashmap / treeset instead of updating them. > > Nicolas > > Le 21 mars 2012 à 16:14, Juigne, Stephane a écrit : > >> That's exactly the fix I did, but for now test fails, I'm still investigating.... >> >> Regards >> >> -----Message d'origine----- >> De : Nicolas Richeton [mailto:nic...@gm...] >> Envoyé : mercredi 21 mars 2012 16:13 >> À : web...@li... >> Objet : Re: Webassembletool-devel Digest, Vol 2, Issue 4 >> >> Sure, I'm sending this to Stephane (watstf) so he can make the fix and send the pached package to performance environment. >> Stéphane, be sure to register to -devel list so you can reply directly :-) >> >> Nicolas >> >>> ---------------------------------------------------------------------- >>> >>> Message: 1 >>> Date: Wed, 21 Mar 2012 15:23:58 +0100 >>> From: Fran?ois-Xavier Bonnet <fra...@ce...> >>> Subject: Re: [EsiGate-devel] Thread locked under load >>> To: web...@li... >>> Message-ID:<4F6...@ce...> >>> Content-Type: text/plain; charset="iso-8859-1" >>> >>> OK, so we should wrap the TreeSet and HashMap used in Output class using >>> Collections.synchronizedSortedSet(...) and Collections.synchronizedMap(...) >>> Nicolas, can you check that it fixes the problem ? >>> >>> Le 21/03/2012 15:10, Alexis Thaveau a ?crit : >>>> http://java.dzone.com/articles/concurrency-and-hashmap >>>> >>>> Le 21/03/2012 15:08, Alexis Thaveau a ?crit : >>>>> The main bug is that headers.put is called by several threads at same >>>>> time. As you said, thread are still runnable, i think map is broken, >>>>> and result is a kind of infinite loop. >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> Le 21/03/2012 14:53, Fran?ois-Xavier Bonnet a ?crit : >>>>>> This is a real problem but do you think it can explain the 100% CPU ? >>>>>> Shouldn't we have some ConcurrentModificationException ? >>>>>> Cordialement, >>>>>> >>>>>> Fran?ois-Xavier Bonnet >>>>>> Responsable de production >>>>>> Smile - Open Source Solutions >>>>>> www.smile.fr >>>>>> T?l : +33 1 41 40 59 28 >>>>>> Fax : +33 1 47 30 25 61 >>>>>> GSM : +33 6 17 45 19 08 >>>>>> >>>>>> Le 21/03/2012 11:52, Alexis Thaveau a ?crit : >>>>>>> Hi, >>>>>>> >>>>>>> Implementation of TreeSet is not synchronized => not thread safe. >>>>>>> http://docs.oracle.com/javase/6/docs/api/java/util/TreeSet.html >>>>>>> TreeSet must be wrapped with Collections.synchronizedSortedSet || >>>>>>> <http://docs.oracle.com/javase/6/docs/api/java/util/Collections.html#synchronizedSortedSet%28java.util.SortedSet%29> >>>>>>> >>>>>>> >>>>>>> Le 21/03/2012 11:44, Nicolas Richeton a ?crit : >>>>>>>> Hi all >>>>>>>> >>>>>>>> We have an issue with with ESIGate 2.19 under load, resulting to 100% cpu usage and lock. >>>>>>>> >>>>>>>> Please have a look to : >>>>>>>> http://sourceforge.net/apps/mantisbt/webassembletool/view.php?id=84 >>>>>>>> >>>>>>>> We have the setup show the issue, but not easy to test. Problem arises after several hours. >>>>>>>> >>>>>>>> This seems to be linked to the new cache system because older versions of ESIGate did not show any locking under heavy load. >>>>>>>> >>>>>>>> Andreii : any idea/comments on this issue ? >>>>>>>> >>>>>>>> Nicolas >>>>>>>> ------------------------------------------------------------------------------ >>>>>>>> This SF email is sponsosred by: >>>>>>>> Try Windows Azure free for 90 days Click Here >>>>>>>> http://p.sf.net/sfu/sfd2d-msazure >>>>>>>> _______________________________________________ >>>>>>>> Webassembletool-devel mailing list >>>>>>>> Web...@li... >>>>>>>> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel >>>>>>> >>>>>>> -- >>>>>>> Alexis Thaveau >>>>>>> Agence Nantes >>>>>>> Smile - Open Source Solutions >>>>>>> http://www.smile.fr >>>>>>> T?l : 02 40 08 68 10 >>>>>>> Mailto :ale...@sm... >>>>>>> >>>>>>> >>>>>>> ------------------------------------------------------------------------------ >>>>>>> This SF email is sponsosred by: >>>>>>> Try Windows Azure free for 90 days Click Here >>>>>>> http://p.sf.net/sfu/sfd2d-msazure >>>>>>> >>>>>>> >>>>>>> _______________________________________________ >>>>>>> Webassembletool-devel mailing list >>>>>>> Web...@li... >>>>>>> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel >>>>>> >>>>>> ------------------------------------------------------------------------------ >>>>>> This SF email is sponsosred by: >>>>>> Try Windows Azure free for 90 days Click Here >>>>>> http://p.sf.net/sfu/sfd2d-msazure >>>>>> >>>>>> >>>>>> _______________________________________________ >>>>>> Webassembletool-devel mailing list >>>>>> Web...@li... >>>>>> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel >>>>> >>>>> -- >>>>> Alexis Thaveau >>>>> Agence Nantes >>>>> Smile - Open Source Solutions >>>>> http://www.smile.fr >>>>> T?l : 02 40 08 68 10 >>>>> Mailto :ale...@sm... >>>>> >>>>> >>>>> ------------------------------------------------------------------------------ >>>>> This SF email is sponsosred by: >>>>> Try Windows Azure free for 90 days Click Here >>>>> http://p.sf.net/sfu/sfd2d-msazure >>>>> >>>>> >>>>> _______________________________________________ >>>>> Webassembletool-devel mailing list >>>>> Web...@li... >>>>> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel >>>> >>>> -- >>>> Alexis Thaveau >>>> Agence Nantes >>>> Smile - Open Source Solutions >>>> http://www.smile.fr >>>> T?l : 02 40 08 68 10 >>>> Mailto :ale...@sm... >>>> >>>> >>>> ------------------------------------------------------------------------------ >>>> This SF email is sponsosred by: >>>> Try Windows Azure free for 90 days Click Here >>>> http://p.sf.net/sfu/sfd2d-msazure >>>> >>>> >>>> _______________________________________________ >>>> Webassembletool-devel mailing list >>>> Web...@li... >>>> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel >> >> >> >> >> >> >> This message contains information that may be privileged or confidential and is the property of the Capgemini Group. It is >> intended only for the person to whom it is addressed. If you are not the intended recipient, you are not authorized to >> read, print, retain, copy, disseminate, distribute, or use this message or any part thereof. If you receive this message >> in error, please notify the sender immediately and delete all copies of this message. >> > > ------------------------------------------------------------------------------ > This SF email is sponsosred by: > Try Windows Azure free for 90 days Click Here > http://p.sf.net/sfu/sfd2d-msazure > _______________________________________________ > Webassembletool-devel mailing list > Web...@li... > https://lists.sourceforge.net/lists/listinfo/webassembletool-devel |
From: Nicolas R. <nic...@gm...> - 2012-03-21 17:33:11
|
Synchronizing slows down performance unit test which fails. We are still investigating this solution. But I think that rather solving concurrent calls to this hashmap, we may prevent these call somewhere higher in the code : If several thread are updating the same cached response, this means that we have launched at the same time several update queries for the SAME content (url+headers). We may : - force queries to run one after another. - return an old object while it is being updated. - copy & replace hashmap / treeset instead of updating them. Nicolas Le 21 mars 2012 à 16:14, Juigne, Stephane a écrit : > That's exactly the fix I did, but for now test fails, I'm still investigating.... > > Regards > > -----Message d'origine----- > De : Nicolas Richeton [mailto:nic...@gm...] > Envoyé : mercredi 21 mars 2012 16:13 > À : web...@li... > Objet : Re: Webassembletool-devel Digest, Vol 2, Issue 4 > > Sure, I'm sending this to Stephane (watstf) so he can make the fix and send the pached package to performance environment. > Stéphane, be sure to register to -devel list so you can reply directly :-) > > Nicolas > >> >> ---------------------------------------------------------------------- >> >> Message: 1 >> Date: Wed, 21 Mar 2012 15:23:58 +0100 >> From: Fran?ois-Xavier Bonnet <fra...@ce...> >> Subject: Re: [EsiGate-devel] Thread locked under load >> To: web...@li... >> Message-ID: <4F6...@ce...> >> Content-Type: text/plain; charset="iso-8859-1" >> >> OK, so we should wrap the TreeSet and HashMap used in Output class using >> Collections.synchronizedSortedSet(...) and Collections.synchronizedMap(...) >> Nicolas, can you check that it fixes the problem ? >> >> Le 21/03/2012 15:10, Alexis Thaveau a ?crit : >>> http://java.dzone.com/articles/concurrency-and-hashmap >>> >>> Le 21/03/2012 15:08, Alexis Thaveau a ?crit : >>>> The main bug is that headers.put is called by several threads at same >>>> time. As you said, thread are still runnable, i think map is broken, >>>> and result is a kind of infinite loop. >>>> >>>> >>>> >>>> >>>> >>>> Le 21/03/2012 14:53, Fran?ois-Xavier Bonnet a ?crit : >>>>> This is a real problem but do you think it can explain the 100% CPU ? >>>>> Shouldn't we have some ConcurrentModificationException ? >>>>> Cordialement, >>>>> >>>>> Fran?ois-Xavier Bonnet >>>>> Responsable de production >>>>> Smile - Open Source Solutions >>>>> www.smile.fr >>>>> T?l : +33 1 41 40 59 28 >>>>> Fax : +33 1 47 30 25 61 >>>>> GSM : +33 6 17 45 19 08 >>>>> >>>>> Le 21/03/2012 11:52, Alexis Thaveau a ?crit : >>>>>> Hi, >>>>>> >>>>>> Implementation of TreeSet is not synchronized => not thread safe. >>>>>> http://docs.oracle.com/javase/6/docs/api/java/util/TreeSet.html >>>>>> TreeSet must be wrapped with Collections.synchronizedSortedSet || >>>>>> <http://docs.oracle.com/javase/6/docs/api/java/util/Collections.html#synchronizedSortedSet%28java.util.SortedSet%29> >>>>>> >>>>>> >>>>>> Le 21/03/2012 11:44, Nicolas Richeton a ?crit : >>>>>>> Hi all >>>>>>> >>>>>>> We have an issue with with ESIGate 2.19 under load, resulting to 100% cpu usage and lock. >>>>>>> >>>>>>> Please have a look to : >>>>>>> http://sourceforge.net/apps/mantisbt/webassembletool/view.php?id=84 >>>>>>> >>>>>>> We have the setup show the issue, but not easy to test. Problem arises after several hours. >>>>>>> >>>>>>> This seems to be linked to the new cache system because older versions of ESIGate did not show any locking under heavy load. >>>>>>> >>>>>>> Andreii : any idea/comments on this issue ? >>>>>>> >>>>>>> Nicolas >>>>>>> ------------------------------------------------------------------------------ >>>>>>> This SF email is sponsosred by: >>>>>>> Try Windows Azure free for 90 days Click Here >>>>>>> http://p.sf.net/sfu/sfd2d-msazure >>>>>>> _______________________________________________ >>>>>>> Webassembletool-devel mailing list >>>>>>> Web...@li... >>>>>>> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel >>>>>> >>>>>> >>>>>> -- >>>>>> Alexis Thaveau >>>>>> Agence Nantes >>>>>> Smile - Open Source Solutions >>>>>> http://www.smile.fr >>>>>> T?l : 02 40 08 68 10 >>>>>> Mailto :ale...@sm... >>>>>> >>>>>> >>>>>> ------------------------------------------------------------------------------ >>>>>> This SF email is sponsosred by: >>>>>> Try Windows Azure free for 90 days Click Here >>>>>> http://p.sf.net/sfu/sfd2d-msazure >>>>>> >>>>>> >>>>>> _______________________________________________ >>>>>> Webassembletool-devel mailing list >>>>>> Web...@li... >>>>>> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel >>>>> >>>>> >>>>> ------------------------------------------------------------------------------ >>>>> This SF email is sponsosred by: >>>>> Try Windows Azure free for 90 days Click Here >>>>> http://p.sf.net/sfu/sfd2d-msazure >>>>> >>>>> >>>>> _______________________________________________ >>>>> Webassembletool-devel mailing list >>>>> Web...@li... >>>>> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel >>>> >>>> >>>> -- >>>> Alexis Thaveau >>>> Agence Nantes >>>> Smile - Open Source Solutions >>>> http://www.smile.fr >>>> T?l : 02 40 08 68 10 >>>> Mailto :ale...@sm... >>>> >>>> >>>> ------------------------------------------------------------------------------ >>>> This SF email is sponsosred by: >>>> Try Windows Azure free for 90 days Click Here >>>> http://p.sf.net/sfu/sfd2d-msazure >>>> >>>> >>>> _______________________________________________ >>>> Webassembletool-devel mailing list >>>> Web...@li... >>>> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel >>> >>> >>> -- >>> Alexis Thaveau >>> Agence Nantes >>> Smile - Open Source Solutions >>> http://www.smile.fr >>> T?l : 02 40 08 68 10 >>> Mailto :ale...@sm... >>> >>> >>> ------------------------------------------------------------------------------ >>> This SF email is sponsosred by: >>> Try Windows Azure free for 90 days Click Here >>> http://p.sf.net/sfu/sfd2d-msazure >>> >>> >>> _______________________________________________ >>> Webassembletool-devel mailing list >>> Web...@li... >>> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel > > > > > > > > This message contains information that may be privileged or confidential and is the property of the Capgemini Group. It is > intended only for the person to whom it is addressed. If you are not the intended recipient, you are not authorized to > read, print, retain, copy, disseminate, distribute, or use this message or any part thereof. If you receive this message > in error, please notify the sender immediately and delete all copies of this message. > |
From: Nicolas R. <nic...@gm...> - 2012-03-21 17:33:06
|
Synchronizing slows down performance unit test which fails. We are still investigating this solution. But I think that rather solving concurrent calls to this hashmap, we may prevent these call somewhere higher in the code : If several thread are updating the same cached response, this means that we have launched at the same time several update queries for the SAME content (url+headers). We may : - force queries to run one after another. - return an old object while it is being updated. - copy & replace hashmap / treeset instead of updating them. Nicolas Le 21 mars 2012 à 16:14, Juigne, Stephane a écrit : > That's exactly the fix I did, but for now test fails, I'm still investigating.... > > Regards > > -----Message d'origine----- > De : Nicolas Richeton [mailto:nic...@gm...] > Envoyé : mercredi 21 mars 2012 16:13 > À : web...@li... > Objet : Re: Webassembletool-devel Digest, Vol 2, Issue 4 > > Sure, I'm sending this to Stephane (watstf) so he can make the fix and send the pached package to performance environment. > Stéphane, be sure to register to -devel list so you can reply directly :-) > > Nicolas > >> >> ---------------------------------------------------------------------- >> >> Message: 1 >> Date: Wed, 21 Mar 2012 15:23:58 +0100 >> From: Fran?ois-Xavier Bonnet <fra...@ce...> >> Subject: Re: [EsiGate-devel] Thread locked under load >> To: web...@li... >> Message-ID: <4F6...@ce...> >> Content-Type: text/plain; charset="iso-8859-1" >> >> OK, so we should wrap the TreeSet and HashMap used in Output class using >> Collections.synchronizedSortedSet(...) and Collections.synchronizedMap(...) >> Nicolas, can you check that it fixes the problem ? >> >> Le 21/03/2012 15:10, Alexis Thaveau a ?crit : >>> http://java.dzone.com/articles/concurrency-and-hashmap >>> >>> Le 21/03/2012 15:08, Alexis Thaveau a ?crit : >>>> The main bug is that headers.put is called by several threads at same >>>> time. As you said, thread are still runnable, i think map is broken, >>>> and result is a kind of infinite loop. >>>> >>>> >>>> >>>> >>>> >>>> Le 21/03/2012 14:53, Fran?ois-Xavier Bonnet a ?crit : >>>>> This is a real problem but do you think it can explain the 100% CPU ? >>>>> Shouldn't we have some ConcurrentModificationException ? >>>>> Cordialement, >>>>> >>>>> Fran?ois-Xavier Bonnet >>>>> Responsable de production >>>>> Smile - Open Source Solutions >>>>> www.smile.fr >>>>> T?l : +33 1 41 40 59 28 >>>>> Fax : +33 1 47 30 25 61 >>>>> GSM : +33 6 17 45 19 08 >>>>> >>>>> Le 21/03/2012 11:52, Alexis Thaveau a ?crit : >>>>>> Hi, >>>>>> >>>>>> Implementation of TreeSet is not synchronized => not thread safe. >>>>>> http://docs.oracle.com/javase/6/docs/api/java/util/TreeSet.html >>>>>> TreeSet must be wrapped with Collections.synchronizedSortedSet || >>>>>> <http://docs.oracle.com/javase/6/docs/api/java/util/Collections.html#synchronizedSortedSet%28java.util.SortedSet%29> >>>>>> >>>>>> >>>>>> Le 21/03/2012 11:44, Nicolas Richeton a ?crit : >>>>>>> Hi all >>>>>>> >>>>>>> We have an issue with with ESIGate 2.19 under load, resulting to 100% cpu usage and lock. >>>>>>> >>>>>>> Please have a look to : >>>>>>> http://sourceforge.net/apps/mantisbt/webassembletool/view.php?id=84 >>>>>>> >>>>>>> We have the setup show the issue, but not easy to test. Problem arises after several hours. >>>>>>> >>>>>>> This seems to be linked to the new cache system because older versions of ESIGate did not show any locking under heavy load. >>>>>>> >>>>>>> Andreii : any idea/comments on this issue ? >>>>>>> >>>>>>> Nicolas >>>>>>> ------------------------------------------------------------------------------ >>>>>>> This SF email is sponsosred by: >>>>>>> Try Windows Azure free for 90 days Click Here >>>>>>> http://p.sf.net/sfu/sfd2d-msazure >>>>>>> _______________________________________________ >>>>>>> Webassembletool-devel mailing list >>>>>>> Web...@li... >>>>>>> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel >>>>>> >>>>>> >>>>>> -- >>>>>> Alexis Thaveau >>>>>> Agence Nantes >>>>>> Smile - Open Source Solutions >>>>>> http://www.smile.fr >>>>>> T?l : 02 40 08 68 10 >>>>>> Mailto :ale...@sm... >>>>>> >>>>>> >>>>>> ------------------------------------------------------------------------------ >>>>>> This SF email is sponsosred by: >>>>>> Try Windows Azure free for 90 days Click Here >>>>>> http://p.sf.net/sfu/sfd2d-msazure >>>>>> >>>>>> >>>>>> _______________________________________________ >>>>>> Webassembletool-devel mailing list >>>>>> Web...@li... >>>>>> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel >>>>> >>>>> >>>>> ------------------------------------------------------------------------------ >>>>> This SF email is sponsosred by: >>>>> Try Windows Azure free for 90 days Click Here >>>>> http://p.sf.net/sfu/sfd2d-msazure >>>>> >>>>> >>>>> _______________________________________________ >>>>> Webassembletool-devel mailing list >>>>> Web...@li... >>>>> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel >>>> >>>> >>>> -- >>>> Alexis Thaveau >>>> Agence Nantes >>>> Smile - Open Source Solutions >>>> http://www.smile.fr >>>> T?l : 02 40 08 68 10 >>>> Mailto :ale...@sm... >>>> >>>> >>>> ------------------------------------------------------------------------------ >>>> This SF email is sponsosred by: >>>> Try Windows Azure free for 90 days Click Here >>>> http://p.sf.net/sfu/sfd2d-msazure >>>> >>>> >>>> _______________________________________________ >>>> Webassembletool-devel mailing list >>>> Web...@li... >>>> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel >>> >>> >>> -- >>> Alexis Thaveau >>> Agence Nantes >>> Smile - Open Source Solutions >>> http://www.smile.fr >>> T?l : 02 40 08 68 10 >>> Mailto :ale...@sm... >>> >>> >>> ------------------------------------------------------------------------------ >>> This SF email is sponsosred by: >>> Try Windows Azure free for 90 days Click Here >>> http://p.sf.net/sfu/sfd2d-msazure >>> >>> >>> _______________________________________________ >>> Webassembletool-devel mailing list >>> Web...@li... >>> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel > > > > > > > > This message contains information that may be privileged or confidential and is the property of the Capgemini Group. It is > intended only for the person to whom it is addressed. If you are not the intended recipient, you are not authorized to > read, print, retain, copy, disseminate, distribute, or use this message or any part thereof. If you receive this message > in error, please notify the sender immediately and delete all copies of this message. > |
From: Juigne, S. <ste...@ca...> - 2012-03-21 15:15:12
|
That's exactly the fix I did, but for now test fails, I'm still investigating.... Regards -----Message d'origine----- De : Nicolas Richeton [mailto:nic...@gm...] Envoyé : mercredi 21 mars 2012 16:13 À : web...@li... Objet : Re: Webassembletool-devel Digest, Vol 2, Issue 4 Sure, I'm sending this to Stephane (watstf) so he can make the fix and send the pached package to performance environment. Stéphane, be sure to register to -devel list so you can reply directly :-) Nicolas > > ---------------------------------------------------------------------- > > Message: 1 > Date: Wed, 21 Mar 2012 15:23:58 +0100 > From: Fran?ois-Xavier Bonnet <fra...@ce...> > Subject: Re: [EsiGate-devel] Thread locked under load > To: web...@li... > Message-ID: <4F6...@ce...> > Content-Type: text/plain; charset="iso-8859-1" > > OK, so we should wrap the TreeSet and HashMap used in Output class using > Collections.synchronizedSortedSet(...) and Collections.synchronizedMap(...) > Nicolas, can you check that it fixes the problem ? > > Le 21/03/2012 15:10, Alexis Thaveau a ?crit : >> http://java.dzone.com/articles/concurrency-and-hashmap >> >> Le 21/03/2012 15:08, Alexis Thaveau a ?crit : >>> The main bug is that headers.put is called by several threads at same >>> time. As you said, thread are still runnable, i think map is broken, >>> and result is a kind of infinite loop. >>> >>> >>> >>> >>> >>> Le 21/03/2012 14:53, Fran?ois-Xavier Bonnet a ?crit : >>>> This is a real problem but do you think it can explain the 100% CPU ? >>>> Shouldn't we have some ConcurrentModificationException ? >>>> Cordialement, >>>> >>>> Fran?ois-Xavier Bonnet >>>> Responsable de production >>>> Smile - Open Source Solutions >>>> www.smile.fr >>>> T?l : +33 1 41 40 59 28 >>>> Fax : +33 1 47 30 25 61 >>>> GSM : +33 6 17 45 19 08 >>>> >>>> Le 21/03/2012 11:52, Alexis Thaveau a ?crit : >>>>> Hi, >>>>> >>>>> Implementation of TreeSet is not synchronized => not thread safe. >>>>> http://docs.oracle.com/javase/6/docs/api/java/util/TreeSet.html >>>>> TreeSet must be wrapped with Collections.synchronizedSortedSet || >>>>> <http://docs.oracle.com/javase/6/docs/api/java/util/Collections.html#synchronizedSortedSet%28java.util.SortedSet%29> >>>>> >>>>> >>>>> Le 21/03/2012 11:44, Nicolas Richeton a ?crit : >>>>>> Hi all >>>>>> >>>>>> We have an issue with with ESIGate 2.19 under load, resulting to 100% cpu usage and lock. >>>>>> >>>>>> Please have a look to : >>>>>> http://sourceforge.net/apps/mantisbt/webassembletool/view.php?id=84 >>>>>> >>>>>> We have the setup show the issue, but not easy to test. Problem arises after several hours. >>>>>> >>>>>> This seems to be linked to the new cache system because older versions of ESIGate did not show any locking under heavy load. >>>>>> >>>>>> Andreii : any idea/comments on this issue ? >>>>>> >>>>>> Nicolas >>>>>> ------------------------------------------------------------------------------ >>>>>> This SF email is sponsosred by: >>>>>> Try Windows Azure free for 90 days Click Here >>>>>> http://p.sf.net/sfu/sfd2d-msazure >>>>>> _______________________________________________ >>>>>> Webassembletool-devel mailing list >>>>>> Web...@li... >>>>>> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel >>>>> >>>>> >>>>> -- >>>>> Alexis Thaveau >>>>> Agence Nantes >>>>> Smile - Open Source Solutions >>>>> http://www.smile.fr >>>>> T?l : 02 40 08 68 10 >>>>> Mailto :ale...@sm... >>>>> >>>>> >>>>> ------------------------------------------------------------------------------ >>>>> This SF email is sponsosred by: >>>>> Try Windows Azure free for 90 days Click Here >>>>> http://p.sf.net/sfu/sfd2d-msazure >>>>> >>>>> >>>>> _______________________________________________ >>>>> Webassembletool-devel mailing list >>>>> Web...@li... >>>>> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel >>>> >>>> >>>> ------------------------------------------------------------------------------ >>>> This SF email is sponsosred by: >>>> Try Windows Azure free for 90 days Click Here >>>> http://p.sf.net/sfu/sfd2d-msazure >>>> >>>> >>>> _______________________________________________ >>>> Webassembletool-devel mailing list >>>> Web...@li... >>>> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel >>> >>> >>> -- >>> Alexis Thaveau >>> Agence Nantes >>> Smile - Open Source Solutions >>> http://www.smile.fr >>> T?l : 02 40 08 68 10 >>> Mailto :ale...@sm... >>> >>> >>> ------------------------------------------------------------------------------ >>> This SF email is sponsosred by: >>> Try Windows Azure free for 90 days Click Here >>> http://p.sf.net/sfu/sfd2d-msazure >>> >>> >>> _______________________________________________ >>> Webassembletool-devel mailing list >>> Web...@li... >>> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel >> >> >> -- >> Alexis Thaveau >> Agence Nantes >> Smile - Open Source Solutions >> http://www.smile.fr >> T?l : 02 40 08 68 10 >> Mailto :ale...@sm... >> >> >> ------------------------------------------------------------------------------ >> This SF email is sponsosred by: >> Try Windows Azure free for 90 days Click Here >> http://p.sf.net/sfu/sfd2d-msazure >> >> >> _______________________________________________ >> Webassembletool-devel mailing list >> Web...@li... >> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel This message contains information that may be privileged or confidential and is the property of the Capgemini Group. It is intended only for the person to whom it is addressed. If you are not the intended recipient, you are not authorized to read, print, retain, copy, disseminate, distribute, or use this message or any part thereof. If you receive this message in error, please notify the sender immediately and delete all copies of this message. |
From: Nicolas R. <nic...@gm...> - 2012-03-21 15:13:06
|
Sure, I'm sending this to Stephane (watstf) so he can make the fix and send the pached package to performance environment. Stéphane, be sure to register to -devel list so you can reply directly :-) Nicolas > > ---------------------------------------------------------------------- > > Message: 1 > Date: Wed, 21 Mar 2012 15:23:58 +0100 > From: Fran?ois-Xavier Bonnet <fra...@ce...> > Subject: Re: [EsiGate-devel] Thread locked under load > To: web...@li... > Message-ID: <4F6...@ce...> > Content-Type: text/plain; charset="iso-8859-1" > > OK, so we should wrap the TreeSet and HashMap used in Output class using > Collections.synchronizedSortedSet(...) and Collections.synchronizedMap(...) > Nicolas, can you check that it fixes the problem ? > > Le 21/03/2012 15:10, Alexis Thaveau a ?crit : >> http://java.dzone.com/articles/concurrency-and-hashmap >> >> Le 21/03/2012 15:08, Alexis Thaveau a ?crit : >>> The main bug is that headers.put is called by several threads at same >>> time. As you said, thread are still runnable, i think map is broken, >>> and result is a kind of infinite loop. >>> >>> >>> >>> >>> >>> Le 21/03/2012 14:53, Fran?ois-Xavier Bonnet a ?crit : >>>> This is a real problem but do you think it can explain the 100% CPU ? >>>> Shouldn't we have some ConcurrentModificationException ? >>>> Cordialement, >>>> >>>> Fran?ois-Xavier Bonnet >>>> Responsable de production >>>> Smile - Open Source Solutions >>>> www.smile.fr >>>> T?l : +33 1 41 40 59 28 >>>> Fax : +33 1 47 30 25 61 >>>> GSM : +33 6 17 45 19 08 >>>> >>>> Le 21/03/2012 11:52, Alexis Thaveau a ?crit : >>>>> Hi, >>>>> >>>>> Implementation of TreeSet is not synchronized => not thread safe. >>>>> http://docs.oracle.com/javase/6/docs/api/java/util/TreeSet.html >>>>> TreeSet must be wrapped with Collections.synchronizedSortedSet || >>>>> <http://docs.oracle.com/javase/6/docs/api/java/util/Collections.html#synchronizedSortedSet%28java.util.SortedSet%29> >>>>> >>>>> >>>>> Le 21/03/2012 11:44, Nicolas Richeton a ?crit : >>>>>> Hi all >>>>>> >>>>>> We have an issue with with ESIGate 2.19 under load, resulting to 100% cpu usage and lock. >>>>>> >>>>>> Please have a look to : >>>>>> http://sourceforge.net/apps/mantisbt/webassembletool/view.php?id=84 >>>>>> >>>>>> We have the setup show the issue, but not easy to test. Problem arises after several hours. >>>>>> >>>>>> This seems to be linked to the new cache system because older versions of ESIGate did not show any locking under heavy load. >>>>>> >>>>>> Andreii : any idea/comments on this issue ? >>>>>> >>>>>> Nicolas >>>>>> ------------------------------------------------------------------------------ >>>>>> This SF email is sponsosred by: >>>>>> Try Windows Azure free for 90 days Click Here >>>>>> http://p.sf.net/sfu/sfd2d-msazure >>>>>> _______________________________________________ >>>>>> Webassembletool-devel mailing list >>>>>> Web...@li... >>>>>> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel >>>>> >>>>> >>>>> -- >>>>> Alexis Thaveau >>>>> Agence Nantes >>>>> Smile - Open Source Solutions >>>>> http://www.smile.fr >>>>> T?l : 02 40 08 68 10 >>>>> Mailto :ale...@sm... >>>>> >>>>> >>>>> ------------------------------------------------------------------------------ >>>>> This SF email is sponsosred by: >>>>> Try Windows Azure free for 90 days Click Here >>>>> http://p.sf.net/sfu/sfd2d-msazure >>>>> >>>>> >>>>> _______________________________________________ >>>>> Webassembletool-devel mailing list >>>>> Web...@li... >>>>> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel >>>> >>>> >>>> ------------------------------------------------------------------------------ >>>> This SF email is sponsosred by: >>>> Try Windows Azure free for 90 days Click Here >>>> http://p.sf.net/sfu/sfd2d-msazure >>>> >>>> >>>> _______________________________________________ >>>> Webassembletool-devel mailing list >>>> Web...@li... >>>> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel >>> >>> >>> -- >>> Alexis Thaveau >>> Agence Nantes >>> Smile - Open Source Solutions >>> http://www.smile.fr >>> T?l : 02 40 08 68 10 >>> Mailto :ale...@sm... >>> >>> >>> ------------------------------------------------------------------------------ >>> This SF email is sponsosred by: >>> Try Windows Azure free for 90 days Click Here >>> http://p.sf.net/sfu/sfd2d-msazure >>> >>> >>> _______________________________________________ >>> Webassembletool-devel mailing list >>> Web...@li... >>> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel >> >> >> -- >> Alexis Thaveau >> Agence Nantes >> Smile - Open Source Solutions >> http://www.smile.fr >> T?l : 02 40 08 68 10 >> Mailto :ale...@sm... >> >> >> ------------------------------------------------------------------------------ >> This SF email is sponsosred by: >> Try Windows Azure free for 90 days Click Here >> http://p.sf.net/sfu/sfd2d-msazure >> >> >> _______________________________________________ >> Webassembletool-devel mailing list >> Web...@li... >> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel |
From: Alexis T. <ale...@sm...> - 2012-03-21 14:43:41
|
Last year, in esigate-app-aggregator, i wrote a PerformanceTestCase (esigate-app-aggregator/src/test/java/org/esigate/test/cases/PerformanceTestCase.java) that allow to test in multithreading mode. It should be great to reproduce this issue in this test case. This test case is automatically run during a mvn install, but you can run this test by invoking *mvn integration-test. *Ouput result can be found in esigate-app-aggregator//target/failsafe-reports/org.esigate.test.cases.PerformanceTestCase.txt Le 21/03/2012 15:23, François-Xavier Bonnet a écrit : > OK, so we should wrap the TreeSet and HashMap used in Output class > using Collections.synchronizedSortedSet(...) and > Collections.synchronizedMap(...) > Nicolas, can you check that it fixes the problem ? > > Le 21/03/2012 15:10, Alexis Thaveau a écrit : >> http://java.dzone.com/articles/concurrency-and-hashmap >> >> Le 21/03/2012 15:08, Alexis Thaveau a écrit : >>> The main bug is that headers.put is called by several threads at >>> same time. As you said, thread are still runnable, i think map is >>> broken, and result is a kind of infinite loop. >>> >>> >>> >>> >>> >>> Le 21/03/2012 14:53, François-Xavier Bonnet a écrit : >>>> This is a real problem but do you think it can explain the 100% CPU ? >>>> Shouldn't we have some ConcurrentModificationException ? >>>> Cordialement, >>>> >>>> François-Xavier Bonnet >>>> Responsable de production >>>> Smile - Open Source Solutions >>>> www.smile.fr >>>> Tél : +33 1 41 40 59 28 >>>> Fax : +33 1 47 30 25 61 >>>> GSM : +33 6 17 45 19 08 >>>> >>>> Le 21/03/2012 11:52, Alexis Thaveau a écrit : >>>>> Hi, >>>>> >>>>> Implementation of TreeSet is not synchronized => not thread safe. >>>>> http://docs.oracle.com/javase/6/docs/api/java/util/TreeSet.html >>>>> TreeSet must be wrapped with Collections.synchronizedSortedSet || >>>>> <http://docs.oracle.com/javase/6/docs/api/java/util/Collections.html#synchronizedSortedSet%28java.util.SortedSet%29> >>>>> >>>>> >>>>> Le 21/03/2012 11:44, Nicolas Richeton a écrit : >>>>>> Hi all >>>>>> >>>>>> We have an issue with with ESIGate 2.19 under load, resulting to 100% cpu usage and lock. >>>>>> >>>>>> Please have a look to : >>>>>> http://sourceforge.net/apps/mantisbt/webassembletool/view.php?id=84 >>>>>> >>>>>> We have the setup show the issue, but not easy to test. Problem arises after several hours. >>>>>> >>>>>> This seems to be linked to the new cache system because older versions of ESIGate did not show any locking under heavy load. >>>>>> >>>>>> Andreii : any idea/comments on this issue ? >>>>>> >>>>>> Nicolas >>>>>> ------------------------------------------------------------------------------ >>>>>> This SF email is sponsosred by: >>>>>> Try Windows Azure free for 90 days Click Here >>>>>> http://p.sf.net/sfu/sfd2d-msazure >>>>>> _______________________________________________ >>>>>> Webassembletool-devel mailing list >>>>>> Web...@li... >>>>>> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel >>>>> >>>>> >>>>> -- >>>>> Alexis Thaveau >>>>> Agence Nantes >>>>> Smile - Open Source Solutions >>>>> http://www.smile.fr >>>>> Tél : 02 40 08 68 10 >>>>> Mailto :ale...@sm... >>>>> >>>>> >>>>> ------------------------------------------------------------------------------ >>>>> This SF email is sponsosred by: >>>>> Try Windows Azure free for 90 days Click Here >>>>> http://p.sf.net/sfu/sfd2d-msazure >>>>> >>>>> >>>>> _______________________________________________ >>>>> Webassembletool-devel mailing list >>>>> Web...@li... >>>>> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel >>>> >>>> >>>> ------------------------------------------------------------------------------ >>>> This SF email is sponsosred by: >>>> Try Windows Azure free for 90 days Click Here >>>> http://p.sf.net/sfu/sfd2d-msazure >>>> >>>> >>>> _______________________________________________ >>>> Webassembletool-devel mailing list >>>> Web...@li... >>>> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel >>> >>> >>> -- >>> Alexis Thaveau >>> Agence Nantes >>> Smile - Open Source Solutions >>> http://www.smile.fr >>> Tél : 02 40 08 68 10 >>> Mailto :ale...@sm... >>> >>> >>> ------------------------------------------------------------------------------ >>> This SF email is sponsosred by: >>> Try Windows Azure free for 90 days Click Here >>> http://p.sf.net/sfu/sfd2d-msazure >>> >>> >>> _______________________________________________ >>> Webassembletool-devel mailing list >>> Web...@li... >>> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel >> >> >> -- >> Alexis Thaveau >> Agence Nantes >> Smile - Open Source Solutions >> http://www.smile.fr >> Tél : 02 40 08 68 10 >> Mailto :ale...@sm... >> >> >> ------------------------------------------------------------------------------ >> This SF email is sponsosred by: >> Try Windows Azure free for 90 days Click Here >> http://p.sf.net/sfu/sfd2d-msazure >> >> >> _______________________________________________ >> Webassembletool-devel mailing list >> Web...@li... >> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel > > > ------------------------------------------------------------------------------ > This SF email is sponsosred by: > Try Windows Azure free for 90 days Click Here > http://p.sf.net/sfu/sfd2d-msazure > > > _______________________________________________ > Webassembletool-devel mailing list > Web...@li... > https://lists.sourceforge.net/lists/listinfo/webassembletool-devel -- Alexis Thaveau Agence Nantes Smile - Open Source Solutions http://www.smile.fr Tél : 02 40 08 68 10 Mailto : ale...@sm... |
From: François-Xavier B. <fra...@ce...> - 2012-03-21 14:24:13
|
OK, so we should wrap the TreeSet and HashMap used in Output class using Collections.synchronizedSortedSet(...) and Collections.synchronizedMap(...) Nicolas, can you check that it fixes the problem ? Le 21/03/2012 15:10, Alexis Thaveau a écrit : > http://java.dzone.com/articles/concurrency-and-hashmap > > Le 21/03/2012 15:08, Alexis Thaveau a écrit : >> The main bug is that headers.put is called by several threads at same >> time. As you said, thread are still runnable, i think map is broken, >> and result is a kind of infinite loop. >> >> >> >> >> >> Le 21/03/2012 14:53, François-Xavier Bonnet a écrit : >>> This is a real problem but do you think it can explain the 100% CPU ? >>> Shouldn't we have some ConcurrentModificationException ? >>> Cordialement, >>> >>> François-Xavier Bonnet >>> Responsable de production >>> Smile - Open Source Solutions >>> www.smile.fr >>> Tél : +33 1 41 40 59 28 >>> Fax : +33 1 47 30 25 61 >>> GSM : +33 6 17 45 19 08 >>> >>> Le 21/03/2012 11:52, Alexis Thaveau a écrit : >>>> Hi, >>>> >>>> Implementation of TreeSet is not synchronized => not thread safe. >>>> http://docs.oracle.com/javase/6/docs/api/java/util/TreeSet.html >>>> TreeSet must be wrapped with Collections.synchronizedSortedSet || >>>> <http://docs.oracle.com/javase/6/docs/api/java/util/Collections.html#synchronizedSortedSet%28java.util.SortedSet%29> >>>> >>>> >>>> Le 21/03/2012 11:44, Nicolas Richeton a écrit : >>>>> Hi all >>>>> >>>>> We have an issue with with ESIGate 2.19 under load, resulting to 100% cpu usage and lock. >>>>> >>>>> Please have a look to : >>>>> http://sourceforge.net/apps/mantisbt/webassembletool/view.php?id=84 >>>>> >>>>> We have the setup show the issue, but not easy to test. Problem arises after several hours. >>>>> >>>>> This seems to be linked to the new cache system because older versions of ESIGate did not show any locking under heavy load. >>>>> >>>>> Andreii : any idea/comments on this issue ? >>>>> >>>>> Nicolas >>>>> ------------------------------------------------------------------------------ >>>>> This SF email is sponsosred by: >>>>> Try Windows Azure free for 90 days Click Here >>>>> http://p.sf.net/sfu/sfd2d-msazure >>>>> _______________________________________________ >>>>> Webassembletool-devel mailing list >>>>> Web...@li... >>>>> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel >>>> >>>> >>>> -- >>>> Alexis Thaveau >>>> Agence Nantes >>>> Smile - Open Source Solutions >>>> http://www.smile.fr >>>> Tél : 02 40 08 68 10 >>>> Mailto :ale...@sm... >>>> >>>> >>>> ------------------------------------------------------------------------------ >>>> This SF email is sponsosred by: >>>> Try Windows Azure free for 90 days Click Here >>>> http://p.sf.net/sfu/sfd2d-msazure >>>> >>>> >>>> _______________________________________________ >>>> Webassembletool-devel mailing list >>>> Web...@li... >>>> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel >>> >>> >>> ------------------------------------------------------------------------------ >>> This SF email is sponsosred by: >>> Try Windows Azure free for 90 days Click Here >>> http://p.sf.net/sfu/sfd2d-msazure >>> >>> >>> _______________________________________________ >>> Webassembletool-devel mailing list >>> Web...@li... >>> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel >> >> >> -- >> Alexis Thaveau >> Agence Nantes >> Smile - Open Source Solutions >> http://www.smile.fr >> Tél : 02 40 08 68 10 >> Mailto :ale...@sm... >> >> >> ------------------------------------------------------------------------------ >> This SF email is sponsosred by: >> Try Windows Azure free for 90 days Click Here >> http://p.sf.net/sfu/sfd2d-msazure >> >> >> _______________________________________________ >> Webassembletool-devel mailing list >> Web...@li... >> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel > > > -- > Alexis Thaveau > Agence Nantes > Smile - Open Source Solutions > http://www.smile.fr > Tél : 02 40 08 68 10 > Mailto :ale...@sm... > > > ------------------------------------------------------------------------------ > This SF email is sponsosred by: > Try Windows Azure free for 90 days Click Here > http://p.sf.net/sfu/sfd2d-msazure > > > _______________________________________________ > Webassembletool-devel mailing list > Web...@li... > https://lists.sourceforge.net/lists/listinfo/webassembletool-devel |
From: Alexis T. <ale...@sm...> - 2012-03-21 14:10:29
|
http://java.dzone.com/articles/concurrency-and-hashmap Le 21/03/2012 15:08, Alexis Thaveau a écrit : > The main bug is that headers.put is called by several threads at same > time. As you said, thread are still runnable, i think map is broken, > and result is a kind of infinite loop. > > > > > > Le 21/03/2012 14:53, François-Xavier Bonnet a écrit : >> This is a real problem but do you think it can explain the 100% CPU ? >> Shouldn't we have some ConcurrentModificationException ? >> Cordialement, >> >> François-Xavier Bonnet >> Responsable de production >> Smile - Open Source Solutions >> www.smile.fr >> Tél : +33 1 41 40 59 28 >> Fax : +33 1 47 30 25 61 >> GSM : +33 6 17 45 19 08 >> >> Le 21/03/2012 11:52, Alexis Thaveau a écrit : >>> Hi, >>> >>> Implementation of TreeSet is not synchronized => not thread safe. >>> http://docs.oracle.com/javase/6/docs/api/java/util/TreeSet.html >>> TreeSet must be wrapped with Collections.synchronizedSortedSet || >>> <http://docs.oracle.com/javase/6/docs/api/java/util/Collections.html#synchronizedSortedSet%28java.util.SortedSet%29> >>> >>> >>> Le 21/03/2012 11:44, Nicolas Richeton a écrit : >>>> Hi all >>>> >>>> We have an issue with with ESIGate 2.19 under load, resulting to 100% cpu usage and lock. >>>> >>>> Please have a look to : >>>> http://sourceforge.net/apps/mantisbt/webassembletool/view.php?id=84 >>>> >>>> We have the setup show the issue, but not easy to test. Problem arises after several hours. >>>> >>>> This seems to be linked to the new cache system because older versions of ESIGate did not show any locking under heavy load. >>>> >>>> Andreii : any idea/comments on this issue ? >>>> >>>> Nicolas >>>> ------------------------------------------------------------------------------ >>>> This SF email is sponsosred by: >>>> Try Windows Azure free for 90 days Click Here >>>> http://p.sf.net/sfu/sfd2d-msazure >>>> _______________________________________________ >>>> Webassembletool-devel mailing list >>>> Web...@li... >>>> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel >>> >>> >>> -- >>> Alexis Thaveau >>> Agence Nantes >>> Smile - Open Source Solutions >>> http://www.smile.fr >>> Tél : 02 40 08 68 10 >>> Mailto :ale...@sm... >>> >>> >>> ------------------------------------------------------------------------------ >>> This SF email is sponsosred by: >>> Try Windows Azure free for 90 days Click Here >>> http://p.sf.net/sfu/sfd2d-msazure >>> >>> >>> _______________________________________________ >>> Webassembletool-devel mailing list >>> Web...@li... >>> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel >> >> >> ------------------------------------------------------------------------------ >> This SF email is sponsosred by: >> Try Windows Azure free for 90 days Click Here >> http://p.sf.net/sfu/sfd2d-msazure >> >> >> _______________________________________________ >> Webassembletool-devel mailing list >> Web...@li... >> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel > > > -- > Alexis Thaveau > Agence Nantes > Smile - Open Source Solutions > http://www.smile.fr > Tél : 02 40 08 68 10 > Mailto :ale...@sm... > > > ------------------------------------------------------------------------------ > This SF email is sponsosred by: > Try Windows Azure free for 90 days Click Here > http://p.sf.net/sfu/sfd2d-msazure > > > _______________________________________________ > Webassembletool-devel mailing list > Web...@li... > https://lists.sourceforge.net/lists/listinfo/webassembletool-devel -- Alexis Thaveau Agence Nantes Smile - Open Source Solutions http://www.smile.fr Tél : 02 40 08 68 10 Mailto : ale...@sm... |
From: Alexis T. <ale...@sm...> - 2012-03-21 14:08:42
|
The main bug is that headers.put is called by several threads at same time. As you said, thread are still runnable, i think map is broken, and result is a kind of infinite loop. Le 21/03/2012 14:53, François-Xavier Bonnet a écrit : > This is a real problem but do you think it can explain the 100% CPU ? > Shouldn't we have some ConcurrentModificationException ? > Cordialement, > > François-Xavier Bonnet > Responsable de production > Smile - Open Source Solutions > www.smile.fr > Tél : +33 1 41 40 59 28 > Fax : +33 1 47 30 25 61 > GSM : +33 6 17 45 19 08 > > Le 21/03/2012 11:52, Alexis Thaveau a écrit : >> Hi, >> >> Implementation of TreeSet is not synchronized => not thread safe. >> http://docs.oracle.com/javase/6/docs/api/java/util/TreeSet.html >> TreeSet must be wrapped with Collections.synchronizedSortedSet || >> <http://docs.oracle.com/javase/6/docs/api/java/util/Collections.html#synchronizedSortedSet%28java.util.SortedSet%29> >> >> >> Le 21/03/2012 11:44, Nicolas Richeton a écrit : >>> Hi all >>> >>> We have an issue with with ESIGate 2.19 under load, resulting to 100% cpu usage and lock. >>> >>> Please have a look to : >>> http://sourceforge.net/apps/mantisbt/webassembletool/view.php?id=84 >>> >>> We have the setup show the issue, but not easy to test. Problem arises after several hours. >>> >>> This seems to be linked to the new cache system because older versions of ESIGate did not show any locking under heavy load. >>> >>> Andreii : any idea/comments on this issue ? >>> >>> Nicolas >>> ------------------------------------------------------------------------------ >>> This SF email is sponsosred by: >>> Try Windows Azure free for 90 days Click Here >>> http://p.sf.net/sfu/sfd2d-msazure >>> _______________________________________________ >>> Webassembletool-devel mailing list >>> Web...@li... >>> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel >> >> >> -- >> Alexis Thaveau >> Agence Nantes >> Smile - Open Source Solutions >> http://www.smile.fr >> Tél : 02 40 08 68 10 >> Mailto :ale...@sm... >> >> >> ------------------------------------------------------------------------------ >> This SF email is sponsosred by: >> Try Windows Azure free for 90 days Click Here >> http://p.sf.net/sfu/sfd2d-msazure >> >> >> _______________________________________________ >> Webassembletool-devel mailing list >> Web...@li... >> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel > > > ------------------------------------------------------------------------------ > This SF email is sponsosred by: > Try Windows Azure free for 90 days Click Here > http://p.sf.net/sfu/sfd2d-msazure > > > _______________________________________________ > Webassembletool-devel mailing list > Web...@li... > https://lists.sourceforge.net/lists/listinfo/webassembletool-devel -- Alexis Thaveau Agence Nantes Smile - Open Source Solutions http://www.smile.fr Tél : 02 40 08 68 10 Mailto : ale...@sm... |
From: François-Xavier B. <fra...@sm...> - 2012-03-21 13:53:11
|
This is a real problem but do you think it can explain the 100% CPU ? Shouldn't we have some ConcurrentModificationException ? Cordialement, François-Xavier Bonnet Responsable de production Smile - Open Source Solutions www.smile.fr Tél : +33 1 41 40 59 28 Fax : +33 1 47 30 25 61 GSM : +33 6 17 45 19 08 Le 21/03/2012 11:52, Alexis Thaveau a écrit : > Hi, > > Implementation of TreeSet is not synchronized => not thread safe. > http://docs.oracle.com/javase/6/docs/api/java/util/TreeSet.html > TreeSet must be wrapped with Collections.synchronizedSortedSet || > <http://docs.oracle.com/javase/6/docs/api/java/util/Collections.html#synchronizedSortedSet%28java.util.SortedSet%29> > > > Le 21/03/2012 11:44, Nicolas Richeton a écrit : >> Hi all >> >> We have an issue with with ESIGate 2.19 under load, resulting to 100% cpu usage and lock. >> >> Please have a look to : >> http://sourceforge.net/apps/mantisbt/webassembletool/view.php?id=84 >> >> We have the setup show the issue, but not easy to test. Problem arises after several hours. >> >> This seems to be linked to the new cache system because older versions of ESIGate did not show any locking under heavy load. >> >> Andreii : any idea/comments on this issue ? >> >> Nicolas >> ------------------------------------------------------------------------------ >> This SF email is sponsosred by: >> Try Windows Azure free for 90 days Click Here >> http://p.sf.net/sfu/sfd2d-msazure >> _______________________________________________ >> Webassembletool-devel mailing list >> Web...@li... >> https://lists.sourceforge.net/lists/listinfo/webassembletool-devel > > > -- > Alexis Thaveau > Agence Nantes > Smile - Open Source Solutions > http://www.smile.fr > Tél : 02 40 08 68 10 > Mailto :ale...@sm... > > > ------------------------------------------------------------------------------ > This SF email is sponsosred by: > Try Windows Azure free for 90 days Click Here > http://p.sf.net/sfu/sfd2d-msazure > > > _______________________________________________ > Webassembletool-devel mailing list > Web...@li... > https://lists.sourceforge.net/lists/listinfo/webassembletool-devel |
From: Alexis T. <ale...@sm...> - 2012-03-21 12:37:02
|
By the way, It's really strange to do a foreach in order to retrieve key/values in a map. Le 21/03/2012 12:40, anleb a écrit : > Hello, > Probably, it was broken in revision #611 > class net.webassembletool.output.Output > revision 610 code > > public final void addHeader(String name, String value) { > headers.put(name, value); > } > > revision 611 code > > public final void addHeader(String name, String value) { > List<String> values = null; > for (Entry<String, List<String>> entry : headers.entrySet()) { > if (name.equalsIgnoreCase(entry.getKey())) { > values = entry.getValue(); > break; > } > } > if (values == null) { > values = new ArrayList<String>(); > headers.put(name, values); > } > values.add(value); > } > > So in the same method we do iteration over headers and change them, in > multi thread environment this can cause problem. > The easiest way to fix it, to add 'synchronized' to follow methods in > class net.webassembletool.output.Output: > public synchronized final String getHeader(String key) > public synchronized final void setHeader(String key, String value) > public synchronized final void setHeader(String key, String value) > > On 03/21/2012 12:44 PM, Nicolas Richeton wrote: >> Hi all >> >> We have an issue with with ESIGate 2.19 under load, resulting to 100% cpu usage and lock. >> >> Please have a look to : >> http://sourceforge.net/apps/mantisbt/webassembletool/view.php?id=84 >> >> We have the setup show the issue, but not easy to test. Problem arises after several hours. >> >> This seems to be linked to the new cache system because older versions of ESIGate did not show any locking under heavy load. >> >> Andreii : any idea/comments on this issue ? >> >> Nicolas > > > -- > Best Regards, > Andrei Lebedinskiy, > Java Web Developer > Smile Ukraine - Open source Solutions in Ukraine > www.smile-ukraine.com > Skype:lebedinskii > E-mail:an...@sm... > > > ------------------------------------------------------------------------------ > This SF email is sponsosred by: > Try Windows Azure free for 90 days Click Here > http://p.sf.net/sfu/sfd2d-msazure > > > _______________________________________________ > Webassembletool-devel mailing list > Web...@li... > https://lists.sourceforge.net/lists/listinfo/webassembletool-devel -- Alexis Thaveau Agence Nantes Smile - Open Source Solutions http://www.smile.fr Tél : 02 40 08 68 10 Mailto : ale...@sm... |
From: anleb <an...@sm...> - 2012-03-21 11:40:17
|
Hello, Probably, it was broken in revision #611 class net.webassembletool.output.Output revision 610 code public final void addHeader(String name, String value) { headers.put(name, value); } revision 611 code public final void addHeader(String name, String value) { List<String> values = null; for (Entry<String, List<String>> entry : headers.entrySet()) { if (name.equalsIgnoreCase(entry.getKey())) { values = entry.getValue(); break; } } if (values == null) { values = new ArrayList<String>(); headers.put(name, values); } values.add(value); } So in the same method we do iteration over headers and change them, in multi thread environment this can cause problem. The easiest way to fix it, to add 'synchronized' to follow methods in class net.webassembletool.output.Output: public synchronized final String getHeader(String key) public synchronized final void setHeader(String key, String value) public synchronized final void setHeader(String key, String value) On 03/21/2012 12:44 PM, Nicolas Richeton wrote: > Hi all > > We have an issue with with ESIGate 2.19 under load, resulting to 100% cpu usage and lock. > > Please have a look to : > http://sourceforge.net/apps/mantisbt/webassembletool/view.php?id=84 > > We have the setup show the issue, but not easy to test. Problem arises after several hours. > > This seems to be linked to the new cache system because older versions of ESIGate did not show any locking under heavy load. > > Andreii : any idea/comments on this issue ? > > Nicolas -- Best Regards, Andrei Lebedinskiy, Java Web Developer Smile Ukraine - Open source Solutions in Ukraine www.smile-ukraine.com Skype:lebedinskii E-mail:an...@sm... |
From: François-Xavier B. <fra...@ce...> - 2012-03-21 11:21:03
|
Hi, The 2 threads you show on the ticket seam to be RUNNABLE. Could you attach a complete thread dump in order to check which threads are locked and which one is locking the others? Francois-Xavier Le 21/03/2012 11:44, Nicolas Richeton a écrit : > Hi all > > We have an issue with with ESIGate 2.19 under load, resulting to 100% cpu usage and lock. > > Please have a look to : > http://sourceforge.net/apps/mantisbt/webassembletool/view.php?id=84 > > We have the setup show the issue, but not easy to test. Problem arises after several hours. > > This seems to be linked to the new cache system because older versions of ESIGate did not show any locking under heavy load. > > Andreii : any idea/comments on this issue ? > > Nicolas > ------------------------------------------------------------------------------ > This SF email is sponsosred by: > Try Windows Azure free for 90 days Click Here > http://p.sf.net/sfu/sfd2d-msazure > _______________________________________________ > Webassembletool-devel mailing list > Web...@li... > https://lists.sourceforge.net/lists/listinfo/webassembletool-devel |
From: Alexis T. <ale...@sm...> - 2012-03-21 11:18:55
|
Hi, Implementation of TreeSet is not synchronized => not thread safe. http://docs.oracle.com/javase/6/docs/api/java/util/TreeSet.html TreeSet must be wrapped with Collections.synchronizedSortedSet || <http://docs.oracle.com/javase/6/docs/api/java/util/Collections.html#synchronizedSortedSet%28java.util.SortedSet%29> Le 21/03/2012 11:44, Nicolas Richeton a écrit : > Hi all > > We have an issue with with ESIGate 2.19 under load, resulting to 100% cpu usage and lock. > > Please have a look to : > http://sourceforge.net/apps/mantisbt/webassembletool/view.php?id=84 > > We have the setup show the issue, but not easy to test. Problem arises after several hours. > > This seems to be linked to the new cache system because older versions of ESIGate did not show any locking under heavy load. > > Andreii : any idea/comments on this issue ? > > Nicolas > ------------------------------------------------------------------------------ > This SF email is sponsosred by: > Try Windows Azure free for 90 days Click Here > http://p.sf.net/sfu/sfd2d-msazure > _______________________________________________ > Webassembletool-devel mailing list > Web...@li... > https://lists.sourceforge.net/lists/listinfo/webassembletool-devel -- Alexis Thaveau Agence Nantes Smile - Open Source Solutions http://www.smile.fr Tél : 02 40 08 68 10 Mailto : ale...@sm... |
From: Nicolas R. <nic...@gm...> - 2012-03-21 10:44:25
|
Hi all We have an issue with with ESIGate 2.19 under load, resulting to 100% cpu usage and lock. Please have a look to : http://sourceforge.net/apps/mantisbt/webassembletool/view.php?id=84 We have the setup show the issue, but not easy to test. Problem arises after several hours. This seems to be linked to the new cache system because older versions of ESIGate did not show any locking under heavy load. Andreii : any idea/comments on this issue ? Nicolas |
From: François-Xavier B. <fra...@ce...> - 2012-03-12 10:15:59
|
Hi Sylvain, I just gave you the developer privileges on MantisBT. You should be able to assign and resolve the issues now. Le 12/03/2012 09:57, syl...@or... a écrit : > Dear EsiGate's community, > > I recently joined the community thanks to François-Xavier Bonnet. I > have commited this morning my firsts contributions on the project. The > corresponding Mantis issues are : > http://sourceforge.net/apps/mantisbt/webassembletool/view.php?id=79 > http://sourceforge.net/apps/mantisbt/webassembletool/view.php?id=80 > http://sourceforge.net/apps/mantisbt/webassembletool/view.php?id=81 > http://sourceforge.net/apps/mantisbt/webassembletool/view.php?id=82 > > Since my mantis user has the reporter role, I cannot affect and > resolve my issues. Maybe someone can do it for me or give my user the > appropriate privileges. > > The features I have commited had been discussed with François-Xavier > some days ago, but I am still interested in some reviews on my code to > let me know if my contributions meets the project's coding rules and > roadmap. > > Cheers, > Sylvain Sicard > > _________________________________________________________________________________________________________________________ > > Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc > pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler > a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration, > France Telecom - Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci. > > This message and its attachments may contain confidential or privileged information that may be protected by law; > they should not be distributed, used or copied without authorisation. > If you have received this email in error, please notify the sender and delete this message and its attachments. > As emails may be altered, France Telecom - Orange is not liable for messages that have been modified, changed or falsified. > Thank you. > > > ------------------------------------------------------------------------------ > Try before you buy = See our experts in action! > The most comprehensive online learning library for Microsoft developers > is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, > Metro Style Apps, more. Free future releases when you subscribe now! > http://p.sf.net/sfu/learndevnow-dev2 > > > _______________________________________________ > Webassembletool-devel mailing list > Web...@li... > https://lists.sourceforge.net/lists/listinfo/webassembletool-devel |
From: <syl...@or...> - 2012-03-12 08:57:20
|
Dear EsiGate's community, I recently joined the community thanks to François-Xavier Bonnet. I have commited this morning my firsts contributions on the project. The corresponding Mantis issues are : http://sourceforge.net/apps/mantisbt/webassembletool/view.php?id=79 http://sourceforge.net/apps/mantisbt/webassembletool/view.php?id=80 http://sourceforge.net/apps/mantisbt/webassembletool/view.php?id=81 http://sourceforge.net/apps/mantisbt/webassembletool/view.php?id=82 Since my mantis user has the reporter role, I cannot affect and resolve my issues. Maybe someone can do it for me or give my user the appropriate privileges. The features I have commited had been discussed with François-Xavier some days ago, but I am still interested in some reviews on my code to let me know if my contributions meets the project's coding rules and roadmap. Cheers, Sylvain Sicard _________________________________________________________________________________________________________________________ Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration, France Telecom - Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci. This message and its attachments may contain confidential or privileged information that may be protected by law; they should not be distributed, used or copied without authorisation. If you have received this email in error, please notify the sender and delete this message and its attachments. As emails may be altered, France Telecom - Orange is not liable for messages that have been modified, changed or falsified. Thank you. |
From: François-Xavier B. <fx....@gm...> - 2011-08-19 09:06:18
|
Hi all, I just released ESIGate 2.19 In this version: - Upgraded to HttpClient 4.1 - Fix on Http pool - Cookie forwarding now supports deletion, domains and preserveHost - No more SocketException in logs in case of a ClientAbort Next version will be 3.0 |
From: François-Xavier B. <fx....@gm...> - 2011-03-24 15:58:34
|
Hi all, I have made a comparison between what can be done with the jsp taglib and the aggregator. As ESI support is almost complete, I also compared to what can be done with ESI. I have put all that in a big table in the wiki. There are a lot of functionalities in common but the syntax is quite different, for example to include a page : * taglib: <w:includeblock page="..." /> * aggregator: <!--$includeblock$aggregated2$block.html$myblock$--> * esi: <esi:include src="..." /> I think it would be much more easy for ESIGate users to have a unified syntax. So I added to the table a last column with a proposal for a new syntax for each functionality. The syntax is ESI when the functionality exists in ESI, some extra functionalities are inspired by Akamai ESI extensions and other extensions are proper pour ESIGate but all the tags are prefixed with <esi: (like they do in Akamai). We could continue support for older syntax but only consider it as deprecated. The table is here: https://sourceforge.net/apps/mediawiki/webassembletool/index.php?title=ESI_syntax_and_ESIGate_extensions So what do you think about it ? |
From: Philippe De O. <phi...@gm...> - 2011-01-24 12:39:21
|
Hi everyone, In order to deploy ESIGate to the Maven central repository, we must sign the artifacts. I configured the pom.xml to do so. You'll find all the info about signing artifacts at : https://docs.sonatype.org/display/Repository/How+To+Generate+PGP+Signatures+With+Maven regards, -- Philippe De Oliveira Afin de contribuer au respect de l'environnement, merci de n'imprimer ce mail qu'en cas de nécessité |
From: Nicolas R. <nic...@fr...> - 2010-11-30 17:48:12
|
Le 30 nov. 2010 à 16:22, Philippe De Oliveira a écrit : > Hi, > > Good idea. I don't think ESIGate fit in any of java-sources.net category. Maybe in Open source Template Engines. But we're not doing the same as the frameworks already present in this category. Same idea. Too bad we cannot select more categories :-) > > The summary can be the one written on www.esigate.org : "ESIGate is a toolkit developped to help developpers to integrate existing web applications and aggregate them as a single website.". Seems pretty good to me. I would add something about CMS integration, Remote templating, ESI reverse proxy and langage/framework compatibility. This summary is really good when you understand what you can do with ESIGate, but I think it's just too generic to make someone think "this is w(h)at I need for my project" :-) I updated the website this way. See http://www.esigate.org -- Nicolas > > On Tue, Nov 30, 2010 at 16:14, Nicolas Richeton <nic...@fr...> wrote: > Hi all, > > I believe that adding ESIGate to well-known lists of frameworks, as java-source.net[1], could help building a community. The question is : in which category falls ESIGate ? > We would have to write a nice summary with some real-world usage (not just "I'm a ESI reverse-proxy" which misses most of the value of this framework). > > Any ideas ? > > -- > Nicolas > > [1] http://java-source.net/open-source/ > ------------------------------------------------------------------------------ > Increase Visibility of Your 3D Game App & Earn a Chance To Win $500! > Tap into the largest installed PC base & get more eyes on your game by > optimizing for Intel(R) Graphics Technology. Get started today with the > Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs. > http://p.sf.net/sfu/intelisp-dev2dev > _______________________________________________ > Webassembletool-devel mailing list > Web...@li... > https://lists.sourceforge.net/lists/listinfo/webassembletool-devel > > > > -- > Philippe De Oliveira > > Afin de contribuer au respect de l'environnement, merci de n'imprimer ce mail qu'en cas de nécessité |
From: Philippe De O. <phi...@gm...> - 2010-11-30 15:23:21
|
Hi, Good idea. I don't think ESIGate fit in any of java-sources.net category. Maybe in Open source Template Engines. But we're not doing the same as the frameworks already present in this category. The summary can be the one written on www.esigate.org : "ESIGate is a toolkit developped to help developpers to integrate existing web applications and aggregate them as a single website.". Seems pretty good to me. On Tue, Nov 30, 2010 at 16:14, Nicolas Richeton <nic...@fr...>wrote: > Hi all, > > I believe that adding ESIGate to well-known lists of frameworks, as > java-source.net[1], could help building a community. The question is : in > which category falls ESIGate ? > We would have to write a nice summary with some real-world usage (not just > "I'm a ESI reverse-proxy" which misses most of the value of this framework). > > Any ideas ? > > -- > Nicolas > > [1] http://java-source.net/open-source/ > > ------------------------------------------------------------------------------ > Increase Visibility of Your 3D Game App & Earn a Chance To Win $500! > Tap into the largest installed PC base & get more eyes on your game by > optimizing for Intel(R) Graphics Technology. Get started today with the > Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs. > http://p.sf.net/sfu/intelisp-dev2dev > _______________________________________________ > Webassembletool-devel mailing list > Web...@li... > https://lists.sourceforge.net/lists/listinfo/webassembletool-devel > -- Philippe De Oliveira Afin de contribuer au respect de l'environnement, merci de n'imprimer ce mail qu'en cas de nécessité |
From: Nicolas R. <nic...@fr...> - 2010-11-30 15:14:32
|
Hi all, I believe that adding ESIGate to well-known lists of frameworks, as java-source.net[1], could help building a community. The question is : in which category falls ESIGate ? We would have to write a nice summary with some real-world usage (not just "I'm a ESI reverse-proxy" which misses most of the value of this framework). Any ideas ? -- Nicolas [1] http://java-source.net/open-source/ |
From: Nicolas R. <nic...@gm...> - 2010-11-30 14:01:15
|
Hi all, I've setup the main wiki page so it no longer looks like being abandoned. It's now open for contributions. There is a "powered by ESIGate" list on this page. Currently, the only publicly available reference is idmacif, but we all know it is used by many other sites. I'll try to get required authorizations to add some new references on my side. Fx, Philippe, Alexis could you look for customers who would agree on publishing this kind of information ? Thanks. -- Nicolas |