Menu
▾
▴
Re: [Exist-open] Server Grind - New error message
|
From: Adam R. <ada...@de...> - 2006-03-02 11:25:53
|
Okay we logged some requests here this morning and used the Replayer to send them back to eXist. We managed to make eXist eat up its memory quite quickly :-) Hopefully I can pass this onto Wolfgang and the team and they can use their Profilers to see whats going on... Cheers Adam. On Wed, 2006-03-01 at 15:24 +0000, Adam Retter wrote: > On Wed, 2006-03-01 at 14:49 +0000, Phillip B Oldham wrote: > > Thanks Adam. > > > > I'll have to look into this further. I'm not sure I understand exactly > > how to compile, > > If you have ant installed you should just be able to go into the folder > I mentioned and run "ant compile" and that may work for you, otherwise - > > "javac -d classes RequestReplayer.java" will compile it, if you have JDK > 1.5 you may want "javac -source 1.4 -target 1.5 -d classes > RequestReplayer.java" > > To Run it - cd into classes, then "java > org.exist.requestlog.RequestReplayer" > > > > and because the server is "live" with a couple of important clients on > > the box I'm not sure running a CVS is a good idea. > > Agreed, this is also the problem we have. > > > I'm sure I'll be able to do this on our dev server, though. However, > > I'm not sure that I'll be able to provide a decent view of usage. I > > can give it a shot, though. > > Yes, we are going to try and do a similar thing on our dev box this > afternoon. We have a rough idea of what we here (Devon Portal) think > causes the memory problems (XQuery update extensions) and we will just > run our `editor` a few times with a few different parameters to create > the replay log that we think we will need. > > > Phill > > > > Adam Retter wrote: > > > So your not waiting on my response, to the questions I am assuming you > > > are going to ask... > > > > > > The latest CVS as of yesterday night/today includes code in the eXist > > > REST server to log incoming GET and POST requests to a file. > > > This is enabled by adding through the web-application descriptor, this > > > isnt really documented yet, but to switch on the logging simply create a > > > descriptor.xml in your EXIST_HOME folder (mine > > > is /usr/local/eXist/descriptor.xml) and place this in the file - > > > > > > <?xml version="1.0" encoding="UTF-8"?> > > > <xquery-app request-replay-log="true"/> > > > > > > When you start up the eXist server a file request-replay-log.txt should > > > be created in your EXIST_HOME folder, this file will have each GET and > > > POST request appended you make appeneded to it. > > > > > > When you are happy that you have generated enough information in the > > > request-replay-log.txt file, shutdown eXist. > > > > > > Now the IMPORTANT bit is that you Move this file outside of EXIST_HOME > > > to a temporary location (otherwise when you play it back to the server > > > you will create a loop between the replayer and the server - this drove > > > me nuts for about an hour during testing!). > > > > > > There is a Small GUI application thats use is fairly self-explanatory > > > once you have seen it. It resides in > > > tools/requestlog/src/org/exist/requestlog. > > > > > > After compiling and starting this application point it at the > > > request-replay-log.txt that you copied to the temporary location > > > earlier, startup eXist server and once its started up, click Start in > > > the Request Replayer. You can set an iteration count, so it will repeat > > > the requests in the file x number of times if you want to generate > > > heavier request loads on eXist. > > > > > > Hopefully this should cause eXist to exhibit the memory problems that > > > you have seen. If so email the request-replay-log.txt and the number of > > > iterations that you ran it for over to Wolfgang and I think he may be > > > able to take this forward from there... > > > > > > Thanks Adam. > > > > > > > > > On Wed, 2006-03-01 at 12:15 +0100, Wolfgang Meier wrote: > > > > > > > Hi, > > > > > > > > As far as I know, several people are trying to find the memory leak, > > > > which does obviously still exist somewhere on the REST service layer. > > > > For this purpose, Adam has written a small "recorder" which logs all > > > > operations that come in via REST and can play them back later. You > > > > should contact him. Basically, we need to be able to reproduce memory > > > > issues before we can fix them. > > > > > > > > Wolfgang > > > > > > > > > > > > On 3/1/06, Phillip B Oldham <phi...@ki...> wrote: > > > > > > > > > Hi all > > > > > > > > > > I'm still getting server grind, however this time I'm getting a new message: > > > > > > > > > > HTTP ERROR: 500 > > > > > > > > > > Java heap space > > > > > > > > > > RequestURI=/documents/index.xml > > > > > > > > > > Powered by Jetty:// > > > > > > > > > > I've now booting from the server.sh using the following command in my > > > > > rc.local: > > > > > > > > > > /usr/eXist/bin/server.sh -t 5 > /var/log/exist.log > > > > > > > > > > However, I'm getting 22 processes/threads running from boot. These are > > > > > reaching 3.3% memory usage each before killing the server. Before it was > > > > > 2.1%. > > > > > > > > > > Any way I can limit the memory usage further? > > > > > > > > > > Phill > > > > > > > > > > > > > > > > > > > > > > > > ------------------------------------------------------- > > > > This SF.Net email is sponsored by xPML, a groundbreaking scripting language > > > > that extends applications into web and mobile media. Attend the live webcast > > > > and join the prime developer group breaking into this new coding territory! > > > > http://sel.as-us.falkag.net/sel?cmd=lnk&kid0944&bid$1720&dat1642 > > > > _______________________________________________ > > > > Exist-open mailing list > > > > Exi...@li... > > > > https://lists.sourceforge.net/lists/listinfo/exist-open > > > > > > > > -- > > Phillip B Oldham > > kilo75 ltd > > a: Round Foundry Media Centre, Foundry St, Leeds, LS11 5QP > > t: +44 (0) 870 420 2410 > > e: phi...@ki... > > w: //kilo75.com/ > > > > ______________________________________________________________________ > > Policies > > > > This e-mail and its attachments are intended for the above named > > recipient(s) only and may be confidential. If they have come to you > > in error, please reply to this e-mail and highlight the error. No > > action > > should be taken regarding content, nor must you copy or show them > > to anyone. > > > > This e-mail has been created in the knowledge that Internet e-mail > > is not a 100% secure communications medium, and we have taken > > steps to ensure that this e-mail and attachments are free from any > > virus. We must advise that in keeping with good computing practice > > the recipient should ensure they are completely virus free, and that > > you understand and observe the lack of security when e-mailing us. > > > > > > > > ______________________________________________________________________ -- Adam Retter Devon Portal Developer Devon Portal Project County Hall Exeter Devon EX2 4QD t: 01392 38 3683 f: 01392 38 2966 e: ada...@de... w: http://www.devonline.gov.uk |