Re: [Hypercontent-users] slow_hyperconent14
Brought to you by:
alexvigdor
From: Alex V. <av...@co...> - 2004-09-22 21:48:52
|
Here are our production settings: -Xms3072m -Xmx3072m -XX:NewSize=3D512m -XX:MaxNewSize=3D512m What hardware configuration are you running on? I recommend you turn off verbose garbage collection in production. I =20= have not tried LWPSynchronization, so I am not certain as to its =20 impact. I don't have an exact count, but we are managing at least 10,000 files =20= via HyperContent right now. As often as possible, we mount the build =20= and publish filesystems via NFS and treat it as a local filesystem, =20 which is much faster than SFTP. I recommend you examine this option =20= if it is possible in your environment. I also recommend you check out and use the latest 1.x repository code. =20= Since the 1.4 release, I have made the build process more forgiving in =20= low-memory situations through more extensive use of soft references. =20= Just today, I wrote a JSch based SFTP filesystem impl based on your =20 recommendation. My initial tests do not show a performance boost over =20= j2ssh, but perhaps you will see improved stability. You will need the =20= jsch-20040922.jar from cvs (I have changed one method to reduce the =20 number of network calls as the library is used in HyperContent, so you =20= cannot currently use the distributed binary), and the new class =20 JSchSFTPFileSystemImpl. To enable this instead of J2ssh, change the =20 classname for the "sftp" filesystem as specified in Filesystems.xml. The speed of building has a lot to do with how you use XML Includes, =20 and whether you have optimized your XSL stylesheets. If you could post =20= a ZIP file of your content repository along with the project definition =20= file to a web address, I will download them and have a look and see if =20= I can recommend any optimizations. It is important with XML Includes =20= only to include what you need, and with XSL it is very beneficial to =20 performance to use keys. Apache Slide may be integrated for WebDAV support in a 2.x release - =20 that decision will be discussed on the developer list when it is time =20= to add WebDAV support, which is not currently planned until sometime =20 next year. I think Cocoon is great, and in fact the pipeline model in HyperContent =20= 2.0 is loosely inspired by Cocoon's model. Unfortunately, Cocoon's =20 pipeline is XML specific, and I wanted a mechanism which would support =20= arbitrary chaining of operations on other types of files, such as =20 resizing and watermarking images. The use of FileAsset subclasses like =20= XMLAsset makes it possible to maintain XML characteristics across =20 pipeline stages in HyperContent. I am not sure if Spring will be used or not in 2.0 - I have not yet =20 found occasion to use it. The MVC framework is attractive, but is tied =20= to servlets. HyperContent abstracts the notion of server request and =20= response and is not tied to being implemented as a servlet. I have =20 recently checked in a new form binding pipeline stage for use in MVC =20 style development, that allows you to bind form processors to inputs =20 via a special name prefix. These bindings can be expired upon use to =20= prevent resubmission of forms, and allow multiple form processors to be =20= mapped to different inputs in a single HTML form. This is critical to =20= the component-based model of constructing authoring forms in 2.0, as =20 multiple forms can be combined without losing their distinct =20 processing. Velocity is already integrated as a template language in 2.0, though =20 there are no examples in the repository yet. This will be an =20 alternative to XSL for building forms or pages. HyperContent 2.0 does follow the WAR packaging model - the "webapp" =20 directory in CVS is equivalent to the root of the WAR file. Tomcat is =20= only embedded via a single class in the CVS as a convenience. There =20 will be an ant target in the future for building the war file, but you =20= can do it manually by just zipping the webapp directory. I recommend you check the portal list for discussion of tomcat =20 restarting - I believe the issue has been discussed there. Cheers, Alex On Sep 22, 2004, at 11:44 AM, Ingmars Rubenis wrote: > Hello! > > About version 1.4 hypercontent. We are daily building more than > 1300 files about 15 times per day. We are going alive on the 28th of > September. We are planing about 3000 http files. The site of =20 > university of Latvia is > quit large site please see http://portal.lu.lv . > The hyperconent 1.4 is very slow. My memory setting are: > JAVA_OPTS=3D"-server -Xincgc -Xms512m -Xmx1024m -Xss128k =20 > -XX:MaxHeapFreeRatio=3D70 -XX:MinHeapFreeRatio=3D40 -XX:NewSize=3D256m = =20 > -XX:MaxNewSize=3D256m -XX:SurvivorRatio=3D8 > -verbose:gc -XX:+UseLWPSynchronization" > It is even difficult to go through files in hypercontent. Build =20 > process > hangs a couple times a day. Also it is time consuming to upload gif > files (it is ok with jpeg). May be you > could help us with that. I have updated ftp.jar from =20 > www.enterprisedt.com library with newer one. > About j2ssh-core.jar. I think this is the slowest point in your > application (the build proces hangs because of this in my mind). The =20= > library is quite slow and old and there are a lot of > bugs. We are going to replace the class SFTPFileSystemImpl with > library from project http://sourceforge.net/projects/jsch/ . What do > You thing? Here is rather old comparing between these libraries > =20 > http://nagoya.apache.org/eyebrowse/ReadMsg?listName=3Dcommons-=20 > de...@ja...&msgId=3D697314 > Is it worth to try? Where is the main problem? Why is this > application so slow and build through sftp is not working as it > should? > I think You should not use old libraries in Your project hypercontent > 2.0 like j2ssh-core.jar. May be try > http://sourceforge.net/projects/jsch/ instead. > Why You are not using apache slide =20 > http://jakarta.apache.org/slide/index.html in the hypercontent 2 =20 > project? > What do You think about apache cocoon and =20 > http://cocoon.apache.org/lenya/ ? > How spring framework will act in the next release and velocity also? > We would like that hypercontnet 2.0 would be as seperate applacition > (war)(not bundled with tomcat). What is Your opinion? How we could =20 > help? > > > About tomcat and uportal. > As I understand from Your previos mail that tomcat is restarted daily? > Is there any application startup script for uportal (after restart it > is slow)? Is there any > tomcat health checking system or may be .sh file? > > > > > > > > > > > > > > > > > Best Wishes > Ingmars Rubenis > LU > University of Latvia > Developer > IT department > (371) 7034736 > > = =FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF= =FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=D3=86+=12=17=F3^=B5=E9=9A= =8AX=AC=B2=9A'=B2=8A=DEu=BC=FF`=E5=01=111=C4%@=20 > = =C6=13=F0^=A2w=A8=7F^=F4>=BA#y=CB@vh=A7=B2=DA+y=C7=A2=BD=E6=A7=02=9Aez#=E8= t=C8=A7=88TD=11=FA+=CA=8B=AB=8E=E7`zg=A7=B6=89=F0=86=8Ah=AE=DB2=A2=EA=E9=AE= =88=DEr=DBh.=20 > )=EE=C4=F3=C2=B6=17=9Bz=CB=FFJ=9A'=B2=8A=DEu=BC=88=04=CF=C3y=A7e=8Aw=FFI= =EAm=FFn=FF=1A=88^=AD=EF=E1=B6=DA=FF=FF=FB=1F=FEw=AD=FE=9A\=FD=CA'=B5=EB-=20= > =FE=98i=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF= =FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=FF=C7=CA=97=ABr=89=EDz{=FF=BA=C7=AB=B2= f=A2=96)=E0=96+-=1F*^=AD=20 > =CA'=B5=E9=ED=FE=EB=1E=AE=CF=E5=8A=CBl=FE=CA.=AD=C7=9F=A2=B8=1E=FEw=AD=86= =DBi=B3=FF=FF=96+-=B3=FB(=BA=B7=1E~=8A=E0{=F9=DE=B7=F9b=B2=DB?=96+-=20 > =8Aw=E8=FE=1C=A9z=B7(=9E=D7=A7=B7=FB=AC =20= |