Re: [Geoserver-users] Performance with huge JPEG2000

SourceForge Headquarters 1320 Columbia Street Suite 310 San Diego, CA 92101 +1 (858) 422-6466

Hi Daniele,

the JAI settings are:
- Memory capacity: 0.75
- Memory threshold: 0.75
- Tile threads: 7
- Tile threads priority: 5
- Tile recycling: unchecked
- JPEG and PNG native acceleration: checked
- Mosaic native acceleration: unchecked

The coverage access settings are:
- Core pool size: 5
- Maximum pool size: 10
- Keep alive time: 30000 ms
- Queue type: unbounded
- ImageIO cache memory threshold: 10230 KB

Thanks for the tips, I will see if we can generate an ECW file. Also, I will experiment with image mosaicing.

Cheers!

-----Mensaje original-----
De: sim...@gm... [mailto:sim...@gm...] En nombre de Simone Giannecchini
Enviado el: miércoles, 03 de abril de 2013 18:31
Para: Fernando Lacunza Prieto
CC: Daniele Romagnoli; geo...@li...
Asunto: Re: [Geoserver-users] Performance with huge JPEG2000

Ciao Fernando,
the new config you are using should be the best one.
One additional thing to tweak is the JAI settings and the Coverage Access settings, can you report them to us?

That said, are you still using JP2MrSID to server the file? In our experience Kakadu or ECW should be faster anyway.
Moreover, depending on how the econding was performed (daniele can add to this...) the decoding will hardly be fast for certain tile/levels.

Regards,
Simone Giannecchini
==
Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.
==

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054  Massarosa (LU)
Italy
phone: +39 0584 962313
fax:     +39 0584 1660272
mob:   +39  333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

On Wed, Apr 3, 2013 at 11:50 AM, Fernando Lacunza Prieto <fla...@tr...> wrote:
> Ciao Daniele,
>
>
>
> The gdalinfo from the file is below:
>
>
>
> Size is 598240, 638720
>
> Coordinate System is:
>
> PROJCS["ETRS89 / UTM zone 30N",
>
>     GEOGCS["ETRS89",
>
>         DATUM["European_Terrestrial_Reference_System_1989",
>
>             SPHEROID["GRS 1980",6378137,298.2572221010002,
>
>                 AUTHORITY["EPSG","7019"]],
>
>             AUTHORITY["EPSG","6258"]],
>
>         PRIMEM["Greenwich",0],
>
>         UNIT["degree",0.0174532925199433],
>
>         AUTHORITY["EPSG","4258"]],
>
>     PROJECTION["Transverse_Mercator"],
>
>     PARAMETER["latitude_of_origin",0],
>
>     PARAMETER["central_meridian",-3],
>
>     PARAMETER["scale_factor",0.9996],
>
>     PARAMETER["false_easting",500000],
>
>     PARAMETER["false_northing",0],
>
>     UNIT["metre",1,
>
>         AUTHORITY["EPSG","9001"]],
>
>     AUTHORITY["EPSG","25830"]]
>
> Origin = (539240.000000000000000,4798780.000000000000000)
>
> Pixel Size = (0.250000000000000,-0.250000000000000)
>
> Metadata:
>
>   GEOTIFF_NUM__1024__GTModelTypeGeoKey=1
>
>   GEOTIFF_CHAR__GTModelTypeGeoKey=ModelTypeProjected
>
>   GEOTIFF_NUM__1025__GTRasterTypeGeoKey=1
>
>   GEOTIFF_CHAR__GTRasterTypeGeoKey=RasterPixelIsArea
>
>   GEOTIFF_NUM__1026__GTCitationGeoKey=This file was created with the
> ECW JPEG 20
>
> 00 SDK build 4.2.0.64 copyright 1998-2005 by ER Mapper.  This GeoJP2
> header was
>
> translated from the following ER Mapper style registration information:
>
>         fOriginX:                       539240.000000
>
>         fOriginY:                       4798780.000000
>
>         fCellIncrementX:                0.250000
>
>         fCellIncrementY:                -0.250000
>
>         fCWRotationDegrees:     0.000000
>
>         szProjection:           EPSG:25830
>
>         szDatum:                        EPSG:25830
>
>
>
>   GEOTIFF_NUM__3072__ProjectedCSTypeGeoKey=25830
>
>   GEOTIFF_CHAR__ProjectedCSTypeGeoKey=Unknown-25830
>
>   GEOTIFF_NUM__3076__ProjLinearUnitsGeoKey=9001
>
>   GEOTIFF_CHAR__ProjLinearUnitsGeoKey=Linear_Meter
>
> Image Structure Metadata:
>
>   INTERLEAVE=PIXEL
>
> Corner Coordinates:
>
> Upper Left  (  539240.000, 4798780.000)
>
> Lower Left  (  539240.000, 4639100.000)
>
> Upper Right (  688800.000, 4798780.000)
>
> Lower Right (  688800.000, 4639100.000)
>
> Center      (  614020.000, 4718940.000)
>
> Band 1 Block=1024x128 Type=Byte, ColorInterp=Red
>
>   Minimum=11.000, Maximum=255.000, Mean=177.955, StdDev=81.483
>
>   Overviews: 299120x319360, 149560x159680, 74780x79840, 37390x39920,
> 18695x19960
>
> , 9348x9980, 4674x4990, 2337x2495, 1169x1248, 585x624, 293x312,
> 147x156, 74x78,
>
> 37x39
>
> Band 2 Block=1024x128 Type=Byte, ColorInterp=Green
>
>   Minimum=18.000, Maximum=255.000, Mean=178.914, StdDev=79.212
>
>   Overviews: 299120x319360, 149560x159680, 74780x79840, 37390x39920,
> 18695x19960
>
> , 9348x9980, 4674x4990, 2337x2495, 1169x1248, 585x624, 293x312,
> 147x156, 74x78,
>
> 37x39
>
> Band 3 Block=1024x128 Type=Byte, ColorInterp=Blue
>
>   Minimum=8.000, Maximum=255.000, Mean=172.125, StdDev=85.485
>
>   Overviews: 299120x319360, 149560x159680, 74780x79840, 37390x39920,
> 18695x19960
>
> , 9348x9980, 4674x4990, 2337x2495, 1169x1248, 585x624, 293x312,
> 147x156, 74x78,
>
> 37x39
>
>
>
>
>
> The layer is EPSG:25830 at both native and declared SRS. To ensure
> there is no reprojection the SRS handling is set to "force declared".
>
>
>
> At the coverage parameters I had initially
> SUGGESTED_TILE_SIZE=512,512, USE_JAI_IMAGEREAD=true,
> USE_MULTITHREADING=false, but I have switched the last two parameters
> to USE_JAI_IMAGEREAD=false, USE_MULTITHREADING=true and I have
> experimented an increase in performance: now I have 16 to 18 seconds per map request, but no later downtime from GeoServer.
>
>
>
> The tile caching is as default, enabled for EPSG:900913 and EPSG:4326,
> but this option is not triggered as I am trying to build the cache in
> EPSG:25830. I don't see any need to use tile caching in this case,
> since the sole purpose of the WMS is to serve MapProxy so it can build the WMTS cache.
>
>
>
> Best regards,
>
> Fernando Lacunza
>
>
>
>
>
>
>
> De: dan...@gm... [mailto:dan...@gm...] En nombre
> de Daniele Romagnoli Enviado el: martes, 02 de abril de 2013 15:33
> Para: Fernando Lacunza Prieto
> CC: geo...@li...
> Asunto: Re: [Geoserver-users] Performance with huge JPEG2000
>
>
>
> Hi,
>
> can you run a gdalinfo on your file or provide us some more info on
> the inner structure of that file (progression order, tiling,
> decomposition levels, ...)?
>
> Moreover, how did you configure the layer on geoserver?
>
>
>
>
>
> Please, let us know.
>
> Daniele
>
>
>
>
>
> On Tue, Apr 2, 2013 at 2:26 PM, Fernando Lacunza Prieto
> <fla...@tr...> wrote:
>
> Hello everyone,
>
>
>
> I have a really big JPEG2000 file (598240x638720 pixels, about 54 GB)
> published in a WMS by GeoServer 2.2 and the GDAL extension. The file
> is accessed with a JP2MrSID store. The purpose of that WMS is to serve
> tiles to MapProxy to build a WMTS cache.
>
>
>
> Unfortunately, the performance is appalling: each GetMap request lasts
> 10 to
> 15 seconds, and after that GeoServer stops responding for another 15
> to 20 seconds. At this rate, my WMTS cache would be done in about 5
> years, and I do not want to wait so long.
>
>
>
> ¿Is there some tweaking I can do to increase the performance to
> acceptable levels? I am a newbie in both GeoServer and MapProxy, and I
> fear that my approach to the problem could be wrong. Therefore, any
> suggestions to accomplish the task of building a restful WMTS cache
> from a JPEG2000 file are welcome.
>
>
>
> Thanks!
>
>
>
> ________________________________
>
> AVISO SOBRE CONFIDENCIALIDAD: La información incluida en este mensaje
> es CONFIDENCIAL y de uso EXCLUSIVO a su FINALIDAD. Su posterior
> divulgación será responsabilidad de quien la realice
>
>
> ----------------------------------------------------------------------
> -------- Own the Future-Intel(R) Level Up Game Demo Contest 2013 Rise
> to greatness in Intel's independent game demo contest. Compete for
> recognition, cash, and the chance to get your game on Steam.
> $5K grand prize plus 10 genre and skill prizes. Submit your demo by
> 6/6/13. http://altfarm.mediaplex.com/ad/ck/12124-176961-30367-2
> _______________________________________________
> Geoserver-users mailing list
> Geo...@li...
> https://lists.sourceforge.net/lists/listinfo/geoserver-users
>
>
>
>
> --
> ==
> Our support, Your Success! Visit http://opensdi.geo-solutions.it for
> more information.
> ==
>
> Ing. Daniele Romagnoli
> Senior Software Engineer
>
> GeoSolutions S.A.S.
> Via Poggio alle Viti 1187
> 55054  Massarosa (LU)
> Italy
> phone: +39 0584 962313
> fax:      +39 0584 1660272
>
> http://www.geo-solutions.it
> http://twitter.com/geosolutions_it
>
> -------------------------------------------------------
>
>
> ________________________________
> AVISO SOBRE CONFIDENCIALIDAD: La información incluida en este mensaje
> es CONFIDENCIAL y de uso EXCLUSIVO a su FINALIDAD. Su posterior
> divulgación será responsabilidad de quien la realice
>
> ----------------------------------------------------------------------
> -------- Minimize network downtime and maximize team effectiveness.
> Reduce network management and security costs.Learn how to hire the
> most talented Cisco Certified professionals. Visit the Employer
> Resources Portal
> http://www.cisco.com/web/learning/employer_resources/index.html
> _______________________________________________
> Geoserver-users mailing list
> Geo...@li...
> https://lists.sourceforge.net/lists/listinfo/geoserver-users
>

AVISO SOBRE CONFIDENCIALIDAD: La información incluida en este mensaje es CONFIDENCIAL y de uso EXCLUSIVO a su FINALIDAD. Su posterior divulgación será responsabilidad de quien la realice