From: Ivan P. <iva...@no...> - 2011-03-25 09:27:24
|
Hi there geoserverers, I'm interested to know if there are people out there who have tried mapping the multi dimensional output of the WRF weather prediction model. At this stage i am looking at the steps neccessary to turn the various information in the model's output NetCDF into data that geoserver can map directly, including the isobars and wind vectors (as vectors), as well as temperature rasters. I've got a few ideas (python) but would be interested to hear if others have done this before, even if its just the broad approach as i understand the specifics may be ip. have a good friday, -ivan |
From: Luca M. <lmo...@ie...> - 2011-03-25 13:48:43
|
On 03/25/2011 10:27 AM, Ivan PRICE wrote: > > I'm interested to know if there are people out there who have tried > mapping the multi dimensional output of the WRF weather prediction > model. At this stage i am looking at the steps neccessary to turn the > various information in the model's output NetCDF into data that > geoserver can map directly, including the isobars and wind vectors (as > vectors), as well as temperature rasters. I've considered an NetCDF DataStore a while ago, but the project's budget did not allow it. By the way, since meteorological information has to be presented in strictly codified way, I have made some contributions to the GeoTools renderer (WKT shapes and some Java-drawn linear symbols) which you may find useful, but be prepared to add Java-drawn symbols via custom code (there should be a pluggable Java class symbolizer now in GeoTools). Regards, Luca Morandini http://www.lucamorandini.it |
From: <ti...@el...> - 2011-03-25 15:20:59
|
We have some home made renderers for NetCDF, are you aiming for something like this - http://bit.ly/ePc0Tp. Simon recently posted an SLD styled layer for winds as well - http://bit.ly/gRlY7B. You might also be interested in Thredds WMS - http://www.unidata.ucar.edu/projects/THREDDS/tech/tds4.1/reference/WMS.html. I am also starting on a CSIRO infrastructure project which will aim to improve NetCDF support across the board in Java land, using classic ucar netcdf and geotools. Cheers, Tisham. > > Hi there geoserverers, > > I'm interested to know if there are people out there who have tried > mapping the multi dimensional output of the WRF weather prediction > model. At this stage i am looking at the steps neccessary to turn the > various information in the model's output NetCDF into data that > geoserver can map directly, including the isobars and wind vectors (as > vectors), as well as temperature rasters. > > I've got a few ideas (python) but would be interested to hear if others > have done this before, even if its just the broad approach as i > understand the specifics may be ip. > > have a good friday, > > -ivan > > > > ------------------------------------------------------------------------------ > Enable your software for Intel(R) Active Management Technology to meet the > growing manageability and security demands of your customers. Businesses > are taking advantage of Intel(R) vPro (TM) technology - will your software > be a part of the solution? Download the Intel(R) Manageability Checker > today! http://p.sf.net/sfu/intel-dev2devmar > _______________________________________________ > Geoserver-users mailing list > Geo...@li... > https://lists.sourceforge.net/lists/listinfo/geoserver-users > |
From: Luca M. <lmo...@ie...> - 2011-03-25 17:52:52
|
On 03/25/2011 04:20 PM, ti...@el... wrote: > > Simon recently posted an SLD styled layer for winds as well - > http://bit.ly/gRlY7B. Is this way of depicting direction and strength of winds codified somewhere ? AFAIK, winds on weather maps are depicted using these symbols (I suppose codified by the WMO): http://www.ncarg.ucar.edu//supplements/wmap/wmex09.gif Regards, Luca Morandini http://www.lucamorandini.it |
From: Andrea A. <and...@ge...> - 2011-03-25 18:25:51
|
On Fri, Mar 25, 2011 at 6:52 PM, Luca Morandini <lmo...@ie...> wrote: > On 03/25/2011 04:20 PM, ti...@el... wrote: >> >> Simon recently posted an SLD styled layer for winds as well - >> http://bit.ly/gRlY7B. > > Is this way of depicting direction and strength of winds codified somewhere ? No, it's just a sample of geometry transformations, it has no pretense to be a correct wind map. It's just a generic way of showing vectors on a map starting from a raster transforming the raster in vectors on the fly, see: http://geo-solutions.blogspot.com/2011/01/developers-corner-have-your-sld.html Cheers Andrea -- ------------------------------------------------------- Ing. Andrea Aime GeoSolutions S.A.S. Tech lead Via Poggio alle Viti 1187 55054 Massarosa (LU) Italy phone: +39 0584 962313 fax: +39 0584 962313 mob: +39 333 8128928 http://www.geo-solutions.it http://geo-solutions.blogspot.com/ http://www.youtube.com/user/GeoSolutionsIT http://www.linkedin.com/in/andreaaime http://twitter.com/geowolf ------------------------------------------------------- |
From: Luca M. <lmo...@ie...> - 2011-03-25 18:50:05
|
On 03/25/2011 07:25 PM, Andrea Aime wrote: > > No, it's just a sample of geometry transformations, it has no pretense to be > a correct wind map. > It's just a generic way of showing vectors on a map starting from a raster > transforming the raster in vectors on the fly, see: Wow ! Coupled with GWC may mean the best of both worlds: small footprint of data (just one raster set stored) and fast display. Regards, Luca Morandini http://www.lucamorandini.it |
From: Andrea A. <and...@ge...> - 2011-03-25 19:20:15
|
On Fri, Mar 25, 2011 at 7:50 PM, Luca Morandini <lmo...@ie...> wrote: > On 03/25/2011 07:25 PM, Andrea Aime wrote: >> >> No, it's just a sample of geometry transformations, it has no pretense to be >> a correct wind map. >> It's just a generic way of showing vectors on a map starting from a raster >> transforming the raster in vectors on the fly, see: > > Wow ! Coupled with GWC may mean the best of both worlds: small footprint of data > (just one raster set stored) and fast display. Not so slow to start with, see this: http://demo1.geo-solutions.it/playground/wms?service=WMS&version=1.1.0&request=GetMap&layers=GeoSolutions:DEM_Vulcano,GeoSolutions:DEM_Vulcano,GeoSolutions:DEM_Vulcano&styles=,dem_contour,dem_values&bbox=14.747,38.336,15.082,38.661&width=512&height=496&srs=EPSG:4326&format=application/openlayers The contouring is done on the fly. Try zooming above 1:2000 and you'll also get the cell values displayed. Still needs some love, but it's new stuff, available only on trunk for the moment, so there is time. Cheers Andrea -- ------------------------------------------------------- Ing. Andrea Aime GeoSolutions S.A.S. Tech lead Via Poggio alle Viti 1187 55054 Massarosa (LU) Italy phone: +39 0584 962313 fax: +39 0584 962313 mob: +39 333 8128928 http://www.geo-solutions.it http://geo-solutions.blogspot.com/ http://www.youtube.com/user/GeoSolutionsIT http://www.linkedin.com/in/andreaaime http://twitter.com/geowolf ------------------------------------------------------- |
From: Luca M. <lmo...@ie...> - 2011-03-26 06:18:50
|
On 03/25/2011 08:20 PM, Andrea Aime wrote: > > Not so slow to start with, see this: Fast indeed, but I would rather compare times, under a realistic workload, with and without on-the-fly contouring before "buying" it. Since we are at it: is the contouring algorithm somehow pluggable (for weathermen like their contours smooth, say Aikima or some other sort of spline) ? Regards, Luca Morandini http://www.lucamorandini.it |
From: Andrea A. <and...@ge...> - 2011-03-26 07:20:00
|
On Sat, Mar 26, 2011 at 7:18 AM, Luca Morandini <lmo...@ie...> wrote: > On 03/25/2011 08:20 PM, Andrea Aime wrote: >> >> Not so slow to start with, see this: > > Fast indeed, but I would rather compare times, under a realistic workload, with > and without on-the-fly contouring before "buying" it. > > Since we are at it: is the contouring algorithm somehow pluggable (for weathermen > like their contours smooth, say Aikima or some other sort of spline) ? You can write your own function/wps process, so yeah, it's pluggable (it won't be called gs:contour in the call and will probably have different params, but you can put in the transform step whatever you want) Cheers Andrea -- ------------------------------------------------------- Ing. Andrea Aime GeoSolutions S.A.S. Tech lead Via Poggio alle Viti 1187 55054 Massarosa (LU) Italy phone: +39 0584 962313 fax: +39 0584 962313 mob: +39 333 8128928 http://www.geo-solutions.it http://geo-solutions.blogspot.com/ http://www.youtube.com/user/GeoSolutionsIT http://www.linkedin.com/in/andreaaime http://twitter.com/geowolf ------------------------------------------------------- |
From: Luca M. <lmo...@ie...> - 2011-03-26 08:12:53
|
On 03/26/2011 08:19 AM, Andrea Aime wrote: > > You can write your own function/wps process, so yeah, it's pluggable Oops, it appears I made a sily question... actually, I failed to notice the <<pipe a process (yes, a WPS one) inside the SLD>> sentence, which means it is *very* pluggable. This mechanism takes the separation of content from presentation to a new level, which I like immensely... but I cannot help thinking that, performance-wise, the WPS overhead needed for every GetMap call is not very reassuring. Anyway, you're the expert on GS performance here. Regards, Luca Morandini http://www.lucamorandini.it |
From: Andrea A. <and...@ge...> - 2011-03-26 08:32:15
|
On Sat, Mar 26, 2011 at 9:13 AM, Luca Morandini <lmo...@ie...> wrote: > Oops, it appears I made a sily question... actually, I failed to notice the <<pipe > a process (yes, a WPS one) inside the SLD>> sentence, which means it is *very* > pluggable. > > This mechanism takes the separation of content from presentation to a new level, > which I like immensely... but I cannot help thinking that, performance-wise, the > WPS overhead needed for every GetMap call is not very reassuring. > > Anyway, you're the expert on GS performance here. Indeed the processes you've seen have been fine tuned to work at best performance, you cannot take a random WPS process and pretend it will be worthy of usage in a on the fly rendering transformation. Then again, you have a choice: - preprocess the data, taking the extra effort of orchestrating the data ingestion, transformation in the various representations needed, publishing of the various layers in GS with styles and all, and long term storage of that somewhat redundant data or - on the fly transformation, which also allows you to pass dynamically the transformation params from the client (see sld param substitution, another custom GS extension), where you just register one layer, and you have to be very careful at optimizing the transformation processes For the specific case we developed this feature for the choice was a no brainer, when you have 100k layers and the viewer wants to specify the isoline levels inside the client, for that specific session only, the first approach just does not really work well Cheers Andrea -- ------------------------------------------------------- Ing. Andrea Aime GeoSolutions S.A.S. Tech lead Via Poggio alle Viti 1187 55054 Massarosa (LU) Italy phone: +39 0584 962313 fax: +39 0584 962313 mob: +39 333 8128928 http://www.geo-solutions.it http://geo-solutions.blogspot.com/ http://www.youtube.com/user/GeoSolutionsIT http://www.linkedin.com/in/andreaaime http://twitter.com/geowolf ------------------------------------------------------- |
From: Ivan P. <iva...@no...> - 2011-03-28 08:51:17
|
Awesome, once again i'm surprised in a good way by whats possible in gs and its friends. it looks like the rendering side is very advanced here, but on the other side i really want to do as little pre-processing as possible, as our data is volatile, hence using the netcdf directly by some method (perhaps using the wms 3 time filters ?) is interesting, i will follow up on this with some of you. i know that gdal supports netcdf to some degree, but i'm not sure if geoserver can be configured to render a particular variable / dimension slice using that. cheers for all your excellent advice -i Le 26/03/2011 9:32 AM, Andrea Aime a écrit : > On Sat, Mar 26, 2011 at 9:13 AM, Luca Morandini<lmo...@ie...> wrote: >> Oops, it appears I made a sily question... actually, I failed to notice the<<pipe >> a process (yes, a WPS one) inside the SLD>> sentence, which means it is *very* >> pluggable. >> >> This mechanism takes the separation of content from presentation to a new level, >> which I like immensely... but I cannot help thinking that, performance-wise, the >> WPS overhead needed for every GetMap call is not very reassuring. >> >> Anyway, you're the expert on GS performance here. > Indeed the processes you've seen have been fine tuned to work at best > performance, > you cannot take a random WPS process and pretend it will be worthy of usage in > a on the fly rendering transformation. > > Then again, you have a choice: > - preprocess the data, taking the extra effort of orchestrating the > data ingestion, > transformation in the various representations needed, publishing of > the various > layers in GS with styles and all, and long term storage of that somewhat > redundant data or > - on the fly transformation, which also allows you to pass dynamically the > transformation params from the client (see sld param substitution, another > custom GS extension), where you just register one layer, and you have to > be very careful at optimizing the transformation processes > > For the specific case we developed this feature for the choice was a no brainer, > when you have 100k layers and the viewer wants to specify the isoline levels > inside the client, for that specific session only, the first approach just does > not really work well > > Cheers > Andrea > > |
From: Simone G. <sim...@ge...> - 2011-03-25 18:46:53
|
Ciao Ivan, long story short: - in the past we used to publish netcdf directly but we dropped tha approach in favour of using an imagemosaic with a time and elevation/depth dimension - we are working on doing contouring and class-based visualization using these example: http://bit.ly/g24vHB http://bit.ly/ewFHoR - as far as wind arrows are concerned, we are not supporting the WMS ones for the moment, but it is feasible - we tend to perform automatic ingestion using geobatch (sooner or later we will release a public version of what we are doing there :) . If you want to know more you can ping me. Regards, Simone Giannecchini ------------------------------------------------------- Ing. Simone Giannecchini GeoSolutions S.A.S. Founder Via Poggio alle Viti 1187 55054 Massarosa (LU) Italy phone: +39 0584 962313 fax: +39 0584 962313 mob: +39 333 8128928 http://www.geo-solutions.it http://geo-solutions.blogspot.com/ http://www.youtube.com/user/GeoSolutionsIT http://www.linkedin.com/in/simonegiannecchini http://twitter.com/simogeo ------------------------------------------------------- On Fri, Mar 25, 2011 at 10:27 AM, Ivan PRICE <iva...@no...> wrote: > > Hi there geoserverers, > > I'm interested to know if there are people out there who have tried > mapping the multi dimensional output of the WRF weather prediction > model. At this stage i am looking at the steps neccessary to turn the > various information in the model's output NetCDF into data that > geoserver can map directly, including the isobars and wind vectors (as > vectors), as well as temperature rasters. > > I've got a few ideas (python) but would be interested to hear if others > have done this before, even if its just the broad approach as i > understand the specifics may be ip. > > have a good friday, > > -ivan > > > > ------------------------------------------------------------------------------ > Enable your software for Intel(R) Active Management Technology to meet the > growing manageability and security demands of your customers. Businesses > are taking advantage of Intel(R) vPro (TM) technology - will your software > be a part of the solution? Download the Intel(R) Manageability Checker > today! http://p.sf.net/sfu/intel-dev2devmar > _______________________________________________ > Geoserver-users mailing list > Geo...@li... > https://lists.sourceforge.net/lists/listinfo/geoserver-users > |