How_To_Import_New_Map_Data modified by Anonymous

Anonymous — Fri, 20 Mar 2015 14:20:04 -0000

Check Data

- Check you have all expected .nc files.

- You may also have some kind of minimum/maximum files, ideally seperated by variable and in .dat format (which can be simply changed to .csv).

Create Local ncWMS

You must have an Apache Tomcat server available on the desired testing machine.

Download ncWMS here: http://en.sourceforge.jp/projects/sfnet_ncwms/downloads/ncwms/1.0RC2/ncWMS-1.0RC2-src.zip/

Place the ncWMS .war file within you Tomcat's WebApps directory, and then restart the tomcat so that it should unpack and build the .war application.

You can test whether it has worked usually by going to localhost:8080/ncWMS-1.0RC2/ The default login details are User: admin Pass: ncWMS

The password can only be changed via the config.xml with details on changing this later.

*UPDATE* Carbones now uses a patched version of the latest release candidate 1.0RC3, referred to as ncWMSrc3_patch. You can download this from the ftp, /home/carbones/ncWMSrc3_patch rather than the old build at sourceforge.

Create NCML Files

ncWMS uses a system known as NCML which essentially allows you to change the structure of your .nc files to remain compliant with the WMS standards (with which ncWMS can read and automate map image creation).

The data will first of all need to be checked for inconsistencies with the existing .nc files. To do this you can use the tool toolsUI-4.2.jar

When you have found the differences the ncml creation tool can start being modified. Such examples may be redundnacy in one the ncml tool's outputs (in v.0.5 for example, the units filed and ogname filed became redundant because they had been placed into the nc).

The ncml files should be within the same folder as the nc files.

The ncml generator tool is available from the carbones repository.

Linking to the .ncml

Under the ncWMS manager http://carbones.eu:8083/ncWMSrc3_patch/ , go to the admin page and enter the new data path for your nc & ncml files (both should be under the same directory). End the path with .ncml

You will have to enter a unique ID, which will be needed in the web app configuration later. CERC have been using names in the format "nc_date" for example "nc_20111130" and "nc_20130305".

Also ensure the map image size is configured for 4096 instead of the default 1024.

Create updated configuration files

A simple C# tool has been created which will automatially create the necessary text which should be copied and pasted into carbones_local.properties and the ncWMS config.xml.

Some modifications will need to be made per use such as file paths, and an updated list of averaging periods etc. If the min/max files are not seperated by variable, then this will have to be modified too (presumably by adding a new array of variables and enclosing for-loop).

The tool can be found at Q:\CRs\Utilities\CARBONES_F862\Website\CR0023 Generating Min & Max Numbers with C# Program\FetchMinMax or from the Carbones repository.

Config.xml

The config.xml file is necesary to produce the desired map colour scales. It does this by using fifth and ninety-fifth percentiles, which are taken from the min/max files.

The config.xml can be edited via ftp, the current ncWMS build (ncWMSrc3_patch) writes to /home/carbones/ncWMSrc3Config. This location is set in the ncWMS ncwmsContext bean in the WMS-servlet.xml, see the ncWMS documentation.

The config.xml file should be edited by deleting any existing data realted to variables, and replacing them with the output from the above step.

After doing this, the ncwms tomcat should be restarted, and the data will take a good while to reload 9so double check everything you have done for accuracy before doing it). The commands are:

{{{{ bash /var/lib/apache-tomcat-6.0.32-ncWMS/bin/shutdown.sh bash /var/lib/apache-tomcat-6.0.32-ncWMS/bin/startup.sh }}}}

The map images should then once again be rechecked, this should be done through the Carbones web application, however ncWMS has a built in map viewer called Godiva2 accessible from the admin panel http://carbones.eu:8083/ncWMSrc3_patch/

Configuring the web app to use the new ncWMS build

Edit the dataset names in these two configuration files. If you know the old dataset name and the new dataset name, it's simplest just to do a search and replace. CERC have been using names in the format "nc_date" for example "nc_20111130" and "nc_20130305".

Recent changes to How_To_Import_New_Map_Data

How_To_Import_New_Map_Data modified by Anonymous