Gradient Test

Gradient Test

In order to run a gradient test, the following command has to be given:

./scripts/run_gradtest.py -s 2000,1,1 -e 2000,1,3 rc/nam1x1-dummy_tr.rc

Note that we use a different script, but the same .rc file. Also we shortened the period a bit.
Now lets first locate where the output is written. The pyshell creates a scratch directory in which the code and output is directed. The location is defined by the .rc file. In my case, the output ends up in:

/scratch/shared/krol/var4d/dummy_tr/nam1x1/ml60/tropo25

A directory listing results in:

drwxrwxr-x 2 krol krol    69632 Aug 20 14:36 DIFFCOEFF
-rw-rw-r-- 1 krol krol      281 Aug 20 14:09 Makefile
-rw-rw-r-- 1 krol krol    84291 Aug 20 14:01 Zoomed.nc4
lrwxrwxrwx 1 krol krol       37 Aug 20 14:09 build -> build_default_real8_openmp_optim-fast
drwxrwxr-x 5 krol krol     4096 Aug 20 13:59 build_default_real8_openmp_optim-fast
-rw-rw-r-- 1 krol krol    74377 Aug 20 14:09 compile.rc
-rwxrwxr-x 1 krol krol     8134 Aug 20 14:09 submit_tm5
drwxrwxr-x 3 krol krol     4096 Aug 13 03:33 test_project
-rwxrwxr-x 1 krol krol 13990359 Aug 20 14:09 tm5-var4d.x
-rw-rw-r-- 1 krol krol   118393 Aug 20 14:01 vec2ll_glb600x400_nam300x200.nc
-rw-rw-r-- 1 krol krol   126025 Aug 20 14:01 vec2ll_nam300x200_nam100x100.nc

Further down the tree

./test_project/output/2000010100-2000010300

We find the output of this particular run.

~~~~~
:::csh
-rw-rw-r-- 1 krol krol 142828 Aug 20 14:43 adj_emissions.nc4
-rw-rw-r-- 1 krol krol 74320 Aug 20 14:42 backward.rc
-rw-rw-r-- 1 krol krol 74353 Aug 20 14:42 backward_001.rc
-rwxr-xr-x 1 krol krol 1282 Aug 20 14:42 backward_001_done.jb
-rwxr-xr-x 1 krol krol 1726 Aug 20 14:42 backward_001_init.jb
-rwxr-xr-x 1 krol krol 1712 Aug 20 14:42 backward_001_run.jb
-rw-rw-r-- 1 krol krol 150975 Aug 20 14:47 emission.nc4
-rw-rw-r-- 1 krol krol 74344 Aug 20 14:47 forward.rc
-rw-rw-r-- 1 krol krol 74377 Aug 20 14:47 forward_001.rc
-rwxr-xr-x 1 krol krol 1279 Aug 20 14:47 forward_001_done.jb
-rwxr-xr-x 1 krol krol 1720 Aug 20 14:47 forward_001_init.jb
-rwxr-xr-x 1 krol krol 1706 Aug 20 14:47 forward_001_run.jb
-rw-rw-r-- 1 krol krol 1450 Aug 20 14:48 gradient_test.log
drwxrwxr-x 2 krol krol 4096 Aug 20 14:42 mass
drwxrwxr-x 2 krol krol 4096 Aug 20 14:43 save
drwxrwxr-x 2 krol krol 4096 Aug 20 14:43 timing
-rw-rw-r-- 1 krol krol 28 Aug 20 14:48 tm5.ok

The relevant file for the gradient test is ___gradient_test.log___.
A listing looks like

:::csh
alpha J_bg J_obs J_tot DJ1 DJ2 DJ2/DJ1 1-DJ2/DJ1
0 3.18200000000e+03 0.00000000000e+00 3.18200000000e+03 6.36400000000e+03 0.00000000000e+00 0 1
0.1 2.57742000000e+03 0.00000000000e+00 2.57742000000e+03 6.36400000000e+03 6.04580000000e+03 0.95 0.05
0.01 3.11867820000e+03 0.00000000000e+00 3.11867820000e+03 6.36400000000e+03 6.33218000000e+03 0.995 0.004999999999
0.001 3.17563918200e+03 0.00000000000e+00 3.17563918200e+03 6.36400000000e+03 6.36081800017e+03 0.9995 0.0004999999726
0.0001 3.18136363182e+03 0.00000000000e+00 3.18136363182e+03 6.36400000000e+03 6.36368179647e+03 0.99995 5.000055543e-05
1e-05 3.18193636032e+03 0.00000000000e+00 3.18193636032e+03 6.36400000000e+03 6.36396820687e+03 0.999995 4.995777863e-06
1e-06 3.18199363600e+03 0.00000000000e+00 3.18199363600e+03 6.36400000000e+03 6.36399654468e+03 0.99999946 5.429481101e-07
1e-07 3.18199936360e+03 0.00000000000e+00 3.18199936360e+03 6.36400000000e+03 6.36399799987e+03 0.99999969 3.142882228e-07
1e-08 3.18199993636e+03 0.00000000000e+00 3.18199993636e+03 6.36400000000e+03 6.36395570837e+03 0.99999304 6.959716198e-06
~~~~

We directly note that the J_obs column contains zeros. The reason is that we did not use any observations in this run. So, we will first create some observations for a more realistic test (now we test only the background part J_bg).

[Observations]