relax SVN archive

Merged revisions 25713-25715,25720-25723,25725-25741,25744-25747,25749-25754,25760-25769 via svnmerge from
svn+ssh://bugman@.../svn/relax/branches/frame_order_cleanup

........
r25713 | bugman | 2014-09-09 14:24:13 +0200 (Tue, 09 Sep 2014) | 5 lines

Implemented the frame_order.permute_axes user function.

This is used to switch between local minima in the pseudo-elliptic frame order models.
........
r25714 | bugman | 2014-09-09 14:25:41 +0200 (Tue, 09 Sep 2014) | 7 lines

Fix for the Frame_order.test_axis_permutation system test.

The motional eigenframe in the old log file was not exactly correct and did not correspond exactly
to the Euler angles in the cam_pseudo_ellipse.bz2 results file in
test_suite/shared_data/frame_order/axis_permutations/.
........
r25715 | bugman | 2014-09-09 14:29:43 +0200 (Tue, 09 Sep 2014) | 6 lines

Extended the Frame_order.test_axis_permutation system test to check frame_order.permute_axes twice.

This will check that two calls to the frame_order.permute_axes user function will restore the
original parameter values.
........
r25720 | bugman | 2014-09-09 19:13:17 +0200 (Tue, 09 Sep 2014) | 5 lines

The frame_order.permute_axes user function can now handle the torsionless pseudo-ellipse.

This model does not have the variable cdp.cone_sigma_max set.
........
r25721 | bugman | 2014-09-09 19:18:46 +0200 (Tue, 09 Sep 2014) | 5 lines

Fix for the frame_order.permute_axes user function for the torsionless pseudo-ellipse.

This should have been part of the last commit.
........
r25722 | bugman | 2014-09-09 19:33:39 +0200 (Tue, 09 Sep 2014) | 8 lines

Added support for axis permutations in the frame order auto-analysis.

This is done by copying the data pipe of the already optimised pseudo-elliptic models, permuting the
axes, and performing another optimisation using all RDC and PCS data. This allows the second
solution for these pseudo-elliptic models to be found. The 2nd pipe is included in the model
selection step to allow the best solution for the model to be found.
........
r25723 | bugman | 2014-09-09 19:39:36 +0200 (Tue, 09 Sep 2014) | 7 lines

Fix for the reading of old results files in the frame order auto-analysis.

The directory name is now processed by the model_directory() method. This will convert the spaces
to '_' and remove commas. Without this the already created files could not be found, if the model
name contains a space or comma.
........
r25725 | bugman | 2014-09-09 21:12:30 +0200 (Tue, 09 Sep 2014) | 6 lines

Made the pivot point in the frame order PDB representation fail-proof.

If the pivot position was outside of the bounds [-1000, 1000], the PDB file creation would fail as
the record would be too long. So now the pivot is shifted to be in these bounds.
........
r25726 | bugman | 2014-09-10 08:46:29 +0200 (Wed, 10 Sep 2014) | 5 lines

The axis permutation step in the frame order auto-analysis is now always performed.

If an old results file was found, this step was accidentally skipped.
........
r25727 | bugman | 2014-09-10 09:22:20 +0200 (Wed, 10 Sep 2014) | 3 lines

Added extensive printouts to the frame_order.permute_axes user function.
........
r25728 | bugman | 2014-09-10 11:43:11 +0200 (Wed, 10 Sep 2014) | 7 lines

Redesigned the frame_order.permute_axes user function frontend.

Previously only cyclic permutations were considered, however non-cyclic permutations are also
allowed when accompanied by an axis inversion. Therefore 3 combinations exist with cone_theta_x <=
cone_theta_y, or 2 when the current combination is excluded.
........
r25729 | bugman | 2014-09-10 13:21:28 +0200 (Wed, 10 Sep 2014) | 10 lines

Created 6 system tests for the frame_order.permute_axes user function.

This covers the 3 starting conditions (x<y<z, x<z<y, z<x<y) and the two permutations ('A' and 'B')
for each of these which do not include the starting permutation. They replace the original
Frame_order.test_axis_permutation system test with the tests
Frame_order.test_axis_perm_x_le_y_le_z_permA, Frame_order.test_axis_perm_x_le_y_le_z_permB,
Frame_order.test_axis_perm_x_le_z_le_y_permA, Frame_order.test_axis_perm_x_le_z_le_y_permB,
Frame_order.test_axis_perm_z_le_x_le_y_permA, and Frame_order.test_axis_perm_z_le_x_le_y_permB.
........
r25730 | bugman | 2014-09-10 13:41:33 +0200 (Wed, 10 Sep 2014) | 8 lines

Implemented the new frame_order.permute_axes backend.

The 3 starting conditions x<y<z, x<z<y, and z<x<y and the two permutations 'A' and 'B' (for each of
these which do not include the starting permutation) are now supported. For these 6 combinations,
the axis and order parameter permutation and the z-axis inversion are selected and applied to the
current system.
........
r25731 | bugman | 2014-09-10 13:43:41 +0200 (Wed, 10 Sep 2014) | 5 lines

Removed the second permutation from the 6 Frame_order.test_axis_perm_* system tests.

A second identical permutation does not necessarily restore the original state.
........
r25732 | bugman | 2014-09-10 13:49:20 +0200 (Wed, 10 Sep 2014) | 5 lines

Fix for the frame_order.permute_axes for the torsionless pseudo-ellipse model.

The data structure cdp.cone_sigma_max does not exist in this model as cone_sigma_max == 0.0.
........
r25733 | bugman | 2014-09-10 13:57:03 +0200 (Wed, 10 Sep 2014) | 7 lines

Modified the frame order auto-analysis axis permutation algorithm to handle both permutations.

Instead of creating one additional data pipe for the permutations, two are now created for the
permutations 'A' and 'B'. This allows all 3 solutions for the pseudo-elliptic models to be
explored and included in the final model selection process.
........
r25734 | bugman | 2014-09-10 14:20:43 +0200 (Wed, 10 Sep 2014) | 5 lines

Fix for the Frame_order.test_axis_perm_x_le_z_le_y_permB system test.

The permuted z-axis needs to be inverted in the test.
........
r25735 | bugman | 2014-09-10 14:24:58 +0200 (Wed, 10 Sep 2014) | 8 lines

Many fixes for the frame_order.permute_axes user function.

The z-axis inversion is now encoded into a 3D numpy array as the index of the new z-axis position
needs to be stored. The cone_theta_x, cone_theta_y and cone_sigma_max parameters are now permuted
in reverse 'perm' data structure by calling its index() method. And the cone_theta_x - cone_theta_y
to y-axis - x-axis switch has been removed (this may need to be reintroduced later).
........
r25736 | bugman | 2014-09-10 14:41:23 +0200 (Wed, 10 Sep 2014) | 6 lines

Fix for the axis permutation protocol in the frame order auto-analysis.

The pipe.copy user function does not switch pipes, therefore the pipe.switch user function is now
being called so that the correct pipe is being permuted and optimised.
........
r25737 | bugman | 2014-09-10 18:46:29 +0200 (Wed, 10 Sep 2014) | 9 lines

Created some test data files for visualising the frame order axis permutation.

This uses the CaM frame order synthetic data for the rotor model to visualise the pseudo-ellipse
frame order model axis permutations. The initial conversion sets the pseudo-ellipse torsion angle
cone_sigma_max to the rotor opening half-angle, and the pseudo-elliptic cone opening to close to
zero. Then the axis permutations are performed. All three solutions are optimised. PDB
representations before and after optimisation are included to illustrate any problems.
........
r25738 | bugman | 2014-09-10 21:33:37 +0200 (Wed, 10 Sep 2014) | 7 lines

Bug fix for the new frame_order.permute_axes user function.

The cone and torsion angles were not being correctly permuted. Now the direct permutation array is
being used. And the fact that cone_theta_x is a rotation along the y-axis and cone_theta_y along
the x-axis is taken into account.
........
r25739 | bugman | 2014-09-11 13:43:37 +0200 (Thu, 11 Sep 2014) | 8 lines

Redesign of the axis permutation algorithm of the frame_order.permute_axes user function.

Instead of tracking the fact that cone_theta_x is a rotation around the y-axis and cone_theta_y is
about the x-axis, now two permutation arrays are created - one for the three angles and one for the
axes. The permutation array values have also been completely changed as previously the incorrect
inverse permutation was coded into the algorithm.
........
r25740 | bugman | 2014-09-11 14:58:38 +0200 (Thu, 11 Sep 2014) | 6 lines

Updated the frame order pseudo-ellipse motion permutation test data.

This is for the CaM frame order rotor model synthetic data. The correct axis and cone angle
permutations of the frame_order.permute_axes user function are now being used and optimised.
........
r25741 | bugman | 2014-09-11 14:59:42 +0200 (Thu, 11 Sep 2014) | 5 lines

Renamed the pseudo-ellipse permutation directory to perm_pseudo_ellipse_x_le_y_le_z.

This is for the CaM frame order rotor model synthetic data.
........
r25744 | bugman | 2014-09-11 15:42:19 +0200 (Thu, 11 Sep 2014) | 5 lines

Fix for the frame_order.permute_axes user function.

One of the 6 permutations had the x and y axes switched (the x <= z <= y condition, permutation A).
........
r25745 | bugman | 2014-09-11 17:17:05 +0200 (Thu, 11 Sep 2014) | 8 lines

Visualisation files for all of the pseudo-ellipse permutations by frame_order.permute_axes.

This includes the x <= z <= y and z <= x <= y conditions (the previous files were for x <= y <= z).
In all permutation combinations, optimisation has been performed to demonstrate that these are all
local minima. These all approximate the rotor when using the CaM frame order rotor model synthetic
data.
........
r25746 | bugman | 2014-09-11 19:16:52 +0200 (Thu, 11 Sep 2014) | 8 lines

Added support for the isotopic cone models to the frame_order.permute_axes user function.

This is a simpler setup, but it uses the same permutation algorithm as derived for the
pseudo-ellipse models. Instead of setting the x and y cone angles separately, they are instead
averaged. And as the cone axis is undefined in the xy plane, the axis has been randomly selected as
being the axis perpendicular to both the z-axis and the reference frame x-axis.
........
r25747 | bugman | 2014-09-11 19:19:18 +0200 (Thu, 11 Sep 2014) | 7 lines

Created set of files showing the axis permutation problem for the isotopic cone frame order model.

This shows that there are two minima. However one has a chi-squared value of ~1, and the other a
value of ~150. Nevertheless, the optimisation could be trapped in the non-global minimum so the
frame_order.permute_axes user function should be used for the isotopic cones as well, just in case.
........
r25749 | bugman | 2014-09-11 19:37:44 +0200 (Thu, 11 Sep 2014) | 7 lines

Created the other isotropic cone condition z <= x = y.

As there are no constraints in this model, this condition should not result in any major
differences, just the size of the cone being different and the optimisation having to decrease the
cone angle significantly to mimic the rotor.
........
r25750 | bugman | 2014-09-11 19:43:45 +0200 (Thu, 11 Sep 2014) | 5 lines

Added the missing PDB files which should have been committed previously.

This are in test_suite/shared_data/frame_order/cam/rotor/perm_iso_cone_z_le_xy.
........
r25751 | bugman | 2014-09-11 19:44:22 +0200 (Thu, 11 Sep 2014) | 5 lines

Added the missing PDB files which should have been committed previously.

This are in test_suite/shared_data/frame_order/cam/rotor/perm_iso_cone_xy_le_z/.
........
r25752 | bugman | 2014-09-11 19:52:47 +0200 (Thu, 11 Sep 2014) | 7 lines

Modified the frame order auto-analysis.

The axis permutation algorithm is now performed on all isotopic cone and pseudo-ellipse models.
This is just in case the non-global minima was found in the original optimisation. The isotropic
cone models possess two local minima whereas the pseudo-ellipse models possess three local minima.
........
r25753 | bugman | 2014-09-11 19:57:46 +0200 (Thu, 11 Sep 2014) | 5 lines

Simplified the optimisation in the axis permutation part of the frame order auto-analysis.

Only the last, highest quality setting is used for optimisation.
........
r25754 | bugman | 2014-09-11 20:30:12 +0200 (Thu, 11 Sep 2014) | 6 lines

Fix for the axis permutation protocol in the frame order auto-analysis.

This would fail if a results file for the permuted model already exists as the pipe.copy user
function call was being performed too early.
........
r25760 | bugman | 2014-09-11 21:56:47 +0200 (Thu, 11 Sep 2014) | 3 lines

Created set of files for the axis permutation of the torsionless isotopic cone frame order model.
........
r25761 | bugman | 2014-09-12 09:35:32 +0200 (Fri, 12 Sep 2014) | 7 lines

Created an initial Frame_order.test_frame_order_pdb_model_ensemble system test.

This is to check the operation of the frame_order.pdb_model user function when an ensemble of
structures is encountered. However as this uses a very minimal number of user functions to set up
the system, a number of other minor bugs will probably be uncovered.
........
r25762 | bugman | 2014-09-12 09:45:00 +0200 (Fri, 12 Sep 2014) | 6 lines

Added printouts to the specific_analyses.frame_order.parameters.update_model() function.

This is to make it easier to understand why certain things fail due to the system not being fully
set up.
........
r25763 | bugman | 2014-09-12 09:49:37 +0200 (Fri, 12 Sep 2014) | 6 lines

Simplified the operation of the frame_order.select_model user function.

This is by removing the check of PCS data from the specific_analyses.frame_order.data.pivot_fixed()
function using the base_data_types() function call. This allows the model to be set up more easily.
........
r25764 | bugman | 2014-09-12 09:54:31 +0200 (Fri, 12 Sep 2014) | 5 lines

Modified the frame order check_pivot() function to operate on any data pipe.

The function now accepts the pipe_name argument so that checks can happen on any data pipe.
........
r25765 | bugman | 2014-09-12 09:57:12 +0200 (Fri, 12 Sep 2014) | 5 lines

Missing imports in the specific_analyses.frame_order.checks module.

This is from the recent pipe_name argument addition in the check_pivot() function.
........
r25766 | bugman | 2014-09-12 09:58:37 +0200 (Fri, 12 Sep 2014) | 6 lines

The frame order generate_pivot() function can now handle no pivot being present.

At the start of this specific_analyses.frame_order.data module function, the check_pivot() function
is being called to make sure that a pivot is present.
........
r25767 | bugman | 2014-09-12 10:08:13 +0200 (Fri, 12 Sep 2014) | 6 lines

Added a call to check_pivot() to the frame_order.select_model user function.

This is to prevent this user function from being called before the pivot has been set, as otherwise
the parameter vector will be incorrectly set up.
........
r25768 | bugman | 2014-09-12 10:12:00 +0200 (Fri, 12 Sep 2014) | 5 lines

Modified the Frame_order.test_frame_order_pdb_model_ensemble system test so it is set up correctly.

The pivot point and moving domain are now specified.
........
r25769 | bugman | 2014-09-12 10:14:16 +0200 (Fri, 12 Sep 2014) | 7 lines

Added Monte Carlo simulations to the Frame_order.test_frame_order_pdb_model_ensemble system test.

This is only setting up Monte Carlo simulation data structures via the monte_carlo.setup user
function. This demonstrates a failure of the frame_order.pdb_model user function when an ensemble
of structures is present with Monte Carlo simulations.
........

Merged revisions 24839-24840,25299-25301,25402,25416,25536-25537,25710-25711 via svnmerge from
svn+ssh://bugman@.../svn/relax/branches/frame_order_cleanup

........
r24839 | bugman | 2014-07-30 17:27:07 +0200 (Wed, 30 Jul 2014) | 8 lines

Fixes for the removal of the RDC data checks from the frame order optimisation functions.

The specific analysis API method overfit_deselect() has now been created to deselect spins which do
not have PCS data or interatomic data containers missing RDC data. The handling of deselected spins
and interatomic data containers is now also correctly handled throughout the frame order specific
code.
........
r24840 | bugman | 2014-07-30 17:27:48 +0200 (Wed, 30 Jul 2014) | 3 lines

Enabled pivot optimisation in the full_analysis.py script for the CaM frame order test data.
........
r25299 | bugman | 2014-08-26 17:31:19 +0200 (Tue, 26 Aug 2014) | 6 lines

The frame order auto-analysis now calls the time() user function.

This is used at the start of each model section, as well as at the very start and very end of the
analysis. This feedback is needed for the user to be able to optimise the optimisation settings.
........
r25300 | bugman | 2014-08-26 17:49:16 +0200 (Tue, 26 Aug 2014) | 8 lines

Major bugfix for the frame order auto-analysis.

The algorithm of using a PCS data subset of a few selected residues to find an initial parameter
estimate followed by using all PCS data was badly implemented. The use of the PCS subset caused
most spin systems to be deselected, however they remained deselected once all data was being used.
So the result was that only the spin subset was ever being used in the analysis.
........
r25301 | bugman | 2014-08-26 17:52:19 +0200 (Tue, 26 Aug 2014) | 3 lines

Removed some printouts accidentally committed in the previous revision.
........
r25402 | bugman | 2014-08-28 18:45:24 +0200 (Thu, 28 Aug 2014) | 3 lines

Fix for the recent lib.period_table and lib.physical_constant module changes.
........
r25416 | bugman | 2014-08-29 10:11:58 +0200 (Fri, 29 Aug 2014) | 7 lines

Created the model_directory() method for the frame order auto-analysis.

This is used to create the full path for saving model specific files. It replaces spaces with
underscores in the path and removes all commas. The commas in the path appear to be fatal for
certain PyMOL versions when viewing the frame order representation.
........
r25536 | bugman | 2014-09-02 11:35:22 +0200 (Tue, 02 Sep 2014) | 3 lines

The frame order auto-analysis results printout has been extended to include the pivot point.
........
r25537 | bugman | 2014-09-02 11:39:40 +0200 (Tue, 02 Sep 2014) | 7 lines

Change to the parameter nesting in the frame order auto-analysis.

The pivot is now taken from the rotor model for all other models. Taking the pivot point from the
isotropic cone model is not a good idea as there are situations where the pivot point optimisation
catastrophically fails, sending the point many tens or hundreds of Angstrom away from the molecule.
........
r25710 | bugman | 2014-09-09 09:18:49 +0200 (Tue, 09 Sep 2014) | 10 lines

Copied a frame order results file for testing axis permutations.

The command used was:
svn cp test_suite/shared_data/frame_order/cam/pseudo_ellipse/frame_order.bz2@r23644 test_suite/shared_data/frame_order/axis_permutations/cam_pseudo_ellipse.bz2

This is from the test_suite/shared_data/frame_order/cam/pseudo_ellipse/ directory. The optimisation
results back at r23644 were identified to have failed, in that it found the alternative minimum.
The pseudo-ellipse model as two minima in the space, and in this case the global minimum was missed.
........
r25711 | bugman | 2014-09-09 10:55:41 +0200 (Tue, 09 Sep 2014) | 5 lines

Created the Frame_order.test_axis_permutation system test.

This is to test the operation of the yet-to-be implemented frame_order.permute_axes user function.
........

Merged revisions 24819-24823,24832-24836 via svnmerge from
svn+ssh://bugman@.../svn/relax/branches/frame_order_cleanup

........
r24819 | bugman | 2014-07-29 18:43:34 +0200 (Tue, 29 Jul 2014) | 5 lines

Missing import in the lib.frame_order.double_rotor module.

This was identified by the new Frame_order.test_auto_analysis system test.
........
r24820 | bugman | 2014-07-30 08:46:03 +0200 (Wed, 30 Jul 2014) | 7 lines

Updates and fixes for the frame order auto-analysis.

The custom grid setup now works for the new reduced parameter set models and the double rotor model
is now also included. The cone axis alpha angle to spherical angle conversion has had a bug
removed. And some of the printouts are now more detailed.
........
r24821 | bugman | 2014-07-30 09:34:22 +0200 (Wed, 30 Jul 2014) | 8 lines

Redesigned the Frame_order.test_auto_analysis system test.

This now uses a hypothetical new Optimisation_settings object from the frame order auto-analysis
module for holding all of the grid search, zooming grid search and minimisation settings. This will
allow for far greater user control of the settings and hugely simplify the auto-analysis interface
by decreasing the number of input arguments. It should also be less confusing.
........
r24822 | bugman | 2014-07-30 11:07:47 +0200 (Wed, 30 Jul 2014) | 16 lines

Implementation of the Optimisation_settings object in the frame order auto-analysis.

This object holds all of the grid search, zooming grid search, and minimisation settings. It
provides the add_grid() and add_min() methods to allow the user to add successive iterations of
optimisation and settings to the object. The loop_grid() and loop_min() methods are used to loop
over each iteration of each method. And the get_grid_inc(), get_grid_num_int_pts(),
get_grid_zoom_level(), get_min_algor(), get_min_func_tol() and get_min_num_int_pts() methods are
used to access the user defined settings.

The auto-analysis has been redesigned around this new concept. All of the optimisation arguments
have been replaced. Instead there are the opt_rigid, opt_subset, opt_full, and opt_mc arguments
which are expected to be instances of the Optimisation_settings object. The optimisation in the
auto-analysis is now more advanced in that more user optimisation settings are now available and
active.
........
r24823 | bugman | 2014-07-30 12:22:43 +0200 (Wed, 30 Jul 2014) | 9 lines

Added linear constraints for the pivot and average domain translation frame order parameters.

The pivot coordinates are constrained between -999 and 999 Angstrom and the translation between -500
and 500 Angstrom. This allows the frame_order.pdb_model user function to operate in the case of
failed models - often the free rotors fitting to torsionally restricted data - by preventing the PDB
coordinates from being out of the PDB format range. It should also speed up optimisation by
stopping the optimisation of failed models earlier.
........
r24832 | bugman | 2014-07-30 14:26:15 +0200 (Wed, 30 Jul 2014) | 8 lines

The frame order auto-analysis Optimisation_settings object now handles the maximum iterations.

The new max_iter argument has been added to the add_min() method, and the new get_min_max_iter()
method added to fetch the value. This is used in the auto-analysis to set the maximum number of
optimisation iterations in the minimise.execute user function calls. Limiting this will be of
greatest benefit for the test suite.
........
r24833 | bugman | 2014-07-30 14:27:47 +0200 (Wed, 30 Jul 2014) | 7 lines

Speed up of the Frame_order.test_auto_analysis system test.

This involves limiting the maximum number of optimisation steps to 20 for most parts (the rigid
model excluded so the average domain position is correctly found), and using the PCS subset data for
the full data set.
........
r24834 | bugman | 2014-07-30 14:36:03 +0200 (Wed, 30 Jul 2014) | 6 lines

Updated the full_analysis.py script for the CaM frame order test data.

This is for the recent changes to the auto-analysis with the Optimisation_settings object and for
the changes of this branch.
........
r24835 | bugman | 2014-07-30 14:38:21 +0200 (Wed, 30 Jul 2014) | 5 lines

Fix for the previous commit (r24834).

The results directory was incorrectly set.
........
r24836 | bugman | 2014-07-30 15:31:09 +0200 (Wed, 30 Jul 2014) | 10 lines

Removed the RDC data checks from the frame order optimisation.

This is in the minimise_setup_rdcs() and store_bc_data() functions of the
specific_analyses.frame_order.optimisation module, called before and after all optimisation. The
reason was identified by profiling - this check was adding significant amounts of time to the setup
and results unpacking parts of the optimisation. Specifically the interatomic_loop() function was
identified via profiling as the function requiring the most amount of cumulative time in the
Frame_order.test_auto_analysis system test (17 seconds out of a total of ~60 seconds).
........

Merged revisions 24778,24783-24784,24787,24798-24810,24814-24817 via svnmerge from
svn+ssh://bugman@.../svn/relax/branches/frame_order_cleanup

........
r24778 | bugman | 2014-07-27 10:40:21 +0200 (Sun, 27 Jul 2014) | 7 lines

Fixes for the CaM free-rotor pseudo-ellipse frame order model test data set.

This is for the constraint 0 <= theta_x <= theta_y <= pi, as the old data was created with theta_x
> theta_y. The new data is also of high quality using 20 million structures and numpy.float128 data
averaging.
........
r24783 | bugman | 2014-07-28 14:21:04 +0200 (Mon, 28 Jul 2014) | 5 lines

Created the lib.frame_order.rotor_axis.convert_axis_alpha_to_spherical() function.

This will convert the axis alpha angle to the equivalent spherical angles theta and phi.
........
r24784 | bugman | 2014-07-28 15:48:50 +0200 (Mon, 28 Jul 2014) | 5 lines

Renamed the lib.frame_order.rotor_axis module to lib.frame_order.conversions.

This module will be used for all sorts of frame order parameter conversions.
........
r24787 | bugman | 2014-07-28 16:29:59 +0200 (Mon, 28 Jul 2014) | 5 lines

Added the pipe_name argument to the specific_analyses.frame_order.data.generate_pivot() function.

This allows the pivot from data pipes other than the current one to be assembled and returned.
........
r24798 | bugman | 2014-07-29 11:39:10 +0200 (Tue, 29 Jul 2014) | 8 lines

Updated the frame order optimisation results for the CaM free rotor, pseudo-ellipse test data.

The optimisation in the frame_order.py is now of higher precision with the number of Sobol' numeric
integration points significantly increased, especially for the Monte Carlo simulations. The new
frame order representation files have been added to the repository, as well as the intermediate
state files.
........
r24799 | bugman | 2014-07-29 11:40:25 +0200 (Tue, 29 Jul 2014) | 8 lines

Updated the frame order optimisation results for the CaM torsionless, pseudo-ellipse test data.

The optimisation in the frame_order.py is now of higher precision with the number of Sobol' numeric
integration points significantly increased, especially for the Monte Carlo simulations. The new
frame order representation files have been added to the repository, as well as the intermediate
state files.
........
r24800 | bugman | 2014-07-29 11:58:19 +0200 (Tue, 29 Jul 2014) | 5 lines

Fix for the Frame_order.test_cam_pseudo_ellipse_free_rotor system test.

This is for the change of the X and Y cone opening angles.
........
r24801 | bugman | 2014-07-29 13:11:20 +0200 (Tue, 29 Jul 2014) | 14 lines

Redesign and expansion of the nested model parameter copying in the frame order auto-analysis.

The nested parameter protocol used to allow the analysis to complete in under 1,000,000 years was no
longer functional due to the switching to the axis alpha parameter to decrease parameter number and
redundancy. The copying of the average domain position for the free rotor models was also incorrect
as the dropping of the alpha Euler angle cause the translation parameters and beta and gamma angles
to change drastically.

The new protocol has been split into four methods for the average domain position, the pivot point,
the motional eigenframe and the parameters of ordering. These use the fact that the free rotor and
torsionless models are the two extrema of the models where the torsion angle is restricted. The
pivot copying is a new addition.
........
r24802 | bugman | 2014-07-29 13:58:14 +0200 (Tue, 29 Jul 2014) | 7 lines

Created the Frame_order.test_auto_analysis system test.

This will be an extremely quick run through of the frame order auto-analysis as this is not
currently tested. 1 Sobol' quasi-random integration point will be used for all models for speed.
The system test uses the rigid CaM test data to perform a full analysis.
........
r24803 | bugman | 2014-07-29 13:59:39 +0200 (Tue, 29 Jul 2014) | 3 lines

Import fix for the frame order auto-analysis.
........
r24804 | bugman | 2014-07-29 14:01:04 +0200 (Tue, 29 Jul 2014) | 3 lines

Alphabetical ordering of the imports in the frame order auto-analysis module.
........
r24805 | bugman | 2014-07-29 14:06:14 +0200 (Tue, 29 Jul 2014) | 5 lines

Fixes for the backend script of the Frame_order.test_auto_analysis system test.

This includes a missing import and the removal of a long ago deleted user function.
........
r24806 | bugman | 2014-07-29 14:08:11 +0200 (Tue, 29 Jul 2014) | 6 lines

Fix for the frame order auto-analysis for the call to the grid search user function.

This user function has been renamed to minimise.grid_search, however not all parts of the analysis
had been converted to the new name.
........
r24807 | bugman | 2014-07-29 15:13:46 +0200 (Tue, 29 Jul 2014) | 6 lines

Created a method in the frame order auto-analysis to reorder the models.

This is needed as the nested model parameter copying protocol requires the simpler models to be
optimised first.
........
r24808 | bugman | 2014-07-29 15:17:02 +0200 (Tue, 29 Jul 2014) | 5 lines

The Frame_order.test_auto_analysis system test now writes all files to the directory of ds.tmpdir.

This is to prevent the system test from dumping files in the current directory.
........
r24809 | bugman | 2014-07-29 15:38:41 +0200 (Tue, 29 Jul 2014) | 5 lines

Modified the specific_analyses.frame_order.parameters.update_model() function.

This will no longer set all parameters to 0.0, excluding the pivot point.
........
r24810 | bugman | 2014-07-29 16:07:28 +0200 (Tue, 29 Jul 2014) | 6 lines

Modified the specific_analyses.frame_order.parameters.assemble_param_vector() function.

This can now handle the case of no parameters being present. The corresponding elements of the
numpy array will consist of NaN values.
........
r24814 | bugman | 2014-07-29 16:41:17 +0200 (Tue, 29 Jul 2014) | 10 lines

Better handling of unset parameters in the frame order optimisation functions.

The specific_analyses.frame_order.optimisation.target_fn_data_setup() and
specific_analyses.frame_order.parameters.assemble_param_vector() function both now accept the
unset_fail argument. This is set in both the calculate() and minimise() API methods. When set, a
RelaxError will be raised in the assemble_param_vector() function when a parameter has not been set
yet. This together with previous changes will prevent the frame order analysis from using 0.0 as a
starting value for unset parameters.
........
r24815 | bugman | 2014-07-29 17:01:55 +0200 (Tue, 29 Jul 2014) | 7 lines

Fixes for all of the Frame_order.test_rigid_data_to_*_model system tests.

The base script now sets all parameter values so that the minimise.calculate user function can
operate. The two free rotor model chi-squared values have been updated as these are sensitive to
the motional eigenframe parameter values - these models can never approximate a rigid state.
........
r24816 | bugman | 2014-07-29 17:38:31 +0200 (Tue, 29 Jul 2014) | 5 lines

Modified the optimisation of the rigid model in the frame order auto-analysis.

The grid search is now implemented as a zooming grid search.
........
r24817 | bugman | 2014-07-29 18:03:37 +0200 (Tue, 29 Jul 2014) | 5 lines

Missing import in the lib.frame_order.rotor module.

This was identified by the new Frame_order.test_auto_analysis system test.
........

Merged revisions 24731-24735,24754 via svnmerge from
svn+ssh://bugman@.../svn/relax/branches/frame_order_cleanup

........
r24731 | bugman | 2014-07-24 18:53:53 +0200 (Thu, 24 Jul 2014) | 3 lines

Converted the frame_order_free_start.py script to use the zooming grid search.
........
r24732 | bugman | 2014-07-24 19:01:00 +0200 (Thu, 24 Jul 2014) | 5 lines

Added lots of calls to the time user function to the frame_order_free_start.py.

This will be used to fine tune the frame order analysis on a cluster.
........
r24733 | bugman | 2014-07-25 09:03:18 +0200 (Fri, 25 Jul 2014) | 7 lines

Increased the default grid bounds for the pivot parameters of the frame order models.

The pivot point is now searched for in a 50 Angstrom box and the pivot displacement for the double
motion models from 10 to 60 Angstroms. These were originally a 20 Angstrom box and 10 to 50
Angstroms. The larger grid is possible when combined with the new zooming grid search.
........
r24734 | bugman | 2014-07-25 09:32:15 +0200 (Fri, 25 Jul 2014) | 8 lines

Updated the frame order optimisation results for the 2-site CaM test data fitting to the rotor model.

The optimisation in the frame_order.py is now of higher precision with the number of Sobol' numeric
integration points significantly increased, especially for the Monte Carlo simulations. The new
frame order representation files have been added to the repository, as well as the intermediate
state files.
........
r24735 | bugman | 2014-07-25 09:36:43 +0200 (Fri, 25 Jul 2014) | 8 lines

Updated the frame order optimisation results for the CaM rotor test data.

The optimisation in the frame_order.py is now of higher precision with the number of Sobol' numeric
integration points significantly increased, especially for the Monte Carlo simulations. The new
frame order representation files have been added to the repository, as well as the intermediate
state files.
........
r24754 | bugman | 2014-07-25 15:57:19 +0200 (Fri, 25 Jul 2014) | 8 lines

Updated the frame order optimisation results for the 2nd CaM rotor test data.

The optimisation in the frame_order.py is now of higher precision with the number of Sobol' numeric
integration points significantly increased, especially for the Monte Carlo simulations. The new
frame order representation files have been added to the repository, as well as the intermediate
state files.
........

Merged revisions 24715-24717 via svnmerge from
svn+ssh://bugman@.../svn/relax/branches/frame_order_cleanup

........
r24715 | bugman | 2014-07-24 16:47:36 +0200 (Thu, 24 Jul 2014) | 5 lines

Turned on the optimisation in the Frame_order.test_cam_rigid system test.

This is to catch a number of failures in the frame order grid search.
........
r24716 | bugman | 2014-07-24 16:50:44 +0200 (Thu, 24 Jul 2014) | 5 lines

Activated the grid search in the frame order system tests using the CaM synthetic data.

This is set to one increment so that the tests can complete in a reasonable time.
........
r24717 | bugman | 2014-07-24 16:53:06 +0200 (Thu, 24 Jul 2014) | 6 lines

Fix for the specific_analyses.frame_order.optimisation.grid_row() function.

This can now handle the case of a single grid increment. The change is similar to r163 in the minfx
project (https://mail.gna.org/public/minfx-commits/2014-07/msg00015.html).
........

Merged revisions 24709-24713 via svnmerge from
svn+ssh://bugman@.../svn/relax/branches/frame_order_cleanup

........
r24709 | bugman | 2014-07-24 15:11:29 +0200 (Thu, 24 Jul 2014) | 3 lines

Some more fixes for the optimisation user function changes.
........
r24710 | bugman | 2014-07-24 16:02:59 +0200 (Thu, 24 Jul 2014) | 7 lines

Removed the parameter scaling for the pivot point frame order parameters.

These were already removed from the frame_order_cleanup branch in the assemble_scaling_matrix()
function, however they were reintroduced accidentally via the parameter object where this
information is now defined. So this removes the scaling a second time.
........
r24711 | bugman | 2014-07-24 16:04:13 +0200 (Thu, 24 Jul 2014) | 6 lines

Fixes for the parameter scaling changes in the trunk.

The scaling flag is no longer part of the specific analysis API optimisation methods. Instead the
pre-assembled scaling matrices are passed into all three API optimisation methods.
........
r24712 | bugman | 2014-07-24 16:21:47 +0200 (Thu, 24 Jul 2014) | 5 lines

Implemented the frame order specific analysis API method print_model_title().

This is simply aliased from the API common method _print_model_title_global().
........
r24713 | bugman | 2014-07-24 16:24:53 +0200 (Thu, 24 Jul 2014) | 5 lines

Fix for the grid search in the frame order analysis.

This is a recently introduced problem due to the changes of the zooming_grid_search branch.
........

Merged revisions 24560-24561,24585-24586,24666-24667 via svnmerge from
svn+ssh://bugman@.../svn/relax/branches/frame_order_cleanup

........
r24560 | bugman | 2014-07-18 10:26:01 +0200 (Fri, 18 Jul 2014) | 8 lines

Updated the frame order optimisation results for the CaM free rotor isotropic cone test data.

The optimisation in the frame_order.py is now of higher precision with the number of Sobol' numeric
integration points significantly increased, especially for the Monte Carlo simulations. The new
frame order representation files have been added to the repository, as well as the intermediate
state files.
........
r24561 | bugman | 2014-07-18 10:30:09 +0200 (Fri, 18 Jul 2014) | 8 lines

Updated the frame order optimisation results for the CaM small angle rotor test data.

The optimisation in the frame_order.py is now of higher precision with the number of Sobol' numeric
integration points significantly increased, especially for the Monte Carlo simulations. The new
frame order representation files have been added to the repository, as well as the intermediate
state files.
........
r24585 | bugman | 2014-07-21 16:07:58 +0200 (Mon, 21 Jul 2014) | 8 lines

Updated the frame order optimisation results for the 2nd CaM free rotor isotropic cone test data.

The optimisation in the frame_order.py is now of higher precision with the number of Sobol' numeric
integration points significantly increased, especially for the Monte Carlo simulations. The new
frame order representation files have been added to the repository, as well as the intermediate
state files.
........
r24586 | bugman | 2014-07-21 16:10:51 +0200 (Mon, 21 Jul 2014) | 8 lines

Updated the frame order optimisation results for the CaM pseudo-ellipse test data.

The optimisation in the frame_order.py is now of higher precision with the number of Sobol' numeric
integration points significantly increased, especially for the Monte Carlo simulations. The new
frame order representation files have been added to the repository, as well as the intermediate
state files.
........
r24666 | bugman | 2014-07-23 08:57:12 +0200 (Wed, 23 Jul 2014) | 8 lines

Updated the frame order optimisation results for the CaM torsionless isotropic cone test data.

The optimisation in the frame_order.py is now of higher precision with the number of Sobol' numeric
integration points significantly increased, especially for the Monte Carlo simulations. The new
frame order representation files have been added to the repository, as well as the intermediate
state files.
........
r24667 | bugman | 2014-07-23 08:58:29 +0200 (Wed, 23 Jul 2014) | 8 lines

Updated the frame order optimisation results for the 2nd CaM pseudo-elliptic cone test data.

The optimisation in the frame_order.py is now of higher precision with the number of Sobol' numeric
integration points significantly increased, especially for the Monte Carlo simulations. The new
frame order representation files have been added to the repository, as well as the intermediate
state files.
........

Merged revisions 24530-24534,24538-24539 via svnmerge from
svn+ssh://bugman@.../svn/relax/branches/frame_order_cleanup

........
r24530 | bugman | 2014-07-11 16:48:43 +0200 (Fri, 11 Jul 2014) | 7 lines

Sent the verbosity argument to the minfx.grid.grid_split() function for the frame order analysis.

This matches the relax trunk changes for the model-free analysis. The minfx function in the next
release (1.0.8) will now be more verbose, so this will help with user feedback when running the
model-free analysis on a cluster or multi-core system using MPI.
........
r24531 | bugman | 2014-07-11 17:21:44 +0200 (Fri, 11 Jul 2014) | 9 lines

Improvements for the parallelised grid search for the frame order analysis.

As each grid point can take wildly different numbers of CPU cycles to calculate the chi-squared
value for, the result of subdividing the grid search was that some subdivisions where incredibly
quick while others required much larger amounts of time. To avoid this bad slave management, the
grid points are now randomised. This means that the subdivisions will require about the same amount
of time to optimise.
........
r24532 | bugman | 2014-07-11 17:47:01 +0200 (Fri, 11 Jul 2014) | 10 lines

Moved the setup of the target function data structures in the frame order analysis.

This is for the grid_search and minimise user functions. The target function data setup function
has been renamed to target_fn_data_setup(). This is now called before the Frame_order_grid_command
and Frame_order_minimise_command multi-processor objects are initialised, and all of the data is now
passed into these functions. Although the code is uglier, this has the benefit that the
target_fn_data_setup() function will only be called once. This data setup requires a lot of time,
so for a large cluster, this can be a large time saving for the grid search.
........
r24533 | bugman | 2014-07-14 12:17:07 +0200 (Mon, 14 Jul 2014) | 3 lines

Modified the frame_order_free_start.py script to better mimic the frame order auto-analysis.
........
r24534 | bugman | 2014-07-15 11:14:39 +0200 (Tue, 15 Jul 2014) | 8 lines

Updated the frame order optimisation results for the 2nd CaM free rotor test data.

The optimisation in the frame_order.py is now of higher precision with the number of Sobol' numeric
integration points significantly increased, especially for the Monte Carlo simulations. The new
frame order representation files have been added to the repository, as well as the intermediate
state files.
........
r24538 | bugman | 2014-07-16 11:32:25 +0200 (Wed, 16 Jul 2014) | 8 lines

Updated the frame order optimisation results for the CaM free rotor test data.

The optimisation in the frame_order.py is now of higher precision with the number of Sobol' numeric
integration points significantly increased, especially for the Monte Carlo simulations. The new
frame order representation files have been added to the repository, as well as the intermediate
state files.
........
r24539 | bugman | 2014-07-16 15:38:08 +0200 (Wed, 16 Jul 2014) | 8 lines

Updated the frame order optimisation results for the CaM missing data free rotor test data.

The optimisation in the frame_order.py is now of higher precision with the number of Sobol' numeric
integration points significantly increased, especially for the Monte Carlo simulations. The new
frame order representation files have been added to the repository, as well as the intermediate
state files.
........

Merged revisions 24522-24524 via svnmerge from
svn+ssh://bugman@.../svn/relax/branches/frame_order_cleanup

........
r24522 | bugman | 2014-07-11 10:46:21 +0200 (Fri, 11 Jul 2014) | 12 lines

Parallelised the frame order grid search to run on clusters or multi-core systems via OpenMPI.

This involved the creation of the Frame_order_grid_command class which is the multi-processor
Slave_command for performing the grid search. This was created by duplicating the
Frame_order_minimise_command class and then differentiating both classes.

For the subdivision of the grid search, the new minfx grid.grid_split_array() function is used in
the frame order grid() API method. The grid() method no longer calls the minimise() method but
instead obtains the processor box itself and adds the subdivided grid slaves to the processor. The
relax grid_search user function takes care of the rest.
........
r24523 | bugman | 2014-07-11 12:01:20 +0200 (Fri, 11 Jul 2014) | 8 lines

Fixes for the parallelised grid search for the frame order analysis.

A chi-squared value check was added to the Frame_order_result_command.run() method to check if the
value is lower than the current when the result is returned to the master. Without this check, each
grid subdivision result will be stored as they are returned rather than storing the results from the
global minimum of the entire grid search.
........
r24524 | bugman | 2014-07-11 15:38:59 +0200 (Fri, 11 Jul 2014) | 7 lines

Added a script for testing out the parameter nesting abilities of the frame order auto-analysis.

This script attempts to find the dynamics solution without knowing where the pivot is located.
Hence this will be as in the auto-analysis were this pivot point will be used as the base for all
other models.
........