perl scripts_pl/50.cd_hmm_tied/slave_convg.pl
while running this am getting the following error. Can you please help me
sitecsp@acl-pg-06:~/Documents/TIMIT_an4/an4$ perl scripts_pl/50.cd_hmm_tied/slave_convg.pl
MODULE: 50 Training Context dependent models
Phase 1: Cleaning up directories:
accumulator...logs...qmanager...
Phase 2: Copy CI to CD initialize
Phase 3: Forward-Backward
Baum welch starting for 1 Gaussian(s), iteration: 1 (1 of 1)
0% FATAL_ERROR: "main.c", line 1054: initialization failed
Failed to start bw
Only 0 parts of 1 of Baum Welch were successfully completed
Parts 1 failed to run!
Training failed in iteration 1
I can't run your example without all files, but according to your transcripts, there are just few words in the training data and eventually you have 63 full triphones:
INFO: mk_mdef_gen.c(835): 25 n_base, 63 n_tri
This means, for you task you should either just use the model produced in an4.ci_cont (simply use it in the decoder) or if you further reduce CFG_N_TIED_STATES (no more than 150). I think cd model will not provide much accuracy gain though
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Sir, thanks for your reply. Now I have reduced this value from 200 to 120 even then I am getting the same error. As you mentioned in the above to use only an4.ci_cont what are the steps I need to follow.
Whether I need to run all these steps.
How to use an4.ci_cont in decoder can you please tell me.
what all the files i need to send you sir can you please mention so that I can send that files.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Sir, I am using cmu sphinx3.
I have executed the following commands in sequence. perl scripts_pl/00.verify/verify_all.pl
perl scripts_pl/10.vector_quantize/slave.VQ.pl
perl scripts_pl/20.ci_hmm/slave_convg.pl
perl scripts_pl/30.cd_hmm_untied/slave_convg.pl
And followed the instructions which are there in the above link given by you.
For decoding i use the following command mentioned in the link. sphinxtrain -s decode run
I am getting following error.
sitecsp@acl-pg-06:~/Documents/PPDIW/an4$ sphinxtrain -s decode run
The program 'sphinxtrain' is currently not installed. You can install it by typing:
sudo apt-get install sphinxtrain
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Thank you sir for your reply.
Sir, I have completed the instructions given in the tutorial link.
For pocket sphinx and sphinx base installation I followed this link. [http://cmusphinx.sourceforge.net/wiki/tutorialpocketsphinx]
And, for sphinxtrain I followed this link. [http://cmusphinx.sourceforge.net/wiki/tutorialam]
Till this I have finished but after this I am able to understand the following instructions.
You will need to install software as an administrator root. After you installed the software you may need to update the system configuration so the system will be able to find the dynamic libraries. For example
export PATH=/usr/local/bin:$PATH
export LD_LIBRARY_PATH=/usr/local/lib
export PKG_CONFIG_PATH=/usr/local/lib/pkgconfig
If you don't want to install into system path, you may install in your home folder. In that case you can append the following option to autogen.sh script or to the configure script
--prefix=/home/user/local
Obvsiously the folder can be an arbitrary folder but remember to update the environment configuration after that. If you will find that your binaries fail to load dynamic libraries, something like failed to open libsphinx.so.0 no such file or directory it means that you didn't configure the environment properly.
I have skipped this instructions and try to run this command in sphinxtrain folder.
sphinxtrain -t an4 setup
It shows
sitecsp@acl-pg-06:~/final_timit/sphinxtrain-5prealpha$ sphinxtrain -t an4 setup
Sphinxtrain path: /usr/local/lib/sphinxtrain
Sphinxtrain binaries path: /usr/local/libexec/sphinxtrain
Setting up the database an4
But in an4 folder there is no sphinx_train.cfg file.
Please help me.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
I have skipped this instructions and try to run this command in sphinxtrain folder.
Do you have root permissions on your computer? You should install with ./configure & sudo make & sudo make install
If you cannot di sudo, you should specify a local folder in prefix and set path in ~/.bashrc file as tutorial suggests
But in an4 folder there is no sphinx_train.cfg file.
what about an4/etc/sphinx_train.cfg ?
Last edit: Arseniy Gorin 2016-11-08
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Sir, finally I got the output thank you so much.
Previously I have done one mistake I am trying to run this command
sphinxtrain -t an4 setup
in sphinxtrain that's why .cfg file is not copied to an4 folder.
Now I try to run this command in an4 folder then it will generate .cfg file in an4/etc.
Once again thank you so much sir.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Sir, I want you to know how the probability values are calculated in language model for 1-gram,2-gram,3-gram.
Is their any mathematical relation is their to calculate.
-1.3979 </s> -0.3010
-1.3979 <s> -0.2833
-1.6990 ALL -0.2923
-1.6990 AN -0.2923
-1.6990 ASK -0.2923
-1.6990 CARRY -0.2923
What is that left and right value indicate.
Thank you.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
In the future, the forum rules require you to create a new post if the question is new. Also, I think I already saw this question in this forum a few days ago and it seems it was coming from some of your colleagues
Last edit: Arseniy Gorin 2016-11-08
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
sitecsp@acl-pg-06:~/Documents/TIMIT_an4/an4$ perl scripts_pl/50.cd_hmm_tied/slave_convg.pl MODULE: 50 Training Context dependent models Phase 1: Cleaning up directories: accumulator...logs...qmanager... Phase 2: Copy CI to CD initialize Phase 3: Forward-Backward Baum welch starting for 1 Gaussian(s), iteration: 1 (1 of 1) 0% FATAL_ERROR: "main.c", line 1054: initialization failed Failed to start bw Only 0 parts of 1 of Baum Welch were successfully completed Parts 1 failed to run! Training failed in iteration 1In log dir it says
Thanks in advance.
The error appears earlier when creating mdef file. It sould be easier to help if you provided all logs
Thank you for your response.
I have made zip file of log dir attached below please find it.
The training data has not enough triphones covered. Try to reduce CFG_N_TIED_STATES in the config file. 200 should be fine for your data set
Can you please tell me where I find the config file so that I can make changes suggested by you.
check etc/sphinx_train.cfg
Sir,initially CFG_N_TIED_STATES value will be1000 now I have changed to 200 and re run all the stepseven then I am getting same error.
I think I need your full training working directory to reproduce the error. Can you provide it?
Sir, today the institution is already closed tomorrow I will send you. Thank you.
Sir, I am extremely sorry, I am not able to upload project directories it is around 350 MB. Please help me in this regard. Thank you.
Sir, i am uploading working directory part by part please find the attachment below.
Thank you.
I can't run your example without all files, but according to your transcripts, there are just few words in the training data and eventually you have 63 full triphones:
This means, for you task you should either just use the model produced in an4.ci_cont (simply use it in the decoder) or if you further reduce CFG_N_TIED_STATES (no more than 150). I think cd model will not provide much accuracy gain though
Sir, thanks for your reply. Now I have reduced this value from 200 to 120 even then I am getting the same error. As you mentioned in the above to use only an4.ci_cont what are the steps I need to follow.
Whether I need to run all these steps.
How to use an4.ci_cont in decoder can you please tell me.
what all the files i need to send you sir can you please mention so that I can send that files.
run training till perl scripts_pl/30.cd_hmm_untied/slave_convg.pl and then decode with pocketsphinx as described here:
http://cmusphinx.sourceforge.net/wiki/tutorialam#using_the_model
the entire an4 folder
Last edit: Arseniy Gorin 2016-11-07
Sir, here I am sending the an4 directory google drive link .
https://drive.google.com/file/d/0Bx5J6h-_0UWoOWJUZXBjRy1haTg/view?usp=sharing
Thank you.
Sir, I am using cmu sphinx3.
I have executed the following commands in sequence.
perl scripts_pl/00.verify/verify_all.pl perl scripts_pl/10.vector_quantize/slave.VQ.pl perl scripts_pl/20.ci_hmm/slave_convg.pl perl scripts_pl/30.cd_hmm_untied/slave_convg.plAnd followed the instructions which are there in the above link given by you.
For decoding i use the following command mentioned in the link.
sphinxtrain -s decode runI am getting following error.
sitecsp@acl-pg-06:~/Documents/PPDIW/an4$ sphinxtrain -s decode run
The program 'sphinxtrain' is currently not installed. You can install it by typing:
sudo apt-get install sphinxtrain
Finally I just run your directory and it works out-of-the-box.
You should install latest versions of sphinxtrain, sphinxbase and pocketsphinx as described here
After that, remove all unnecessary files (you keep only etc and wav, also remove .cfg files from etc folder)
sphinxtrain -t an4 setup$CFG_WAVFILE_EXTENSION = 'sph';
$CFG_WAVFILE_TYPE = 'nist'; # one of nist, mswav, raw
$CFG_LANGUAGEMODEL = "$CFG_LIST_DIR/$CFG_DB_NAME.ug.lm.DMP";
$DEC_CFG_LANGUAGEMODEL = "$CFG_BASE_DIR/etc/${CFG_DB_NAME}.ug.lm.DMP";
sphinxtrain runfrom an4 directoryWith your data and the process described above you should get suspiciously good results:
Thank you sir for your reply.
Sir, I have completed the instructions given in the tutorial link.
For pocket sphinx and sphinx base installation I followed this link.
[http://cmusphinx.sourceforge.net/wiki/tutorialpocketsphinx]
And, for sphinxtrain I followed this link.
[http://cmusphinx.sourceforge.net/wiki/tutorialam]
tutorial an4 an4_sphere.tar.gz sphinxtrain sphinxtrain-5prealpha.tar.gz pocketsphinx pocketsphinx-5prealpha.tar.gz sphinxbase sphinxbase-5prealpha.tar.gzTill this I have finished but after this I am able to understand the following instructions.
I have skipped this instructions and try to run this command in sphinxtrain folder.
It shows
But in an4 folder there is no sphinx_train.cfg file.
Please help me.
Do you have root permissions on your computer? You should install with
./configure & sudo make & sudo make installIf you cannot di sudo, you should specify a local folder in prefix and set path in ~/.bashrc file as tutorial suggests
what about an4/etc/sphinx_train.cfg ?
Last edit: Arseniy Gorin 2016-11-08
Sir, finally I got the output thank you so much.
Previously I have done one mistake I am trying to run this command
in sphinxtrain that's why .cfg file is not copied to an4 folder.
Now I try to run this command in an4 folder then it will generate .cfg file in an4/etc.
Once again thank you so much sir.
No problem. You are welcome
Sir, I want you to know how the probability values are calculated in language model for 1-gram,2-gram,3-gram.
Is their any mathematical relation is their to calculate.
What is that left and right value indicate.
Thank you.
Left one is log probability of the corresponding unigram, right one is back-off weight.
Check this https://web.stanford.edu/class/cs124/lec/languagemodeling.pdf
In the future, the forum rules require you to create a new post if the question is new. Also, I think I already saw this question in this forum a few days ago and it seems it was coming from some of your colleagues
Last edit: Arseniy Gorin 2016-11-08
Ok sir, I will abide by the rules of the forum and I also inform my colleague about the same.
Thank you for your kind help.