From: David Warde-F. <d.w...@gm...> - 2015-06-12 06:06:26
|
Hi, Apologies if this has been answered in the archives, but I'm trying to use the s5 recipe for LibriSpeech on a single machine with a single GPU. I've modified cmd.sh to use run.pl. After about a day, I see a lot of background processes like gmm-latgen-faster, lattice-add-penalty, lattice-scale, etc. that have been launched in the background (the terminal is actually free, which suggests the run.sh script has terminated...). I'm not totally sure what's going on, or how to find out. Specifically, I'm trying to export the features used to train the final stage neural network as well as the aligned targets. One thing I noticed earlier is that the script was trying to spawn multiple GPU jobs, but this GPU is configured (by administrators) to permit at most one CUDA process, and so I saw "3 of 4 jobs failed" messages. Would these jobs have been retried? Thanks in advance, David |