Menu

karel's dnn error

Help
wbgxx333
2014-05-03
2014-05-04
  • wbgxx333

    wbgxx333 - 2014-05-03

    dear povey,
    now i use my own dataset and i use the karel's dnn to test.but now i have the error:
    $ ./local/run_dnn.sh
    steps/nnet/make_fmllr_feats.sh --cmd run.pl --transform-dir exp/tri3b/decode da
    a-fmllr-tri3b/test data/test exp/tri3b data-fmllr-tri3b/test/log data-fmllr-tri
    b/test/data
    steps/nnet/make_fmllr_feats.sh: feature type is lda
    Using fMLLR transforms from exp/tri3b/decode
    run.pl: job failed, log is in data-fmllr-tri3b/test/log/make_fmllr_feats.1.log
    and the make_fmllr_feats.1.log is:

    copy-feats 'ark,s,cs:apply-cmvn --utt2spk=ark:data/test/split1/1/utt2spk scp:data/test/split1/1/cmvn.scp scp:data/test/split1/1/feats.scp ark:- | splice-feats --left-context=3 --right-context=3 ark:- ark:- | transform-feats exp/tri3b/final.mat ark:- ark:- | transform-feats --utt2spk=ark:data/test/split1/1/utt2spk "ark:cat exp/tri3b/decode/trans.* |" ark:- ark:- |' ark,scp:/home/Yunpeng/kaldi-trunk/egs/zwsb/s3/data-fmllr-tri3b/test/data/feats_fmllr_test.1.ark,/home/Yunpeng/kaldi-trunk/egs/zwsb/s3/data-fmllr-tri3b/test/data/feats_fmllr_test.1.scp

    Started at Sat May 3 17:29:09 2014

    copy-feats 'ark,s,cs:apply-cmvn --utt2spk=ark:data/test/split1/1/utt2spk scp:data/test/split1/1/cmvn.scp scp:data/test/split1/1/feats.scp ark:- | splice-feats --left-context=3 --right-context=3 ark:- ark:- | transform-feats exp/tri3b/final.mat ark:- ark:- | transform-feats --utt2spk=ark:data/test/split1/1/utt2spk "ark:cat exp/tri3b/decode/trans. |" ark:- ark:- |' ark,scp:/home/Yunpeng/kaldi-trunk/egs/zwsb/s3/data-fmllr-tri3b/test/data/feats_fmllr_test.1.ark,/home/Yunpeng/kaldi-trunk/egs/zwsb/s3/data-fmllr-tri3b/test/data/feats_fmllr_test.1.scp
    apply-cmvn --utt2spk=ark:data/test/split1/1/utt2spk scp:data/test/split1/1/cmvn.scp scp:data/test/split1/1/feats.scp ark:-
    splice-feats --left-context=3 --right-context=3 ark:- ark:-
    transform-feats exp/tri3b/final.mat ark:- ark:-
    transform-feats --utt2spk=ark:data/test/split1/1/utt2spk 'ark:cat exp/tri3b/decode/trans.
    |' ark:- ark:-
    ERROR (transform-feats:FindKeyInternal():util/kaldi-table-inl.h:2013) Error in RandomAccessTableReader: duplicate key ZHCN_ZHL in archive cat exp/tri3b/decode/trans. |
    WARNING (transform-feats:Close():kaldi-io.cc:446) Pipe cat exp/tri3b/decode/trans.
    | had nonzero return status 13
    KALDI_ASSERT: at transform-feats:CloseInternal:util/kaldi-table-inl.h:1562, failed: holder_ == NULL
    /bin/sh: line 1: 8316 Broken pipe apply-cmvn --utt2spk=ark:data/test/split1/1/utt2spk scp:data/test/split1/1/cmvn.scp scp:data/test/split1/1/feats.scp ark:-
    6704 | splice-feats --left-context=3 --right-context=3 ark:- ark:-
    6548 | transform-feats exp/tri3b/final.mat ark:- ark:-
    8920 Aborted (core dumped) | transform-feats --utt2spk=ark:data/test/split1/1/utt2spk "ark:cat exp/tri3b/decode/trans. |" ark:- ark:-
    WARNING (copy-feats:Close():kaldi-io.cc:446) Pipe apply-cmvn --utt2spk=ark:data/test/split1/1/utt2spk scp:data/test/split1/1/cmvn.scp scp:data/test/split1/1/feats.scp ark:- | splice-feats --left-context=3 --right-context=3 ark:- ark:- | transform-feats exp/tri3b/final.mat ark:- ark:- | transform-feats --utt2spk=ark:data/test/split1/1/utt2spk "ark:cat exp/tri3b/decode/trans.
    |" ark:- ark:- | had nonzero return status 34304
    LOG (copy-feats:main():copy-feats.cc:99) Copied 0 feature matrices.

    Accounting: time=4 threads=1

    Ended (code 256) at Sat May 3 17:29:13 2014, elapsed time 4 seconds

    i hope you can help me!thank you very much .

     
    • Daniel Povey

      Daniel Povey - 2014-05-03

      This is the error:
      "duplicate key ZHCN_ZHL in archive cat exp/tri3b/decode/trans.* |"
      duplicate key means the same key appears twice. Either this is an error in
      your data preparation (check with validate_data_dir.sh), or you ran with
      different numbers of jobs in tri3b and did not clean up.
      Dan

      On Sat, May 3, 2014 at 5:06 AM, wbgxx333 wbgxx333@users.sf.net wrote:

      dear povey,
      now i use my own dataset and i use the karel's dnn to test.but now i have
      the error:
      $ ./local/run_dnn.sh
      steps/nnet/make_fmllr_feats.sh --cmd run.pl --transform-dir
      exp/tri3b/decode da
      a-fmllr-tri3b/test data/test exp/tri3b data-fmllr-tri3b/test/log
      data-fmllr-tri
      b/test/data
      steps/nnet/make_fmllr_feats.sh: feature type is lda
      Using fMLLR transforms from exp/tri3b/decode
      run.pl: job failed, log is in
      data-fmllr-tri3b/test/log/make_fmllr_feats.1.log
      and the make_fmllr_feats.1.log is:
      copy-feats 'ark,s,cs:apply-cmvn --utt2spk=ark:data/test/split1/1/utt2spk
      scp:data/test/split1/1/cmvn.scp scp:data/test/split1/1/feats.scp ark:- |
      splice-feats --left-context=3 --right-context=3 ark:- ark:- |
      transform-feats exp/tri3b/final.mat ark:- ark:- | transform-feats
      --utt2spk=ark:data/test/split1/1/utt2spk "ark:cat exp/tri3b/decode/trans.*
      |" ark:- ark:- |'
      ark,scp:/home/Yunpeng/kaldi-trunk/egs/zwsb/s3/data-fmllr-tri3b/test/data/feats_fmllr_test.1.ark,/home/Yunpeng/kaldi-trunk/egs/zwsb/s3/data-fmllr-tri3b/test/data/feats_fmllr_test.1.scp Started
      at Sat May 3 17:29:09 2014

      copy-feats 'ark,s,cs:apply-cmvn --utt2spk=ark:data/test/split1/1/utt2spk
      scp:data/test/split1/1/cmvn.scp scp:data/test/split1/1/feats.scp ark:- |
      splice-feats --left-context=3 --right-context=3 ark:- ark:- |
      transform-feats exp/tri3b/final.mat ark:- ark:- | transform-feats
      --utt2spk=ark:data/test/split1/1/utt2spk "ark:cat exp/tri3b/decode/trans.

      • |" ark:- ark:- |'
        ark,scp:/home/Yunpeng/kaldi-trunk/egs/zwsb/s3/data-fmllr-tri3b/test/data/feats_fmllr_test.1.ark,/home/Yunpeng/kaldi-trunk/egs/zwsb/s3/data-fmllr-tri3b/test/data/feats_fmllr_test.1.scp
        apply-cmvn --utt2spk=ark:data/test/split1/1/utt2spk
        scp:data/test/split1/1/cmvn.scp scp:data/test/split1/1/feats.scp ark:-
        splice-feats --left-context=3 --right-context=3 ark:- ark:- transform-feats
        exp/tri3b/final.mat ark:- ark:- transform-feats
        --utt2spk=ark:data/test/split1/1/utt2spk 'ark:cat exp/tri3b/decode/trans.*|' ark:- ark:-
        ERROR (transform-feats:FindKeyInternal():util/kaldi-table-inl.h:2013)
        Error in RandomAccessTableReader: duplicate key ZHCN_ZHL in archive cat
        exp/tri3b/decode/trans.
      • | WARNING (transform-feats:Close():kaldi-io.cc:446) Pipe cat
        exp/tri3b/decode/trans.* | had nonzero return status 13
        KALDI_ASSERT: at
        transform-feats:CloseInternal:util/kaldi-table-inl.h:1562, failed: holder_
        == NULL
        /bin/sh: line 1: 8316 Broken pipe apply-cmvn
        --utt2spk=ark:data/test/split1/1/utt2spk scp:data/test/split1/1/cmvn.scp
        scp:data/test/split1/1/feats.scp ark:-
        6704 | splice-feats --left-context=3 --right-context=3 ark:- ark:-
        6548 | transform-feats exp/tri3b/final.mat ark:- ark:-
        8920 Aborted (core dumped) | transform-feats
        --utt2spk=ark:data/test/split1/1/utt2spk "ark:cat exp/tri3b/decode/trans.
      • |" ark:- ark:- WARNING (copy-feats:Close():kaldi-io.cc:446) Pipe
        apply-cmvn --utt2spk=ark:data/test/split1/1/utt2spk
        scp:data/test/split1/1/cmvn.scp scp:data/test/split1/1/feats.scp ark:- |
        splice-feats --left-context=3 --right-context=3 ark:- ark:- |
        transform-feats exp/tri3b/final.mat ark:- ark:- | transform-feats
        --utt2spk=ark:data/test/split1/1/utt2spk "ark:cat exp/tri3b/decode/trans.*|" ark:- ark:- | had nonzero return status 34304
        LOG (copy-feats:main():copy-feats.cc:99) Copied 0 feature matrices.
        Accounting: time=4 threads=1 Ended (code 256) at Sat May 3 17:29:13 2014,
        elapsed time 4 seconds

      i hope you can help me!thank you very much .

      karel's dnn error
      https://sourceforge.net/p/kaldi/discussion/1355348/thread/89d7cfca/?limit=50#bb1e


      Sent from sourceforge.net because you indicated interest in
      https://sourceforge.net/p/kaldi/discussion/1355348/

      To unsubscribe from further messages, please visit
      https://sourceforge.net/auth/subscriptions/

       
      • wbgxx333

        wbgxx333 - 2014-05-04

        thank you very much!i will test it.

         
MongoDB Logo MongoDB