Hi,
I am new here, so please forgive me if I am asking somethining stupid.
I created an LM with CMU LM toolkit ver2. following the instructions.
I found messages on the forum about lm3g2dmp utility that I must use to convert the LM to dmp format.
I am running it.
When I am trying to run it with a text LM I am getting a FATAL_ERROR:
INFO: lm3g2dmp.c(704): Reading LM file new_noOOVs.arpa (name "")
INFO: lm3g2dmp.c(726): ngrams 1=5001, 2=1132385, 3=7225048
INFO: lm3g2dmp.c(423): Reading unigrams
FATAL_ERROR: "hash.c", line 141:
hash_add: Error: [am] hash conflict
There are two entries in the dictionary for [am]
Please change or remove one of them and re-run.
And when I am trying to run it with a binary LM created with idngram2lm I am getting a FATAL_ERROR:
INFO: lm3g2dmp.c(704): Reading LM file new_noOOVs.binlm (name "")
FATAL_ERROR: "lm3g2dmp.c", line 380: No \data\ mark in LM file
Thanks.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Hi,
I am new here, so please forgive me if I am asking somethining stupid.
I created an LM with CMU LM toolkit ver2. following the instructions.
I found messages on the forum about lm3g2dmp utility that I must use to convert the LM to dmp format.
I am running it.
When I am trying to run it with a text LM I am getting a FATAL_ERROR:
INFO: lm3g2dmp.c(704): Reading LM file new_noOOVs.arpa (name "")
INFO: lm3g2dmp.c(726): ngrams 1=5001, 2=1132385, 3=7225048
INFO: lm3g2dmp.c(423): Reading unigrams
FATAL_ERROR: "hash.c", line 141:
hash_add: Error: [am] hash conflict
There are two entries in the dictionary for [am]
Please change or remove one of them and re-run.
And when I am trying to run it with a binary LM created with idngram2lm I am getting a FATAL_ERROR:
INFO: lm3g2dmp.c(704): Reading LM file new_noOOVs.binlm (name "")
FATAL_ERROR: "lm3g2dmp.c", line 380: No \data\ mark in LM file
Thanks.
How is your lm look like? -Arthur