[Mosesdecoder-commits] SF.net SVN: mosesdecoder: [1227] trunk

[<hie...@us...>]

Revision: 1227
          http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1227&view=rev
Author:   hieuhoang1972
Date:     2007-02-21 11:48:53 -0800 (Wed, 21 Feb 2007)

Log Message:
-----------
change unknown word processing to be closer to the way pharaoh does it - create unknown word whenever single word is not in translation table but penalise hypothesis for using it.

Modified Paths:
--------------
    trunk/moses/src/DummyScoreProducers.cpp
    trunk/moses/src/DummyScoreProducers.h
    trunk/moses/src/GenerationDictionary.cpp
    trunk/moses/src/GenerationDictionary.h
    trunk/moses/src/HypothesisCollection.cpp
    trunk/moses/src/LanguageModel.cpp
    trunk/moses/src/LanguageModel.h
    trunk/moses/src/LanguageModelFactory.cpp
    trunk/moses/src/LanguageModelFactory.h
    trunk/moses/src/LanguageModelInternal.cpp
    trunk/moses/src/LanguageModelInternal.h
    trunk/moses/src/LanguageModelJoint.h
    trunk/moses/src/LanguageModelMultiFactor.cpp
    trunk/moses/src/LanguageModelMultiFactor.h
    trunk/moses/src/LanguageModelSingleFactor.cpp
    trunk/moses/src/LanguageModelSingleFactor.h
    trunk/moses/src/LanguageModelSkip.h
    trunk/moses/src/StaticData.cpp
    trunk/moses/src/StaticData.h
    trunk/moses/src/TranslationOption.cpp
    trunk/moses/src/TranslationOptionCollection.cpp
    trunk/moses-cmd/src/Main.cpp
    trunk/regression-testing/MosesRegressionTesting.pm
    trunk/regression-testing/tests/basic-surface-binptable/truth/results.dat
    trunk/regression-testing/tests/basic-surface-only/truth/results.dat
    trunk/regression-testing/tests/multi-factor/truth/results.dat


This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site.