From: <cha...@us...> - 2010-11-17 14:06:27
|
Revision: 3719 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=3719&view=rev Author: chardmeier Date: 2010-11-17 14:06:21 +0000 (Wed, 17 Nov 2010) Log Message: ----------- Cleaned up language modelling code by disentangling the decoder's LM feature function from the LM toolkit abstraction layer. There are two different groups of classes now: - LanguageModel, which inherits from StatefulFeatureFunction and contains the n-gram model feature function. - LanguageModelImplementation, which is the base class of the individual LM implementations (SRI, IRST, RandLM, KenLM) and provides methods to query LM probabilities and states. Each LanguageModel controls a LanguageModelImplementation. Implementations can be shared by more than one LanguageModel. This should make it easier to use the LM libraries as a backend for other feature functions while retaining the flexibility to use different LM toolkits. Modified Paths: -------------- trunk/moses/src/LanguageModel.cpp trunk/moses/src/LanguageModel.h trunk/moses/src/LanguageModelFactory.cpp trunk/moses/src/LanguageModelIRST.cpp trunk/moses/src/LanguageModelIRST.h trunk/moses/src/LanguageModelInternal.cpp trunk/moses/src/LanguageModelInternal.h trunk/moses/src/LanguageModelJoint.h trunk/moses/src/LanguageModelKen.cpp trunk/moses/src/LanguageModelKen.h trunk/moses/src/LanguageModelMultiFactor.cpp trunk/moses/src/LanguageModelMultiFactor.h trunk/moses/src/LanguageModelParallelBackoff.cpp trunk/moses/src/LanguageModelParallelBackoff.h trunk/moses/src/LanguageModelRandLM.h trunk/moses/src/LanguageModelRemote.cpp trunk/moses/src/LanguageModelRemote.h trunk/moses/src/LanguageModelSRI.cpp trunk/moses/src/LanguageModelSRI.h trunk/moses/src/LanguageModelSingleFactor.cpp trunk/moses/src/LanguageModelSingleFactor.h trunk/moses/src/LanguageModelSkip.h trunk/moses/src/Makefile.am trunk/moses/src/StaticData.cpp Added Paths: ----------- trunk/moses/src/LanguageModelImplementation.cpp trunk/moses/src/LanguageModelImplementation.h Removed Paths: ------------- trunk/moses/src/LanguageModelDelegate.h This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |