Menu
▾
▴
[moses-smt/mosesdecoder] 01c2b0: FIXED OPTION FOR FUTURE DISTORTION COST [Moore & Q...
|
From: GitHub <no...@gi...> - 2012-09-13 12:37:17
|
Branch: refs/heads/master Home: https://github.com/moses-smt/mosesdecoder Commit: 01c2b001b1008d94297008a0ce7e6682a7360b99 https://github.com/moses-smt/mosesdecoder/commit/01c2b001b1008d94297008a0ce7e6682a7360b99 Author: Arianna Bisazza <ari...@gm...> Date: 2012-06-21 (Thu, 21 Jun 2012) Changed paths: M moses/src/DummyScoreProducers.cpp M moses/src/Parameter.cpp M moses/src/StaticData.cpp M moses/src/StaticData.h M moses/src/WordsRange.h Log Message: ----------- FIXED OPTION FOR FUTURE DISTORTION COST [Moore & Quirk 2007] Summary of changes 1) DistortionScoreProducer::CalculateDistortionScore The previous implementation had the following bugs: - wasn't correctly converting size_t to int - in initial (empty) hypothesis, prefixEndPos was -2 instead of -1 - nb of words between phrases was always one too much 2) DistortionScoreProducer::Evaluate The new distortion state was assgined the first gap of the old hypothesis (it should be the current's) 3) WordsRange::GetNumWordsBetween It returned one word too much. For instance the nb of words between [0..1] and [2..3] was 1, now it's 0. 4) Parameter.cpp, StaticData.cpp, StaticData.h Added binary option to activate future distortion cost (fdc) and corresponding StaticData's variable Commit: 5231312805f3d214fd1d09a8965c4f7b1c02626f https://github.com/moses-smt/mosesdecoder/commit/5231312805f3d214fd1d09a8965c4f7b1c02626f Author: Arianna Bisazza <ari...@gm...> Date: 2012-09-13 (Thu, 13 Sep 2012) Changed paths: M moses/src/DummyScoreProducers.cpp M moses/src/Parameter.cpp M moses/src/StaticData.cpp M moses/src/StaticData.h Log Message: ----------- changed parameter name from future-distortion-cost to early-distortion-cost Commit: 468b88ca67575fa119b6bea42ecf0e28cf311210 https://github.com/moses-smt/mosesdecoder/commit/468b88ca67575fa119b6bea42ecf0e28cf311210 Author: Arianna Bisazza <ari...@gm...> Date: 2012-09-13 (Thu, 13 Sep 2012) Changed paths: A .gitmodules M Jamroot A NOTICE M OnDiskPt/OnDiskWrapper.h M OnDiskPt/Phrase.h M OnDiskPt/PhraseNode.h M OnDiskPt/SourcePhrase.h M OnDiskPt/TargetPhrase.h M OnDiskPt/TargetPhraseCollection.h M OnDiskPt/Vocab.cpp M OnDiskPt/Vocab.h M OnDiskPt/Word.h M bjam R contrib/Extract_TMX_Corpus/Extract_TMX_Corpus.py R contrib/Extract_TMX_Corpus/Extract_TMX_Corpus.rsrc.py R contrib/Extract_TMX_Corpus/LanguageCodes.txt R contrib/Extract_TMX_Corpus/LanguagePairs.txt R contrib/Extract_TMX_Corpus/_READ_ME_FIRST.txt R contrib/Extract_TMX_Corpus/gpl.txt R contrib/Moses2TMX/LanguageCodes.txt R contrib/Moses2TMX/Moses2TMX.py R contrib/Moses2TMX/Moses2TMX.rsrc.py R contrib/Moses2TMX/_READ_ME_FIRST.txt R contrib/Moses2TMX/gpl.txt A contrib/fuzzy-match/Makefile A contrib/fuzzy-match/Match.h A contrib/fuzzy-match/SentenceAlignment.h A contrib/fuzzy-match/SuffixArray.cpp A contrib/fuzzy-match/SuffixArray.h A contrib/fuzzy-match/Util.cpp A contrib/fuzzy-match/Util.h A contrib/fuzzy-match/Vocabulary.cpp A contrib/fuzzy-match/Vocabulary.h A contrib/fuzzy-match/fuzzy-match2.cpp A contrib/fuzzy-match/fuzzy-match2.h A contrib/fuzzy-match/make-xml-from-match.perl A contrib/fuzzy-match/old/fuzzy-match.cpp A contrib/fuzzy-match/old/get-multiple-translations-for-uniq-sources.perl A contrib/fuzzy-match/old/make-pt-from-tm.perl A contrib/fuzzy-match/old/make-pt-from-tm2.perl A contrib/fuzzy-match/old/make-xml-from-match-multiple.perl A contrib/fuzzy-match/suffix-test.cpp A contrib/iSenWeb/Introduction/iSenWeb A Web-based Machine Translation System to Translate Sentences.docx A contrib/iSenWeb/Introduction/iSenWeb A Web-based Machine Translation System to Translate Sentences.pdf A contrib/iSenWeb/index.html A contrib/iSenWeb/jquery-1.7.2.js A contrib/iSenWeb/moses.pl A contrib/iSenWeb/themes/images/common/Logo (1000x300).png A contrib/iSenWeb/themes/images/common/Logo (2000x2000).png A contrib/iSenWeb/themes/images/common/Logo (250x250).png A contrib/iSenWeb/themes/images/common/Logo (500x500).png A contrib/iSenWeb/themes/images/common/Logo.png A contrib/iSenWeb/themes/images/common/Logo_lab.png A contrib/iSenWeb/themes/images/common/header_bg.png A contrib/iSenWeb/themes/images/common/ico_cor10.png A contrib/iSenWeb/themes/images/common/icon_feedback.png A contrib/iSenWeb/themes/images/common/logo_christmas.png A contrib/iSenWeb/themes/images/common/logo_christmas1.png A contrib/iSenWeb/themes/images/common/logo_christmas2.png A contrib/iSenWeb/themes/images/common/logo_christmas3.png A contrib/iSenWeb/themes/images/common/nav_bgn.png A contrib/iSenWeb/themes/images/common/sidebar_bg.png A contrib/iSenWeb/themes/images/fanyi/fanyi_sprite.png A contrib/iSenWeb/themes/images/fanyi/inputTextBg.png A contrib/iSenWeb/themes/images/search/s.png A contrib/iSenWeb/themes/styles/common.css A contrib/iSenWeb/themes/styles/fanyi.css A contrib/iSenWeb/themes/styles/search.css A contrib/iSenWeb/trans_result.php R contrib/lmserver/INSTALL A contrib/mert-moses-multi.pl R contrib/moses-for-mere-mortals/READ_ME_FIRST.txt R contrib/moses-for-mere-mortals/Windows-add-ins/Extract_TMX_Corpus-1.043/Extract_TMX_Corpus.py R contrib/moses-for-mere-mortals/Windows-add-ins/Extract_TMX_Corpus-1.043/Extract_TMX_Corpus.rsrc.py R contrib/moses-for-mere-mortals/Windows-add-ins/Extract_TMX_Corpus-1.043/LanguageCodes.txt R contrib/moses-for-mere-mortals/Windows-add-ins/Extract_TMX_Corpus-1.043/LanguagePairs.txt R contrib/moses-for-mere-mortals/Windows-add-ins/Extract_TMX_Corpus-1.043/_READ_ME_FIRST.txt R contrib/moses-for-mere-mortals/Windows-add-ins/Extract_TMX_Corpus-1.043/gpl.txt R contrib/moses-for-mere-mortals/Windows-add-ins/Moses2TMX-1.032/LanguageCodes.txt R contrib/moses-for-mere-mortals/Windows-add-ins/Moses2TMX-1.032/Moses2TMX.py R contrib/moses-for-mere-mortals/Windows-add-ins/Moses2TMX-1.032/Moses2TMX.rsrc.py R contrib/moses-for-mere-mortals/Windows-add-ins/Moses2TMX-1.032/_READ_ME_FIRST.txt R contrib/moses-for-mere-mortals/Windows-add-ins/Moses2TMX-1.032/gpl.txt R contrib/moses-for-mere-mortals/all.css R contrib/moses-for-mere-mortals/docs/Help-Tutorial.doc R contrib/moses-for-mere-mortals/docs/Overview.jpeg R contrib/moses-for-mere-mortals/docs/Quick-Start-Guide.doc R contrib/moses-for-mere-mortals/docs/all.css R contrib/moses-for-mere-mortals/docs/thanks.html R contrib/moses-for-mere-mortals/index.html R contrib/moses-for-mere-mortals/scripts/create-1.37 R contrib/moses-for-mere-mortals/scripts/make-test-files-0.14 R contrib/moses-for-mere-mortals/scripts/modified-scripts/READ_ME_FIRST R contrib/moses-for-mere-mortals/scripts/modified-scripts/mert-moses-new-modif.pl R contrib/moses-for-mere-mortals/scripts/modified-scripts/nonbreaking_prefix.pt R contrib/moses-for-mere-mortals/scripts/score-0.85 R contrib/moses-for-mere-mortals/scripts/train-1.11 R contrib/moses-for-mere-mortals/scripts/transfer-training-to-another-location-0.07 R contrib/moses-for-mere-mortals/scripts/translate-1.32 M contrib/other-builds/CreateOnDisk.vcxproj M contrib/other-builds/OnDiskPt.vcxproj M contrib/other-builds/OnDiskPt/.cproject A contrib/other-builds/fuzzy-match.xcodeproj/project.pbxproj A contrib/other-builds/fuzzy-match.xcodeproj/xcuserdata/hieuhoang.xcuserdatad/xcdebugger/Breakpoints.xcbkptlist A contrib/other-builds/fuzzy-match.xcodeproj/xcuserdata/hieuhoang.xcuserdatad/xcschemes/fuzzy-match.xcscheme A contrib/other-builds/fuzzy-match.xcodeproj/xcuserdata/hieuhoang.xcuserdatad/xcschemes/fuzzy-match2.xcscheme A contrib/other-builds/fuzzy-match.xcodeproj/xcuserdata/hieuhoang.xcuserdatad/xcschemes/xcschememanagement.plist A contrib/other-builds/kbmira.xcodeproj/project.pbxproj M contrib/other-builds/kenlm.vcxproj M contrib/other-builds/lm.xcodeproj/project.pbxproj A contrib/other-builds/lm.xcodeproj/xcuserdata/hieuhoang.xcuserdatad/xcschemes/lm.xcscheme A contrib/other-builds/lm.xcodeproj/xcuserdata/hieuhoang.xcuserdatad/xcschemes/xcschememanagement.plist M contrib/other-builds/lm/.cproject M contrib/other-builds/lm/.project A contrib/other-builds/mert.xcodeproj/project.pbxproj A contrib/other-builds/mert.xcodeproj/project.xcworkspace/contents.xcworkspacedata A contrib/other-builds/mert.xcodeproj/project.xcworkspace/xcuserdata/hieuhoang.xcuserdatad/UserInterfaceState.xcuserstate A contrib/other-builds/mert.xcodeproj/xcuserdata/hieuhoang.xcuserdatad/xcdebugger/Breakpoints.xcbkptlist A contrib/other-builds/mert.xcodeproj/xcuserdata/hieuhoang.xcuserdatad/xcschemes/extractor.xcscheme A contrib/other-builds/mert.xcodeproj/xcuserdata/hieuhoang.xcuserdatad/xcschemes/mert.xcscheme A contrib/other-builds/mert.xcodeproj/xcuserdata/hieuhoang.xcuserdatad/xcschemes/xcschememanagement.plist A contrib/other-builds/mert_lib.xcodeproj/project.pbxproj A contrib/other-builds/mert_lib.xcodeproj/xcuserdata/hieuhoang.xcuserdatad/xcschemes/mert_lib.xcscheme A contrib/other-builds/mert_lib.xcodeproj/xcuserdata/hieuhoang.xcuserdatad/xcschemes/xcschememanagement.plist M contrib/other-builds/moses-chart-cmd.vcxproj M contrib/other-builds/moses-chart-cmd.xcodeproj/project.pbxproj M contrib/other-builds/moses-cmd.vcxproj M contrib/other-builds/moses-cmd.xcodeproj/project.pbxproj A contrib/other-builds/moses-cmd.xcodeproj/xcuserdata/hieuhoang.xcuserdatad/xcschemes/moses-cmd.xcscheme A contrib/other-builds/moses-cmd.xcodeproj/xcuserdata/hieuhoang.xcuserdatad/xcschemes/xcschememanagement.plist M contrib/other-builds/moses-cmd/.cproject M contrib/other-builds/moses.sln M contrib/other-builds/moses.vcxproj M contrib/other-builds/moses.xcodeproj/project.pbxproj M contrib/other-builds/moses/.cproject M contrib/other-builds/moses/.project A contrib/other-builds/mosesserver.vcxproj A contrib/other-builds/processLexicalTableMin.xcodeproj/project.pbxproj A contrib/other-builds/processPhraseTableMin.xcodeproj/project.pbxproj A contrib/other-builds/query.sln A contrib/other-builds/query.vcxproj M contrib/other-builds/util/.cproject A contrib/python/README.md A contrib/python/binpt/binpt.cpp A contrib/python/binpt/binpt.pxd A contrib/python/binpt/binpt.pyx A contrib/python/example.py A contrib/python/setup.py A contrib/relent-filter/AUTHORS A contrib/relent-filter/README.txt A contrib/relent-filter/scripts/calcEmpiricalDistribution.pl A contrib/relent-filter/scripts/calcPruningScores.pl A contrib/relent-filter/scripts/interpolateScores.pl A contrib/relent-filter/scripts/prunePT.pl A contrib/relent-filter/sigtest-filter/Makefile A contrib/relent-filter/sigtest-filter/README.txt A contrib/relent-filter/sigtest-filter/WIN32_functions.cpp A contrib/relent-filter/sigtest-filter/WIN32_functions.h A contrib/relent-filter/sigtest-filter/check-install A contrib/relent-filter/sigtest-filter/filter-pt.cpp A contrib/relent-filter/sigtest-filter/sigtest-filter.sln A contrib/relent-filter/src/IOWrapper.cpp A contrib/relent-filter/src/IOWrapper.h A contrib/relent-filter/src/Jamfile A contrib/relent-filter/src/LatticeMBR.cpp A contrib/relent-filter/src/LatticeMBR.h A contrib/relent-filter/src/LatticeMBRGrid.cpp A contrib/relent-filter/src/Main.cpp A contrib/relent-filter/src/Main.h A contrib/relent-filter/src/RelativeEntropyCalc.cpp A contrib/relent-filter/src/RelativeEntropyCalc.h A contrib/relent-filter/src/TranslationAnalysis.cpp A contrib/relent-filter/src/TranslationAnalysis.h A contrib/relent-filter/src/mbr.cpp A contrib/relent-filter/src/mbr.h R contrib/reranking/data/README R contrib/reranking/data/nbest.small R contrib/reranking/data/weights R contrib/reranking/src/Hypo.cpp R contrib/reranking/src/Hypo.h R contrib/reranking/src/Main.cpp R contrib/reranking/src/Makefile R contrib/reranking/src/NBest.cpp R contrib/reranking/src/NBest.h R contrib/reranking/src/ParameterNBest.cpp R contrib/reranking/src/ParameterNBest.h R contrib/reranking/src/Tools.cpp R contrib/reranking/src/Tools.h A contrib/server/Translation-web/src/conf/MANIFEST.MF A contrib/server/Translation-web/src/java/com/hpl/mt/Translate.java A contrib/server/Translation-web/web/META-INF/context.xml A contrib/server/Translation-web/web/WEB-INF/web.xml A contrib/server/Translation-web/web/css/common.css A contrib/server/Translation-web/web/index.html A contrib/server/Translation-web/web/lib/jquery-1.6.4.js A contrib/server/Translation-web/web/lib/jquery-ui-1.8.16.custom.js M contrib/server/mosesserver.cpp M contrib/sigtest-filter/Makefile M contrib/sigtest-filter/filter-pt.cpp M contrib/tmcombine/README.md M contrib/tmcombine/tmcombine.py R contrib/tmcombine/train_model.patch M contrib/web/bin/daemon.pl M cruise-control/test_all_new_commits.sh A jam-files/fail/Jamroot M jam-files/sanity.jam M lm/Jamfile M lm/binary_format.cc M lm/build_binary.cc M lm/config.cc M lm/config.hh M lm/left.hh M lm/left_test.cc A lm/max_order.cc R lm/max_order.hh M lm/model.cc M lm/model.hh M lm/model_test.cc M lm/model_type.hh M lm/ngram_query.cc M lm/ngram_query.hh M lm/quantize.cc M lm/quantize.hh M lm/read_arpa.cc M lm/read_arpa.hh M lm/return.hh M lm/search_hashed.cc M lm/search_hashed.hh M lm/search_trie.cc M lm/search_trie.hh A lm/state.hh M lm/trie.cc M lm/trie.hh M lm/trie_sort.cc M lm/trie_sort.hh A lm/value.hh A lm/value_build.cc A lm/value_build.hh M lm/vocab.cc M lm/vocab.hh M lm/weights.hh M mert/BleuScorer.cpp M mert/BleuScorer.h M mert/BleuScorerTest.cpp M mert/CderScorer.cpp M mert/CderScorer.h M mert/Data.cpp M mert/Data.h M mert/DataTest.cpp M mert/Fdstream.h M mert/FeatureArray.cpp M mert/FeatureArray.h M mert/FeatureData.cpp M mert/FeatureData.h M mert/FeatureDataIterator.cpp M mert/FeatureDataIterator.h M mert/FeatureDataTest.cpp M mert/FeatureStats.cpp M mert/FeatureStats.h M mert/HypPackEnumerator.cpp M mert/HypPackEnumerator.h M mert/InterpolatedScorer.cpp M mert/InterpolatedScorer.h M mert/Jamfile M mert/MergeScorer.cpp M mert/MergeScorer.h M mert/MiraFeatureVector.cpp M mert/MiraFeatureVector.h M mert/MiraWeightVector.cpp M mert/MiraWeightVector.h M mert/Ngram.h M mert/NgramTest.cpp M mert/Optimizer.cpp M mert/Optimizer.h M mert/OptimizerFactory.cpp M mert/OptimizerFactory.h M mert/OptimizerFactoryTest.cpp M mert/PerScorer.cpp M mert/PerScorer.h A mert/Permutation.cpp A mert/Permutation.h A mert/PermutationScorer.cpp A mert/PermutationScorer.h M mert/Point.cpp M mert/Point.h M mert/PointTest.cpp M mert/PreProcessFilter.cpp M mert/PreProcessFilter.h M mert/Reference.h M mert/ReferenceTest.cpp M mert/ScopedVector.h M mert/ScoreArray.cpp M mert/ScoreArray.h M mert/ScoreData.cpp M mert/ScoreData.h M mert/ScoreDataIterator.cpp M mert/ScoreDataIterator.h M mert/ScoreStats.cpp M mert/ScoreStats.h M mert/Scorer.cpp M mert/Scorer.h M mert/ScorerFactory.cpp M mert/ScorerFactory.h M mert/SemposOverlapping.cpp M mert/SemposOverlapping.h M mert/SemposScorer.cpp M mert/SemposScorer.h A mert/SentenceLevelScorer.cpp A mert/SentenceLevelScorer.h M mert/Singleton.h M mert/SingletonTest.cpp A mert/StatisticsBasedScorer.cpp A mert/StatisticsBasedScorer.h M mert/TerScorer.cpp M mert/TerScorer.h M mert/Timer.cpp M mert/Timer.h M mert/TimerTest.cpp M mert/Types.h M mert/Util.cpp M mert/Util.h M mert/UtilTest.cpp M mert/Vocabulary.cpp M mert/Vocabulary.h M mert/VocabularyTest.cpp M mert/evaluator.cpp M mert/extractor.cpp M mert/kbmira.cpp M mert/mert.cpp M mert/pro.cpp M misc/Jamfile R misc/pmoses/COPYING R misc/pmoses/INSTALL A misc/processLexicalTableMin.cpp A misc/processPhraseTableMin.cpp M moses-chart-cmd/src/IOWrapper.cpp M moses-chart-cmd/src/IOWrapper.h M moses-chart-cmd/src/Main.cpp M moses-chart-cmd/src/Main.h M moses-chart-cmd/src/TranslationAnalysis.h M moses-cmd/src/IOWrapper.cpp M moses-cmd/src/IOWrapper.h M moses-cmd/src/LatticeMBR.cpp M moses-cmd/src/LatticeMBR.h M moses-cmd/src/LatticeMBRGrid.cpp M moses-cmd/src/Main.cpp M moses/src/AlignmentInfo.h M moses/src/AlignmentInfoCollection.cpp M moses/src/AlignmentInfoCollection.h M moses/src/BilingualDynSuffixArray.cpp M moses/src/BilingualDynSuffixArray.h M moses/src/BitmapContainer.cpp M moses/src/BitmapContainer.h M moses/src/CYKPlusParser/ChartRuleLookupManagerCYKPlus.cpp M moses/src/CYKPlusParser/ChartRuleLookupManagerCYKPlus.h M moses/src/CYKPlusParser/ChartRuleLookupManagerMemory.cpp M moses/src/CYKPlusParser/ChartRuleLookupManagerMemory.h A moses/src/CYKPlusParser/ChartRuleLookupManagerMemoryPerSentence.cpp A moses/src/CYKPlusParser/ChartRuleLookupManagerMemoryPerSentence.h M moses/src/CYKPlusParser/ChartRuleLookupManagerOnDisk.h M moses/src/CYKPlusParser/DotChart.h M moses/src/CYKPlusParser/DotChartInMemory.h M moses/src/CYKPlusParser/DotChartOnDisk.h R moses/src/CellCollection.h M moses/src/ChartCell.cpp M moses/src/ChartCell.h M moses/src/ChartCellCollection.cpp M moses/src/ChartCellCollection.h M moses/src/ChartCellLabel.h M moses/src/ChartCellLabelSet.h M moses/src/ChartHypothesis.cpp M moses/src/ChartHypothesis.h M moses/src/ChartHypothesisCollection.cpp M moses/src/ChartHypothesisCollection.h M moses/src/ChartManager.cpp M moses/src/ChartManager.h M moses/src/ChartRuleLookupManager.h M moses/src/ChartTranslationOption.h M moses/src/ChartTranslationOptionCollection.h M moses/src/ChartTranslationOptionList.h M moses/src/ChartTrellisDetour.h M moses/src/ChartTrellisDetourQueue.h M moses/src/ChartTrellisNode.h M moses/src/ChartTrellisPath.h A moses/src/CompactPT/BlockHashIndex.cpp A moses/src/CompactPT/BlockHashIndex.h A moses/src/CompactPT/CanonicalHuffman.h A moses/src/CompactPT/CmphStringVectorAdapter.cpp A moses/src/CompactPT/CmphStringVectorAdapter.h A moses/src/CompactPT/ConsistentPhrases.h A moses/src/CompactPT/Jamfile A moses/src/CompactPT/LexicalReorderingTableCompact.cpp A moses/src/CompactPT/LexicalReorderingTableCompact.h A moses/src/CompactPT/LexicalReorderingTableCreator.cpp A moses/src/CompactPT/LexicalReorderingTableCreator.h A moses/src/CompactPT/ListCoders.h A moses/src/CompactPT/MmapAllocator.h A moses/src/CompactPT/MonotonicVector.h A moses/src/CompactPT/MurmurHash3.cpp A moses/src/CompactPT/MurmurHash3.h A moses/src/CompactPT/PackedArray.h A moses/src/CompactPT/PhraseDecoder.cpp A moses/src/CompactPT/PhraseDecoder.h A moses/src/CompactPT/PhraseDictionaryCompact.cpp A moses/src/CompactPT/PhraseDictionaryCompact.h A moses/src/CompactPT/PhraseTableCreator.cpp A moses/src/CompactPT/PhraseTableCreator.h A moses/src/CompactPT/StringVector.h A moses/src/CompactPT/TargetPhraseCollectionCache.h A moses/src/CompactPT/ThrowingFwrite.cpp A moses/src/CompactPT/ThrowingFwrite.h M moses/src/ConfusionNet.h M moses/src/DecodeFeature.h M moses/src/DecodeGraph.h M moses/src/DecodeStep.h M moses/src/Dictionary.cpp M moses/src/Dictionary.h M moses/src/DummyScoreProducers.h A moses/src/DynSAInclude/FileHandler.cpp A moses/src/DynSAInclude/FileHandler.h M moses/src/DynSAInclude/RandLMCache.h M moses/src/DynSAInclude/RandLMFilter.h R moses/src/DynSAInclude/file.cpp R moses/src/DynSAInclude/file.h M moses/src/DynSAInclude/hash.h M moses/src/DynSAInclude/onlineRLM.h M moses/src/DynSAInclude/params.h M moses/src/DynSAInclude/perfectHash.h M moses/src/DynSAInclude/quantizer.h M moses/src/DynSAInclude/types.h M moses/src/DynSAInclude/utils.h M moses/src/DynSAInclude/vocab.h M moses/src/DynSuffixArray.h M moses/src/FFState.h M moses/src/Factor.h M moses/src/FactorCollection.cpp M moses/src/FactorCollection.h M moses/src/FactorTypeSet.h M moses/src/FeatureFunction.h M moses/src/FilePtr.h M moses/src/GenerationDictionary.cpp M moses/src/GlobalLexicalModel.h M moses/src/HypoList.h M moses/src/Hypothesis.cpp M moses/src/Hypothesis.h M moses/src/HypothesisStack.h M moses/src/HypothesisStackCubePruning.h M moses/src/HypothesisStackNormal.h M moses/src/InputType.h M moses/src/Jamfile M moses/src/LM/Base.h M moses/src/LM/IRST.cpp M moses/src/LM/IRST.h M moses/src/LM/Implementation.h M moses/src/LM/Jamfile M moses/src/LM/Joint.h M moses/src/LM/Ken.cpp M moses/src/LM/Ken.h M moses/src/LM/LDHT.cpp M moses/src/LM/MultiFactor.h M moses/src/LM/ORLM.h M moses/src/LM/ParallelBackoff.h M moses/src/LM/Remote.h M moses/src/LM/SRI.h M moses/src/LMList.h M moses/src/LVoc.h M moses/src/LexicalReordering.h M moses/src/LexicalReorderingState.cpp M moses/src/LexicalReorderingState.h M moses/src/LexicalReorderingTable.cpp M moses/src/LexicalReorderingTable.h M moses/src/Manager.cpp M moses/src/Manager.h M moses/src/NonTerminal.h M moses/src/OutputCollector.h M moses/src/PCNTools.h M moses/src/PDTAimp.h M moses/src/Parameter.cpp M moses/src/Parameter.h M moses/src/PartialTranslOptColl.h M moses/src/Phrase.h M moses/src/PhraseDictionary.cpp M moses/src/PhraseDictionaryDynSuffixArray.cpp M moses/src/PhraseDictionaryDynSuffixArray.h M moses/src/PhraseDictionaryMemory.cpp M moses/src/PhraseDictionaryNode.h M moses/src/PhraseDictionaryTree.h M moses/src/PhraseDictionaryTreeAdaptor.h M moses/src/PrefixTree.h M moses/src/PrefixTreeMap.h M moses/src/ReorderingConstraint.h M moses/src/ReorderingStack.h M moses/src/RuleCube.h M moses/src/RuleCubeItem.h M moses/src/RuleCubeQueue.h M moses/src/RuleTable/Jamfile M moses/src/RuleTable/Loader.h M moses/src/RuleTable/LoaderCompact.h M moses/src/RuleTable/LoaderFactory.cpp M moses/src/RuleTable/LoaderFactory.h M moses/src/RuleTable/LoaderHiero.h M moses/src/RuleTable/LoaderStandard.cpp M moses/src/RuleTable/LoaderStandard.h M moses/src/RuleTable/PhraseDictionaryALSuffixArray.cpp M moses/src/RuleTable/PhraseDictionaryALSuffixArray.h A moses/src/RuleTable/PhraseDictionaryFuzzyMatch.cpp A moses/src/RuleTable/PhraseDictionaryFuzzyMatch.h M moses/src/RuleTable/PhraseDictionaryNodeSCFG.h M moses/src/RuleTable/PhraseDictionaryOnDisk.cpp M moses/src/RuleTable/PhraseDictionaryOnDisk.h M moses/src/RuleTable/PhraseDictionarySCFG.h M moses/src/RuleTable/Trie.h M moses/src/RuleTable/UTrie.h M moses/src/RuleTable/UTrieNode.h M moses/src/Scope3Parser/ApplicableRuleTrie.h M moses/src/Scope3Parser/IntermediateVarSpanNode.h M moses/src/Scope3Parser/Parser.h M moses/src/Scope3Parser/StackLattice.h M moses/src/Scope3Parser/StackLatticeBuilder.h M moses/src/Scope3Parser/VarSpanNode.h M moses/src/Scope3Parser/VarSpanTrieBuilder.h M moses/src/ScoreIndexManager.h M moses/src/Search.cpp M moses/src/Search.h M moses/src/SearchCubePruning.h M moses/src/SearchNormal.h A moses/src/SearchNormalBatch.cpp A moses/src/SearchNormalBatch.h M moses/src/Sentence.h M moses/src/SentenceStats.h M moses/src/SquareMatrix.h M moses/src/StaticData.cpp M moses/src/StaticData.h M moses/src/TargetPhrase.h M moses/src/ThreadPool.h M moses/src/Timer.cpp M moses/src/Timer.h M moses/src/TranslationOptionCollection.cpp M moses/src/TranslationOptionCollection.h M moses/src/TranslationOptionCollectionConfusionNet.h M moses/src/TranslationOptionCollectionText.h M moses/src/TranslationOptionList.h M moses/src/TranslationSystem.cpp M moses/src/TranslationSystem.h M moses/src/TreeInput.h M moses/src/TrellisPath.h M moses/src/TrellisPathCollection.h M moses/src/TrellisPathList.h M moses/src/TypeDef.h M moses/src/UniqueObject.h M moses/src/UserMessage.h M moses/src/Util.cpp M moses/src/Util.h M moses/src/Word.cpp M moses/src/Word.h M moses/src/WordLattice.h M moses/src/WordsRange.h A moses/src/fuzzy-match/FuzzyMatchWrapper.cpp A moses/src/fuzzy-match/FuzzyMatchWrapper.h A moses/src/fuzzy-match/Jamfile A moses/src/fuzzy-match/Match.h A moses/src/fuzzy-match/SentenceAlignment.cpp A moses/src/fuzzy-match/SentenceAlignment.h A moses/src/fuzzy-match/SuffixArray.cpp A moses/src/fuzzy-match/SuffixArray.h A moses/src/fuzzy-match/Vocabulary.cpp A moses/src/fuzzy-match/Vocabulary.h M moses/src/gzfilebuf.h M phrase-extract/AlignmentPhrase.cpp M phrase-extract/AlignmentPhrase.h M phrase-extract/ExtractedRule.cpp M phrase-extract/ExtractedRule.h M phrase-extract/Hole.h M phrase-extract/HoleCollection.cpp M phrase-extract/HoleCollection.h M phrase-extract/Jamfile M phrase-extract/PhraseAlignment.cpp M phrase-extract/PhraseAlignment.h A phrase-extract/PhraseExtractionOptions.h M phrase-extract/RuleExist.h M phrase-extract/RuleExtractionOptions.h M phrase-extract/SentenceAlignment.cpp M phrase-extract/SentenceAlignment.h M phrase-extract/SentenceAlignmentWithSyntax.cpp M phrase-extract/SentenceAlignmentWithSyntax.h M phrase-extract/SyntaxTree.cpp M phrase-extract/SyntaxTree.h M phrase-extract/XmlException.h M phrase-extract/XmlTree.cpp M phrase-extract/XmlTree.h M phrase-extract/consolidate.cpp A phrase-extract/domain.cpp A phrase-extract/domain.h M phrase-extract/extract-ghkm/XmlTreeParser.cpp M phrase-extract/extract-ghkm/XmlTreeParser.h M phrase-extract/extract-lex.cpp M phrase-extract/extract-lex.h M phrase-extract/extract-rules.cpp M phrase-extract/extract.cpp M phrase-extract/extract.xcodeproj/project.pbxproj M phrase-extract/hierarchical.h M phrase-extract/pcfg-common/xml_tree_parser.cc M phrase-extract/pcfg-common/xml_tree_parser.h M phrase-extract/relax-parse.cpp M phrase-extract/relax-parse.h M phrase-extract/score.cpp M phrase-extract/score.h M phrase-extract/statistics.cpp M phrase-extract/tables-core.cpp M phrase-extract/tables-core.h M regression-testing/Jamfile M regression-testing/MosesRegressionTesting.pm A regression-testing/tests M scripts/Jamfile M scripts/analysis/weight-scan.pl M scripts/ems/example/config.basic M scripts/ems/example/config.factored M scripts/ems/example/config.hierarchical M scripts/ems/example/config.syntax M scripts/ems/example/config.toy M scripts/ems/experiment.meta M scripts/ems/experiment.perl M scripts/ems/support/analysis.perl A scripts/ems/support/build-domain-file-from-subcorpora.perl A scripts/ems/support/build-sparse-lexical-features.perl M scripts/ems/support/reuse-weights.perl M scripts/ems/support/run-command-on-multiple-refsets.perl M scripts/ems/support/split-sentences.perl A scripts/ems/support/train-irstlm.perl A scripts/fuzzy-match/create_xml.perl M scripts/generic/compound-splitter.perl M scripts/generic/extract-parallel.perl M scripts/generic/multi-bleu.perl M scripts/generic/score-parallel.perl M scripts/generic/trainlm-irst.perl M scripts/recaser/recase.perl M scripts/recaser/train-recaser.perl A scripts/share/nonbreaking_prefixes/README.txt A scripts/share/nonbreaking_prefixes/nonbreaking_prefix.ca A scripts/share/nonbreaking_prefixes/nonbreaking_prefix.cs A scripts/share/nonbreaking_prefixes/nonbreaking_prefix.de A scripts/share/nonbreaking_prefixes/nonbreaking_prefix.el A scripts/share/nonbreaking_prefixes/nonbreaking_prefix.en A scripts/share/nonbreaking_prefixes/nonbreaking_prefix.es A scripts/share/nonbreaking_prefixes/nonbreaking_prefix.fr A scripts/share/nonbreaking_prefixes/nonbreaking_prefix.is A scripts/share/nonbreaking_prefixes/nonbreaking_prefix.it A scripts/share/nonbreaking_prefixes/nonbreaking_prefix.nl A scripts/share/nonbreaking_prefixes/nonbreaking_prefix.pl A scripts/share/nonbreaking_prefixes/nonbreaking_prefix.pt A scripts/share/nonbreaking_prefixes/nonbreaking_prefix.ro A scripts/share/nonbreaking_prefixes/nonbreaking_prefix.ru A scripts/share/nonbreaking_prefixes/nonbreaking_prefix.sk A scripts/share/nonbreaking_prefixes/nonbreaking_prefix.sl A scripts/share/nonbreaking_prefixes/nonbreaking_prefix.sv M scripts/tokenizer/deescape-special-chars.perl M scripts/tokenizer/detokenizer.perl M scripts/tokenizer/escape-special-chars.perl R scripts/tokenizer/nonbreaking_prefixes/README.txt R scripts/tokenizer/nonbreaking_prefixes/nonbreaking_prefix.ca R scripts/tokenizer/nonbreaking_prefixes/nonbreaking_prefix.de R scripts/tokenizer/nonbreaking_prefixes/nonbreaking_prefix.el R scripts/tokenizer/nonbreaking_prefixes/nonbreaking_prefix.en R scripts/tokenizer/nonbreaking_prefixes/nonbreaking_prefix.es R scripts/tokenizer/nonbreaking_prefixes/nonbreaking_prefix.fr R scripts/tokenizer/nonbreaking_prefixes/nonbreaking_prefix.is R scripts/tokenizer/nonbreaking_prefixes/nonbreaking_prefix.it R scripts/tokenizer/nonbreaking_prefixes/nonbreaking_prefix.nl R scripts/tokenizer/nonbreaking_prefixes/nonbreaking_prefix.pl R scripts/tokenizer/nonbreaking_prefixes/nonbreaking_prefix.pt R scripts/tokenizer/nonbreaking_prefixes/nonbreaking_prefix.ro R scripts/tokenizer/nonbreaking_prefixes/nonbreaking_prefix.ru R scripts/tokenizer/nonbreaking_prefixes/nonbreaking_prefix.sk R scripts/tokenizer/nonbreaking_prefixes/nonbreaking_prefix.sl R scripts/tokenizer/nonbreaking_prefixes/nonbreaking_prefix.sv M scripts/tokenizer/tokenizer.perl A scripts/training/LexicalTranslationModel.pm M scripts/training/absolutize_moses_model.pl M scripts/training/filter-model-given-input.pl A scripts/training/get-lexical.perl R scripts/training/mert-moses-multi.pl M scripts/training/mert-moses.pl A scripts/training/reduce-topt-count.pl M scripts/training/train-model.perl A scripts/training/wrappers/adam-suffix-array/suffix-array-create.sh A scripts/training/wrappers/adam-suffix-array/suffix-array-extract.sh M scripts/training/wrappers/parse-de-berkeley.perl M scripts/training/wrappers/parse-de-bitpar.perl R scripts/training/wrappers/suffix-array-create.sh R scripts/training/wrappers/suffix-array-extract.sh M scripts/training/zmert-moses.pl M util/Jamfile M util/bit_packing.hh M util/ersatz_progress.cc M util/ersatz_progress.hh M util/file.cc M util/file.hh M util/file_piece.cc M util/have.hh M util/mmap.cc M util/murmur_hash.cc M util/murmur_hash.hh M util/probing_hash_table.hh M util/probing_hash_table_test.cc M util/string_piece.hh A util/usage.cc A util/usage.hh M util/util.xcodeproj/project.pbxproj Log Message: ----------- Merge remote branch 'upstream/master' Compare: https://github.com/moses-smt/mosesdecoder/compare/21938e4d940f...468b88ca6757 |
