From: <hie...@us...> - 2007-01-20 22:03:50
|
Revision: 1130 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1130&view=rev Author: hieuhoang1972 Date: 2007-01-20 14:03:48 -0800 (Sat, 20 Jan 2007) Log Message: ----------- visual studio projects Modified Paths: -------------- trunk/moses/moses.sln Added Paths: ----------- trunk/misc/processPhraseTable.vcproj Removed Paths: ------------- trunk/misc/misc.vcproj This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <mau...@us...> - 2007-02-08 13:48:50
|
Revision: 1189 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1189&view=rev Author: maurocettolo Date: 2007-02-08 05:48:43 -0800 (Thu, 08 Feb 2007) Log Message: ----------- - update of irstlm library: files larger than 4Gb can be handled in mmap (see irstlm/src/*cpp and irstlm/src/*h) - fixed a bug in querying IRST LMs with OOVs (LanguageModelIRST.cpp) - some more checks on config file: if specified, existence of generation and distortion files is checked (Parameter.cpp) - 0 valued entries in binary phrase tables are loaded as 1.0e-38 (PhraseDictionaryTree.cpp) Modified Paths: -------------- trunk/irstlm/src/compile-lm.cpp trunk/irstlm/src/dictionary.cpp trunk/irstlm/src/dictionary.h trunk/irstlm/src/htable.cpp trunk/irstlm/src/htable.h trunk/irstlm/src/lmtable.cpp trunk/irstlm/src/lmtable.h trunk/irstlm/src/n_gram.cpp trunk/irstlm/src/n_gram.h trunk/irstlm/src/ngramcache.cpp trunk/irstlm/src/quantize-lm.cpp trunk/irstlm/src/util.cpp trunk/irstlm/src/util.h trunk/moses/src/LanguageModelIRST.cpp trunk/moses/src/Parameter.cpp trunk/moses/src/PhraseDictionaryTree.cpp This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <hie...@us...> - 2007-02-13 19:17:04
|
Revision: 1209 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1209&view=rev Author: hieuhoang1972 Date: 2007-02-13 11:15:34 -0800 (Tue, 13 Feb 2007) Log Message: ----------- fixed regression test failing. Number of features for generation models MUST be specified in ini file, no backward compatability hack Modified Paths: -------------- trunk/misc/processPhraseTable.vcproj trunk/moses/src/GenerationDictionary.cpp trunk/moses/src/GenerationDictionary.h trunk/moses/src/Parameter.cpp trunk/moses/src/StaticData.cpp trunk/moses-cmd/moses-cmd.vcproj trunk/regression-testing/tests/multi-factor-drop/moses.ini This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <hie...@us...> - 2007-02-16 18:08:39
|
Revision: 1218 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1218&view=rev Author: hieuhoang1972 Date: 2007-02-16 10:08:37 -0800 (Fri, 16 Feb 2007) Log Message: ----------- code cleanup - make FactorCollection and StaticData totally accessible only globally Modified Paths: -------------- trunk/misc/processPhraseTable.cpp trunk/moses/src/ConfusionNet.cpp trunk/moses/src/ConfusionNet.h trunk/moses/src/DecodeStep.h trunk/moses/src/DecodeStepGeneration.cpp trunk/moses/src/DecodeStepGeneration.h trunk/moses/src/DecodeStepTranslation.cpp trunk/moses/src/DecodeStepTranslation.h trunk/moses/src/DummyScoreProducers.cpp trunk/moses/src/FactorCollection.cpp trunk/moses/src/FactorCollection.h trunk/moses/src/GenerationDictionary.cpp trunk/moses/src/GenerationDictionary.h trunk/moses/src/Hypothesis.cpp trunk/moses/src/Hypothesis.h trunk/moses/src/HypothesisCollection.cpp trunk/moses/src/InputType.h trunk/moses/src/LanguageModel.cpp trunk/moses/src/LanguageModelFactory.cpp trunk/moses/src/LanguageModelFactory.h trunk/moses/src/LanguageModelInternal.cpp trunk/moses/src/LanguageModelInternal.h trunk/moses/src/LanguageModelJoint.h trunk/moses/src/LanguageModelMultiFactor.h trunk/moses/src/LanguageModelSingleFactor.h trunk/moses/src/LanguageModelSkip.h trunk/moses/src/LexicalReordering.cpp trunk/moses/src/Manager.cpp trunk/moses/src/Manager.h trunk/moses/src/PDTAimp.h trunk/moses/src/PartialTranslOptColl.cpp trunk/moses/src/Phrase.cpp trunk/moses/src/Phrase.h trunk/moses/src/PhraseDictionary.cpp trunk/moses/src/PhraseDictionaryMemory.cpp trunk/moses/src/PhraseDictionaryMemory.h trunk/moses/src/PhraseDictionaryTreeAdaptor.cpp trunk/moses/src/PhraseDictionaryTreeAdaptor.h trunk/moses/src/ScoreComponentCollection.cpp trunk/moses/src/Sentence.cpp trunk/moses/src/Sentence.h trunk/moses/src/StaticData.cpp trunk/moses/src/StaticData.h trunk/moses/src/TargetPhrase.cpp trunk/moses/src/TranslationOption.cpp trunk/moses/src/TranslationOptionCollection.cpp trunk/moses/src/TranslationOptionCollection.h trunk/moses/src/TranslationOptionCollectionConfusionNet.cpp trunk/moses/src/TranslationOptionCollectionConfusionNet.h trunk/moses/src/TranslationOptionCollectionText.cpp trunk/moses/src/TranslationOptionCollectionText.h trunk/moses/src/Util.h trunk/moses/src/Word.cpp trunk/moses-cmd/src/IOStream.cpp trunk/moses-cmd/src/IOStream.h trunk/moses-cmd/src/Main.cpp trunk/moses-cmd/src/Main.h trunk/moses-cmd/src/TranslationAnalysis.cpp This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <hie...@us...> - 2007-02-21 19:48:58
|
Revision: 1227 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1227&view=rev Author: hieuhoang1972 Date: 2007-02-21 11:48:53 -0800 (Wed, 21 Feb 2007) Log Message: ----------- change unknown word processing to be closer to the way pharaoh does it - create unknown word whenever single word is not in translation table but penalise hypothesis for using it. Modified Paths: -------------- trunk/moses/src/DummyScoreProducers.cpp trunk/moses/src/DummyScoreProducers.h trunk/moses/src/GenerationDictionary.cpp trunk/moses/src/GenerationDictionary.h trunk/moses/src/HypothesisCollection.cpp trunk/moses/src/LanguageModel.cpp trunk/moses/src/LanguageModel.h trunk/moses/src/LanguageModelFactory.cpp trunk/moses/src/LanguageModelFactory.h trunk/moses/src/LanguageModelInternal.cpp trunk/moses/src/LanguageModelInternal.h trunk/moses/src/LanguageModelJoint.h trunk/moses/src/LanguageModelMultiFactor.cpp trunk/moses/src/LanguageModelMultiFactor.h trunk/moses/src/LanguageModelSingleFactor.cpp trunk/moses/src/LanguageModelSingleFactor.h trunk/moses/src/LanguageModelSkip.h trunk/moses/src/StaticData.cpp trunk/moses/src/StaticData.h trunk/moses/src/TranslationOption.cpp trunk/moses/src/TranslationOptionCollection.cpp trunk/moses-cmd/src/Main.cpp trunk/regression-testing/MosesRegressionTesting.pm trunk/regression-testing/tests/basic-surface-binptable/truth/results.dat trunk/regression-testing/tests/basic-surface-only/truth/results.dat trunk/regression-testing/tests/multi-factor/truth/results.dat This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <hie...@us...> - 2007-02-21 20:05:31
|
Revision: 1229 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1229&view=rev Author: hieuhoang1972 Date: 2007-02-21 12:05:27 -0800 (Wed, 21 Feb 2007) Log Message: ----------- minor gcc compile error. also, no longer use IRSTLM as a subsitutute for SRILM, and vice versa. They don't give identitcal results - avoids confusion. Modified Paths: -------------- trunk/moses/src/LanguageModelFactory.cpp trunk/moses/src/LanguageModelIRST.cpp trunk/moses/src/LanguageModelIRST.h trunk/moses/src/LanguageModelSRI.cpp trunk/moses/src/LanguageModelSRI.h trunk/regression-testing/MosesRegressionTesting.pm trunk/regression-testing/tests/nbest-multi-factor/truth/results.dat This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <ph...@us...> - 2007-02-26 20:59:50
|
Revision: 1246 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1246&view=rev Author: phkoehn Date: 2007-02-26 12:59:41 -0800 (Mon, 26 Feb 2007) Log Message: ----------- added option -include-alignment-in-n-best to include the word alignment for each sentence in the n-best list file Modified Paths: -------------- trunk/moses/src/Parameter.cpp trunk/moses/src/StaticData.cpp trunk/moses/src/StaticData.h trunk/moses-cmd/src/IOStream.cpp trunk/scripts/generic/multi-bleu.perl This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <hie...@us...> - 2007-03-04 00:43:48
|
Revision: 1266 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1266&view=rev Author: hieuhoang1972 Date: 2007-03-03 16:43:45 -0800 (Sat, 03 Mar 2007) Log Message: ----------- make output of decimal places consistent by not format anywhere but in Main.cpp Modified Paths: -------------- trunk/moses/src/Timer.h trunk/moses-cmd/src/Main.cpp trunk/regression-testing/tests/basic-surface-binptable/truth/results.dat trunk/regression-testing/tests/basic-surface-only/truth/results.dat trunk/regression-testing/tests/confusionNet-multi-factor/truth/results.dat trunk/regression-testing/tests/confusionNet-surface-only/truth/results.dat trunk/regression-testing/tests/multi-factor/truth/results.dat trunk/regression-testing/tests/multi-factor-binptable/truth/results.dat trunk/regression-testing/tests/multi-factor-drop/truth/results.dat trunk/regression-testing/tests/nbest-multi-factor/truth/results.dat trunk/regression-testing/tests/ptable-filtering/truth/results.dat This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <kon...@us...> - 2007-03-14 12:43:21
|
Revision: 1301 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1301&view=rev Author: konrad_rawlik Date: 2007-03-14 05:42:35 -0700 (Wed, 14 Mar 2007) Log Message: ----------- Added lexical reordering changes Modified Paths: -------------- trunk/misc/Makefile.am trunk/moses/src/LexicalReordering.cpp trunk/moses/src/LexicalReordering.h trunk/moses/src/Makefile.am trunk/moses/src/Parameter.cpp trunk/moses/src/PhraseDictionaryTree.cpp trunk/moses/src/StaticData.cpp Added Paths: ----------- trunk/misc/processLexicalTable.cpp trunk/moses/src/LVoc.cpp trunk/moses/src/LVoc.h trunk/moses/src/LexicalReorderingTable.cpp trunk/moses/src/LexicalReorderingTable.h trunk/moses/src/PrefixTreeMap.cpp trunk/moses/src/PrefixTreeMap.h This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <hie...@us...> - 2007-03-14 13:02:02
|
Revision: 1302 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1302&view=rev Author: hieuhoang1972 Date: 2007-03-14 06:02:00 -0700 (Wed, 14 Mar 2007) Log Message: ----------- lexicalised reodering working with visual studio Modified Paths: -------------- trunk/moses/moses.sln trunk/moses/moses.vcproj trunk/moses/src/LVoc.cpp Added Paths: ----------- trunk/misc/processLexicalTable.vcproj This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <hie...@us...> - 2007-03-14 22:22:39
|
Revision: 1307 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1307&view=rev Author: hieuhoang1972 Date: 2007-03-14 15:22:36 -0700 (Wed, 14 Mar 2007) Log Message: ----------- add svn id comments to start of file Modified Paths: -------------- trunk/regression-testing/compare-results.pl trunk/regression-testing/run-single-test.pl trunk/regression-testing/run-test-suite.pl trunk/scripts/analysis/nontranslated_words.pl trunk/scripts/analysis/sentence-by-sentence.pl trunk/scripts/analysis/show-phrases-used.pl trunk/scripts/analysis/smtgui/filter-phrase-table.pl trunk/scripts/analysis/smtgui/newsmtgui.cgi trunk/scripts/check-dependencies.pl trunk/scripts/check-dependenciesWIN32.pl trunk/scripts/generic/extract-factors.pl trunk/scripts/generic/lopar2pos.pl trunk/scripts/generic/moses-parallel.pl trunk/scripts/generic/multi-bleu.perl trunk/scripts/generic/qsub-wrapper.pl trunk/scripts/recaser/recase.perl trunk/scripts/recaser/train-recaser.perl trunk/scripts/tests/full-train-mert-decode.test trunk/scripts/tests/train-factored-test-step9.test trunk/scripts/training/absolutize_moses_model.pl trunk/scripts/training/analyse_moses_model.pl trunk/scripts/training/build-generation-table.perl trunk/scripts/training/clean-corpus-n.perl trunk/scripts/training/clone_moses_model.pl trunk/scripts/training/cmert-0.5/bleu.py trunk/scripts/training/cmert-0.5/data.c trunk/scripts/training/cmert-0.5/data.h trunk/scripts/training/cmert-0.5/dataset.py trunk/scripts/training/cmert-0.5/log.py trunk/scripts/training/cmert-0.5/mert.c trunk/scripts/training/cmert-0.5/point.c trunk/scripts/training/cmert-0.5/point.h trunk/scripts/training/cmert-0.5/score-nbest.py trunk/scripts/training/cmert-0.5/score.c trunk/scripts/training/cmert-0.5/score.h trunk/scripts/training/combine_factors.pl trunk/scripts/training/exodus.perl trunk/scripts/training/filter-and-binarize-model-given-input.pl trunk/scripts/training/filter-model-given-input.pl trunk/scripts/training/mert-moses.pl trunk/scripts/training/phrase-extract/extract.cpp trunk/scripts/training/phrase-extract/score.cpp trunk/scripts/training/phrase-extract/tables-core.cpp trunk/scripts/training/phrase-extract/tables-core.h trunk/scripts/training/postprocess-lopar.perl trunk/scripts/training/reduce_combine.pl trunk/scripts/training/symal/cmd.c trunk/scripts/training/symal/cmd.h trunk/scripts/training/symal/giza2bal.pl trunk/scripts/training/symal/symal.cpp trunk/scripts/training/train-factored-phrase-model.perl This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <hie...@us...> - 2007-03-14 22:44:47
|
Revision: 1310 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1310&view=rev Author: hieuhoang1972 Date: 2007-03-14 15:44:36 -0700 (Wed, 14 Mar 2007) Log Message: ----------- set svn properties Modified Paths: -------------- trunk/irstlm/src/gzfilebuf.h trunk/moses/src/InputType.cpp trunk/moses/src/InputType.h trunk/moses/src/LanguageModelInternal.cpp trunk/moses/src/LanguageModelInternal.h trunk/moses/src/LatticePathCollection.cpp trunk/moses/src/NGramCollection.cpp trunk/moses/src/NGramCollection.h trunk/moses/src/NGramNode.cpp trunk/moses/src/NGramNode.h trunk/moses/src/PhraseReference.cpp trunk/moses/src/SentenceStats.cpp Property Changed: ---------------- trunk/irstlm/src/gzfilebuf.h trunk/irstlm/src/util.cpp trunk/irstlm/src/util.h trunk/misc/processLexicalTable.cpp trunk/moses/src/File.cpp trunk/moses/src/InputType.cpp trunk/moses/src/InputType.h trunk/moses/src/LVoc.cpp trunk/moses/src/LVoc.h trunk/moses/src/LanguageModelInternal.cpp trunk/moses/src/LanguageModelInternal.h trunk/moses/src/LatticePathCollection.cpp trunk/moses/src/LexicalReorderingTable.cpp trunk/moses/src/LexicalReorderingTable.h trunk/moses/src/NGramCollection.cpp trunk/moses/src/NGramCollection.h trunk/moses/src/NGramNode.cpp trunk/moses/src/NGramNode.h trunk/moses/src/PhraseReference.cpp trunk/moses/src/PhraseReference.h trunk/moses/src/PrefixTreeMap.cpp trunk/moses/src/PrefixTreeMap.h trunk/moses/src/SentenceStats.cpp trunk/moses/src/WordsRange.cpp This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <kon...@us...> - 2007-03-15 12:44:39
|
Revision: 1314 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1314&view=rev Author: konrad_rawlik Date: 2007-03-15 05:43:27 -0700 (Thu, 15 Mar 2007) Log Message: ----------- queryLexicalTable Modified Paths: -------------- trunk/misc/queryLexicalTable.cpp trunk/moses/src/LexicalReorderingTable.cpp trunk/moses/src/StaticData.cpp This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <hie...@us...> - 2007-04-11 19:56:59
|
Revision: 1351 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1351&view=rev Author: hieuhoang1972 Date: 2007-04-11 12:56:43 -0700 (Wed, 11 Apr 2007) Log Message: ----------- Add alignment info to phrase table Modified Paths: -------------- trunk/moses/src/PhraseDictionaryTree.cpp trunk/scripts/Makefile trunk/scripts/training/phrase-extract/Makefile trunk/scripts/training/phrase-extract/score.cpp trunk/scripts/training/train-factored-phrase-model.perl This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <re...@us...> - 2007-04-18 14:08:48
|
Revision: 1359 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1359&view=rev Author: redpony Date: 2007-04-18 07:08:46 -0700 (Wed, 18 Apr 2007) Log Message: ----------- Support for the decoding of arbitrary word lattices. Must be given in the form of a "plf" file, which is a little tricky. I'll add documentation at some point; for now, refer to the example plf file in the "lattice-surface" regression test. Modified Paths: -------------- trunk/irstlm/src/Makefile.am trunk/moses/src/ConfusionNet.cpp trunk/moses/src/ConfusionNet.h trunk/moses/src/HypothesisStack.cpp trunk/moses/src/InputType.h trunk/moses/src/Makefile.am trunk/moses/src/PDTAimp.h trunk/moses/src/Sentence.cpp trunk/moses/src/StaticData.cpp trunk/moses/src/TranslationOptionCollection.cpp trunk/moses/src/TranslationOptionCollection.h trunk/moses/src/TranslationOptionCollectionConfusionNet.cpp trunk/moses/src/TypeDef.h trunk/moses/src/Util.cpp trunk/moses/src/Util.h trunk/moses-cmd/src/IOStream.cpp trunk/moses-cmd/src/Main.cpp trunk/regression-testing/run-test-suite.pl trunk/scripts/Makefile Added Paths: ----------- trunk/moses/src/PCNTools.cpp trunk/moses/src/PCNTools.h trunk/regression-testing/tests/lattice-surface/ trunk/regression-testing/tests/lattice-surface/filter-stderr.pl trunk/regression-testing/tests/lattice-surface/filter-stdout.pl trunk/regression-testing/tests/lattice-surface/moses.ini trunk/regression-testing/tests/lattice-surface/to-translate.txt trunk/regression-testing/tests/lattice-surface/truth/ trunk/regression-testing/tests/lattice-surface/truth/results.txt This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <re...@us...> - 2007-04-18 16:49:54
|
Revision: 1362 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1362&view=rev Author: redpony Date: 2007-04-18 09:49:51 -0700 (Wed, 18 Apr 2007) Log Message: ----------- fix bug with unknown words/CNs/lexical reordering Modified Paths: -------------- trunk/moses/src/TargetPhrase.cpp trunk/moses/src/TranslationOptionCollection.cpp trunk/moses/src/TranslationOptionCollection.h trunk/regression-testing/run-test-suite.pl Added Paths: ----------- trunk/regression-testing/tests/lexicalized-reordering-cn/ trunk/regression-testing/tests/lexicalized-reordering-cn/filter-stderr.pl trunk/regression-testing/tests/lexicalized-reordering-cn/filter-stdout.pl trunk/regression-testing/tests/lexicalized-reordering-cn/moses.ini trunk/regression-testing/tests/lexicalized-reordering-cn/to-translate.txt trunk/regression-testing/tests/lexicalized-reordering-cn/truth/ trunk/regression-testing/tests/lexicalized-reordering-cn/truth/results.txt This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <nic...@us...> - 2007-05-22 15:41:17
|
Revision: 1395 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1395&view=rev Author: nicolabertoldi Date: 2007-05-22 08:40:56 -0700 (Tue, 22 May 2007) Log Message: ----------- Removed irstlm stuff Modified instructions Changed configure.in to load a machine-dependent irstlm library Modified Paths: -------------- trunk/BUILD-INSTRUCTIONS trunk/configure.in Removed Paths: ------------- trunk/irstlm/ This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <nic...@us...> - 2007-05-23 07:34:52
|
Revision: 1396 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1396&view=rev Author: nicolabertoldi Date: 2007-05-23 00:34:50 -0700 (Wed, 23 May 2007) Log Message: ----------- Added notes for compilation on Mac. Modified Paths: -------------- trunk/BUILD-INSTRUCTIONS trunk/regenerate-makefiles.sh This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <hie...@us...> - 2007-07-17 20:45:54
|
Revision: 1427 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1427&view=rev Author: hieuhoang1972 Date: 2007-07-17 13:45:51 -0700 (Tue, 17 Jul 2007) Log Message: ----------- build with SRILM in windows under different configuration Modified Paths: -------------- trunk/misc/processLexicalTable.vcproj trunk/misc/processPhraseTable.vcproj trunk/moses/moses.sln trunk/moses/moses.vcproj trunk/moses-cmd/moses-cmd.vcproj This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <re...@us...> - 2007-07-26 20:26:33
|
Revision: 1438 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1438&view=rev Author: redpony Date: 2007-07-26 13:26:32 -0700 (Thu, 26 Jul 2007) Log Message: ----------- Implementation of idea in "Improving Translation Quality by Discarding Most of the Phrasetable". Johnson et al. 2007. EMNLP. Requires Joy Zhang's SALM toolkit. Added Paths: ----------- trunk/sigtest-filter/ trunk/sigtest-filter/Makefile trunk/sigtest-filter/README trunk/sigtest-filter/check-install trunk/sigtest-filter/filter-pt.cpp This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: Philipp K. <pk...@in...> - 2007-07-27 04:43:05
|
Hi Chris, cool... does it help? -phi On 7/26/07, re...@us... <re...@us...> wrote: > Revision: 1438 > http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1438&view=rev > Author: redpony > Date: 2007-07-26 13:26:32 -0700 (Thu, 26 Jul 2007) > > Log Message: > ----------- > Implementation of idea in "Improving Translation Quality by Discarding Most of the Phrasetable". Johnson et al. 2007. EMNLP. Requires Joy Zhang's SALM toolkit. > > Added Paths: > ----------- > trunk/sigtest-filter/ > trunk/sigtest-filter/Makefile > trunk/sigtest-filter/README > trunk/sigtest-filter/check-install > trunk/sigtest-filter/filter-pt.cpp > > > This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. > > ------------------------------------------------------------------------- > This SF.net email is sponsored by: Splunk Inc. > Still grepping through log files to find problems? Stop. > Now Search log events and configuration files using AJAX and a browser. > Download your FREE copy of Splunk now >> http://get.splunk.com/ > _______________________________________________ > Mosesdecoder-commits mailing list > Mos...@li... > https://lists.sourceforge.net/lists/listinfo/mosesdecoder-commits > > |
From: <re...@us...> - 2007-09-14 07:32:02
|
Revision: 1458 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1458&view=rev Author: redpony Date: 2007-09-14 00:31:56 -0700 (Fri, 14 Sep 2007) Log Message: ----------- The primary change here is that the distortion distance in a word lattice is now defined to be the number of words on the shortest path between the previous phrase's ending span and the next phrase's starting span. Originally, the distance was defined to be the difference in node number, which could be extremely large even for words that are, in some sense, adjacent. Only the distortion scoring has been fixed for word lattices, but the distortion limit is still broken. Modified Paths: -------------- trunk/moses/src/DummyScoreProducers.cpp trunk/moses/src/InputType.cpp trunk/moses/src/InputType.h trunk/moses/src/Makefile.am trunk/moses/src/StaticData.cpp trunk/moses/src/StaticData.h trunk/moses/src/WordLattice.cpp trunk/moses/src/WordLattice.h trunk/regression-testing/MosesRegressionTesting.pm trunk/regression-testing/run-test-suite.pl Added Paths: ----------- trunk/moses/src/FloydWarshall.cpp trunk/moses/src/FloydWarshall.h trunk/regression-testing/tests/lattice-distortion/ trunk/regression-testing/tests/lattice-distortion/CMD trunk/regression-testing/tests/lattice-distortion/filter-nbest.pl trunk/regression-testing/tests/lattice-distortion/filter-stderr.pl trunk/regression-testing/tests/lattice-distortion/filter-stdout.pl trunk/regression-testing/tests/lattice-distortion/moses.ini trunk/regression-testing/tests/lattice-distortion/phrase-table trunk/regression-testing/tests/lattice-distortion/phrase-table.binphr.idx trunk/regression-testing/tests/lattice-distortion/phrase-table.binphr.srctree trunk/regression-testing/tests/lattice-distortion/phrase-table.binphr.srcvoc trunk/regression-testing/tests/lattice-distortion/phrase-table.binphr.tgtdata trunk/regression-testing/tests/lattice-distortion/phrase-table.binphr.tgtvoc trunk/regression-testing/tests/lattice-distortion/small.lm trunk/regression-testing/tests/lattice-distortion/to-translate.txt trunk/regression-testing/tests/lattice-distortion/truth/ trunk/regression-testing/tests/lattice-distortion/truth/results.txt This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <re...@us...> - 2007-09-17 02:49:10
|
Revision: 1460 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1460&view=rev Author: redpony Date: 2007-09-16 19:49:08 -0700 (Sun, 16 Sep 2007) Log Message: ----------- fix distortion limiting functionality for WordLattices. Now, the shortest path to a another node is used to determine whether the threshold has been exceeded. Modified Paths: -------------- trunk/moses/src/Manager.cpp trunk/regression-testing/run-test-suite.pl trunk/regression-testing/tests/lattice-distortion/to-translate.txt trunk/regression-testing/tests/lattice-distortion/truth/results.txt This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <re...@us...> - 2007-09-27 05:03:34
|
Revision: 1463 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1463&view=rev Author: redpony Date: 2007-09-26 22:03:06 -0700 (Wed, 26 Sep 2007) Log Message: ----------- fixed a subtle bug in the word lattice decoder. it now acts sane. This experience also gave me more evidence for thinking that numbering the words in a phrase is not good-- we should be numbering the spaces between them. this would fix oh so many nasty things we've got (like the fact that we represent word drops with [n,n-1] etc). Modified Paths: -------------- trunk/moses/src/ConfusionNet.cpp trunk/moses/src/FloydWarshall.cpp trunk/moses/src/Hypothesis.cpp trunk/moses/src/InputType.cpp trunk/moses/src/InputType.h trunk/moses/src/Manager.cpp trunk/moses/src/WordLattice.cpp trunk/moses/src/WordLattice.h trunk/regression-testing/tests/lattice-distortion/to-translate.txt trunk/regression-testing/tests/lattice-distortion/truth/results.txt This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <re...@us...> - 2007-09-27 12:14:44
|
Revision: 1464 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1464&view=rev Author: redpony Date: 2007-09-27 05:14:42 -0700 (Thu, 27 Sep 2007) Log Message: ----------- stricter checks on word lattice distortion Modified Paths: -------------- trunk/moses/src/InputType.cpp trunk/moses/src/InputType.h trunk/moses/src/Manager.cpp trunk/moses/src/WordLattice.cpp trunk/moses/src/WordLattice.h trunk/moses/src/WordsBitmap.h trunk/regression-testing/tests/lattice-distortion/truth/results.txt This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |