From: <ph...@us...> - 2007-02-19 18:35:58
|
Revision: 1224 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1224&view=rev Author: phkoehn Date: 2007-02-19 10:35:51 -0800 (Mon, 19 Feb 2007) Log Message: ----------- minor bug fix with config file Modified Paths: -------------- trunk/scripts/training/train-factored-phrase-model.perl This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <ph...@us...> - 2007-02-22 19:37:14
|
Revision: 1231 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1231&view=rev Author: phkoehn Date: 2007-02-22 11:37:11 -0800 (Thu, 22 Feb 2007) Log Message: ----------- changes to fit with edinburgh setup, added switch -generation-type: "single" only produces one probability, not both Modified Paths: -------------- trunk/scripts/training/train-factored-phrase-model.perl This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <jor...@us...> - 2007-02-23 11:49:59
|
Revision: 1235 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1235&view=rev Author: jorcisai Date: 2007-02-23 03:49:54 -0800 (Fri, 23 Feb 2007) Log Message: ----------- Trying to parse $type in --lm option, but not available. So we just need to parse three tokens. Modified Paths: -------------- trunk/scripts/training/train-factored-phrase-model.perl This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: Philipp K. <pk...@in...> - 2007-02-23 14:57:37
|
Hi, you redid here a change that I put in to enable the optional specification of the language model type (irst / srilm). Note that in my version was backward compatible, so it was necessary to change it. Or am I missing something? -phi On 2/23/07, jor...@us... <jor...@us...> wrote: > Revision: 1235 > http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1235&view=rev > Author: jorcisai > Date: 2007-02-23 03:49:54 -0800 (Fri, 23 Feb 2007) > > Log Message: > ----------- > Trying to parse $type in --lm option, but not available. So we just need to parse three tokens. > > Modified Paths: > -------------- > trunk/scripts/training/train-factored-phrase-model.perl > > > This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. > > ------------------------------------------------------------------------- > Take Surveys. Earn Cash. Influence the Future of IT > Join SourceForge.net's Techsay panel and you'll get the chance to share your > opinions on IT & business topics through brief surveys-and earn cash > http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV > _______________________________________________ > Mosesdecoder-commits mailing list > Mos...@li... > https://lists.sourceforge.net/lists/listinfo/mosesdecoder-commits > > |
From: Jorge C. S. <jor...@it...> - 2007-02-23 15:22:38
|
On Friday 23 February 2007 15:57, Philipp Koehn wrote: > Hi, > > you redid here a change that I put in to enable the > optional specification of the language model type > (irst / srilm). Note that in my version was backward > compatible, so it was necessary to change it. > Or am I missing something? I didn't know that you did that change, I just saw that in the ninth step when creating the moses.ini file the variable $type was assigned no value and I was getting the following error: Use of uninitialized value in concatenation (.) or string at /home/v1jciver/Research/PB/bin/scripts/training/train-factored-phrase-model.perl line 1398. I chased up that error and I finally found this: if ($___LAST_STEP == 9) { die "use --lm factor:order:filename to specify at least one language model" if scalar @_LM == 0; foreach my $lm (@_LM) { my $type = 0; # default to srilm my ($f, $order, $filename); ($f, $order, $filename, $type) = split /:/, $lm, 4; die "Wrong format of --lm. Expected: --lm factor:order:filename" if $f !~ /^[0-9]+$/ || $order !~ /^[0-9]+$/ || !defined $filename; die "Language model file not found or empty: $filename" if ! -s $filename; push @___LM, [ $f, $order, $filename, $type ]; } } but there was no comment about the optional specification of the language model type and $type was getting no value after the parsing ($type was not zero anymore after that isolated line). For that reason, I decided to change that line. Sorry about that, Jorge |
From: <jor...@us...> - 2007-02-23 12:27:53
|
Revision: 1236 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1236&view=rev Author: jorcisai Date: 2007-02-23 04:27:50 -0800 (Fri, 23 Feb 2007) Log Message: ----------- reordering model was left in the local directory instead of model directory Modified Paths: -------------- trunk/scripts/training/train-factored-phrase-model.perl This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <jor...@us...> - 2007-02-23 17:33:01
|
Revision: 1238 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1238&view=rev Author: jorcisai Date: 2007-02-23 09:32:51 -0800 (Fri, 23 Feb 2007) Log Message: ----------- language model parser for --lm option is now again able to parse $type, but it is backward compatible Modified Paths: -------------- trunk/scripts/training/train-factored-phrase-model.perl This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <jor...@us...> - 2007-02-26 14:37:06
|
Revision: 1243 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1243&view=rev Author: jorcisai Date: 2007-02-26 06:36:53 -0800 (Mon, 26 Feb 2007) Log Message: ----------- distortion filename was incorrectly written into moses.ini file in step 9 Modified Paths: -------------- trunk/scripts/training/train-factored-phrase-model.perl This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <hie...@us...> - 2007-03-26 21:00:22
|
Revision: 1332 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1332&view=rev Author: hieuhoang1972 Date: 2007-03-26 14:00:20 -0700 (Mon, 26 Mar 2007) Log Message: ----------- use pawd instead of pwd whenever we can Modified Paths: -------------- trunk/scripts/training/train-factored-phrase-model.perl This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <jds...@us...> - 2007-04-18 19:39:42
|
Revision: 1365 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1365&view=rev Author: jdschroeder Date: 2007-04-18 12:38:14 -0700 (Wed, 18 Apr 2007) Log Message: ----------- Changed initial setting of number of distortion weights from 0 to 1. For models with lexicalized reordering, this script was generating one too few weights in moses.ini Modified Paths: -------------- trunk/scripts/training/train-factored-phrase-model.perl This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <nic...@us...> - 2007-06-27 16:30:35
|
Revision: 1419 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1419&view=rev Author: nicolabertoldi Date: 2007-06-27 09:30:20 -0700 (Wed, 27 Jun 2007) Log Message: ----------- changes to reduce disk memory consumption during training Modified Paths: -------------- trunk/scripts/training/train-factored-phrase-model.perl This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <hie...@us...> - 2007-07-14 09:54:08
|
Revision: 1425 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1425&view=rev Author: hieuhoang1972 Date: 2007-07-14 02:54:05 -0700 (Sat, 14 Jul 2007) Log Message: ----------- mkdir before doing generation Modified Paths: -------------- trunk/scripts/training/train-factored-phrase-model.perl This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <hie...@us...> - 2007-07-25 10:05:36
|
Revision: 1435 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1435&view=rev Author: hieuhoang1972 Date: 2007-07-25 03:05:34 -0700 (Wed, 25 Jul 2007) Log Message: ----------- turn off debugging Modified Paths: -------------- trunk/scripts/training/train-factored-phrase-model.perl This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <re...@us...> - 2007-10-19 03:44:07
|
Revision: 1474 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1474&view=rev Author: redpony Date: 2007-10-18 20:44:05 -0700 (Thu, 18 Oct 2007) Log Message: ----------- add --hmm-align option. Allows using Giza++'s HMM word alignment model as the underlying word alignment. It is much faster than Model 4 alignment and not much worse. Modified Paths: -------------- trunk/scripts/training/train-factored-phrase-model.perl This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <bo...@us...> - 2008-02-22 16:14:34
|
Revision: 1568 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1568&view=rev Author: bojar Date: 2008-02-22 08:14:30 -0800 (Fri, 22 Feb 2008) Log Message: ----------- corpus compression correctly used even for generation step Modified Paths: -------------- trunk/scripts/training/train-factored-phrase-model.perl This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <bo...@us...> - 2008-02-26 10:20:24
|
Revision: 1571 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1571&view=rev Author: bojar Date: 2008-02-26 02:20:09 -0800 (Tue, 26 Feb 2008) Log Message: ----------- default to reordering factors of 0-0 even if decoding steps are set (users might have explicitly said e.g. t0-0!) Modified Paths: -------------- trunk/scripts/training/train-factored-phrase-model.perl This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <hie...@us...> - 2008-06-04 14:43:17
|
Revision: 1817 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1817&view=rev Author: hieuhoang1972 Date: 2008-06-04 07:42:51 -0700 (Wed, 04 Jun 2008) Log Message: ----------- most popular alignment outputted, finally Modified Paths: -------------- trunk/scripts/training/train-factored-phrase-model.perl This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <hie...@us...> - 2008-06-04 14:50:43
|
Revision: 1818 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1818&view=rev Author: hieuhoang1972 Date: 2008-06-04 07:49:56 -0700 (Wed, 04 Jun 2008) Log Message: ----------- most popular alignment outputted, finally Modified Paths: -------------- trunk/scripts/training/train-factored-phrase-model.perl This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <bo...@us...> - 2008-07-14 16:24:26
|
Revision: 1865 http://mosesdecoder.svn.sourceforge.net/mosesdecoder/?rev=1865&view=rev Author: bojar Date: 2008-07-14 09:24:18 -0700 (Mon, 14 Jul 2008) Log Message: ----------- removed SCRIPTS_ROOTDIR from this 'my' declaration, it was obscuring previous declaration! lines wrapped Modified Paths: -------------- trunk/scripts/training/train-factored-phrase-model.perl This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |