Menu
▾
▴
2 Attachments
#221 RankLib error with normalization and saved models
Reported in https://sourceforge.net/p/lemur/discussion/ranklib/thread/aa023cd9/?limit=25#6061
harvey:~/Development/RankLib/tmp$ java -jar ../bin/RankLib.jar -train data-run-1/5fold/f1.train.ranklibfeatures.svm.shuffled -test data-run-1/5fold/f1.test.ranklibfeatures.svm.shuffled -ranker 2 -norm zscore -silent -metric2t MAP -save model.txt
[+] General Parameters:
Training data: data-run-1/5fold/f1.train.ranklibfeatures.svm.shuffled
Test data: data-run-1/5fold/f1.test.ranklibfeatures.svm.shuffled
Feature vector representation: Dense.
Ranking method: RankBoost
Feature description file: Unspecified. All features will be used.
Train metric: MAP
Test metric: MAP
Feature normalization: zscore
Model file: model.txt
[+] RankBoost's Parameters:
Reading feature file [data-run-1/5fold/f1.train.ranklibfeatures.svm.shuffled]: 0Reading feature file [data-run-1/5fold/f1.train.ranklibfeatures.svm.shuffled]: 0Reading feature file [data-run-1/5fold/f1.train.ranklibfeatures.svm.shuffled]: 0Reading feature file [data-run-1/5fold/f1.train.ranklibfeatures.svm.shuffled]... [Done.]
(34 ranked lists, 27078 entries read)
Reading feature file [data-run-1/5fold/f1.test.ranklibfeatures.svm.shuffled]: 0.Reading feature file [data-run-1/5fold/f1.test.ranklibfeatures.svm.shuffled]... [Done.]
(8 ranked lists, 6381 entries read)
MAP on test data: 0.4084
Model saved to: model.txt
harvey:~/Development/RankLib/tmp$ java -jar ../bin/RankLib.jar -load model.txt -norm zscore -metric2T MAP -test data-run-1/5fold/f1.test.ranklibfeatures.svm.shuffled
[+] General Parameters:
Model file: model.txt
Feature normalization: zscore
Test metric: MAP
Model: RankBoost
Reading feature file [data-run-1/5fold/f1.test.ranklibfeatures.svm.shuffled]: 0.Reading feature file [data-run-1/5fold/f1.test.ranklibfeatures.svm.shuffled]... [Done.]
(8 ranked lists, 6381 entries read)
MAP on test data: 0.2732
Added as a bug: https://sourceforge.net/p/lemur/bugs/221/ thanks for reporting it.
add the test case data.
To ship in 12/2013 release.
I'm still experiencing the same issue using this version: 2.1-patched-2