#221 RankLib error with normalization and saved models

v1.x
closed
David Fisher
RankLib (5)
1
2013-12-12
2013-11-14
David Fisher
No

Reported in https://sourceforge.net/p/lemur/discussion/ranklib/thread/aa023cd9/?limit=25#6061

harvey:~/Development/RankLib/tmp$ java -jar ../bin/RankLib.jar -train data-run-1/5fold/f1.train.ranklibfeatures.svm.shuffled -test data-run-1/5fold/f1.test.ranklibfeatures.svm.shuffled -ranker 2 -norm zscore -silent -metric2t MAP -save model.txt

[+] General Parameters:
Training data: data-run-1/5fold/f1.train.ranklibfeatures.svm.shuffled
Test data: data-run-1/5fold/f1.test.ranklibfeatures.svm.shuffled
Feature vector representation: Dense.
Ranking method: RankBoost
Feature description file: Unspecified. All features will be used.
Train metric: MAP
Test metric: MAP
Feature normalization: zscore
Model file: model.txt

[+] RankBoost's Parameters:

Reading feature file [data-run-1/5fold/f1.train.ranklibfeatures.svm.shuffled]: 0Reading feature file [data-run-1/5fold/f1.train.ranklibfeatures.svm.shuffled]: 0Reading feature file [data-run-1/5fold/f1.train.ranklibfeatures.svm.shuffled]: 0Reading feature file [data-run-1/5fold/f1.train.ranklibfeatures.svm.shuffled]... [Done.]
(34 ranked lists, 27078 entries read)
Reading feature file [data-run-1/5fold/f1.test.ranklibfeatures.svm.shuffled]: 0.Reading feature file [data-run-1/5fold/f1.test.ranklibfeatures.svm.shuffled]... [Done.]
(8 ranked lists, 6381 entries read)
MAP on test data: 0.4084

Model saved to: model.txt
harvey:~/Development/RankLib/tmp$ java -jar ../bin/RankLib.jar -load model.txt -norm zscore -metric2T MAP -test data-run-1/5fold/f1.test.ranklibfeatures.svm.shuffled

[+] General Parameters:
Model file: model.txt
Feature normalization: zscore
Test metric: MAP
Model: RankBoost
Reading feature file [data-run-1/5fold/f1.test.ranklibfeatures.svm.shuffled]: 0.Reading feature file [data-run-1/5fold/f1.test.ranklibfeatures.svm.shuffled]... [Done.]
(8 ranked lists, 6381 entries read)
MAP on test data: 0.2732

2 Attachments

Discussion

  • David Fisher
    David Fisher
    2013-11-14

    add the test case data.

     
  • David Fisher
    David Fisher
    2013-11-19

    To ship in 12/2013 release.

     
  • David Pane
    David Pane
    2013-12-12

    • status: open --> closed