Thanks for the reply. So the data I'm using is actually from the Kaggle Home Depot...
I'm running Ranklib and am finding my MAP score is the same (and high) irrespective...