...After defining criteria, PriEsT allows you to enter your judgements against each criterion, which are then used to calculate the final ranking (or weights).
Please cite this if you find it useful:-
Siraj, S., Mikhailov, L. and Keane, J. A. (2015), "PriEsT: an interactive decision support tool to estimate priorities from pairwise comparison judgments". International Transactions in Operational Research. 22: 217–235. doi:10.1111/itor.12054