Digital Commons Network^™

Suppressing Outliers In Pairwise Preference Ranking, Vitor S. Cavalho, Jonathan L. Elsas, William W. Cohen, Jaime G. Carbonell

Jaime G. Carbonell

Many of the recently proposed algorithms for learning feature-based ranking functions are based on the pairwise preference framework, in which instead of taking documents in isolation, document pairs are used as instances in the learning process [3, 5]. One disadvantage of this process is that a noisy relevance judgment on a single document can lead to a large number of mislabeled document pairs. This can jeopardize robustness and deteriorate overall ranking performance. In this paper we study the effects of outlying pairs in rank learning with pairwise preferences and introduce a new meta-learning algorithm capable of suppressing these undesirable effects. …