Social and Behavioral Sciences Commons^™

Testing Intergroup Concordance In Ranking Experiments With Two Groups Of Judges, Dawn J. Dekle, Leung, Denis H. Y., Min Zhu

Research Collection School Of Economics

Across many areas of psychology, concordance is commonly used to measure the (intragroup) agreement in ranking a number of items by a group of judges. Sometimes, however, the judges come from multiple groups, and in those situations, the interest is to measure the concordance between groups, under the assumption that there is some within-group concordance. In this investigation, existing methods are compared under a variety of scenarios. Permutation theory is used to calculate the error rates and the power of the methods. Missing data situations are also studied. The results indicate that the performance of the methods depend on (a) …