Psychology Commons^™

Further Evaluating The Effect Of Behavioral Observability And Overall Impressions On Rater Agreement: A Replication Study, Patrick Sizemore

Masters Theses & Specialist Projects

This replication study sought to analyze the effects of behavioral observability and overall impressions on rater agreement, as recently examined by Roch, Paquin, & Littlejohn (2009) and Scott (2012). Results from the study performed by Roch et al. indicated that raters are more likely to agree when items are either more difficult to rate or less observable. In the replication study conducted by Scott, the results did not support the relationship which Roch et al. found between observability and rater agreement, but did support the relationship previously found between item difficulty and rater agreement. The four objectives of this replication …