Business Commons^™

Creating Test Score Bands For Assessments Involving Ratings Using A Generalizability Theory Approach To Reliability Estimation, Charles Scherbaum, Marcus Dickson, Elliott Larson, Brian Bellenger, Kenneth Yusko, Harold Goldstein

Personnel Assessment and Decisions

The selection of a method for estimating the reliability of ratings has considerable implications for the use of assessments in personnel selection. In particular, the accuracy of corrections to validity coefficients for unreliability and test score bands are completely dependent on the correct estimation of the reliability. In this paper, we discuss how generalizability theory can be used to estimate reliability for test score bands with assessments involving ratings. Using selection data from a municipal entity, we demonstrate the use of generalizability theory-based compare the implications of its use in test score banding compared to the traditional approach.