Business Commons^™

Optimizing The Validity Of Situational Judgment Tests: The Importance Of Scoring Methods, Qingxiong Weng, Hui Yang, Filip Lievens, Michael A. Mcdaniel

Research Collection Lee Kong Chian School Of Business

In recent years, situational judgment tests (SJTs) have made strong inroads in assessment practices. Despite the importance of scoring for the validity of SJTs, little attention has been paid to different SJT scoring methods. This study investigated the influence of scoring methods on the criterion-related validity of SJTs. We examined five different consensus scoring methods (i.e., raw, standardized, dichotomous, mode, and proportion scoring) and several integrated scoring methods for scoring the same SJT. Results showed that one of the most popular scoring approaches (raw consensus scoring) is associated with an extreme response tendency and yields the lowest scale validity of …