Open Access. Powered by Scholars. Published by Universities.®
Social and Behavioral Sciences Commons™
Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 4 of 4
Full-Text Articles in Social and Behavioral Sciences
Optimizing The Validity Of Situational Judgment Tests: The Importance Of Scoring Methods, Qingxiong Weng, Hui Yang, Filip Lievens, Michael A. Mcdaniel
Optimizing The Validity Of Situational Judgment Tests: The Importance Of Scoring Methods, Qingxiong Weng, Hui Yang, Filip Lievens, Michael A. Mcdaniel
Research Collection Lee Kong Chian School Of Business
In recent years, situational judgment tests (SJTs) have made strong inroads in assessment practices. Despite the importance of scoring for the validity of SJTs, little attention has been paid to different SJT scoring methods. This study investigated the influence of scoring methods on the criterion-related validity of SJTs. We examined five different consensus scoring methods (i.e., raw, standardized, dichotomous, mode, and proportion scoring) and several integrated scoring methods for scoring the same SJT. Results showed that one of the most popular scoring approaches (raw consensus scoring) is associated with an extreme response tendency and yields the lowest scale validity of …
Do Candidate Reactions Relate To Job Performance Or Affect Criterion-Related Validity? A Multistudy Investigation Of Relations Among Reactions, Selection Test Scores, And Job Performance, Julie Mccarthy, Chad H. Van Iddekinge, Filip Lievens, Mavis Mei-Chuan Kung, Evan F. Sinar, Michael A. Campion
Do Candidate Reactions Relate To Job Performance Or Affect Criterion-Related Validity? A Multistudy Investigation Of Relations Among Reactions, Selection Test Scores, And Job Performance, Julie Mccarthy, Chad H. Van Iddekinge, Filip Lievens, Mavis Mei-Chuan Kung, Evan F. Sinar, Michael A. Campion
Research Collection Lee Kong Chian School Of Business
Considerable evidence suggests that how candidates react to selection procedures can affect their test performance and their attitudes toward the hiring organization (e.g., recommending the firm to others). However, very few studies of candidate reactions have examined one of the outcomes organizations care most about: job performance. We attempt to address this gap by developing and testing a conceptual framework that delineates whether and how candidate reactions might influence job performance. We accomplish this objective using data from 4 studies (total N = 6,480), 6 selection procedures (personality tests, job knowledge tests, cognitive ability tests, work samples, situational judgment tests, …
Modeling The Impact Of Test Anxiety And Test Familiarity On The Criterion-Related Validity Of Cognitive Ability Tests, Charlie L. Reeve, Eric D. Heggestad, Filip Lievens
Modeling The Impact Of Test Anxiety And Test Familiarity On The Criterion-Related Validity Of Cognitive Ability Tests, Charlie L. Reeve, Eric D. Heggestad, Filip Lievens
Research Collection Lee Kong Chian School Of Business
The assessment of cognitive abilities, whether it is for purposes of basic research or applied decision making. is potentially susceptible to both facilitating and debilitating influences. However, relatively little research has examined the degree to which these factors might moderate the criterion-related validity of cognitive ability tests. To address this gap, we use Classical Test Theory formulas to articulate how test anxiety and test familiarity can influence observed scores, observed score variance, and most importantly, the criterion-related validity of observed scores. The resulting equations reveal that understanding the influence of test anxiety and test familiarity on criterion-related validity coefficients requires …
A Closer Look At The Frame-Of-Reference Effect In Personality Scale Scores And Validity, Filip Lievens, Wifiried De Corte, Eveline Schollaert
A Closer Look At The Frame-Of-Reference Effect In Personality Scale Scores And Validity, Filip Lievens, Wifiried De Corte, Eveline Schollaert
Research Collection Lee Kong Chian School Of Business
This article contributes to the understanding of why the use of a frame-of-reference leads to increased criterion-related validity of personality inventories. Two competing explanations are described and tested. A between-subjects (N = 337) and a within-subject (N = 105) study are conducted to test the hypothesized effects of use of a frame of reference on reliability and validity. Regarding the effects on reliability, use of a frame of reference reduces within-person inconsistency (instead of between-person variability) in responding to generic items. Use of a frame of reference further leads to higher validity as a result of the reduction of between-person …