Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 4 of 4
Full-Text Articles in Business
Constructed Response Formats And Their Effects On Minority-Majority Differences And Validity, Filip Lievens, Paul R. Sackett, Jeffrey Dahlke, Janneke Oostrom, Britt De Soete
Constructed Response Formats And Their Effects On Minority-Majority Differences And Validity, Filip Lievens, Paul R. Sackett, Jeffrey Dahlke, Janneke Oostrom, Britt De Soete
Research Collection Lee Kong Chian School Of Business
The inflow of immigrants challenges organizations to consider alternative selection procedures that reduce potential minority (immigrants)-majority (natives) differences, while maintaining valid predictions of performance. To deal with this challenge, this paper proposes response format as a practically and theoretically relevant factor for situational judgment tests (SJTs). We examine a range of response format categories (from traditional multiple-choice formats to more innovative constructed response formats) and conceptually link these response formats to mechanisms underlying minority-majority differences. Two field experiments are conducted with SJTs. Study 1 (274 job seekers) contrasts minority-majority differences in scores on a multiple-choice versus a written constructed response …
Validity And Reliability Of Situational Judgement Test Scores: A New Approach Based On Cognitive Diagnosis Models, Miguel A. Sorrel, Julio Olea, Francisco José Abad, Jimmy De La Torre, David Aguado, Filip Lievens
Validity And Reliability Of Situational Judgement Test Scores: A New Approach Based On Cognitive Diagnosis Models, Miguel A. Sorrel, Julio Olea, Francisco José Abad, Jimmy De La Torre, David Aguado, Filip Lievens
Research Collection Lee Kong Chian School Of Business
Conventional methods for assessing the validity and reliability of situational judgment test (SJT) scores have proven to be inadequate. For example, factor analysis techniques typically lead to nonsensical solutions, and assumptions underlying Cronbach's alpha coefficient are violated due to the multidimensional nature of SJTs. In the current article, we describe how cognitive diagnosis models (CDMs) provide a new approach that not only overcomes these limitations but that also offers extra advantages for scoring and better understanding SJTs. The analysis of the Q-matrix specification, model fit, and model parameter estimates provide a greater wealth of information than traditional procedures do. Our …
Simulations, Filip Lievens, Britt De Coete
Simulations, Filip Lievens, Britt De Coete
Research Collection Lee Kong Chian School Of Business
Simulations represent more or less exact replicas of tasks, knowledge, skills, and abilities required in actual work behavior. This chapter reviews research on the more traditional high-fidelity simulations (i.e., assessment centers and work samples) and contrasts it with the growing body of research on low-fidelity simulations (i.e., situational judgment tests). Both types of simulations are compared in terms of the following five statements: “The use of simulations enables organizations to make predictions about a broader array of KSAOs,” “We don't know what simulations exactly measure,” “When organizations use simulations, the adverse impact of their selection system will be reduced,” “Simulations …
Situational Judgment Tests In High-Stakes Settings: Issues And Strategies With Generating Alternate Forms, Filip Lievens, Paul R. Sackett
Situational Judgment Tests In High-Stakes Settings: Issues And Strategies With Generating Alternate Forms, Filip Lievens, Paul R. Sackett
Research Collection Lee Kong Chian School Of Business
This study used principles underlying item generation theory to posit competing perspectives about which features of situational judgment tests might enhance or impede consistent measurement across repeat test administrations. This led to 3 alternate-form development approaches (random assignment, incident isomorphism, and item isomorphism). The effects of these approaches on alternate-form consistency, mean score changes, and criterion-related validity were examined in a high-stakes context (N = 3,361). Generally, results revealed that even small changes in the context of the situations presented resulted in significantly lower alternate-form consistency. Conversely, placing more constraints on the alternate-form development process proved beneficial. The contributions, implications, …