Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 7 of 7
Full-Text Articles in Business
Prompt-Specificity In Scenario-Based Assessments: Associations With Personality Versus Knowledge And Effects On Predictive Validity, Thomas Rockstuhl, Filip Lievens
Prompt-Specificity In Scenario-Based Assessments: Associations With Personality Versus Knowledge And Effects On Predictive Validity, Thomas Rockstuhl, Filip Lievens
Research Collection Lee Kong Chian School Of Business
Many scenario-based assessments (e.g., interviews, assessment center exercises, work samples, simulations, and situational judgment tests) use prompts (i.e., cues provided to respondents to increase the likelihood that the information received from them is clear, sufficient, and job-related). However, a dilemma for practitioners and researchers is how general or specific one should prompt people's answers. We posit that such differences in prompt-specificity (i.e., extent to which prompts cue performance criteria) have important implications for the predictive validity of scenario-based assessment scores. Drawing on the interplay of situation construal and situational strength theory, we propose that prompt-specificity leads to differential relationships between …
Constructed Response Formats And Their Effects On Minority-Majority Differences And Validity, Filip Lievens, Paul R. Sackett, Jeffrey Dahlke, Janneke Oostrom, Britt De Soete
Constructed Response Formats And Their Effects On Minority-Majority Differences And Validity, Filip Lievens, Paul R. Sackett, Jeffrey Dahlke, Janneke Oostrom, Britt De Soete
Research Collection Lee Kong Chian School Of Business
The inflow of immigrants challenges organizations to consider alternative selection procedures that reduce potential minority (immigrants)-majority (natives) differences, while maintaining valid predictions of performance. To deal with this challenge, this paper proposes response format as a practically and theoretically relevant factor for situational judgment tests (SJTs). We examine a range of response format categories (from traditional multiple-choice formats to more innovative constructed response formats) and conceptually link these response formats to mechanisms underlying minority-majority differences. Two field experiments are conducted with SJTs. Study 1 (274 job seekers) contrasts minority-majority differences in scores on a multiple-choice versus a written constructed response …
Construct-Driven Sjts: Toward An Agenda For Future Research, Filip Lievens
Construct-Driven Sjts: Toward An Agenda For Future Research, Filip Lievens
Research Collection Lee Kong Chian School Of Business
A common theme running through recent research on Situational Judgment Tests (SJTs) and this special issue is the aim to improve the measurement of constructs via SJTs. Construct-driven SJTs differ from traditional SJTs in that they present a trait activating situation to test-takers and a more unidimensional set of response options that depict different trait levels. In this commentary, I frame the different papers of this special issue into a research agenda related to construct-driven SJTs. Specifically, I posit that future research should examine whether construct-driven SJTs lead to more unidimensionality at the item level, cleaner measurement of the constructs, …
Validity And Reliability Of Situational Judgement Test Scores: A New Approach Based On Cognitive Diagnosis Models, Miguel A. Sorrel, Julio Olea, Francisco José Abad, Jimmy De La Torre, David Aguado, Filip Lievens
Validity And Reliability Of Situational Judgement Test Scores: A New Approach Based On Cognitive Diagnosis Models, Miguel A. Sorrel, Julio Olea, Francisco José Abad, Jimmy De La Torre, David Aguado, Filip Lievens
Research Collection Lee Kong Chian School Of Business
Conventional methods for assessing the validity and reliability of situational judgment test (SJT) scores have proven to be inadequate. For example, factor analysis techniques typically lead to nonsensical solutions, and assumptions underlying Cronbach's alpha coefficient are violated due to the multidimensional nature of SJTs. In the current article, we describe how cognitive diagnosis models (CDMs) provide a new approach that not only overcomes these limitations but that also offers extra advantages for scoring and better understanding SJTs. The analysis of the Q-matrix specification, model fit, and model parameter estimates provide a greater wealth of information than traditional procedures do. Our …
Adjusting Medical School Admission: Assessing Interpersonal Skills Using Situational Judgement Tests, Filip Lievens
Adjusting Medical School Admission: Assessing Interpersonal Skills Using Situational Judgement Tests, Filip Lievens
Research Collection Lee Kong Chian School Of Business
Context: Todays formal medical school admission systems often include only cognitively oriented tests, although most medical school curricula emphasise both cognitive and non-cognitive factors. Situational judgement tests (SJTs) may represent an innovative approach to the formal measurement of interpersonal skills in large groups of candidates in medical school admission processes. This study examined the validity of interpersonal video-based SJTs in relation to a variety of outcome measures. Methods: This study used a longitudinal and multiple-cohort design to examine anonymised medical school admissions and medical education data. It focused on data for the Flemish medical school admission examination between 1999 and …
Validity Evidence For The Situational Judgment Test Paradigm In Emotional Intelligence Measurement, Nele Libbrecht, Filip Lievens
Validity Evidence For The Situational Judgment Test Paradigm In Emotional Intelligence Measurement, Nele Libbrecht, Filip Lievens
Research Collection Lee Kong Chian School Of Business
To date, various measurement approaches have been proposed to assess emotional intelligence (EI). Recently, two new EI tests have been developed based on the situational judgment test (SJT) paradigm: the Situational Test of Emotional Understanding (STEU) and the Situational Test of Emotion Management (STEM). Initial attempts have been made to examine the construct-related validity of these new tests; we extend these findings by placing the tests in a broad nomological network. To this end, 850 undergraduate students completed a personality inventory, a cognitive ability test, a self-report EI test, a performance-based EI measure, the STEU, and the STEM. The SJT-based …
The Validity And Incremental Validity Of Knowledge Tests, Low-Fidelity Simulations, And High-Fidelity Simulations For Predicting Job Performance In Advanced-Level High-Stakes Selection, Filip Lievens, Fiona Patterson
The Validity And Incremental Validity Of Knowledge Tests, Low-Fidelity Simulations, And High-Fidelity Simulations For Predicting Job Performance In Advanced-Level High-Stakes Selection, Filip Lievens, Fiona Patterson
Research Collection Lee Kong Chian School Of Business
In high-stakes selection among candidates with considerable domain-specific knowledge and experience, investigations of whether high-fidelity simulations (assessment centers; ACs) have incremental validity over low-fidelity simulations (situational judgment tests; SJTs) are lacking. Therefore, this article integrates research on the validity of knowledge tests, low-fidelity simulations, and high-fidelity simulations in advanced-level high-stakes settings. A model and hypotheses of how these 3 predictors work in combination to predict job performance were developed. In a sample of 196 applicants, all 3 predictors were significantly related to job performance. Both the SJT and the AC had incremental validity over the knowledge test. Moreover, the AC …