Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 5 of 5
Full-Text Articles in Psychology
The Role Of Situations In Situational Judgment Tests: Effects On Construct Saturation, Predictive Validity, And Applicant Perceptions, Philipp Schäpers, Patrick Mussel, Filip Lievens, Cornelius J. König, Jan-Philipp Freudenstein, Stefan Krumm
The Role Of Situations In Situational Judgment Tests: Effects On Construct Saturation, Predictive Validity, And Applicant Perceptions, Philipp Schäpers, Patrick Mussel, Filip Lievens, Cornelius J. König, Jan-Philipp Freudenstein, Stefan Krumm
Research Collection Lee Kong Chian School Of Business
Recent theorizing and empirical evidence suggesting thatsituational judgment tests (SJTs) are more context-independent than previouslythought has sparked a debate about the role of situation descriptions in SJTs.To contribute to this debate and add to our understanding of how SJTs work,this paper conceptually embeds SJT performance in a situation construal modeland examines the effects of situation descriptions on the construct saturationand predictive validity of SJT scores, as well as on applicant perceptions.Across two studies (N = 1,092 and 578) and different SJTs, personality andcognitive ability were equally important determinants of SJT performance regardlessof whether situation descriptions were presented or omitted. The …
A Dual-Process Theory Perspective To Better Understand Judgments In Assessment Centers: The Role Of Initial Impressions For Dimension Ratings And Validity, Pia V. Ingold, Mirjam Donni, Filip Lievens
A Dual-Process Theory Perspective To Better Understand Judgments In Assessment Centers: The Role Of Initial Impressions For Dimension Ratings And Validity, Pia V. Ingold, Mirjam Donni, Filip Lievens
Research Collection Lee Kong Chian School Of Business
Insight into assessors’ initial impressions has the potential to advance knowledge on how assessors form dimension-based judgments and on possible biases in these ratings. Therefore, this study draws on dual process theory to build and test a model that integrates assessors’ dimension ratings (i.e., systematic, slow, deliberate processing mode) with their initial impressions (i.e., intuitive, fast, automatic processing mode). Data collection started with an AC where assessors provided ratings of assessees, and an online survey of assessees’ supervisors who rated their job performance. In addition, two other rater pools provided initial impressions of these assessees by evaluating extracted 2-min video …
Validity And Reliability Of Situational Judgement Test Scores: A New Approach Based On Cognitive Diagnosis Models, Miguel A. Sorrel, Julio Olea, Francisco José Abad, Jimmy De La Torre, David Aguado, Filip Lievens
Validity And Reliability Of Situational Judgement Test Scores: A New Approach Based On Cognitive Diagnosis Models, Miguel A. Sorrel, Julio Olea, Francisco José Abad, Jimmy De La Torre, David Aguado, Filip Lievens
Research Collection Lee Kong Chian School Of Business
Conventional methods for assessing the validity and reliability of situational judgment test (SJT) scores have proven to be inadequate. For example, factor analysis techniques typically lead to nonsensical solutions, and assumptions underlying Cronbach's alpha coefficient are violated due to the multidimensional nature of SJTs. In the current article, we describe how cognitive diagnosis models (CDMs) provide a new approach that not only overcomes these limitations but that also offers extra advantages for scoring and better understanding SJTs. The analysis of the Q-matrix specification, model fit, and model parameter estimates provide a greater wealth of information than traditional procedures do. Our …
How "Situational" Is Judgment In Situational Judgment Tests?, Stefan Krumm, Filip Lievens, Joachim Huffmeier, Anastasiya A. Lipnevich, Hanna Bendels, Gudio Hertel
How "Situational" Is Judgment In Situational Judgment Tests?, Stefan Krumm, Filip Lievens, Joachim Huffmeier, Anastasiya A. Lipnevich, Hanna Bendels, Gudio Hertel
Research Collection Lee Kong Chian School Of Business
Whereas situational judgment tests (SJTs) have traditionally been conceptualized as low-fidelity simulations with an emphasis on contextualized situation descriptions and context-dependent knowledge, a recent perspective views SJTs as measures of more general domain (context-independent) knowledge. In the current research, we contrasted these 2 perspectives in 3 studies by removing the situation descriptions (i.e., item stems) from SJTs. Across studies, the traditional contextualized SJT perspective was not supported for between 43% and 71% of the items because it did not make a significant difference whether the situation description was included or not for these items. These results were replicated across construct …
Assessment Centers In Belgium: The Results Of A Study On Their Validity And Fairness, Filip Lievens, Etienne Van Keer, Morel De Witte
Assessment Centers In Belgium: The Results Of A Study On Their Validity And Fairness, Filip Lievens, Etienne Van Keer, Morel De Witte
Research Collection Lee Kong Chian School Of Business
In Belgium, assessment centers have grown in popularity. Despite this growing popularity, the validity of these selection and development methods has not been examined in Belgium. Therefore, this study examines the predictive validity and fairness of an assessment center of a large bank. The sample consisted of 252 middle level managers. Results revealed that the assessment center provides a valid prediction of success in higher managerial positions. With respect to fairness, this assessment center also scores well. Virtually no significant differences between men and women and between Flemish and French speaking Belgians are found. These positive results might be explained …