Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 8 of 8
Full-Text Articles in Business
Effects Of Situation Descriptions On The Construct-Related Validity Of Construct-Driven Situational Judgment Tests, Philipp Christopher Schaepers, Jan-Philipp Freudenstein, Patrick Mussel, Filip Lievens, Stefan Krumm
Effects Of Situation Descriptions On The Construct-Related Validity Of Construct-Driven Situational Judgment Tests, Philipp Christopher Schaepers, Jan-Philipp Freudenstein, Patrick Mussel, Filip Lievens, Stefan Krumm
Research Collection Lee Kong Chian School Of Business
Despite the common belief that situation descriptions in SJTs are central to the measurement of targeted constructs, recent studies demonstrated that omitting situation descriptions had only minor effects on SJT performance and validity. However, these results might be due to the fact that traditional SJTs often fail to assess well-defined constructs. So, we aimed to examine the relationships between construct-driven SJT scores with and without situations and self- and peer-rated personality dimensions (N = 158). Results revealed almost no difference in construct-related validity between both versions. The conscientiousness facet emerged as the only exception, for which the SJT scores without …
Removing Situation Descriptions From Situational Judgment Test Items: Does The Impact Differ For Video-Based Versus Text-Based Formats?, Philipp Schäpers, Filip Lievens, Jan-Philipp Freudenstein, Joachim Hüffmeier, Cornelius J. König, Stefan Krumm
Removing Situation Descriptions From Situational Judgment Test Items: Does The Impact Differ For Video-Based Versus Text-Based Formats?, Philipp Schäpers, Filip Lievens, Jan-Philipp Freudenstein, Joachim Hüffmeier, Cornelius J. König, Stefan Krumm
Research Collection Lee Kong Chian School Of Business
Recent research has shown that many text-based situational judgment test (SJT) items can be solved even when the situational descriptions in the item stems are not presented to test takers. This finding challenges the traditional view of SJTs as low-fidelity simulations that rely on ‘situational’ (context-dependent) judgment. However, media richness theory and construal level theory suggest that situation descriptions presented in a richer and more concrete format (video format) will reduce uncertainty about inherent requirements and facilitate the perception that the situation is taking place in the here and now. Therefore, we hypothesized that situational judgment would be more important …
Is It All In The Eye Of The Beholder? The Importance Of Situation Construal For Situational Judgment Test Performance, Jan-Philipp Freudenstein, Philipp Schaepers, Lena Roemer, Patrick Mussel, Stefan Krumm
Is It All In The Eye Of The Beholder? The Importance Of Situation Construal For Situational Judgment Test Performance, Jan-Philipp Freudenstein, Philipp Schaepers, Lena Roemer, Patrick Mussel, Stefan Krumm
Research Collection Lee Kong Chian School Of Business
Recent research challenges the importance of situation descriptions for situational judgment test (SJT) performance. This study contributes to resolving the ongoing debate on whether SJTs are situational measures, by incorporating findings on person x situation interactions into SJT research. Specifically, across three studies (N-Total = 1,239), we first tested whether situation construal (i.e., the individual perception of situations in SJTs) predicts responses to SJT items. Second, we assessed whether the relevance of situation construal for SJT performance depends on test elements (i.e., situation descriptions and response options) and item features (i.e., description-dependent vs. description-independent SJT items). Lastly, we determined whether …
Optimizing The Validity Of Situational Judgment Tests: The Importance Of Scoring Methods, Qingxiong Weng, Hui Yang, Filip Lievens, Michael A. Mcdaniel
Optimizing The Validity Of Situational Judgment Tests: The Importance Of Scoring Methods, Qingxiong Weng, Hui Yang, Filip Lievens, Michael A. Mcdaniel
Research Collection Lee Kong Chian School Of Business
In recent years, situational judgment tests (SJTs) have made strong inroads in assessment practices. Despite the importance of scoring for the validity of SJTs, little attention has been paid to different SJT scoring methods. This study investigated the influence of scoring methods on the criterion-related validity of SJTs. We examined five different consensus scoring methods (i.e., raw, standardized, dichotomous, mode, and proportion scoring) and several integrated scoring methods for scoring the same SJT. Results showed that one of the most popular scoring approaches (raw consensus scoring) is associated with an extreme response tendency and yields the lowest scale validity of …
Differences Between Multimedia And Text-Based Assessments Of Emotion Management: An Exploration With The Multimedia Emotion Management Assessment (Mema), Carolyn Maccann, Filip Lievens, Nele Libbrecht, Richard D. Roberts
Differences Between Multimedia And Text-Based Assessments Of Emotion Management: An Exploration With The Multimedia Emotion Management Assessment (Mema), Carolyn Maccann, Filip Lievens, Nele Libbrecht, Richard D. Roberts
Research Collection Lee Kong Chian School Of Business
People process emotional information using visual, vocal, and verbal cues. However, emotion management is typically assessed with text based rather than multimedia stimuli. This study (N=427) presents the new multimedia emotion management assessment (MEMA) and compares it to the text-based assessment of emotion management used in the MSCEIT. The text-based and multimedia assessment showed similar levels of cognitive saturation and similar prediction of relevant criteria. Results demonstrate that the MEMA scores have equivalent evidence of validity to the text-based MSCEIT test scores, demonstrating that multimedia assessment of emotion management is viable. Furthermore, our results inform the debate as to whether …
Understanding The Building Blocks Of Selection Procedures: Effects Of Response Fidelity On Performance And Validity, Filip Lievens, Wilfried De Corte, Lena Westerveld
Understanding The Building Blocks Of Selection Procedures: Effects Of Response Fidelity On Performance And Validity, Filip Lievens, Wilfried De Corte, Lena Westerveld
Research Collection Lee Kong Chian School Of Business
This study aims to advance our conceptual understanding of selection procedures by exploring the effect of response fidelity (i.e., written constructed response vs. behavioral constructed response) on test performance, validity, and applicant perceptions. Stimulus fidelity (multimedia stimulus) was kept constant. In a field experiment, 208 applicants for entry-level police officer jobs completed a multimedia situational judgment test with written constructed responses and behavioral responses. We hypothesized the behavioral response mode (a) to be a better predictor of police trainee performance one year later, (b) to be less cognitively saturated, (c) to exhibit higher personality (extraversion) saturation, and (d) to be …
How "Situational" Is Judgment In Situational Judgment Tests?, Stefan Krumm, Filip Lievens, Joachim Huffmeier, Anastasiya A. Lipnevich, Hanna Bendels, Gudio Hertel
How "Situational" Is Judgment In Situational Judgment Tests?, Stefan Krumm, Filip Lievens, Joachim Huffmeier, Anastasiya A. Lipnevich, Hanna Bendels, Gudio Hertel
Research Collection Lee Kong Chian School Of Business
Whereas situational judgment tests (SJTs) have traditionally been conceptualized as low-fidelity simulations with an emphasis on contextualized situation descriptions and context-dependent knowledge, a recent perspective views SJTs as measures of more general domain (context-independent) knowledge. In the current research, we contrasted these 2 perspectives in 3 studies by removing the situation descriptions (i.e., item stems) from SJTs. Across studies, the traditional contextualized SJT perspective was not supported for between 43% and 71% of the items because it did not make a significant difference whether the situation description was included or not for these items. These results were replicated across construct …
Video-Based Versus Written Situational Judgment Tests: A Comparison In Terms Of Predictive Validity, Filip Lievens, Paul R. Sackett
Video-Based Versus Written Situational Judgment Tests: A Comparison In Terms Of Predictive Validity, Filip Lievens, Paul R. Sackett
Research Collection Lee Kong Chian School Of Business
In this study, the authors examined whether video-based situational judgment tests (SJTs) have higher predictive validity than written SJTs (keeping verbal content constant). The samples consisted of 1, 159 students who completed a video-based version of an SIT and 1,750 students who completed the same SIT in a written format. The study was conducted in a high stakes testing context. The video-based version of an interpersonally oriented SJT had a lower correlation with cognitive ability than did the written version. It also had higher predictive and incremental validity for predicting interpersonally oriented criteria than did the written version. In this …