Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 13 of 13
Full-Text Articles in Business
Effects Of Situation Descriptions On The Construct-Related Validity Of Construct-Driven Situational Judgment Tests, Philipp Christopher Schaepers, Jan-Philipp Freudenstein, Patrick Mussel, Filip Lievens, Stefan Krumm
Effects Of Situation Descriptions On The Construct-Related Validity Of Construct-Driven Situational Judgment Tests, Philipp Christopher Schaepers, Jan-Philipp Freudenstein, Patrick Mussel, Filip Lievens, Stefan Krumm
Research Collection Lee Kong Chian School Of Business
Despite the common belief that situation descriptions in SJTs are central to the measurement of targeted constructs, recent studies demonstrated that omitting situation descriptions had only minor effects on SJT performance and validity. However, these results might be due to the fact that traditional SJTs often fail to assess well-defined constructs. So, we aimed to examine the relationships between construct-driven SJT scores with and without situations and self- and peer-rated personality dimensions (N = 158). Results revealed almost no difference in construct-related validity between both versions. The conscientiousness facet emerged as the only exception, for which the SJT scores without …
Removing Situation Descriptions From Situational Judgment Test Items: Does The Impact Differ For Video-Based Versus Text-Based Formats?, Philipp Schäpers, Filip Lievens, Jan-Philipp Freudenstein, Joachim Hüffmeier, Cornelius J. König, Stefan Krumm
Removing Situation Descriptions From Situational Judgment Test Items: Does The Impact Differ For Video-Based Versus Text-Based Formats?, Philipp Schäpers, Filip Lievens, Jan-Philipp Freudenstein, Joachim Hüffmeier, Cornelius J. König, Stefan Krumm
Research Collection Lee Kong Chian School Of Business
Recent research has shown that many text-based situational judgment test (SJT) items can be solved even when the situational descriptions in the item stems are not presented to test takers. This finding challenges the traditional view of SJTs as low-fidelity simulations that rely on ‘situational’ (context-dependent) judgment. However, media richness theory and construal level theory suggest that situation descriptions presented in a richer and more concrete format (video format) will reduce uncertainty about inherent requirements and facilitate the perception that the situation is taking place in the here and now. Therefore, we hypothesized that situational judgment would be more important …
Is It All In The Eye Of The Beholder? The Importance Of Situation Construal For Situational Judgment Test Performance, Jan-Philipp Freudenstein, Philipp Schaepers, Lena Roemer, Patrick Mussel, Stefan Krumm
Is It All In The Eye Of The Beholder? The Importance Of Situation Construal For Situational Judgment Test Performance, Jan-Philipp Freudenstein, Philipp Schaepers, Lena Roemer, Patrick Mussel, Stefan Krumm
Research Collection Lee Kong Chian School Of Business
Recent research challenges the importance of situation descriptions for situational judgment test (SJT) performance. This study contributes to resolving the ongoing debate on whether SJTs are situational measures, by incorporating findings on person x situation interactions into SJT research. Specifically, across three studies (N-Total = 1,239), we first tested whether situation construal (i.e., the individual perception of situations in SJTs) predicts responses to SJT items. Second, we assessed whether the relevance of situation construal for SJT performance depends on test elements (i.e., situation descriptions and response options) and item features (i.e., description-dependent vs. description-independent SJT items). Lastly, we determined whether …
Situational Judgment Tests As Measures Of 21st Century Skills: Evidence Across Europe And Latin America, Christoph Herde, Filip Lievens, Emily G. Solberg, Harbaugh Jan L., Mark H. Strong, Gary J. Burkholder
Situational Judgment Tests As Measures Of 21st Century Skills: Evidence Across Europe And Latin America, Christoph Herde, Filip Lievens, Emily G. Solberg, Harbaugh Jan L., Mark H. Strong, Gary J. Burkholder
Research Collection Lee Kong Chian School Of Business
Over the years, various governmental, employment, and academic organizations have identified a list of skills to successfully master the challenges of the 21st century. So far, an adequate assessment of these skills across countries has remained challenging. Limitations inherent in the use of self-reports (e.g., lack of self-insight, socially desirable responding, response style bias, reference group bias, etc.) have spurred on the search for methods that could complement or even substitute self-report inventories. Situational judgment tests (SJTs) have been proposed as one of the complements/alternatives to the traditional self-report inventories. SJTs are low-fidelity simulations that confront participants with multiple domain-relevant …
The Predictive Power Of People's Intraindividual Variability Across Situations: Implementing Whole Trait Theory In Assessment, Filip Lievens, Jonas W. B. Lang, Filip De Fruyt, Myrjam Van De Vijver, Ronald Bledow
The Predictive Power Of People's Intraindividual Variability Across Situations: Implementing Whole Trait Theory In Assessment, Filip Lievens, Jonas W. B. Lang, Filip De Fruyt, Myrjam Van De Vijver, Ronald Bledow
Research Collection Lee Kong Chian School Of Business
In the last decade, there has been increased recognition that traits refer not only to between-person differences but also to meaningful within-person variability across situations (i.e., whole trait theory). So far, this broader more contemporary trait conceptualization has made few inroads into assessment practices. Therefore, this study focuses on the assessment and predictive power of people’s intraindividual variability across situations. In three studies (either in student or employee samples), both test-takers’ mean trait scores and the variability of their responses across multiple written job-related situations of a situational judgment test (SJT) were assessed. Results revealed that people’s intraindividual variability (a) …
Optimizing The Validity Of Situational Judgment Tests: The Importance Of Scoring Methods, Qingxiong Weng, Hui Yang, Filip Lievens, Michael A. Mcdaniel
Optimizing The Validity Of Situational Judgment Tests: The Importance Of Scoring Methods, Qingxiong Weng, Hui Yang, Filip Lievens, Michael A. Mcdaniel
Research Collection Lee Kong Chian School Of Business
In recent years, situational judgment tests (SJTs) have made strong inroads in assessment practices. Despite the importance of scoring for the validity of SJTs, little attention has been paid to different SJT scoring methods. This study investigated the influence of scoring methods on the criterion-related validity of SJTs. We examined five different consensus scoring methods (i.e., raw, standardized, dichotomous, mode, and proportion scoring) and several integrated scoring methods for scoring the same SJT. Results showed that one of the most popular scoring approaches (raw consensus scoring) is associated with an extreme response tendency and yields the lowest scale validity of …
Differences Between Multimedia And Text-Based Assessments Of Emotion Management: An Exploration With The Multimedia Emotion Management Assessment (Mema), Carolyn Maccann, Filip Lievens, Nele Libbrecht, Richard D. Roberts
Differences Between Multimedia And Text-Based Assessments Of Emotion Management: An Exploration With The Multimedia Emotion Management Assessment (Mema), Carolyn Maccann, Filip Lievens, Nele Libbrecht, Richard D. Roberts
Research Collection Lee Kong Chian School Of Business
People process emotional information using visual, vocal, and verbal cues. However, emotion management is typically assessed with text based rather than multimedia stimuli. This study (N=427) presents the new multimedia emotion management assessment (MEMA) and compares it to the text-based assessment of emotion management used in the MSCEIT. The text-based and multimedia assessment showed similar levels of cognitive saturation and similar prediction of relevant criteria. Results demonstrate that the MEMA scores have equivalent evidence of validity to the text-based MSCEIT test scores, demonstrating that multimedia assessment of emotion management is viable. Furthermore, our results inform the debate as to whether …
Understanding The Building Blocks Of Selection Procedures: Effects Of Response Fidelity On Performance And Validity, Filip Lievens, Wilfried De Corte, Lena Westerveld
Understanding The Building Blocks Of Selection Procedures: Effects Of Response Fidelity On Performance And Validity, Filip Lievens, Wilfried De Corte, Lena Westerveld
Research Collection Lee Kong Chian School Of Business
This study aims to advance our conceptual understanding of selection procedures by exploring the effect of response fidelity (i.e., written constructed response vs. behavioral constructed response) on test performance, validity, and applicant perceptions. Stimulus fidelity (multimedia stimulus) was kept constant. In a field experiment, 208 applicants for entry-level police officer jobs completed a multimedia situational judgment test with written constructed responses and behavioral responses. We hypothesized the behavioral response mode (a) to be a better predictor of police trainee performance one year later, (b) to be less cognitively saturated, (c) to exhibit higher personality (extraversion) saturation, and (d) to be …
How "Situational" Is Judgment In Situational Judgment Tests?, Stefan Krumm, Filip Lievens, Joachim Huffmeier, Anastasiya A. Lipnevich, Hanna Bendels, Gudio Hertel
How "Situational" Is Judgment In Situational Judgment Tests?, Stefan Krumm, Filip Lievens, Joachim Huffmeier, Anastasiya A. Lipnevich, Hanna Bendels, Gudio Hertel
Research Collection Lee Kong Chian School Of Business
Whereas situational judgment tests (SJTs) have traditionally been conceptualized as low-fidelity simulations with an emphasis on contextualized situation descriptions and context-dependent knowledge, a recent perspective views SJTs as measures of more general domain (context-independent) knowledge. In the current research, we contrasted these 2 perspectives in 3 studies by removing the situation descriptions (i.e., item stems) from SJTs. Across studies, the traditional contextualized SJT perspective was not supported for between 43% and 71% of the items because it did not make a significant difference whether the situation description was included or not for these items. These results were replicated across construct …
The Validity Of Interpersonal Skills Assessment Via Situational Judgment Tests For Predicting Academic Success And Job Performance, Filip Lievens, Paul R. Sackett
The Validity Of Interpersonal Skills Assessment Via Situational Judgment Tests For Predicting Academic Success And Job Performance, Filip Lievens, Paul R. Sackett
Research Collection Lee Kong Chian School Of Business
This study provides conceptual and empirical arguments why an assessment of applicants' procedural knowledge about interpersonal behavior via a video-based situational judgment test might be valid for academic and postacademic success criteria. Four cohorts of medical students (N = 723) were followed from admission to employment. Procedural knowledge about interpersonal behavior at the time of admission was valid for both internship performance (7 years later) and job performance (9 years later) and showed incremental validity over cognitive factors. Mediation analyses supported the conceptual link between procedural knowledge about interpersonal behavior, translating that knowledge into actual interpersonal behavior in internships, and …
Situational Judgment Tests As A New Tool For Dental Student Selection, Tine Buyse, Filip Lievens
Situational Judgment Tests As A New Tool For Dental Student Selection, Tine Buyse, Filip Lievens
Research Collection Lee Kong Chian School Of Business
Cognitive tests are used to select students into dental school, yet cognitive predictors explain only part of the variance in academic performance. Therefore, interviews and personality tests are often used to measure noncognitive (e.g., interpersonal) characteristics. Recently, situational judgment tests (SJTs) have drawn attention since there is evidence that SJTs can be valid predictors in medical admission contexts. This study examines the validity of an SJT measuring interpersonal skills for predicting academic performance of dental students. Incremental validity over cognitive tests is also examined. In this study, 796 dental students who passed the admission exam for medical and dental students …
The Effects Of Response Instructions On Situational Judgment Test Performance And Validity In A High-Stakes Context, Filip Lievens, Paul R. Sackett, Tine Buyse
The Effects Of Response Instructions On Situational Judgment Test Performance And Validity In A High-Stakes Context, Filip Lievens, Paul R. Sackett, Tine Buyse
Research Collection Lee Kong Chian School Of Business
This study fills a key gap in research on response instructions in situational judgment tests (SJTs). The authors examined whether the assumptions behind the differential effects of knowledge and behavioral tendency SJT response instructions hold in a large-scale high-stakes selection context (i.e., admission to medical college). Candidates (N = 2,184) were randomly assigned to a knowledge or behavioral tendency response instruction SJT, while SJT content was kept constant. Contrary to prior research in low-stakes settings, no meaningfully important differences were found between mean scores for the response instruction sets. Consistent with prior research, the SJT with knowledge instructions correlated more …
Video-Based Versus Written Situational Judgment Tests: A Comparison In Terms Of Predictive Validity, Filip Lievens, Paul R. Sackett
Video-Based Versus Written Situational Judgment Tests: A Comparison In Terms Of Predictive Validity, Filip Lievens, Paul R. Sackett
Research Collection Lee Kong Chian School Of Business
In this study, the authors examined whether video-based situational judgment tests (SJTs) have higher predictive validity than written SJTs (keeping verbal content constant). The samples consisted of 1, 159 students who completed a video-based version of an SIT and 1,750 students who completed the same SIT in a written format. The study was conducted in a high stakes testing context. The video-based version of an interpersonally oriented SJT had a lower correlation with cognitive ability than did the written version. It also had higher predictive and incremental validity for predicting interpersonally oriented criteria than did the written version. In this …