Open Access. Powered by Scholars. Published by Universities.®
- Discipline
- Institution
- Publication Year
- Publication
- Publication Type
Articles 1 - 15 of 15
Full-Text Articles in Psychology
The Chemistry Between Us: Illuminating Complementarity Patterns In Interpersonal Role Play Assessment Via Moment-To-Moment Analyses, Christoph N. Herde, Filip Lievens
The Chemistry Between Us: Illuminating Complementarity Patterns In Interpersonal Role Play Assessment Via Moment-To-Moment Analyses, Christoph N. Herde, Filip Lievens
Research Collection Lee Kong Chian School Of Business
In assessment and selection, organizations often include interpersonal interactions because they provide insights into candidates’ interpersonal skills. These skills are then typically assessed via one-shot, retrospective assessor ratings. Unfortunately, the assessment of interpersonal skills at such a trait-like level fails to capture the richness of how the interaction unfolds at the behavioral exchange level within a role-play assessment. This study uses the lens of interpersonal complementarity theory to advance our understanding of interpersonal dynamics in role-play assessment and their effects on assessor ratings. Ninety-six MBA students participated in four different flash role-plays as part of diagnosing their strengths and weaknesses. …
Interpersonal Behavior In Assessment Center Role-Play Exercises: Investigating Structure, Consistency, And Effectiveness, Simon M. Breil, Filip Lievens, Boris Forthmann, Mitla D. Back
Interpersonal Behavior In Assessment Center Role-Play Exercises: Investigating Structure, Consistency, And Effectiveness, Simon M. Breil, Filip Lievens, Boris Forthmann, Mitla D. Back
Research Collection Lee Kong Chian School Of Business
Although the behaviors displayed by assessees are the currency of assessment centers (ACs), they have remained largely unexplored. This is surprising because a better understanding of assessees' behaviors may provide the missing link between research on the determinants of assessee performance and research on the validity of performance ratings. Therefore, this study draws on behavioral personality science to scrutinize the behaviors that assessees express in interpersonal AC exercises. Our goals were to investigate (a) the structure of interpersonal behaviors, (b) the consistency of these behaviors across AC exercises, and (c) their effectiveness. We obtained videotaped performances of 203 assessees who …
Behavioral Assessment Of Expert Talent Competencies: Analysis, Decision Making, And Written And Verbal Communication Skills, Homayoon Kord, George C. Thornton Iii
Behavioral Assessment Of Expert Talent Competencies: Analysis, Decision Making, And Written And Verbal Communication Skills, Homayoon Kord, George C. Thornton Iii
Personnel Assessment and Decisions
Organizations face challenges of screening applicants for critical skills to serve in expert staff positions requiring interactions with line managers. Such positions require a special set of cognitive and interpersonal competencies. This study investigates the psychometric qualities of a new behavioral assessment method in use in an applied setting. Using data from a group of 219 finalists for positions in a large Iranian steel company, it examined the validity and fairness of the method in relation to other test and demographic information. Results showed evidence of convergent and discriminant validity and no discrimination against women or older candidates. The study …
A New Scoring Procedure In Assessment Centers: Insights From Interaction Analysis, Janneke K. Oostrom, Nale Lehmann-Willenbrock, Ute-Christine Klehe
A New Scoring Procedure In Assessment Centers: Insights From Interaction Analysis, Janneke K. Oostrom, Nale Lehmann-Willenbrock, Ute-Christine Klehe
Personnel Assessment and Decisions
This paper proposes interaction analysis as an alternative scoring procedure in assessment centers (ACs). Interaction analysis allows for a more fine-grained scoring approach by which candidate behaviors are captured as they actually happen, thus avoiding judgment errors typically associated with traditional scoring procedures. We describe interaction analysis and explain how this procedure can improve the validity of ACs. In a short research example, we showcase how interaction analysis can be implemented in AC settings. Finally, we integrate our arguments in terms of three key propositions which we hope will inspire future research on more dynamic scoring procedures.
A Dual-Process Theory Perspective To Better Understand Judgments In Assessment Centers: The Role Of Initial Impressions For Dimension Ratings And Validity, Pia V. Ingold, Mirjam Donni, Filip Lievens
A Dual-Process Theory Perspective To Better Understand Judgments In Assessment Centers: The Role Of Initial Impressions For Dimension Ratings And Validity, Pia V. Ingold, Mirjam Donni, Filip Lievens
Research Collection Lee Kong Chian School Of Business
Insight into assessors’ initial impressions has the potential to advance knowledge on how assessors form dimension-based judgments and on possible biases in these ratings. Therefore, this study draws on dual process theory to build and test a model that integrates assessors’ dimension ratings (i.e., systematic, slow, deliberate processing mode) with their initial impressions (i.e., intuitive, fast, automatic processing mode). Data collection started with an AC where assessors provided ratings of assessees, and an online survey of assessees’ supervisors who rated their job performance. In addition, two other rater pools provided initial impressions of these assessees by evaluating extracted 2-min video …
Gender Differences In Development Center Performance In A Healthcare Organization, Samuel Lawson
Gender Differences In Development Center Performance In A Healthcare Organization, Samuel Lawson
All Graduate Theses, Dissertations, and Other Capstone Projects
Over the past 50 years, the assessment center has evolved into a tool used for making selection and job placement decisions, as well as for identifying development areas among incumbents to promote skill and competency development where gaps exist. The present study examined the latter, that of development centers, to address potential gender differences in performance on a variety of exercise and competency areas within a development center context. Research efforts were also directed toward the exercises and competencies themselves and the relationships between them. Multiple regression analyses were conducted to investigate exercise-competency relationships, while t-tests were conducted to investigate …
Finding The Ghost With The Machine: Breaking Through The Assessment Center Validity Ceiling By Exploring Decisional Processes Using New Sources Of Behavioral Data Within Virtual Assessments, Brett W. Guidry
Open Access Dissertations
Decades of assessment center (AC) research has resulted in an inevitable “validity ceiling” whereby increasing the validity of the AC method is becoming increasingly difficult. To overcome this challenge, new avenues for collecting and evaluating AC participant behaviors must be explored, with a particular focus on overcoming the inherent limitations of human observation—a hallmark of the AC method. This study examines detailed logs of AC participant behaviors captured automatically and unobtrusively during a computer-based simulation assessment. Using a decision making framework, basic characteristics of the new behavioral data are tested against existing theories of decisional efficacy. The construct-related validity of …
Interpersonal Dynamics In Assessment Center Exercises: Effects Of Role Player Portrayed Disposition, Tom Oliver, Peter Hausdorf, Filip Lievens, Peter Conlon
Interpersonal Dynamics In Assessment Center Exercises: Effects Of Role Player Portrayed Disposition, Tom Oliver, Peter Hausdorf, Filip Lievens, Peter Conlon
Research Collection Lee Kong Chian School Of Business
Although interpersonal interactions are the mainstay of many assessment center exercises, little is known about how these interactions unfold and affect participant behavior and performance. More specifically, participants interact with role players who have been instructed to demonstrate behavior reflecting specific dispositions as part of the exercise. This study focuses on role player portrayed disposition as a potentially important social demand relevant to participant behavior and performance in interpersonal simulations. We integrate interpersonal theory and trait activation theory to formulate hypotheses about the effects of role player portrayed disposition on participant behavior and performance in 184 interpersonal simulations. A significant …
Understanding The Building Blocks Of Selection Procedures: Effects Of Response Fidelity On Performance And Validity, Filip Lievens, Wilfried De Corte, Lena Westerveld
Understanding The Building Blocks Of Selection Procedures: Effects Of Response Fidelity On Performance And Validity, Filip Lievens, Wilfried De Corte, Lena Westerveld
Research Collection Lee Kong Chian School Of Business
This study aims to advance our conceptual understanding of selection procedures by exploring the effect of response fidelity (i.e., written constructed response vs. behavioral constructed response) on test performance, validity, and applicant perceptions. Stimulus fidelity (multimedia stimulus) was kept constant. In a field experiment, 208 applicants for entry-level police officer jobs completed a multimedia situational judgment test with written constructed responses and behavioral responses. We hypothesized the behavioral response mode (a) to be a better predictor of police trainee performance one year later, (b) to be less cognitively saturated, (c) to exhibit higher personality (extraversion) saturation, and (d) to be …
The Interplay Of Elicitation And Evaluation Of Trait-Expressive Behavior: Evidence In Assessment Center Exercises, Filip Lievens, Eveline Schollaert, Gert Keen
The Interplay Of Elicitation And Evaluation Of Trait-Expressive Behavior: Evidence In Assessment Center Exercises, Filip Lievens, Eveline Schollaert, Gert Keen
Research Collection Lee Kong Chian School Of Business
In assessment centers (ACs), research on eliciting candidate behavior and evaluating candidate behavior have largely followed independent paths. This study integrates trait activation and trait rating models to posit hypotheses about the effects of behavior elicitation via situational cues on key assessor observation and rating variables. To test the hypotheses, a series of experimental and field studies are conducted. Only when trait-expressive behavior activation and evaluation models work in conjunction, increases in observability are coupled with increases in the interrater reliability, convergent validity, discriminant validity, and accuracy of AC ratings. Implications of these findings for AC theory and practice are …
Guidelines And Ethical Considerations For Assessment Center Operations, Deborah E. Rupp, Brian J Hoffman, David Bischof, William Byham, Lynn Collins, Alyssa Gibbons, Shinichi Hirose, Martin Kleinmann, Jeffrey D. Kudisch, Martin Lanik, Duncan J. R. Jackson, Myungjoon Kim, Filip Lievens, Deon Meiring, Klaus G. Melchers, Vina G. Pendit, Dan J. Putka, Nigel Povah, Doug Reynolds, Sandra Schlebusch
Guidelines And Ethical Considerations For Assessment Center Operations, Deborah E. Rupp, Brian J Hoffman, David Bischof, William Byham, Lynn Collins, Alyssa Gibbons, Shinichi Hirose, Martin Kleinmann, Jeffrey D. Kudisch, Martin Lanik, Duncan J. R. Jackson, Myungjoon Kim, Filip Lievens, Deon Meiring, Klaus G. Melchers, Vina G. Pendit, Dan J. Putka, Nigel Povah, Doug Reynolds, Sandra Schlebusch
Research Collection Lee Kong Chian School Of Business
This document’s intended purpose is to provide professional guidelines and ethical considerations for users of the assessment center method. These guidelines are designed to cover both existing and future applications. The title assessment center is restricted to those methods that follow these guidelines.
Measurement Invariance Of Assessment Center Ratings: Consistency Of Dimensional Constructs Across Exercises, Jin Lee
Master's Theses
The criterion-related validity of assessment centers (ACs) has been consistently supported. However, there has been an ongoing debate about AC construct validity in regard to low dimension variance and overriding exercise variance. Many studies that showed weak dimension effects in ACs have been based on the multitrait-multimethod (MTMM) framework which posits cross-situational variance as error and all capability dimensions can be equally represented from different exercises. The goal of this study is to introduce a measurement invariance (MI) framework for evaluating the construct validity of AC dimensions. Specifically, MI analysis was used to test whether the construct meaning of AC …
Gathering Behavioral Samples Through A Computerized And Standardized Assessment Center Exercise Yes, It Is Possible, Filip Lievens, Etienne Van Keer, Ellen Volckaert
Gathering Behavioral Samples Through A Computerized And Standardized Assessment Center Exercise Yes, It Is Possible, Filip Lievens, Etienne Van Keer, Ellen Volckaert
Research Collection Lee Kong Chian School Of Business
Although computerization and standardization might make assessment center (AC) exercises easier to administer and score, drawbacks are that most of such exercises have a static and multiple-choice format. This study reports on the development and initial validation of a computerized and standardized AC exercise that simulates key managerial tasks. This AC exercise capitalizes not only on the benefits of computerization and standardization (efficiency and cost savings) but at the same time aims to avoid their usual drawbacks (lower response fidelity and interactivity). The composite exercise score was significantly related to several criteria of interest and had incremental validity beyond cognitive …
Using A Contingency-Based Method For Combining Individual Assessment Center Dimension Ratings Into Overall Assessment Ratings, Keisha Wicks
Using A Contingency-Based Method For Combining Individual Assessment Center Dimension Ratings Into Overall Assessment Ratings, Keisha Wicks
Electronic Theses and Dissertations
The current study applies a newly proposed mechanical combination method along with four traditional mechanical combination methods to assessment center scoring. These comparisons were made for two job levels (Fire Lieutenant and Fire Captain). The study further assesses the level of adverse impact for the various methods at three cut-off scores. Results indicated that the new contingency-based scoring method was successfully implemented in the assessment center. Results were mixed regarding whether the contingencies developed for the two job levels were different. Further, results indicated that although the various combination methods were highly correlated as expected, there were clear distinctions in …
Dimension And Exercise Variance In Assessment Center Scores: A Large-Scale Evaluation Of Multitrait-Multimethod Studies, Filip Lievens, James M. Conway
Dimension And Exercise Variance In Assessment Center Scores: A Large-Scale Evaluation Of Multitrait-Multimethod Studies, Filip Lievens, James M. Conway
Research Collection Lee Kong Chian School Of Business
This study addresses 3 questions regarding assessment center construct validity: (a) Are assessment center ratings best thought of is reflecting dimension constructs (dimension model). exercises (exercise model). or a combination? (b) To what extent do dimensions or exercises account for variance? (c) Which design characteristics increase dimension variance? To this end, a large set of multitrait-multimethod studies (N = 34) were analyzed, showing that assessment center ratings were best represented (i.e., in terms of fit and admissible solutions) by a model with correlated dimensions and exercises specified a correlated uniquenesses. In this model, dimension variance equals exercise variance. Significantly more …