Industrial and Organizational Psychology Commons^™

Development And Test Of An Integrative Model Of Job Search Behaviour, Greet Van Hoye, Alan M. Saks, Filip Lievens, Bert Weijters

Research Collection Lee Kong Chian School Of Business

Research on job search and the theory of planned behaviour (TPB) has identified job search attitude, subjective norm, and job search self-efficacy as the most proximal determinants of job seekers' search intentions and subsequently job search behaviours. However, we do not yet know how more distal individual differences (e.g., personality) and situational factors (e.g., social context) might help to predict these key TPB determinants of job search behaviour. In an integrative model of job search behaviour, we propose specific relationships between these distal variables and the TPB determinants, which in turn are expected to mediate the effects of individual differences …

The Interplay Of Elicitation And Evaluation Of Trait-Expressive Behavior: Evidence In Assessment Center Exercises, Filip Lievens, Eveline Schollaert, Gert Keen

Research Collection Lee Kong Chian School Of Business

In assessment centers (ACs), research on eliciting candidate behavior and evaluating candidate behavior have largely followed independent paths. This study integrates trait activation and trait rating models to posit hypotheses about the effects of behavior elicitation via situational cues on key assessor observation and rating variables. To test the hypotheses, a series of experimental and field studies are conducted. Only when trait-expressive behavior activation and evaluation models work in conjunction, increases in observability are coupled with increases in the interrater reliability, convergent validity, discriminant validity, and accuracy of AC ratings. Implications of these findings for AC theory and practice are …

Guidelines And Ethical Considerations For Assessment Center Operations, Deborah E. Rupp, Brian J Hoffman, David Bischof, William Byham, Lynn Collins, Alyssa Gibbons, Shinichi Hirose, Martin Kleinmann, Jeffrey D. Kudisch, Martin Lanik, Duncan J. R. Jackson, Myungjoon Kim, Filip Lievens, Deon Meiring, Klaus G. Melchers, Vina G. Pendit, Dan J. Putka, Nigel Povah, Doug Reynolds, Sandra Schlebusch

Research Collection Lee Kong Chian School Of Business

This document’s intended purpose is to provide professional guidelines and ethical considerations for users of the assessment center method. These guidelines are designed to cover both existing and future applications. The title assessment center is restricted to those methods that follow these guidelines.

How "Situational" Is Judgment In Situational Judgment Tests?, Stefan Krumm, Filip Lievens, Joachim Huffmeier, Anastasiya A. Lipnevich, Hanna Bendels, Gudio Hertel

Research Collection Lee Kong Chian School Of Business

Whereas situational judgment tests (SJTs) have traditionally been conceptualized as low-fidelity simulations with an emphasis on contextualized situation descriptions and context-dependent knowledge, a recent perspective views SJTs as measures of more general domain (context-independent) knowledge. In the current research, we contrasted these 2 perspectives in 3 studies by removing the situation descriptions (i.e., item stems) from SJTs. Across studies, the traditional contextualized SJT perspective was not supported for between 43% and 71% of the items because it did not make a significant difference whether the situation description was included or not for these items. These results were replicated across construct …

On The Limitations Of Using Situational Judgement Tests To Measure Interpersonal Skills: The Moderating Influence Of Employee Anger, Jerel E. Slaughter, Michael S. Christian, Nathan P. Podsakoff, Evan F. Sinar, Filip Lievens

Research Collection Lee Kong Chian School Of Business

Many authors have suggested that situational judgment tests (SJTs) are useful tools for assessing applicants because SJT items can be written to assess a number of job-related knowledges, skills, abilities and other characteristics (KSAOs). However, SJTs may not be appropriate for measuring certain KSAOs for some applicants. We posit that using SJTs to measure interpersonal skills may lead to invalid inferences about applicants with higher levels of angry hostility (AH), and thus, AH should moderate the relation between interpersonally oriented SJTs and job performance. Three studies, using samples of healthcare workers (n = 225), police officers (n = 54), and …

The Invisible Eye? Electronic Performance Monitoring And Employee Job Performance, Devasheesh P Bhave

Research Collection Lee Kong Chian School Of Business

To enhance employee performance, many organizations are increasingly using electronic performance monitoring (EPM). The relationship between the frequency of EPM use and employee performance is examined in 2 field studies. In Study 1, which uses a unique longitudinal data set, results reveal that shorter time lags between 2 consecutive employee performance assessments are related to better task performance as indicated by call quality metrics. A second field study using matched supervisor–employee and EPM system data is conducted in 2 call centers to extend these results and to focus more directly on the supervisors’ use of EPM and its relationship with …

The Move To Business Schools: How Is Industrial-Organizational Psychology Holding Up In Europe?, Frederik Anseel, Bernd Carette, Jonas W. B. Lang, Filip Lievens

Research Collection Lee Kong Chian School Of Business

Aguinis, Bradley, and Brodersen (in press) empirically documented the move of Industrial and Organizational (I/O) psychologists to business schools, thereby mainly focusing on the situation in the US. However, in the last decades, I/O psychology has seen a trend towards internationalization. For instance, since the early 90s, there has been a steady increase in the number of authors from outside of the US publishing in Journal of Applied Psychology and Personnel Psychology (Cascio & Aguinis, 2008). Similarly, in international rankings the number of European business schools has increased (Collet & Vives, 2013). This begs the question as to whether a …

The Image Of Psychology Programs: The Value Of The Instrumental-Symbolic Framework, Greet Van Hoye, Filip Lievens, Britt De Soete, Nele Libbrecht, Eveline Schollaert, Dimphna Baligant

Research Collection Lee Kong Chian School Of Business

As competition for funding and students intensifies, it becomes increasingly important for psychology programs to have an image that is attractive and makes them stand out from other programs. The current study uses the instrumental-symbolic framework from the marketing domain to determine the image of different master's programs in psychology and examines how these image dimensions relate to student attraction and competitor differentiation. The samples consist of both potential students (N = 114) and current students (N = 68) of three psychology programs at a Belgian university: industrial and organizational psychology, clinical psychology, and experimental psychology. The results demonstrate that …

Measurement Invariance Of The Wong And Law Emotional Intelligence Scale Scores: Does The Measurement Structure Hold Across Far Eastern And European Countries?, Nele Libbrecht, Alain De Beuckelaer, Filip Lievens, Thomas Rockstuhl

Research Collection Lee Kong Chian School Of Business

In recent years, emotional intelligence and emotional intelligence measures have been used in a plethora of countries and cultures. This is also the case for the Wong and Law Emotional Intelligence Scale (WLEIS), highlighting the importance of examining whether the WLEIS is invariant across regions other than the Far Eastern region (China) where it was originally developed. This study investigated the measurement invariance (MI) of the WLEIS scores across two countries, namely Singapore (N= 505) and Belgium (N= 339). Apart from items measuring the factor use of emotion, the measurement structure underlying the WLEIS ratings was generally invariant across both …

Family Incivility And Job Performance: A Moderated Mediated Model Of Psychological Distress And Core Self-Evaluation, Sandy Lim, Kenneth Tai

Research Collection Lee Kong Chian School Of Business

This study extends the stress literature by exploring the relationship between family incivility and job performance. We examine whether psychological distress mediates the link between family incivility and job performance. We also investigate how core self-evaluation might moderate this mediated relationship. Data from a 2-wave study indicate that psychological distress mediates the relationship between family incivility and job performance. In addition, core self-evaluation moderates the relationship between family incivility and psychological distress but not the relationship between psychological distress and job performance. The results hold while controlling for general job stress, family-to-work conflict, and work-to-family conflict. The findings suggest that …

Anticipated Regret In Time-Based Work-Family Conflict, Jessica Bagger, Jochen Reb, Andrew Li

Research Collection Lee Kong Chian School Of Business

The primary purpose of this research was to investigate the role of anticipated regret in time-based work-family conflict decisions.

A total of 90 working parents responded to a decision making problem describing a time-based conflict between a work event and a family event. Participants' preference for which event to attend constituted the dependent variable. Independent variables were participants' work and family centralities. Anticipated regret for choosing the work option and anticipated regret for choosing the family option were measured as hypothesized mediators.

Structural equation modeling revealed that anticipated regret for choosing the family option mediated the relationship between work centrality …

The Instrumental And Symbolic Dimensions Of Organisations' Image As An Employer: A Large-Scale Field Study On Employer Branding In Turkey, Greet Van Hoye, Turker Bas, Saartje Cromheecke, Filip Lievens

Research Collection Lee Kong Chian School Of Business

Research on recruitment and employer branding has typically been situated in Western countries with predominantly individualistic cultures. The present study investigates the instrumental-symbolic framework for studying organisations' image and attraction as an employer in a non-Western collectivistic culture. In a large nationwide sample of Turkish university students, both instrumental (working conditions) and symbolic image dimensions (competence) were positively related to organisational attractiveness. Moreover, symbolic traits explained significant incremental variance beyond instrumental attributes and accounted for a greater amount of predictable variance. In addition, organisations were better differentiated from each other on the basis of symbolic image dimensions (sincerity and innovativeness) …

Emotion Regulation In Workgroups: The Roles Of Demographic Diversity And Relational Work Context, Eugene Kim, Devasheesh P. Bhave, Theresa M. Glomb

Research Collection Lee Kong Chian School Of Business

Drawing on the social identity perspective, we investigate the cross-level relationship between demographic diversity in workgroups and emotion regulation. We propose that age, racial, and gender diversity in workgroups relate positively to emotion regulation because of demography-related in-group/out-group dynamics. We also examine the moderating role of the relational work context, specifically task interdependence and social interaction, on the relationship between demographic diversity and emotion regulation. Results from a sample of 2,072 employees in 274 workgroups indicate that working in a group with greater age diversity is positively related to an employee's emotion regulation. Results suggest the operation of the age …

Alternative Predictors For Dealing With The Diversity-Validity Dilemma In Personnel Selection: The Constructed Response Multimedia Test, Britt De Soete, Filip Lievens, Janneke Oostrom, Lena Westerveld

Research Collection Lee Kong Chian School Of Business

In the context of the diversity-validity dilemma in personnel selection, the present field study compared ethnic subgroup differences on an innovative constructed response multimedia test to other commonly used selection instruments. Applicants (N=245, 27% ethnic minorities) for entry-level police jobs completed a constructed response multimedia test, cognitive ability test, language proficiency test, personality inventory, structured interview, and role play. Results demonstrated minor ethnic subgroup differences on constructed response multimedia test scores as compared to other instruments. Constructed response multimedia test scores were related to the selection decision, and no evidence for predictive bias was found. Subgroup differences were also examined …

Do Candidate Reactions Relate To Job Performance Or Affect Criterion-Related Validity? A Multistudy Investigation Of Relations Among Reactions, Selection Test Scores, And Job Performance, Julie Mccarthy, Chad H. Van Iddekinge, Filip Lievens, Mavis Mei-Chuan Kung, Evan F. Sinar, Michael A. Campion

Research Collection Lee Kong Chian School Of Business

Considerable evidence suggests that how candidates react to selection procedures can affect their test performance and their attitudes toward the hiring organization (e.g., recommending the firm to others). However, very few studies of candidate reactions have examined one of the outcomes organizations care most about: job performance. We attempt to address this gap by developing and testing a conceptual framework that delineates whether and how candidate reactions might influence job performance. We accomplish this objective using data from 4 studies (total N = 6,480), 6 selection procedures (personality tests, job knowledge tests, cognitive ability tests, work samples, situational judgment tests, …

Changing Things Up In Recruitment: Effects Of A 'Strange' Recruitment Medium On Applicant Pool Quantity And Quality, Saartje Cromheecke, Greet Van Hoye, Filip Lievens

Research Collection Lee Kong Chian School Of Business

In a field experiment, we investigated the impact of a 'strange' recruitment medium on the quantity and quality of the applicant pool. Recruiting through an unusual medium (i.e., postcard) was associated with higher applicant pool quantity, as compared to a more frequently used medium (i.e., e-mail). With respect to quality, applicants recruited through the strange medium were higher educated. A follow-up questionnaire confirmed that the media were perceived to differ in strangeness, not in media richness or credibility. These results suggest that 'changing things up' in recruitment by employing strange recruitment media can positively affect key recruitment outcomes.

Pay Satisfaction And Work-Family Conflict Across Time, Devasheesh P. Bhave, Amit Kramer, Theresa M. Glomb

Research Collection Lee Kong Chian School Of Business

On the basis of justice and exchange theories, the authors propose that employees offset their levels of work–family conflict (WFC) with their levels of pay satisfaction. Results based on two waves of data indicate that pay satisfaction has a negative relationship with WFC after controlling for actual pay and other work-related and family-related variables. Analysis of pay satisfaction dimensions reveals that satisfaction with benefits and pay structure are negatively related to WFC, whereas satisfaction with pay level and pay raise are not. Number of dependents and level of education moderate the relationship between pay satisfaction and WFC; specifically, having more …

Situation Assessment As An Ignored Factor In The Behavioral Consistency Paradigm Underlying The Validity Of Personnel Selection Procedures, Anne Jansen, Klaus G. Melchers, Filip Lievens, Martin Kleinmann, Michael Brandli, Laura Fraefel, Cornelius J. Konig

Research Collection Lee Kong Chian School Of Business

This study contributes to the literature on why selection procedures that are based on the behavioral consistency logic (e. g., structured interviews and assessment centers) are valid predictors of job performance. We rely on interactionist theories to propose that individual differences in assessing situational demands explain true variance in performance in selection procedures and on the job. Results from 124 individuals in a simulated selection process showed that the assessment of situational demands was related to both selection and job performance. Individual differences in assessing situational demands also contributed to the criterion-related validity of assessment center and structured interview ratings, …

Adjusting Medical School Admission: Assessing Interpersonal Skills Using Situational Judgement Tests, Filip Lievens

Research Collection Lee Kong Chian School Of Business

Context: Todays formal medical school admission systems often include only cognitively oriented tests, although most medical school curricula emphasise both cognitive and non-cognitive factors. Situational judgement tests (SJTs) may represent an innovative approach to the formal measurement of interpersonal skills in large groups of candidates in medical school admission processes. This study examined the validity of interpersonal video-based SJTs in relation to a variety of outcome measures. Methods: This study used a longitudinal and multiple-cohort design to examine anonymised medical school admissions and medical education data. It focused on data for the Flemish medical school admission examination between 1999 and …

Validity Evidence For The Situational Judgment Test Paradigm In Emotional Intelligence Measurement, Nele Libbrecht, Filip Lievens

Research Collection Lee Kong Chian School Of Business

To date, various measurement approaches have been proposed to assess emotional intelligence (EI). Recently, two new EI tests have been developed based on the situational judgment test (SJT) paradigm: the Situational Test of Emotional Understanding (STEU) and the Situational Test of Emotion Management (STEM). Initial attempts have been made to examine the construct-related validity of these new tests; we extend these findings by placing the tests in a broad nomological network. To this end, 850 undergraduate students completed a personality inventory, a cognitive ability test, a self-report EI test, a performance-based EI measure, the STEU, and the STEM. The SJT-based …

The Effects Of Coaching On Situational Judgment Tests In High-Stakes Selection, Filip Lievens, Tine Buyse, Paul R. Sackett, Brian S. Connelly

Research Collection Lee Kong Chian School Of Business

Although the evidence for the use of situational judgment tests (SJTs) in high-stakes testing has been generally promising, questions have been raised regarding the potential coachability of SJTs. This study reports the first examination of the effects of coaching on SJT scores in an operational high-stakes setting. We contrast findings from a simple comparison of SJT scores for coached and uncoached participants (posttest only) with three different approaches to deal with the effects of self-selection into coaching programs, namely using a pretest as a covariate and using two different forms of propensity score-based matching using a wide range of variables …

A Critical Review Of Research And Publication Trends In The Field Of Industrial And Organizational Psychology, Filip Lievens, Frederik Anseel

Research Collection Lee Kong Chian School Of Business

The aim of this article consists of critically reviewing research and publication trends in the field of industrial and organizational psychology. The focus is on four trends: (1) the extreme importance of theory, (2) the loss of the identity of industrial and organizational psychology, (3) the cumbersome nature of the review process, and (4) the deficient reporting of methodology and results in light of replication research. After each trend recommendations are made to turn the situation around. We also hope that this article might generate the necessary discussion about these four trends.

Strength In Adversity: The Influence Of Psychological Capital On Job Search, Don J. Q. Chen, Vivien K. G. Lim

Research Collection Lee Kong Chian School Of Business

This study examined the influence of psychological capital on job search among displaced employees. On the basis of a sample of 179 retrenched professionals, managers, executives, and technicians, we found that psychological capital (self-efficacy, hope, optimism, and resilience) was positively related with displaced employees' level of perceived employability, a coping resource. Perceived employability was positively related with problem-focused and symptom-focused coping strategies. Whereas problem-focused coping was positively related with preparatory and active job search, symptom-focused coping strategy was not. The relationship between psychological capital and preparatory and active job search was mediated by perceived employability and problem-focused coping. Implications of …

Building Situational Stimuli In Assessment Center Exercises: Do Specific Exercise Instructions And Role-Player Prompts Increase The Observability Of Behavior?, Eveline Schollaert, Filip Lievens

Research Collection Lee Kong Chian School Of Business

Little is known about how assessment center exercises might be designed to better elicit job-relevant behavior. This study uses trait activation theory as a theoretical lens for increasing the number of behaviors that can be observed in assessment centers. Two standardized exercise stimuli (specific exercise instructions and role-player prompts) are proposed, and their effects on the observability of candidate behavior are examined. Results showed a significant effect of role-player prompts in increasing both the general number of behavioral observations and the number of behavioral observations related to three out of four dimensions. Specific exercise instructions did not have effects on …

Dealing With The Threats Inherent In Unproctored Internet Testing Of Cognitive Ability: Results From A Large-Scale Operational Test Program, Filip Lievens, Eugene Burke

Research Collection Lee Kong Chian School Of Business

There is little information available about operational systems of unproctored Internet testing (UIT) of cognitive ability and how they deal with the threats inherent in UIT. This descriptive study provides a much-needed empirical examination of a large-scale operational UIT system of cognitive ability that implemented test design and verification testing for increasing test security and honest responding. Test security evaluations showed item exposure and test overlap rates were acceptable. Aberrant score evaluations revealed that negative score change (higher unproctored scores than proctored ones) was negligible. Implications for UIT research are discussed.

The Validity And Incremental Validity Of Knowledge Tests, Low-Fidelity Simulations, And High-Fidelity Simulations For Predicting Job Performance In Advanced-Level High-Stakes Selection, Filip Lievens, Fiona Patterson

Research Collection Lee Kong Chian School Of Business

In high-stakes selection among candidates with considerable domain-specific knowledge and experience, investigations of whether high-fidelity simulations (assessment centers; ACs) have incremental validity over low-fidelity simulations (situational judgment tests; SJTs) are lacking. Therefore, this article integrates research on the validity of knowledge tests, low-fidelity simulations, and high-fidelity simulations in advanced-level high-stakes settings. A model and hypotheses of how these 3 predictors work in combination to predict job performance were developed. In a sample of 196 applicants, all 3 predictors were significantly related to job performance. Both the SJT and the AC had incremental validity over the knowledge test. Moreover, the AC …

Designing Pareto-Optimal Selection Systems: Formalizing The Decisions Required For Selection System Development, Wilfried De Corte, Paul R. Sackett, Filip Lievens

Research Collection Lee Kong Chian School Of Business

The article presents an analytic method for designing Pareto-optimal selection systems where the applicants belong to a mixture of candidate populations. The method is useful in both applied and research settings. In an applied context, the present method is the first to assist the selection practitioner when deciding on 6 major selection design issues: (1) the predictor subset, (2) the selection rule, (3) the selection staging, (4) the predictor sequencing, (5) the predictor weighting, and (6) the stage retention decision issue. From a research perspective, the method offers a unique opportunity for studying the impact and relative importance of different …

The Use Of Role-Player Prompts In Assessment Center Exercises, Eveline Schollaert, Filip Lievens

Research Collection Lee Kong Chian School Of Business

So far, a substantial amount of assessment center (AC) studies have aimed to improve the quality of the AC method by focusing on the assessors. However, systematic studies about the role-player in AC exercises are nonexistent. This is surprising as the role-player might serve as a key figure for consistently evoking job-relevant behavior across candidates. Therefore, this study focused on the 'role' of role-players in ACs. We examined the effects of instructing role-players to use prompts among 233 candidates. Results suggest that role-players are able to use prompts and that their negative impact on candidates' reactions is negligible. In addition, …

A Macro Perspective To Micro Issues, Devasheesh P. Bhave, Stephane Brutus

Research Collection Lee Kong Chian School Of Business

Comments on an article by Elaine D. Pulakos and Ryan S. O'Leary. The authors argue that bringing the focus on the relationship between the manager and the employee will mend performance management. We concur with the broad assessment that an excessive focus on technical improvements in performance management systems is misplaced and that implementation issues plague performance management. But we believe that poor implementation is an operational challenge not because of the practice itself but rather on account of misalignment. They also allude to a consideration of alignment. They also glosses over the issue of internal alignment or the fact …

Collective Intelligence Ratio: Measurement Of Real-Time Multimodal Interactions In Team Projects, Paul Kim, Donghwan Lee, Youngjo Lee, Chuan Huang, Tamas Makany

Research Collection Lee Kong Chian School Of Business

PurposeWith a team interaction analysis model, the authors sought to identify a varying range of individual and collective intellectual behaviors in a series of communicative intents particularly expressed with multimodal interaction methods. In this paper, the authors aim to present a new construct (i.e. collective intelligence ratio (CIR)) which refers to a numeric indicator representing the degree of intelligence of a team in which each team member demonstrates an individual intelligence ratio (IR) specific to a team goal.Design/methodology/approachThe authors analyzed multimodal team interaction data linked to communicative intents with a Poisson‐hierarchical generalized linear model (HGLM).FindingsThe study found evidence of a …