Industrial and Organizational Psychology Commons^™

Measuring Intelligence With The Sandia Matrices: Psychometric Review And Recommendations For Free Raven-Like Item Sets, Alexandra M. Harris, Jeremiah T. Mcmillan, Benjamin Listyg, Laura E. Matzen, Nathan Carter

Personnel Assessment and Decisions

The Sandia Matrices are a free alternative to the Raven’s Progressive Matrices (RPMs). This study offers a psychometric review of Sandia Matrices items focused on two of the most commonly investigated issues regarding the RPMs: (a) dimensionality and (b) sex differences. Model-data fit of three alternative factor structures are compared using confirmatory multidimensional item response theory (IRT) analyses, and measurement equivalence analyses are conducted to evaluate potential sex bias. Although results are somewhat inconclusive regarding factor structure, results do not show evidence of bias or mean differences by sex. Finally, although the Sandia Matrices software can generate infinite items, editing …

A Comparison Of The Two-Option Versus The Four-Option Multiple-Choice Item: A Case For Fewer Distractors, Allan Bateson, William R. Dardick

Personnel Assessment and Decisions

Multiple choice test items typically consist of the key and 3-4 distractors. However, research has supported the efficacy of using fewer alternatives. Haladyna and Downing (1993) found that it is difficult to write test items with more than one plausible distractor, resulting in items with a correct answer and one alternative, also known as the alternate choice (AC) format. We constructed two 32-item tests; one with four alternatives (MC4) and one with two (AC), using an inter-judge agreement approach to eliminate distractors. Tests were administered to 138 personnel working for a U.S. Government agency. Testing time was significantly less and …

Is It Complicated? Validity Of Personality Interactions For Predicting Performance, Jacob C. Bradburn, Ann Marie Ryan, Anthony Boyce, Tamera Mckinniss, Jason Way

Personnel Assessment and Decisions

Research on personality within the organizational sciences and for employee selection typically focuses on main effects, as opposed to interactive effects between personality variables. Large, multi-organizational datasets involving two different measures of personality were examined to test theoretically driven trait by trait interactions in predicting job performance. Interactive effects of Agreeableness and Conscientiousness, Agreeableness and Extraversion, Extraversion and Conscientiousness, and Emotional Stability and Conscientiousness were hypothesized as predicting overall job performance. However, these hypothesized effects were generally not supported. Implications for personality assessment are discussed.

The Relationship Between Criminal Records And Job Performance: An Examination Of Customer Service Representatives, Jakari N. Griffith, Todd C. Harris

Personnel Assessment and Decisions

Between 70 million and 100 million Americans—or as many as one in three—have some type of criminal record (Vallas & Dietrich, 2014). Having even a minor criminal record often functions as a significant impediment to gainful employment and resultant economic security. This is especially problematic given that: (a) many companies now incorporate background checks within their hiring process and (b) little empirical research exists about the relationship between criminal records and job performance. Thus, this study examined the relationship between criminal records and objective performance of customer service representatives (N = 627) in a large telecommunications firm. Our regression analyses …

The Machines Aren’T Taking Over (Yet): An Empirical Comparison Of Traditional, Profiling, And Machine Learning Approaches To Criterion-Related Validation, Kristin S. Allen, Mathijs Affourtit, Craig M. Reddock

Personnel Assessment and Decisions

Criterion-related validation (CRV) studies are used to demonstrate the effectiveness of selection procedures. However, traditional CRV studies require significant investment of time and resources, as well as large sample sizes, which often create practical challenges. New techniques, which use machine learning to develop classification models from limited amounts of data, have emerged as a more efficient alternative. This study empirically investigates the effectiveness of traditional CRV with a variety of profiling approaches and machine learning techniques using repeated cross-validation. Results show that the traditional approach generally performs best both in terms of predicting performance and larger group differences between candidates …

Editorial: Five Years In, Scott Highhouse

Personnel Assessment and Decisions

No abstract provided.

The Process Of Establishing A Green Climate: Face-To-Face Interaction Between Leaders And Employees In The Microsystem, Ingeborg Flagstad, Svein Åge Kjøs Johnsen, Leif Rydstedt

The Journal of Values-Based Leadership

This study explores the processes of establishing a green organizational climate in small-scale companies. Previous studies have primarily focused on factors associated with pro-environmental behaviour in large organizations. The role of a green organizational climate—specifically, the interactional processes involved in the construction of a green climate—has largely been unexplored. Entrepreneurial small companies constitute an ideal arena in which to study the initial phase of greening processes. The present study examined the process of establishing a green organizational climate in seven small-scale Norwegian companies. This article presents a systems model that was developed to analyse how processes at different levels interact …

Development And Validation Of A Global Competency Framework For Preparing New Graduates For Early Career Professional Roles, Mark Strong, Gary J. Burkholder, Emily Solberg, Amy Stellmack, William Presson, Jean-Bernard Seitz

Higher Learning Research Communications

Objectives: The current objectives include the development of a global competency model applicable across a wide range of jobs, industries, and geographies for university graduates entering the workplace.

Method: The competency model was developed utilizing a global panel of subject matter experts and a validation survey of over 25,000 students, faculty, staff, and employers across more than 30 countries.

Results: The results showed substantial consistency for the importance and criticality ratings of the competencies, with Achieving Objectives, Analyzing and Solving Problems, Adapting to Change, Communicating Orally, Learning and Self-Development, Making Decisions, Planning and Organizing, and Working Well with Others as …

Workplace Bullying In Healthcare: A Qualitative Analysis Of Bystander Experiences, Neill James Thompson Mr, Madeline Carter, Paul Crampton, Bryan Burford, Jan Illing, Gill Morrow

The Qualitative Report

Bystander action has been proposed as a promising intervention to tackle workplace bullying, however there is a lack of in-depth qualitative research on the direct experiences of bystanders. In this paper, we developed a more comprehensive definition of bullying bystanders, and examined first person accounts from healthcare professionals who had been bystanders to workplace bullying. These perspectives highlighted factors that influence the type and the extent of support bystanders may offer to targets. Semi-structured telephone interviews were conducted with 43 healthcare professionals who were working in the UK, of which 24 had directly witnessed bullying. The data were transcribed and …

A Near Miss: The Lived Experiences Of Telecommunication Technicians’ Injurious Accidents And Near Misses, Bridgette M. Hester, Patricia I. Fusch

The Qualitative Report

Due to a dearth in the literature, this study was conducted to explore the lived experiences of telecommunication field technicians who have experienced near miss and injurious accidents. Using protection motivation theory (PMT), we sought to explore if, after an accident, a technician would alter behaviors and insights regarding safety practices while executing their job duties. Participants for this qualitative phenomenological study included six telecommunication technicians with an average of 19 years’ experience and who had experienced an injurious or near miss accident at work. Findings suggested that after experiencing such an event, technicians demonstrated PMT characteristics including a heightened …

Mindfulness: A Promising Practice To Reduce Accountant Stress, Abigail Anderson

Marriott Student Review

This article considers the practice of mindfulness as an approach to reduce stress within the lives of accountants. Mindfulness has existed for centuries as a Buddhist tradition and has only recently become popular in the Western world as a stress-reduction technique that can lead to improved mental and emotional well-being. This article also examines the prevalence of mindfulness within the Top 10 accounting firms in the United States and some results regarding employee performance. As more and more firms begin to utilize mindfulness as a low-cost method to better employee performance and well-being, university accounting programs should consider incorporating the …

Special Issue - Call For Papers: Rethinking The Future Police Department: Examining The Role Of Testing And Assessment, Dennis Doverspike, Alexandra Petruzzelli, Marc Cubrich

Personnel Assessment and Decisions

No abstract provided.

A Unifying Framework To Study Workplace Decision-Making Aptitude And Performance, Nikki Blacksmith, Maureen E. Mccusker, Theodore L. Hayes

Personnel Assessment and Decisions

Employers are facing a skills shortage in the labor market: there are not enough workers who can perform the complex decision-making tasks that characterize 21st-century work. This manuscript aims to stimulate research investigating the relationship among individual differences, decision-making aptitude, and decision performance. We offer guidelines for future research by laying out a framework to unify disparate streams of research from organizational science, and judgment and decision-making research. We advocate for the use of pattern-oriented analytical approaches to capture the complexities of the predictor and criterion space.

The Impact Of Nondiagnostic Information On Selection Decision Making: A Cautionary Note And Mitigation Strategies, Dev K. Dalal, Levi Sassaman, Xiaoyuan (Susan) Zhu

Personnel Assessment and Decisions

Selection decision makers are inundated with information from which to make decisions about the suitability of a job candidate for a position. Although some of this information is relevant for making a high-quality decision (i.e., diagnostic information), much of the information is actually unrelated to the decision (i.e., nondiagnostic information). Although the deleterious effects of nondiagnostic information on selection decision making have been demonstrated, the prevalence and impact of this type of information is increasing, especially with recent advances in new selection methods used by employers. The purpose of this paper, therefore, is to caution selection decision makers, and/or those …

Threat Of Technological Unemployment, Use Intentions, And The Promotion Of Structured Interviews In Personnel Selection, Kevin P. Nolan, Dev K. Dalal, Nathan Carter

Personnel Assessment and Decisions

Meehl (1986) proposed that an important factor underlying professional decision makers’ resistance to standardized decision aids is threat of technological unemployment – fear that using the practices would reduce the perceived value of their employment. Nolan, Carter, and Dalal (2016) provided initial support for threat of technological unemployment being a factor that contributes to practitioners’ reluctance to adopt scientifically meritorious standardized hiring practices. This study serves to further develop the theory of threat of technological unemployment in personnel selection by (a) replicating the findings of our earlier research using a within-subjects methodology that is more generalizable to the cognitive processes …

Decoy Effects Improve Diversity Hiring, Nathan R. Kuncel, Jeffrey A. Dahlke

Personnel Assessment and Decisions

A growing literature demonstrates that when making choices among multiple options, decision makers are strongly influenced by the mere presence of additional options, even when those options are largely undesirable and are never actually selected. The effects of irrelevant options on decisions, often called decoy effects, have been observed in hiring and admissions decisions where the nature of a third candidate can radically shift preferences. In this study, we examine the influence of decoy effects on diversity hiring and extend research by examining choices with more than two organizational goals. Results indicate that the presence of a second candidate who …

Does Feedback Increase Decision Aid Use Among Hiring Professionals?, Aneeqa Thiele, Alexander T. Jackson, Stacey M. Stremic, Satoris S. Howes

Personnel Assessment and Decisions

We examined the influence of formative and outcome feedback on people’s reliance on decision aids. Decision aids are tools that managers can use to increase the accuracy of their hiring decisions. In our study, participants were asked to make 20 different hiring decisions and make predictions of a candidate’s performance on the job, with the option of using a decision aid formula. We manipulated whether participants received feedback on the accuracy of their predictions, the accuracy of the decision aid’s predictions, or both. The results demonstrated that feedback failed to have a significant impact on decision aid use for both …

Communicating Validity Information To Differentially Experienced Audiences: The Effects Of Numeracy And Nontraditional Metrics, Nathaniel M. Voss, Christopher J. Lake

Personnel Assessment and Decisions

One of the biggest challenges facing organizational researchers is convincing practitioners to adopt evidence-based personnel selection practices such as the structured interview. In this study, we examined the effects of nontraditional validity metrics and numeracy by presenting validity information about the structured interview to audiences with differing amounts of interview experience (students, working adults, and hiring managers). The results indicated that nontraditional metrics were associated with higher understanding, more positive attitudes, and greater perceptions of the usefulness of the structured interview. These effects were constant across differing levels of numeracy. Additionally, the results revealed that nontraditional metrics result in more …

Pushing The Limits For Judgmental Consistency: Comparing Random Weighting Schemes With Expert Judgments, Martin C. Yu, Nathan R. Kuncel

Personnel Assessment and Decisions

Consistent use of information has been identified as a critical issue that can undermine expert predictions. Using three personnel assessment datasets, we conduct Monte Carlo simulations to compare the accuracy of expert judgements for predicting the job performance of managers against four different weighting schemes: consistent random weights, completely random weights, unit weights, and optimal weights. Expert accuracy fell within the completely random weight distribution in two samples and at the low end of the consistent random weight distribution in one sample. In other words, consistent random weights reliably outperformed expert judgment for hiring decisions across three datasets with a …

Introduction To The Special Issue On Applications Of Judgment And Decision Making To Problems In Personnel Assessment, Edgar E. Kausel, Alexander T. Jackson

Personnel Assessment and Decisions

No abstract provided.

Perspective: Responding To The Well-Being Of Health Care Workers And Learners In Academic Medicine During The Covid-19 Pandemic, Cherie C. Hill, Paula G. Gomes, Alayna H. Feng, Cricket C. Gullickson, Carla I. Haack, Sheryl L. Heron

Journal of Wellness

No abstract provided.

Exploring Self-Silencing In Workplace Relationships: A Qualitative Study Of Female Software Engineers, Sucharita Maji, Shikha Dixit

The Qualitative Report

Self-silencing has been extensively studied in the context of the relational aspect of the female psyche. The previous research on self-silencing mostly emphasized on intimate partner relationships and not much is explored in the context of workplace relationships, that is, relationships with colleagues, team managers etc. The present study aims to explore the self-silencing phenomenon in workplace relationships among a sample of female software engineers (N=21) in India. A purposive sampling strategy was used to select the participants of the study. Semi-structured, in-depth interviews were conducted to collect the data for the thematic analysis. At first, theoretical thematic analysis was …

Evaluation Of An Advanced Quality Improvement Program, Arjun M. Dangre Bds Mph, Angelo P. Giardino Md, Phd

Journal of Nursing & Interprofessional Leadership in Quality & Safety

Texas Children’s Hospital implemented the Advanced Quality Improvement and Patient Safety Program (AQI) in 2009, designed to train clinicians and staff to develop leaders in quality improvement to improve patient care, lower costs, change culture, and lead improvement initiatives at the organization. Evaluations of the AQI programs measured the program’s effectiveness in achieving its goals and objectives. This paper describes the Texas Children’s Hospital’s Advanced Quality Improvement and Patient Safety program (AQI,) the program’s evaluation processes, and show the results of the evaluation of the AQI programs using evaluation surveys completed by QI participants over the span of 13 successful …

Special Issue - Call For Papers: Understanding Effects Of Impression Management On Assessment Outcomes, Neil Christiansen, Chet Robie

Personnel Assessment and Decisions

No abstract provided.

The Dynamic Of Performing Social Relations Amongst Managers And Supervisors: A Thematic Analysis, Tri Astuti, Avin Fadilla Helmi, Aniq Hudiyah Bil Haq, Mohamad Dziqie Aulia Al Farauqi

The Qualitative Report

This study investigated the factors, dimensions, and dynamic flow of the manager-supervisor social relationship in a company with family values. This research was a qualitative study with a thematic analysis approach based on the six-step thematic analysis from Braun and Clarke (2006). The authors used open-ended questionnaires and interviews as data gathering tools. This study found that the three factors that influence four interrelated dimensions can result in group cohesiveness, target achievement, and performance improvement. The results of this study can be used in policy-making by considering the social relationship between employees as a supporting factor in achieving organizational goals. …

A New Perspective To Measuring Employee Growth: Developing A Successful Aging At Work Scale, Stanimira K. Taneva, Georgi P. Yankov

Personnel Assessment and Decisions

The aging of the world’s population has become a grand societal challenge, which requires an urgent response from researchers, professionals, and the wider society. One way to respond to this challenge is by supporting individuals in sustaining longer and healthier working lives, that is, age successfully. Although the advantages of promoting and enabling successful aging at work have been widely acknowledged, no single instrument for measuring this construct has been published so far. We develop and test in three consecutive samples a two-dimensional successful aging at work scale. This novel instrument is rooted conceptually in the most recent theoretical developments …

Behavioral Assessment Of Expert Talent Competencies: Analysis, Decision Making, And Written And Verbal Communication Skills, Homayoon Kord, George C. Thornton Iii

Personnel Assessment and Decisions

Organizations face challenges of screening applicants for critical skills to serve in expert staff positions requiring interactions with line managers. Such positions require a special set of cognitive and interpersonal competencies. This study investigates the psychometric qualities of a new behavioral assessment method in use in an applied setting. Using data from a group of 219 finalists for positions in a large Iranian steel company, it examined the validity and fairness of the method in relation to other test and demographic information. Results showed evidence of convergent and discriminant validity and no discrimination against women or older candidates. The study …

Initial Reliability And Validity For The Critical Hire® - Screen, Tony Tatman, Matthew T. Huss

Personnel Assessment and Decisions

Although the use of integrity testing during the application process has become a frequent practice in general business settings, their use has been rather nonexistent in the field of corrections. This limited use may stem from a lack of awareness about integrity tests in corrections, as well as a lack of integrity measures that have been normed and validated for use with correctional applicants. This study outlines the development, reliability, and validity for the Critical Hire®-Screen (CH-S), an overt integrity assessment measure developed for probation, parole, and other correctional officer job applicants. Four separate studies were conducted and provide evidence …

Some Advice For Psychologists Who Want To Work With Computer Scientists On Big Data, Cornelius J. König, Andrew M. Demetriou, Philipp Glock, Annemarie M. F. Hiemstra, Dragos Iliescu, Camelia Ionescu, Markus Langer, Cynthia C. S. Liem, Anja Linnenbürger, Rudolf Siegel, Ilias Vartholomaios

Personnel Assessment and Decisions

This article is based on conversations from the project “Big Data in Psychological Assessment” (BDPA) funded by the European Union, which was initiated because of the advances in data science and artificial intelligence that offer tremendous opportunities for personnel assessment practice in handling and interpreting this kind of data. We argue that psychologists and computer scientists can benefit from interdisciplinary collaboration. This article aims to inform psychologists who are interested in working with computer scientists about the potentials of interdisciplinary collaboration, as well as the challenges such as differing terminologies, foci of interest, data quality standards, approaches to data analyses, …

Situational Judgment Tests: An Overview Of Development Practices And Psychometric Characteristics, Deborah L. Whetzel, Taylor S. Sullivan, Rodney A. Mccloy

Personnel Assessment and Decisions

Situational judgment tests (SJTs) are popular assessment methods often used for personnel selection and promotion. SJTs present problem scenarios to examinees, who then evaluate each response option for addressing the issue described in the scenario. As guidance for practitioners and researchers alike, this paper provides experience- and evidence-based best practices for developing SJTs: writing scenarios and response options, creating response instructions, and selecting a response format. This review describes scoring options, including key stretching and within-person standardization. The authors also describe research on psychometric issues that affect SJTs, including reliability, validity, group differences, presentation modes, faking, and coaching.