Other Psychology Commons^™

Unintended Consequences Of Interview Faking: Impact On Perceived Fit And Affective Outcomes, Brooke D. Charbonneau, Deborah M. Powell, Jeffrey R. Spence, Sean T. Lyons

Personnel Assessment and Decisions

Drawing on signalling theory, we propose that use of deceptive impression management (IM) in the employment interview could produce false signals, and individuals hired based on such signals may incur consequences once they are on the job—such as poor perceived fit. We surveyed job applicants who recently interviewed and received a job to investigate the relationship between use of deceptive IM in the interview and subsequent perceived personjob and person-organization fit, stress, well-being, and employee engagement. In a twophase study, 206 job applicants self-reported their use of deceptive IM in their interviews at Time 1, and their perceived person–job and …

Identifying Faking On Forced-Choice Personality Items Using Mouse Tracking, Irina Kuzmich, Charles Scherbaum

Personnel Assessment and Decisions

This research utilizes mouse tracking as a potential behavioral method to examine cognitive processes underlying faking on forced-choice personality inventories. Mouse tracking is a method from social categorization research that captures a variety of metrics related to motor movements, which are linked to cognitive processing. To explore the utility of this method, we examined differences in the mouse tracking metrics of those instructed to respond honestly or to fake. Our findings show that there is a distinguishable difference in the behavioral response of those who are faking when responding to pairs of personality descriptors presented in a forced-choice format compared …

Faking And The Validity Of Personality Tests: An Experimental Investigation Using Modern Forced Choice Measures, Christopher R. Huber, Nathan R. Kuncel, Katie B. Huber, Anthony S. Boyce

Personnel Assessment and Decisions

Despite the established validity of personality measures for personnel selection, their susceptibility to faking has been a persistent concern. However, the lack of studies that combine generalizability with experimental control makes it difficult to determine the effects of applicant faking. This study addressed this deficit in two ways. First, we compared a subtle incentive to fake with the explicit “fake-good” instructions used in most faking experiments. Second, we compared standard Likert scales to multidimensional forced choice (MFC) scales designed to resist deception, including more and less fakable versions of the same MFC inventory. MFC scales substantially reduced motivated score elevation …

Put Your Best Foot Forward: Introduction To The Special Issue On Understanding Effects Of Impression Management On Assessment Outcomes, Chet Robie, Neil D. Christiansen

Personnel Assessment and Decisions

No abstract provided.

Measuring Intelligence With The Sandia Matrices: Psychometric Review And Recommendations For Free Raven-Like Item Sets, Alexandra M. Harris, Jeremiah T. Mcmillan, Benjamin Listyg, Laura E. Matzen, Nathan Carter

Personnel Assessment and Decisions

The Sandia Matrices are a free alternative to the Raven’s Progressive Matrices (RPMs). This study offers a psychometric review of Sandia Matrices items focused on two of the most commonly investigated issues regarding the RPMs: (a) dimensionality and (b) sex differences. Model-data fit of three alternative factor structures are compared using confirmatory multidimensional item response theory (IRT) analyses, and measurement equivalence analyses are conducted to evaluate potential sex bias. Although results are somewhat inconclusive regarding factor structure, results do not show evidence of bias or mean differences by sex. Finally, although the Sandia Matrices software can generate infinite items, editing …

A Comparison Of The Two-Option Versus The Four-Option Multiple-Choice Item: A Case For Fewer Distractors, Allan Bateson, William R. Dardick

Personnel Assessment and Decisions

Multiple choice test items typically consist of the key and 3-4 distractors. However, research has supported the efficacy of using fewer alternatives. Haladyna and Downing (1993) found that it is difficult to write test items with more than one plausible distractor, resulting in items with a correct answer and one alternative, also known as the alternate choice (AC) format. We constructed two 32-item tests; one with four alternatives (MC4) and one with two (AC), using an inter-judge agreement approach to eliminate distractors. Tests were administered to 138 personnel working for a U.S. Government agency. Testing time was significantly less and …

Is It Complicated? Validity Of Personality Interactions For Predicting Performance, Jacob C. Bradburn, Ann Marie Ryan, Anthony Boyce, Tamera Mckinniss, Jason Way

Personnel Assessment and Decisions

Research on personality within the organizational sciences and for employee selection typically focuses on main effects, as opposed to interactive effects between personality variables. Large, multi-organizational datasets involving two different measures of personality were examined to test theoretically driven trait by trait interactions in predicting job performance. Interactive effects of Agreeableness and Conscientiousness, Agreeableness and Extraversion, Extraversion and Conscientiousness, and Emotional Stability and Conscientiousness were hypothesized as predicting overall job performance. However, these hypothesized effects were generally not supported. Implications for personality assessment are discussed.

The Relationship Between Criminal Records And Job Performance: An Examination Of Customer Service Representatives, Jakari N. Griffith, Todd C. Harris

Personnel Assessment and Decisions

Between 70 million and 100 million Americans—or as many as one in three—have some type of criminal record (Vallas & Dietrich, 2014). Having even a minor criminal record often functions as a significant impediment to gainful employment and resultant economic security. This is especially problematic given that: (a) many companies now incorporate background checks within their hiring process and (b) little empirical research exists about the relationship between criminal records and job performance. Thus, this study examined the relationship between criminal records and objective performance of customer service representatives (N = 627) in a large telecommunications firm. Our regression analyses …

The Machines Aren’T Taking Over (Yet): An Empirical Comparison Of Traditional, Profiling, And Machine Learning Approaches To Criterion-Related Validation, Kristin S. Allen, Mathijs Affourtit, Craig M. Reddock

Personnel Assessment and Decisions

Criterion-related validation (CRV) studies are used to demonstrate the effectiveness of selection procedures. However, traditional CRV studies require significant investment of time and resources, as well as large sample sizes, which often create practical challenges. New techniques, which use machine learning to develop classification models from limited amounts of data, have emerged as a more efficient alternative. This study empirically investigates the effectiveness of traditional CRV with a variety of profiling approaches and machine learning techniques using repeated cross-validation. Results show that the traditional approach generally performs best both in terms of predicting performance and larger group differences between candidates …

Editorial: Five Years In, Scott Highhouse

Personnel Assessment and Decisions

No abstract provided.

Special Issue - Call For Papers: Rethinking The Future Police Department: Examining The Role Of Testing And Assessment, Dennis Doverspike, Alexandra Petruzzelli, Marc Cubrich

Personnel Assessment and Decisions

No abstract provided.

A Unifying Framework To Study Workplace Decision-Making Aptitude And Performance, Nikki Blacksmith, Maureen E. Mccusker, Theodore L. Hayes

Personnel Assessment and Decisions

Employers are facing a skills shortage in the labor market: there are not enough workers who can perform the complex decision-making tasks that characterize 21st-century work. This manuscript aims to stimulate research investigating the relationship among individual differences, decision-making aptitude, and decision performance. We offer guidelines for future research by laying out a framework to unify disparate streams of research from organizational science, and judgment and decision-making research. We advocate for the use of pattern-oriented analytical approaches to capture the complexities of the predictor and criterion space.

The Impact Of Nondiagnostic Information On Selection Decision Making: A Cautionary Note And Mitigation Strategies, Dev K. Dalal, Levi Sassaman, Xiaoyuan (Susan) Zhu

Personnel Assessment and Decisions

Selection decision makers are inundated with information from which to make decisions about the suitability of a job candidate for a position. Although some of this information is relevant for making a high-quality decision (i.e., diagnostic information), much of the information is actually unrelated to the decision (i.e., nondiagnostic information). Although the deleterious effects of nondiagnostic information on selection decision making have been demonstrated, the prevalence and impact of this type of information is increasing, especially with recent advances in new selection methods used by employers. The purpose of this paper, therefore, is to caution selection decision makers, and/or those …

Threat Of Technological Unemployment, Use Intentions, And The Promotion Of Structured Interviews In Personnel Selection, Kevin P. Nolan, Dev K. Dalal, Nathan Carter

Personnel Assessment and Decisions

Meehl (1986) proposed that an important factor underlying professional decision makers’ resistance to standardized decision aids is threat of technological unemployment – fear that using the practices would reduce the perceived value of their employment. Nolan, Carter, and Dalal (2016) provided initial support for threat of technological unemployment being a factor that contributes to practitioners’ reluctance to adopt scientifically meritorious standardized hiring practices. This study serves to further develop the theory of threat of technological unemployment in personnel selection by (a) replicating the findings of our earlier research using a within-subjects methodology that is more generalizable to the cognitive processes …

Decoy Effects Improve Diversity Hiring, Nathan R. Kuncel, Jeffrey A. Dahlke

Personnel Assessment and Decisions

A growing literature demonstrates that when making choices among multiple options, decision makers are strongly influenced by the mere presence of additional options, even when those options are largely undesirable and are never actually selected. The effects of irrelevant options on decisions, often called decoy effects, have been observed in hiring and admissions decisions where the nature of a third candidate can radically shift preferences. In this study, we examine the influence of decoy effects on diversity hiring and extend research by examining choices with more than two organizational goals. Results indicate that the presence of a second candidate who …

Does Feedback Increase Decision Aid Use Among Hiring Professionals?, Aneeqa Thiele, Alexander T. Jackson, Stacey M. Stremic, Satoris S. Howes

Personnel Assessment and Decisions

We examined the influence of formative and outcome feedback on people’s reliance on decision aids. Decision aids are tools that managers can use to increase the accuracy of their hiring decisions. In our study, participants were asked to make 20 different hiring decisions and make predictions of a candidate’s performance on the job, with the option of using a decision aid formula. We manipulated whether participants received feedback on the accuracy of their predictions, the accuracy of the decision aid’s predictions, or both. The results demonstrated that feedback failed to have a significant impact on decision aid use for both …

Pushing The Limits For Judgmental Consistency: Comparing Random Weighting Schemes With Expert Judgments, Martin C. Yu, Nathan R. Kuncel

Personnel Assessment and Decisions

Consistent use of information has been identified as a critical issue that can undermine expert predictions. Using three personnel assessment datasets, we conduct Monte Carlo simulations to compare the accuracy of expert judgements for predicting the job performance of managers against four different weighting schemes: consistent random weights, completely random weights, unit weights, and optimal weights. Expert accuracy fell within the completely random weight distribution in two samples and at the low end of the consistent random weight distribution in one sample. In other words, consistent random weights reliably outperformed expert judgment for hiring decisions across three datasets with a …

Introduction To The Special Issue On Applications Of Judgment And Decision Making To Problems In Personnel Assessment, Edgar E. Kausel, Alexander T. Jackson

Personnel Assessment and Decisions

No abstract provided.

Zentangles For Mental Health Awareness, Rachel Immel

Honors Projects

The world is starting to see the rise of a stress related epidemic. Finding time to balance the struggles of everyday life, like academics, finances, careers and relationships, while also maintaining personal mental health is becoming increasingly difficult. This is what prompted me to use my project as an opportunity to help people relieve stress and create a community through the use of art, especially during a time where social interaction has been severely limited due to COVID-19.

My project is a series of live-streamed Zentangle art classes I hosted personally that were open to the public through Zoom. Zentangle …

The Ability Of Thaumoctopus Mimicus To Be Operantly Conditioned To A Sound Stimulus, Stephanie Wittman

Honors Projects

This paper focuses on the ability of the mimic octopus Thaumoctopus mimicus to be operantly conditioned to an auditory stimulus. The octopus is known to be the most advanced of the invertebrates and has learning abilities that are comparable to vertebrates in spite of their differences in brain structure. These animals have been shown to react to visual and tactile stimuli and can be operantly conditioned to perform behaviors to obtain a food reward. The goal of this experiment is to determine whether the octopus can be operantly conditioned to swim into a box on the side of its tank …

Lgbtq Training For Aquatic Employees: Impact On Attitudes And Professional Competencies, Austin R. Anderson, Eric Knee, William D. Ramos

International Journal of Aquatic Research and Education

This study examined the impact of a LGBTQ diversity training on the attitudes and professional competencies of aquatic employees within a campus recreational sports setting. While diversity training is often discussed as a key component of inclusive aquatic programming, little empirical research examining the outcomes associated with such trainings exists. As such, members of the research team developed, implemented, and evaluated a four-month long training program consisting of one in-person training session and monthly inclusion handouts discussing issues related to the inclusion of LGBTQ participants. A comparative quantitative research design was used to measure employee’s attitudes towards the LGBTQ population …

Special Issue - Call For Papers: Understanding Effects Of Impression Management On Assessment Outcomes, Neil Christiansen, Chet Robie

Personnel Assessment and Decisions

No abstract provided.

A Qualitative Examination Of Sport Retirement In Former Ncaa Division I Athletes, Kelly Barcza-Renner, Amber M. Shipherd, Itay Basevitch

Journal of Athlete Development and Experience

Statistics indicate that the overwhelming majority of NCAA Division I college athletes will not continue in their sport professionally (NCAA, 2019). Therefore, there is a need to develop a deeper understanding of the variables that influence college athletes’ psychological health and well-being as they transition to retirement. The present study gathered detailed information about 15 former NCAA Division I college athletes’ retirement experiences four to five months post retirement. The findings suggested that the former college athletes had varied retirement experiences ranging from negative to positive. All college athletes who reported having a successful retirement transition described having at least …

Initial Reliability And Validity For The Critical Hire® - Screen, Tony Tatman, Matthew T. Huss

Personnel Assessment and Decisions

Although the use of integrity testing during the application process has become a frequent practice in general business settings, their use has been rather nonexistent in the field of corrections. This limited use may stem from a lack of awareness about integrity tests in corrections, as well as a lack of integrity measures that have been normed and validated for use with correctional applicants. This study outlines the development, reliability, and validity for the Critical Hire®-Screen (CH-S), an overt integrity assessment measure developed for probation, parole, and other correctional officer job applicants. Four separate studies were conducted and provide evidence …

Crowdsourcing Job Satisfaction Data: Examining The Construct Validity Of Glassdoor.Com Ratings, Richard N. Landers, Robert C. Brusso, Elena M. Auer

Personnel Assessment and Decisions

Researchers, practitioners, and job seekers now routinely use crowdsourced data about organizations for both decision-making and research purposes. Despite the popularity of such websites, empirical evidence regarding their validity is generally absent. In this study, we tackled this problem by combining two curated datasets: (a) the results of the 2017 Federal Employee Viewpoint Survey (FEVS), which contains facet-level job satisfaction ratings from 407,789 US federal employees, and which we aggregated to the agency level, and (b) current overall and facet ratings of job satisfaction of the federal agencies contained within FEVS from Glassdoor.com as scraped from the Glassdoor application programming …

“Where’S The I-O?” Artificial Intelligence And Machine Learning In Talent Management Systems, Manuel F. Gonzalez, John F. Capman, Frederick L. Oswald, Evan R. Theys, David L. Tomczak

Personnel Assessment and Decisions

Artificial intelligence (AI) and machine learning (ML) have seen widespread adoption by organizations seeking to identify and hire high-quality job applicants. Yet the volume, variety, and velocity of professional involvement among I-O psychologists remains relatively limited when it comes to developing and evaluating AI/ML applications for talent assessment and selection. Furthermore, there is a paucity of empirical research that investigates the reliability, validity, and fairness of AI/ML tools in organizational contexts. To stimulate future involvement and research, we share our review and perspective on the current state of AI/ML in talent assessment as well as its benefits and potential pitfalls; …

Developing Device-Equivalent And Effective Measures Of Complex Thinking With An Information Processing Framework And Mobile First Design Principles, Darrin M. Grelle, Sara L. Gutierrez

Personnel Assessment and Decisions

Organizations are increasingly offering pre-employment assessments on mobile devices to evaluate candidates. The aim of this study is to investigate whether employing a mobile first responsive web design based on an information processing framework will result in device-equivalent measures of cognitive ability. Tests of numerical and deductive reasoning composed of interactive item types were tested for measurement equivalence across device types. Hypotheses were tested using data collected from paid participants over 3 weeks in 2018. Participants completed the test on both a PC and a mobile device. Paired samples t-tests indicated no mean differences in scores or number of items …

Introduction To The Special Issue On Advanced Technologies In Assessment: A Science-Practice Concern, Tara S. Behrend, Richard N. Landers

Personnel Assessment and Decisions

No abstract provided.

Disability, Gender And Race: Does Educational Attainment Reduce Earning Disparity For All Or Just Some?, David C. Baldridge, Mukta Kulkarni, Beatrix Eugster, Richard Dirmyer

Personnel Assessment and Decisions

Although interest in research on persons with disabilities has grown steadily, these individuals continue to encounter workplace discrimination and remain marginalized and understudied. We draw on human capital and discrimination theories to propose and test hypotheses on the effects of educational attainment on earnings (in)equality for persons with disabilities and the moderating influence of gender and race using 885,950 records, including 40,438 persons with disabilities from the American Community Survey 2015 (United States Census Bureau, 2015). Consistent with human capital theory, we find that persons with disabilities benefit from greater educational attainment, yet consistent with disability discrimination theories, we find …

Motivations To Control Prejudice Bias Performance Feedback In Developmental Relationships, C. Malik Boykin, Christine R. Smith

Personnel Assessment and Decisions

In developmental relationships, providing accurate assessments of performance is necessary to maximize the developmental benefits for those receiving the feedback. Research suggests that performance assessments for underrepresented minorities are susceptible to biases related to out-group prejudice; however, little is known about the contributions of motivations to control prejudice, particularly in face-to-face settings. Addressing this, we examined the influences of internal and external motivations to control prejudice (IMS and EMS) on the positivity of White mentor’s feedback about their underrepresented minority mentee’s task performance. We analyzed video-recorded interactions between 56 randomly assigned cross-racial dyads, wherein mentees performed a speech task and …