Open Access. Powered by Scholars. Published by Universities.®

Social and Behavioral Sciences Commons

Open Access. Powered by Scholars. Published by Universities.®

Articles 1 - 24 of 24

Full-Text Articles in Social and Behavioral Sciences

Crowdsourcing Job Satisfaction Data: Examining The Construct Validity Of Glassdoor.Com Ratings, Richard N. Landers, Robert C. Brusso, Elena M. Auer Nov 2019

Crowdsourcing Job Satisfaction Data: Examining The Construct Validity Of Glassdoor.Com Ratings, Richard N. Landers, Robert C. Brusso, Elena M. Auer

Personnel Assessment and Decisions

Researchers, practitioners, and job seekers now routinely use crowdsourced data about organizations for both decision-making and research purposes. Despite the popularity of such websites, empirical evidence regarding their validity is generally absent. In this study, we tackled this problem by combining two curated datasets: (a) the results of the 2017 Federal Employee Viewpoint Survey (FEVS), which contains facet-level job satisfaction ratings from 407,789 US federal employees, and which we aggregated to the agency level, and (b) current overall and facet ratings of job satisfaction of the federal agencies contained within FEVS from Glassdoor.com as scraped from the Glassdoor application programming …


“Where’S The I-O?” Artificial Intelligence And Machine Learning In Talent Management Systems, Manuel F. Gonzalez, John F. Capman, Frederick L. Oswald, Evan R. Theys, David L. Tomczak Nov 2019

“Where’S The I-O?” Artificial Intelligence And Machine Learning In Talent Management Systems, Manuel F. Gonzalez, John F. Capman, Frederick L. Oswald, Evan R. Theys, David L. Tomczak

Personnel Assessment and Decisions

Artificial intelligence (AI) and machine learning (ML) have seen widespread adoption by organizations seeking to identify and hire high-quality job applicants. Yet the volume, variety, and velocity of professional involvement among I-O psychologists remains relatively limited when it comes to developing and evaluating AI/ML applications for talent assessment and selection. Furthermore, there is a paucity of empirical research that investigates the reliability, validity, and fairness of AI/ML tools in organizational contexts. To stimulate future involvement and research, we share our review and perspective on the current state of AI/ML in talent assessment as well as its benefits and potential pitfalls; …


Developing Device-Equivalent And Effective Measures Of Complex Thinking With An Information Processing Framework And Mobile First Design Principles, Darrin M. Grelle, Sara L. Gutierrez Nov 2019

Developing Device-Equivalent And Effective Measures Of Complex Thinking With An Information Processing Framework And Mobile First Design Principles, Darrin M. Grelle, Sara L. Gutierrez

Personnel Assessment and Decisions

Organizations are increasingly offering pre-employment assessments on mobile devices to evaluate candidates. The aim of this study is to investigate whether employing a mobile first responsive web design based on an information processing framework will result in device-equivalent measures of cognitive ability. Tests of numerical and deductive reasoning composed of interactive item types were tested for measurement equivalence across device types. Hypotheses were tested using data collected from paid participants over 3 weeks in 2018. Participants completed the test on both a PC and a mobile device. Paired samples t-tests indicated no mean differences in scores or number of items …


Validity Evidence For Off-The-Shelf Language-Based Personality Assessment Using Video Interviews: Convergent And Discriminant Relationships With Self And Observer Ratings, Louis Hickman, Louis Tay, Sang Eun Woo Nov 2019

Validity Evidence For Off-The-Shelf Language-Based Personality Assessment Using Video Interviews: Convergent And Discriminant Relationships With Self And Observer Ratings, Louis Hickman, Louis Tay, Sang Eun Woo

Personnel Assessment and Decisions

Technological advances have led to the development of automated methods for personnel assessment that are purported to augment or outperform human judgment. However, empirical research providing validity evidence for such techniques in the selection context remains scarce. In addressing this void, this study focuses on language-based personality assessments using an off-the-shelf, commercially available product (i.e., IBM Watson Personality Insights) in the context of video-based interviews. The scores derived from the language-based assessment were compared to self and observer ratings of personality to examine convergent and discriminant relationships. The language-based assessment scores showed low convergence with self-ratings for openness, and with …


Fair And Flexible?! Explanations Can Improve Applicant Reactions Toward Asynchronous Video Interviews, Johannes M. Basch, Klaus G. Melchers Nov 2019

Fair And Flexible?! Explanations Can Improve Applicant Reactions Toward Asynchronous Video Interviews, Johannes M. Basch, Klaus G. Melchers

Personnel Assessment and Decisions

Asynchronous video interviews are used more and more for the preselection of potential job candidates. However, recent research has shown that they are less accepted by applicants than face-to-face interviews. Our study aimed to identify ways to improve perceptions of video interviews by using explanations that emphasize standardization and flexibility. Our results showed that an explanation stressing the higher level of standardization improved fairness perceptions, whereas an explanation stressing the flexibility concerning interview scheduling improved perceptions of usability. Additionally, the improvement of fairness perceptions eventually influenced perceived organizational attractiveness. Furthermore, older participants accepted video interviews less. Practical implications and recommendations …


Introduction To The Special Issue On Advanced Technologies In Assessment: A Science-Practice Concern, Tara S. Behrend, Richard N. Landers Nov 2019

Introduction To The Special Issue On Advanced Technologies In Assessment: A Science-Practice Concern, Tara S. Behrend, Richard N. Landers

Personnel Assessment and Decisions

No abstract provided.


The Impact Of Suspect Descriptions In University Crime Reports On Racial Bias, Naomi M. Fa-Kaji, Shannon K. Cheng, Mikki R. Hebl Oct 2019

The Impact Of Suspect Descriptions In University Crime Reports On Racial Bias, Naomi M. Fa-Kaji, Shannon K. Cheng, Mikki R. Hebl

Personnel Assessment and Decisions

Crime reports often include suspect descriptions to alert community members and aid in police investigations. However, vague descriptions of suspects with racial identifiers can potentially do more harm than good. We first conducted an archival study to examine the frequency of reporting suspect race, as well as the relationship between the inclusion of race and the likelihood that the suspect was caught. Then we conducted an experimental study to examine how reporting race may affect overt and subtle racial attitudes. We found no significant relationship between the racial identification of a suspect and the likelihood that the suspect was caught …


Disability, Gender And Race: Does Educational Attainment Reduce Earning Disparity For All Or Just Some?, David C. Baldridge, Mukta Kulkarni, Beatrix Eugster, Richard Dirmyer Oct 2019

Disability, Gender And Race: Does Educational Attainment Reduce Earning Disparity For All Or Just Some?, David C. Baldridge, Mukta Kulkarni, Beatrix Eugster, Richard Dirmyer

Personnel Assessment and Decisions

Although interest in research on persons with disabilities has grown steadily, these individuals continue to encounter workplace discrimination and remain marginalized and understudied. We draw on human capital and discrimination theories to propose and test hypotheses on the effects of educational attainment on earnings (in)equality for persons with disabilities and the moderating influence of gender and race using 885,950 records, including 40,438 persons with disabilities from the American Community Survey 2015 (United States Census Bureau, 2015). Consistent with human capital theory, we find that persons with disabilities benefit from greater educational attainment, yet consistent with disability discrimination theories, we find …


Examining Why And For Whom Reflection Diversity Training Works, Alex P. Lindsey, Eden King, Brittney Amber, Isaac Sabat, Afra S. Ahmad Oct 2019

Examining Why And For Whom Reflection Diversity Training Works, Alex P. Lindsey, Eden King, Brittney Amber, Isaac Sabat, Afra S. Ahmad

Personnel Assessment and Decisions

This research introduces a novel approach to diversity training by theoretically developing and empirically testing a model that considers a new training exercise aimed at improving proximal and distal pro-diversity outcomes. This new training exercise, reflection, is proposed to be effective at increasing pro-diversity attitudes and behaviors due to the promotion of one's internal motivations to respond without prejudice. Further, we test a critical trainee characteristic, social dominance orientation (SDO), as a boundary condition of our proposed effects. Results from an online experiment with two time points indicate that reflection can be an effective diversity training exercise and leads to …


Framing Matters: The Influence Of Group-Image Threat On Reactions To Affirmative Action Policies, Kisha S. Jones, Anuradha Anantharaman, Anjali Bhatt Oct 2019

Framing Matters: The Influence Of Group-Image Threat On Reactions To Affirmative Action Policies, Kisha S. Jones, Anuradha Anantharaman, Anjali Bhatt

Personnel Assessment and Decisions

Affirmative action (AA) attempts to rectify the institutional effects of prior employment discrimination toward minority groups. Although AA has played a large role in increasing workplace diversity, organizations may vary in their perspectives towards diversity itself, ranging from a sole focus on increasing diversity to appreciating the value diversity may add. Support for AA has been considered as a form of White identity management (Knowles, Lowery, Chow, & Unzueta, 2014) and is impacted by the extent to which White people experience group-image threat to their racial identity. Our findings suggest that the level of group-image threat experienced by White people …


Motivations To Control Prejudice Bias Performance Feedback In Developmental Relationships, C. Malik Boykin, Christine R. Smith Oct 2019

Motivations To Control Prejudice Bias Performance Feedback In Developmental Relationships, C. Malik Boykin, Christine R. Smith

Personnel Assessment and Decisions

In developmental relationships, providing accurate assessments of performance is necessary to maximize the developmental benefits for those receiving the feedback. Research suggests that performance assessments for underrepresented minorities are susceptible to biases related to out-group prejudice; however, little is known about the contributions of motivations to control prejudice, particularly in face-to-face settings. Addressing this, we examined the influences of internal and external motivations to control prejudice (IMS and EMS) on the positivity of White mentor’s feedback about their underrepresented minority mentee’s task performance. We analyzed video-recorded interactions between 56 randomly assigned cross-racial dyads, wherein mentees performed a speech task and …


The Effects Of Perspective Taking Implementing Intentions On Employee Evaluations And Hostile Sexism, Saaid A. Mendoza, Jeanine L. M. Skorinko, Sarah A. Martin, Lauren E. Martone Oct 2019

The Effects Of Perspective Taking Implementing Intentions On Employee Evaluations And Hostile Sexism, Saaid A. Mendoza, Jeanine L. M. Skorinko, Sarah A. Martin, Lauren E. Martone

Personnel Assessment and Decisions

The current research examined whether gender bias in the workplace could be reduced through perspective taking implementation intentions, which are if–then statements that specify how to accomplish goals (Gollwitzer, 1999). Amazon MTurk participants (N = 180, 53% male) learned they would complete a two-step performance review for a consulting company. Prior to receiving a male or female employee’s record, all participants were given a goal strategy to be fair in their review, with half also receiving an if–then strategy that encouraged perspective taking. Participants rated the employee on three work related dimensions (skillset, performance, and traits), provided an overall promotion …


Helping Or Hurting?: Understanding Women’S Perceptions Of Male Allies, Shannon K. Cheng, Linnea C. Ng, Allison M. Traylor, Eden B. King Oct 2019

Helping Or Hurting?: Understanding Women’S Perceptions Of Male Allies, Shannon K. Cheng, Linnea C. Ng, Allison M. Traylor, Eden B. King

Personnel Assessment and Decisions

In the past decade, organizational scholars have begun to explore the role of allies in mitigating workplace discrimination toward women and members of minority groups. However, this nascent literature has, to this point, failed to consider the perspective of targets of ally behavior. That is, we do not yet know how targets of discrimination experience others’ intervention or advocacy. To begin to understand these issues, we examine target perceptions of allyship through a qualitative critical incident approach, asking women to describe experiences in which a man has effectively and ineffectively acted as an ally to them in the workplace. Our …


Reducing Interpersonal Discrimination For Pregnant Job Applicants Seeking Professional Jobs, Sarah Singletary Walker, Whitney Botsford Morgan Oct 2019

Reducing Interpersonal Discrimination For Pregnant Job Applicants Seeking Professional Jobs, Sarah Singletary Walker, Whitney Botsford Morgan

Personnel Assessment and Decisions

This study seeks to extend previous research on the experiences of pregnant job applicants from retail settings (see Botsford Morgan, Walker, Hebl, & King, 2013) to entry-level professional jobs. The current research utilized a 2 (expectant status: not pregnant, pregnant) x 4 (counterstereotypic information: control, competence, commitment, flexibility) betweensubjects factorial design to empirically test the relative efficacy of real, practical interventions designed to reduce the interpersonal discrimination (enhanced negativity and reduced positivity) that pregnant women may encounter when applying for entry-level professional jobs. Results reveal that pregnant job applicants experience more positive interactions when presenting information about their competence than …


A Review Of Compensatory Strategies To Mitigate Bias, Oscar Holmes Iv, Gabrielle Lopiano, Erika V. Hall Oct 2019

A Review Of Compensatory Strategies To Mitigate Bias, Oscar Holmes Iv, Gabrielle Lopiano, Erika V. Hall

Personnel Assessment and Decisions

Experiences of bias and discrimination remain pernicious obstacles for many individuals. Both micro- and macro-level interventions are necessary to eliminate and/or mitigate these negative experiences. This review focuses on micro-level interventions, specifically, five types of compensatory strategies that targets can use to eliminate and/or mitigate the bias and discrimination they experience. In this manuscript, we synthesize the research on humor, avoidance, affiliation, enhancement, and social category label switching strategies; describe identities with which the strategies could be used; and highlight strengths and weaknesses of each of the strategies. Finally, we propose actionable directions for future research for each of the …


To Look Or Not To Look: Acknowledging Facial Stigmas In The Interview To Reduce Discrimination, Juan M. Madera, Mikki Hebl Oct 2019

To Look Or Not To Look: Acknowledging Facial Stigmas In The Interview To Reduce Discrimination, Juan M. Madera, Mikki Hebl

Personnel Assessment and Decisions

As the use of technology-mediated interviews (e.g., Skype) is becoming a standard method to interview applicants, it is important to understand how discrimination can still manifest in these types of interviews. Because technology-mediated interviews focus on applicants’ faces, discrimination based on facial stigmas can be particularly inevitable. Thus, the purpose of the current study is to examine how a facial stigma affects visual attention during a technology-mediated interview and acknowledgment as a remediation strategy that individuals might use to reduce the amount of visual attention on a facial stigma. We used a 2 (acknowledge: yes or no) x 2 (target …


“Say It Loud, I’M Black And Proud:” The Effectiveness Of Racial Acknowledgments At Work, Enrica N. Ruggs, Sarah Singletary Walker, Abby Corrington, Christine L. Nittrouer Oct 2019

“Say It Loud, I’M Black And Proud:” The Effectiveness Of Racial Acknowledgments At Work, Enrica N. Ruggs, Sarah Singletary Walker, Abby Corrington, Christine L. Nittrouer

Personnel Assessment and Decisions

Research underscores engagement in identity management strategies as an effective way to reduce workplace discrimination, particularly subtle forms of discrimination. The aim of the current study is to examine the use and effectiveness of different methods of the specific identity management strategy of acknowledging race as a way to reduce workplace discrimination and lead to other positive outcomes for Black individuals. A sample of Black and White individuals with professional work experience participated in an online vignettebased survey. Participants read four short vignettes involving race in the workplace and responded to a series of questions assessing usage of various acknowledgment …


Special Issue On Reducing Discrimination In The Workplace: An Introduction, Mikki Hebl, Juan M. Madera, Whitney Botsford Morgan Oct 2019

Special Issue On Reducing Discrimination In The Workplace: An Introduction, Mikki Hebl, Juan M. Madera, Whitney Botsford Morgan

Personnel Assessment and Decisions

No abstract provided.


Are Consensus Ratings Of Functional Job Analysis Scales More Reliable Than Ratings Made By Independent Raters?, Greg A. Chung-Yan, Aaron C. H. Schat, Steven F. Cronshaw Jul 2019

Are Consensus Ratings Of Functional Job Analysis Scales More Reliable Than Ratings Made By Independent Raters?, Greg A. Chung-Yan, Aaron C. H. Schat, Steven F. Cronshaw

Personnel Assessment and Decisions

This study addresses an open research question in regard to a well-established and widely-used job analysis system, Functional Job Analysis (FJA): Are consensus ratings of the FJA scales more reliable than the independent scale ratings that are the norm in job analysis application and the related research literature? In our experimental study, we found that this is not the case: no significant difference is found between consensus and independent ratings of the FJA scales. The reasons for this finding are explored as well as its relevance to the validity of the FJA system. Implications for other work and job analysis …


A New Scoring Procedure In Assessment Centers: Insights From Interaction Analysis, Janneke K. Oostrom, Nale Lehmann-Willenbrock, Ute-Christine Klehe Jul 2019

A New Scoring Procedure In Assessment Centers: Insights From Interaction Analysis, Janneke K. Oostrom, Nale Lehmann-Willenbrock, Ute-Christine Klehe

Personnel Assessment and Decisions

This paper proposes interaction analysis as an alternative scoring procedure in assessment centers (ACs). Interaction analysis allows for a more fine-grained scoring approach by which candidate behaviors are captured as they actually happen, thus avoiding judgment errors typically associated with traditional scoring procedures. We describe interaction analysis and explain how this procedure can improve the validity of ACs. In a short research example, we showcase how interaction analysis can be implemented in AC settings. Finally, we integrate our arguments in terms of three key propositions which we hope will inspire future research on more dynamic scoring procedures.


Selection Tool Use: A Focus On Personality Testing In Canada, The United States, And Germany, Stephen D. Risavy, Peter A. Fisher, Chet Robie, Cornelius J. König Jul 2019

Selection Tool Use: A Focus On Personality Testing In Canada, The United States, And Germany, Stephen D. Risavy, Peter A. Fisher, Chet Robie, Cornelius J. König

Personnel Assessment and Decisions

The purpose of this paper is to provide new data regarding the current staffing practices being used by organizations in Canada and the United States (US) as well as a comparison with existing data from Germany (Diekmann & König, 2015). Data regarding the beliefs of human resource (HR) practitioners in terms of using personality tests in personnel selection is also provided. A geographically representative sample of 453 HR practitioners across Canada and the US were surveyed. Although general mental ability testing has previously been found to be highly valid and cost effective, this selection tool was among the least commonly …


Criterion-Related Validity Of Forced-Choice Personality Measures: A Cautionary Note Regarding Thurstonian Irt Versus Classical Test Theory Scoring, Peter A. Fisher, Chet Robie, Neil D. Christiansen, Andrew B. Speer, Leann Schneider Jul 2019

Criterion-Related Validity Of Forced-Choice Personality Measures: A Cautionary Note Regarding Thurstonian Irt Versus Classical Test Theory Scoring, Peter A. Fisher, Chet Robie, Neil D. Christiansen, Andrew B. Speer, Leann Schneider

Personnel Assessment and Decisions

This study examined criterion-related validity for job-related composites of forced-choice personality scores against job performance using both Thurstonian Item Response Theory (TIRT) and Classical Test Theory (CTT) scoring methods. Correlations were computed across 11 different samples that differed in job or role within a job. A meta-analysis of the correlations (k = 11 and N = 613) found a higher average corrected correlation for CTT (mean ρ = .38) than for TIRT (mean ρ = .00). Implications and directions for future research are discussed.


Who Is Conducting “Better” Employment Interviews? Antecedents Of Structured Interview Components Use, Nicolas Roulin, Joshua S. Bourdage, Timothy G. Wingate Jul 2019

Who Is Conducting “Better” Employment Interviews? Antecedents Of Structured Interview Components Use, Nicolas Roulin, Joshua S. Bourdage, Timothy G. Wingate

Personnel Assessment and Decisions

The employment interview remains a unique paradox. One the one hand, decades of research demonstrates that using more structured components (e.g., question consistency, evaluation standardization) can largely improve the psychometric properties of interviews. On the other hand, although interviews are almost universally used, many interviewers still resist using structured formats. We examined the use of seven structure components by 131 professional interviewers, and their association with three types of antecedents: interviewers’ background (e.g., experience, training), the focus of the interview (selection vs. recruitment), and interviewers’ personality (based on the HEXACO model). Interviewers’ background (i.e., training) and the focus of the …


Examining Factors Influencing Use Of A Decision Aid In Personnel Selection, Alexander T. Jackson, Michael E. Young, Satoris S. Howes, Patrick A. Knight, Sydney L. Reichin Jul 2019

Examining Factors Influencing Use Of A Decision Aid In Personnel Selection, Alexander T. Jackson, Michael E. Young, Satoris S. Howes, Patrick A. Knight, Sydney L. Reichin

Personnel Assessment and Decisions

In this research, two studies were conducted to examine factors influencing reliance on a decision aid in personnel selection. Specifically, this study examined the effect of feedback, validity of selection predictors, and presence of a decision aid on the use of the aid in personnel selection. The results demonstrate that when people are provided with the decision aid, their predictions were significantly more similar to the predictions made by the aid than people who were not provided with the aid. This suggests that when people are provided with an aid, they will use it to some degree. This research also …