Social and Behavioral Sciences Commons^™

Validity Evidence For Off-The-Shelf Language-Based Personality Assessment Using Video Interviews: Convergent And Discriminant Relationships With Self And Observer Ratings, Louis Hickman, Louis Tay, Sang Eun Woo

Personnel Assessment and Decisions

Technological advances have led to the development of automated methods for personnel assessment that are purported to augment or outperform human judgment. However, empirical research providing validity evidence for such techniques in the selection context remains scarce. In addressing this void, this study focuses on language-based personality assessments using an off-the-shelf, commercially available product (i.e., IBM Watson Personality Insights) in the context of video-based interviews. The scores derived from the language-based assessment were compared to self and observer ratings of personality to examine convergent and discriminant relationships. The language-based assessment scores showed low convergence with self-ratings for openness, and with …