Psychology Commons^™

Using Bayesian Generalized Structural Equation Modeling To Analyze Latent Agreement, Sydne T. Mccluskey

Dissertations, Theses, and Capstone Projects

Rater comparison analysis is commonly necessary in the social sciences. Conventional approaches to the problem generally focus on calculation of agreement statistics, which provide useful but incomplete information about rater agreement. Importantly, one-number agreement statistics give no indication regarding the nature of disagreements, nor do they distinguish between agreement on presence versus absence of a state or trait. Latent variable models can address both problems, as well as overcoming other well-documented limitations of agreement statistics (e.g., sample dependence, inappropriate population assumptions). Whether raters exactly agree is usually not the question of interest – researchers almost never care whether the difference …