Social and Behavioral Sciences Commons^™

Assessing Reliability Of Expert Ratings Among Judges Responding To A Survey Instrument Developed To Study The Long Term Efficacy Of The Abet Engineering Criteria, Ec2000, Tracy L. Litzinger

Master's Theses - Daytona Beach

In today’s assessment processes, especially those evaluations that rely on humans to make subjective judgements, it is necessary to analyze the quality of their ratings. The psychometric issues associated with assessment provide the lens through which researchers interpret results and important decisions are made. Therefore, inter-rater agreement (IRA) and inter-rater reliability (IRR) are pre-requisites for rater-dependent data analysis. A survey instrument cannot provide “good” information if it is not reliable; in other words, reliability is central to the validation of an instrument. When judges cannot be shown to reliably rate a performance, item, or target, the question becomes why the …

The Effect Of Gender Schematicity On The Assessment Of Male And Female Pilots’ Competence Given Identical Scenarios, Jan D. Laplante

Master's Theses - Daytona Beach

Gender has been identified as one of the top three categories, along with race, and age that are subject to stereotyping, prejudice and discrimination (Fiske, 1998). With the emergence of women in stereotypical male domains, gender research has never been more important. The aviation community is a prime example of one such domain.

This study examined the presence of an existing perception that male pilots are more competent then female pilots. It suggested that there does not appear to be evidence that would explain why there should be a difference in this perception of competence. It also discussed social theories …