Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 1 of 1
Full-Text Articles in Psychology
Assessing Reliability Of Expert Ratings Among Judges Responding To A Survey Instrument Developed To Study The Long Term Efficacy Of The Abet Engineering Criteria, Ec2000, Tracy L. Litzinger
Assessing Reliability Of Expert Ratings Among Judges Responding To A Survey Instrument Developed To Study The Long Term Efficacy Of The Abet Engineering Criteria, Ec2000, Tracy L. Litzinger
Master's Theses - Daytona Beach
In today’s assessment processes, especially those evaluations that rely on humans to make subjective judgements, it is necessary to analyze the quality of their ratings. The psychometric issues associated with assessment provide the lens through which researchers interpret results and important decisions are made. Therefore, inter-rater agreement (IRA) and inter-rater reliability (IRR) are pre-requisites for rater-dependent data analysis. A survey instrument cannot provide “good” information if it is not reliable; in other words, reliability is central to the validation of an instrument. When judges cannot be shown to reliably rate a performance, item, or target, the question becomes why the …