Higher Education Commons^™

Is It Actually Reliable? Examining Statistical Methods For Inter-Rater Reliability Of A Rubric In Graduate Education, Brent J. Goertzen, Kaley Klaus

Leadership Faculty Publications

When evaluating student learning, educators often employ scoring rubrics, for which quality can be determined through evaluating validity and reliability. This article discusses the norming process utilized in a graduate organizational leadership program for a capstone scoring rubric. Concepts of validity and reliability are discussed, as is the development of a scoring rubric. Various statistical measures of inter-rater reliability are presented and effectiveness of those measures are discussed. Our findings indicated that inter-rater reliability can be achieved in graduate scoring rubrics, though the strength of reliability varies substantially based on the selected statistical measure. Recommendations for determining validity and measuring …

Education Based On Graduate Marginalized Perspective, Bryanna Edwards

All Graduate Theses, Dissertations, and Other Capstone Projects

The United States Education system has received many budget cuts throughout the years. Sixty-six percent of Americans believe that the United States Education system needs major changes or to be rebuilt (Pew Research, 2013). There has been much debate regarding the first step toward reform. To begin to answer this question this research investigated some of the most restrictive educational spaces.

The most available and beneficial first steps to reform lie in the minds and practices within the educational institution. This research could lead to cultivating more inclusive policies and practices, to serve an increasingly diverse student population. Although disciplines …