Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 1 of 1
Full-Text Articles in Education
Reliability Evidence For The Nc Teacher Evaluation Process Using A Variety Of Indicators Of Inter-Rater Agreement, T. Scott Holcomb, Richard Lambert, Bryndle L. Bottoms
Reliability Evidence For The Nc Teacher Evaluation Process Using A Variety Of Indicators Of Inter-Rater Agreement, T. Scott Holcomb, Richard Lambert, Bryndle L. Bottoms
Journal of Educational Supervision
In this study, various statistical indexes of agreement were calculated using empirical data from a group of evaluators (n = 45) of early childhood teachers. The group of evaluators rated ten fictitious teacher profiles using the North Carolina Teacher Evaluation Process (NCTEP) rubric. The exact and adjacent agreement percentages were calculated for the group of evaluators. Kappa, weighted Kappa, Gwet’s AC1, Gwet’s AC2, and ICCs were used to interpret the level of agreement between the group of raters and a panel of expert raters. Similar to previous studies, Kappa statistics were low in the presence of high levels of …