Education Commons^™

Faculty Inter - Rater Reliability Of A Reflective Journaling Rubric -- Research, Mari Alschuler

Kentucky Journal of Excellence in College Teaching and Learning

There has been a lack of research regarding faculty training in the grading of student reflective journals (RJs). Whether or how one should evaluate RJs remains contentious. This quasi-experimental study assessed whether providing faculty in-service training on scoring RJs using a rubric would result in statistically significant inter-rater reliability.Prior to the study, faculty raters received training on reflective practice and scoring RJs with a rubric based on five levels of reflection. Percent agreement between rater pairs, with 80% set as the inter-rater reliability benchmark, was utilized. Faculty raters scored anonymous BSW and MSW RJs assigned in cultural diversity and oppression …