Open Access. Powered by Scholars. Published by Universities.®

Education Commons

Open Access. Powered by Scholars. Published by Universities.®

Higher Education

PDF

Fort Hays State University

Graduate education

Articles 1 - 2 of 2

Full-Text Articles in Education

Is It Actually Reliable? Examining Statistical Methods For Inter-Rater Reliability Of A Rubric In Graduate Education, Brent J. Goertzen, Kaley Klaus Jan 2023

Is It Actually Reliable? Examining Statistical Methods For Inter-Rater Reliability Of A Rubric In Graduate Education, Brent J. Goertzen, Kaley Klaus

Leadership Faculty Publications

When evaluating student learning, educators often employ scoring rubrics, for which quality can be determined through evaluating validity and reliability. This article discusses the norming process utilized in a graduate organizational leadership program for a capstone scoring rubric. Concepts of validity and reliability are discussed, as is the development of a scoring rubric. Various statistical measures of inter-rater reliability are presented and effectiveness of those measures are discussed. Our findings indicated that inter-rater reliability can be achieved in graduate scoring rubrics, though the strength of reliability varies substantially based on the selected statistical measure. Recommendations for determining validity and measuring …


Not On My Watch: How To Have A Diverse Academic Program And High Quality Students In Your Program At The Same Time?, Marcheta Evans Apr 2008

Not On My Watch: How To Have A Diverse Academic Program And High Quality Students In Your Program At The Same Time?, Marcheta Evans

Academic Leadership: The Online Journal (2003-2012)

Here is the dilemma: The faculty in my department wants to use the Graduate Record Examination (GRE) as a criterion for admissions into our Master’s program. This is a new shift since my university has made the decision to move to a research one institution. Now on the outside, this sounds like a wonderful idea. The university where I am employed is a Hispanic serving institution with over 28,000 students. We have developed many new doctoral programs including a new Ph.D. program in my department. So, of course, the next step is to move up in the Carnegie rankings to …