Open Access. Powered by Scholars. Published by Universities.®

Educational Assessment, Evaluation, and Research Commons™

Open Access. Powered by Scholars. Published by Universities.®

Discipline
Institution
Keyword
Publication Year
Publication
Publication Type
File Type

Articles 3151 - 3180 of 22555

Full-Text Articles in Educational Assessment, Evaluation, and Research

Investigation Of The Role Of Principal Servant Leadership Based On Spiritual Moral Values In Conditioning Humanistic Education, Yulius Rustan Effendi, Pieter Sahertian Jan 2023

Investigation Of The Role Of Principal Servant Leadership Based On Spiritual Moral Values In Conditioning Humanistic Education, Yulius Rustan Effendi, Pieter Sahertian

Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan

This study aims to describe the leadership role of the principal's servant leadership based on spiritual moral values in conditioning humanistic education. This research uses qualitative research and case study design. The research subjects were 3 school principals and 3 senior teachers from three schools in State Junior High Schools, Islamic Private Junior High Schools, and Catholic Junior High Schools located in Malang City, East Java, Indonesia. Data were collected using in-depth interview techniques, participant observation, and documentation study. Data analysis used a modified analytic analysis method. Data validation by measuring credibility, transferability, dependability, and confirmability. The results of this …


Code Mixing In Parent’S Bilingualism For Developing English Children Literacy, Testiana Deni Wijayatiningsih, Riana Eka Budiastuti, Mustasyfa Thabib Kariadi, M. Riyanton, Dini Anggraheni Jan 2023

Code Mixing In Parent’S Bilingualism For Developing English Children Literacy, Testiana Deni Wijayatiningsih, Riana Eka Budiastuti, Mustasyfa Thabib Kariadi, M. Riyanton, Dini Anggraheni

Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan

This case study aims at analyzing the bilingualism Indonesian-English code mixing in parents’ day-to-day talk toward children’s literacy development in learning English. The areas of analysis in this bilingualism study include code-mixing categories: intra-sentential, intra-lexical, and changing dictions. Further, those areas give impacts to the children’s literacy development. The findings indicate that the parent is a bilingual who used Indonesian and English equally well. She is accustomed to do conversation by mixing two different languages to her children. In the conversation, the children are able to imitate and remember the words and phrases produced by parent. Further, this study also …


Concept And Implementation Merdeka Belajar Curriculum In Higher Education, Muhammad Ade Kurnia Harahap, Bambang Ismaya, Abdul Wahab, Susatyo Adhi Pramono, Ichsan Ichsan Jan 2023

Concept And Implementation Merdeka Belajar Curriculum In Higher Education, Muhammad Ade Kurnia Harahap, Bambang Ismaya, Abdul Wahab, Susatyo Adhi Pramono, Ichsan Ichsan

Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan

The government has implemented numerous policies to improve educational quality, such as the independent learning policy. Educational institutions are no less lagging behind in terms of improving educational quality. The descriptive qualitative method was used in this research. The sources used are from scientific books, academic article, journal that has been published in line with the main issue. The results of this study show that the implementation and the concept of the independent learning policy in higher educational level aims to improve the quality of education through the learning process, commitment from teachers, as well as creativity and support from …


Former Students’ Perceptions Toward Rsbi Program: A Reflection Of Indonesia’S Abolished Bilingual Program, Putu Yoga Sathya Pratama, Luh Putu Artini, Ni Putu Era Marsakawati Jan 2023

Former Students’ Perceptions Toward Rsbi Program: A Reflection Of Indonesia’S Abolished Bilingual Program, Putu Yoga Sathya Pratama, Luh Putu Artini, Ni Putu Era Marsakawati

Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan

This article is an attempt to describe RSBI program’s reflection from the former students’ perceptions. The article employed case study research design to explore students’ perceptions with particular emphasis on the use of bilingualism in the classroom. The data were gathered from interview toward 17 former students of RSBI program. The obtained data were analyzed qualitatively and inductively. Results presented RSBI program were perceived diversely from the reason, experience, and expectation viewpoints. Implications portrayed evaluation material in planning future programs that intensify the implementation of international-standards in general, or the use of two languages in the classroom in particular.


Development Of Android-Based Mobile Learning On Ecosystem Materials To Increase The Interest In Learning Elementary School Students, Linda Setiawati, Asep Sunandar, Muhammad Zidni Ilman Nafi’A, Ediyanto Ediyanto, Melor Md Yunus Jan 2023

Development Of Android-Based Mobile Learning On Ecosystem Materials To Increase The Interest In Learning Elementary School Students, Linda Setiawati, Asep Sunandar, Muhammad Zidni Ilman Nafi’A, Ediyanto Ediyanto, Melor Md Yunus

Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan

The development of mobile learning ecosystem materials for elementary school students aims to produce a learning media that aims to support teachers in delivering learning materials in class while increasing interest in learning. Research and Development (R&D) is the research method used, and the Lee and Owens model is the development model used in this development. The results of this mobile learning development were validated by the validator with an average percentage of 94.5%. The results of this validation indicate that the resulting mobile learning is valid or feasible to use in the learning process in order to increase student …


Voices Of Language Lecturers On The Implementation Of Case Method And Project Based Learning, Reli Handayani, Mukhlas Abrar, Friscilla Wulan Tersta, Muhammad Fauzan, Muhammad Sobri Jan 2023

Voices Of Language Lecturers On The Implementation Of Case Method And Project Based Learning, Reli Handayani, Mukhlas Abrar, Friscilla Wulan Tersta, Muhammad Fauzan, Muhammad Sobri

Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan

Innovative learning can be interpreted as an innovation from conventional learning in terms of facilities, media, and methods. Using a student-oriented approach to innovative learning bas ed on the constructivism paradigm which sees that knowledge is built independently by students through the process of investigation and use of technology. Innovative learning can be realized through several methods such as problem solving (problem-based learning), investigation (discovery learning), research (inquiry learning), and group discussion (project-based learning). Responding to this, the Department of Language and Literature Education (PBS) under the auspices of the Faculty of Education and Teacher Training, Jambi University is trying …


Scenario Problem Based Learning On The Critical Thinking Ability Of Vocational High School Students Using The Piagetian Approach, Chendi Pirwanto Putra, Rahmania Sri Untari, Fitria Nur Hasanah, Elma Yunita Jan 2023

Scenario Problem Based Learning On The Critical Thinking Ability Of Vocational High School Students Using The Piagetian Approach, Chendi Pirwanto Putra, Rahmania Sri Untari, Fitria Nur Hasanah, Elma Yunita

Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan

Students' low critical thinking skills in the learning process can affect the quality and results of student learning. This study aims to determine the influence of students' critical thinking skills by applying problem-based learning scenarios in primary computer and network subjects. This study used the Pre ExperimentalDesign research with the One Group Pretest-Posttest Design. The subjects of this study were students of class X TKJ as the experimental group. The data collection technique used in this research is a critical thinking instrument. The data analysis used isa descriptive quantitative analysis using the Paired-Samples T-Test. The results showed that the problem-based …


Scrutinizing Indonesian Students’ Understanding And Perceptions Toward Plagiarism, Lisa Ramadhani Harianti, Ilham Mulya Putra Pradana, Betty Masruroh, Laksono Budiarto, Ravinesh Rohit Prasad Jan 2023

Scrutinizing Indonesian Students’ Understanding And Perceptions Toward Plagiarism, Lisa Ramadhani Harianti, Ilham Mulya Putra Pradana, Betty Masruroh, Laksono Budiarto, Ravinesh Rohit Prasad

Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan

This study aims at investigating Indonesian students’ understanding of plagiarism practice during their final writing project (thesis and dissertation). Further, it also seeks to know the connection between their understanding and their responses to some situations that required them to discriminate against cases of plagiarism. We used a questionnaire provided by Turnitin. It was distributed to 131 undergraduate, graduate, and doctoral students from various universities in Malang, Indonesia. The questionnaire was disseminated through Google Forms in the first week of April 2021. The obtained data were analyzed using descriptive analysis. Our data analysis results showed that many of our participants …


The Relationship Between Ethnochemistry Learning Experience And Cognitive Learning Outcomesbased On Gender, Dwi Wahyudiati Jan 2023

The Relationship Between Ethnochemistry Learning Experience And Cognitive Learning Outcomesbased On Gender, Dwi Wahyudiati

Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan

This study analyzes the relationship between ethnochemistry learning experiences and students’ cognitive learning outcomes based on gender perspective. This quantitative study adopted the survey design. The sample of 60 people (40 women and 20 men) was determined through cluster random sampling. An ethnochemistry-based learning experience questionnaire and student cognitive learning outcomes tests were utilized to collect the data. The collected data were then analyzed by multiple regression test with a significance level of .05. The conclusion drawn based on the results were; 1) the cognitive learning outcomes of chemistry students are higher than the ethnochemistry-based learning experience, and 2) there …


The Analysis Of Role Teacher Personality Competence, Curriculum, And School Climate On Islamic Student’S Morals Amid The Covid-19 Pandemic, Ruslan Ruslan, Saparuddin Saparuddin, Muhammad Alqadri Burga Jan 2023

The Analysis Of Role Teacher Personality Competence, Curriculum, And School Climate On Islamic Student’S Morals Amid The Covid-19 Pandemic, Ruslan Ruslan, Saparuddin Saparuddin, Muhammad Alqadri Burga

Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan

The purpose of this study was to analyze the influence of teacher personality competencies, the curriculum, and the climate of Islamic boarding school on the morals of students in Sulawesi Selatan district, Indonesia. This type of research is a survey with a quantitative approach. Data collection methods using questionnaires, documentation, and observation. Data analysis using descriptive statistical and inferential statistical analysis techniques. The results showed that the teacher's personal competence, the curriculum, and climate of the Islamic boarding school have a positive and significant effect both partially and simultaneously on the morals of the students.


English Language At Secondary Level In Bangladesh: (Dis)Connections Between Policy And Practice Of Oral Skills, S.M. Akramul Kabir Jan 2023

English Language At Secondary Level In Bangladesh: (Dis)Connections Between Policy And Practice Of Oral Skills, S.M. Akramul Kabir

The Qualitative Report

The development of curriculum, textbooks and assessment is a continuous process for better teaching and learning outcomes. The National Curriculum & Textbook Board (NCTB) revised its secondary curriculum in 2012 for English education considering the 2010 National Education policy. The only textbook for the whole country for secondary level, English for Today has been developed accordingly in 2013 for grades 6 to 10, to help students attain competency in listening, speaking, reading, and writing. This qualitative study is based on semi-structured interviews and content analysis of pertinent policy documents. The semi-structured interview data includes a set of English curriculum policy …


Self-Care, Managing Stress And Faculty Promotion, William Buker, Kim Boyd Jan 2023

Self-Care, Managing Stress And Faculty Promotion, William Buker, Kim Boyd

Academy Resources

Dr. Buker, Associate Dean and Senior Professor of Counseling, opens the presentation on the topic of self-care – managing stress and anxiety. He discusses common stress-related symptoms, levels of stress, common causes of stress, variables for managing stress, and self-care principles. Dr. Buker encourages listeners to shoot “PAR”, by managing one’s Perspective, Attitude and Response. Dr. Buker then reviews several practical self-care ideas in the following areas: the physical body, thoughts and perspective, emotions, social relationships, and spiritual resources. He then discusses the role cultures play in determining success and significance, encouraging a grace-based relationship orientation over an image-based performance …


Establishing The Validity And Reliability Of The Locus Assessments, Tim Jacobbe, Bob Delmas, Brad Hartlaub, Jeff Haberstroh, Catherine Case, Steven Foti, Douglas Whitaker Jan 2023

Establishing The Validity And Reliability Of The Locus Assessments, Tim Jacobbe, Bob Delmas, Brad Hartlaub, Jeff Haberstroh, Catherine Case, Steven Foti, Douglas Whitaker

Numeracy

The development of assessments as part of the funded LOCUS project is described. The assessments measure students’ conceptual understanding of statistics as outlined in the GAISE PreK–12 Framework. Results are reported from a large-scale administration to 3,430 students in grades 6 through 12 in the United States. Items were designed to assess levels of understanding as well as components of the statistical problem solving process as articulated in the GAISE framework. We discuss details of how the model used to develop the LOCUS assessments guided the gathering of evidence for validity and reliability arguments. Three types of validity evidence are …


Focused On Pedagogy: Qr Grading Rubrics For Written Arguments, Ruby Daniels, Kathryn Appenzeller Knowles, Emily Naasz, Amanda Lindner Jan 2023

Focused On Pedagogy: Qr Grading Rubrics For Written Arguments, Ruby Daniels, Kathryn Appenzeller Knowles, Emily Naasz, Amanda Lindner

Numeracy

Institutional assessments of quantitative literacy/reasoning (QL/QR) have been extensively tested and reported in the literature. While appropriate for measuring student learning at the programmatic or institutional level, such instruments were not designed for classroom grading. After modifying a widely accepted institutional rubric designed to assess QR in written arguments, the current mixed method study tested the reliability of two QR analytic grading rubrics for written arguments and explored students’ reactions to the grading tools. Undergraduate students enrolled in a business course (N = 59) participated. A total of 415 QR artifacts from 40 students were assessed; an additional 19 …


What Role Do Individual Differences Play In Attrition For High School Students In A Stem Curriculum?, Jacob W. Parsons, Peter M. Dittmer Ed.D Jan 2023

What Role Do Individual Differences Play In Attrition For High School Students In A Stem Curriculum?, Jacob W. Parsons, Peter M. Dittmer Ed.D

National Training Aircraft Symposium (NTAS)

No abstract provided.


Explanation Needed: Understanding The Low Graduation Rates Of Spanish-Speaking English Learners In Southeastern Louisiana, Alice I. Garcia Jan 2023

Explanation Needed: Understanding The Low Graduation Rates Of Spanish-Speaking English Learners In Southeastern Louisiana, Alice I. Garcia

LSU Doctoral Dissertations

This qualitative research study used the case study method of one-on-one interviews to collect and examine the experiences of former English learners (ELs) who were unable to finish high school in southeastern Louisiana. This study aimed to identify specific factors that, using Everett Lee’s theory, pushed or pulled these ELs from school and affected their ability to graduate. The push factors that were identified included language, inadequate support, academic performance, discrimination, and lack of connection with school and culture. Pull factors that were identified included lack of prior education, immigration, poverty, pregnancy, being far from family, financially supporting family, and …


A Swimming Program For Children With Autism Spectrum Disorders: Assessing Critical Parameters From Caregivers’ Perspectives, Abir K. Bekhet, Norah Johnson, Tana Karenke, Amy Van Hecke Jan 2023

A Swimming Program For Children With Autism Spectrum Disorders: Assessing Critical Parameters From Caregivers’ Perspectives, Abir K. Bekhet, Norah Johnson, Tana Karenke, Amy Van Hecke

International Journal of Aquatic Research and Education

One in 54 individuals is diagnosed with autism spectrum disorders (ASD). Swimming can impact the physical and mental well-being of persons with ASD, which in turn may improve their caregivers’ well-being. The purpose of this qualitative evaluation study is to assess the necessity, acceptability, feasibility, fidelity, and beginning effectiveness of a 12-session swimming training program (STP) at an indoor university pool designed to teach persons with ASD how to swim, and to teach caregivers precautions for safety around water. Participants included 7 boys, and 3 girls with ASD [mean age 7.05 years (SD 1.17)] and their caregivers. Results indicated that …


Interaction Between Students With And Without Disabilities In An Inclusive Schools From Their Teachers Perspective., Dr. Basmah Alshahrani Jan 2023

Interaction Between Students With And Without Disabilities In An Inclusive Schools From Their Teachers Perspective., Dr. Basmah Alshahrani

Journal of Science Education for Students with Disabilities

The success of the inclusion of students with disabilities substantially depends on the collaboration of various social agents, including non-disabled peers, who play a substantial role in the lives of students with disabilities. Peers, as social agent, are responsible for the creation of a favourable social environment, in which one of the key factors is a positive acceptance. This research examined the reality of interactions between non-disabled students and their acceptance to peers with disabilities. A qualitative research approach was employed using interviews with Nine special education teachers. An overall positive attitudes were reported with non-disabled peers being reported as …


Adjusting/Modifying Assignments To Support Students With Learning Disabilities While Engaging In Ngss Science And Engineering Practices And Inquiry-Based Learning, Shannon Morago Dr. Jan 2023

Adjusting/Modifying Assignments To Support Students With Learning Disabilities While Engaging In Ngss Science And Engineering Practices And Inquiry-Based Learning, Shannon Morago Dr.

Journal of Science Education for Students with Disabilities

Effective science instruction involves opportunities for all students to do science, including engaging in the NGSS Science and Engineering Practices through inquiry-based learning. Many students with learning disabilities have the accommodation of shortened or reduced assignments in their Individualized Educational Programs to allow them equal access to science learning. Science teachers struggle to provide this accommodation. This practice brief provides examples of supports and strategies for implementing this accommodation during an inquiry-based investigation. A vignette is used to follow a science teacher and her students through an investigation; it details how she provides equal access to the learning objectives as …


Impact Of School Closures And Virtual Instruction On Sixth Grade Reading And Math Achievement Of Student Subgroups, Crystal Michelle Pope Jan 2023

Impact Of School Closures And Virtual Instruction On Sixth Grade Reading And Math Achievement Of Student Subgroups, Crystal Michelle Pope

Doctoral Dissertations and Projects

The purpose of this quantitative, causal-comparative design study was to determine whether differences existed between the reading and math achievement of sixth grade general education students and students with disabilities who have been identified with a specific learning disability or other health impairment. This study was important because achievement gaps exist between subgroups of students (Farkas et al., 2020). The sample included scores from 144 students in a school division in Southeastern Virginia. The instrument used was the Grade 6 Reading and Math Standards of Learning assessments administered in the spring of 2021. Two one-way ANOVAs were used to compare …


The Extent To Which Extra-Curricular School Activities Contribute To Combating Extremism, Khalid Mohammad Abdelljalil Taqatqah Jan 2023

The Extent To Which Extra-Curricular School Activities Contribute To Combating Extremism, Khalid Mohammad Abdelljalil Taqatqah

Journal of the Association of Arab Universities for Research in Higher Education مجلة اتحاد الجامعات العربية للبحوث في التعليم العالي

The study aimed to identify the extent to which school extracurricular activities contribute to combating extremism by identifying the nature and types of extracurricular activities, recognizing the importance of extra-curricular activities in the learning process, and highlighting the importance of extra-curricular activities in combating extremism. To achieve these goals, the study relied on the descriptive analytical approach. The study revealed that extracurricular activities have an important and effective role in confronting extremism through creating harmony and social interaction among the students participating in those activities, Raising their self-confidence and the ability to deal with others, facing different social conditions and …


Navigating The Adoption Of Interprofessional Education As A Performance Standard In Dietetics Education, Paige Whitney, Mary Ann Kluge Jan 2023

Navigating The Adoption Of Interprofessional Education As A Performance Standard In Dietetics Education, Paige Whitney, Mary Ann Kluge

Journal of Dietetic Education

Abstract: The purpose of this collective case study was to explore the diffusion of interprofessional education (IPE) in response to specific Future Education Model (FEM) Graduate Program accreditation standards and performance indicators. Data were collected via semi-structured interviews with a purposive sample of 12 FEM program directors from geographically diverse US states. Website and document review were triangulated with the interview data, and Roger’s Diffusion of Innovation (DOI) was used as a theoretical framework to add dimension to the study. Three themes emerged from analysis: 1) Accreditation standards are not the driving force of IPE; 2) Program Directors can serve …


A Framework To Enhance The International Competitive Advantage Of Information Technology Graduates, Gehad Elsharkawy, Engy Yehia, Yehia Helmy Jan 2023

A Framework To Enhance The International Competitive Advantage Of Information Technology Graduates, Gehad Elsharkawy, Engy Yehia, Yehia Helmy

Future Computing and Informatics Journal

The main objective of any educational institution is to provide its students with the best educational knowledge and experience so, they can be employed to meet the labor market demands. Due to the rapidly changing technology industry and the expanding need for information technology (IT) professionals. The mismatch between IT graduates and the needs of the labor market leads to their inability to employ and job misplacement. Therefore, this paper aims to identify the most significant factors affecting IT graduates' employability and their ability to compete in the local, regional, and international labor markets through a detailed literature review and …


Iea International Civic And Citizenship Education Study 2022: Assessment Framework, Wolfram Schulz, Julian Fraillon, Bruno Losito, Gabriella Agrusti, John Ainley, Valeria Damiani, Tim Friedman Jan 2023

Iea International Civic And Citizenship Education Study 2022: Assessment Framework, Wolfram Schulz, Julian Fraillon, Bruno Losito, Gabriella Agrusti, John Ainley, Valeria Damiani, Tim Friedman

Civics and Citizenship Assessment

The International Civic and Citizenship Education Study (ICCS) investigates the preparation of young people to undertake their roles as citizens. It gathers and analyzes data from representative national samples on students’ conceptual knowledge and understanding of civics and citizenship, as well as their attitudes to, and engagement with, aspects of civics and citizenship. ICCS builds on a succession of IEA studies in this field dating back to 1971, and especially since 2009. The 2022 study has been developed to build on previous perspectives on, and monitor changes in, such enduring issues as: levels of civic knowledge and understanding; patterns of …


Guide To The Dr. Owen B. Kiernan Collection, 1934-2010, Undated, Noah Smith, Orson Kingsley Jan 2023

Guide To The Dr. Owen B. Kiernan Collection, 1934-2010, Undated, Noah Smith, Orson Kingsley

Archives & Special Collections Finding Aids

Owen Kiernan was born on March 9, 1914, in Randolph, Massachusetts. Kiernan graduated from Bridgewater State University in 1935 (known then as Bridgewater State Teachers College) and went on to get his masters at Boston University and his Doctorate at Harvard. Kiernan participated in baseball and basketball while at Bridgewater State and was inducted into the school’s Athletic Hall of Fame in 1989. After graduating from Bridgewater State in 1935, Kiernan kept a strong connection to the school for the rest of his life.

Kiernan became the Massachusetts Commissioner of Education in 1957. He would stay in that role until …


Curricular And Cocurricular Use Of Social Media To Transform Learning Outcomes In Higher Education, Riley Justis, Amy Mcginnis, Rachel Esterline Perkins, Eric L. Buschlen Jan 2023

Curricular And Cocurricular Use Of Social Media To Transform Learning Outcomes In Higher Education, Riley Justis, Amy Mcginnis, Rachel Esterline Perkins, Eric L. Buschlen

Journal of Contemporary Research in Education

No abstract provided.


Taking A State Conference Virtual, With The Result Being Record Attendance, Joni Meade Jan 2023

Taking A State Conference Virtual, With The Result Being Record Attendance, Joni Meade

Journal of Contemporary Research in Education

No abstract provided.


2022-2023 Profile, Morehead State University. Institutional Research & Analysis. Jan 2023

2022-2023 Profile, Morehead State University. Institutional Research & Analysis.

Office of Institutional Research & Analysis Publication Archive

2022-2023 issue of the Profile Website.


The Relational Exchange Model For Academic Partnerships (Remap): A Transition From Transactional To Transformational Relationships Between Pk-12 School Districts And Institutions Of Higher Education, Kaleb G. Patrick Ed.D., Gregg Dionne Ph.D. Jan 2023

The Relational Exchange Model For Academic Partnerships (Remap): A Transition From Transactional To Transformational Relationships Between Pk-12 School Districts And Institutions Of Higher Education, Kaleb G. Patrick Ed.D., Gregg Dionne Ph.D.

Journal of Contemporary Research in Education

Education is in an incredible time of transition. Even prior to the COVID-19 pandemic, there was mounting importance on the need for professional development to meet the ever-increasing demands of students, families, and communities along with ongoing accountability and improvement measures. This increased need of professional development for educators in PK-12 school districts has only accelerated in the wake of COVID-19. Considering this need, a new model for sustainable, mutually beneficial, relationships between PK-12 school districts and Institutions of Higher Education (IHE) is critical. A movement from the currently existing, singularly beneficial, transactional finite relationships to a sustained, mutually beneficial, …


Is It Actually Reliable? Examining Statistical Methods For Inter-Rater Reliability Of A Rubric In Graduate Education, Brent J. Goertzen, Kaley Klaus Jan 2023

Is It Actually Reliable? Examining Statistical Methods For Inter-Rater Reliability Of A Rubric In Graduate Education, Brent J. Goertzen, Kaley Klaus

Leadership Faculty Publications

When evaluating student learning, educators often employ scoring rubrics, for which quality can be determined through evaluating validity and reliability. This article discusses the norming process utilized in a graduate organizational leadership program for a capstone scoring rubric. Concepts of validity and reliability are discussed, as is the development of a scoring rubric. Various statistical measures of inter-rater reliability are presented and effectiveness of those measures are discussed. Our findings indicated that inter-rater reliability can be achieved in graduate scoring rubrics, though the strength of reliability varies substantially based on the selected statistical measure. Recommendations for determining validity and measuring …