Educational Assessment, Evaluation, and Research Commons^™

Assessing The Effects Of Restorative Practices On Teacher Practices In Elementary Classrooms, Cheng Fisher

Graduate Theses, Dissertations, and Capstones

Restorative practices have been broadly adopted in American schools. However, few empirical studies have rigorously examined the effects of restorative practices on teacher practices through direct observations. This quasi-experimental designed study tested the hypothesis that restorative practices experience would increase positive interactions between teachers and students. Measurably, it would improve positive teacher practices and positive student behavior. The study analyzed data from a school-randomized evaluation with two rounds of observations in a single school year. Observational data of 140 elementary teachers and their students from nine restorative schools were used to examine the impact of restorative practices on teacher practices …

A Correlational Study Of School Report Card Grades And Degrees Of Poverty, Morgan V. Blanton

Journal of Organizational & Educational Leadership

This study explores the ways in which public schools are evaluated and the results are reported in North Carolina. Currently using a formula that calculates a summative score based on academic achievement and academic growth, the impact of poverty and the complexity of school evaluation is investigated using demographic and testing data from schools across the state. Furthermore, recommendations to alter current practices of school evaluation and reporting as well as suggestions for future research are discussed based on this study’s findings.

Chart A Clear Course: Evaluation Is Key To Building Better, More Relevant Learning, Chase Nordengren, Thomas R. Guskey

Educational, School, and Counseling Psychology Faculty Publications

When we engage in professional learning, we do it for one big reason: to get better at supporting students. Rigorous and thoughtful program evaluations can provide the critical connection between well-designed programs or initiatives and continuous improvement that builds essential knowledge and skills for educators. Evaluation helps us examine what has been accomplished in a professional learning initiative and identify course corrections that can help the initiative improve.

Doing Discipline Different: Evaluating The Implementation Of Restorative Justice As An Alternative To Punitive Discipline In New York City Public Schools, Virginia Diaz-Mendoza

Dissertations, Theses, and Capstone Projects

Given that punitive discipline practices have disproportionately impacted its poor students of color, New York City is committed to transforming school discipline and improving school climate by implementing restorative justice as an alternative. This study is an evaluation of the restorative justice pilot program funded by the New York City Council and managed by the New York City Department of Education where key stakeholders including officials at the Department of Education, school administrators, educators, school staff, and community organizations are involved in the implementation of restorative justice in schools with high suspension rates. Data was collected through interviews, observations of …

The Future Of International Education: Why Agility Is Now Integral To Strategic Planning, Aaron Clevenger, Elaine Meyer-Lee

Publications

Based on my experience, agility is truly based on the principles of resiliency. Resiliency is an approach to sustainability that focuses on building capacity to deal with disasters, unexpected changes and/or shifts to our daily routines.

● Kampala, Uganda example shows mild disruption, poor maintenance, and insufficient infrastructure creates a lack of resiliency.

At Embry-Riddle, hurricanes are the norm.

Health Education Projects In Portuguese Schools: A Multicases Study, Hugo Oliveira, Jorge Bonito

ASEAN Journal of Community Engagement

Health education projects (HEP) incorporate all the educational projects of the Portuguese elementary and secondary schools in order to respond to four key areas: mental health and violence prevention; food education and physical activity; addictive behaviors and dependencies; and affection and sexuality education. This study aimed at identifying the effects of HEP as they are perceived by teachers and students. A multicase study was developed in five schools in the municipality of Castelo Branco, Portugal. The sample consisted of a HEP coordinating teacher and one student from each case. The content analysis of each HEP was performed and semi-structured interviews …

Rancho Cielo Value Added Program Evaluation, Yacin Cardenas Alfaro

Capstone Projects and Master's Theses

Rancho Cielo Youth Campus is a 501 (c) (3) non-profit organization located in Salinas CA. The agency serves underserved and disconnected youth that have dropped out of school, are on probation, or under truancy regulations in Monterey County. The problem this capstone addressed is that the recidivism rate for at-risk youth is too high. Rancho Cielo’s Value-added program seeks to alleviate this problem by training youth in agriculture technology as a way to connect them with careers in the sector. The capstone project consisted of a program evaluation that documented the program implementation and the creation of a program logic …

Student Self-Assessment: Boon Or Bane?, Ashtamurthy Killimangalam

Teacher India

Student self-assessment can help to improve learning outcomes, but only if used as a formative exercise, as Ashtamurthy Killimangalam explains.

Evaluation Of The Impact Of Social Collaborations On Sexual And Reproductive Health Knowledge, Lucki Word, Jaila Campbell, Manar T. Edriss, Destiny Stroman, Jewel Evans, Melanie Hanna-Johnson, Md, Anil N. F. Aranha, Phd

Medical Student Research Symposium

Introduction: Developments in technology, such as the popularity of mobile devices and social media outlets, have enhanced the ability of individuals to communicate. Currently, search engines allow for easy exploration of information related to every topic of interest. Our study purpose was to evaluate the impact of technological and social collaborations on sexual and reproductive health knowledge (SRHK).

Methods: A 50-item survey instrument, integrating factors of sociodemographics, number/type of social collaborations, technological communication use, and SRHK, was developed to assess familiarity with sexual and reproductive health perceptions. The survey was provided to consenting patients in an ambulatory, primary care setting. …

Aggie First Scholars: A Quality Workforce Initiative For Promoting First-Generation Student Success, Amanda M. Hagman, John Louviere, Heidi Kesler, Mykel Beorchia, Lisa Simmons, Mitchell Colver

Publications

Introduction: First-generation students lag behind continuing-generation peers in terms of graduation rates and average time to graduation. This phenomenon has been extensively studied in higher education with the intent of closing the gap seen between generational statuses. Utah State University provides services to support first-generation students. In the 2018/2019 academic year, USU initiative a full-kit initiative to help first-generation student participate in several proven first-year student milestones. This report explores the impact of full-kit use of services and the individual impact of each service on first-generation student persistence. METHODS: Students who self-identified as first-generation on their USU application were invited …

Encouraging Healthy Eating Among Older Adults Using The Transtheoretical Model: An Evaluation Of A Pilot Intervention, Lauren Brinkman Roberson

Theses and Dissertations--Communication

Older adults, defined as those age 60 and above, are at an increased risk for many health-related complications that are directly related to nutrition (Centers for Disease Control and Prevention, 2015). This study highlights the lack of nutrition education material developed for older adults in Kentucky. Such material has great potential to influence the health of older adults (Chernoff, 2001). This study evaluated an intervention developed, by means of formative research, to teach older adults nutrition basics. Both direct and indirect measures related to stages of change for healthy eating behaviors were collected six weeks pre-intervention and then immediately post-intervention. …

Student Nutrition Access Center: Impact Analysis 2019, Amanda M. Hagman, Hayden Hoopes, Nelda Ault-Dyslin

Publications

Introduction: Access to nutritional food items is crucial to student well-being, which in turn is crucial to student success. Student success emerges from “the amount of physical and psychological energy that the student devotes to the academic experience” (Astin, 1984). Campus nutrition programs help students eliminate food security issues so that they can devote more energy to the academic experience. However, creating efficient and convenient nutrition programs requires that administrators understand the complexities of their implementation, their effect on specific student segments, and their effect on decisions to either persist at or leave an institution. This report explores the impact …

Aggie Recreation Center Impact Report Fall 2015 To Spring 2019, Amanda M. Hagman, Erik Dickamore, Daniel Lawrence, Mitchell Colver

Publications

Recreation facilities are an integral part of the university community. The Aggie Recreation Center is a place that helps foster a well balanced student. The ARC provides students with a myriad of opportunities for recreation, exercise, and community that can support students on their academic journey. This report explored the association between ARC facility use and student persistence to the next term at Utah State University. METHODS: Students recreation center use was captured with entry log-ins as students entered the facility. Students who had a record of using the facility were compared to similar students who did not have a …

Exploratory Advising Impact Report: Spring 2016 To Spring 2019, Amanda M. Hagman, Mykel Beorchia, Stephanie Hamblin, Mitchell Colver

Publications

Academic advising performs a pivotal contribution to student success by providing information about univeristy expectations and avenues towards graduation. Exploratory student advising has the additional task of supporting students in major selection. This analysis investigated the relationship between academic advising and student persistence for exploratory students to better understand the impact of current advising practices. METHODS: Exploratory academic advisors met with an average 53% of exporatory students each semester. Students with a record of meeting with an academic advisor were compared to similar exploratory students who did not. Students were compared using prediction-based propensity score matching. Students who met with …

Teachers’ Perspectives Of The Observation Process Within The Evaluation, Christine E. Lenhart

Teacher Education, Educational Leadership & Policy ETDs

One of the largest challenges for administrators is to create and implement teacher evaluation systems that help improve teaching and student learning. As policymakers and administrators have worked throughout the United States to develop and implement new teacher evaluation systems, teacher involvement in developing those teacher evaluation systems has been limited. Specifically, the evaluation process and the tools used in a state in the southwestern part of the United States to evaluate teachers do not incorporate teachers’ perspectives, yet they directly impact teacher standing, ability to receive tenure status, and, in some cases, their salary.

The purpose of this research …

University Academic Advising: Impact Analysis, Amanda M. Hagman, Mykel Beorchia, Erik Dickamore

Publications

abstract: Academic advising performs a pivotal contribution to student success by providing information about university expectations and avenues towards graduation. The impact of academic advising is routinely assessed to explore its influence on student persistence. This report explores the impact of academic advising between 2016 to 2019 on student persistence to the next term. METHODS: Academic advising met with nearly 40% of students at USU each semester. Students who had a record of meeting with an academic advisor were compared to similar students who did not. Students were compared using prediction-based propensity score matching. Students who met with an advisor …

Using An Lms In Teaching English: A Qualitative Content Analysis Of Medical Sciences Students’ Evaluations And Suggestions, Iman Alizadeh

The Qualitative Report

In this study, I aimed to discover Iranian medical sciences students’ evaluation of using a Learning Management System (LMS) in teaching English and to collect their suggestions for using the system more efficiently. To collect data, I conducted semi-structured interviews with 38 students. The themes emerging from the qualitative content analysis of the students’ responses were (1) technical advantages (accessibility, and online homework bank), (2) educational gains (learning gains, benefits for professors, and professor-student interaction), (3) logistical benefits (optimizing class time, task management, and logistical support), (4) educational shortcomings (limited instruction, correction and feedback, and academic misconduct), (5) technical limitations …

The Impact Of Pbl As A Stem School Reform Model, Michael R. L. Odell, Teresa J. Kennedy, Eric Stocks

Interdisciplinary Journal of Problem-Based Learning

Project/problem-based learning (PBL) can provide an effective model for school reform when implemented with fidelity. In the report, Rising Above the Gathering Storm, it was recommended that if the U.S. is to remain competitive in the 21st-century economy, there must be a serious effort to “enlarge the pipeline of students who are prepared to enter college and graduate with a degree in STEM” (National Academy of Sciences, National Academy of Engineering, & Institute of Medicine, 2007, p. 6). The report included the recommendation that states develop statewide specialty STEM high schools (National Academy of Sciences, National Academy of Engineering, …

Measuring Media Literacy Inquiry In Higher Education: Innovation In Assessment, Evelien Schilder, Theresa Redmond

Journal of Media Literacy Education

The ability to critically access, analyze, evaluate, and create media messages is crucial in the process of becoming an informed and engaged citizen throughout life. Asking critical questions is not only a valuable dimension of media literacy, but also an indispensable aspect of participating in a democracy. Yet, measuring the effectiveness of media literacy is still a major challenge for the field. It is unclear to what extent people of all ages may engage in critical questioning habits with regards to media. To address this gap, we studied the changes in critical questioning habits for college-aged students enrolled in media …

Examining Information Considered In Texas School Board Superintendent Evaluations: A Modified Replication Study, Audrey Young

Electronic Theses and Dissertations

The purpose of this study was to identify the information, through a modified replicated study, that Texas public school board trustees utilize as part of their evaluation of the district superintendent. This modified replicated study used a survey with ranking and multiple choice. The survey in this study was developed by Dr. Phil Gore for Washington school board members and modified by the researcher for Texas. A convenience sample of 168 school board trustees across the state of Texas was invited to participate in the study

The findings in this study identified the various elements from which schoolboards derive information …

Assessment In The Interpersonal Domain: Experiences From Empathy Assessment In Medical Education, Neville Chiavaroli

2009 - 2019 ACER Research Conferences

Frameworks for the teaching and assessment of 21st-century skills commonly recognise the importance of learning and skill development in the interpersonal domain. They also usually acknowledge the challenge of reliably and validly assessing students in this domain. In the field of medical education and in selecting students for medical courses, the concept of empathy has become central to representing the particular interpersonal understandings and skills expected of students and practising doctors. Attempts to assess these attributes during medical training are just as challenging as in school contexts. This presentation draws on several years’ experience of working with medical educators to …

Values In Evaluations Of Maternal And Child Health Programs, Erica Lynn Dodds

Dissertations

Values are a central component in evaluation and are prominently discussed in evaluation theory, but relatively little is known about how they are used in practice. The theory-practice gap in evaluation may cause unsound evaluation practice or irrelevant or impractical evaluation theory. However, little is known about this gap as it relates to values and valuing. Failing to take certain values into account in an evaluation risks reinforcing the status quo to the detriment of vulnerable populations, so identifying how the theory-practice gap plays out in the use of values is important.

This study focuses on the maternal and child …

An Exploratory Investigation Into The Role Of Evaluation Theory In Evaluative Thinking, Lyssa Wilson Becho

Dissertations

The field of evaluation generally agrees that evaluation theory is important. Evaluation theorists and scholars have written prolifically about the role of evaluation theory in practice. However, the empirical literature associated with how and why evaluation theory is important is still emerging. In particular, how evaluation theory fosters high quality evaluation practice through transparent logical reasoning, attention to values and valuing, and contextual responsiveness, and how these inform evaluative thinking are understudied phenomena in the field.

This study intends to provide insights into the relationship between evaluation theory and evaluation practice to answer two major research questions. The first research …

An Exploration Of Professional Preparedness Of Instructional Designers To Evaluate, Philena V. Devaughn

STEMPS Theses & Dissertations

Formative, summative, and confirmative evaluation of instructional products determine whether learner objectives have been attained and substantiate the value of the instruction. The ability to implement an evaluation plan is classified as an essential skill for instructional designers by the International Board of Standards for Training and Performance Improvement (IBSTPI). Previous research has ascertained that entry-level instructional designers have failed to master the skills required to create evaluation plans.

The purpose of this qualitative study was to examine the professional preparation received by instructional designers, for instruction evaluation, through graduate level programs. The data collected for this study was the …

Meaningful Learner Information For Mooc Instructors Examined Through A Contextualized Evaluation Framework, Kerrie Douglas, Mitch Zielinski, Hillary Merzdorf, Heidi Diefes-Dux, Peter Bermel

Department of Agricultural and Biological Systems Engineering: Faculty Publications

Improving STEM MOOC evaluation requires an understanding of the current state of STEM MOOC evaluation, as perceived by all stakeholders. To this end, we investigated what kinds of information STEM MOOC instructors currently use to evaluate their courses and what kinds of information they feel would be valuable for that purpose. We conducted semi-structured interviews with 14 faculty members from a variety of fields and research institutions who had taught STEM MOOCs on edX, Coursera, or Udacity. Four major themes emerged related to instructors’ desires: (1) to informally assess learners as an instructor might in a traditional classroom, (2) to …

Assessing The Effectiveness Of Computer Science Rpps: The Case Of Cafecs, Erin Henrick, Steven Mcgee, Ronald I. Greenberg, Lucia Dettori, Andrew M. Rasmussen, Don Yanek, Dale F. Reed

Computer Science: Faculty Publications and Other Works

Research Practice Partnerships (RPPs) are a relatively

recent development as a potential strategy to address the

complex challenges in computer science education. Consequently,

there is little guidance available for assessing the effectiveness of

RPPs. This paper describes the formative evaluation approach

used to assess the progress of the first year of the formalized RPP,

Chicago Alliance for Equity in Computer Science (CAFE´CS).

This paper contributes to the RPP literature by providing a case

study of how an RPP effectiveness framework can be adapted

and used to inform partnership improvement efforts in computer

science education.

Report From The Stem 2026 Workshop On Assessment, Evaluation, And Accreditation, Rebecca Bates, Angela Arnold, Cary Komoto, Peggy Brickman, R. Alan Cheville, Elizabeth Longley, Jose Mestre, Mihaela Sabin, James Warnock

Integrated Engineering Department Publications

A gathering of science, technology, engineering, and math (STEM) higher education stakeholders met in November 2018 to consider the relationship between innovation in education and assessment. When we talk about assessment in higher education, it is inextricably linked to both evaluation and accreditation, so all three were considered. The first question we asked was can we build a nation of learners? This starts with considering the student, first and foremost. As educators, this is a foundation of our exploration and makes our values transparent. As educators, how do we know we are having an impact? As members and implementers of …

Report From The Stem 2026 Workshop On Assessment, Evaluation, And Accreditation, Rebecca Bates, Angela Arnold, Cary Komoto, Peggy Brickman, R. Alan Cheville, Elizabeth Longley, Jose Mestre, Mihaela Sabin, James Warnock

Reports

A gathering of science, technology, engineering, and math (STEM) higher education stakeholders met in November 2018 to consider the relationship between innovation in education and assessment. When we talk about assessment in higher education, it is inextricably linked to both evaluation and accreditation, so all three were considered. The first question we asked was can we build a nation of learners? This starts with considering the student, first and foremost. As educators, this is a foundation of our exploration and makes our values transparent. As educators, how do we know we are having an impact? As members and implementers of …

Teachers' Perceptions Of School District Professional Development Alignment With National Standards, Arlene Jean Wacha

Walden Dissertations and Doctoral Studies

Despite ongoing delivery of teacher professional development (PD), educational leaders in the local district did not have an objective evaluation whether their implementation of the Marzano causal teacher evaluation model and the iObservation tool training were aligned with accepted national standards for PD effectiveness. Using Vygotsky's constructivist theory as the theoretical framework, the purpose of this quantitative descriptive, correlational study was to describe teachers' perceptions of the alignment of the district's PD with national standards and the relationship between teachers' reported self-efficacy and attitudes toward the PD program. A purposive sample of 80 middle school teachers completed the Learning Forward's …

Reliability And Validity Of An Evaluation Capacity Assessment Instrument For Principals Of Public Schools In Michigan And The Current Distribution Of Evaluation Capacity By Poverty Concentration, Christine M. Lewis

Wayne State University Dissertations

This study used Confirmatory Factor Analysis (CFA) to investigate the reliability and validity of an Evaluation Capacity Assessment Instrument (ECAI) for principals of K-12 public schools in Michigan. The ECAI was then used to investigate whether scores between principals of high poverty schools and low poverty schools were significantly different. The ECAI was administered to 121 principals across Michigan. Based on the results of the CFA, evidence of fit to the a priori model was not established but internal consistency statistics provide some reliability evidence. A Principle Components Analysis (PCA) was conducted and factor loadings were examined. Some groups of …