Educational Assessment, Evaluation, and Research Commons^™

Health Education Projects In Portuguese Schools: A Multicases Study, Hugo Oliveira, Jorge Bonito

ASEAN Journal of Community Engagement

Health education projects (HEP) incorporate all the educational projects of the Portuguese elementary and secondary schools in order to respond to four key areas: mental health and violence prevention; food education and physical activity; addictive behaviors and dependencies; and affection and sexuality education. This study aimed at identifying the effects of HEP as they are perceived by teachers and students. A multicase study was developed in five schools in the municipality of Castelo Branco, Portugal. The sample consisted of a HEP coordinating teacher and one student from each case. The content analysis of each HEP was performed and semi-structured interviews …

Rancho Cielo Value Added Program Evaluation, Yacin Cardenas Alfaro

Capstone Projects and Master's Theses

Rancho Cielo Youth Campus is a 501 (c) (3) non-profit organization located in Salinas CA. The agency serves underserved and disconnected youth that have dropped out of school, are on probation, or under truancy regulations in Monterey County. The problem this capstone addressed is that the recidivism rate for at-risk youth is too high. Rancho Cielo’s Value-added program seeks to alleviate this problem by training youth in agriculture technology as a way to connect them with careers in the sector. The capstone project consisted of a program evaluation that documented the program implementation and the creation of a program logic …

Encouraging Healthy Eating Among Older Adults Using The Transtheoretical Model: An Evaluation Of A Pilot Intervention, Lauren Brinkman Roberson

Theses and Dissertations--Communication

Older adults, defined as those age 60 and above, are at an increased risk for many health-related complications that are directly related to nutrition (Centers for Disease Control and Prevention, 2015). This study highlights the lack of nutrition education material developed for older adults in Kentucky. Such material has great potential to influence the health of older adults (Chernoff, 2001). This study evaluated an intervention developed, by means of formative research, to teach older adults nutrition basics. Both direct and indirect measures related to stages of change for healthy eating behaviors were collected six weeks pre-intervention and then immediately post-intervention. …

Using An Lms In Teaching English: A Qualitative Content Analysis Of Medical Sciences Students’ Evaluations And Suggestions, Iman Alizadeh

The Qualitative Report

In this study, I aimed to discover Iranian medical sciences students’ evaluation of using a Learning Management System (LMS) in teaching English and to collect their suggestions for using the system more efficiently. To collect data, I conducted semi-structured interviews with 38 students. The themes emerging from the qualitative content analysis of the students’ responses were (1) technical advantages (accessibility, and online homework bank), (2) educational gains (learning gains, benefits for professors, and professor-student interaction), (3) logistical benefits (optimizing class time, task management, and logistical support), (4) educational shortcomings (limited instruction, correction and feedback, and academic misconduct), (5) technical limitations …

The Impact Of Pbl As A Stem School Reform Model, Michael R. L. Odell, Teresa J. Kennedy, Eric Stocks

Interdisciplinary Journal of Problem-Based Learning

Project/problem-based learning (PBL) can provide an effective model for school reform when implemented with fidelity. In the report, Rising Above the Gathering Storm, it was recommended that if the U.S. is to remain competitive in the 21st-century economy, there must be a serious effort to “enlarge the pipeline of students who are prepared to enter college and graduate with a degree in STEM” (National Academy of Sciences, National Academy of Engineering, & Institute of Medicine, 2007, p. 6). The report included the recommendation that states develop statewide specialty STEM high schools (National Academy of Sciences, National Academy of Engineering, …

Measuring Media Literacy Inquiry In Higher Education: Innovation In Assessment, Evelien Schilder, Theresa Redmond

Journal of Media Literacy Education

The ability to critically access, analyze, evaluate, and create media messages is crucial in the process of becoming an informed and engaged citizen throughout life. Asking critical questions is not only a valuable dimension of media literacy, but also an indispensable aspect of participating in a democracy. Yet, measuring the effectiveness of media literacy is still a major challenge for the field. It is unclear to what extent people of all ages may engage in critical questioning habits with regards to media. To address this gap, we studied the changes in critical questioning habits for college-aged students enrolled in media …

Assessment In The Interpersonal Domain: Experiences From Empathy Assessment In Medical Education, Neville Chiavaroli

2009 - 2019 ACER Research Conferences

Frameworks for the teaching and assessment of 21st-century skills commonly recognise the importance of learning and skill development in the interpersonal domain. They also usually acknowledge the challenge of reliably and validly assessing students in this domain. In the field of medical education and in selecting students for medical courses, the concept of empathy has become central to representing the particular interpersonal understandings and skills expected of students and practising doctors. Attempts to assess these attributes during medical training are just as challenging as in school contexts. This presentation draws on several years’ experience of working with medical educators to …

An Exploration Of Professional Preparedness Of Instructional Designers To Evaluate, Philena V. Devaughn

STEMPS Theses & Dissertations

Formative, summative, and confirmative evaluation of instructional products determine whether learner objectives have been attained and substantiate the value of the instruction. The ability to implement an evaluation plan is classified as an essential skill for instructional designers by the International Board of Standards for Training and Performance Improvement (IBSTPI). Previous research has ascertained that entry-level instructional designers have failed to master the skills required to create evaluation plans.

The purpose of this qualitative study was to examine the professional preparation received by instructional designers, for instruction evaluation, through graduate level programs. The data collected for this study was the …

Meaningful Learner Information For Mooc Instructors Examined Through A Contextualized Evaluation Framework, Kerrie Douglas, Mitch Zielinski, Hillary Merzdorf, Heidi Diefes-Dux, Peter Bermel

Department of Agricultural and Biological Systems Engineering: Faculty Publications

Improving STEM MOOC evaluation requires an understanding of the current state of STEM MOOC evaluation, as perceived by all stakeholders. To this end, we investigated what kinds of information STEM MOOC instructors currently use to evaluate their courses and what kinds of information they feel would be valuable for that purpose. We conducted semi-structured interviews with 14 faculty members from a variety of fields and research institutions who had taught STEM MOOCs on edX, Coursera, or Udacity. Four major themes emerged related to instructors’ desires: (1) to informally assess learners as an instructor might in a traditional classroom, (2) to …

Assessing The Effectiveness Of Computer Science Rpps: The Case Of Cafecs, Erin Henrick, Steven Mcgee, Ronald I. Greenberg, Lucia Dettori, Andrew M. Rasmussen, Don Yanek, Dale F. Reed

Computer Science: Faculty Publications and Other Works

Research Practice Partnerships (RPPs) are a relatively

recent development as a potential strategy to address the

complex challenges in computer science education. Consequently,

there is little guidance available for assessing the effectiveness of

RPPs. This paper describes the formative evaluation approach

used to assess the progress of the first year of the formalized RPP,

Chicago Alliance for Equity in Computer Science (CAFE´CS).

This paper contributes to the RPP literature by providing a case

study of how an RPP effectiveness framework can be adapted

and used to inform partnership improvement efforts in computer

science education.

Report From The Stem 2026 Workshop On Assessment, Evaluation, And Accreditation, Rebecca Bates, Angela Arnold, Cary Komoto, Peggy Brickman, R. Alan Cheville, Elizabeth Longley, Jose Mestre, Mihaela Sabin, James Warnock

Integrated Engineering Department Publications

A gathering of science, technology, engineering, and math (STEM) higher education stakeholders met in November 2018 to consider the relationship between innovation in education and assessment. When we talk about assessment in higher education, it is inextricably linked to both evaluation and accreditation, so all three were considered. The first question we asked was can we build a nation of learners? This starts with considering the student, first and foremost. As educators, this is a foundation of our exploration and makes our values transparent. As educators, how do we know we are having an impact? As members and implementers of …

Report From The Stem 2026 Workshop On Assessment, Evaluation, And Accreditation, Rebecca Bates, Angela Arnold, Cary Komoto, Peggy Brickman, R. Alan Cheville, Elizabeth Longley, Jose Mestre, Mihaela Sabin, James Warnock

Reports

A gathering of science, technology, engineering, and math (STEM) higher education stakeholders met in November 2018 to consider the relationship between innovation in education and assessment. When we talk about assessment in higher education, it is inextricably linked to both evaluation and accreditation, so all three were considered. The first question we asked was can we build a nation of learners? This starts with considering the student, first and foremost. As educators, this is a foundation of our exploration and makes our values transparent. As educators, how do we know we are having an impact? As members and implementers of …

Teachers' Perceptions Of School District Professional Development Alignment With National Standards, Arlene Jean Wacha

Walden Dissertations and Doctoral Studies

Despite ongoing delivery of teacher professional development (PD), educational leaders in the local district did not have an objective evaluation whether their implementation of the Marzano causal teacher evaluation model and the iObservation tool training were aligned with accepted national standards for PD effectiveness. Using Vygotsky's constructivist theory as the theoretical framework, the purpose of this quantitative descriptive, correlational study was to describe teachers' perceptions of the alignment of the district's PD with national standards and the relationship between teachers' reported self-efficacy and attitudes toward the PD program. A purposive sample of 80 middle school teachers completed the Learning Forward's …

An Evaluation Of Islamic Moral Teaching For Students Of Madrasah Aliyah Negeri (Man), Siti Amanah, Haryanto Haryanto

REID (Research and Evaluation in Education)

This research is aimed at evaluating: the preparation, implementation, and outcome of the moral teaching program using Stake Countenance evaluation model (antecedent, implementation, and outcome). The study was conducted at Madrasah Aliyah Negeri (MAN) Cilacap, MAN Kroya, and MAN Majenang. The subjects were the principals, teachers of Aqidah Akhlak, chairpersons of the Madrasah Committee, and 276 grade XII students. Interview, observation, questionnaire, and documentation were used as data collection techniques. The data analysis method used was the quantitative-qualitative descriptive analysis. The result of the evaluation shows that: (1) the preparation of the moral teaching is in 'good' category; (2) …

Developing An Instrument Of National Examination Of Equivalency Education Package C Of Mathematics Subject, Ian Harum Prasasti, Edi Istiyono

REID (Research and Evaluation in Education)

The national examination of equivalency education is a competency test to equalize non-formal education with formal education. Departing from the importance of the quality and expectations of the national examination of equivalency education package C mathematics subjects and because the results are inseparable from the implementation process, developing an evaluation instrument to assess the implementation of the national examination of equivalency education package C mathematics subjects is important. The purpose of this study is to develop a suitable instrument for conducting an evaluation of the national examination implementation of the equivalency education package C mathematics subject. The respondents in this …

Teacher And Administrator Perceptions Of The Teacher Excellence And Support System (Tess) In Arkansas, Allison Louise Byford

Graduate Theses and Dissertations

The purpose of this study was to investigate differences in Arkansas teachers’ and building-level administrators’ perceptions regarding the purpose of the Arkansas TESS teacher evaluation system, whether TESS authentically assesses teacher effectiveness, how teacher evaluation data are used, and how the TESS process supports learner-centered professional development. Additionally, the relationship of teacher and administrator demographics on their perceptions of TESS was explored. The results of this study highlight the differences in perceptions in all areas questioned along with misalignment in perceptions among teachers. Overall, the study points toward the need for clear communication and the cultivation of relationships among building …

An Elementary Perspective Of The Value-Added Model, Pat Mccoy

Walden Dissertations and Doctoral Studies

In a small, rural school district in the southeastern United States, elementary school teachers were receiving positive evaluation ratings while student proficiency on state assessments was below the state average. Due to changes in federal and state laws, school personnel evaluate methods have undergone significant reform. The purpose of this study was to answer the guiding research questions of teachers and administrators perceptions toward the value-added model (VAM) of evaluation and how those perceptions affect teacher performance. Taylor's scientific management theory, which suggests examining human productivity through the lens of applied science served as the conceptual framework. Data were collected …

Effects Of Collaborative Teaching Evaluation Process On Teacher/Administrator Collegiality, Gary A. Storts Jr.

Cal Poly Humboldt theses and projects

The job of the professional educator is becoming ever more complex. Research has shown that effective teacher evaluation processes and collegial relationships between the teacher and the principal both positively impact student achievement. This study investigates how a collaborative teacher evaluation process effects collegiality between the teacher and the site administrator. Four teachers who had experienced both traditional and collaborative reviews in a small rural school district in Northern California were interviewed to assess the impact that a collaborative evaluation had on their professional relationship with their principal.

The results of this research confirmed that teaching evaluations, however they are …

Utilizing A Learning Management System To Support Access To Study Abroad: A Program Evaluation At The University Of Denver, Christopher Chaves E Silva

Higher Education: Doctoral Research Projects

This doctoral research project investigated issues of access to study abroad at the University of Denver (DU). The study evaluated the use of the learning management system Canvas during Fall 2017, in preparation for student applications for study abroad during Fall 2018. The evaluation utilized qualitative data from focus groups with students and families, interviews with higher education professionals and analytics data on the usage of Canvas. The findings identified that the usage of Canvas during Fall 2017 was low in comparison to the number of individuals who applied to study abroad and was focused on the preparation for the …

Action Research: Teacher Evaluation And Reflection, Courtney Lynne Landry

Educational Leadership and Policy Studies: Doctoral Research Projects

The purpose of this qualitative action research study was to create an improved learning log procedure, based on the theory of action that the use of professional learning logs will improve self-reflection, which will increase teacher self-efficacy. Data collected through interviews, focus groups, and a research action committee have led to the assertions that (a) reflection is a necessary and welcomed part of being a professional; (b) procedures for reflection must be easily accessed and consistent; (c) teachers should have autonomy over their choice of reflection method to gain meaning; (d) though the learning log process allows for autonomy, the …

What Impacts Do Oer Have On Students? Students Share Their Experiences With A Health Psychology Oer At New York City College Of Technology, Cailean Cooney

Publications and Research

This article reports findings from a study conducted with students in three sections of a Health Psychology course that replaced a traditional textbook with open educational resources (OER) as the primary course material. The purpose of the study was to learn how OER impacted students. Data were collected in Fall 2015 with students from New York City College of Technology (City Tech), of the City University of New York (CUNY), a comprehensive college located in Brooklyn. Students were assigned the OER by their course instructor, who developed it as part of a library funded OER pilot initiative. Two research instruments …

Formative Evaluation Of Byu Internship Course Syllabi, Shiloh Marie Howland

Instructional Psychology and Technology Graduate Student Projects

ABSTRACT

Annually, approximately 4,000 undergraduate and graduate students participate in the 133 academic internship courses offered at BYU. Each course is required to comply with the university Internship Policy. The university Internship Policy provides guidelines of how internship courses operate, responsibilities of the intern, site supervisor, and faculty advisor, and how students earn academic credit for internships. Compliance with these guidelines is supposed to be monitored by the Internship Office; however, due to personnel and time constraints, the degree to which the courses comply with that policy had not been studied prior to this evaluation. This project evaluated the syllabi …

Secondary Teachers' Perceptions Of The Effectiveness Of A Professional Learning Community, Catina Shontelle Stewart

Walden Dissertations and Doctoral Studies

The implementation of professional learning communities (PLCs) in schools has been shown to serve as a catalyst in transforming school culture and increasing the academic performance of students. Our school district mandated that PLCs were established at the research site, an urban Louisiana school, for the primary purpose of closing the achievement gap. Yet, recent data from the local district indicate that these PLCs have not resulted in capacity building for sustainable improvement. Ineffective implementation of the current PLCs may have contributed to the poor outcomes. One purpose of this qualitative case study was to examine teachers' perceptions of the …

A Formative Evaluation Of A Program Providing Support To College Students With Autism Spectrum Disorder, Kourtney Kay Bakalyar

Dissertations

Young adults with autism spectrum disorder (ASD) are attending institutions of higher education more than ever before (Smith, 2007). All college students with disabilities have the right to accommodations under the American with Disabilities Act Amendments Act of 2008 (ADAAA; P.L. 110-325); however, these accommodations frequently do not address barriers that prevent students with ASD from successfully completing their academic programs. The Autism Services Center at a public, four-year university provides services to its college students with ASD to address difficulties with communication and social skills, unique emotional and behavior characteristics, insufficient executive function, and difficulties with independent living skills. …

The Relationship Between Instructional Strategies And Teacher Evaluation In Michigan Public Schools, Stephen D. Laatsch

Master's Theses and Doctoral Dissertations

The purpose of this quantitative study was to determine whether teachers altered instructional strategies based on their local school district’s teacher evaluation framework. Further, if changes were made to their use of instructional strategies, specific factors that influenced the changes were explored. This information is important because school districts across Michigan spend time, energy, and money for new teacher evaluation frameworks. Thus, it is essential to know if these frameworks change the use of instructional strategies in the classroom.

Teachers in 10 southeastern Michigan public school districts were surveyed to determine use of research-based instructional strategies before and after the …

Gatton Academy Study Abroad Program Effects On Perceptions Of Community Belongingness And Personal Growth And Development, Derick Brandon Strode

Dissertations

This dissertation’s focus is at the intersection of study abroad, impact assessment, and a population of gifted and talented students at a specialized, residential high school called The Gatton Academy. A summative impact evaluation was conducted to assess effects of Gatton Academy study abroad programs on student participants’ perceptions of peer belongingness, mentor belongingness, and personal growth and development, as well as to compare differences among three different program models being employed by the school. The three program models studied included a Non-Credit program, a Faculty-led Field-Study, and a Faculty-led Traditional program. The research was conducted amidst documented calls for …

A Metaevaluation Of The Commission On Fire Accreditation International Accreditation Process, Stacy A. French

Dissertations

Fire and emergency services throughout the country are being required by local governmental authorities to provide efficient and effective services. In 1996, the International City-County Management Association (ICMA) and the International Association of Fire Chief (IAFC) executed a master trust agreement that established the Commission on Fire Accreditation International (CFAI) to award accreditation to those fire and emergency services that demonstrated efficiency and effectiveness in the services provided. As of this study, no documented research had been published that challenged the current CFAI Accreditation process to ensure the highest level of accountability and usefulness for both the public and fire …

Principal Perceptions Of Standards-Based Teacher Evaluation In West Virginia, Brent Douglas Griffith

Theses, Dissertations and Capstones

Standards-based teacher evaluations have become the norm in many states due to an increased focus on student achievement and teacher effectiveness. These evaluations have become integral to the improvement of classroom instruction efforts and the planning of specific professional development for teachers. West Virginia deployed a new standards-based teacher evaluation system in 2014, using the West Virginia Professional Teaching Standards as a basis for measuring teacher performance and growth in certain areas. The new evaluation system also included teacher self-reflection and goal-setting portions. The purpose of this study was to assess the perceptions of school principals as to the effectiveness …

An Internal Evaluation Of A Health Program For Adults With Mild, Moderate, And Severe Intellectual Disabilities, Shelley C. Sellwood-Davis

Theses and Dissertations--Educational Policy Studies and Evaluation

Adults with intellectual disabilities are not only more likely to be obese, but they are also more prone to medical complications, including diabetes, cardiovascular disease, thyroid disorder and osteoporosis. Therefore, health programs targeting this population are becoming more frequent in nature, and learning what makes such programs effective will be important in serving this population. A health program for adults between the ages of eighteen and forty with mild, moderate, and severe intellectual disabilities was evaluated in order to learn how the individual health program could be improved and in what ways the program itself could serve as a model …

A Program Evaluation Of The Comprehensive School Reform Model Making Middle Grades Work, Wycondia West

Walden Dissertations and Doctoral Studies

A Program Evaluation of the Comprehensive School Reform Model Making Middle Grades Work

by

Wycondia S. West

MA, Spring Hill College, 2002

BS, Spring Hill College, 1998

Doctoral Study Submitted in Partial Fulfillment

of the Requirements for the Degree of

Doctor of Education

Walden University

August 2016

There is increasing concern in the United States about the academic challenges that middle grade students face. Middle schools are not meeting accountability standards, and as a result students are not being adequately prepared for high school. In response to these concerns, a state in the southeastern United States adopted a comprehensive school …