Educational Assessment, Evaluation, and Research Commons^™

Gatton Academy Study Abroad Program Effects On Perceptions Of Community Belongingness And Personal Growth And Development, Derick Brandon Strode

Dissertations

This dissertation’s focus is at the intersection of study abroad, impact assessment, and a population of gifted and talented students at a specialized, residential high school called The Gatton Academy. A summative impact evaluation was conducted to assess effects of Gatton Academy study abroad programs on student participants’ perceptions of peer belongingness, mentor belongingness, and personal growth and development, as well as to compare differences among three different program models being employed by the school. The three program models studied included a Non-Credit program, a Faculty-led Field-Study, and a Faculty-led Traditional program. The research was conducted amidst documented calls for …

An Analysis Of Evaluation Practices Of Two Training Programs In The Healthcare Sector Using The New World Kirkpatrick Model, Michelle Woodhouse

Dissertations

The American Customer Satisfaction Index Report in 2015 indicated that service quality in the healthcare sector has declined even though the demand for healthcare service is rising. Companies invest billions of dollars annually to develop and implement customer service training programs; however, although companies evaluate their programs in order to continuously improve customer satisfaction, service quality is still on the decline. This may be because the evaluation process is neither formal nor comprehensive. Although the literature indicates that companies carry out evaluations, little is known about the actual evaluation process that is utilized to evaluate training programs, the levels at …

The Effects Of Consistent Observation And Feedback On Teacher Practice And Motivation To Refine Instruction, Scott I. Nasatir

Dissertations

This evaluation of a pilot program investigates the effects consistent observation and feedback had on teacher practice and motivation to refine instruction. An observation-feedback loop was initiated at a high school in a large Midwestern urban school district where teachers received bi-weekly observations and were provided with instantaneous feedback. Current research has shown that teacher evaluation, if utilized appropriately and with fidelity, can be a strong lever to improve instructional practices. While the advantages are vast, few schools and districts alike are also enacting measures to roll out a companion model that has “coaching” attributes embedded to support educators entrenched …

A Metaevaluation Of The Commission On Fire Accreditation International Accreditation Process, Stacy A. French

Dissertations

Fire and emergency services throughout the country are being required by local governmental authorities to provide efficient and effective services. In 1996, the International City-County Management Association (ICMA) and the International Association of Fire Chief (IAFC) executed a master trust agreement that established the Commission on Fire Accreditation International (CFAI) to award accreditation to those fire and emergency services that demonstrated efficiency and effectiveness in the services provided. As of this study, no documented research had been published that challenged the current CFAI Accreditation process to ensure the highest level of accountability and usefulness for both the public and fire …

Principal Perceptions Of Standards-Based Teacher Evaluation In West Virginia, Brent Douglas Griffith

Theses, Dissertations and Capstones

Standards-based teacher evaluations have become the norm in many states due to an increased focus on student achievement and teacher effectiveness. These evaluations have become integral to the improvement of classroom instruction efforts and the planning of specific professional development for teachers. West Virginia deployed a new standards-based teacher evaluation system in 2014, using the West Virginia Professional Teaching Standards as a basis for measuring teacher performance and growth in certain areas. The new evaluation system also included teacher self-reflection and goal-setting portions. The purpose of this study was to assess the perceptions of school principals as to the effectiveness …

Applications Of Peer Assessment And Self-Assessment In Music, Christopher Valle, Heidi Andrade, Maria Palma, Joanna Hefferen

Educational & Counseling Psychology Faculty Scholarship

Feedback is crucial to students’ growth as musicians. Fortunately, the teacher is not the sole source of feedback in the music classroom. Under the right conditions, students can provide actionable feedback to themselves and each other. This article showcases the work of three elementary music specialists who have innovatively incorporated formative peer assessment and self-assessment in their music lessons to promote student learning and self-direction.

Data-Based Decision Making In School Counseling: Utilizing Multiple Single-Case Indicators To Evaluate Interventions, Ryan J. Mcgill, Kelly S. Kennedy, Randy T. Busse

Education Faculty Articles and Research

As the field of professional school counseling continues to move toward a data-based decision making model of service delivery, there is a need for dissemination of best practice methods for evaluating whether school-based counseling interventions are effective. In that vein, the purpose of this article is to review several methods of data-based decision making within a single-case outcome evaluation model, as well as their potential applications for school counseling interventions. To aid practitioners, the potential use of these methods is demonstrated in a case example and accompanying graphic displays.

Nsu Early Literacy And Reading Education Curriculum 2016, Nova Southeastern University

Abraham S. Fischler College of Education and School of Criminal Justice College Archive

No abstract provided.

The Impact Of Classroom Observations And Collaborative Feedback On Evaluation Of Teacher Performance, Based On The Danielson Framework For Teaching, Christine L. Hofer

Wayne State University Dissertations

ABSTRACT

THE IMPACT OF CLASSROOM OBSERVATIONS AND COLLABORATIVE FEEDBACK ON EVALUATION OF TEACHER PERFORMANCE, BASED ON THE DANIELSON FRAMEWORK FOR TEACHING

by

CHRISTINE L. HOFER

December 2016

Advisor: Dr. Thomas Edwards

Major: Education

Degree: Doctor of Philosophy

Teacher evaluation systems in Michigan are undergoing major reforms driven by recent legislation at both the federal and state levels. Multiple teacher observations, as well as student achievement data, are now required to be a major indicator of teacher effectiveness for evaluative purposes. The reformed system is high-stakes, as employment decisions such as layoffs and termination rest squarely on evaluation results. Implementation has …

Use Of Youth Program Quality Assessment (Ypqa) As A Method Of Process Evaluation: Maximizing Limited Resources Of Nonprofit Organizations, Young Im

Master's Theses

Past literature shows the progression of different phases of evaluation practice in nonprofit organizations. Pressure of outcome or impact evaluation started the beginning of the 21st century. The attempt to manage the weight of conducting outcome evaluation has raised many complications, inhibiting the nonprofit organization’s ability to learn and understand the proper role of evaluation and what it can provide to assist in improving programs. It, therefore, has led to a gap in which nonprofits miss what happens during implementation, a crucial part of process evaluation. Among nonprofit organizations in the areas of youth development and after-school programs, various types …

An Internal Evaluation Of A Health Program For Adults With Mild, Moderate, And Severe Intellectual Disabilities, Shelley C. Sellwood-Davis

Theses and Dissertations--Educational Policy Studies and Evaluation

Adults with intellectual disabilities are not only more likely to be obese, but they are also more prone to medical complications, including diabetes, cardiovascular disease, thyroid disorder and osteoporosis. Therefore, health programs targeting this population are becoming more frequent in nature, and learning what makes such programs effective will be important in serving this population. A health program for adults between the ages of eighteen and forty with mild, moderate, and severe intellectual disabilities was evaluated in order to learn how the individual health program could be improved and in what ways the program itself could serve as a model …

Nsu Elementary Education Curriculum 2016, Nova Southeastern University

Abraham S. Fischler College of Education and School of Criminal Justice College Archive

No abstract provided.

Guage Impact With Five Levels Of Data, Thomas R. Guskey

Educational, School, and Counseling Psychology Faculty Publications

Effective professional learning evaluation requires consideration of five critical stages or levels of information (Guskey, 2000a, 2002a, 2005). These five levels represent an adaptation of an evaluation model developed by Kirkpatrick (1959, 1998) for judging the value of supervisory training programs in business and industry. The five levels in this model are hierarchically arranged, from simple to more complex. With each succeeding level, the process of gathering evaluation data requires more time and resources. And because each level builds on those that come before, success at one level is usually necessary for success at higher levels.

Best Practices For Controlling Tuberculosis - Training In Correctional Facilities: A Mixed Methods Evaluation, Ellen Reynolds Murray

Walden Dissertations and Doctoral Studies

According to the literature, identifying and treating tuberculosis (TB) in correctional facilities have been problematic for the inmates and also for the communities into which inmates are released. The importance of training those who can identify this disease early into incarceration is vital to halt the transmission. Although some training has been done by public health authorities for corrections, there is little to no evaluation of such training. The aim of this mixed methods retrospective study was to evaluate the effectiveness of a training to control TB in correctional facilities. The Southeastern National Tuberculosis Center (SNTC) conducted 12 trainings between …

Teachers' Perceptions Of The Use Of Small-Group Tutorial, Karen Y. Johnson

Walden Dissertations and Doctoral Studies

This study addressed the implementation of the tutorial program currently in use at an urban school district in Mississippi. Because successful completion of assessments is a graduation requirement, the study site implemented the tutorial program to help at-risk students improve their academic outcomes on state-mandated assessments in Biology I, United States History, English II, Algebra I. The purpose of this study, guided by Bloom's theory of mastery learning, was to examine the perceptions of the teachers who served as tutors in the program. Using the narrative inquiry method, the research focused on the implementation of the tutorial program, the perceived …

A Program Evaluation Of The Comprehensive School Reform Model Making Middle Grades Work, Wycondia West

Walden Dissertations and Doctoral Studies

A Program Evaluation of the Comprehensive School Reform Model Making Middle Grades Work

by

Wycondia S. West

MA, Spring Hill College, 2002

BS, Spring Hill College, 1998

Doctoral Study Submitted in Partial Fulfillment

of the Requirements for the Degree of

Doctor of Education

Walden University

August 2016

There is increasing concern in the United States about the academic challenges that middle grade students face. Middle schools are not meeting accountability standards, and as a result students are not being adequately prepared for high school. In response to these concerns, a state in the southeastern United States adopted a comprehensive school …

Evaluation Of The Bridging Course Offered At A University To Foreign Students: Batches Of 2012 And 2013, Beatriz Eugenia Orantes Perez, Djemari Mardapi

REID (Research and Evaluation in Education)

This evaluation was a case study of the bridging language program offered at YSU to KNB students, it evaluated the generations 2012/2013. The focus of this evaluation was to evaluate the strengths and weaknesses of the bridging program. This was a summative evaluation used the CIPP method. It was a pragmatic parallel mix-method design research. The analysis technique was descriptive for the qualitative data; and it was descriptive statistical for the quantitative data; Triangulation was used. 15 students, 6 teachers, 10 tutors, 3 administrators were involved. In each component of the evaluation strengths and weaknesses were found. The main strengths …

Improving Evaluation In Nonprofit Organizations: A Study Of How Evaluation Requests For Proposals Are Developed, Responded To, And Fulfilled, Nakia S. Matthews

Dissertations

It is often necessary for nonprofit organizations (NPOs) to formulate a Request for Proposal (RFP) to procure essential contracted services. This is most common when seeking the services of an external evaluator. Since most NPOs do not have internal evaluation staff, developing an appropriate RFP can be quite challenging. With limited literature and resources to guide NPOs on how to prepare RFPs, the process for procuring qualified evaluators can be even more daunting. This lack of resources and supports can lead to insufficient or incomplete RFPs, subsequently narrowing the pool of qualified potential bidders and reducing the extent to which …

Assessing General Capabilities, Julian Fraillon, Juliette Mendelovits

2009 - 2019 ACER Research Conferences

There is growing interest in general capabilities and cross-curricular learning outcomes such as literacy in information and communication technologies, creative thinking and collaborative and individual problem-solving. As the expectation for such competencies to be taught in schools has increased, so has the need for teachers and schools to validly and reliably assess student learning in those areas, and to report on them in ways that teaching and learning. In this presentation examine the challenges of assessing on student learning and learning growth capabilities and cross-curricular learning present approaches used in research some of these challenges and reflect can be applied …

Assessment Standards, ‘Intentional Alignment’, And Dialogic Inquiry, Claire Wyatt-Smith

2009 - 2019 ACER Research Conferences

Internationally, the policy move towards standards-aligned instruction is gaining momentum. In Australia, standards have assumed unprecedented prominence in education policy relating both to classroom practice and to teacher preparation and career progression. The move is also evident in the United States, where the lure of standards to inform improvement is clear: significant investment has been committed to longitudinal research to examine at state and district levels the desirable conditions for implementing standards, their impact on developing college- and career-ready teachers, and in turn, the impact on teacher instruction and student outcomes. Moves such as this are occurring in the absence …

Collaborative Problem-Solving: Assessment And Reporting, Patrick Griffin

2009 - 2019 ACER Research Conferences

This practical session will present a live administration of interactive collaborative problem-solving assessment and reporting. The presenter will demonstrate example tasks and reports. Audience representatives will have the opportunity to role-play as students being assessed across a range of social and cognitive skills associated with collaborative problem-solving. The discussion will then explore how these social and cognitive skills can be incorporated into the teaching program, enabling higher-order skills to be assessed in key learning areas across the curriculum.

The Danielson Model Of Teacher Evaluation: Exploring Teacher Perceptions Concerning Its Value In Shaping And Improving Instructional Practice, Jonathan Tyler Moss

Seton Hall University Dissertations and Theses (ETDs)

Since the publication of A Nation at Risk in 1983, the school reform movement has offered many contrasting ideas and initiatives to make our nation’s schools more effective and globally competitive. Today’s educational leaders are faced with an array of complex demands as they are challenged at the state and federal level to improve teacher practices and learning outcomes within their schools. One of those demands for New Jersey administrators was to implement a teacher evaluation program that improves teaching and learning during the 2013-2014 school year. Mielke and Frontier (2012) believe that meaningful teacher evaluation has the potential …

Achievement Gaps - The Continuing Challenge, Geoff N. Masters Ao

Teacher columnist – Geoff Masters

Professor Geoff Masters AO discusses the challenges of closing achievement gaps.

How Can We Accurately Measure Whether Students Are Gaining Relevant Outcomes In Higher Education?, Tatiana Melguizo, Gema Zamarro, Tatiana Velasco, Fabio Sanchez

Education Reform Faculty and Graduate Students Publications

The main objective of this study is to empirically test a number of theory-based models (i.e. fixed effects (FE), random effects (RE), and aggregated residuals (AR)) to measure both, the generic knowledge as well as the degree attainment rates and early labor outcomes, gained by students in different programs and institutions in higher education. There are four main findings: First, the results of the paper confirm the need of using models that address the issue of student selection into programs and institutions in order to avoid biased estimates. Second, our findings provide suggestive evidence in favor of using FE models. …

Service Learning And Assessment: A Brief Overview, Katherine Paschetto

Assessment & Accountability in Student Affairs & Higher Education (CNS 610)

No abstract provided.

Evaluation Of Weeks 1-3, Judith Longfield

Teaching Academy

Rate the first three weeks of the Academy by writing a BRIEF response to the following statements.

Week One Evaluation, Judith Longfield

Teaching Academy

Help me make the Academy a good learning experience for you by rating today’s session. Please write a BRIEF response to the following statements.

Evaluating Colleges And Universities: A New Model For Institutional Rankings, Lucien Robert Costley

Seton Hall University Dissertations and Theses (ETDs)

Abstract

Most colleges and universities function independently and lack the wherewithal of measuring performance areas of effectiveness, efficiency or quality. The United States Department of Education maintain a number of subsidiary organizations and external sources that provide public statistical data for analysis, yet an institutional performance output measure has not been defined, created, nor developed. At best, university rankings (from sources such as US News and World Report) have been the main source of institutional performance for decades despite researchers’ attempts to address gaps within the higher education field. These sources remain limited within their methodology and may not truly …

Plunging Beneath The Surface: Uncovering Internal Dispositions, Lori Piowlski, Karen Colum

Elementary and Literacy Education Department Publications

Teacher preparation programs face the challenge of measuring candidates’ competencies that can be considered internal dispositions; which impact the quality of their instruction. This study delves into candidate edTPA scores in correlation with their IDI mindsets to support program development.

Illinois Teacher Evaluation Student Growth Component: A Predecision-Making Policy Analysis, Joshua Robert Olsen

Theses and Dissertations

ILLINOIS TEACHER EVALUATION STUDENT GROWTH COMPONENT:

A PREDECISION-MAKING POLICY ANALYSIS

Joshua R. Olsen

122 Pages May 2015

Public school districts in Illinois are going to face massive changes to their evaluation systems in the coming years. Thanks to the adoption of the Performance Evaluation Reform Act of 2010 and Senate Bill 7 of 2011, teacher evaluation must contain student growth as a significant factor, beginning with the 2016-2017 school year. Not only must student performance on tests become part of the evaluation of teachers, but, moreover, teacher evaluation will play a greater role in the hiring, retention, and release of …