Educational Assessment, Evaluation, and Research Commons^™

Administrative Evaluations Of Teachers In Tested And Non-Tested Subjects., Natasha Lanham

Electronic Theses and Dissertations

The teacher evaluation process seeks to help teachers grow and thrive, and as a result, affect student achievement. Administrators evaluate teachers from different subjects, grade levels, and experience levels. This qualitative study examined the perception of feedback given through the cooperating school district’s evaluation system from both the teacher and the principal viewpoint in order to explore their perceptions of the quality and quantity of feedback given during the evaluation process. Participants were arts teachers, tested subject teachers, and their evaluating administrators from a suburban school district in Kentucky. The analysis revealed that generic evaluations do not differentiate for teachers …

Iea International Civic And Citizenship Education Study 2022: Assessment Framework, Wolfram Schulz, Julian Fraillon, Bruno Losito, Gabriella Agrusti, John Ainley, Valeria Damiani, Tim Friedman

Civics and Citizenship Assessment

The International Civic and Citizenship Education Study (ICCS) investigates the preparation of young people to undertake their roles as citizens. It gathers and analyzes data from representative national samples on students’ conceptual knowledge and understanding of civics and citizenship, as well as their attitudes to, and engagement with, aspects of civics and citizenship. ICCS builds on a succession of IEA studies in this field dating back to 1971, and especially since 2009. The 2022 study has been developed to build on previous perspectives on, and monitor changes in, such enduring issues as: levels of civic knowledge and understanding; patterns of …

Administrator Feedback To Teachers, Regina Frazier, Candace Wilkerson, Jacquie Cioffi, Patrick Simmons, Makeba Lindsay D'Abreu, Thea Racelis, Amanda Simmons, Melissa Yancey, Deanna Fierro, David B. Naff

MERC Publications

This brief from the Metropolitan Educational Research Consortium (MERC) curates peer-reviewed scholarship as well as state and school board policies in Virginia related to administrator feedback to teachers. It explores the following questions: 1) What is the purpose of administrators providing feedback to teachers? 2) How do administrators typically provide feedback to teachers? 3) How do teachers typically receive feedback from administrators? 4) What are research-based strategies for administrators to provide productive feedback to teachers? It concludes with key takeaways and recommendations for how administrators provide feedback to teachers.

Evaluators' Perceptions On The Quality Of Training For Conducting Classroom Observations, Mark Williams

Walden Dissertations and Doctoral Studies

AbstractThere is a problem in the state of Michigan’s evaluation system regarding the training received by those conducting classroom teacher observations. A performance gap between teachers and students and provides training solutions for classroom observers was identified. The purpose of this basic qualitative study was to explore the perceptions of school administrators regarding their preparedness and ability to conduct effective observations of teachers. Social cognitive theory and its six constructs was the conceptual framework used for this research study. Research questions addressed the perceptions of school administrators about the training they have received and their need for additional training. A …

Evaluators' Perceptions On The Quality Of Training For Conducting Classroom Observations, Mark Williams

Walden Dissertations and Doctoral Studies

AbstractThere is a problem in the state of Michigan’s evaluation system regarding the training received by those conducting classroom teacher observations. A performance gap between teachers and students and provides training solutions for classroom observers was identified. The purpose of this basic qualitative study was to explore the perceptions of school administrators regarding their preparedness and ability to conduct effective observations of teachers. Social cognitive theory and its six constructs was the conceptual framework used for this research study. Research questions addressed the perceptions of school administrators about the training they have received and their need for additional training. A …

The Effects Of Early Identification And Intervention On Reading Scores At The Kindergarten Level, Cara Milby

Murray State Theses and Dissertations

Research indicates that reading fluently is the key to success: academically, economically, socially, as well as to a healthier lifestyle (Forrest, 2018; Wanzek et al., 2018). While research has shown that Response to Intervention (RTI) is a positive instructional program that will increase primary students’ academic abilities at grades 1 and 2 (Richards et al., 2007), there is a need for more research regarding RTI with kindergarten students. This quasi-experimental quantitative research study examined if early identification and intensive intervention through the addition of Response to Intervention (RTI) at the kindergarten level will lead to increased reading scores and better …

An Evaluation Of The Implementation Of Study-From-Home Policy In Senior High School During Covid-19 Pandemic, Junus Simangunsong, Hastuti Mustikaningsih

REID (Research and Evaluation in Education)

The increase in Coronavirus Disease-19 in Indonesia has prompted the central and regional governments to issue a study-from-home (SFH) policy through the Minister of Education and Culture Circular Letter Number 4 of 2020. The policy aims to reduce activities in schools but uses a meaningful curriculum. The purpose of the evaluation is to see the SFH policy implementation related to teaching and learning activities. The collection of information and data, interviews, and group discussion forums were conducted through online meetings, including video conferencing and other social media. This policy implementation was analyzed in the aspects of context, input, process, and …

The Use Of Single-Subject Research Design For Assessment, Evaluation, And Research In Higher Education, Jordan C. Spencer

Theses and Dissertations

While enrolling in a college for a degree is still considered to be more of the expectation than the rule in households across the United States it is facing public criticism regarding its overall cost versus long-term benefits. This has prompted researchers to reevaluate practices in higher education to determine ways in which post-secondary institutions can improve their overall outcomes. In part, research indicates that this should include revisions to assessment, evaluation, and research (AER) practices. Currently, higher education faces many challenges associated with rigorous AER practices, which include an institutional focus on accountability measures, organizational challenges, and difficulties in …

The Impact Of Utah 4-H On Positive Youth Development, Lendel K. Narine, Kelsey Romney, David Francis, Craig Dart

Outcomes and Impact Quarterly

4-H is the largest youth development program in the United States. Utah 4-H conducts programs guided by the principles of positive youth development to help youth across the state lead a successful life. This article discusses the impact of Utah 4-H on the wellbeing of youth.

Introducing The Education Technology Value Evaluation Tool For Schools, Ralph Saubern, Pauline Taylor-Guy, Fabienne Van Der Kleij

International Conference on Assessment and Learning (ICAL)

Despite the enthusiasm for technology in school education, the importance attributed to it by policymakers, educators, students and parents, and the extensive impact of the changes in practices and provision related to the adoption of digital technologies, research has provided little evidence that the adoption of digital technologies has led to improved outcomes for learners. Given the significant, ongoing investment in technology and research evidence that technology has potential to improve learning outcomes, it is timely for education systems and schools to have access to tools and frameworks that can support effective use of technology in education. This paper introduces …

Evaluating Utah's Rural Online Initiative: Empowering Organizational Leaders Through Remote Work, Paul A. Hill, Amanda D. Ali, Lendel K. Narine, Andrea T. Schmutz, Tyson M. Riskas, Debra M. Spielmaker

Journal of Extension

Compared to urban counties, Utah's rural counties experienced high levels of unemployment. Informed by a statewide needs assessment, Utah State University Extension developed a remote work leadership course to equip business leaders with knowledge and skills to create remote jobs as a solution to rural unemployment. This descriptive evaluation study collected data from course participants (N = 62). Findings showed short-term outcomes were achieved; participants experienced increases in knowledge and skills and had more positive intentions toward creating remote jobs and hiring employees from rural counties. Extension professionals can design and evaluate their programs using the framework in this study.

Teacher Evaluation In Saudi Arabia Relative To National And International Teacher Evaluation Standards And Best Practices, Suhayb Kattan

Dissertations

Teacher evaluation systems are essential in tracking the quality and effectiveness of teachers and education systems. This dissertation examines the teacher evaluation system in Saudi Arabia through multiple perspectives, including research-based frameworks for teacher evaluation, norms and best practices from OECD countries, and established Saudi Teaching Standards. An explanatory sequential mixed methods model was used. Data collection involved 643 responses to a teacher survey that covered working conditions, existence of professional learning communities, and teacher evaluation practices, methods, and uses. Following the survey, in-depth interviews were conducted with 11 teachers and 3 key informants.

Findings from this study indicate the …

Exploring The Impact Of An Online Leadership Course On Japanese Undergraduates' Conceptions Of Leadership, Ryosuke Watanabe

Dissertations

Today’s complex problems transcend borders and require a collective and adaptive learning response. Literature suggests that, because the traditional hierarchical or positional style of leadership cannot effectively address problems we face today, leadership should take a more collaborative and systemic form. Rost (1991) characterized this new approach as the postindustrial paradigm of leadership. Unfortunately, changing the existing conception of leadership is not easy. Furthermore, assessing people’s leadership perceptions is challenging because leadership is often a tacit and latent construct. Because formal leadership education is still in its infancy in Japan, little is known about the impact of leadership education in …

Community Engagement And Programming Models For The 21st Century Extension Professional, Laura Downey

Journal of Extension

In this article, I review Donaldson's (2020) Community Engagement for Extension Professionals: 21st Century Program Planning, Evaluation, and Professionalism. This guidebook is relevant to several audiences including undergraduate and graduate students, Extension professionals, and faculty who work with students and advisees on program planning research and practice. This article highlights the primary contributions of the guidebook, with special emphasis on proactive and reactive Extension programming models.

Iea International Civic And Citizenship Education Study 2022: Assessment Framework [Early Online Version], Wolfram Schulz, Julian Fraillon, John Ainley, Bruno Losito, Valeria Damiani, Tim Friedman

Civics and Citizenship Assessment

The International Civic and Citizenship Study (ICCS) 2022 continues IEA’s investigation into the ways in which young people understand and are prepared to be citizens in a world where contexts of democracy and civic participation continue to change. This assessment framework provides insight into the study’s conceptual background, cognitive, affective-behavioral and contextual content, and assessment design. It also describes content relevant for the measurement of the United Nations’ Sustainable Development Goals (SDGs) that is related to Global Citizenship Education (GCED) and Education for Sustainable Development (ESD). Countries that participated in ICCS 2009, ICCS 2016, and ICCS 2022 will be able …

Contributing Factors Of Success For Middle School Agriculture Teachers, Sara Hughes

Murray State Theses and Dissertations

The changing dynamics of middle school agriculture education requires research into the causes for some teachers and chapters to succeed while others do not. The reasons for success may be varied and related to many different factors. The aim of this study is to determine how programs perform at high levels, what factors help them achieve success, and the role that evaluation may play in the process. The types of evaluation used for middle school agriculture teachers in Georgia will also be analyzed.

A Discipline In Search Of A Voice: A Corpus Linguistic Study Of Evaluation Scholarly Literature, Aaron Wilson Kates

Dissertations

Linguists use the concept of discourse community (DC) to describe the speech of groups of people associated by some extrinsic purpose or interest (Swales, 1990). One defining feature of a DC is a shared lexicon. Scriven (1994), in his discussion of evaluation as a discipline, addresses the need for evaluation to have a “core subject” which would then allow, among other things, the development of “concepts and language to deal with core problems,” while noting that there exists a definite lack of clarity of language among evaluators (p. 147). Christie and Rose (2003) suggest that the lack of clarification around …

Communicating Program Outcomes And Impact Using Data Visualization Dashboards, Amanda D. Ali, Paul A. Hill, Dominic C. Bria

Outcomes and Impact Quarterly

Governed by the Government Performance and Results Act (GPRA) of 1993, program performance benchmarks within the Cooperative Extension System relate to (a) relevance, (b) quality, and (c) accomplishments. This study discusses the development and implementation of data dashboards for the Rural Online Initiative, adhering to GRPA’s benchmarks of performance.

Using Extension As A Vehicle To Reduce Elementary Student Food Waste, Rebecca Koetz, Rod N. Williams

Journal of Extension

Extension can play a key role in providing food waste education nation-wide. This study is the first to evaluate the effects of environmentally focused lesson plans on elementary student knowledge and perceptions regarding food waste. Herein we provide suggestions on concepts to teach students for the greatest impact on food waste reduction. We also provide avenues to incorporate food waste education into existing Extension programming. We hope the study can inspire and inform further food waste program development, assessment, and implementation through Extension.

Using Assessment Data To Improve Equity: How Teachers Use Insights From The Scottish National Standardised Assessments, Sarah Richardson, Sladana Krstic

2021-2030 ACER Research Conferences

Evidence-based decision-making is regarded as an important indicator of quality in schools around the world. Using data gathered from assessments, in conjunction with other insights, can help school leaders and teachers better meet the needs of learners. In schools that cater to disadvantaged learners, using data to design targeted interventions plays an important role in improving equity. In this paper we report on a study with five schools in Scotland. All schools had learner cohorts characterised by multiple layers of disadvantage. Informed by the theoretical underpinnings of sensemaking theory, we investigated how teachers and school leaders used data from the …

Online Prehealth Advising: Impact Analysis Spring 2017 To Fall 2020, Alasdair Ekpenyong, Mykel Beorchia

Publications

At Utah State University, various online, Canvas-based advising programs complement the traditional in-person advising program. The online prehealth advising service assists students who are considering health professions graduate school.

This report explored the association between online prehealth advising participation and student persistence to the next term at Utah State University.

Effects Of Nonmusical Factors On Virginia High School Band Concert Performance Assessment Results, Larry Michael Seipp

Doctoral Dissertations and Projects

Nonmusical factors affect the Virginia Band and Orchestra Directors Association (VBODA) concert performances and subsequent assessment results; namely, school size, ethnicity, and socioeconomic status. A comparison of ratings given by individual trained evaluators demonstrates interrater reliability. A comparison of final ratings given at different assessment locations and times reflects the reliability of ratings. However, administrators and evaluators must consider nonmusical factors to report instrumental music performance results accurately. Predictor variables included SES, school size, and minority percentage. Outcome variables included overall band rating and band performance literature difficulty. Using an MLR design, the researcher compared data from the 2019 VBODA …

The Post-Observation Conference: An Exploration Of Feedback Strategies, Dennis M. Fare

Graduate Theses and Dissertations

The post-observation conference is valuable, dedicated time for a teacher to focus their discussion on their own instruction and instructional delivery. This experience serves as an opportunity for the teacher to review the details of a lesson with their observer, while also reflecting on teaching practices. Not only does the post-observation provide the teacher with accolades regarding their teaching performance, but it is also an exchange where the teacher can reflect and is provided with critical feedback to improve instructional execution moving forward. The purpose of this qualitative study is to explore those strategies and conditions that prompt teachers to …

Students’ Perceptions Of Factors Contributing To Enrollment In Arabic Courses At A College Level, Qays Q. Majeed

USF Tampa Graduate Theses and Dissertations

The purpose of this evaluation was to investigate the factors that contribute to students’ recruitment and retention in the Arabic program at my college. The two questions guiding this evaluation were: (1) what factors influence students to join the Arabic program at my college and (2) what factors influence students to continue to enroll in subsequent higher-level Arabic courses? To accomplish this evaluation, I conducted interviews with six former students --four women and two men--in the Arabic program. Eight themes emerged following analysis of data. The findings show that students joined the Arabic program for a variety of reasons. Several …

Faculty Perceptions Of Dyadic Advising Relationships, Power, And Cultural Consciousness On College Student Learning Outcomes, Hind Albana

Seton Hall University Dissertations and Theses (ETDs)

Abstract

Academic advising in institutions of higher education lack consistent assessment and evaluation of practices impairing the ability to define the role, objectives, and methods utilized. Over-reliance on student satisfaction surveys for evaluating advising reinforces this phenomenon. To break the cycle, this study used survey responses from a nationwide sample (N = 156) of faculty advisors from public and private 4-year colleges and universities to examine the relationship between and among the constructs of a working relationship, shared power, cultural consciousness, and student learning outcomes. The questionnaire instrument score produced a Cronbach's alpha of .927, illustrating substantially strong internal consistency. …

Success And Sustainability Of Sponsored International Development Programs In Education: A Narrative Inquiry, Sara Beth Leikin

USF Tampa Graduate Theses and Dissertations

In a 2008 working paper published by the U.S. Agency for International Development, the authors lamented that, despite billions of dollars in investment in global education initiatives, access to education had been improved in targeted areas, but the return on investment with regards to learning outcomes was “much less impressive” (Gillies & Jester Quijada, 2008). From 2012-2017, USAID engaged in the Egypt STEM Schools Project (ESSP) along with four partner organizations with the goal of building model science and mathematics public schools that would challenge the educational status quo by providing students with hands-on, constructivist learning and providing an alternative …

Competent Office Staffing For Minority, Women-Owned, And Local Business Enterprise Contractors Via Workforce Development, Ralston C. O'Connor

Walden Dissertations and Doctoral Studies

AbstractConversations about workforce development in the construction industry are centered around improving the construction trade skills of displaced workers or other unskilled or untrained individuals. Rarely will that conversation focus on the administrative skills necessary for contractor success, particularly in public works construction where administrative oversight is a challenge for the minority, women-owned, and local business enterprise (MWLBE) community. Anecdotal data indicated that MWLBE contractors are skilled at their trades and have little or no problem accessing a skilled labor force. Where these contractors tend to fall short is in the administrative requirements of government contracts. The purpose of this …

Pre-Reading Activities And Students’ Achievement In French Oracy: Implication For Evaluation In Library And Information Science, Kenneth O. Eze Phd, Grace C. Offorma Phd, Christian S. Ugwuanyi Phd, Chinedu I.O. Okeke Phd

Library Philosophy and Practice (e-journal)

Library and Information Science is a profession that is full of people who are passionate about making a positive change in the world. In this profession, the workers are known as Librarians whose duty is to bridge the gaps that exist between people, information and technology. Librarians work to create reader’s advisory resources to encourage young students to develop a lifelong love of reading and learning through pre-reading activities. This paper thus, investigated the effect of pre-reading activities on students’ achievement in French oracy. Using quasi-experimental research design, 154 senior secondary one students participated in the study. French Oracy Achievement …

Understanding The Influence Of Interdisciplinary Research: An Examination Of Carol Hirschon Weiss’S Scholarship, Gregory Dee Greenman Ii

Dissertations

Research evaluation is the subfield of evaluation that examines the processes and products of scientific and technological research. This dissertation explores the case of interdisciplinary research evaluation by reviewing the publications of one of the most influential and highly cited scholars in evaluation, public administration, and knowledge utilization: Carol Hirschon Weiss. As one of the foundational theorists of evaluation, the evaluation perspective of Weiss's work typically pervades discussions. That approach ignores her influence in other fields, particularly her centrality to the knowledge utilization field. Prior research indicates that the influence of interdisciplinary research is challenging to ascertain because research evaluation …

Assessing The Effects Of Restorative Practices On Teacher Practices In Elementary Classrooms, Cheng Fisher

Graduate Theses, Dissertations, and Capstones

Restorative practices have been broadly adopted in American schools. However, few empirical studies have rigorously examined the effects of restorative practices on teacher practices through direct observations. This quasi-experimental designed study tested the hypothesis that restorative practices experience would increase positive interactions between teachers and students. Measurably, it would improve positive teacher practices and positive student behavior. The study analyzed data from a school-randomized evaluation with two rounds of observations in a single school year. Observational data of 140 elementary teachers and their students from nine restorative schools were used to examine the impact of restorative practices on teacher practices …