Open Access. Powered by Scholars. Published by Universities.®

Education Commons

Open Access. Powered by Scholars. Published by Universities.®

Educational Assessment, Evaluation, and Research

Evaluation

Institution
Publication Year
Publication
Publication Type
File Type

Articles 1 - 30 of 259

Full-Text Articles in Education

A Meta-Analysis Of The Effects Of Enrichment Programs On Gifted Students, Mihyeon Kim Sep 2019

A Meta-Analysis Of The Effects Of Enrichment Programs On Gifted Students, Mihyeon Kim

Mihyeon Kim

Although descriptions of enrichment programs are valuable for practitioners, practices, and services for gifted students, they must be backed by evidence, derived through a synthesis of research. This study examined research on enrichment programs serving gifted students and synthesized the current studies between 1985 and 2014 on the effects of enrichment programs. A total of 26 studies were included in this meta-analysis, and the findings show that enrichment programs had a positive impact on both gifted students’ academic achievement (g = 0.96, 95% CI [0.64, 1.30], under a random-effects model) and socioemotional development (g = 0.55, 95% CI ...


The Impact Of Pbl As A Stem School Reform Model, Michael R. L. Odell, Teresa J. Kennedy, Eric Stocks Aug 2019

The Impact Of Pbl As A Stem School Reform Model, Michael R. L. Odell, Teresa J. Kennedy, Eric Stocks

Interdisciplinary Journal of Problem-Based Learning

Project/problem-based learning (PBL) can provide an effective model for school reform when implemented with fidelity. In the report, Rising Above the Gathering Storm, it was recommended that if the U.S. is to remain competitive in the 21st-century economy, there must be a serious effort to “enlarge the pipeline of students who are prepared to enter college and graduate with a degree in STEM” (National Academy of Sciences, National Academy of Engineering, & Institute of Medicine, 2007, p. 6). The report included the recommendation that states develop statewide specialty STEM high schools (National Academy of Sciences, National Academy of Engineering ...


Measuring Media Literacy Inquiry In Higher Education: Innovation In Assessment, Evelien Schilder, Theresa Redmond Aug 2019

Measuring Media Literacy Inquiry In Higher Education: Innovation In Assessment, Evelien Schilder, Theresa Redmond

Journal of Media Literacy Education

The ability to critically access, analyze, evaluate, and create media messages is crucial in the process of becoming an informed and engaged citizen throughout life. Asking critical questions is not only a valuable dimension of media literacy, but also an indispensable aspect of participating in a democracy. Yet, measuring the effectiveness of media literacy is still a major challenge for the field. It is unclear to what extent people of all ages may engage in critical questioning habits with regards to media. To address this gap, we studied the changes in critical questioning habits for college-aged students enrolled in media ...


Assessment In The Interpersonal Domain: Experiences From Empathy Assessment In Medical Education, Neville Chiavaroli Aug 2019

Assessment In The Interpersonal Domain: Experiences From Empathy Assessment In Medical Education, Neville Chiavaroli

2009 - 2019 ACER Research Conferences

Frameworks for the teaching and assessment of 21st-century skills commonly recognise the importance of learning and skill development in the interpersonal domain. They also usually acknowledge the challenge of reliably and validly assessing students in this domain. In the field of medical education and in selecting students for medical courses, the concept of empathy has become central to representing the particular interpersonal understandings and skills expected of students and practising doctors. Attempts to assess these attributes during medical training are just as challenging as in school contexts. This presentation draws on several years’ experience of working with medical educators to ...


Assessment In The Interpersonal Domain: Experiences From Empathy Assessment In Medical Education, Neville Chiavaroli Aug 2019

Assessment In The Interpersonal Domain: Experiences From Empathy Assessment In Medical Education, Neville Chiavaroli

Neville Chiavaroli

Frameworks for the teaching and assessment of 21st-century skills commonly recognise the importance of learning and skill development in the interpersonal domain. They also usually acknowledge the challenge of reliably and validly assessing students in this domain. In the field of medical education and in selecting students for medical courses, the concept of empathy has become central to representing the particular interpersonal understandings and skills expected of students and practising doctors. Attempts to assess these attributes during medical training are just as challenging as in school contexts. This presentation draws on several years’ experience of working with medical educators to ...


An Exploration Of Professional Preparedness Of Instructional Designers To Evaluate, Philena V. Devaughn Apr 2019

An Exploration Of Professional Preparedness Of Instructional Designers To Evaluate, Philena V. Devaughn

STEMPS Theses & Dissertations

Formative, summative, and confirmative evaluation of instructional products determine whether learner objectives have been attained and substantiate the value of the instruction. The ability to implement an evaluation plan is classified as an essential skill for instructional designers by the International Board of Standards for Training and Performance Improvement (IBSTPI). Previous research has ascertained that entry-level instructional designers have failed to master the skills required to create evaluation plans.

The purpose of this qualitative study was to examine the professional preparation received by instructional designers, for instruction evaluation, through graduate level programs. The data collected for this study was the ...


Development And Evaluation Of An Online University Readiness Course Furthered By Capturing The Lived Experience Of Students During This Transition: A Multi-Perspective Understanding Of The Transition To University, Cortney Hanna-Benson Mar 2019

Development And Evaluation Of An Online University Readiness Course Furthered By Capturing The Lived Experience Of Students During This Transition: A Multi-Perspective Understanding Of The Transition To University, Cortney Hanna-Benson

Electronic Thesis and Dissertation Repository

In the transition to university, students may hold expectations about university life: how their classes, friendships, and support networks would change in university. They may need to adjust their time management skills and study strategies to better suit the new self-directed learning environment, while grappling with psychosocial and emotional changes resulting from the new social and living environments. ‘University readiness’ provided the context and rationale for development of a pre-university online course, Leg UP: An Introduction to Health Across the Lifespan. This program was evaluated in a quasi-experimental study to assess its effectiveness at easing students’ transition to university in ...


Assessment Of University Support Services For Regional And Remote Students On Transition To University: Final Report, Darren Matthews, Gina Milgate, Leyna Clarke Mar 2019

Assessment Of University Support Services For Regional And Remote Students On Transition To University: Final Report, Darren Matthews, Gina Milgate, Leyna Clarke

Gina C Milgate

This report details the development and piloting of an Assessment of university support services for regional and remote students on transition to university. The project forms part of the Australian Government’s response to the Independent Review into Regional, Rural and Remote Education led by Emeritus Professor John Halsey. In its recommendations, the Review highlighted how critical it is to “Support RRR [regional, rural and remote] students to make successful transitions from school to university, training, employment and combinations of them”. In relation to this recommendation, this project is designed to support the Australian Government’s response to the Halsey ...


Assessing The Effectiveness Of Computer Science Rpps: The Case Of Cafecs, Erin Henrick, Steven Mcgee, Ronald I. Greenberg, Lucia Dettori, Andrew M. Rasmussen, Don Yanek, Dale F. Reed Feb 2019

Assessing The Effectiveness Of Computer Science Rpps: The Case Of Cafecs, Erin Henrick, Steven Mcgee, Ronald I. Greenberg, Lucia Dettori, Andrew M. Rasmussen, Don Yanek, Dale F. Reed

Computer Science: Faculty Publications and Other Works

Research Practice Partnerships (RPPs) are a relatively

recent development as a potential strategy to address the

complex challenges in computer science education. Consequently,

there is little guidance available for assessing the effectiveness of

RPPs. This paper describes the formative evaluation approach

used to assess the progress of the first year of the formalized RPP,

Chicago Alliance for Equity in Computer Science (CAFE´CS).

This paper contributes to the RPP literature by providing a case

study of how an RPP effectiveness framework can be adapted

and used to inform partnership improvement efforts in computer

science education.


Report From The Stem 2026 Workshop On Assessment, Evaluation, And Accreditation, Rebecca Bates, Angela Arnold, Cary Komoto, Peggy Brickman, R. Alan Cheville, Elizabeth Longley, Jose Mestre, Mihaela Sabin, James Warnock Jan 2019

Report From The Stem 2026 Workshop On Assessment, Evaluation, And Accreditation, Rebecca Bates, Angela Arnold, Cary Komoto, Peggy Brickman, R. Alan Cheville, Elizabeth Longley, Jose Mestre, Mihaela Sabin, James Warnock

Reports

A gathering of science, technology, engineering, and math (STEM) higher education stakeholders met in November 2018 to consider the relationship between innovation in education and assessment. When we talk about assessment in higher education, it is inextricably linked to both evaluation and accreditation, so all three were considered. The first question we asked was can we build a nation of learners? This starts with considering the student, first and foremost. As educators, this is a foundation of our exploration and makes our values transparent. As educators, how do we know we are having an impact? As members and implementers of ...


Report From The Stem 2026 Workshop On Assessment, Evaluation, And Accreditation, Rebecca Bates, Angela Arnold, Cary Komoto, Peggy Brickman, R. Alan Cheville, Elizabeth Longley, Jose Mestre, Mihaela Sabin, James Warnock Jan 2019

Report From The Stem 2026 Workshop On Assessment, Evaluation, And Accreditation, Rebecca Bates, Angela Arnold, Cary Komoto, Peggy Brickman, R. Alan Cheville, Elizabeth Longley, Jose Mestre, Mihaela Sabin, James Warnock

Integrated Engineering Faculty Publications

A gathering of science, technology, engineering, and math (STEM) higher education stakeholders met in November 2018 to consider the relationship between innovation in education and assessment. When we talk about assessment in higher education, it is inextricably linked to both evaluation and accreditation, so all three were considered. The first question we asked was can we build a nation of learners? This starts with considering the student, first and foremost. As educators, this is a foundation of our exploration and makes our values transparent. As educators, how do we know we are having an impact? As members and implementers of ...


Factores Académicos De Incidencia En La Generación De Desigualdades Educativas En El Colegio Seminario San Juan Apóstol Y El Liceo Hermano Miguel La Salle Desde Los Resultados De Las Pruebas Saber 11 2015-2017, Sergio Alfonso Pineda, Johanna Andrea Santa Bernal, Andrea Beltrán Páez Jan 2019

Factores Académicos De Incidencia En La Generación De Desigualdades Educativas En El Colegio Seminario San Juan Apóstol Y El Liceo Hermano Miguel La Salle Desde Los Resultados De Las Pruebas Saber 11 2015-2017, Sergio Alfonso Pineda, Johanna Andrea Santa Bernal, Andrea Beltrán Páez

Maestría en Docencia

A través de esta investigación se realizó la identificación de los factores académicos que presentaron mayor incidencia en los resultados de las PRUEBAS SABER 11 y que contribuyeron en la generación de desigualdades educativas que afectan la calidad de la educación en los contextos rural y urbano, se aplicó como metodología la teoría fundamentada, la cual permitió la indagación y comparación constante de los fenómenos observados en dos instituciones, una rural y la otra urbana, de tal manera, que se logró identificar los factores más influyentes en la generación de desigualdades y llegar a proponer una hipótesis que describe los ...


Teachers' Perceptions Of School District Professional Development Alignment With National Standards, Arlene Jean Wacha Jan 2019

Teachers' Perceptions Of School District Professional Development Alignment With National Standards, Arlene Jean Wacha

Walden Dissertations and Doctoral Studies

Despite ongoing delivery of teacher professional development (PD), educational leaders in the local district did not have an objective evaluation whether their implementation of the Marzano causal teacher evaluation model and the iObservation tool training were aligned with accepted national standards for PD effectiveness. Using Vygotsky's constructivist theory as the theoretical framework, the purpose of this quantitative descriptive, correlational study was to describe teachers' perceptions of the alignment of the district's PD with national standards and the relationship between teachers' reported self-efficacy and attitudes toward the PD program. A purposive sample of 80 middle school teachers completed the ...


Assessment Of University Support Services For Regional And Remote Students On Transition To University: Final Report, Darren Matthews, Gina Milgate, Leyna Clarke Aug 2018

Assessment Of University Support Services For Regional And Remote Students On Transition To University: Final Report, Darren Matthews, Gina Milgate, Leyna Clarke

Higher Education Research

This report details the development and piloting of an Assessment of university support services for regional and remote students on transition to university. The project forms part of the Australian Government’s response to the Independent Review into Regional, Rural and Remote Education led by Emeritus Professor John Halsey. In its recommendations, the Review highlighted how critical it is to “Support RRR [regional, rural and remote] students to make successful transitions from school to university, training, employment and combinations of them”. In relation to this recommendation, this project is designed to support the Australian Government’s response to the Halsey ...


Data Parties I Have Known: Lessons Learned And Best Practices For Success, Nancy K. Franz Aug 2018

Data Parties I Have Known: Lessons Learned And Best Practices For Success, Nancy K. Franz

Education Publications

Increased focus on data-driven decision making requires Extension professionals to excel at data analysis and interpretation. Data parties have become increasingly popular for involving stakeholders in making sense of data. As these parties become more frequently used by Extension professionals, best practices are emerging from lessons learned to improve the process and enhance the outcomes. These practices include designing discussion questions to fit the specific goals of the process, engaging a team of key partners, setting a theme and party environment that appeals to the participants and fits the context, providing appropriate data visualization tools, and using strong facilitation practices.


Apology Not Accepted: The Impact Of Executive Rhetoric, Communication Strategies, Media Coverage And Time On Crisis Management And Public Perception During Major Oil Spills, Todd D. Harcek Apr 2018

Apology Not Accepted: The Impact Of Executive Rhetoric, Communication Strategies, Media Coverage And Time On Crisis Management And Public Perception During Major Oil Spills, Todd D. Harcek

Dissertations

This research builds upon the scholarship in crisis communication strategies and apologia employed by companies during a crisis. Within the expansive domain of crisis management, this work evaluates the media coverage and crisis communication strategies during three major oil spills: the Exxon Valdez, the American Trader, and the BP Gulf oil spill. The purpose of this study is to provide practitioners, researchers and others additional insight into the impact of media coverage on prior, current and future crises and how this coverage, coupled with the communication strategies of companies during a crisis, can influence public awareness or perception. Furthermore, this ...


Student Social Services In Kentucky’S Schools: Understanding The Impact Of Fryscs On Student Achievement, Stephen W. Lin Mar 2018

Student Social Services In Kentucky’S Schools: Understanding The Impact Of Fryscs On Student Achievement, Stephen W. Lin

Graduate Theses, Dissertations, and Capstones

This study examines the impact of a public policy intervention, called Family Resource and Youth Service Centers (FRYSC), on student achievement in Kentucky. The author provides a quantitative evaluation of FRYSC, supplementing a void in prior research on FRYSC effectiveness. FRYSC-eligible schools (n = 1263) included in this study had no center, an elementary center, a middle or high school center, or a combined center. The researcher analyzed data obtained from government databases reporting school-level statewide assessment results. Student achievement metrics reflect reading and mathematics proficiency outcomes for at-risk students, whom are typically served by a FRYSC. For reading and mathematics ...


Effects Of Collaborative Teaching Evaluation Process On Teacher/Administrator Collegiality, Gary A. Storts Jr. Jan 2018

Effects Of Collaborative Teaching Evaluation Process On Teacher/Administrator Collegiality, Gary A. Storts Jr.

Theses and projects

The job of the professional educator is becoming ever more complex. Research has shown that effective teacher evaluation processes and collegial relationships between the teacher and the principal both positively impact student achievement. This study investigates how a collaborative teacher evaluation process effects collegiality between the teacher and the site administrator. Four teachers who had experienced both traditional and collaborative reviews in a small rural school district in Northern California were interviewed to assess the impact that a collaborative evaluation had on their professional relationship with their principal.

The results of this research confirmed that teaching evaluations, however they are ...


Utilizing A Learning Management System To Support Access To Study Abroad: A Program Evaluation At The University Of Denver, Christopher Chaves E Silva Jan 2018

Utilizing A Learning Management System To Support Access To Study Abroad: A Program Evaluation At The University Of Denver, Christopher Chaves E Silva

Higher Education: Doctoral Research Projects

This doctoral research project investigated issues of access to study abroad at the University of Denver (DU). The study evaluated the use of the learning management system Canvas during Fall 2017, in preparation for student applications for study abroad during Fall 2018. The evaluation utilized qualitative data from focus groups with students and families, interviews with higher education professionals and analytics data on the usage of Canvas. The findings identified that the usage of Canvas during Fall 2017 was low in comparison to the number of individuals who applied to study abroad and was focused on the preparation for the ...


Action Research: Teacher Evaluation And Reflection, Courtney Lynne Landry Jan 2018

Action Research: Teacher Evaluation And Reflection, Courtney Lynne Landry

Educational Leadership and Policy Studies: Doctoral Research Projects

The purpose of this qualitative action research study was to create an improved learning log procedure, based on the theory of action that the use of professional learning logs will improve self-reflection, which will increase teacher self-efficacy. Data collected through interviews, focus groups, and a research action committee have led to the assertions that (a) reflection is a necessary and welcomed part of being a professional; (b) procedures for reflection must be easily accessed and consistent; (c) teachers should have autonomy over their choice of reflection method to gain meaning; (d) though the learning log process allows for autonomy, the ...


Discerning Disciples: A Mixed Methods Study On Attitudes Toward And Practices Of Evaluation Among Lay Catechetical Leaders, Anthony Dallas Paz Jan 2018

Discerning Disciples: A Mixed Methods Study On Attitudes Toward And Practices Of Evaluation Among Lay Catechetical Leaders, Anthony Dallas Paz

Graduate Theses and Dissertations

Despite the work of catechetical leaders to help fellow Catholics deepen their relationship with Jesus Christ, the Catholic Church in the US continues to lose members at an alarming rate. In other educational and professional settings, practices of assessment and evaluation have been employed to determine whether and how their missions are achieved. The literature reveals that there is very little research on evaluative practices and attitudes among professional catechetical leaders and suggests that there is a great lack of evaluation in the field of catechesis and religious education in the US. This study utilized an explanatory sequential mixed methods ...


Teacher And Administrator Perceptions Of The Teacher Excellence And Support System (Tess) In Arkansas, Allison Louise Byford Jan 2018

Teacher And Administrator Perceptions Of The Teacher Excellence And Support System (Tess) In Arkansas, Allison Louise Byford

Theses and Dissertations

The purpose of this study was to investigate differences in Arkansas teachers’ and building-level administrators’ perceptions regarding the purpose of the Arkansas TESS teacher evaluation system, whether TESS authentically assesses teacher effectiveness, how teacher evaluation data are used, and how the TESS process supports learner-centered professional development. Additionally, the relationship of teacher and administrator demographics on their perceptions of TESS was explored. The results of this study highlight the differences in perceptions in all areas questioned along with misalignment in perceptions among teachers. Overall, the study points toward the need for clear communication and the cultivation of relationships among building ...


Using Immediate Feedback To Improve Short-Term Learning In Extension, Erin W. Hodgson Jan 2018

Using Immediate Feedback To Improve Short-Term Learning In Extension, Erin W. Hodgson

Entomology Publications

Program evaluation is an important part of any extension program and is often a required component by funding agencies. Given declining resources in land-grant universities, we must be creative in evaluating the learning and adoption of our research-based recommendations. I used a survey tool to give immediate feedback to participants in a wide variety of situations. Results indicate adults were receptive to this evaluation method, and close-ended questions can provide reliable evaluation data in an extension program. People showed improved significant learning with this technique and it is a model for other extension personnel.


A Phenomenological Study Of Teachers' Emotional Responses To Tkes, A High-Stakes Evaluation System, Kristina J. Hirsch Jan 2018

A Phenomenological Study Of Teachers' Emotional Responses To Tkes, A High-Stakes Evaluation System, Kristina J. Hirsch

Electronic Theses and Dissertations

Teachers experience a plethora of emotions relating to being evaluated and we are losing a lot of good teachers due to some of these emotions. The purpose of this phenomenological study was to investigate how teachers at one rural high school describe their emotional responses to evaluation and the implementation of TKES as well as if there were gender differences in their responses. This research is important because teachers need to understand that their emotions are not taboo and they are not alone in the evaluation process. Additionally, evaluators benefit from knowing how teachers respond to evaluation so that they ...


An Elementary Perspective Of The Value-Added Model, Pat Mccoy Jan 2018

An Elementary Perspective Of The Value-Added Model, Pat Mccoy

Walden Dissertations and Doctoral Studies

In a small, rural school district in the southeastern United States, elementary school teachers were receiving positive evaluation ratings while student proficiency on state assessments was below the state average. Due to changes in federal and state laws, school personnel evaluate methods have undergone significant reform. The purpose of this study was to answer the guiding research questions of teachers and administrators perceptions toward the value-added model (VAM) of evaluation and how those perceptions affect teacher performance. Taylor's scientific management theory, which suggests examining human productivity through the lens of applied science served as the conceptual framework. Data were ...


Strengthening Families In Santa Cruz County, Yajaira Rubio-Mendoza Dec 2017

Strengthening Families In Santa Cruz County, Yajaira Rubio-Mendoza

Capstone Projects and Master's Theses

Parenting is very rewarding and enjoyable, yet it can be challenging and exhausting. Therefore, there is no right way to be a parent. At La Manzana Community Resources (LMCR), a family program of Community Bridges, there is a strong belief in strengthening families within the Santa Cruz County community. That is why LMCR provides various services such as, Triple-P Positive Parenting Program. Triple-P, funded by First 5, provides parents and caregivers parenting support ranging from birth to 12 years of age, with additional support for families with teens, and families of children with special needs. The main purpose of this ...


Effects Of A Hospital-Wide Physician Communication Skills Training Workshop On Self-Efficacy, Attitudes And Behavior, Minna Saslaw, Dana R. Sirota, Deborah P. Jones, Marcy Rosenbaum, Steven Kaplan Nov 2017

Effects Of A Hospital-Wide Physician Communication Skills Training Workshop On Self-Efficacy, Attitudes And Behavior, Minna Saslaw, Dana R. Sirota, Deborah P. Jones, Marcy Rosenbaum, Steven Kaplan

Patient Experience Journal

Hospital systems interested in improving patient experience and physician engagement may look to physician communication skills training (CST) as a means of improving both. This study examines a 7.5-hour, multi-specialty, hospital-wide physician CST workshop in a large academic hospital system and its effects on participants’ self-efficacy, attitudes, and behaviors related to communicating with patients. Data was gathered from October 2014 through June 2016 through a web-based questionnaire sent to participants 6-weeks post-workshop which focused on skills taught in the course, attitudes toward communication training, and provider behaviors when communicating with patients. Along with demographic questions, a ten question retrospective ...


An Evaluation Of The Effects Of The Search For Education, Elevation, And Knowledge (Seek) Program On Short- And Intermediate-Term Outcomes, Raymond Galinski Jun 2017

An Evaluation Of The Effects Of The Search For Education, Elevation, And Knowledge (Seek) Program On Short- And Intermediate-Term Outcomes, Raymond Galinski

All Dissertations, Theses, and Capstone Projects

The Search for Education, Elevation, and Knowledge (SEEK) program is an educational opportunity program within the City University of New York designed to provide economically and academically disadvantaged students, who otherwise would not have such access, the opportunity to attend college and to succeed once enrolled. However, despite being in existence for a half-century, surprisingly little is known about how the SEEK program contributes to student achievement and success. This study was the first to empirically measure the short- and intermediate-term impacts of this program on student outcomes.

Using propensity scores to match SEEK students to similar non-SEEK students to ...


What Impacts Do Oer Have On Students? Students Share Their Experiences With A Health Psychology Oer At New York City College Of Technology, Cailean Cooney Jun 2017

What Impacts Do Oer Have On Students? Students Share Their Experiences With A Health Psychology Oer At New York City College Of Technology, Cailean Cooney

Publications and Research

This article reports findings from a study conducted with students in three sections of a Health Psychology course that replaced a traditional textbook with open educational resources (OER) as the primary course material. The purpose of the study was to learn how OER impacted students. Data were collected in Fall 2015 with students from New York City College of Technology (City Tech), of the City University of New York (CUNY), a comprehensive college located in Brooklyn. Students were assigned the OER by their course instructor, who developed it as part of a library funded OER pilot initiative. Two research instruments ...


Derring Do Survey Data: Exploring Health Sciences Library Collaboration With Evaluation Experts, Marian Taliaferro, Jackie Loweree May 2017

Derring Do Survey Data: Exploring Health Sciences Library Collaboration With Evaluation Experts, Marian Taliaferro, Jackie Loweree

Marian Taliaferro

No abstract provided.