Educational Assessment, Evaluation, and Research Commons^™

Emerging Issues And Innovations In Public Pk-12 Education: Implications For Strategic Planning, David B. Naff, Lisa Gwyn, Fred Gatty, Tara Willging, Marzia Farhana, Jill Flynn, Cammie Justus-Smith, Jean Samuel, Alexander Campbell, Ciana Cross, Jamie Nervil, Michael L. Schad

MERC Publications

This research and policy brief from the Metropolitan Educational Research Consortium (MERC) explores emerging issues and innovations that PK-12 school districts should consider when engaging in strategic planning. It includes a discussion of peer reviewed literature related to how PK-12 school districts engage in strategic planning, a thematic analysis of strategic plans across Virginia (as well as the largest school districts in the United States), and an exploration of Google trends related to prominent topics in PK-12 education over the previous five years. It explores the following questions: 1) How do PK-12 school systems engage in strategic planning?, 2) What …

Capstone Projects In Education: Learning The Research Story, Kim Chappell, Greg Voykhansky J.D., Ph.D.

All Open Educational Resources

This book is designed to facilitate understanding of education research and guide the development and the writing of a capstone project. In education, like other social sciences, we are investigating issues directly involving or influencing humans. Research involving humans can be a complex and awkward endeavor. However, if we view this endeavor through the lens of a research story, we find a familiar genre we can relate to and understand. This concise, open textbook weaves the story of a cat throughout to explain the components of typical education capstone projects.

Global Perspective Inventory Analysis On International Education Experience: Differences Between Colombian Mba Alumni Who Participated In A Dual Degree Program And Those Who Did Not, Luis N. Romero

Graduate Research Theses & Dissertations

The purpose of this study is to describe differences in global perspective-taking between MBA alums who graduated with a dual degree from both a Colombian university and a U.S. university and those who did not participate in the program. The Global Perspective Inventory (GPI) is a survey tool that evaluates global competencies across three domains of development: cognitive, intrapersonal, and interpersonal dimensions. To go deeper into the study, a U-test was implemented to compare the means for a nonparametric sample. A comparative analysis of data with the Mann–Whitney–Wilcoxon test found no difference between Colombian PRIME MBA students who completed an …

Th 2140 Theatre In Western Culture Core General Education Assessment, 2023-2024, College Of Liberal Arts, Wright State University

Core General Education Assessments - All

This report assesses Wright State University's course TH 2140, Theatre in Western Culture, as part of the institution’s ongoing general education Core assessment plan.

2022-2023 Annual Student Assessment Report, Southwestern Oklahoma State University

Assessment Center Reports

Annual Student Assessment Report produced by the SWOSU Assessment Center.

Vcu And The 2021 Virginia Course Materials Survey, Jessica Kirschner

Scholarship about Open Education

In Fall 2021, VIVA, Virginia’s Academic Library Consortium, distributed the Virginia Course Materials Survey to a selection of students at Virginia higher education institutions. The survey hoped to explore:

1. The relationship between educational equity and textbook costs, and

2. Which textbook features most benefited students’ learning experiences.

This report presents the results from this survey, focused on Virginia Commonwealth University (VCU). At VCU, the survey was disseminated to a 20% random sample of students. 603 VCU responses were received (10% response rate). Due to the IRB approved protocols and efforts to maintain respondent anonymity, VCU data is only available on the …

Stable Or Unstable Associations Between Learning Environment Factors, Study Approaches And Exam Grades: Cross-Sectional Analyses Across Two Consecutive Program Years, Jenny Solveig Mygland, Gry Mørk, Linda Stigen, Astrid Gramstad, Trine Alise A. Magne, Tore Bonsaksen

Journal of Occupational Therapy Education

Studies into the relationships between learning environment perceptions, approaches to studying, and academic outcomes have largely followed cross-sectional designs. As a result, knowledge is sparse with regards to whether, or to what degree, the established associations are consistent across years of study. This study aimed to (i) examine associations between occupational therapy students’ academic performance, their approaches to studying and perceptions of the learning environment, while in their second and third years of study, and (ii) evaluate the consistency of the results across years of study. Occupational therapy students in Norway were assessed annually with regards to their perceptions of …

2023 Institutional Effectiveness Survey Report, Southwestern Oklahoma State University

Assessment Center Reports

Institutional Effectiveness Survey reports produced by the SWOSU Assessment Center.

School Improvement Tool: A Summary Of The Underpinning Research, Christina Rogers, Fabienne Van Der Kleij, Pauline Taylor-Guy

School and system improvement

In 2023, ACER published the School Improvement Tool (SIT), the second iteration of the National School Improvement Tool (NSIT). A comprehensive review of international research was undertaken to inform the development of the SIT which consists of nine inter-related domains that describe the practices of highly effective schools and leaders. This document provides a summary of research evidence that underpins each of the nine domains of the SIT. Acknowledging interdependencies between domains, it presents a narrative of key evidence and research-based considerations for each domain. Further detail about the evidence for each domain can be found in the School Improvement …

Rising With Joy: Re-Defining The Meaning Of School Success, Eric Middleton

West Chester University Master’s Theses

Throughout this thesis, I will be discussing some of the pressure and stresses placed upon educators in the traditional school setting in America. Under an educational system that is about rigid routine and control, I examine the ill effects that come from a lack of creativity and autonomy. My overall goal throughout the thesis is to define what joy looks like for our students and staff. I conclude with a program proposal that links the concepts of free play, movement through wandering, and mental wellness to building a better community.

Transformative Social Emotional Learning: A Call To Heal The Effects Of Racial Trauma On Identity And Self-Efficacy, Elizabeth Trostle

West Chester University Master’s Theses

Growing up I was never a child that loved school. I fell in love with learning in environments that did not look or feel like classrooms. And in 2005 I learned that I had a passion for learning about pedagogy. I entered the classroom again this time as a teacher, ready to engage students in learning. What I was offered was curriculum and learning standards that left little room for experiences. Despite my efforts, and after a decade of experience, I was still baffled by the resistance to learning.

I wanted to understand this because I saw that education—when you …

Literacy Master's Degree Annual Program Outcomes Assessments, 2022-23, College Of Health, Education, And Human Services, Wright State University

Annual Program Outcomes Assessments - All

This report reviews Wright State University's Literacy Master's Degree program for the 2022-2023 academic year.

Health And Physical Education Baccalaureate Degree Annual Program Outcomes Assessments, 2022-23, College Of Health, Education, And Human Services, Wright State University

Annual Program Outcomes Assessments - All

This report reviews Wright State University's Health and Physical Education Baccalaureate Degree program for the 2022-2023 academic year.

Accountancy Baccalaureate Degree Annual Program Outcomes Assessments, 2022-23, Raj Soin College Of Business, Wright State University

Annual Program Outcomes Assessments - All

This report reviews Wright State University's Accountancy Baccalaureate Degree program for the 2022-2023 academic year.

Online Early Childhood Teacher Education Program: Practices And Future Possibilities, Yasmeen Mehboob, Silpa Aziz Karim

Institute for Educational Development, Karachi

The study aimed to test the effectiveness and the feasibility of Zoom and Virtual Learning Environments (VLE) for early childhood teacher education (ECTE) at a university in Pakistan. The study addresses how a Community of Inquiry (COI) framework can be embedded within Zoom and VLE to make the online course meaningful, interactive and accessible. This is an exploratory case study with a mixed method approach. Data was gathered through survey, focus group discussion, reflective journals, observations and meeting notes. Pre- and post-online knowledge tests and assignments were used to assess changes in participant’s knowledge and understanding. Survey result indicated positive …

Improving Critical Thinking In Written Assignments: Human Vs. Chatgpt Tutor In Socratic Questioning Intervention, Katia Martha

Scripps Senior Theses

The purpose of the proposed study is to trial a short Socratic Questioning (SQ) intervention in the writing process, facilitated by either a human or ChatGPT tutor, and explore the effects that this may have on students’ critical thinking (CT), which will be coded from their written responses. Participants will be undergraduate college first years in the local California area who are fluent in English and have no learning disabilities. This study involves two visits, spaced a week apart, to gather pre- and post- test data for evaluating the effectiveness of the SQ intervention in improving CT. Both visits will …

Development Of A Teaching Performance Assessment In Australia: What Did We Learn?, Rebecca Spooner-Lane, Tania Broadley, Elizabeth Curtis, Peter Grainger

Australian Journal of Teacher Education

Following increasing criticism of the variability in graduate teachers’ readiness to enter the profession, the Australian Institute for Teaching and School Leadership (AITSL) introduced a program accreditation requirement that all initial teacher education (ITE) providers must implement a Teaching Performance Assessment (TPA) in the final year of their teacher education programs. AITSL were not prescriptive in how ITE providers must meet the program standard which has resulted in 12 TPAs being implemented across 42 ITE providers. This paper outlines the development and implementation of one endorsed TPA designed to measure the readiness of graduating teachers, whilst taking into consideration the …

The Implementation And Impact Of The Teacher Evaluation Process On Special Educator Professional Growth In A Public Middle School, Michael L. Lefko

Doctor of Education Dissertations

This mixed methods program evaluation examined teacher and administrator perceptions regarding fidelity of implementation of components of the teacher evaluation program with middle school special education teachers. These components include pre-conferences, observations, and post-conferences; summary evaluations; and professional development plans. Incorporating evidence from qualitative interviews with school-based administrators, qualitative focus groups with special education teachers, and a quantitative survey with special education teachers, this study found that fidelity of implementation of the components of teacher evaluation is impacted by evaluator capacity. Capacity is defined as both, time to engage in the components of teacher evaluation and professional knowledge of special …

Rethinking Assessment In Response To Generative Artificial Intelligence, Jacob Pearce, Neville Chiavaroli

Higher education research

The use of decision-making support tools during assessments, such as electronic differential diagnosis in examinations, is just the tip of the iceberg when it comes to how technology is currently changing assessment practice. We have reached a transformative stage in the development of artificial intelligence (AI). We can no longer rely on non-invigilated assessments and submitted ‘artefacts’ to demonstrate student learning and competence. This is bringing many long-term demands on educators, course coordinators and curriculum designers, forcing us to rethink assessment approaches. Going forward, we see an important distinction between ‘assisted’ assessments and ‘unassisted’ assessments. With the recent increase and …

Analytics-Enabled Authentic Assessment Design Approach For Digital Education, Tristan Lim, Swapna Gottipati, Michelle L. F. Cheong, Jun Wei Ng, Christopher Pang

Research Collection School Of Computing and Information Systems

There are known issues in authentic assessment design practices in digital education, which include the lack of freedom-of-choice, lack of focus on the multimodal nature of the digital process, and shortage of effective feedbacks. This study looks to identify an assessment design construct that overcomes these issues. Specifically, this study introduces an authentic assessment that combines gamification (G) with heutagogy (H) and multimodality (M) of assessments, building upon rich pool of multimodal data and learning analytics (A), known as GHMA. This is a skills-oriented assessment approach, where learners determine their own goals and create individualized multimodal artefacts, receive cognitive challenge …

Evaluation Education In A World In Transformation: The Way Forward, Marcia Paterno Joppert

CGU Theses & Dissertations

The world has experienced rapid changes, leading to pressing issues such as environmental degradation, social inequality, and resource depletion. As a transdisciplinary field, evaluation has emerged as a crucial tool in addressing these challenges and promoting systemic change. However, concerns have been raised regarding the field's capacity to meet these expectations and the existing gaps in evaluation education. This research aims to address these gaps by exploring how formal evaluation education programs (EEPs) respond to the preparation of professionals for systems change evaluations, prompting discussions on the need to redefine the approach to teaching evaluation. The study adopts a sequential …

Preparing For The Future: A Collaborative Design For High-Quality Career And Technical Education Programming, Shannon Rodriguez

Education Theses and Dissertations

Educators in public education as faced with preparing students for college and career after high school graduation. The collaborative efforts of Career and Technical Education programming allows for the development of a high-quality program through exploring non-traditional teacher use goal setting and pedagogy provide a foundation of success for students.

The Application Of Interpersonal Concepts To Reframe Instructor Misbehaviors, Jonathan A. Mendoza

All Graduate Theses, Dissertations, and Other Capstone Projects

The research literature surrounding instructor misbehaviors has been largely influenced by two typologies of misbehaviors. Kearney et al. (1991) introduced the first typology of instructor misbehaviors, which included incompetence, offensiveness, and indolence. Goodboy and Myers (2015) later revisited this initial typology, finding additional misbehaviors that reflected changes in the classroom climate, including antagonism and misbehaviors enacted during lectures. Much of the research on instructor misbehaviors utilizes these typologies, using a framework of interpersonal theories as a means of understanding instructor misbehaviors. In my review of the literature, common theories applied included expectancy violations theory, communication privacy management theory, and attribution …

Evaluating The Differential Effects Of Using A Technology-Based Antecedent Intervention In Comparison To A Technology-Based Treatment Package, Rachel Fosnaught

Theses and Dissertations--Early Childhood, Special Education, and Counselor Education

This study investigated the differential effects of using non-contingent reinforcement in the form of attention as an antecedent intervention in comparison to using non-contingent reinforcement in addition to self-monitoring as a treatment package. A multi treatment single case research design was utilized in this study. Levels of student’s on-task behavior were measured to evaluate the differential effects of an antecedent intervention in comparison to the combination of an antecedent and consequent intervention. This study also only used treatments that were technologically delivered to the participants.

A Qualitative Case Study On Perceived Readiness For The Diffusion Of Blended Learning In Tvet Institutions In Jamaica, Roxanne M. Hinds

Theses and Dissertations

Blended learning is seen as a promising innovative instructional approach for Technical Vocational Education and Training (TVET) institutions to reduce costs, increase flexibility, and reach marginalized learners in developing countries. However, lack of understanding about how key stakeholders who are expected to adopt and implement the innovation perceive readiness for the innovation can make it difficult for institutions to maximize its benefits. This qualitative case study sought to understand the perceptions of students, instructors, and administrators about the readiness of the key stakeholder groups, institutions, and the organization for blended learning and the role of readiness in the diffusion process. …

Equity And Equality In Learning In Asia-Pacific: What Do Results From Large-Scale Assessments Tell Us? Gender In Focus Policy Brief, Syeda Kashfee Ahmed, Anna Dabrowski, Jacqueline Cheng, Victoria Klimova, Isabella Mccallum

Global education monitoring

This policy brief investigates gender disparities in learning outcomes and the factors contributing to these disparities as identified in large-scale assessment data in Southeast Asia. It additionally provides a set of recommendations aimed at enhancing equitable student learning outcomes while advocating for comprehensive support of gender-based interventions within educational quality initiatives, spanning both systemic and school-level support. The findings presented in this brief are drawn from large-scale assessment (LSA) datasets and secondary analysis of these sources. For more detailed information regarding the large-scale assessments in Southeast Asia, please refer to the appendix section.

Authentic Learning Design Failures: The Need For Learner And Contextual Analysis And Participatory Design, Mohan Yang, Jon Harbor

STEMPS Faculty Publications

This design case examines what program leaders learned from failures in the design of a program of authentic learning about teaching diverse audiences through educational outreach. The program was initiated and then redesigned to develop the teaching and communication skills of graduate students from a wide range of backgrounds by engaging them in authentic experiences with middle school teachers and students. Analysis of post-program data revealed seven design failures related to the lack of upfront analysis to inform the program design. Each design failure was detailed through a fishbone diagram method to identify the corre- sponding contributing factors. The failures …

A Multilevel Nonlinear Approach Of Piecewise Regression For Detecting Turning Points: Developing An Alternative Platform With An Application Of Timss, Jing Zhang

Theses and Dissertations--Education Sciences

Studies in recent years have explored the methods of identifying the turning points when dealing with the non-linear relationship. Four approaches applied by researchers, the eyeball approach, the establishment approach, the theory-driven approach, and the data-driven approach, are all under the traditional piecewise regression framework when seeking turning points. Thus, the purpose of this study is to introduce a multilevel piecewise regression model to identify the turning point beyond the traditional piecewise regression, as a completely non-linear approach.

Data used for this study is TIMSS 2019 United States sample. TIMSS is a project guided by the International Association for the …

Professional Learning Communities Effectiveness On Teacher Learning As Perceived By Title I Elementary Teachers: A Case Study, Tiffany Nicole Baisden

Theses and Dissertations

Professional learning communities (PLCs) have undergone decades of research as an improvement strategy for schools. PLCs are known to foster a collaborative culture among educators through shared learning. Teachers can improve their effectiveness by strengthening their pedagogical practices, which will have a positive impact on student achievement. The purpose of this bounded case study was to examine how Title I elementary school teachers who participated in a PLC perceived PLCs and their effectiveness on improving teacher learning. The goal was to gather teachers’ insights and experiences of PLCs to provide state, district, and school leaders with an understanding of how …

Acer 2020-2021 Annual Report, Australian Council For Educational Research (Acer)

ACER Annual Reports

No abstract provided.