Educational Assessment, Evaluation, and Research Commons^™

واقع الممارسة المَبْنية على الأدلة في مقررات مناهج البحث العلمي لبرامج الدراسات العليا في الكليات الإنسانية بجامعة السلطان قابوس: دراسة استكشافية, Naifa Eid Bait Saleem

Journal of the Association of Arab Universities for Research in Higher Education مجلة اتحاد الجامعات العربية للبحوث في التعليم العالي

هدف المقال استكشاف واقع ظهور "الممارسة المبنية على الأدلة " Evidence Based Practice " في مقررات مناهج البحث العلمي ببرامج الدراسات العليا بكليات العلوم الإنسانية في جامعة السلطان قابوس: الآداب والعلوم الاجتماعية، الاقتصاد والعلوم السياسية، التربية، والحقوق. ولتحقيق هدفت الدراسة فتم استخدام المنهج الاستكشافي وطبَّقتْ أداة تحليل المحتوى لجمع البيانات من المقررات الدراسية التي شكلت مجتمع الدراسة. وتكون مجتمع الدراسة من 27=28% برنامجًا للماجستير بكليات العلوم الإنسانية الأربعة، و10= 27% برنامجًا على مستوى درجة الدكتوراة. توصلت الدراسة إلى أن الممارسة المبنية على الأدلة موجودة واقعيًا في مقررات الدراسات العليا للكليات الإنسانية بجامعة السلطان قابوس، لكن ظهورها كان في برنامجين فقط …

تقييم مطابقة مقياس متعدد الأبعاد لرضا الطلبة عن الحياة الجامعية باستخدام نظرية الاستجابة للفقرة, Jomanah Mete'b Baniissa, Nermeen Nedal Al Shraifin

Journal of the Association of Arab Universities for Research in Higher Education مجلة اتحاد الجامعات العربية للبحوث في التعليم العالي

هدفت المقال الكشف عن مدى مطابقة مقياس متعدد الأبعاد لرضا الطلبة عن الحياة الجامعية باستخدام نموذج الاستجابة المتدرجة لنظرية الاستجابة للفقرة. ولتحقيق هدف الدراسة تم استخدام المنهج الوصفي، ووزع المقياس على عينة مكونة من (781) طالبًا وطالبةً من مجتمع الدراسة، اختيروا بالطريقة المتيسرة من مختلف الكليات العلمية والإنسانية في الجامعات الحكومية الأردنية في شمال المملكة، استبعد منهم 81 طالباً وطالبة إما لعدم اكتمال استجاباتهم على فقرات الاستبانة أو لنمطية الاستجابة، أظهرت نتائج التحليل العاملي الاستكشافي لأبعاد المقياس تحقق افتراض أحادية البعد لكل بعد من أبعاد المقياس الأربعة، كما تم التحقق من افتراض الاستقلال الموضعي، وتم التحقق من افتراض مطابقة الأفراد …

Creating Assessment Rubrics For Final Teacher Education Degree Projects: A Qualitative Case Study, Carla Fernández Garcimartín, Víctor Manuel López Pastor, Teresa Fuentes Nieto, David Hortiguela Alcalá

The Qualitative Report

This paper analyzes the process of creating the assessment instruments for the Final Year Project (FYP) by education faculty based on the opinions of the lecturers. Qualitative methodology was used, with a case study design and the in-depth interview as a data collection technique. Four lecturers participated as relevant informants. The results show that: (a) the faculty decided to create the instruments due to the lack of clear assessment criteria among the lecturers in the first years (2009-2015); (b) work was carried out on three assessment instruments over two years (2015-2017): a tutor's report (without grade), a document rubric (80% …

Bridging The Gap Between Neuroscience And Education: What Are Teachers’ Perceptions Of Applying “Neuropedagogy” To High School Classrooms?, Hanan Rashwan

Theses and Dissertations

Teachers can use neurobiological explanations to evaluate students' behavior and performance and create more supportive learning settings in their school environment. There is a growing interest among educators regarding the potential benefits of incorporating neuroscience into teaching practices. However, there is a lack of comprehensive understanding of how to effectively integrate cognitive neuroscience into teacher education programs to maximize its impact on student learning and teacher development. This study focuses on understanding teachers' views on the integration of neuroscience principles in educational settings by utilizing a questionnaire and interviews to gather data from participating teachers. The findings reveal that the …

Children’S University In Australia And New Zealand: Reach And Impact, Katherine Dix, Shani Sniedze, Tamara Van Der Zant

Higher education research

This report presents a comprehensive overview of the reach and impact of Children’s University in Australia and New Zealand. The Australian Council for Educational Research compiled available evidence to consolidate the evidence of the Children's University outreach program's extent and influence across the Australasian partnership. The independent evaluation synthesises information from existing research, reports, operational data, social media, and other documentation to provide a current snapshot of the Children's University's reach and impact, guided by the following research questions. How is the program underpinned by evidence-based best practice? What is the reach of the program in Australia? What does the …

Who Gets To Decolonize: A Reflection On The Importance Of Positionality In The Decolonization Of Digital Learning Spaces And Learning Design, Rebecca Y. Bayeck, Tutaleni Iita Asino

Instructional Technology and Learning Sciences Faculty Publications

Decolonization as a term and concept gained prominence in the 20th century as new nations emerged from the cessation of the global colonial project which primarily saw European countries occupying different parts of the world. In modern times, interests in decolonization have taken different forms, particularly in learning design and digital learning spaces. In the digital space, researchers mainly suggest introducing indigenous perspectives and cultural lenses in the design of digital learning environments and the design of emerging technologies that embed indigenous perspectives (Nede, 2023). This reflexive essay discusses the importance of positionality in digital learning spaces and learning/instructional design. …

Effects Of Plc At Work In Arkansas On Academic Outcomes, Sarah Mckenzie, Kate Barnes, Charlene Reid

Policy Briefs

This study evaluates the impact of Solution Tree’s Professional Learning Communities (PLC) at Work model on the academic achievement and growth of students in Arkansas schools. It provides the first large-scale evaluation of the PLC at Work model’s effectiveness in improving student academic outcomes. Using publicly available data from the Arkansas Department of Education (ADE), the analysis uses a two-stage matching process and an event study framework to determine the effectiveness of PLC at Work across six cohorts. The findings hold significant implications for policymakers, educators, and researchers interested in leveraging professional development to enhance educational practices and student outcomes. …

Understanding Non-Designers' Practices And Processes In A Human-Centered Design Course, Luettamae Lawrence, Saadeddine Shehab, Mike Tissenbaum

Instructional Technology and Learning Sciences Faculty Publications

Human-centered design (HCD) has been identified in the literature as a useful problem-solving approach for learners. However, learning and applying HCD poses several challenges for students who are unfamiliar with this form of learning. In this paper, we analyse how a novice design team worked on a HCD class project to examine how non-designers learn about and integrate HCD practices into their project. We introduce the HCD taxonomy to define the processes and practices that students engage in. The team’s design work is triangulated across multiple data sources and revealed three challenges for engaging non-designers in HCD: 1) the need …

Professional Learning Communities And Student Outcomes: A Quantitative Analysis Of The Plc At Work Model In Arkansas Schools, Kate Barnes, Sarah Mckenzie

Arkansas Education Reports

This study evaluates the impact of the Professional Learning Communities (PLC) at Work model on student achievement and growth in Arkansas schools. Implemented through a partnership between the Arkansas Department of Education and Solution Tree, the program promotes collaborative professional development among educators. Using a matching process and an event study framework, we analyze longitudinal data on student performance in English Language Arts (ELA) and mathematics from multiple cohorts of schools.

The overall results reveal mixed outcomes. While no statistically significant improvements were observed in overall student achievement or growth, there were concerning trends for economically disadvantaged students. This subgroup …

Medmicromaps, A Novel Decision-Tree Guide For Infectious Diseases Differential Diagnoses, And Evaluation Of Pre- And Post-Pandemic User Engagement By Preclinical Medical Students, Jason Ceballos, Tavsimran Luthra, Lucia Garces-Torres, Valerie Lentz, Jack Nelson, Claudia Carceles-Roman, Ian Holyoak, Jane Harrington

International Journal of Emerging and Disruptive Innovation in Education : VISIONARIUM

Background: Medical education has undergone major changes in the past 5 years to adapt to the digital-centered student population with diverse learning preferences. To address the challenges of shifting delivery modalities, multimedia resources were created to provide interactive e-learning material on infectious diseases for year 2 medical students.

Methods: Medical students at a USA-accredited Caribbean medical school were provided with supplemental e-learning materials including animations, illustrations, diagnostic algorithms aka MedMicroMaps, and Case-Based tutorials. Participants were classified by semester and lecture delivery: In-person: Cohort 1 (n=526); Virtual: Cohort 2 (n=651); and Hybrid: Cohort 3 ( …

Developing Cultural Humility Through The Arts: Evaluating An Arts Intervention For Healthcare Provider Leaders, Katie L. Nickel

USF Tampa Graduate Theses and Dissertations

At all levels of healthcare, providers are experiencing rising levels of professional burnout. For healthcare provider leaders, burnout is particularly critical since leaders must maintain healthy and trusting relationships with patients and their teams of healthcare professionals. This utilization-focused evaluation study explores an arts intervention program designed to promote cultural humility among healthcare providers. Increased cultural humility may provide coping tools for healthcare providers to ward off burnout. The arts intervention took place over three sessions: one at a museum, one virtual, and one at a hospital. Four types of data were collected including a quantitative pre- and post-survey, observation …

Teachers’ Knowledge And Preparedness For Retirement: Results From A Nationally Representative Teacher Survey, Dillon Fuchsman, Josh B. Mcgee, Gema Zamarro

Education Reform Faculty and Graduate Students Publications

Adequately preparing for retirement requires planning and knowledge about available savings and investment options. Teachers participate in a complex set of plan designs, and many do not participate in Social Security. While teachers represent a large part of the public workforce, relatively little is known regarding their knowledge and preparation for retirement. We administered a survey to a nationally representative sample of teachers through RAND’s American Teacher Panel and asked teachers about their retirement planning and employer-sponsored retirement plans. We find that while most teachers are taking steps to prepare for retirement, many teachers do not currently possess the basic …

Fostering Self-Reflection On Library Instruction: Testing A Peer Observation Instrument Focused On Questioning Strategies, Eric Silberberg

Publications and Research

This study demonstrates that a library instruction observation instrument can effectively foster critical self-reflection among academic library faculty and staff on their teaching practices. The paper outlines the instrument's design, which gathers low inference observations on instructors’ use of questioning as a pedagogical strategy based on recommendations from the LIS and education literature. To test and refine the instrument's design, the instructors’ utilised the instrument to collect data from classes taught by five participating instructors, who, during post-observation interviews, engaged in thoughtful reflections on their class planning, student participation, and teaching philosophy. They also provided valuable critiques of the usefulness …

The Importance Of Art Programming For Underserved Youth, Aja Delgado

Masters Theses

Arts programming for underserved youth holds great significance in fostering holistic development, empowerment, and a creative outlet for students. This thesis dives into the importance of such initiatives by addressing the multifaceted needs of marginalized communities.The arts serve as a catalyst for self-expression, creativity, and emotional well-being, offering a platform for individuals to explore their identities and narratives. For underserved youth facing socio-economic challenges, access to arts programming can be transformative, providing avenues for personal growth, and empowerment. Through collaboration, exploration and experimentation I’ve investigated the ways in which underserved youth can benefit from artmaking, through a collaborative workshop titled …

Community Engagement In Art & Design Colleges, Mah Rukh Raja

Masters Theses

This thesis titled ‘Community Engagement in Art & Design Colleges: Case Studies from Pakistan’ highlights the importance of community-engaged practices in education, specifically within the realm of art and design, and examines the effect of community engagement on student learning. It focuses on the importance of creating opportunities for reciprocal, community-engaged learning where responsibilities, roles and credit are shared equally among students, community partners, and educational institutions to develop projects that are in the best interest of communities.

This research coincides with the introduction of community and civic engagement in undergraduate education in Pakistan. Its primary objective is to serve …

Your International Education Matters, Marina Chakmakchi Mppm, Ll.M.

Global Talent Navigator

Flyer that will be helpful to prospective students seeking credential evaluation.

Evaluation Of The Smiling Mind Primary School Program 2023, Tamara Van Der Zant, Katherine Dix, Toby Carslake

Wellbeing

In its various forms, the Smiling Mind Primary School Program (the Program) has been delivered in Australian schools since 2016. The Program is a mindfulness-based social and emotional learning (SEL) program designed for primary school students in Years 1 to 6. It aims to support the mental wellbeing and emotional resilience of students. The Program offers an online, digital, curriculum, delivered by trained classroom educators, that incorporates practices and techniques to help students develop skills for managing stress, building resilience, and enhancing their overall mental health.

The Program was delivered to 733 schools in 2023, and due to the ongoing …

Learning Through Play At School Ukraine: Final Research Report (Ukrainian Version), Rachel Parker, Amy Berry, David Jeffries, Prue Anderson, Oksana Zabolotna

Student learning processes

The Learning Through Play (LTP) at School Research Study Ukraine was a four-year intervention study funded by the LEGO Foundation and implemented by the Australian Council for Educational Research (ACER) and the Ukrainian Educational Research Association (UERA). The intervention was a two-year professional learning program that blended online, and face-to-face learning called the Teacher Innovative Play Program (TIPP). The TIPP was designed based on documented evidence that reports that teachers need opportunities to experiment and reflect to change practice. The study was guided by three research questions which were revised following the full-scale invasion of Ukraine by Russian armed forces …

Learning Through Play At School: Ukraine, 2019-2024 (Ukrainian Version), Rachel Parker, Amy Berry, Kellie Picker, David Jeffries, Prue Anderson, Oksana Zabolotna

Student learning processes

The Learning Through Play at School Research Study Ukraine was a four-year longitudinal intervention study funded by the LEGO Foundation and implemented by the Australian Council for Educational Research (ACER) and the Ukrainian Educational Research Association (UERA). The study was implemented between 2019 and 2024, during COVID-19 and the full-scale invasion of Ukraine by Russian armed forces. Despite, at times, insurmountable challenges, the professional learning intervention was successful in supporting most teachers to progress from a surface level understanding of learning through play to a deep level. In addition, almost all children’s literacy and social-emotional skills grew significantly from start …

Gender Disparity In Students’ Performance Of Science And Mathematics: Evidence From Nationwide Study In Pakistan, Sadia Muzaffar Bhutta, Aisha Naz Ansari, Sohail Ahmad

Institute for Educational Development, Karachi

Gender disparity in science and mathematics performance is being researched internationally. In a complex education system, like Pakistan, studying the difference in isolation may not generate holistic understanding. Therefore, this paper investigates changes in trends of performance in Science and Mathematics for both genders across public and private schools. Data were gathered from a nationwide sample of elementary grades students (n=15,391) using SATs/MATS. Independent t-test and two-way-ANOVA were employed to analyse data. Results revealed that girls outperformed boys in Science (p<0.01) while no gender differences in performance were observed in Mathematics. Gender and school systems demonstrated significant interaction effect only in mathematics, unveiling that girls perform better in public schools while this difference diminished in the private school system. The results show implications for employing gender-fair policies and practices in science and mathematics education.

Estimating And Applying Parameters Necessary To Plan Cluster Randomized Trials (Crts) And Multisite Cluster Randomized Trials (Mscrts), Dea Mulolli

Dissertations

Cluster randomized trials (CRTs) are commonly used to study the effectiveness of educational interventions. During the design phase of a study, it is critical for researchers to ensure their studies are adequately powered to detect meaningful treatment effects, including both main and moderator effects. Designing CRTs with adequate power to detect main and moderator effects requires accurate estimates of design parameters. This research aims to advance the literature on design parameters for power analyses, specifically focusing on empirical estimates of intraclass correlations (ICCs). The work consists of three research papers that examine the role of including the teacher level in …

Poetry In Teaching & Learning Qualitative Research, Amber Mullens, Audra Skukauskaite, Megan K. Mitchell

The Qualitative Report

This article stems from a workshop presented at the 15th TQR conference on poetry in teaching and learning qualitative research. Over the last few decades, scholars have argued for the use of poetry and other arts-based techniques in qualitative research. Most of the research, however, focuses on using poetry for data analysis and representation. In this article, we shift the conversation to the use of poetry for teaching and learning qualitative research. Starting with a poem in three voices of educator, student, and researcher, we provide an overview of poetry use in qualitative inquiry. We then offer brief overviews of …

A Multi-Tiered Mentoring Community Approach To Research Experiences For Local Students From Disadvantaged And Underrepresented Minority Backgrounds, Thomas Mckean, Lashall Bates, Gary Bates, Jacquelyn D. Wiersma-Mosley, S. Ranil Wickramasinghe

Chemical Engineering Faculty Publications and Presentations

Introduction: A research and mentoring program was developed to provide local first-generation students, students returning to school after a professional experience, and underrepresented minority students resources and relationships to guide them toward a STEM degree from a four-year university.

Methods: A multi-tiered mentoring community was formed including direct mentoring from graduate students and faculty advisors, peer mentoring among undergraduate students from different colleges and universities, and high school students to increase the accessibility of research opportunities for this demographic. Local students were recruited from Northwest Arkansas Community College and Upward Bound to combine community college and high school students in …

Applying An Intersectional And Multi-Systemic Level Approach To Adei Institutional Assessments In Social Work Higher Education, Diana A. Melendez

Dissertations, Theses, and Capstone Projects

Institutional Anti-racism, Diversity, Equity and Inclusion (ADEI) tools and assessment models are needed to support schools of social work in demonstrating compliance with the Council on Social Work Education’s (CSWE) 2022 Educational Policy and Accreditation Standards (EPAS). This study develops a new tool and model for ADEI institutional assessment in social work higher education using a collaborative, intersectional and multi-systemic level approach. The primary aim of the project was to develop and test a new tool to gather and document experience(s) of coloniality within a social work higher education institution, from multiple stakeholders’ perspectives, as a usable model of ADEI …

An Examination Of The Relationship Between Instructional Modality And Pedagogy Licensure Exam Scores In Post-Baccalaureate Educator Preparation Programs In Indiana, Kelly Eckel

Dissertations

The efficacy of the modality of instruction employed in higher education institutions has been a point of contention among students, faculty, administration, and other stakeholders in the educational realm. Since the COVID-19 pandemic, online and hybrid instruction has become a valued and desirable option for Educator Preparation Programs (EPPs) to offer for recruitment and retention purposes. The effectiveness of varying modalities in relation to teacher licensure exams has been limited in research and can serve as a critical quantitative measure for EPPs to assess. This longitudinal study examined the relationship between instructional modality and pedagogy teacher licensure exam scores in …

The Fourth Wall Of Dialogue: A Co-Constructive Collaboration On Bipoc Student Sense Of Belonging In Higher Education, Valarie Lindsey

Dissertations

Black, Indigenous, People of Color (BIPOC) students’ sense of belonging (SOB) at higher education institutions has decreased over the last 30 years despite numerous initiatives aimed at increasing a sense of belonging for this group of students and addressing the challenges they face from various intersectionalities including cultural biases, gender marginalization, and racial subjectivities. Sense of belonging is often subjective in nature because it refers to an individual's lived experience, it is important for higher education institutions to tailor their Diversity, Equity, and Inclusive (DEI) initiatives to meet the needs of the students on their campus. This initiative should include …

A Program Evaluation Of 3de Schools By Junior Achievement, Audra Lewis-Hoesch

Dissertations

3DE Schools by Junior Achievement is a framework for instruction designed to reshape the instructional ecosystem through a high school model that uses project-based learning and case-study methodology to help students acquire core competencies. The context of this inquiry includes various states in America where 3DE Schools are implemented. I utilized a mixed methods approach to collect data and gauge the influence of the 3DE instructional framework on students' readiness for college and career pursuits. Key outcomes showed that students in 3DE cohorts scored higher in math and English than the national average, contributing to an overall higher graduation rate …

Senior Exit Interview, Brendon Pedro Duran

Construction Management

The goal of this project was to provide graduating seniors in construction management a means to share their opinions on the department and offer potential solutions that could improve the student learning experience. Prior to COVID, the senior exit interview filled this need, but it was run by faculty and has not been repeated since 2021. The discussion was structured to cover the three topics that constitute the student experience: curriculum, student-run clubs and teams, and industry recruitment. Prior to the event, a dozen in-person interviews were conducted with graduating seniors to better understand what topics should be included in …

Adaptations And Transformations: Perceptions Of Change In Academic Motivation, Resilience, And Covid-19 Stress, Ella V. Gregorio

Dissertations, Theses, and Capstone Projects

Of concern to educators, post-COVID-19 assessments have revealed significant achievement gaps in student performance, as well as significant decreases in adolescent mental health. Less is known about changes in achievement motivation. Here we ask how students perceive their own motivation and whether it changed between “before” the pandemic to the present (Fall 2022 - Spring 2023), about three years after the beginning of the pandemic when many school routines were returning to “normal.” To understand how variance in these perceived changes might be related to pandemic-related stressors, trait resilience, and current mental health, we conducted a large survey study (N …

Factors That Impact New York City Public High School Graduation: Finding Barriers To Education Through Data Analysis And Visualization, Kyoung Kang

Dissertations, Theses, and Capstone Projects

This capstone project is to provide visual evidence about the factors related to high school graduation rates of New York City public high school students. By analyzing the NYC public high school data, including graduation rates, school survey results, and school funding allocations, this project explores the graduation gaps among different student bodies, such as ethnic groups and school locations. The graduation disparities across the five boroughs are further examined for students with disabilities, economic difficulties, and language barriers. School-level data is used to visualize the gaps in school performances and funding allocations across the five boroughs. Lastly, the visualization …