Educational Assessment, Evaluation, and Research Commons^™

The Alchemy Of Assessment And Evaluation, Jessica Kahlow

Mavs Open Press Open Educational Resources - Archive

This comprehensive guide illuminates the art and science of educational assessment, blending ancient alchemical wisdom with modern AI innovations. Part one lays the foundation, exploring essential principles of assessment and evaluation and its pivotal role in shaping learning outcomes. Part two delves into diverse assessment types, from formative assessments driving real-time adjustments to summative evaluations measuring overall achievement. Part three offers expert guidance on crafting effective assessment designs, ensuring authenticity and inclusivity. Part four examines the alchemy of feedback and grading, empowering educators with strategies for constructive engagement and growth. Part five focuses on evaluations, showcasing methods to assess program …

Cultural Competence And Cultural Humility Among Healthcare Students Related To Community Engagement And Service Learning: A Multiple Regression And Confirmatory Factor Analysis Study, Maryanne Koech Gathambo

Doctoral Dissertations and Projects

The purpose of this quantitative, hierarchical multiple regression and confirmatory factor analysis study was to investigate the cultural humility and cultural competence (competemility) of healthcare students and examine the strongest predictor of cultural competemility based on demographic and experiential learning factors. Hierarchical multiple regression was used to investigate the degree to which the predictor variables age, gender, and community engagement/service hours (i.e., CEL/SL) could be forecasted by their competemility score (criterion variable) as measured by The Inventory for Assessing The Process Of Cultural Competemility Among Healthcare Professionals (IAPCC-HCP). Data were obtained from a criterion-based purposive sample of 70 survey participants …

Building For Success? Ninth-Grade Course Failures And School Configurations, Sarah Ruth Morris, Sarah C. Mckenzie

Mid-Western Educational Researcher

This research study investigates the influence of school building configurations on the likelihood of ninth-grade student course failure. We analyze data from the 2017-18 and 2018-19 school years in Arkansas, and we categorize buildings as “Non-transitional,” “Focus,” or “Traditional.” Employing logistic regression models and interaction terms, our research finds that ninth-grade students are less likely to fail in “Focus” building configurations compared to “Non-transitional” and “Traditional” building configurations. Moreover, we find economically disadvantaged ninth-grade students are less likely to fail when they attend “Focus” buildings than “Non-transitional” or “Traditional” buildings. Our findings emphasize the importance of interventions and policy adjustments …

The Adventures Of Trans Educators: A Comic Book Issue

Occasional Paper Series

Through remarkable comic book illustrations, issue #52 of the Occasional Paper Series presents authentic, nuanced stories about the experiences of trans educators working with children from preschool through high school. This visually engaging format brings these stories to life and invites readers to connect more deeply with the unique journeys of trans educators.

Your Roots Are Showing (Spanish) Se Te Ven Las Raíces, Daniel Gallardo, Martín Pech

Occasional Paper Series

No abstract provided.

A Light In Dark Times: In Overt Defense Of Trans-Affirming Spaces In Education, James F. Woglom, Stephanie Jones, Dylan Brody

Occasional Paper Series

No abstract provided.

More Than, Nora Borre, Farra Yasin

Occasional Paper Series

No abstract provided.

Your Roots Are Showing (English), Daniel Gallardo, Martin Pech

Occasional Paper Series

No abstract provided.

Socrates And Me, Per Sia, Ali R. Blake

Occasional Paper Series

No abstract provided.

Always Been (English), Yarrow Koning, Sofía Abreu

Occasional Paper Series

No abstract provided.

Always Been (Spanish) Siempre Hemos Sido, Yarrow Koning, Sofía Abreu

Occasional Paper Series

No abstract provided.

Ten Year Reunion, Owen Dempsey, Jet Lepper

Occasional Paper Series

No abstract provided.

How's Teaching Going?, Sam Long, Quan Phan

Occasional Paper Series

No abstract provided.

Introduction: The Adventures Of Trans Educators: A Comic Book Issue, Harper B. Keenan, Lee Iskander, Rachel Marie-Crane Williams

Occasional Paper Series

Through our work in teacher education and trans advocacy, the three of us (Harper, Lee, and Rachel) are lucky to regularly hear about the important work trans educators do every day. Whether it’s helping students to organize gender and sexuality alliances, mentoring trans youth, working with teachers’ unions to improve health care benefits for people of all genders, or simply showing up to school and being present for their students, there is no doubt that trans educators are making important and necessary contributions to learning environments across North America and beyond.

Scholar Perspectives On The Impact Of A Scientific Community Program For Neurodivergent Undergraduate Stem Scholars, Dylan Sullivan, Fernando Zavala, Derek Hidalgo, Jacob Stolle, Rebecca Matte, Christin B. Monroe

Journal of Science Education for Students with Disabilities

Despite the adaptive strengths and unique problem-solving skills demonstrated by neurodivergent (ND) individuals, they remain underrepresented in Science, Technology, Engineering and Mathematics (STEM) fields. High unemployment rates among individuals with disabilities emphasize the need for addressing barriers to entry and persistence in the workforce. This study introduces a program designed to enhance opportunities for neurodivergent STEM scholars with financial needs, supported by the National Science Foundation (NSF). The program involves: 1) a weekly cohort course to engage in professional development, 2) use of the Birkman Method® survey to help scholars identify and communicate strengths, fostering self-awareness and growth, and 3) …

Wellbeing And Working Conditions In The Arkansas Teacher Workforce, Gema Zamarro, Josh B. Mcgee, Meredith Schellhase

Education Reform Faculty and Graduate Students Publications

• To better support a healthy teacher workforce, it is crucial to understand their job satisfaction, stress, and intentions to leave the profession.
• While most Arkansas teachers (86%) report being satisfied being an educator, we identify several potential areas for improvement.
• Teachers report that managing student behavior is their primary source of stress.
• Thirteen percent (13%) of teachers reported they plan to leave their current school.
• When asked why they were considering leaving their current school, teachers reported feeling unsupported, lacking influence over school policies, and insufficient planning time.
• Regular assessments of teacher well-being and job satisfaction can help us identify …

Examining Emergency Remote Teaching And Undergraduate Academic Outcomes During The Pandemic, Melissa S. Ramge

USF Tampa Graduate Theses and Dissertations

The COVID-19 pandemic represented an extraordinary public health emergency, leading to the most profound disruption to education systems in modern history. As higher education institutions expand their post-pandemic online course catalogs, it is necessary first to explore the student outcomes and student perceptions of learning related to the pandemic. This study used an explanatory sequential mixed methods research design to assess the relationship between the COVID-19 pandemic and students’ perceptions of online learning. The purpose of the study was to examine what, if any, trends in undergraduate student course grades and student perceptions of the instruction occurred coincident with the …

Real-World Assessment (Rwa): Validity Evidence For Cataract Surgery With A Tool Your Faculty Will Actually Use, Grace L. Paley, Hui Zhao, Victoria M. Addis, Casey J. Beal, Geetha K. Davis, Gabriela M. Espinoza, Michael S. Lee, Stacy L. Pineles, Jamie B. Rosenberg, Robert T. Swan, Misha F. Syed, Evan L. Waxman, Susan M. Culican

Journal of Academic Ophthalmology

Background: We developed and implemented a real-world assessment tool (RWA) for resident surgery. It was designed to improve utility by reducing faculty and trainee cost (completion and training time, cognitive burden). RWA uses an entrustability scale where higher scores indicate a resident’s readiness for independent surgical practice. We describe a two-phase implementation of RWA and report validity evidence for cataract surgery assessment.

Methods: RWA was developed iteratively with resident and faculty input and piloted at a single residency program in phase 1. Phase 2 implemented RWA at 11 ophthalmology residency programs. The main outcome measures were 1) number …

Imitasd: Imitation Assessment Model For Children With Autism Based On Human Pose Estimation, Hany Said, Khaled Mahar, Shaymaa E. Sorour, Ahmed Elsheshai, Ramy Shaaban, Mohamed Hesham, Mustafa Khadr, Youssef A. Mehanna, Ammar Basha, Fahima A. Maghraby

Instructional Technology and Learning Sciences Faculty Publications

Autism is a challenging brain disorder affecting children at global and national scales. Applied behavior analysis is commonly conducted as an efficient medical therapy for children. This paper focused on one paradigm of applied behavior analysis, imitation, where children mimic certain lessons to enhance children’s social behavior and play skills. This paper introduces IMITASD, a practical monitoring assessment model designed to evaluate autistic children’s behaviors efficiently. The proposed model provides an efficient solution for clinics and homes equipped with mid-specification computers attached to webcams. IMITASD automates the scoring of autistic children’s videos while they imitate a series of lessons. The …

Unraveling The Impact Of Cognitive Test Anxiety On Academic Performance Among Adolescents: The Case Of Minority And Majority Communities, Zulfiqar Ullah Siddiqui, Wael M. F. Abuhassan

An-Najah University Journal for Research - B (Humanities)

Background: Within the Indian society and its many communities, adolescents exhibit a wide range of individual differences, including cognitive abilities, learning styles, and personality traits. These differences can influence how students perceive and cope with test anxiety and related stress. Objective: The primary goal of this research study was to investigate the influence of cognitive test anxiety on academic performance in adolescents from both minority (Muslims) and majority (Hindus) communities in India. Method: Based on descriptive-inferential research design, a sample of 450 students was selected, with 223 students representing the majority community and the remaining 227 students representing the minority …

General Practice Training In Australia: National Report On The 2024 National Registrar Survey, Rebecca Taylor, Leyna Clarke, Michelle Hsien, Ali Radloff

Higher education research

The General Practice National Registrar Survey (GP NRS) is an annual, national survey of GP registrars currently training in Commonwealth funded trainings programs which include Australian General Practice Training (AGPT), Remote Vocational Training Scheme (RVTS) and Rural Generalist Training Scheme (RGTS) programs (prior to 2024, it was only carried out with AGPT registrars). It collects information via an online questionnaire about GP registrar satisfaction, experience and future career plans. It also collects information about GP registrars’ demographics and training contexts and other aspects of their training experience. This survey is part of the Department of Health and Aged Care’s (the …

Unlocking College Potential: The Role Of Student Expectations And Non-Cognitive Skills In College Success, Gema Zamarro, Malachi Nichols, Julie R. Trivitt, Rian Djita

Education Reform Faculty and Graduate Students Publications

Attending college is a significant human capital investment but only about 60% of those who start college will have a completed degree six years later. This makes identifying the skills associated with college success an important policy concern. We surveyed over 1,100 entering college freshmen, majoring in business and engineering at a public university in the US, and combined this information with administrative data to create a comprehensive data set that, in addition to the usual academic performance data, cognitive ability measures, and demographics, also included measures of non-cognitive skills, personality traits, student expectations about college success and performance at …

The Impact Of Oer’S Continuous Improvement Cycles On Students’ Performance: A Longitudinal Analysis Of The Rise Framework, Daniela Castellanos-Reyes, Sandra L. Carmago Salamanca, David Wiley

Entrepreneurship Faculty Research

Open educational resources (OER) have been praised for revolutionizing education. However, practitioners and instructors battle keeping OER updated and measuring their impact on students’ performance. Few studies have analyzed the improvement of OER over time in relation to achievement. This longitudinal study uses learning analytics through the open-source Resource Inspection, Selection, and Enhancement (RISE) analysis framework to assess the impact of continuous improvement cycles on students’ outcomes. Panel data (i.e., performance and use) from 190 learning objectives of OER of an introductory sociology course were analyzed using a hierarchical linear model. Results show that more visits to an OER do …

Art Teams Year 3 Report, Guy Trainin, Hyeonjin Yoon, Azadeh Hassani, Zohreh Tamimdari, Jiabin Lyu, Kimberley D'Adamo, Gretchen Larsen, Elizabeth Valerio-Boster, Michael Nti Ababio, Sarah Trainin

Research and Evaluation in Education, Technology, Art, and Design

The Art TEAMs project, now in its third year, continues to enhance teacher professional development through art-integrated curricula and emerging media. Year Three focused on refining Cohort One’s learning, recruiting and training Cohort Two, and evaluating classroom implementation. Key advancements include an adaptive curriculum model that leverages co-creation to empower educators as active collaborators in their professional growth. Data reveal significant progress in integrating arts-centered practices, including creative research journaling and culturally responsive teaching frameworks. Partnerships with educational institutions and advisory board expansions have bolstered the program’s sustainability and dissemination. Classroom observations and teacher interviews highlight transformative impacts, such as …

Connecting Compassion: Empathy's Role In Stem And Literacy Integration, Leah R. Cheek, Vinson Carter, Michael K. Daugherty, Christian Goering

Curriculum and Instruction Faculty Publications and Presentations

Empathy, an unsung, yet critical element of learning, can be strategically interlaced with literacy instruction and engineering design to create a rich and authentic learning experience for students. Integrated STEM education rests on the promise of engaging students and providing deep understandings through the intentional practice of delivering science and math content through the application of technology and engineering skills. Using children's literature to activate empathy and design thinking can help students become better problem-solvers, critical thinkers, and caring members of society. Empathy facilitates a deeper connection to the human experience, ensuring that solutions not only meet the design requirements, …

Exploring Pre-Service Teachers' Experiences With Emerging Technologies In Secondary Education: A Phenomenological Study, Richelle M. Decuir

LSU Doctoral Dissertations

This research was an investigation of the role of emerging technologies in preparing pre-service teachers to engage with secondary learners effectively. A phenomenological approach was utilized to explore how instructional design models and constructivist learning theories shape technology training in two Southeastern public universities. The research was focused on pre-service teachers' experiences developing digital competencies, integrating instructional design, and utilizing emerging technologies in educational settings. Data was collected through semi-structured interviews and demographic surveys to understand the participants’ perspectives comprehensively. The study findings revealed that while pre-service teachers recognize the value of technology in enhancing student engagement and supporting personalized …

Selected Indiana Government Statistical Agencies And Their Data, Bert Chapman

Libraries Faculty and Staff Presentations

Provides coverage of Indiana state government agencies statistics and selected Tippecanoe County, Indiana local government statistical publications. Presentation describes state agencies such as the Indiana Departments of Agriculture, Education, Health, Local Government Finance, and State Budget Agency. Examples of historical and current data are presented.

Pisa 2022. Assessing Creative Thinking For A Better Future, Lisa De Bortoli, Catherine Underwood

OECD Programme for International Student Assessment (PISA) Australia

Creative thinking was assessed as an innovative domain for the first time in PISA 2022. This report presents the creative thinking results for Australia as a whole, for the Australian states and territories and for the other groups in PISA 2022. It is one of two thematic reports providing additional high-level analysis of Australia's 2022 PISA performance. Differences in results are only reported if tests of statistical significance showed that these were likely to be real differences; that is, differences were unlikely to be caused by chance.

Preparedness For Practice Of Health Professionals In Papua New Guinea: A Cross-Sectional Survey Of Nurses And Community Health Workers., Mary Kililo, Julie Dopsie, Sulpain Passingan, Julie Kep, Nina Joseph, Russel Kitau, Mary Roroi, Chris Rossiter, Jenny Sim, Di Brown, Caroline Havery, Ali Moloney, Michele Rumsey

Pacific Journal of Health

Introduction

Papua New Guinea (PNG) experiences widespread health inequity and shortage of health professionals, exacerbated by poverty, isolation, gender-based violence and limited infrastructure, transport and accessible services. Nurses and community health workers (CHW) represent 72% of health workforce. However, health professional education programs are outdated and not aligned with national health priorities. We aimed to explore the adequacy of current curricula for nurses and CHWs by examining graduate competencies and preparedness for practice.

Methods

Cross-sectional study with four cohorts: 1) 130 new nurse graduates, 2) 75 nurses who supervised them, 3) 105 new CHW graduates and 4) 65 CHW supervisors. …

Designing A Human-Centred Learning Analytics Dashboard In-Use, Riordan Alfredo, Vanessa Echeverria, Linxuan Zhao, Luettamae Lawrence, Jie Xiang Fan, Lixiang Yan, Xinyu Li, Zachari Swiecki, Dragan Gašević, Roberto Martinez-Maldonado

Instructional Technology and Learning Sciences Faculty Publications

Despite growing interest in applying human-centred design methods to create learning analytics (LA) systems, most efforts have concentrated on initial design phases, with limited exploration of how LA tools and practices can coevolve during the actual learning and teaching activities. This paper examines how a human-centred LA dashboard can be further refined and adapted by teachers while actively using it in a real-world scenario (i.e., design-in-use), beyond its intended design (i.e., design-for-use). We use instrumental genesis as a theoretical lens to analyze the temporary and permanent instrumentalization of design features and individual and collective instrumentation of the LA …