Educational Assessment, Evaluation, and Research Commons^™

She Speaks: Amplifying Women's Voices For Wellbeing, Narelle Lemon

Reports accepted as research outputs

Executive Summary

The SheSpeaks project successfully transformed how 223 Western Australian women understand and practice self-care, demonstrating  that targeted wellbeing literacy interventions can create lasting change  in women’s relationship with their own wellbeing. Funded by the Women’s Grants for a Stronger Future program, this innovative initiative combined evidence-based workshops with authentic podcasting to challenge the pervasive cultural narrative that positions women’s self-care as selfish  or impossible.

Influence Of Faculty-Derived Concept Maps On Student Study Strategies, Kaitlin P. Hardy, Amanda K. Burbage, Julie A. Kerry

EVMS School of Health Professions Faculty Publications

Background

Concept mapping is a well-established tool for students to actively organize information into a visual and spatial framework. However, some students are resistant to adopting concept mapping as a study strategy due to the time and effort involved in generating the maps. In this study, we explored student perceptions of faculty-derived concept maps (FD-maps) developed to accompany content within a Foundational Science module in a medical school curriculum. We subsequently investigated whether student use of FD-maps helped overcome resistance to adoption of concept mapping.

Methods

Student evaluation data was analyzed using a mixed methods approach to explore student perceptions …

Belonging And The Lived Experiences Of Underrepresented Occupational Therapy Students, Daniel Cezar Da Cruz, Angela Murphy, Zara Mahmood

Journal of Occupational Therapy Education

Belonging has been explored in research in higher education with a focus on student engagement or performance and the impact of psychological aspects on individuals' learning. Few studies focused on underrepresented occupational therapy students’ belonging. Our research aimed to explore the lived experience of occupational therapy students regarding belonging at university. This phenomenological study was conducted with six occupational therapy students from the United Kingdom who volunteered to participate in semi-structured interviews. Data analysis was carried out through Reflexive Thematic Analysis (RTA). Three themes were constructed: Theme 1: Representation and belonging - “I was the only non-white person in the …

Demographic Factors As Predictors Of Academic Performance In First- And Second-Year Occupational Therapy Students, Eileen Du Plooy, Daleen Casteleijn, Denise Franzsen, Gopika Ramkilawon

Journal of Occupational Therapy Education

Significant disparities in academic performance that may be associated with specific demographics can be utilized for supporting diverse student cohorts. Strategies can be developed for students to enhance equity and inclusivity in undergraduate occupational therapy education to ensure student success. This study aimed to determine the predictive demographic factors influencing academic performance among first- and second-year undergraduate occupational therapy students at a university in South Africa. A quantitative, cross-sectional design was utilized, and the sample included 129 first- and second-year students. Data were collected retrospectively from university records and student dashboards. Key demographic and academic variables were analyzed, including personal …

The Students’ Conceptions Of Assessment (Scoa) Instrument: A Validation Study In Medical Education Context, Diantha Soemantri, Nadia Greviana, Najila Ramadhina

Health Professions Education

Purpose: To validate the Students’ Conceptions of Assessment (SCoA) instrument for the medical education context as a tool to examine Indonesian medical students’ conceptions of assessment in general before its implementation.

Method: A cross-sectional study was conducted to validate the translated SCoA instrument. The original 45-item instrument was translated to Indonesian with some modifications. The study was conducted on a total of 308 preclinical and clinical participants in two public medical schools: Universitas Indonesia and Universitas Udayana.

Results: The samples were found to be suitable for exploratory factor analysis, as indicated by a high Kaiser–Meyer–Olkin value (0.949) and a significant …

Transformation Of Accreditation Of Higher Education In Health In Indonesia: Qualitative Assessment, Yefta Moenadjat, Insan Sosiawan A. Tunru, Sutrisno Soemardjo

The New Ropanasuri Journal of Surgery

Accreditation of higher education in health in Indonesia shifts to the qualitative assessment driven to ensure quality improvement. The method replaces the former quantitative assessment method that has been applied since 2012; it will be effective in January 2025. The driving factors and rationale of transformation are outlined in this article. The rationale of the qualitative assessment that applies principle–based accreditation and the quantitative assessment that applies rule–based accreditation is reviewed here. Information on the accreditation procedure and the goal is presented, aiming for institutions to prepare for this new version of accreditation.

Physical Fitness And Nutrition In Collegiate Musical Theater Programs, Alexis Ochi, Amy Morgan Ph.D, Mary-Jon Ludy Ph.D.

Honors Projects

BACKGROUND: Athleticism and physical fitness are often not the first characteristics one identifies when visualizing someone in musical theater. Watching just one performance can make it clear that dancing, acting, running, all while singing and keeping near perfect pitch requires a theater actor to be extremely fit. As well as fitness, nutrition considerations and injury prevention should also be considered due to the high physiological demand placed on these performers. Minimal research has been conducted regarding the fitness and nutritional habits of musical theater performers. PURPOSE: This study investigated the prevalence of discussions about fitness and nutrition in collegiate musical …

Coph Professors Advocate For First-Gen Students, Dustin Roberto

HSC Newsroom

More than half of U.S. undergraduates are first-generation college students. University of New Mexico College of Population Health professors Claudia Pratesi, PhD, and Tammy Thomas, PhD, held focus groups to learn about first-generation students' experiences. Many students in the groups balance school with caring for family and find systems like financial aid difficult to navigate. The professors are developing recommendations, including peer mentoring and connections to scholarships, and will share findings with university leadership.

Assessing The Short-Term Outcomes Of Erase And Replace: A Series Of Health & Wellness Activities, Gabriela Murza, Christina Pay, Eva Timothy, Melanie Dabb, Cris Meier

Outcomes and Impact Quarterly

Utah State University Extension faculty addressed Utah's high rate of poor mental health with activities that improved participants’ connections, confidence, and abilities. These efforts positively impacted adults' mental health and quality of life and offered an additional resource to address self-care needs while encouraging connection and skill-building.

The Learning Crisis: Three Years After Covid-19, Tomasz Gajderowicz, Maciej Jakubowski, Alec Kennedy, Christian Christrup Kjeldsen, Harry Anthony Patrinos, Rolf Strietholt

Education Reform Faculty and Graduate Students Publications

The COVID-19 pandemic caused widespread disruptions to education, with school closures affecting over one billion children. These closures, aimed at reducing virus transmission, resulted in significant learning losses, particularly in mathematics and science. Using data from TIMSS 2023, which assesses fourth and eighth-grade achievements across 71 education systems, this study analyzes the impact of school closure duration on learning outcomes. Mixed-effect models estimate deviations from pre-pandemic trends, adjusting for demographic factors. Results show a global average decline of 0.11 standard deviations (SD) in student achievement, with longer closures linked to more severe losses. The effects on low performers, girls, and …

Their Stories, Our Testimony: A Narrative Inquiry Into The Remote Teaching Experiences Of Community College Clinical Nurse Educators During The Covid-19 Pandemic, Catherine E. Fenner

Doctor of Education Program Dissertations

This narrative inquiry explored the lived experiences of clinical nurse educators who taught at community colleges during the COVID-19 global pandemic, contributing to the growing body of literature about what nurses endured during the pandemic. The pandemic and the ensuing havoc it caused occurred when the profession faced significant staffing shortages. In the early months of 2020, when the virus was spreading rapidly, many states issued stay-at-home orders requiring nursing programs to pivot to remote learning platforms. Teaching hands-on skills, communication techniques, and time management strategies through virtual and remote pedagogy was a time of confusion for nurse educators, who …

Real-World Assessment (Rwa): Validity Evidence For Cataract Surgery With A Tool Your Faculty Will Actually Use, Grace L. Paley, Hui Zhao, Victoria M. Addis, Casey J. Beal, Geetha K. Davis, Gabriela M. Espinoza, Michael S. Lee, Stacy L. Pineles, Jamie B. Rosenberg, Robert T. Swan, Misha F. Syed, Evan L. Waxman, Susan M. Culican

Journal of Academic Ophthalmology

Background: We developed and implemented a real-world assessment tool (RWA) for resident surgery. It was designed to improve utility by reducing faculty and trainee cost (completion and training time, cognitive burden). RWA uses an entrustability scale where higher scores indicate a resident’s readiness for independent surgical practice. We describe a two-phase implementation of RWA and report validity evidence for cataract surgery assessment.

Methods: RWA was developed iteratively with resident and faculty input and piloted at a single residency program in phase 1. Phase 2 implemented RWA at 11 ophthalmology residency programs. The main outcome measures were 1) number …

General Practice Training In Australia: National Report On The 2024 National Registrar Survey, Rebecca Taylor, Leyna Clarke, Michelle Hsien, Ali Radloff

Higher education research

The General Practice National Registrar Survey (GP NRS) is an annual, national survey of GP registrars currently training in Commonwealth funded trainings programs which include Australian General Practice Training (AGPT), Remote Vocational Training Scheme (RVTS) and Rural Generalist Training Scheme (RGTS) programs (prior to 2024, it was only carried out with AGPT registrars). It collects information via an online questionnaire about GP registrar satisfaction, experience and future career plans. It also collects information about GP registrars’ demographics and training contexts and other aspects of their training experience. This survey is part of the Department of Health and Aged Care’s (the …

Preparedness For Practice Of Health Professionals In Papua New Guinea: A Cross-Sectional Survey Of Nurses And Community Health Workers., Mary Kililo, Julie Dopsie, Sulpain Passingan, Julie Kep, Nina Joseph, Russel Kitau, Mary Roroi, Chris Rossiter, Jenny Sim, Di Brown, Caroline Havery, Ali Moloney, Michele Rumsey

Pacific Journal of Health

Introduction

Papua New Guinea (PNG) experiences widespread health inequity and shortage of health professionals, exacerbated by poverty, isolation, gender-based violence and limited infrastructure, transport and accessible services. Nurses and community health workers (CHW) represent 72% of health workforce. However, health professional education programs are outdated and not aligned with national health priorities. We aimed to explore the adequacy of current curricula for nurses and CHWs by examining graduate competencies and preparedness for practice.

Methods

Cross-sectional study with four cohorts: 1) 130 new nurse graduates, 2) 75 nurses who supervised them, 3) 105 new CHW graduates and 4) 65 CHW supervisors. …

Assessing The Climate Readiness Of Physician Education Leaders In Graduate Medical Education, Deborah Simpson, Anne Getzin, Aaron A. Levy, Victoria Gillet

Journal of Patient-Centered Research and Reviews

Climate change affects patient health through an array of exposures, including increasing heatwaves, extreme weather events, poor air quality, and expanding vector-borne illnesses. Physicians are at the forefront of addressing the health consequences of these exposures with patients, and environmental sustainability has become a priority for health care organizations. Accordingly, climate change and health is becoming a critical area for graduate medical education (GME). As GME leaders design and drive education in residency and fellowship programs, understanding those leaders’ baseline knowledge on this topic and its alignment with their organizations’ priorities is an essential step in the development of climate …

Professional Identity Formation Through A Peer Learning, Integrated Clinical Experience, T.R. Goins, Michelle Green, Bridget Eubanks

Internet Journal of Allied Health Sciences and Practice

Purpose: The purpose of this study was to explore the experiences and perceptions of first-year DPT students related to professional behaviors and professional identity formation after an integrated clinical experience facilitated by peers. Methods: Forty-one first-year DPT students from an accredited Doctor of Physical Therapy program participated in a class assignment designed to collect qualitative data regarding their experiences with professional behaviors and professional identity formation after completing an integrated clinical experience. Incident coding processes analyzed responses to open-ended assignment prompts. Results: The most frequent professional behaviors students felt they could demonstrate during the integrated clinical experience were “communication” and …

Incorporating Transparency Into An Online Respiratory Care Curriculum, Kristen Mchenry, Adrian Hoyal

Internet Journal of Allied Health Sciences and Practice

Purpose: The Transparency in Learning and Teaching (TILT) framework has been shown to impact student academic success, improve retention rates, and increase reported course satisfaction. This instructional strategy has demonstrated effectiveness in traditional, online, and underrepresented student groups. This project aimed to revise one elective 7-week course in an online undergraduate degree advancement (DA) program in Respiratory Care to incorporate the TILT infrastructure and assess retention and satisfaction pre and post-implementation. Methods: The methodology can be characterized as evaluative, non-experimental research. An objectives-oriented approach was used to retrospectively evaluate the pedagogical change (TILT) and its degree of instructional impact on …

Two Lives, Shruti Trehan Mbbs

Journal of Wellness

A busy oncologist makes a decision to leave her busy, thriving, community practice in the Mid-West and moves to a Veterans Affairs hospital in South Florida in the quest for a better work-life balance.

Identifying Key Predictors Of Academic Achievement In A Longitudinal Medical Research Module., Anesu Karen Murambadoro, Juan C. Lopez-Alvarenga, Kevin Garcia Valdez, Kory Deshawn Punch, Natasha N. Quailes, Nina Mourao, Elias Arellano Villanueva, Tyler Torres, Nikhilesh Anand, Bharathi Shrikanth Gadad

Research Colloquium

Background: Research engagement among medical students is often hindered by perceived time constraints, lack of motivation, inadequate facilities, and insufficient supervisory guidance. Only 7% have published research papers. Project-based programs enhance research skills but frequently lack alignment between objectives, teaching methods, and evaluation. In the Rio Grande Valley, there is limited research on these issues. This study aims to analyze the performance of pre-clerkship students in a two-year longitudinal research course.

Aim: We hypothesize that core independent variables (InVar) such as attitudes toward research (R-ATR), cognition (BCRS), self-efficacy, and competency scores will improve throughout the longitudinal Research Module. These …

Use Of Digital Cadaveric Digital Atlases To Improve Student Performance In Neuroanatomy, Kevin A. Garcia Valdez, Anesu Karen Murambadoro, Kory Deshawn Punch, Megan W. Szobody, Tori Sayers, Nina Mourao, Blake Martin, Tyler Torres, Juan Torres, Natasha N. Quailes, Neharika Penmetcha, Sriya Gullapalli, Lois F. Baldado, Isabella Rodriguez, Arjun Bellamkonda, Sridhar Srinivasan, Xiaoqian Fang, Bharathi Shrikanth Gadad, Ricardo Belmares

Research Colloquium

Background: The use of digital platforms to teach various subjects in the pre-clerkship curriculum is a fast-developing field, but their utility compared to traditional in-person didactics is unclear. Partly fueled by the recent demand for remote learning materials and ever-burgeoning access to artificial intelligence, the drive has been to develop materials to meet the demands of the digital age. Our goal is to evaluate the efficacy of the use of a digital atlas to improve learning outcomes in the field of neuroanatomy, namely developing skills in interpreting imaging studies featured on summative examinations. Literature has shown that the implementation of …

Exploring The Use Of An Interprofessional Education Session For Speech-Language Pathology And Pharmacy Students, Sophia Werden Abrams, Heather Macphee, Linnea Hodge, Justine Hamilton, Ashwini Namasivayam-Macdonald

Teaching and Learning in Communication Sciences & Disorders

Interprofessional education (IPE) occurs when students are provided the opportunity to learn with and from others of related professions to improve the potential for future collaboration. The aim of this study was to explore the perceptions of students about working with professionals from different disciplines before and after their engagement in an interprofessional learning activity and determine any changes in their willingness to work in interprofessional teams.

Doctor of Pharmacy students from the University of Manitoba and Master’s speech-language pathology students from McMaster University participated in an online inter-university and inter-provincial education module. Students were invited to complete the Interprofessional …

Preservice Augmentative And Alternative Communication Coursework Across 311 Speech-Language Pathology Graduate Programs, Brandon S. Eddy, Emily Sorensen, Mariel Pinto

Teaching and Learning in Communication Sciences & Disorders

Speech-language pathologists often report a lack of preparedness to provide augmentative and alternative communication (AAC) services, suggesting the need for improved graduate level training. Recent studies of AAC coursework offerings found 86% to 88% of programs offered AAC coursework, but these studies relied on survey methods with limited numbers of responses. This study examined AAC course offerings at 311 graduate programs using website and course catalog reviews, supplemented by direct contact with departments when dedicated AAC courses could not be found using online resources. Of these, 282 (90.68%) offered a dedicated AAC course, and 16 (5.14%) offered AAC in combination …

A Survey Of Post-Graduate Satisfaction With Orthopaedic Residency Training At A Single Institution, Jared L. Sain, Craig R. Louer, Robert J. Esther, Christopher W. Olcott

HCA Healthcare Journal of Medicine

Background

The Accreditation Council for Graduate Medical Education (ACGME) has called for self-study within residency programs. Post-graduate surveys allow the graduate to reflect upon their residency experience after years of autonomous practice. Despite their potential utility, a standardized assessment of residency training from the perspective of orthopaedic alumni does not exist. In this study, we aimed to create, analyze, and share with our alumni a post-graduate survey based on ACGME core competencies.

Methods

The survey was developed by full-time orthopaedic faculty and reviewed by a survey methodologist to ensure clarity and an ideal survey format. In May 2020, the survey …

Approaches To Teaching Evidence-Based Medicine In Residency: A Systematic Review, Kathleen Matheson Phd, Cip, Megan Weemer Dhsc, Mches, Laura Lipke

Library Scholarship

ABSTRACT Background Studies of evidence-based medicine (EBM) curricula in graduate medical education are common, but little consensus exists on the best methods to teach EBM.

Objective The purpose of the current study was to evaluate EBM teaching approaches for graduate medical trainees and to update a 2014 systematic review.

Methods We conducted a systematic literature search of major health and education databases for articles published from January 2014 through October 2022. Articles were independently screened to ensure they described an experimental or quasi-experimental evaluation of EBM teaching for graduate medical trainees. Quality of included studies was appraised using the Medical …

Authentic Assessment For Early Childhood Intervention: In-Vivo & Virtual Practices For Interdisciplinary Professionals, Stephen J. Bagnato, Marisa Macy, Carmen Dionne, Nora Smith, Jackie Robinson Brock, Tracy Larson, Maria Londono, Antonio Fevola, Mary Beth Bruder, Jamie Cranmer

Perspectives on Early Childhood Psychology and Education

Abstract

The pandemic has exposed the many glaring difficulties inherent in implementing effective assessment and intervention for young children with neurodevelopmental delays and disabilities in our respective countries, but, especially in the US. The urgency for innovative models of assessment linked to interdisciplinary services and supports in both remote and in-vivo settings became prominent. Yet, the commitment to developmentally-appropriate practice (DAP), assessment linked to intervention, is the hallmark of ECI, whether virtual or in-vivo.

However, interdisciplinary professionals have rallied during these challenging times by displaying creativity, compassion, and superb clinical judgment in providing responsive services via both virtual and in-vivo …

Link Virtual Forum On Authentic Assessment For Early Childhood Intervention: Interdisciplinary & International Consensus, Stefano J. Bagnato, Marisa Macy, Nora Smith, Carmen Dionne, Mary Beth Bruder, Maria Londono, Jackie Robinson Brock, Antonio Fevola, Tracy Larson

Perspectives on Early Childhood Psychology and Education

The LINK Virtual Forum on Authentic Assessment for Early Childhood Intervention: Interdisciplinary & International Consensus was orchestrated through a series of virtual focus-groups during the pandemic in 2021-2022. This new strategy for conducting a more robust national/international consumer social validity study gathered practice-based evidence from the field using national and international expert panel focus groups and an expert panel forum to survey Authentic Assessment experts and users. Uniquely, these deliberations relied upon the Nominal Group Technique (NGT) among participants to reach consensus decisions and Qualtrics survey results. The decision-making process addressed types of assessment measures that address early childhood …

A Process Evaluation Of Utah’S Food Security Council, Palak Gupta, Heidi Leblanc

Outcomes and Impact Quarterly

Utah’s Food Security Council (FSC) brings together diverse stakeholders to address food security across the state. As FSC concluded its inaugural year of work, a process evaluation assessed its progress. Findings will inform FSC’s future strategic improvements, partnerships, and community outreach activities.

A National Perspective Of Mental Health Awareness Among Agricultural Workers, Anna Gilliam, Ethan Gilliam

Outcomes and Impact Quarterly

The knowledge and perceptions of mental health resources for agricultural workers were explored at the 2024 American Farm Bureau Federation (AFBF) National Conference. Data were gathered via a voluntary survey conducted at the event. With 137 completed surveys, the study revealed that the participants desired more information regarding agricultural mental health resources and revealed their preferences for receiving this information. These findings will lead USU Extension to create impactful educational resources to better address mental health awareness and education needs in agricultural workers.

Inter-Institutional Analysis Of Skin Of Color Representation In Dermatological Lecture Content At Md And Do Medical Schools, Oluwafunke Ogunremi

Sanford School of Medicine Posters and Presentations

The purpose of this study was to analyze the lecture materials provided in medical schools through a diversity lens. Skin pathologies manifest distinctively on various shades of skin and physicians must be equipped with the proper knowledge to identify and diagnose these conditions accurately and promptly. For most medical students, images in prominent textbooks and lecture slides are their first encounter with disease presentations. Therefore, it is important to analyze the diversity of skin tones in the content that is being delivered. Specifically, the use of images featuring darker skin tones compared to those depicting lighter skin tones. This study …

What Do Extension And Public Health Educators Need To Address Substance Misuse?, Lisa Washburn, Karen Franck

Journal of Extension

Limited organizational capacity has hindered Extension’s ability to address substance misuse in communities. To inform capacity-building efforts, we obtained Extension educator and health educator feedback on opportunities, challenges and resource needs using the Delphi technique. Opportunities included collaboration and partnerships with local entities. Stigma, inadequate resources, and limited knowledge and skills of educators were challenges. Top resource needs were updated youth curricula, funding, and clear guidance on what educators can do and what should be referred externally. Findings provide insights to educator perceptions and suggest additional training and resources needed to implement evidence-based approaches to address substance misuse.