Medicine and Health Sciences Commons^™

Exploring Factors For Implementation Of Epas In Pediatric Subspecialty Fellowships: A Qualitative Study Of Program Directors., Angela S. Czaja, Richard B. Mink, Bruce E. Herman, Pnina Weiss, David A. Turner, Megan L. Curran, Diane E J Stafford, Angela Myers, Melissa L. Langhan

Manuscripts, Articles, Book Chapters and Other Papers

OBJECTIVE: To understand fellowship program directors' (FPDs) perspectives on facilitators and barriers to using entrustable professional activities (EPAs) in pediatric subspecialty training.

METHODS: We performed a qualitative study of FPDs, balancing subspecialty, program size, geographic region and current uses of EPAs. A study coordinator conducted 1-on-1 interviews using a semistructured approach to explore EPA use or nonuse and factors supporting or preventing their use. Investigators independently coded transcribed interviews using an inductive approach and the constant comparative method. Group discussion informed code structure development and refinement. Iterative data collection and analysis continued until theoretical sufficiency was achieved, yielding a thematic …

Osces’ Impact On Occupational Therapy Student Learning: Insights From Second- And Third-Year Focus Groups, Craig R. St. Jean, Karin Werther, Mary R. Roberts

The Open Journal of Occupational Therapy

Background: Objective Structured Clinical Examinations (OSCEs) are widely used in health programs to assess clinical skills. We present results of a qualitative study investigating occupational therapy students’ perceptions of OSCEs’ impact on their learning and readiness for clinical practice.

Method: Six second and six third year students in the University of Alberta’s Master of Science in Occupational Therapy program were interviewed in separate focus groups. Independent reviewers applied thematic analysis to the focus group transcripts to identify, analyze, and report themes in the data.

Results: Five themes were constructed from the data: from learning to action, transition …

Relationship Between Epa Level Of Supervision With Their Associated Subcompetency Milestone Levels In Pediatric Fellow Assessment., Richard B. Mink, Carol L. Carraccio, Bruce E. Herman, Pnina Weiss, David A. Turner, Diane E J Stafford, Kathleen A. Mcgann, Jennifer Kesselheim, Deborah C. Hsu, Pamela C. High, Jill J. Fussell, Megan L. Curran, Patricia R. Chess, Cary Sauer, Sarah Pitts, Angela Myers, John D. Mahan, Christiane E L Dammann, Tandy Aye, Alan Schwartz, Subspecialty Pediatrics Investigator Network

Manuscripts, Articles, Book Chapters and Other Papers

BACKGROUND: Entrustable Professional Activities (EPA) and competencies represent components of a competency-based education framework. EPAs are assessed based on the level of supervision (LOS) necessary to perform the activity safely and effectively. The broad competencies, broken down into narrower subcompetencies, are assessed using milestones, observable behaviors of one's abilities along a developmental spectrum. Integration of the two methods, accomplished by mapping the most relevant subcompetencies to each EPA, may provide a cross check between the two forms of assessment and uncover those subcompetencies that have the greatest influence on the EPA assessment.

OBJECTIVES: We hypothesized that 1) there would be …

Development Of An On-Call Assessment Tool For Competency-Based Surgical Training, Eric C. Mitchell

Electronic Thesis and Dissertation Repository

Introduction: A central tenet of competency-based medical education is formative assessment of trainees. There are no assessments examining resident competence on-call, despite this being a significant component of resident training and characterized by less supervision compared to daytime.

Methods: A national survey was conducted to evaluate the state of assessment in Canadian Plastic and Reconstructive Surgery programs. An on-call assessment tool was developed based on a consensus group and was piloted over six months. Validity of the tool was examined through qualitative and quantitative methods.

Results: There were 63 tools completed across ten residents and seven staff physicians. Tool reliability …

Assessment During Covid-19: Quality Assurance Of An Online Open Book Formative Examination For Undergraduate Medical Students, Javeria Rehman, Rahila Ali Mazhar, Azam Afzal, Sara Shakil, Amber Shahmim Sultan, Romana Idress, Syeda Sadia Fatima

Department of Pathology and Laboratory Medicine

Background: The spread of COVID-19 pandemic in early 2020 compelled all the educational activities, including medical education to be shifted from face-to-face interaction to a virtual platform. This shift provided opportunities for exploring online assessment modalities. One such assessment method is an online open book exam which is a unique concept in medical education of Pakistan. Limited information is available in literature regarding open book exam for the basic science subjects. Hence, the objective of the study was to determine the quality of the open book exam administered as a pilot project to the first-year medical students.
Methods: It was …

Assessment And Diagnostic Practices Relating To Autism Spectrum Disorder In The United States And Mexico, Maria Valdez, Jessica R. Stewart, Wan-Lin Chang, Ruth Crutchfield, Ralph Carlson

Internet Journal of Allied Health Sciences and Practice

Purpose: The present study examined and compared professional assessment and diagnostic practices relating to autism spectrum disorder (ASD) in Mexico and the United States (U.S.). This information is of great importance because there is an extremely limited amount of information pertaining the assessment and diagnostic practices for ASD in Mexico and little is known about how these practices compare to those in the U.S. Methods: Archival data from a survey investigating ASD in the U.S. and Mexico was used for this study. Participants included 29 professionals from the U.S. and 7 professionals from Mexico. Professionals were from a variety of …

Establishing The Content Validity Of A Student Pharmacist Patient Counseling Competency Assessment In Oncology, Matthew Newman, Emily Pherson, Bradley Burton, Eric C. Nemec

Physician Assistant Studies Faculty Publications

Objective. The main goal of this project was to establish content validity and describe internal consistency of a patient counseling competency assessment instrument used to evaluate student pharmacists practicing in an oncology setting. Methods A modified e-Delphi panel of oncology clinical pharmacy specialists, clinical pharmacy generalists, and oncology pharmacy residents was employed. Iterative rounds of the e-Delphi process were conducted until consensus was reached on a majority of the instrument items. Consensus was defined as agreement by at least 75% of participants that an item was, or was not important. Internal consistency of defined sections of the instrument was determined …

Assessment Of Cultural Sensitivity In Dietetics Education, Julie Plasencia, Heather Norman-Burgdolf, Lorraine Weatherspoon

Dietetics and Human Nutrition Faculty Publications

Cultural sensitivity and competency are skills needed for agricultural professionals including nutrition and dietetics practitioners. The objective of the current study was to examine the learning transference of cultural sensitivity topics taught in a cultural foods course into case study assessments of a capstone-level course. This study is a cross-sectional, content analysis of cultural sensitivity assessment rubric (CSAR) scores for two case study assessments. The study was conducted in a landgrant, research-intensive university and 55 students (60%) from a capstone-level dietetics course participated. T-tests were used to compare CSAR scores between students who had completed a cultural foods course and …

Identifying The Content And Context Of Pain Within Paediatric Rheumatology Healthcare Professional Curricula In The Uk: A Summative Content Analysis., Rebecca Rachael Lee, Janet E. Mcdonagh, Mark Connelly, Sarah Peters, Lis Cordingley

Manuscripts, Articles, Book Chapters and Other Papers

BACKGROUND: The curriculum for professionals working in paediatric rheumatology should include pain but it is unclear to what extent this currently occurs. The aim of this study was to identify pain-related curriculum content and the context in which pain is presented in educational and training documentation for healthcare professionals in this clinical speciality.

METHODS: Core curricula documents from UK based professional organisations were identified in partnership with healthcare professionals. Documents were analysed using a summative content analysis approach. Key pain terms were quantified and weighted frequencies were used to explore narrative pain themes. Latent content was interpreted qualitatively to explore …

Pace Yourself: Impact Of Covid-19 On Patient-Centered Care Experience, Kristen Wilhite, Mikael D. Jones, Clark D. Kebodeaux

Pharmacy Practice and Science Faculty Publications

(1) Background: The outbreak of the novel coronavirus, COVID-19, forced colleges of pharmacy to implement new online learning methodologies to ensure that students could complete required courses. This transition was especially acute for laboratory simulation courses that require students to practice professional skills. This study aims to compare student assessment performance within a simulation-based laboratory course for students who completed the module prior to and after the online transition. (2) Methods: This study was a retrospective cohort comparison of student outcome performance with two distinct content delivery methods. Students were organized into two tracks at the beginning of the semester …

Exploring The Evolution Of Professional Identity Formation In Health Professions Education, Lindsey E. Moseley, Lauren Mcconnell, Kimberly B. Garza, Channing R. Ford

Research, Publications & Creative Work

This article provides a general overview of professional identity formation (PIF) in health professions education, a summary of relevant theories related to PIF, and a description of pedagogical models which promote PIF.

Evaluating The Impact Of A Longitudinal Patient Case On The Development Of Professionalism And Professional Identity, Kimberly B. Garza, Lindsey E. Moseley, Bradley M. Wright, Channing R. Ford

Research, Publications & Creative Work

This article explores the student outcomes of a progressive case on the development of professional identity and professionalism within first-year student pharmacists.

Developing A Self-Assessment Instrument To Evaluate Practice-Readiness Among Student Pharmacists, Channing Ford, Kevin N. Astle, Erika L. Kleppinger, Jeanna Sewell, Amber Hutchison, Kimberly B. Garza

Research, Publications & Creative Work

This chapter explores the role of self-assessment in the development of professional identity formation within student pharmacists.

Assessment Of Professional Identity Formation: Challenges And Opportunities, Kimberly B. Garza, Lindsey E. Moseley, Channing Ford

Research, Publications & Creative Work

This final chapter will discuss challenges of assessing PIF, available assessment tools, and future directions.

Workplace Based Assessment: Tools To Assess Competencies In A Clinical Setting, Amber Shahmim Sultan, Rahila Ali, Sara Shakil, Rehan Nasir Khan

Department for Educational Development

The apprenticeship model has been used for long in surgical training. It initially provides opportunity to the trainee to observe the attending surgeon, followed by gradual introduction to surgical technique under direct supervision and later with detached supervision. The attending provides informal feedback at different intervals to the trainee. Several changes have been made in postgraduate programmes with a shift towards using workplace-based assessment tools for formative and summative evaluation of the trainee's clinical skills.

Agreement Of Program Directors With Clinical Competency Committees For Fellow Entrustment., Richard Mink, Bruce E. Herman, Carol Carraccio, Tandy Aye, Jeanne M. Baffa, Patricia R. Chess, Jill J. Fussell, Cary G. Sauer, Diane E J Stafford, Pnina Weiss, Megan L. Curran, Christiane E L Dammann, Pamela C. High, Deborah Hsu, Jennifer C. Kesselheim, John D. Mahan, Kathleen A. Mcgann, Angela Myers, Sarah Pitts, David A. Turner, Alan Schwartz

Manuscripts, Articles, Book Chapters and Other Papers

Objectives: Fellowship program directors (FPD) and Clinical Competency Committees (CCCs) both assess fellow performance. We examined the association of entrustment levels determined by the FPD with those of the CCC for 6 common pediatric subspecialty entrustable professional activities (EPAs), hypothesizing there would be strong correlation and minimal bias between these raters.

Methods: The FPDs and CCCs separately assigned a level of supervision to each of their fellows for 6 common pediatric subspecialty EPAs. For each EPA, we determined the correlation between FPD and CCC assessments and calculated bias as CCC minus FPD values for when the FPD was or was …

Mental Health Assessments In Icu And Acute Care, Carolynn M. Keane, Megan Altom, Taylor Harrell, Erica Smith, Danielle Woodward

Master of Occupational Therapy Student Critically Appraised Topics

The purpose of our critically appraised topic is to provide a brief summary of assessments that may be relevant to the burn unit or ICU setting, including their validity, reliability, specificity, sensitivity, and limitations. We had a total of eight articles with the following study designs: Systematic Review (2 articles), Longitudinal Study (1 article), Comparative Analysis (1 article), Correlational Analysis (2 articles) and Methodological (2 articles). These articles looked at the reliability, validity, specificity, and sensitivity of the following assessments: Abbreviated Burn Specific Anxiety Scale (A-BSPAS), Beck Depression Inventory-II, Brief Coping Orientation to Problems Experience (B-COPE), Concise Mental Health Checklist …

Co-Curriculum Implementation And Assessment In Accredited Doctor Of Pharmacy Programs, Jaime L. Maerten-Rivera, Aleda Chen, Jill Augustine, Richard D'Assalenaux, Kelly C. Lee, Cameron C. Lindsey, Daniel R. Malcom, Laurie S. Mauro, Nina Pavuluri, Michael J. Rudolph, Siu Fun Wong, Jacqueline M. Zeeman, Paula Zeszotarski

Pharmacy Practice Faculty Publications

Objective. To determine how accredited Doctor of Pharmacy programs implement and evaluate the co-curriculum requirement as mandated by the Accreditation Council for Pharmacy Education (ACPE).

Methods. A survey was administered to all ACPE-accredited pharmacy programs to collect information regarding how co-curriculum models were being implemented, including types of activities, structure, learning outcomes, oversight, and assessment. The frequency of responses to items were presented to describe the general features of co-curriculum models.

Results. The types of co-curricular activities reported by programs were generally consistent, with the majority of programs categorizing these activities and allowing students to choose which they would engage …

Screening For Palliative Care Services In An Assisted Living Facility, Maria Delia Crosby

College of Nursing and Health Sciences Doctor of Nursing Practice (DNP) Project Publications

Background: Palliative care services remain under-utilized, even as evidence suggests that early palliative care leads to positive health outcomes, reduced ED visits, and substantial cost savings. Barriers include a lack of knowledge of palliative care services in the community, and under-utilization of validated assessment tools, including a symptom checklist. Aims of this project: 1. To determine whether the integration of validated community-based palliative care screening tool in an assisted living setting will identify older adults with unmet palliative care needs. 2. To determine if tool implementation could lead to a referral for palliative care consultation.

Methods: A screening tool developed …

The Role Of Using Formative Assessments In Problem-Based Learning: A Health Sciences Education Perspective, Kristi W. Kelley, Julaine M. Fowlin, Andrew A. Tawfik, Max C. Anderson

Interdisciplinary Journal of Problem-Based Learning

Practitioners in the field of pharmacy are often confronted with ill-structured problems. Specifically, pharmacists are tasked with making patient-specific recommendations that are both safe and effective, which requires combining knowledge from the biomedical, behavioral, and pharmaceutical sciences. Given the dynamic nature of pharmacy as a profession, the field has begun to explore learning strategies that go beyond mere content coverage to strategies that better support higher-order learning outcomes. One of these approaches is problem-based learning (PBL). While studies have focused on how to support PBL to improve learning outcomes, the role of assessment is often overlooked. Further exploration is thus …

Main And Regional Campus Assessments Of Applicants To A Rural Physician Leadership Program: A Generalizability Analysis, Terry D. Stratton, Clarence Kreiter, Carol L. Elam

Behavioral Science Faculty Publications

While the selection of qualified applicants often relies, in part, on scores generated from a medical school pre-admission interview (MSPI), the growth of regional medical campuses (RMCs) – many with specialized rural tracks, programs, or missions – has challenged schools to accommodate a wider range of stakeholder input. This study examines the reliabilities of main (urban) and regional (rural) campus interviewers’ assessments of applicants to a Rural Physician Leadership Program (RPLP) located in the southeastern United States.

Data from RPLP applicants completing MSPIs on two campuses from 2009-2017 (n = 232) were examined in a generalizability analysis. In two separate …

Faculty Entrustment Of Students In The Core Clerkships: A Comparison Between The Longitudinal Integrated Clerkship And The Block Clerkship, Robert L. Trowbridge, Marybeth D. Ford, Jenny L. Carwile, Eliza R. Bullis, Robert G. Bing-You

Journal of Maine Medical Center

INTRODUCTION: Entrustable Professional Activities (EPAs) have been proposed for use in undergraduate medical education. The ability of faculty to entrust students with EPAs may differ between Longitudinal Integrated Clerkships (LICs) and traditional block clerkships.

METHODS: Participants were core clerkship faculty, 64 in a LIC and 31 in a sequential block clerkship. We administered a web-based survey at the end of the core clerkship year to measure preceptors’ typical entrustment (on a scale of 0–10) in students for the 13 American Association of Medical Colleges Core EPAs. We compared entrustment between LIC and block faculty using a Mann-Whitney test.

RESULTS:LIC …

Patients Don't Come With Multiple Choice Options: Essay-Based Assessment In Ume, J. B. Bird, D. M. Olvet, J. M. Willey, J. Brenner

Journal Articles

No abstract provided.

A Mixed-Methods Refugee Community Health Needs And Assets Assessment, Eleni Florakis, Rickie Brawer, Phd, Mph, Mches, Abby Cabrera, Kaushal Desai, Saya Bery

Phase 1

Introduction:

Many factors may negatively affect the experience of refugees navigating the healthcare system in Philadelphia. These factors include, but are not limited to, lack of familiarity with the healthcare system, language and cultural barriers, limited health literacy, physical and transportation barriers, and fear and/or distrust of the healthcare system. In addition, there are a large proportion of United States refugees in Pennsylvania. According to usnews.com, Pennsylvania was ranked the top 6th state for taking in the most refugees in the year 2017.

Objective:

The primary objective is to assess the experiences of refugees within the healthcare system since resettlement …

The Effects Of Formative And Summative Assessment On Student's Connectedness, Satisfaction, Learning And Academic Performance Within An Online Healthcare Course, Thomas J. Wing

Boise State University Theses and Dissertations

The quantitative study presented here evaluates the effects of formative and summative assessment on student’s connectedness, satisfaction, learning and academic performance within a university three-credit 400 level online healthcare course. Literature exploring the role that formative assessment plays within an online environment is currently lacking. Additionally, understanding how assessment practices can help support the goals of online healthcare education is vitally important given the rise in popularity of this delivery format.

This study investigated student outcomes in the form of connectedness, satisfaction, learning and academic performance. Four cohorts of students were included in this study. Two cohorts were provided with …

Faculty Development Initiatives: A Prerequisite For Capacity Building And Enhanced Productivity In A Medical Institution, Rehana Rehman, Hassan Mehmood, Syeda Fatima, Irfanullah Baig, Zohaib Rana, Mohammad Iqbal

Department of Biological & Biomedical Sciences

Objective: To determine the contribution of teaching, learning and assessment forum's initiatives on professional development of faculty and staff.
Methods: This retrospective study was conducted at the Department of Biological and Biomedical Sciences, Aga Khan University, Karachi, from July to December 2016, and comprised teaching, learning and assessment activities carried out from 2012 to 2015. The responses acquired from feedback evaluation were recorded at the end of activity on a Likert-type scale ranging from 1-5. Positive responses were presented for each variable with respective activity type across the study years. The association of the effectiveness of teaching, learning …

Assessment Of Medical Screening And Clinical Reasoning Skills By Physical Therapy Students In A Simulated Patient Encounter, Therese E. Johnston

Internet Journal of Allied Health Sciences and Practice

Purpose: Physical therapists (PTs) screen their patients for medical issues that may present as musculoskeletal conditions. In physical therapy education, learning activities followed by assessment of skills and clinical reasoning is important. The purposes of this study are to 1) demonstrate the feasibility of the use of standardized patients (SPs) and standardized physicians (SPhs) during a practical examination focused on medical screening, and 2) report outcomes related to the students’ abilities to screen for medical issues and make clinical decisions about referral to a physician.

Methods: Students evaluated a standardized patient in an outpatient setting model. After receiving …

Implementing The Weefim System In Outpatient Pediatric Rehabilitation, Chelsea Ratilainen

Master's Projects and Capstones

Abstract

This project was designed to achieve an unmet criteria in the accreditation process for the outpatient pediatric rehabilitation program at a local, community hospital in the greater Bay Area. The clients range from 6 months old to 20 years old with functional disabilities. The Commission of Accreditation of Rehabilitation Facilities (CARF) requires that applicants demonstrate outcome measure data over a 6 month time period. During the self-evaluation process this was noted to be a deficiency in the department’s efforts. The WeeFIM system was chosen as the first tool to implement in the department. This is a functional improvement measurement …

Correlation Of Formative Assessments As The Means Of Predicting Summative Performance In Paramedic Students, William J. Leggio Jr, Alan M. Batt, Jennifer C. Berry, Tom Fentress, Marilee L. Vosper, Kelly Walsh, James Dinsch

Internet Journal of Allied Health Sciences and Practice

Background: Paramedic programs use formative assessments to determine cognitive competency. Understanding the number of failed formative units as a probability of passing the summative exam will allow programs to set additional benchmarks. The purpose of this study was to determine whether failure in formative exams determines success on a summative exam.

Methods: Formative and summative scores from 2011 – 2016 for paramedic students with accounts in Fisdap™, an Internet-based administrative database, were retrospectively reviewed for the following criteria: provided consent for research, completed all six formative (unit) examinations, and completed a summative (comprehensive) examination. Analyses were performed with Pearson correlations …

Development Of The Clinical Teaching Effectiveness Questionnaire In The United States, Michelle E. Wormley, Wendy Romney, Anna E. Greer

All PTHMS Faculty Publications

The purpose of this study was to develop a single valid measure for assessing clinical teaching effectiveness within the field of physical therapy. Pilot testing with CIs from both universities were purposively sampled to complete the questionnaire. The CI databases yielded 1,001 potential respondents, recruited via e-mail. The questionnaire and two follow-up reminders were sent. Respondents consented by clicking a link which redirected them to the SurveyMonkey® questionnaire. Two hundred five CIs completed the questionnaire, a 20.5% response rate. The 205 respondents were mostly female (68.4%) with an average age of 40.54 years (SD=10.22). CI experience was distributed as follows: …