Education Commons^™

Tools For Capturing Outcomes In Virtual Educational Programs, Leyla Marandi, Eleanor Haworth, Vikram Koundinya, Katherine Webb-Martinez, Kit Alviz

The Journal of Extension

During the COVID-19 pandemic, organizations increased virtual programming and adoption of online technologies. This article outlines the [University redacted] assessment of tools for gathering data on participant learning outcomes from virtual educational programs. After assessing colleagues’ experiences and searching for new web applications, a central repository was created. [University redacted] team will use this information to assist extension professionals in collecting program planning and evaluation data. We believe that these tools can help other extension programs nationally and globally with similar efforts, as more virtual programming is likely to increase in the future.

Healthy School Recognized Campus’ Impact On Middle School Children’S Physical Activity Levels And Cardiovascular Fitness, Hoang Dao, Minh Le, Paula Butler, Mia Putnam, Allyson Schaefers, Jacob Szeszulski

International Journal of Exercise Science: Conference Proceedings

Most current research is focused on the effectiveness of a single physical activity intervention. Healthy School Recognized Campus (HSRC) is a Texas A&M AgriLife Extension initiative that promotes the delivery of multiple physical activity and nutrition programs on a school campus, such as Walk Across Texas. PURPOSE: This study aims to determine whether HSRC will improve cardiovascular fitness and increase physical activity among middle school students. METHODS: Students completed the Youth Activity Profile (YAP) survey to assess the amount of time that students spent engaging in physical activity (during school, outside of school, on weekends) and sedentary behaviors, the …

Evaluation Of Industrial Work Practice Program In Vocational High School 1 Rejotangan, Andini Dwi Rachmawati, Yaya Sukjaya Kusumah

Jurnal Pendidikan Vokasi

This study aims to evaluate implementing the Industrial Work Practice (Prakerin) program at the Vocational High School (VHS) of 1 Rejotangan. This type of research is evaluative with a descriptive qualitative method using the CIPP model. The population of this study was 15 students involved, five work of world instructors, 21 teacher councils, and the headmaster of VHS of 1 Rejotangan. Data collection techniques use interviews and observations. Interviews are conducted openly and behind closed doors. The interview was conducted with the headmaster of VHS of 1 Rejotangan. The observations made by the researchers aimed to capture data on pre-employment …

Developmental Assets And Community-Based Youth Programs In Colombia, Guatemala, And Honduras, Claire M. De Mezerville-López

Journal of Youth Development

This paper explores the external developmental assets and how they manifest in specific youth programs from Colombia, Guatemala, and Honduras. An evaluation process was created through a qualitative phenomenological with the youth programs' leadership. To triangulate the data, a survey was developed and piloted with a small sample from three youth programs, one from Honduras, one from Guatemala and one from Colombia, exploring how the staff evaluate items related with the external developmental assets. This survey was created in a way that the results display in the form of a Spiderweb and in a circular way that evokes and relates …

Preparing Youth For Civic Life And Leadership: Evaluating The Washington County 4-H Youth Officer Program, Paul A. Hill, Katarina J. Aikens

Outcomes and Impact Quarterly

The Washington County 4-H Youth Officer Program was designed to address youth preparedness for civic life in a democratic society. This program is targeted to students in grades 6-8th, who are at a critical stage in their development as citizens. The program emphasizes experiential learning, which allows youth to learn by doing as they deliver public speeches, visit with elected officials, and facilitate business meetings using Roberts Rules of Order. A total of 24 youth participants completed the program over two years. Evaluation results showed the program was successful in achieving student learning outcomes, with significant improvements in citizenship knowledge …

Journey Mapping: A New Approach To Extension Program Design And Evaluation, Jennifer Hawkins, Neil Linscheid, Somongkol Teng

The Journal of Extension

With origins in service and human-centered design and customer experience, journey mapping is a research and evaluation method that allows users to visualize the journey a person or group takes while engaging in a service, program, or system. Using this method, individuals provide feedback on their experience, highlighting successes and challenges along the way.

Minnesota Extension educators have utilized journey mapping in program design and evaluation contexts and have found great value in both. This article highlights three use cases which provide insight into lessons learned during the process and how Extension staff may use the tool in the future.

Incorporating Complexity Theory In Collaborative Educational Programs, Ximeng Chen

Northeast Journal of Complex Systems (NEJCS)

The field of education has witnessed an increasing trend of inter-organizational and inter-departmental collaborations and forming of networks. Collaborative educational programs have been implemented in a variety of ways. This paper proposes to understand and study collaborative educational programs through the lens of complexity theory and to utilize nonlinear research methods. This paper also proposes to connect the dots in the literature among complexity theory, collaborative educational programs, program evaluation, and alternative nonlinear research methods.

The Condensed Stem Survey As A Tool For Extension Educators, Jafeth E. Sanchez

The Journal of Extension

One Extension Specialist implemented a STEM pilot robotics program across three middle school settings. A program evaluation to provide guidance and recommendations for future development, implementation, and continued evaluation was conducted as part of a larger study. This process led to the development of a condensed STEM survey that can be used by Extension professionals on STEM dispositions among middle school youth.

Nurse Educator Certification: Overview And Evaluation Of The Canadian Association Of Schools Of Nursing Program, Karin Page-Cutrara, Patricia Bradley, Cynthia Baker

Quality Advancement in Nursing Education - Avancées en formation infirmière

The Canadian Association of Schools of Nursing (CASN) has spearheaded an education institute and fostered the growth of an accessible cadre of innovative educational programming that were built on identified national nursing educator competencies. The purpose of this article is to outline the development and structure of the CASN Canadian Nurse Educator Certification Program, share an analysis of one aspect of program evaluation data and summarize the program’s current value to nurse educators. The program offers flexible professional development for Canadian nurse educators through three online modules that prepare participants to sit the national certification exam and attain the designation …

Evaluating A Relationship Education Program With Incarcerated Adults, Terra L. Jackson, Francesca Adler-Baeder, Leah Burke, Silvia Vilches

Journal of Human Sciences and Extension

Research indicates healthy family relationships can reduce recidivism. More effort has been placed towards providing family life programming in prisons to promote healthy individual and relational functioning, yet only a handful of studies have evaluated and provided insight on relationship education (RE) for incarcerated adults. This study contributes to this emerging effort and examines changes following participation in a RE program, using a sample of 461 incarcerated men and women. Findings indicate significant improvements in anxiety and depressive symptoms and conflict resolution skills. Additional tests of moderation of change by gender, relationship status, and child age revealed a greater change …

Eyes Save Lives Water Safety Program For Parents And Caregivers: Program Design And Pilot Evaluation From Southern California, Rachel Love-Smith, William A. Koon, Lauren Tabios, Scott M. Bartell

International Journal of Aquatic Research and Education

Despite expert consensus and evidence-based preventative strategies against drowning, limited formal study exists on translating recommendations into practical and effective interventions. This paper describes the design of an education-based drowning prevention intervention and reports results from a pilot evaluation of the program’s effect on self-reported water-safe behaviors, attitudes, self-efficacy, and knowledge. Parents and caregivers attending children’s swim lessons in July and August 2018 participated in a brief water-safety education program. A pre-post-test design evaluated "Theory of Planned Behavior" indicators to assess for changes. We found significant increases in scores related to water safety knowledge, attitudes on maintaining arms reach distance …

Evaluation Of The Implementation Of Educational Assessment Standards At Madrasah Tsanawiyah Modern Islamic Boarding School, Nurul Ngarifillaili, Badrun Kartowagiran, Umwari Yvette

REID (Research and Evaluation in Education)

This study aims to collect, analyze, and present evaluation results and assess them by comparing the evaluation indicators. The evaluation focuses on achieving and implementing seven components of the Educational Assessment Standard in Islamic middle school (Madrasah Tsanawiyah or MTs) of modern Islamic boarding schools (pesantren) in the Kebumen Regency. The study employed a descriptive quantitative approach. The evaluation model was the discrepancy evaluation model. The study subjects were 227 students of grade VIII class 2020/2021. Data collection was performed using a questionnaire and brief interviews. The study result shows that 70.55% of students stated the assessment …

Evaluating The Structure, Demographics, And Effectiveness Of The Mississippi Master Naturalist Program, Sarah Cunningham, Eric Sparks, Adam Rohnke

The Journal of Extension

The purpose of our evaluation was to assess the structure, demographics, and effectiveness of the Mississippi Master Naturalist Program (MMNP) from 2015-2019. Results show that racial diversity within the MMNP was low and offering basic training courses during the work week attracts more retirees. Subsequently, an average retiree completed nearly three times more annual volunteer service hours than a non-retiree. Therefore, targeting retirees may be the most effective means of enhancing environmental stewardship within this program. Additionally, the results of this evaluation highlight that active recruitment of underserved populations is necessary to increase the diversity of participants in Extension programs.

A Review Of Program Evaluation In School Counseling: Improving Comprehensive And Developmental Programs, Amanda D. Rumsey

Journal of School-Based Counseling Policy and Evaluation

This book review includes a detailed overview and discussion of Michael S. Trevisan and John C. Carey’s book: Program Evaluation in School Counseling: Improving Comprehensive and Developmental Programs, New York, NY: Routledge, 132 pages, $124.00 (hardcover), ISBN 9781138346574. The review includes strengths and potential issues regarding the text’s value and uses in graduate programs and school counseling practice. Overall, the book is a great resource and would be helpful knowledge for anyone working in the context of school counseling.

Water Safety Education Programs In Culturally And Linguistically Diverse Seattle Communities: Program Design And Pilot Evaluation, William A. Koon, Elizabeth Bennett, Sarah Stempski, Jennifer Blitvich

International Journal of Aquatic Research and Education

Drowning is a public health concern that disproportionally affects children and minorities in Washington State. Community health educators from Seattle Children’s Hospital designed a Water Safety Education and Lifejacket Giveaway Program for low-income parents of preschool-aged children from culturally and linguistically diverse backgrounds. The program was interpreted into multiple languages and parents and children in attendance received free lifejackets. The mixed-methods pilot evaluation of this program found statistically significant relationships between language and self-reported parent swim skill level (English-speaker OR 4.6; 95%CI: 1.84 – 11.54); and confidence of keeping one’s child safe (English-speaker OR 3.34; 95%CI: 1.10 – 10.4). Additionally, …

Innovating A Promising Practice In High Poverty Rural School Districts, Hobart Harmon

The Rural Educator

This article gives meaning to innovating promising practices in high poverty rural contexts, as experienced by the Rural Math Excel Partnership (RMEP). The project sought to develop a model of shared school-family-community responsibility to support student success in foundational math courses as preparation for science, technology, engineering, mathematics and health (STEM-H) careers. RMEP was one of the two rural development grant awards in the 2012 federal fiscal year, the first year for awards in the rural priority area of the U. S. Department of Education’s Investing in Innovation (i3) program. High poverty rural areas may have major implications for fidelity …

Occupational Therapy Students’ Experiences Of Team-Based Learning: A Multi-Year Study, Bhing-Leet Tan, I-Ling Yeh, Phyllis Liang

Journal of Occupational Therapy Education

Many health sciences disciplines have adopted team-based learning (TBL) as part of their education pedagogy, with studies showing increased classroom participation and learner satisfaction. However, it will be beneficial to explore the learning experiences of occupational therapy students in TBL using a mixed methods approach. In an undergraduate occupational therapy program, students undertook three clinical modules using TBL in years two and three. This study explored their perceptions and experiences of TBL. This was a mixed methods prospective cohort study, during which two cohorts of students from Academic Year (AY) 2016 and AY2017 completed the Team-Based Learning Student Assessment Instrument …

The Evaluation Of Competency Certification Program Through The Lsp P-1 At Vocational High School, Budiyanto Budiyanto, Wardan Suyanto

Jurnal Pendidikan Vokasi

This research aims to evaluate the competency certification program's implementation through the First-Party Professional Certification Institute (LSP P-1) at SMK N 2 Klaten. The evaluation of the implementation of the competency certification program was reviewed on four aspects, e.g.: (1) context, (2) input, (3) process, and (4) product. This research is evaluation research based on the CIPP model (Context, Input, Process, Product). This research was conducted at SMK N 2 Klaten, which already had an LSP P-1license. The respondents were the principal, LSP chairman, secretary, treasurer, certification manager, chairman of the scheme committee, the competency test venue (TUK), and assessors. …

Us School Counselor State Licensure Requirements For Program Evaluation, Michael S. Trevisan, John C. Carey, Ian Martin, Narayankripa Sundararajan

Journal of School-Based Counseling Policy and Evaluation

Using qualitative content analysis (Cohen, Manion, & Morrison, 2007), we examined the expectations of states in the US regarding program evaluation content for school counselor licensure. Results show that 43 states maintain some form of program evaluation expectations for licensure, up from the 19 identified by Trevisan (2000). Twenty-eight states require licensure tests that purportedly align with CACREP, ASCA, or maintain a state developed licensure test that measures program evaluation content. Twenty-one states explicitly mention alignment of their curriculum with CACREP, ASCA, or both. The depth and scope of the program evaluation requirements that could be identified are ambiguous and …

Examining The Factor Structure Of A Middle School Stem Occupational Values Scale, Jessica Harlan, James Van Haneghan

Journal of Pre-College Engineering Education Research (J-PEER)

As part of a longitudinal study of the development and implementation of a middle school engineering design curriculum, we have used an occupational values subscale of the Assessing Men and Women in Engineering (AWE) project’s Engineering version of the Core Survey for Middle School-Aged Participants to measure student occupational interest in science, technology, engineering, and mathematics (STEM). According to the developers, this set of tools is intended to measure factors related to STEM careers, including occupational interests. While the AWE tools have been widely used, there have been no formal examinations of the psychometric properties of the middle school tools. …

Accreditation By Design: Construction Of An Instrument To Measure Teacher Candidates’ Perceptions Of Preparedness To Meet Intasc Standards, Michael Floren, Chelsie Hess, Valerie J.H. Sherman, Nancy M. Sileo

Journal of Educational Research and Innovation

The InTASC Candidate Self-Perception Instrument (ICSPI) is an innovative, high-quality educational measurement tool designed to support the assessment and accreditation efforts of a wide variety of educator preparation programs (EPP). The procedures used for the creation and refining of items for the ICSPI are presented, including empirical estimates of reliability from a trial implementation across three semesters. Evidence of instrument validity is discussed, while observed reliability estimates were found to be above acceptable levels for all subgroups. The ICSPI can be used to evaluate EPPs’ course offerings and requirements, align course outcomes with educational standards, provide data to advise programs …

Technically Speaking: Technical Skills Needed For Agricultural Communication Baccalaureate Graduates, Arthur Leal, Kati M. Lawson, Ricky W. Telg, Joy N. Rumble, Nicole Lamee Perez Stedman, Debbie Treise

Journal of Applied Communications

Technically Speaking: Technical Skills Needed for Agricultural Communication Baccalaureate Graduates

Abstract

The purpose of this national study was to assess the perceived importance of 57 technical skills identified in previous literature, and to determine entry-level, agricultural communication graduates’ ability to perform those technical skills as perceived by agricultural communication graduates, communication industry professionals, and agricultural communication faculty members. Participants from the three evaluation groups (n = 193) identified three of the most important technical skills needed by agricultural communication graduates. These skills were communicating in written form, concise and clear writing, and communicating verbally. Graduates placed a higher importance …

The Development, Implementation, And Evaluation Of A Pilot Program Designed To Enhance Wellbeing Through Self-Identified, Debra M. Sellers, Naomi R. Meinertz

Journal of Human Sciences and Extension

We describe the development, implementation, and evaluation of an introductory and interdisciplinary program to increase participants’ knowledge and awareness of wellbeing and intention to implement self-identified lifestyle changes. “Wellness and Wellbeing: What About Me?” was a University Extension pilot program that was designed to introduce wellbeing as a multidimensional construct. The program was delivered by Extension professionals in 14 sites across Iowa. Program evaluation consisted of a post-program assessment at the end of the seven-week series. The majority of the 115 post-program survey respondents were female, ranging in age from 22-88 years. Almost all survey respondents (89%) reported learning something …

Kids Don’T Float…And Their Parents Don’T Either: Using A Family-Centered Approach In Alaska’S Kids Don’T Float Program, Michelle E. E. Bauer, Audrey R. Giles, Justina Marianayagam, Kelli M. Toth

International Journal of Aquatic Research and Education

The goal of this experiential report is to outline the adoption of a family-centered Kids Don’t Float approach. We conducted a critical synthesis of information to reflect the expansion of the Kids Don’t Float program into a more family-centered approach. The critical synthesis provided insights into why we should adopt this approach, how it was implemented, and how it influenced drowning incidents compared to the previously used child-centered approach. The adoption of a family-centered approach may contribute to reducing drowning incidents by targeting parents, providing safety information to families, and promoting parental modelling of life jackets. Program evaluators and water …

Alcohol_Focused Drowning Prevention Campaigns: What Do We Know And What Should We Do Now?, Hannah Calverley, Lauren Petrass, Jennifer Blitvich

International Journal of Aquatic Research and Education

Alcohol and drugs have been identified as key risk factors for youth (aged 15-24 years) and adult drownings in high-income countries (HIC). Whilst alcohol specific drowning prevention education programs have been developed and implemented, youth continue to be over-represented in drowning statistics, including those linked with alcohol. Therefore, this project aimed to: (i) review and assess all alcohol themed drowning prevention campaigns within HICs; (ii) determine whether the campaign had undergone evaluation for effectiveness; and (iii) provide recommendations to improve the effectiveness of future interventions. For each of the eighty-one HICs identified for the 2019 fiscal year, searches of peer-reviewed …

Evaluation Of Beauty Training Programs In Regional Work Training Center Of East Jakarta Using The Goal Free Evaluation Model, Nely Suroyya Martalena, Dwi Atmanto, Jenny Sista Siregar

Jurnal Pendidikan Vokasi

This study aims to determine the impact of the beauty training program in PPKD of East Jakarta on students. The impact can be seen based on three criteria, namely positive impacts according to program objectives, positive impacts outside the program objectives (side effects), and negative impacts outside the program objectives. The research method used in this study is an evaluative study using the Goal Free Evaluation model. The research subjects consisted of: managers, instructors, and beauty training participants in PPKD of East Jakarta . Data was collected using observation, interviews, and documentation. The results showed that (1) the positive impact …

Developing A Tool For Analysing National Assessment Systems, Ursula Schwantner

International Developments

The Global Partnership for Education (GPE) Secretariat appointed the Australian Council for Educational Research (ACER) to develop a tool for analysing national assessment systems and identifying areas for improvement. Known as the Analysis of National Learning Assessment Systems (ANLAS), it provides a framework and tools that help countries, particularly GPE partner developing countries, to examine their national learning assessments and design strategies to address any gaps.

Exploring Beyond The Obvious: Social Skills Needed For Agricultural Communication Baccalaureate Graduates, Arthur Leal, Ricky W. Telg, Joy N. Rumble, Nicole Lamee Perez Stedman, Debbie M. Treise

Journal of Applied Communications

This national study sought to expand on current research to identify the importance of and graduates’ ability to perform selected social skills to aid in curricula evaluation and small program development. Using three evaluation groups – agricultural communication graduates, communication industry professionals, and agricultural communication faculty members – 193 individuals responded to the online survey. The most important social skills were those associated with having work values and transitioning into an organization to be a productive member in the workplace. Graduates placed a higher importance on social skills than the other two evaluation groups. All three evaluation groups showed some …

Youths’ Perspectives Of Experiential Learning Delivery: Findings From A Multistate 4-H Youth Program, Sarah Taylor, K. Anh Do, Shen Qin, Yan Ruth Xia, Maria Rosario T. De Guzman

Journal of Human Sciences and Extension

Youths’ perspectives are often unexplored in youth program development and implementation. This article examined youths’ perspectives of a 4-H youth prevention program called “Health Rocks!” that is designed to promote healthful decision-making skills, stress coping, and socioemotional skills related to substance use. Qualitative and quantitative data were collected and analyzed. Qualitative findings reveal that participants appreciated the fun and engaging curriculum, valued program staff who were interactive, and enjoyed the hands-on program activities. Participants also reported that the program positively impacted their knowledge and skills. Quantitative results show that participants who perceived the program as fun were significantly more likely …

An Evaluation Of Internship Program By Using Kirkpatrick Evaluation Model, Lathifa Rosiana Dewi, Badrun Kartowagiran

REID (Research and Evaluation in Education)

This study was aimed at evaluating an internship program using Kirkpatrick's evaluation program. The subjects of the study were students of batch 2015 and instructors. Slovin formula was used to calculate the sample. A questionnaire and teaching assessment sheet were used as instruments for collecting data. This study used content validity and exploratory factor analysis as the validity of the test. Reliability was estimated by Cronbach's Alpha. The results of this study showed that (1) in facility, the level of satisfaction was in the 'very satisfactory' category (77.01%); (2) in instructor, the level of satisfaction was in the 'very satisfactory' …