Social and Behavioral Sciences Commons^™

Evaluating The Organizational Advancement Of Diversity, Equity, And Inclusion In Extension Education, John M. Diaz, Lendel K. Narine, Cody Gusto

Journal of International Agricultural and Extension Education

In response to global trends and calls for greater inclusivity, the field of extension education has made significant strides towards embracing Diversity, Equity, and Inclusion (DEI) principles. This study explores the progress of DEI initiatives in the Cooperative Extension System (CES), which has aligned with industry groups, non-profit organizations, academia, and scientific societies worldwide. Through a multifaceted approach, CES has pursued strategies such as intercultural competence (ICC) training for professionals, diversity action plans, and culturally responsive teaching techniques. This study assessed the advancement of DEI in extension education using a survey of DEI specialists across extension organizations in the U.S. …

An Instrument To Evaluate 4-H Cloverbud Stem Programming, Alisha M. Hardman, Donna J. Peterson, Mariah S. Morgan, H. Elizabeth Solace

The Journal of Extension

Evaluation data is needed to demonstrate the impact of 4-H science, technology, engineering, and mathematics (STEM) programming on children and youth. However, collecting evaluation data from cloverbuds (ages 5-7) is particularly challenging given their developmental age. We adapted an observational Cloverbud evaluation tool to measure basic life skills, essential elements of positive youth development experiences, and, unique to this tool, STEM specific experiences. We developed the STEM items using educational science standards allowing Extension to document STEM in addition to youth development outcomes. Doing so, may increase the adoption of 4-H STEM programming by teachers in the school setting.

Development And Evaluation Of Impact Statements For The Expanded Food And Nutrition Education Program (Efnep), Kylie Pybus, Ronald L. Gibbs Jr., Karen Franck, M. Catalina Aragón

The Journal of Extension

Extension professionals often communicate program outcomes to external stakeholders using impact statements. We developed and evaluated four impact statements for the Expanded Food and Nutrition Education Program (EFNEP). We drafted the statements after conducting literature reviews for core content areas of EFNEP that include diet quality, food resource management, physical activity, and food safety. Subsequently, we evaluated the statements by facilitating expert panels made up of subject matter experts and communication professionals (n=14) from 12 Land-grant Universities. These impact statements aim to support EFNEP and other Extension professionals when communicating program value with key external stakeholders.

In Conversation: Two Community Foundations In Dialogue About Their Equitable Evaluation Framework™ Practice, Madeline Brandt, Kelly Casey, Jean-Marie Callan, Joel Hicks-Rivera, Kim Leonard, Madeline Nguyen, Elena Tamanas Ragusa, Cierra Stancil, Kimberlee Salmond, Becky Seel, Kate Szczerbacki

The Foundation Review

This conversation between staff at the Oregon Community Foundation and the Hartford Foundation for Public Giving shares how we are infusing the Equitable Evaluation Framework™ into our practice as we aim to be less extractive, shift power, and honor all ways of knowing and being as valid. In sharing this conversation, we want to pull the curtain back and offer a behind-the-scenes view into the conversations, realities, and challenges involved in doing this kind of work.

We sat down together for 90 minutes on a Wednesday afternoon, and the following is a rough transcript of our time together. The intention …

Learning, Unlearning, And Sprinkling In: Our Journey With Equitable Evaluation, Jane Mosley, Leigh W. Quarles, Jason L. Williams

The Foundation Review

The Health Forward Foundation recently completed a two-year journey with the Equitable Evaluation Initiative as a practicing partner. This partnership provided us with the support to push for change that better aligned with our new focus, prioritizing racial equity and economic advancement.

The partnership also allowed us to explore a number of questions fundamental to our work in learning and evaluation: what we really know about the impact philanthropy is making in our communities; how we can explain that to board members, and how we honor the personal experiences of the people we serve.

In this article we discuss our …

A Team's Journey Toward More Equitable Philanthropic Research And Evaluation Practices, Kimberly A. Spring, Maria Fernanda Mata, Jeffrey Poirier, Allison Holmes, Amir François

The Foundation Review

This article describes the journey of the Research and Evaluation team at the Annie E. Casey Foundation to develop an approach that would allow us to rethink and deepen how we, as funders of research and evaluation, center equity in our practice.

In particular, we explain how, through this process, we began to focus on what it means to orient research and evaluation toward participant owners and came to examine the assumptions, expectations, habits, and values that we held. These experiences have presented us with opportunities to learn and be open to new ways of engaging in our work.

We …

A Journey Into Equitable Practice: Doing More, Doing Differently, And Doing Better, Bree Bode, Sarah Panken, Annie Murphy, Marci Scott

The Foundation Review

The mission of the Michigan Fitness Foundation is to encourage and facilitate active lifestyles and healthy food choices through education, environmental awareness, community participation, and policy leadership. The article shares how a three-year engagement with the Equitable Evaluation Initiative led the foundation to see its grantmaking, programming, and evaluation practices anew through an equity lens.

Through naming and noticing the ways in which traditional grantmaking has contributed to the inequities that philanthropy seeks to address, the foundation was able to change its own way of working — specifically by going beyond the standard written grant proposal to actually sit with …

Servant Leadership And Violent Extremism: An Evaluative Framework, Eric J. Russell, Ardian Shajkovci

Servant Leadership: Theory & Practice

The following article presents a conceptual servant leadership framework for evaluating preventing violent extremism (PVE) policies and programs. The purpose of the work was to discover how servant leadership could strengthen existing PVE evaluative strategies. This article stems from work being done in servant leadership, counterterrorism, and countering violent extremism at Nichols College and Utah Valley University. The authors used a secondary analysis of empirical and literary servant leadership and PVE works to develop the framework. The analysis revealed a relationship between servant leadership’s commitment to the growth of people and building community and the need for PVE to be …

Evaluating The “What’S Up Down South” Economic Summit: A Platform For Business Leaders To Share Ideas, Paul A. Hill, Amanda D. Ali

Outcomes and Impact Quarterly

The What’s Up Down South economic summit is southern Utah’s largest business gathering. The event provides the business community with economic insights to assist them in making informed decisions. USU Extension evaluated the 27^th annual What's Up Down South economic summit. Results showed the event was an effective platform for disseminating information and advancing knowledge on economic and business topics. Participants felt the summit provided a valuable experience to the business community. These findings support the continuation of the summit's information dissemination activities in the future.

From Rastra To Bpnt: An Empirical Quantitative Evaluation Of Food Assistance Reform In Indonesia, Wahyuni Andriana Sofa

Economics and Finance in Indonesia

Since 2017, Indonesia has shifted from its Rastra program to BPNT, an e-voucher food-based initiative, due to issues with targeting and effectiveness in social assistance. This paper examines the impact of this transition on poverty alleviation and food security, using SUSENAS 2018 and propensity score matching. Findings indicate BPNT is less effective than Rastra in reducing households’ poverty risk and has led to decreased food access and nutrition. Impact variations are noted, which are found to be worse in households with less-educated heads, located in Java Island, and rural areas.

Evaluation Of E-Government Information Systems Agility: A Method And Case Study, Soumia Aggoune, Maohamed Amine Riahla

Emirates Journal for Engineering Research

Development of e-government evaluation frameworks began around 2000s. Most of the developed approaches are technologically driven in which they focus on the “E” rather than the “Government”. Moreover, they tend to evaluate tangible measures (such as costs, benefits, etc.) and neglects important intangible measures (such as agility, sustainability, etc.). The state of the art tells that the evaluation of agility within e-government has been proved to be important but complex. However, the importance is due to the increasing need for governments to justify investments, assess impacts and monitor progress in the ever-changing environment. On the other side, the complexity comes …

Development And Piloting Of A Novel Evaluation Tool For Childhood Obesity Prevention Programs, Heather Norman-Burgdolf, Anne R. Lindsay, Kelly Webber, Julie C. Parker, Ingrid K. Richards Adams, Rafida Idris, Laura Hubbs-Tait, Karen Chapman-Novakofski

Journal of Human Sciences and Extension

Childhood obesity remains chronic and high in the U.S., driven by factors including poor dietary habits and lack of physical activity. Interventions that address multiple causal factors may be the most appropriate strategy to address rising childhood obesity rates. The Cooperative Extension Service offers programs across the country to address causal factors of childhood obesity, but few coordinated or concerted efforts have been made to determine overlap, reduce duplication, or identify best practices in programming. To fill this gap, the National Institute of Food and Agriculture Multistate Project W3005 Extension Workgroup sought to develop a novel tool to compare programs …

Evaluating Implementation And Barriers To Sustainability Of An Asthma Clinical Quality Improvement Project, Holly Uphold Phd, Ms, Diane Liu Md, Faap

Journal of Nursing & Interprofessional Leadership in Quality & Safety

Purpose and Objectives

Asthma is an important public health issue in Utah and quality asthma care is essential to addressing the burden of asthma. The purpose of this initiative was to evaluate clinical asthma quality improvement (QI) program delivery formats and identify barriers to sustaining QI processes.

Intervention Approach

The focus of the intervention was to improve clinical asthma care through reducing variation in clinician knowledge about recommended asthma care and facilitating process improvements in asthma care delivery using Academic Detailing (AD) and Learning Collaboratives (LC) QI delivery formats.

Evaluation Methods

A pre/post-test design was used to compare improvements between …

Using Research To Save The Anthropocene: A Review Of Michael Quinn Patton’S Blue Marble Evaluation: Premises And Principles, Richard H. Rogers

The Qualitative Report

Patton’s (2020) book, Blue Marble Evaluation: Premises and Principles, will expand your knowledge of evaluation, research, the Anthropocene, global issues, and the planet. In 2023, it is important that we understand the impact of our past and present actions on the planet and the future of humanity. Patton’s principles, supported with comics, figures, and exhibits, will grow evaluators in the knowledge, skills, and mindset to make a positive future difference in our planet and humanity. Methodologists will appreciate a new way to examine evaluation and grow as professionals while professors will have a source to add to their course …

Construction Of Evaluation System Of Effectiveness Of Supply Based On Spatial Perspective, Tienan Song, Haikuo Yu

International Journal of Physical Activity and Health

The requirement of "building a higher-level National Fitness Public Service system centering on meeting the needs of the people" by the Chinese State Council is to guarantee and satisfy the demand of public through effective supply. However, despite of the clear purpose of the task, there is still a gap between the actual and the expected status of National Fitness Public Service supply. Based on the characteristics of the perspective of space, the purpose of this study is to examine how to measure and achieve the effectiveness of National Fitness Public Service’s supply. By reviewing the literature, relevant results of …

A Promising Place-Based Collaborative Impact Investing Fund Strengthens Community And Informs Philanthropic Practice, Benjamin Kerman, Clara Miller

The Foundation Review

A recent evaluation of the Western New York Impact Investment Fund adds to the proof-of-concept literature regarding “doing good and doing well” while pointing to experience-based best practices in philanthropic impact investing. Born of a collaboration between regional and national philanthropies, the fund brings together corporate, individual, and philanthropic investors to deliver an inclusive impact investment mechanism. Founded in 2017, the fund evolved from concept to operating entity, focusing on mitigating capital gaps, longterm economic decline, and wealth divides.

Evaluation at Year 5 describes how the professionally managed, collaboratively governed fund has attracted and deployed capital, contributing to ecosystem improvements …

Tour De Fort: Creating And Evaluating Guided Archaeology Tours, Laura K. Clark Hunt, Mike Thomin

Journal of Archaeology and Education

Since 2011, the Florida Public Archaeology Network (FPAN) Coordinating Center office in Pensacola, Florida has partnered with the National Park Service staff at Gulf Islands National Seashore (GUIS) to develop and implement a public program called Tour de Fort. This guided bicycling tour was created by FPAN with the goal to promote the public appreciation for the many terrestrial and underwater archaeological resources located within the GUIS Fort Pickens Area. Tour de Fort has remained a popular and well attended program over the years. Based on public demand, other guided tours were developed using Tour de Fort as a …

Informing Practice Through Professional Development: An Interstate Urban Programming Study Tour, Vernelle Mitchell-Hawkins, Deborah Dietrich

Journal of Youth Development

Southeast Pennsylvania 4-H Extension educators identified a need for professional development in order to further develop current urban 4-H programs. The expectation was that increased awareness and knowledge would lead to increased skills competency in planning, implementing, and evaluating urban 4-H youth development programs. An interstate professional development program was developed to inform practitioners on positive youth development in urban communities. The 2-day program included on-site observations of urban programs and professional development on best practices. The event was scheduled as a study tour that involved intentional focus on practical applications of research theory for informal education. The Penn State …

The Go Wild With Whole Grains! School-Based Program: Positive Impacts Among Children, Joshua Bailey, Sara Van Offelen, Hyunjun Kim, Marla Reicks

The Journal of Extension

Whole grain foods have been associated with health benefits, yet are underconsumed by youth compared to recommendations. This study evaluated impacts of a school-based curriculum among children in grades 3-5 to address barriers to intake (2018-2019) (n = 1,748). Surveys before and after the program indicated youth were more willing to try and better able to identify whole grain foods. Open-ended responses confirmed findings regarding increased ability to identify whole grain foods, increased preferences and perceptions of availability. Together, these impacts could increase the likelihood that youth can meet whole grain intake recommendations to improve diet quality and health.

Evaluating Utah's Rural Online Initiative: Empowering Organizational Leaders Through Remote Work, Paul A. Hill, Amanda D. Ali, Lendel K. Narine, Andrea T. Schmutz, Tyson M. Riskas, Debra M. Spielmaker

The Journal of Extension

Compared to urban counties, Utah's rural counties experienced high levels of unemployment. Informed by a statewide needs assessment, Utah State University Extension developed a remote work leadership course to equip business leaders with knowledge and skills to create remote jobs as a solution to rural unemployment. This descriptive evaluation study collected data from course participants (N = 62). Findings showed short-term outcomes were achieved; participants experienced increases in knowledge and skills and had more positive intentions toward creating remote jobs and hiring employees from rural counties. Extension professionals can design and evaluate their programs using the framework in this study.

Advancing Philanthropic Strategy Through Evaluative Thinking: One Foundation’S Approach, Christine Baker, Margaret Eigsti, Kathryn Racine, Laurence O’Connell

The Foundation Review

The Sisters of Charity Foundation of Cleveland supports Catholic sisters and their ministries in northeast Ohio through the grantmaking, partnership, capacitybuilding, and evaluation efforts of its Catholic Sisters Program Area. The decline of sisters actively engaged in ministry, due both to their rising median age and a decades-long decline in their overall numbers, called for a reconsideration and likely revision of the CSPA existing theory of change.

Unlike other strategic approaches at the foundation, such as ending homelessness or improving health equity, transitioning from sister-led to lay-led leadership of ministries remained largely unexplored: Basic research was lacking, and model practices …

Out Of Crisis, Learnings Shape Future Grantmaking, Stacie S. Cherner

The Foundation Review

Like other philanthropic organizations during the early weeks of the COVID-19 pandemic, the Jim Joseph Foundation took steps to loosen grant requirements, support CEOs and leadership teams, and provide funding for emergencies and innovations.

The foundation, which strives to bring consistent expertise with evaluation and research in untroubled times and whose mission is to foster effective Jewish learning experiences for young Jews, has a unique perspective when reflecting on learning. So another area that required flexibility was in the re-examination of learning plans to take advantage of the “forced experimentation” imposed by the pandemic lockdown.

In March 2020, the foundation …

The Method Of Goalkeeper’S Evaluation In Futsal, Andrzej Szwarc, Mateusz Oszmaniec, Patrycja Lipinska

Baltic Journal of Health and Physical Activity

Background: The aim of this study was to develop a research tool used to assess the efficiency a goalkeeper’s actions in a game of futsal. Material/Methods: Author’s own proposal of an observation sheet was created and subject to a validation procedure. To assess intra-rater reliability and inter-rater reliability, the ICC test was used. Results: There was a strong compatibility of ratings of the intra-rater reliability – 1.00 (95% Cl 1.00-1.00) and the inter-rater reliability – 0.99 (95% CI 0.99-1.00), which proves the reliability of the proposed research tool. Conclusions: The developed sheet allows the registration and evaluation of individual performance …

Optimizing The Assessment Of Motor Skills In 6th Grade Pupils Through Multimedia Means, Paul Szabo-Alexi, István Pocsai, Mariana Szabo-Alexi

Baltic Journal of Health and Physical Activity

Background: In this paper we propose to analyze ways to introduce multimedia methods in the evaluation process in the discipline of physical education and sports, by increasing the objectivity of evaluation and self-evaluation. Material and Methods: During the research, 20 students aged 12–13 were filmed and evaluated. Movement analysis software, Kinovea application, version 0.8.15, was used to analyze the recorded image. Results: Through the centralized data represented in graphs and tables, at the first evaluation, the control group obtained results closer to the execution model by an average of 0.62% in 5 of the 6 samples. Following the application of …

Tools For Healthy Living: Lessons Learned About Program Efficacy, Youth Knowledge, And Youth Engagement, Sharon Gray, Jennifer Cushman, Miriah Kelly, Mary Margaret Gaudio, E. Jean Gubbins

The Journal of Extension

Youth in grades 4 to 6 were presented with healthy living topics through a two cycle, 11-week 4-H after school curriculum designed for low income, urban populations. Pre- and post-surveys were used to measure knowledge of healthy homes topics such as mold and moisture, lead poisoning, pests, asthma triggers, smoking, and food safety. Daily journaling activities designed to measure youth engagement also added to the mixed data set. Lessons learned about program efficacy, youth knowledge, and youth engagement are presented.

Development Of Instrument To Assess Influence Of Extension Conference On Intended Outcomes, Marina D. Denny, Martha A. Ellard

The Journal of Extension

The Annual Conference for Mississippi State University Extension is the sole event at which the majority of Extension personnel gather for networking, organizational updates, recognition of efforts, and professional development. Extension leaders plan this conference with intended outcomes but without ever evaluating those outcomes beyond attendee satisfaction. We developed an evaluation instrument to determine how certain conference events influence participants’ critical psychological states and ultimately, their perceived motivation, professional enrichment, opportunities for networking, professional accountability, and organizational awareness. Rather than simply assessing attendee satisfaction, this instrument may help inform planning for successive Extension conferences and other professional development events.

Can Mini Grant Programs Address Community Health Improvement Plans In Rural Areas? A Local Evaluation, Kelley Ditzel, Cameron Watts

Journal of the Georgia Public Health Association

Background: In the rural community of Hancock County, Georgia, it became apparent in the summer of 2017 that outside help was necessary to address the failing health and education problems plaguing this area. The North Central Health District received Healthcare Georgia Foundation grant leading to the creation of the Hancock Health Improvement Partnership (HHIP) composed of 11 community leaders who developed the Community Health Improvement Plan to positively impact their county.

Methods: This evaluation was conducted to report the efficacy of the mini grant program developed by the HHIP, particularly how grants could best improve organizational capacity, incentivize community collaborations, …

Gis Application For Evaluation Of Trade And Services Area Development In Serang City, Banten Province, Adam Hastara Aji, Nurina Rachmita, Nurwita Mustika Sari, Benedictus Kushardian

Jurnal Geografi Lingkungan Tropik (Journal of Geography of Tropical Environments)

Trade and service area is an area that facilitates trade transactions and services between people in need (demand side) and people who sell services (supply-side). In determining trade areas and services, SMCE or Spatial Multi-Criteria Evaluation or spatial evaluation techniques consider many different criteria when making decisions. The method used in this paper is SMCE with Weight Overlay technique using four variables, namely roads, slopes, settlements and rivers. Weighting carried out in the analysis was made with various simulations, namely Simulation A with the same weight weighting on each variable 25%, simulation B with dominant weighting on one of the …

Using Extension As A Vehicle To Reduce Elementary Student Food Waste, Rebecca Koetz, Rod N. Williams

The Journal of Extension

Extension can play a key role in providing food waste education nation-wide. This study is the first to evaluate the effects of environmentally focused lesson plans on elementary student knowledge and perceptions regarding food waste. Herein we provide suggestions on concepts to teach students for the greatest impact on food waste reduction. We also provide avenues to incorporate food waste education into existing Extension programming. We hope the study can inspire and inform further food waste program development, assessment, and implementation through Extension.

Lost Causal: Debunking Myths About Causal Analysis In Philanthropy, Jewlya Lynn, Sarah Stachowiak, Julia Coffman

The Foundation Review

What if philanthropic evaluations told us that changes in the world had occurred, as well as how and why they occurred, including in what ways foundation funding and grantees contributed to those changes? What if evaluations made change pathways more visible, tested hypotheses and assumptions, and generated new insights based on what happened in the “black box” of systems change strategies? This type of learning comes from causal analysis — inquiry that explores cause-andeffect relationships.

Yet currently in philanthropy, particularly for strategies and initiatives that feature high complexity, few evaluations use robust techniques for understanding causality. Instead, philanthropic evaluation tends …