Social and Behavioral Sciences Commons^™

In Conversation: Two Community Foundations In Dialogue About Their Equitable Evaluation Framework™ Practice, Madeline Brandt, Kelly Casey, Jean-Marie Callan, Joel Hicks-Rivera, Kim Leonard, Madeline Nguyen, Elena Tamanas Ragusa, Cierra Stancil, Kimberlee Salmond, Becky Seel, Kate Szczerbacki

The Foundation Review

This conversation between staff at the Oregon Community Foundation and the Hartford Foundation for Public Giving shares how we are infusing the Equitable Evaluation Framework™ into our practice as we aim to be less extractive, shift power, and honor all ways of knowing and being as valid. In sharing this conversation, we want to pull the curtain back and offer a behind-the-scenes view into the conversations, realities, and challenges involved in doing this kind of work.

We sat down together for 90 minutes on a Wednesday afternoon, and the following is a rough transcript of our time together. The intention …

Learning, Unlearning, And Sprinkling In: Our Journey With Equitable Evaluation, Jane Mosley, Leigh W. Quarles, Jason L. Williams

The Foundation Review

The Health Forward Foundation recently completed a two-year journey with the Equitable Evaluation Initiative as a practicing partner. This partnership provided us with the support to push for change that better aligned with our new focus, prioritizing racial equity and economic advancement.

The partnership also allowed us to explore a number of questions fundamental to our work in learning and evaluation: what we really know about the impact philanthropy is making in our communities; how we can explain that to board members, and how we honor the personal experiences of the people we serve.

In this article we discuss our …

A Team's Journey Toward More Equitable Philanthropic Research And Evaluation Practices, Kimberly A. Spring, Maria Fernanda Mata, Jeffrey Poirier, Allison Holmes, Amir François

The Foundation Review

This article describes the journey of the Research and Evaluation team at the Annie E. Casey Foundation to develop an approach that would allow us to rethink and deepen how we, as funders of research and evaluation, center equity in our practice.

In particular, we explain how, through this process, we began to focus on what it means to orient research and evaluation toward participant owners and came to examine the assumptions, expectations, habits, and values that we held. These experiences have presented us with opportunities to learn and be open to new ways of engaging in our work.

We …

A Journey Into Equitable Practice: Doing More, Doing Differently, And Doing Better, Bree Bode, Sarah Panken, Annie Murphy, Marci Scott

The Foundation Review

The mission of the Michigan Fitness Foundation is to encourage and facilitate active lifestyles and healthy food choices through education, environmental awareness, community participation, and policy leadership. The article shares how a three-year engagement with the Equitable Evaluation Initiative led the foundation to see its grantmaking, programming, and evaluation practices anew through an equity lens.

Through naming and noticing the ways in which traditional grantmaking has contributed to the inequities that philanthropy seeks to address, the foundation was able to change its own way of working — specifically by going beyond the standard written grant proposal to actually sit with …

A Promising Place-Based Collaborative Impact Investing Fund Strengthens Community And Informs Philanthropic Practice, Benjamin Kerman, Clara Miller

The Foundation Review

A recent evaluation of the Western New York Impact Investment Fund adds to the proof-of-concept literature regarding “doing good and doing well” while pointing to experience-based best practices in philanthropic impact investing. Born of a collaboration between regional and national philanthropies, the fund brings together corporate, individual, and philanthropic investors to deliver an inclusive impact investment mechanism. Founded in 2017, the fund evolved from concept to operating entity, focusing on mitigating capital gaps, longterm economic decline, and wealth divides.

Evaluation at Year 5 describes how the professionally managed, collaboratively governed fund has attracted and deployed capital, contributing to ecosystem improvements …

Evaluating Utah's Rural Online Initiative: Empowering Organizational Leaders Through Remote Work, Paul A. Hill, Amanda D. Ali, Lendel K. Narine, Andrea T. Schmutz, Tyson M. Riskas, Debra M. Spielmaker

The Journal of Extension

Compared to urban counties, Utah's rural counties experienced high levels of unemployment. Informed by a statewide needs assessment, Utah State University Extension developed a remote work leadership course to equip business leaders with knowledge and skills to create remote jobs as a solution to rural unemployment. This descriptive evaluation study collected data from course participants (N = 62). Findings showed short-term outcomes were achieved; participants experienced increases in knowledge and skills and had more positive intentions toward creating remote jobs and hiring employees from rural counties. Extension professionals can design and evaluate their programs using the framework in this study.

Advancing Philanthropic Strategy Through Evaluative Thinking: One Foundation’S Approach, Christine Baker, Margaret Eigsti, Kathryn Racine, Laurence O’Connell

The Foundation Review

The Sisters of Charity Foundation of Cleveland supports Catholic sisters and their ministries in northeast Ohio through the grantmaking, partnership, capacitybuilding, and evaluation efforts of its Catholic Sisters Program Area. The decline of sisters actively engaged in ministry, due both to their rising median age and a decades-long decline in their overall numbers, called for a reconsideration and likely revision of the CSPA existing theory of change.

Unlike other strategic approaches at the foundation, such as ending homelessness or improving health equity, transitioning from sister-led to lay-led leadership of ministries remained largely unexplored: Basic research was lacking, and model practices …

Out Of Crisis, Learnings Shape Future Grantmaking, Stacie S. Cherner

The Foundation Review

Like other philanthropic organizations during the early weeks of the COVID-19 pandemic, the Jim Joseph Foundation took steps to loosen grant requirements, support CEOs and leadership teams, and provide funding for emergencies and innovations.

The foundation, which strives to bring consistent expertise with evaluation and research in untroubled times and whose mission is to foster effective Jewish learning experiences for young Jews, has a unique perspective when reflecting on learning. So another area that required flexibility was in the re-examination of learning plans to take advantage of the “forced experimentation” imposed by the pandemic lockdown.

In March 2020, the foundation …

Hci Education And Ux Practice: Highlights From Singapore, Tamas Makany, Dharani Perera-Schulz

Research Collection Lee Kong Chian School Of Business

This position paper highlights trends in education, practice, and support of HCI/UX in Singapore, a small city-state island in Southeast Asia. The paper was prepared for the 2022 Southeast Asia Computer-Human Interaction (SEACHI'22) virtual workshop on Apr 14, 2022, as part of the ACM CHI Conference on Human Factors in Computing Systems (CHI'22) international conference.

Lost Causal: Debunking Myths About Causal Analysis In Philanthropy, Jewlya Lynn, Sarah Stachowiak, Julia Coffman

The Foundation Review

What if philanthropic evaluations told us that changes in the world had occurred, as well as how and why they occurred, including in what ways foundation funding and grantees contributed to those changes? What if evaluations made change pathways more visible, tested hypotheses and assumptions, and generated new insights based on what happened in the “black box” of systems change strategies? This type of learning comes from causal analysis — inquiry that explores cause-andeffect relationships.

Yet currently in philanthropy, particularly for strategies and initiatives that feature high complexity, few evaluations use robust techniques for understanding causality. Instead, philanthropic evaluation tends …

A Systematic Literature Review : Information Technology Capital And Performance, Ilham M, Anis Eliyana, Tri Siwi Agustina

Library Philosophy and Practice (e-journal)

This study aims to conduct a systematic literature review of research in the field of Information Technology Capital and Performance with data from all international research publications. The data obtained in this study amounted to 113 academic documents published from 1994 to 2020 globally. Research has discussed a lot about the causal relationship between information technology capital and company performance, the results of empirical studies vary to some extent with the exception of Information Technology business partnerships which are referred to as Information Technology business and strategic alignment. To that end, strategic alignment has emerged as one of the most …

A Mission To Improve Health: Lessons From Missouri’S Expanding Coverage Initiative, Anna Saltzman, Shayla Spilker, Megan Klenke-Isgriggs

The Foundation Review

To support the implementation of the Affordable Care Act, in 2013 Missouri Foundation for Health launched the Expanding Coverage Initiative. The fiveyear effort sought to reduce Missouri’s uninsured rate from 13% to less than 5% by developing a broad-based state coalition and employing a three-pronged approach of awareness building and outreach, enrollment assistance, and increasing health literacy.

While the initiative did not achieve its rate-reduction goal, the rate of uninsured Missourians dropped to 9% during the ECI’s time frame, a decrease on par with the national average despite the fact that at the time Missouri was one of 17 states …

Evaluasi Pelayanan Posbindu Penyakit Tidak Menular Di Wilayah Kerja Puskesmas Jagasatru Kota Cirebon Pada Era Pandemi Covid-19, Ari Nurfikri, Supriadi Supriadi, Badra Al Aufa

Jurnal Administrasi Bisnis Terapan

This study evaluates the Non-Communicable Disease Posbindu services in the Jagasatru Public Health Center in Cirebon City during the Covid-19 pandemic era seen from the aspects of communication, resources, disposition, and bureaucratic structure. The method used is a qualitative analysis method, with a case study design. The research subjects were eight cadres of Posbindu Non-Communicable Diseases using random sampling technique; data collection was done by in-depth interview technique. This study's results indicate that the evaluation of services from the aspect of communication to the target of the analysis is correct, but has not yet reached the mark of productive age. …

Measuring The Effectiveness Of Equitable Economic Development Strategies, Amy Minzner

The Foundation Review

There is anecdotal evidence that equitable economic development activities can foster inclusive growth and unlock the full potential of local economies by dismantling barriers and expanding opportunities for low-income people and communities of color. These strategies are being used with increasing frequency, and advocates and funders are pressing for their use throughout the country. Because of this, there is a need to better understand the link between equitable economic development activities and their ability to foster equitable opportunities and resulting impacts.

Establishing this link will require a new measurement strategy because traditional measures of economic development effectiveness focus on communitywide …

Library Services: Impact Analysis Spring 2018 To Fall 2018, Amanda M. Hagman, Lindsay Ozburn, Hayden Hoopes, Erik Dickamore, Bradford R. Cole, Mitchell Colver

Publications

Libraries are an essential element of learning on university campuses. The content housed within libraries supports academic exploration and growth. Physically, libraries are designed to provide access to materials and spaces that facilitate learning. This report explored the impact of student library resource use on student persistence to the next term.

Students' library resource use was captured with EZ Proxy log-ins and library material check-outs. Students who had a record of using library resources were compared to similar students who did not have a record of library resource use. They were compared using prediction-based propensity score matching. Students who used …

Using Social Network Analysis To Understand The Perceived Role And Influence Of Foundations, Todd L. Ely, Katie Edwards, Rachel Hogg Graham, Danielle Varda

The Foundation Review

Collaboration between foundations and other organizations is critical to the success of foundation-supported initiatives, but the power dynamics among foundations, grantees, and their broader communities can be challenging. Social network analysis is a tool to assess collaboration among organizations and its outcomes. A unique yet often underemphasized benefit of this method of analysis is its focus on dyadic relationships between organizations, which presents an opportunity for foundations to evaluate their role in a network and how they are perceived by the very organizations whose missions they support.

This article leverages a social network analysis of community partners focused on addressing …

Assessing Change And Deepening Impact In Early Learning Systems: The Formal-System Self-Assessment Tool, Erika Takada, Clare Nolan, Meera Mani

The Foundation Review

The David and Lucile Packard Foundation is investing in a 10-year strategy, Starting Smart and Strong, that partners with three California communities to develop and test solutions to support parents, caregivers, and educators as they prepare children to be ready for school. Central to this strategy are community efforts to create comprehensive early learning systems that model quality teaching practices, secure and ensure adequate distribution of resources, and have capacity to improve, innovate, and scale.

One of the challenges in systems evaluation is identifying meaningful indicators of interim progress toward longer-term change. From the start, the evaluation has been learning …

Building Nonprofit Capacity To Achieve Greater Impact: Lessons From The U.S.-Mexico Border, Meg Loomis, Shirly Thomas, Carla Taylor

The Foundation Review

Foundations often rely on strong relationships with grantees doing frontline work in marginalized communities. Yet these nonprofits typically face myriad financial and policy pressures that must be managed amid increasing need for their services. Helping them expand their impact requires funders to invest in their grantees’ organizational health and capacity.

This article discusses the capacity-building funding experiences of Methodist Healthcare Ministries of South Texas, which saw firsthand the needs of grantees when it partnered with eight community-health organizations through its Sí Texas initiative and, in response, created a $1.5 million capacity-building program for those organizations.

This article also shares the …

Can Coaching Help Community Partnerships Promote Health Equity, Community Engagement, And Policy, Systems, And Environmental Changes? Results From An Evaluation, Jung Y. Kim, Lisa Schottenfeld, Michael Cavanaugh

The Foundation Review

Foundations and other entities have increasingly funded coaching and technical assistance to support multisector community partnerships to promote health and health equity. However, much remains to be learned about how coaching can best support these partnerships.

As part of its efforts to build a culture in which everyone in the United States has a fair opportunity to be healthy, the Robert Wood Johnson Foundation partnered with the University of Wisconsin Population Health Institute to provide structured coaching to strengthen the capacities of community partnerships. The foundation contracted with Mathematica to evaluate the coaching program, focusing on whether it had an …

Scaling Programs With Research Evidence And Effectiveness (Spree), Nan Maxwell, Scott Richman

The Foundation Review

Foundations can serve more people by identifying and supporting effective interventions that are ready to be scaled. This article describes a process called SPREE — Scaling Programs with Research Evidence and Effectiveness — that can help funders and their grantees scale successfully. Implementing this process can assist foundations in using evaluation research as a tool to determine which interventions are likely to produce desired outcomes, and to identify which organizations are ready to scale them. The SPREE process is grounded in evaluation and implementation science frameworks and has been applied since 2016 by the Corporation for National and Community Service. …

2019 Improving The Lives Of San Diego County Seniors Through Stable Housing: An Evaluation Of Elderhelp's Homeshare Program, Tessa Tinkler, Lisa Walker, Mary Jo Schumann

Seniors

This report, prepared by the Nonprofit Institute's Caster Center, documents the findings from a program evaluation of ElderHelp's HomeShare program, which is designed to connect individuals who want to share their homes with others looking for alternative housing options.

Evaluating For The Bigger Picture: Breaking Through The Learning And Evaluation Barriers To Advancing Community Systems-Change Field Knowledge, Thomas Kelly, Prudence Brown, Hanh Cao Yu, Marie Colombo

The Foundation Review

Foundations investing in community systems change often fail to prioritize field-level and cross-initiative evaluation questions in building initiatives. As a result, many of the documented evaluations of such investments lack translatable lessons specific and influential enough to drive related decisions and actions of others in the field.

This article developed from ongoing, multiyear peer learning across several foundations that collectively compiled recommendations for community systems-change funders and evaluators to implement more powerful evaluations. They are intended to help funders and evaluators engaged in these efforts build sectorwide knowledge capable of informing improved work across initiatives and communities. This article also …

Challenges To Effective Monitoring And Evaluation Systems: Lessons From Afghanistan, Qudratullah Jahid

International Development, Community and Environment (IDCE)

How can monitoring and evaluation (M&E) systems better support improving the aid effectiveness? What are the existing challenges to the M&E systems in Afghanistan? I try to answer these questions by briefly looking at the development aid in Afghanistan since 2001. I provide summary of attempts made at improving aid effectiveness through mutual accountability frameworks. I then try to briefly discuss the principles of Paris Declaration and provide brief insights from Afghanistan. I then discuss the status of monitoring and evaluation in Afghanistan by providing a picture functional M&E system and then discussing the existing challenges in Afghanistan. Finally, I …

Knowledge Translation To Enhance Evaluation Use: A Case Example, Alison Rogers, Catherine Malla

The Foundation Review

Knowledge in the form of information suitable for decision making or advocacy by foundations is not always readily available — a situation unacceptable for those who need such information for accountability, learning, and influencing policy and practice. This article addresses how essential information about monitoring, evaluation, and lessons learned can be made available to foundations.

The Fred Hollows Foundation identified a gap in this area through an evaluation capacity-building readiness assessment, and introduced the concept of participatory, real-time monitoring, evaluation, and learning bulletins grounded in the principles of knowledge translation. This article describes how those bulletins were developed and used …

Challenges And Opportunities In Philanthropic Organizational Learning: Reflections From Fellow Grantmakers, Jennifer Chubinski, Kelley Adcock, Susan Sprigg

The Foundation Review

As the field of philanthropy has matured, increasing attention has been paid to evaluating the impact of philanthropic investments. In recent years, the scope of evaluation has expanded to include an intentional focus on organizational learning with the goal of learning from ongoing work, informing decision-making, and ultimately improving impact.

With this momentum to carry out organizational learning strategies and share successes, the sector has not yet stopped to reflect on challenges and lessons learned in the process of building the capacity for organizational learning — the messy yet meaningful middle between a desire for learning and the implementation of …

Strategic Learning In Practice: A Case Study Of The Kauffman Foundation, Matthew Carr, Brett Hembree, Nathan Madden

The Foundation Review

Increasingly, foundations and nonprofits are seeking to engage their staff in learning and reflection activities that assess successes and challenges, and then generate insights that can improve programs and funding strategies. Yet, despite the intuitive benefits, there are common challenges that often stand in the way of promoting strategic learning for continuous improvement.

For the past year, the Ewing Marion Kauffman Foundation has been focused on creating more systematic and intentional strategic learning across our organization. As part of this work we cultivated a select cohort of staff to be “learning champions,” created simple tools and processes that can more …

Shifting Mindsets: How Meaningful Accountability Systems Can Strengthen Foundation Learning And Improve Impact, Marc J. Holley, Marcie Parkhurst

The Foundation Review

This article explores what it looks like when a foundation attempts to integrate accountability and learning practices, and presents a framework for the unique and complementary contributions that accountability and learning can make to the work of foundations.

The article also looks at the tensions that can arise when a foundation’s internal evaluation staff attempt to design, implement, and make use of accountability systems. Specifically, it identifies three problematic perspectives that can hold foundations back from full engagement in internally driven accountability initiatives, and offers practical guidance on how to shift these mindsets to more productive practices.

It concludes by …

Evaluators As Conduits And Supports For Foundation Learning, Clare Nolan, Meg Long, Debra Joy Perez

The Foundation Review

Evaluators play a critical role in supporting philanthropic learning, programming, and strategy, but evaluation and learning in philanthropy is often limited in ways that impede deeper resonance and impact.

Most philanthropic evaluation is focused on the needs of individual foundations, knowledge sharing with the broader field is limited, and foundations struggle to integrate evaluation and learning as a management tool. This article makes the case that evaluators and funders can do more to build the collective capacity of evaluators working in philanthropy in order to enhance their contributions to community change.

This article also examines the ways that evaluation in …

Building Principle-Based Strategic Learning: Insights From Practice, Kelci M. Price, Chera Reid, Suzanne Kennedy Leahy

The Foundation Review

Strategic learning is a powerful tool for foundations to achieve greater impact, yet foundations have struggled to create practices and behaviors that effectively support them in learning about strategy. Given that many foundations are engaged in strategic philanthropy, where they have specific conditions in the world they are trying to change, it is critical that they have the capacity to effectively learn about and improve their strategies.

This article offers three principles for strategic learning, informed by the field of strategic learning and insights from practice across three foundations. Each principle is explored in terms of what it means and …

Efektivitas Program Pelatihan Program Pengendalian Infeksi (Ppi) Melalui Evaluasi Pre Test Dan Pos Test Di Bagian Diklat Rumah Sakit Pusat Otak Nasional (Rsp Pon), Nur Fadilah Dewi, Yulial Hikmah

Jurnal Administrasi Bisnis Terapan

Education and Training National Brain Center Hospital is the part that takes care of all matters related to education and training of hospital staff. One type of training is held, namely the Training of Prevention and Control of Infection. Prevention and Control of Infection training is a systematic and planned effort to control the spread of hospital infections. This study aims to determine the effectiveness of infection control program training to employees of National Brain Center Hospital by using pre-test method before training and post-test after training. Research subjects amounted to 30 participants. This research is a quantitative research by …