Social and Behavioral Sciences Commons^™

A Team's Journey Toward More Equitable Philanthropic Research And Evaluation Practices, Kimberly A. Spring, Maria Fernanda Mata, Jeffrey Poirier, Allison Holmes, Amir François

The Foundation Review

This article describes the journey of the Research and Evaluation team at the Annie E. Casey Foundation to develop an approach that would allow us to rethink and deepen how we, as funders of research and evaluation, center equity in our practice.

In particular, we explain how, through this process, we began to focus on what it means to orient research and evaluation toward participant owners and came to examine the assumptions, expectations, habits, and values that we held. These experiences have presented us with opportunities to learn and be open to new ways of engaging in our work.

We …

In Conversation: Two Community Foundations In Dialogue About Their Equitable Evaluation Framework™ Practice, Madeline Brandt, Kelly Casey, Jean-Marie Callan, Joel Hicks-Rivera, Kim Leonard, Madeline Nguyen, Elena Tamanas Ragusa, Cierra Stancil, Kimberlee Salmond, Becky Seel, Kate Szczerbacki

The Foundation Review

This conversation between staff at the Oregon Community Foundation and the Hartford Foundation for Public Giving shares how we are infusing the Equitable Evaluation Framework™ into our practice as we aim to be less extractive, shift power, and honor all ways of knowing and being as valid. In sharing this conversation, we want to pull the curtain back and offer a behind-the-scenes view into the conversations, realities, and challenges involved in doing this kind of work.

We sat down together for 90 minutes on a Wednesday afternoon, and the following is a rough transcript of our time together. The intention …

Learning, Unlearning, And Sprinkling In: Our Journey With Equitable Evaluation, Jane Mosley, Leigh W. Quarles, Jason L. Williams

The Foundation Review

The Health Forward Foundation recently completed a two-year journey with the Equitable Evaluation Initiative as a practicing partner. This partnership provided us with the support to push for change that better aligned with our new focus, prioritizing racial equity and economic advancement.

The partnership also allowed us to explore a number of questions fundamental to our work in learning and evaluation: what we really know about the impact philanthropy is making in our communities; how we can explain that to board members, and how we honor the personal experiences of the people we serve.

In this article we discuss our …

A Journey Into Equitable Practice: Doing More, Doing Differently, And Doing Better, Bree Bode, Sarah Panken, Annie Murphy, Marci Scott

The Foundation Review

The mission of the Michigan Fitness Foundation is to encourage and facilitate active lifestyles and healthy food choices through education, environmental awareness, community participation, and policy leadership. The article shares how a three-year engagement with the Equitable Evaluation Initiative led the foundation to see its grantmaking, programming, and evaluation practices anew through an equity lens.

Through naming and noticing the ways in which traditional grantmaking has contributed to the inequities that philanthropy seeks to address, the foundation was able to change its own way of working — specifically by going beyond the standard written grant proposal to actually sit with …

A Promising Place-Based Collaborative Impact Investing Fund Strengthens Community And Informs Philanthropic Practice, Benjamin Kerman, Clara Miller

The Foundation Review

A recent evaluation of the Western New York Impact Investment Fund adds to the proof-of-concept literature regarding “doing good and doing well” while pointing to experience-based best practices in philanthropic impact investing. Born of a collaboration between regional and national philanthropies, the fund brings together corporate, individual, and philanthropic investors to deliver an inclusive impact investment mechanism. Founded in 2017, the fund evolved from concept to operating entity, focusing on mitigating capital gaps, longterm economic decline, and wealth divides.

Evaluation at Year 5 describes how the professionally managed, collaboratively governed fund has attracted and deployed capital, contributing to ecosystem improvements …

Advancing Philanthropic Strategy Through Evaluative Thinking: One Foundation’S Approach, Christine Baker, Margaret Eigsti, Kathryn Racine, Laurence O’Connell

The Foundation Review

The Sisters of Charity Foundation of Cleveland supports Catholic sisters and their ministries in northeast Ohio through the grantmaking, partnership, capacitybuilding, and evaluation efforts of its Catholic Sisters Program Area. The decline of sisters actively engaged in ministry, due both to their rising median age and a decades-long decline in their overall numbers, called for a reconsideration and likely revision of the CSPA existing theory of change.

Unlike other strategic approaches at the foundation, such as ending homelessness or improving health equity, transitioning from sister-led to lay-led leadership of ministries remained largely unexplored: Basic research was lacking, and model practices …

Out Of Crisis, Learnings Shape Future Grantmaking, Stacie S. Cherner

The Foundation Review

Like other philanthropic organizations during the early weeks of the COVID-19 pandemic, the Jim Joseph Foundation took steps to loosen grant requirements, support CEOs and leadership teams, and provide funding for emergencies and innovations.

The foundation, which strives to bring consistent expertise with evaluation and research in untroubled times and whose mission is to foster effective Jewish learning experiences for young Jews, has a unique perspective when reflecting on learning. So another area that required flexibility was in the re-examination of learning plans to take advantage of the “forced experimentation” imposed by the pandemic lockdown.

In March 2020, the foundation …

Lost Causal: Debunking Myths About Causal Analysis In Philanthropy, Jewlya Lynn, Sarah Stachowiak, Julia Coffman

The Foundation Review

What if philanthropic evaluations told us that changes in the world had occurred, as well as how and why they occurred, including in what ways foundation funding and grantees contributed to those changes? What if evaluations made change pathways more visible, tested hypotheses and assumptions, and generated new insights based on what happened in the “black box” of systems change strategies? This type of learning comes from causal analysis — inquiry that explores cause-andeffect relationships.

Yet currently in philanthropy, particularly for strategies and initiatives that feature high complexity, few evaluations use robust techniques for understanding causality. Instead, philanthropic evaluation tends …

A Mission To Improve Health: Lessons From Missouri’S Expanding Coverage Initiative, Anna Saltzman, Shayla Spilker, Megan Klenke-Isgriggs

The Foundation Review

To support the implementation of the Affordable Care Act, in 2013 Missouri Foundation for Health launched the Expanding Coverage Initiative. The fiveyear effort sought to reduce Missouri’s uninsured rate from 13% to less than 5% by developing a broad-based state coalition and employing a three-pronged approach of awareness building and outreach, enrollment assistance, and increasing health literacy.

While the initiative did not achieve its rate-reduction goal, the rate of uninsured Missourians dropped to 9% during the ECI’s time frame, a decrease on par with the national average despite the fact that at the time Missouri was one of 17 states …

Measuring The Effectiveness Of Equitable Economic Development Strategies, Amy Minzner

The Foundation Review

There is anecdotal evidence that equitable economic development activities can foster inclusive growth and unlock the full potential of local economies by dismantling barriers and expanding opportunities for low-income people and communities of color. These strategies are being used with increasing frequency, and advocates and funders are pressing for their use throughout the country. Because of this, there is a need to better understand the link between equitable economic development activities and their ability to foster equitable opportunities and resulting impacts.

Establishing this link will require a new measurement strategy because traditional measures of economic development effectiveness focus on communitywide …

Assessing Change And Deepening Impact In Early Learning Systems: The Formal-System Self-Assessment Tool, Erika Takada, Clare Nolan, Meera Mani

The Foundation Review

The David and Lucile Packard Foundation is investing in a 10-year strategy, Starting Smart and Strong, that partners with three California communities to develop and test solutions to support parents, caregivers, and educators as they prepare children to be ready for school. Central to this strategy are community efforts to create comprehensive early learning systems that model quality teaching practices, secure and ensure adequate distribution of resources, and have capacity to improve, innovate, and scale.

One of the challenges in systems evaluation is identifying meaningful indicators of interim progress toward longer-term change. From the start, the evaluation has been learning …

Using Social Network Analysis To Understand The Perceived Role And Influence Of Foundations, Todd L. Ely, Katie Edwards, Rachel Hogg Graham, Danielle Varda

The Foundation Review

Collaboration between foundations and other organizations is critical to the success of foundation-supported initiatives, but the power dynamics among foundations, grantees, and their broader communities can be challenging. Social network analysis is a tool to assess collaboration among organizations and its outcomes. A unique yet often underemphasized benefit of this method of analysis is its focus on dyadic relationships between organizations, which presents an opportunity for foundations to evaluate their role in a network and how they are perceived by the very organizations whose missions they support.

This article leverages a social network analysis of community partners focused on addressing …

Can Coaching Help Community Partnerships Promote Health Equity, Community Engagement, And Policy, Systems, And Environmental Changes? Results From An Evaluation, Jung Y. Kim, Lisa Schottenfeld, Michael Cavanaugh

The Foundation Review

Foundations and other entities have increasingly funded coaching and technical assistance to support multisector community partnerships to promote health and health equity. However, much remains to be learned about how coaching can best support these partnerships.

As part of its efforts to build a culture in which everyone in the United States has a fair opportunity to be healthy, the Robert Wood Johnson Foundation partnered with the University of Wisconsin Population Health Institute to provide structured coaching to strengthen the capacities of community partnerships. The foundation contracted with Mathematica to evaluate the coaching program, focusing on whether it had an …

Building Nonprofit Capacity To Achieve Greater Impact: Lessons From The U.S.-Mexico Border, Meg Loomis, Shirly Thomas, Carla Taylor

The Foundation Review

Foundations often rely on strong relationships with grantees doing frontline work in marginalized communities. Yet these nonprofits typically face myriad financial and policy pressures that must be managed amid increasing need for their services. Helping them expand their impact requires funders to invest in their grantees’ organizational health and capacity.

This article discusses the capacity-building funding experiences of Methodist Healthcare Ministries of South Texas, which saw firsthand the needs of grantees when it partnered with eight community-health organizations through its Sí Texas initiative and, in response, created a $1.5 million capacity-building program for those organizations.

This article also shares the …

Scaling Programs With Research Evidence And Effectiveness (Spree), Nan Maxwell, Scott Richman

The Foundation Review

Foundations can serve more people by identifying and supporting effective interventions that are ready to be scaled. This article describes a process called SPREE — Scaling Programs with Research Evidence and Effectiveness — that can help funders and their grantees scale successfully. Implementing this process can assist foundations in using evaluation research as a tool to determine which interventions are likely to produce desired outcomes, and to identify which organizations are ready to scale them. The SPREE process is grounded in evaluation and implementation science frameworks and has been applied since 2016 by the Corporation for National and Community Service. …

Evaluating For The Bigger Picture: Breaking Through The Learning And Evaluation Barriers To Advancing Community Systems-Change Field Knowledge, Thomas Kelly, Prudence Brown, Hanh Cao Yu, Marie Colombo

The Foundation Review

Foundations investing in community systems change often fail to prioritize field-level and cross-initiative evaluation questions in building initiatives. As a result, many of the documented evaluations of such investments lack translatable lessons specific and influential enough to drive related decisions and actions of others in the field.

This article developed from ongoing, multiyear peer learning across several foundations that collectively compiled recommendations for community systems-change funders and evaluators to implement more powerful evaluations. They are intended to help funders and evaluators engaged in these efforts build sectorwide knowledge capable of informing improved work across initiatives and communities. This article also …

Strategic Learning In Practice: A Case Study Of The Kauffman Foundation, Matthew Carr, Brett Hembree, Nathan Madden

The Foundation Review

Increasingly, foundations and nonprofits are seeking to engage their staff in learning and reflection activities that assess successes and challenges, and then generate insights that can improve programs and funding strategies. Yet, despite the intuitive benefits, there are common challenges that often stand in the way of promoting strategic learning for continuous improvement.

For the past year, the Ewing Marion Kauffman Foundation has been focused on creating more systematic and intentional strategic learning across our organization. As part of this work we cultivated a select cohort of staff to be “learning champions,” created simple tools and processes that can more …

Shifting Mindsets: How Meaningful Accountability Systems Can Strengthen Foundation Learning And Improve Impact, Marc J. Holley, Marcie Parkhurst

The Foundation Review

This article explores what it looks like when a foundation attempts to integrate accountability and learning practices, and presents a framework for the unique and complementary contributions that accountability and learning can make to the work of foundations.

The article also looks at the tensions that can arise when a foundation’s internal evaluation staff attempt to design, implement, and make use of accountability systems. Specifically, it identifies three problematic perspectives that can hold foundations back from full engagement in internally driven accountability initiatives, and offers practical guidance on how to shift these mindsets to more productive practices.

It concludes by …

Evaluators As Conduits And Supports For Foundation Learning, Clare Nolan, Meg Long, Debra Joy Perez

The Foundation Review

Evaluators play a critical role in supporting philanthropic learning, programming, and strategy, but evaluation and learning in philanthropy is often limited in ways that impede deeper resonance and impact.

Most philanthropic evaluation is focused on the needs of individual foundations, knowledge sharing with the broader field is limited, and foundations struggle to integrate evaluation and learning as a management tool. This article makes the case that evaluators and funders can do more to build the collective capacity of evaluators working in philanthropy in order to enhance their contributions to community change.

This article also examines the ways that evaluation in …

Building Principle-Based Strategic Learning: Insights From Practice, Kelci M. Price, Chera Reid, Suzanne Kennedy Leahy

The Foundation Review

Strategic learning is a powerful tool for foundations to achieve greater impact, yet foundations have struggled to create practices and behaviors that effectively support them in learning about strategy. Given that many foundations are engaged in strategic philanthropy, where they have specific conditions in the world they are trying to change, it is critical that they have the capacity to effectively learn about and improve their strategies.

This article offers three principles for strategic learning, informed by the field of strategic learning and insights from practice across three foundations. Each principle is explored in terms of what it means and …

Knowledge Translation To Enhance Evaluation Use: A Case Example, Alison Rogers, Catherine Malla

The Foundation Review

Knowledge in the form of information suitable for decision making or advocacy by foundations is not always readily available — a situation unacceptable for those who need such information for accountability, learning, and influencing policy and practice. This article addresses how essential information about monitoring, evaluation, and lessons learned can be made available to foundations.

The Fred Hollows Foundation identified a gap in this area through an evaluation capacity-building readiness assessment, and introduced the concept of participatory, real-time monitoring, evaluation, and learning bulletins grounded in the principles of knowledge translation. This article describes how those bulletins were developed and used …

Challenges And Opportunities In Philanthropic Organizational Learning: Reflections From Fellow Grantmakers, Jennifer Chubinski, Kelley Adcock, Susan Sprigg

The Foundation Review

As the field of philanthropy has matured, increasing attention has been paid to evaluating the impact of philanthropic investments. In recent years, the scope of evaluation has expanded to include an intentional focus on organizational learning with the goal of learning from ongoing work, informing decision-making, and ultimately improving impact.

With this momentum to carry out organizational learning strategies and share successes, the sector has not yet stopped to reflect on challenges and lessons learned in the process of building the capacity for organizational learning — the messy yet meaningful middle between a desire for learning and the implementation of …

Thriving Communities: A Model For Community-Engaged Grantmaking, Mary Francis, Colleen Desmond, Jeffrey Williams, Jennifer Chubinski, Jennifer Zimmerman, Ashlee Young

The Foundation Review

Interact for Health is a health conversion foundation serving the three-state region of Greater Cincinnati, Ohio. Its current community change initiative, Thriving Communities, is a community-learning model that helps embed health promotion and advocacy work in communities while those communities build an equitable infrastructure with stakeholders to more rapidly spread evidence-based practices.

This article explores the three tools developed for the Thriving Communities initiative: Success Markers, the Developmental Pathway, and Relationship Mapping. Interact for Health has found that these tools build core competencies and confidence among grantees as well as a process for community engagement that produces results at the …

Unplanned Donor Legacies: How To Avoid Them, And How One Family Foundation Corrected Course With An Evaluation, Saphira Maude Baker, Kelly Chopus, Casey Cox, Anita Mcginty

The Foundation Review

As funders turn to community change, intentionally addressing the unique power differential between funder and grantee partners and structuring ways to mitigate this imbalance is essential to honest communication. Funder relationships with their grantees impact the legacy of major community initiatives. This article explores this relationship and its effects through the lens of the recent evaluation of one family foundation — the Robins Foundation in Richmond, Virginia — and its follow-up actions.

Through a participatory evaluation process, we derived three principal approaches for this donor, and others, to consider in contemplating funder-grantee partnerships and the way these may influence the …

Aligning Evaluation And Strategy With The Mission Of A Community-Focused Foundation, Claudio Balestri

The Foundation Review

Foundations are commonly recognized as having a comparative advantage in supporting forward-looking projects and programs. In this sense, the long term represents the natural horizon in which the foundations are called to fulfill their mission to plan and develop philanthropic activities and, therefore, the time reference for assessing results.

When a mission is focused more on improving the quality of life in a specific community than on addressing a specific social problem, evaluation of outcomes becomes more challenging. While available methods can provide valuable support to measuring the impact of a foundation’s specific program, they are unlikely to provide an …

Considerations For Measuring The Impact Of Policy-Relevant Research, Megan Collado, Lauren Gerlach, Caroline Ticse, Katherine Hempstead

The Foundation Review

Philanthropy, and the research and analysis it supports, has an important role to play in informing policy and making government more effective. Yet all too often, foundations and other research funders struggle to understand whether and how their investments have affected policy.

This article highlights the findings of an 18-month pilot project conducted by AcademyHealth to help the Robert Wood Johnson Foundation better understand the impact of a subset of the foundation’s research grants, across investment types, on health insurance coverage and health reform, and to help inform how the foundation may more systematically track and measure the impact of …

Transforming Coalition Leadership: An Evaluation Of A Collaborative Leadership Training Program, Jung Y. Kim, Todd Honeycutt, Michaella Morzuch

The Foundation Review

Effective coalitions need leaders who are able to reach beyond individual, group, and sectoral boundaries to advance a shared vision for healthy and thriving communities. The Robert Wood Johnson Foundation partnered with the Center for Creative Leadership to create a one-year pilot, the Community Coalition Leadership Program, to test a new approach to providing training in collaborative leadership.

This article discusses the program, whether and how it improved participants’ individual and coalition leadership skills, and the implications for foundations and other entities seeking to increase interdependent leadership capacity within community coalitions. This article does not, however, intend to describe progress …

Motivations For Staying In Vacation Rentals And Evaluation Of Experience, Patrick Tierney

Journal of Tourism Insights

Persons attending the 2015 Outside Lands Music and Art Festival at Golden Gate Park in San Francisco had a range of lodging options. One of relatively new lodging options available was staying at non-commercial residences with a fee, also known as “vacation rentals.” Vacation rentals (VR), where a tourist rents a room or entire house from a private individual for a short term stay, are booming, especially at online booking sites, such as Air BNB. There are over a million rentals listed on Air BNB and its growth has been stunning (Weed 2015). Mayock (2015) found that vacation rentals are …

Foundations As Network Strategists, Weavers, And Managers: Learning From One Foundation’S Journey And Results, Clare Nolan, Brian Souza, Michael Monopoli, Marianne Hughes

The Foundation Review

This article shares insights from a five-year evaluation of the Oral Health 2020 network, an effort by the DentaQuest Foundation to align and strengthen efforts in service of a national movement to improve oral health. The evaluation helped to place the foundation’s journey in the context of a broader field seeking new approaches to achieve deep and sustainable social change.

The foundation’s approach was informed by several ideas that have gained momentum in the social sector, including collective impact, networks, systems change, and equity – all of which challenged the foundation to take a nontraditional approach that combined the roles …

A Community Foundation’S Experience Implementing And Evaluating General Operating Support, Annemarie Riemer, Erika Frank, Hedda Rublin, Susan Merrow-Kehoe

The Foundation Review

In 2013, the Hartford Foundation for Public Giving began to offer unrestricted general operating support grants in response to grantees’ expressed need. The foundation hired Technical Development Corp., a Boston consulting firm, to evaluate the process and implementation.

This article shares early indicators of the impact of the new grantmaking approach on both grantees and the foundation. Grantee outcomes include enhanced infrastructure and financial health, continued progress on strategic plan goals, and more creative thinking about programs. Beyond the adoption of a new funding option, the decision led the foundation to modify its overall grantmaking process.

The greatest challenge – …