Public Administration Commons^™

Evaluability Of Community Dispute Resolution Programs: Effecting Change Or Maintaining The Status Quo?, Rebecca Gourde

West Chester University Doctoral Projects

Between the 1960s and the 1990s, dozens of programs and organizations arose throughout the United States designed to bring peaceful resolutions to emerging community disputes, following in the conceptual footsteps of the federal Community Relations Service. Many of these community dispute resolution programs have encountered calls for reduced funding in recent years, as economic hardships force public administrators to parcel out limited public monies to those services that can demonstrate the most benefit. This study is a content analysis that examines the public-facing web content of 20 representative community dispute resolution programs in the United States. The researcher found that …

An Evaluation Of A Drug Policy At A Federal University In Southeastern Nigeria, Linus N. Okahia

Walden Dissertations and Doctoral Studies

Drug abuse among university students has become a public health problem. The prevalence of drug abuse has negatively impacted the students, causing serious health outcomes. Finding a solution has the potential to benefit both students and society. Various intervention strategies have been adopted but the results have varied. The purpose of this qualitative case study was to evaluate the administrators’ and students’ perceptions of anti-drug-use policy at a federal university in Southeastern Nigeria to determine its effectiveness on drug abuse prevention among students. The policy feedback theory (PFT), which helps to understand and analyze the policy process, was the explanatory …

Stem For Success Evaluation And Assessment Resources For Researchers, Cristo Leon

STEM for Success Resources

The article presents a collection of federal and nonfederal resources intending to assist the researcher in the understanding of evaluation of broader impacts and participation in STEM.

STEM for Success is an integrated program to broaden participation in STEM.

Lost Causal: Debunking Myths About Causal Analysis In Philanthropy, Jewlya Lynn, Sarah Stachowiak, Julia Coffman

The Foundation Review

What if philanthropic evaluations told us that changes in the world had occurred, as well as how and why they occurred, including in what ways foundation funding and grantees contributed to those changes? What if evaluations made change pathways more visible, tested hypotheses and assumptions, and generated new insights based on what happened in the “black box” of systems change strategies? This type of learning comes from causal analysis — inquiry that explores cause-andeffect relationships.

Yet currently in philanthropy, particularly for strategies and initiatives that feature high complexity, few evaluations use robust techniques for understanding causality. Instead, philanthropic evaluation tends …

A Mission To Improve Health: Lessons From Missouri’S Expanding Coverage Initiative, Anna Saltzman, Shayla Spilker, Megan Klenke-Isgriggs

The Foundation Review

To support the implementation of the Affordable Care Act, in 2013 Missouri Foundation for Health launched the Expanding Coverage Initiative. The fiveyear effort sought to reduce Missouri’s uninsured rate from 13% to less than 5% by developing a broad-based state coalition and employing a three-pronged approach of awareness building and outreach, enrollment assistance, and increasing health literacy.

While the initiative did not achieve its rate-reduction goal, the rate of uninsured Missourians dropped to 9% during the ECI’s time frame, a decrease on par with the national average despite the fact that at the time Missouri was one of 17 states …

Measuring The Effectiveness Of Equitable Economic Development Strategies, Amy Minzner

The Foundation Review

There is anecdotal evidence that equitable economic development activities can foster inclusive growth and unlock the full potential of local economies by dismantling barriers and expanding opportunities for low-income people and communities of color. These strategies are being used with increasing frequency, and advocates and funders are pressing for their use throughout the country. Because of this, there is a need to better understand the link between equitable economic development activities and their ability to foster equitable opportunities and resulting impacts.

Establishing this link will require a new measurement strategy because traditional measures of economic development effectiveness focus on communitywide …

Using Social Network Analysis To Understand The Perceived Role And Influence Of Foundations, Todd L. Ely, Katie Edwards, Rachel Hogg Graham, Danielle Varda

The Foundation Review

Collaboration between foundations and other organizations is critical to the success of foundation-supported initiatives, but the power dynamics among foundations, grantees, and their broader communities can be challenging. Social network analysis is a tool to assess collaboration among organizations and its outcomes. A unique yet often underemphasized benefit of this method of analysis is its focus on dyadic relationships between organizations, which presents an opportunity for foundations to evaluate their role in a network and how they are perceived by the very organizations whose missions they support.

This article leverages a social network analysis of community partners focused on addressing …

Assessing Change And Deepening Impact In Early Learning Systems: The Formal-System Self-Assessment Tool, Erika Takada, Clare Nolan, Meera Mani

The Foundation Review

The David and Lucile Packard Foundation is investing in a 10-year strategy, Starting Smart and Strong, that partners with three California communities to develop and test solutions to support parents, caregivers, and educators as they prepare children to be ready for school. Central to this strategy are community efforts to create comprehensive early learning systems that model quality teaching practices, secure and ensure adequate distribution of resources, and have capacity to improve, innovate, and scale.

One of the challenges in systems evaluation is identifying meaningful indicators of interim progress toward longer-term change. From the start, the evaluation has been learning …

Can Coaching Help Community Partnerships Promote Health Equity, Community Engagement, And Policy, Systems, And Environmental Changes? Results From An Evaluation, Jung Y. Kim, Lisa Schottenfeld, Michael Cavanaugh

The Foundation Review

Foundations and other entities have increasingly funded coaching and technical assistance to support multisector community partnerships to promote health and health equity. However, much remains to be learned about how coaching can best support these partnerships.

As part of its efforts to build a culture in which everyone in the United States has a fair opportunity to be healthy, the Robert Wood Johnson Foundation partnered with the University of Wisconsin Population Health Institute to provide structured coaching to strengthen the capacities of community partnerships. The foundation contracted with Mathematica to evaluate the coaching program, focusing on whether it had an …

Building Nonprofit Capacity To Achieve Greater Impact: Lessons From The U.S.-Mexico Border, Meg Loomis, Shirly Thomas, Carla Taylor

The Foundation Review

Foundations often rely on strong relationships with grantees doing frontline work in marginalized communities. Yet these nonprofits typically face myriad financial and policy pressures that must be managed amid increasing need for their services. Helping them expand their impact requires funders to invest in their grantees’ organizational health and capacity.

This article discusses the capacity-building funding experiences of Methodist Healthcare Ministries of South Texas, which saw firsthand the needs of grantees when it partnered with eight community-health organizations through its Sí Texas initiative and, in response, created a $1.5 million capacity-building program for those organizations.

This article also shares the …

Scaling Programs With Research Evidence And Effectiveness (Spree), Nan Maxwell, Scott Richman

The Foundation Review

Foundations can serve more people by identifying and supporting effective interventions that are ready to be scaled. This article describes a process called SPREE — Scaling Programs with Research Evidence and Effectiveness — that can help funders and their grantees scale successfully. Implementing this process can assist foundations in using evaluation research as a tool to determine which interventions are likely to produce desired outcomes, and to identify which organizations are ready to scale them. The SPREE process is grounded in evaluation and implementation science frameworks and has been applied since 2016 by the Corporation for National and Community Service. …

Evaluating For The Bigger Picture: Breaking Through The Learning And Evaluation Barriers To Advancing Community Systems-Change Field Knowledge, Thomas Kelly, Prudence Brown, Hanh Cao Yu, Marie Colombo

The Foundation Review

Foundations investing in community systems change often fail to prioritize field-level and cross-initiative evaluation questions in building initiatives. As a result, many of the documented evaluations of such investments lack translatable lessons specific and influential enough to drive related decisions and actions of others in the field.

This article developed from ongoing, multiyear peer learning across several foundations that collectively compiled recommendations for community systems-change funders and evaluators to implement more powerful evaluations. They are intended to help funders and evaluators engaged in these efforts build sectorwide knowledge capable of informing improved work across initiatives and communities. This article also …

Knowledge Translation To Enhance Evaluation Use: A Case Example, Alison Rogers, Catherine Malla

The Foundation Review

Knowledge in the form of information suitable for decision making or advocacy by foundations is not always readily available — a situation unacceptable for those who need such information for accountability, learning, and influencing policy and practice. This article addresses how essential information about monitoring, evaluation, and lessons learned can be made available to foundations.

The Fred Hollows Foundation identified a gap in this area through an evaluation capacity-building readiness assessment, and introduced the concept of participatory, real-time monitoring, evaluation, and learning bulletins grounded in the principles of knowledge translation. This article describes how those bulletins were developed and used …

Strategic Learning In Practice: A Case Study Of The Kauffman Foundation, Matthew Carr, Brett Hembree, Nathan Madden

The Foundation Review

Increasingly, foundations and nonprofits are seeking to engage their staff in learning and reflection activities that assess successes and challenges, and then generate insights that can improve programs and funding strategies. Yet, despite the intuitive benefits, there are common challenges that often stand in the way of promoting strategic learning for continuous improvement.

For the past year, the Ewing Marion Kauffman Foundation has been focused on creating more systematic and intentional strategic learning across our organization. As part of this work we cultivated a select cohort of staff to be “learning champions,” created simple tools and processes that can more …

Shifting Mindsets: How Meaningful Accountability Systems Can Strengthen Foundation Learning And Improve Impact, Marc J. Holley, Marcie Parkhurst

The Foundation Review

This article explores what it looks like when a foundation attempts to integrate accountability and learning practices, and presents a framework for the unique and complementary contributions that accountability and learning can make to the work of foundations.

The article also looks at the tensions that can arise when a foundation’s internal evaluation staff attempt to design, implement, and make use of accountability systems. Specifically, it identifies three problematic perspectives that can hold foundations back from full engagement in internally driven accountability initiatives, and offers practical guidance on how to shift these mindsets to more productive practices.

It concludes by …

Building Principle-Based Strategic Learning: Insights From Practice, Kelci M. Price, Chera Reid, Suzanne Kennedy Leahy

The Foundation Review

Strategic learning is a powerful tool for foundations to achieve greater impact, yet foundations have struggled to create practices and behaviors that effectively support them in learning about strategy. Given that many foundations are engaged in strategic philanthropy, where they have specific conditions in the world they are trying to change, it is critical that they have the capacity to effectively learn about and improve their strategies.

This article offers three principles for strategic learning, informed by the field of strategic learning and insights from practice across three foundations. Each principle is explored in terms of what it means and …

Challenges And Opportunities In Philanthropic Organizational Learning: Reflections From Fellow Grantmakers, Jennifer Chubinski, Kelley Adcock, Susan Sprigg

The Foundation Review

As the field of philanthropy has matured, increasing attention has been paid to evaluating the impact of philanthropic investments. In recent years, the scope of evaluation has expanded to include an intentional focus on organizational learning with the goal of learning from ongoing work, informing decision-making, and ultimately improving impact.

With this momentum to carry out organizational learning strategies and share successes, the sector has not yet stopped to reflect on challenges and lessons learned in the process of building the capacity for organizational learning — the messy yet meaningful middle between a desire for learning and the implementation of …

Evaluators As Conduits And Supports For Foundation Learning, Clare Nolan, Meg Long, Debra Joy Perez

The Foundation Review

Evaluators play a critical role in supporting philanthropic learning, programming, and strategy, but evaluation and learning in philanthropy is often limited in ways that impede deeper resonance and impact.

Most philanthropic evaluation is focused on the needs of individual foundations, knowledge sharing with the broader field is limited, and foundations struggle to integrate evaluation and learning as a management tool. This article makes the case that evaluators and funders can do more to build the collective capacity of evaluators working in philanthropy in order to enhance their contributions to community change.

This article also examines the ways that evaluation in …

Thriving Communities: A Model For Community-Engaged Grantmaking, Mary Francis, Colleen Desmond, Jeffrey Williams, Jennifer Chubinski, Jennifer Zimmerman, Ashlee Young

The Foundation Review

Interact for Health is a health conversion foundation serving the three-state region of Greater Cincinnati, Ohio. Its current community change initiative, Thriving Communities, is a community-learning model that helps embed health promotion and advocacy work in communities while those communities build an equitable infrastructure with stakeholders to more rapidly spread evidence-based practices.

This article explores the three tools developed for the Thriving Communities initiative: Success Markers, the Developmental Pathway, and Relationship Mapping. Interact for Health has found that these tools build core competencies and confidence among grantees as well as a process for community engagement that produces results at the …

Unplanned Donor Legacies: How To Avoid Them, And How One Family Foundation Corrected Course With An Evaluation, Saphira Maude Baker, Kelly Chopus, Casey Cox, Anita Mcginty

The Foundation Review

As funders turn to community change, intentionally addressing the unique power differential between funder and grantee partners and structuring ways to mitigate this imbalance is essential to honest communication. Funder relationships with their grantees impact the legacy of major community initiatives. This article explores this relationship and its effects through the lens of the recent evaluation of one family foundation — the Robins Foundation in Richmond, Virginia — and its follow-up actions.

Through a participatory evaluation process, we derived three principal approaches for this donor, and others, to consider in contemplating funder-grantee partnerships and the way these may influence the …

Enhancing The Cultural Competency Of Prospective Leaders Via A Study Abroad Experience, Douglas Hermond, Mathias R. Vairez, Jr., Tyrone Tanner

Administrative Issues Journal

The purpose of this investigation was to determine whether an experiential learning opportunity, specifically a study tour experience, would improve the cultural intelligence of prospective educational leaders and would challenge them to expand their own cultural understanding and behavior. Several prospective leaders who enrolled in a graduate program in Educational Leadership volunteered to attend a study abroad program that was intended, in part, to enhance their cultural competence. They were then asked to complete a survey that measured the four domains of cultural intelligence, namely metacognition, cognition, motivation and behavior. They were also asked to respond to prompts about how …

Aligning Evaluation And Strategy With The Mission Of A Community-Focused Foundation, Claudio Balestri

The Foundation Review

Foundations are commonly recognized as having a comparative advantage in supporting forward-looking projects and programs. In this sense, the long term represents the natural horizon in which the foundations are called to fulfill their mission to plan and develop philanthropic activities and, therefore, the time reference for assessing results.

When a mission is focused more on improving the quality of life in a specific community than on addressing a specific social problem, evaluation of outcomes becomes more challenging. While available methods can provide valuable support to measuring the impact of a foundation’s specific program, they are unlikely to provide an …

Transforming Coalition Leadership: An Evaluation Of A Collaborative Leadership Training Program, Jung Y. Kim, Todd Honeycutt, Michaella Morzuch

The Foundation Review

Effective coalitions need leaders who are able to reach beyond individual, group, and sectoral boundaries to advance a shared vision for healthy and thriving communities. The Robert Wood Johnson Foundation partnered with the Center for Creative Leadership to create a one-year pilot, the Community Coalition Leadership Program, to test a new approach to providing training in collaborative leadership.

This article discusses the program, whether and how it improved participants’ individual and coalition leadership skills, and the implications for foundations and other entities seeking to increase interdependent leadership capacity within community coalitions. This article does not, however, intend to describe progress …

Considerations For Measuring The Impact Of Policy-Relevant Research, Megan Collado, Lauren Gerlach, Caroline Ticse, Katherine Hempstead

The Foundation Review

Philanthropy, and the research and analysis it supports, has an important role to play in informing policy and making government more effective. Yet all too often, foundations and other research funders struggle to understand whether and how their investments have affected policy.

This article highlights the findings of an 18-month pilot project conducted by AcademyHealth to help the Robert Wood Johnson Foundation better understand the impact of a subset of the foundation’s research grants, across investment types, on health insurance coverage and health reform, and to help inform how the foundation may more systematically track and measure the impact of …

Three Perspectives On Social Equity And Public Health Emergency Preparedness And Response Policy, Lucila M. Zamboni

Legacy Theses & Dissertations (2009 - 2024)

In the past 20 years, large-scale disasters have generated economic loss of $660 billion in the United States. Research has identified that low income individuals and economically vulnerable communities are at heightened risk and often experience disadvantages in access to public services during emergencies. Public administration literature has claimed that social equity should be included as a consideration together with economic and efficiency principles when formulating and implementing public policy. Yet there has been limited empirical research that follows this premise. The three studies that comprise this dissertation are guided by one overarching research question: which socioeconomic characteristics at the …

Improving Evaluation In Nonprofit Organizations: A Study Of How Evaluation Requests For Proposals Are Developed, Responded To, And Fulfilled, Nakia S. Matthews

Dissertations

It is often necessary for nonprofit organizations (NPOs) to formulate a Request for Proposal (RFP) to procure essential contracted services. This is most common when seeking the services of an external evaluator. Since most NPOs do not have internal evaluation staff, developing an appropriate RFP can be quite challenging. With limited literature and resources to guide NPOs on how to prepare RFPs, the process for procuring qualified evaluators can be even more daunting. This lack of resources and supports can lead to insufficient or incomplete RFPs, subsequently narrowing the pool of qualified potential bidders and reducing the extent to which …

Maintaining And Regaining Organizational Legitimacy : The U.S. Securities And Exchange Commission, Karen R. Bryce

Legacy Theses & Dissertations (2009 - 2024)

Focusing on organizational legitimacy is an essential element to the survival of an organization. Suchman (1995) suggests that "Legitimacy is a generalized perception or assumption that the actions of an entity are desirable, proper, or appropriate within some socially constructed system of norms, values, beliefs, and definitions" (p. 574). Legitimacy must first be gained and then maintained. If lost, legitimacy must be regained or the organization is unlikely to survive. Organizations can use both symbolic and substantive means of gaining, maintaining or regaining legitimacy. This dissertation explores organizational legitimacy by examining the case of the U.S. Securities and Exchange Commission …

Navigating The Challenges Of Helping Teachers Use Data To Inform Educational Decisions, Kelli Thomas, Douglas Huffman

Administrative Issues Journal

In this paper we present a model of collaborative evaluation that has been used to engage teachers in data-based decision making for improving teaching and learning in mathematics and science. We examine three external challenges that threaten the process of continuous school improvement; namely, making sense of data, policy changes, and curriculum changes. In addition, we describe how the collaborative evaluation model facilitated progress beyond these challenges.