Policy Design, Analysis, and Evaluation Commons^™

12-Year Report Of The Massachusetts Community Mediation Center Grant Program (Fiscal Years 2013 – 2024), Madhawa Palihapitiya, Karina Zeferino

Massachusetts Office of Public Collaboration Publications

This report examines the development, performance, and impact of the Massachusetts Community Mediation Center Grant Program during its first 12 years, covering fiscal years 2013 through 2024. Established under Massachusetts General Laws Chapter 75, Section 47, the Grant Program provides operational and programmatic funding to qualified community mediation centers offering free or low-cost dispute resolution services through trained community volunteers. The Massachusetts Office of Public Collaboration at the University of Massachusetts Boston administers and evaluates the program.

Over the period examined, the Commonwealth’s annual appropriation increased from $650,000 in FY2013 to approximately $3.2 million in FY2024. This investment stabilized community …

Determinants Of Evaluation Demand In The United States Federal Government: A Sequential Mixed Methods Study With Hierarchical Linear Modeling, Ruqayyah Abu-Obaid

Dissertations

This dissertation examines the factors that influence demand for evaluation in the federal government of the United States. Although evaluation has become a central element of evidence-based policymaking, limited empirical research explains what drives variation in evaluation activity across federal agencies. The study addresses this gap through a sequential exploratory mixed-methods design that integrates qualitative document analysis with quantitative hierarchical (panel) data modeling. Hierarchical linear modeling (HLM) was employed to analyze longitudinal data from 23 federal agencies (2008–2024), accounting for both within- and between-agency variation over time and providing more accurate estimates of factors influencing evaluation demand.

In the qualitative …

Increasing Housing Stability Through State-Funded Community Mediation Massachusetts Housing Mediation Program Fy2025 Evaluation Report, Madhawa Palihapitiya, Karina Zeferino

Massachusetts Office of Public Collaboration Publications

Mediation offers a flexible alternative to court for resolving housing disputes, allowing parties to address a wider range of issues and solutions without the delays and formalities of the judicial system. The Housing Mediation Program (HMP or Program) was established in FY2021 as part of the Eviction Diversion Initiative (EDI), a coordinated state and federal response to the housing challenges caused by the COVID-19 pandemic. Led by the Executive Office of Housing and Livable Communities (EOHLC), the EDI brought together housing agencies, Community Mediation Centers (Centers) through MOPC, and legal services to provide robust support for tenants and …

Youth Program Fy2025 Evaluation Report, Madhawa Palihapitiya, Karina Zeferino

Massachusetts Office of Public Collaboration Publications

A School Climate Needs Assessment completed by 57 administrators evaluated both overall school climate and the key components that contribute to it. Administrators revealed low satisfaction with overall school climate (25%) and with students’ SEL skills (19%), and most considered these areas important to improve (77% and 79%) and expressed a desire for support (60% and 53%). Similar patterns emerged for academic performance (28% satisfied; 86% considered improvement important; 44% desired support), disciplinary actions (19%; 54%; 49%), and conflict levels—student-student (21%; 79%; 60%) and student-teacher (26%; 49%; 47%). Across these domains, a substantial proportion of respondents—often …

Perception Map As A Tool For Program Evaluation, Marlene K. Rebori

Journal of Extension

Perception maps can be powerful tools for visually sharing and conveying program information with the general public and decision makers. A perception map is a common visual data tool used in the marketing and economics discipline, but not commonly used in Extension. A framework for developing a perception map and a step-by-step process for setting up evaluation metrics to create a perception map is provided using an example from a community leadership development program.

Massachusetts Community Mediation Center Grant Program Fiscal Year 2024 Report And Evaluation, Madhawa Palihapitiya, Karina Zeferino

Massachusetts Office of Public Collaboration Publications

In FY2024, the Commonwealth allocated $3,213,465 to the CMC Grant Program, supplemented by $149,674 carried over from FY2023, for a total of $3,363,139. Of the total funding, $2,542,100 (76%) was awarded to Centers in grants and technical assistance, with Centers leveraging these funds to secure an additional $2,199,813 from private foundations and other state, local, and federal sponsors. These grants supported Centers’ participation in CMC Grant Program related statewide programs, including the Housing Mediation Program (HMP), Reentry Mediation Program (ReMAp), Youth Conflict Resolution and Restorative Practices Program (Youth Program), and DEI organizational capacity-building initiatives. These grants bolstered staffing infrastructure, enabling …

Co-Creating A Responsive, Sustainable, And Equitable Community Health Model For Older Adults With Chronic Diseases, Rachel M. Gallo Mph

Children, Youth, & Families

In 2022, the Bangor YMCA received a grant from the Maine Health Access Foundation’s (MeHAF) Systems Improvement and Innovation Responsive Grants Program for their “Co-Create Responsive, Sustainable, and Equitable Community Health Models for Older Adults with Chronic Diseases” project. This project aimed to “engage older adults with chronic disease conditions and their care partners to collectively identify new ways to connect people to community resources and to co-create community-based continuum of care systems to support the physical, emotional, and mental well-being of people in [their] communities of focus”.

The University of Southern Maine’s Data Innovation Project (DIP) at the Catherine …

Increasing Housing Stability Through State-Funded Community Mediation Delivered By The Massachusetts Housing Mediation Program (Hmp) In Fy2022, Madhawa Palihapitiya, David Sulewski, Karina Zeferino, Jarling Ho

Massachusetts Office of Public Collaboration Publications

This report presents findings and recommendations from an evaluation of the Massachusetts Housing Mediation Program (HMP) administered by the MA Office of Public Collaboration (MOPC) at the University of Massachusetts Boston in partnership with 11 Community Mediation Centers (Centers). The program is funded by the Commonwealth of Massachusetts and implemented in partnership with the Department of Housing and Community Development (DHCD). The program was initially part of the Governor’s Eviction Diversion Initiative (EDI), which ended in the latter half of FY2022 and is continuing as an intervention to support housing stability. The evaluation was conducted by MOPC’s research unit comprised …

Massachusetts Community Mediation Center Grant Program: Fiscal Year 2022 Report & Evaluation, Madhawa Palihapitiya

Massachusetts Office of Public Collaboration Publications

The FY2022 evaluation report prepared by MOPC for the tenth year of the Grant Program operations confirms that the state’s FY2022 appropriation of $2.7 million[1]continued to strengthen community mediation center operations statewide, expanded public awareness and utilization of community mediation, and maintained critical public programs focused on housing stability, youth empowerment, reducing recidivism and building capacity for diversity, equity and inclusion for center practices and services, while producing significant social and economic impacts, including a $22.1 million return on the state’s investment in cost-savings and leveraged resources. This impact demonstrates the public value and cost-effectiveness of this local …

Medication Assisted Treatment: Prescription Drug And Opioid Addiction Expansion Project, Mary Lindsey Smith Phd, Katharine Knight Mph, Mark Richards Bs, Tyler Egeland Ba, Evelyn Ali Bs

Substance Use Research & Evaluation

Greater Portland Health (GPH) in collaboration with Preble Street Resource Center was awarded a Medication Assisted Treatment: Prescription Drug & Opioid Addiction (MOUD-PDOA) grant from SAMHSA. The GPH MOUD-PDOA project will include a mixed-methods evaluation led by Catherine E. Cutler Institute. The evaluation team will build knowledge and provide feedback to inform the implementation and refinement of the GPH MOUD-PDOA Program.

Evaluation Goals:

• Document program strategies and identify barriers and facilitators to implementation
• Examine the efficacy of using a continuum of treatment services to increase access to MOUD among vulnerable populations in underserved communities
• Assess the impact of the intervention …

House: Homeless Opioid User Service Engagement Program. Year 1 Report, Mary Lindsey Smith Phd, Katharine Knight Mph, Evelyn Ali Bs, Thomas Chalmers Mclaughlin Msw, Phd, Katie Rosingana Ba, Tyler Egeland Ba, Mark Richards Bs, Karen Pearson Mlis, Ma

Substance Use Research & Evaluation

Homelessness and lack of stable housing is often a barrier to achieving stability for individuals who are experiencing homelessness (IWAEH) with an OUD. In order to meet the complex needs of IWAEH with OUD, the Department of Health and Human Services funded a pilot program in 2021, the Homeless Opioid Users Service Engagement (HOUSE) Program; clinicians at Greater Portland Health provide clients with low-barrier Medication Assisted Treatment (MAT), while staff at Preble Street provide casework support and rapid housing assistance to individuals who have been identified as being at high risk of overdose, are experiencing homelessness, and are diagnosed with …

R.A.C.E. To Recovery Year 1 Evaluation Summary Report, Katie Rosingana Ba, Evelyn Ali Bs, Tyler Egeland Ba, Mary Lindsey Smith Phd

Substance Use Research & Evaluation

Through a collaborative effort led by the Healthy Community Coalition, the multi-sector Rural Addiction Care Expansion (R.A.C.E.) to Recovery initiative consortium is utilizing evidence-based, community-wide response to impact and reduce the effects of the opioid epidemic in the Western Maine Public Health District/ Greater Franklin County. To assess and evaluate the implementation, successes, and challenges of the RACE to Recovery project, the Cutler Institute is collecting and analyzing data for both process and outcomes of the initiative.

In the first year of the initiative, the Cutler evaluation team utilized both primary and secondary data to assess RACE to Recovery program …

Evaluability Of Community Dispute Resolution Programs: Effecting Change Or Maintaining The Status Quo?, Rebecca Gourde

West Chester University Doctoral Projects

Between the 1960s and the 1990s, dozens of programs and organizations arose throughout the United States designed to bring peaceful resolutions to emerging community disputes, following in the conceptual footsteps of the federal Community Relations Service. Many of these community dispute resolution programs have encountered calls for reduced funding in recent years, as economic hardships force public administrators to parcel out limited public monies to those services that can demonstrate the most benefit. This study is a content analysis that examines the public-facing web content of 20 representative community dispute resolution programs in the United States. The researcher found that …

A Program Evaluation Of The Town Of Woodside, Plumas County Fire Safe Council, And Mountain Communities’ Fire Safe Council Defensible Space Projects, Mandeep Gill

Master's Projects

California is one of the most fire-prone regions in the world, with every passing year becoming more hazardous. With a tremendous amount of loss and damage occurring every year due to wildfires, property owners must prepare their homes and structures to withstand fires as much as possible. The best way to achieve this is by building and retrofitting homes with fire-resistant materials and creating defensible space around the property (Cal Fire, n.d.). Although it is the best way to protect one’s property, it is often times difficult for property owners to do so because of financial or physical limitations, or …

Stem For Success Evaluation And Assessment Resources For Researchers, Cristo Leon

STEM for Success Resources

The article presents a collection of federal and nonfederal resources intending to assist the researcher in the understanding of evaluation of broader impacts and participation in STEM.

STEM for Success is an integrated program to broaden participation in STEM.

Support For Me: Substance Use Disorder Prevalence And Treatment Capacity Assessment, Rachel T. Gallo Mph, Katharine Knight Mph, Mary Lindsey Smith Phd

Substance Use Research & Evaluation

The aim of this report was to understand the sociodemographic and geographic distribution of substance use disorder (SUD) prevalence in Maine, through a claims-based analysis which assessed current statewide capacity to address SUD by examining current SUD treatment and recovery infrastructure, service utilization patterns, and geographic distribution of services and usage throughout the state to identify any gaps in treatment and recovery capacity.

The authors would like to note that this report was completed during the planning phase of the SUPPORT for ME project, which was funded by the Centers for Medicare & Medicaid Services (CMS) via the SUPPORT Act …

Understanding The Influence Of Interdisciplinary Research: An Examination Of Carol Hirschon Weiss’S Scholarship, Gregory Dee Greenman Ii

Dissertations

Research evaluation is the subfield of evaluation that examines the processes and products of scientific and technological research. This dissertation explores the case of interdisciplinary research evaluation by reviewing the publications of one of the most influential and highly cited scholars in evaluation, public administration, and knowledge utilization: Carol Hirschon Weiss. As one of the foundational theorists of evaluation, the evaluation perspective of Weiss's work typically pervades discussions. That approach ignores her influence in other fields, particularly her centrality to the knowledge utilization field. Prior research indicates that the influence of interdisciplinary research is challenging to ascertain because research evaluation …

Challenges To Effective Monitoring And Evaluation Systems: Lessons From Afghanistan, Qudratullah Jahid

Sustainability and Social Justice

How can monitoring and evaluation (M&E) systems better support improving the aid effectiveness? What are the existing challenges to the M&E systems in Afghanistan? I try to answer these questions by briefly looking at the development aid in Afghanistan since 2001. I provide summary of attempts made at improving aid effectiveness through mutual accountability frameworks. I then try to briefly discuss the principles of Paris Declaration and provide brief insights from Afghanistan. I then discuss the status of monitoring and evaluation in Afghanistan by providing a picture functional M&E system and then discussing the existing challenges in Afghanistan. Finally, I …

Evaluation Instruction In Council On Education For Public Health Accredited Master Of Public Health Schools And Programs, Kristin Ann Hobson

Dissertations

Despite the increasing role of evaluation in public health practice and research (Association of Schools and Programs of Public Health [ASPH], 2006; Institute of Medicine [IOM], 1998; Public Health Functions Steering Committee, 2008; United States Government Accountability Office [GAO], 2012), as well as Henry and Mark’s (2003) assertion of a need for systematic evidence on evaluation training and education, the literature continues to lack studies on evaluation instruction in Council on Education for Public Health (CEPH)-accredited Master of Public Health (MPH) schools and programs. As such, this study explored evaluation instruction in CEPH-accredited MPH schools and programs in the following …

Harnessing Complexity: Analysis Methodology And Ethical Framework To Facilitate Utilization Of Video Data In Evaluations, Kurt A. Wilson

Dissertations

Most evaluations in the nonprofit and international development sectors are conducted in contexts of complexity; the specific intervention being evaluated is but one of many interrelated factors influencing the desired outcome. Video data, especially when directly generated by program participants, can provide both exceptionally rich qualitative data as well as contextually-relevant feedback within complex systems. Despite these unique strengths and opportunities, video data is underutilized in the field of evaluation. This dissertation addresses specific barriers associated with video data through three inter-related papers: Papers one and two (Chapters II and III) present the findings from two interrelated studies of an …

The Relationship Among Training Policy, Knowledge Transfer, And Performance Improvement: A Study Of Private Sector Organizations In The Kingdom Of Saudi Arabia, Fayez M. Shafloot

Dissertations

The purpose of this study was to explore human resource (HR) managers' perceptions of training practices (i.e., needs assessment, trainee preparation, training program review, accountability, management support, knowledge transfer, and performance improvement) in Saudi private sector organizations. The research questions were: (1) How do HR managers perceive the importance and or occurrence of training needs assessment, trainee preparation, training program review, accountability and management support? (2) How do HR managers perceive knowledge transfer and performance improvement as a function of training? and (3) What training factors do HR managers identify as being important to the delivery of training?

Data were …

Ohio Regional Forum Report Findings From The Survey And Small Small-Group Participation, Ryan E. Spohn

Criminology and Criminal Justice Faculty Publications

The Midwest Child Welfare Implementation Center (MCWIC) is collaborating with The Ohio Office of Families and Children (OFC) to develop and implement a new technical assistance (TA) model. This project is a part of Ohio's systemic effort to improve its child welfare outcomes, and will materially alter how OFC works with Ohio's county-administered child welfare offices. It will build Ohio's capacity to implement evidence-informed and promising child welfare interventions.

To inform the process of developing a new technical assistance model, MCWIC hosted a series of ten regional forums throughout the state during July, 2010. The purpose of these events was …

A Formative Evaluation Of Kentucky’S Environmental Compliance Assistance Program, Bonnie Wathen

MPA/MPP/MPFM Capstone Projects

Kentucky’s Department for Environmental Protection’s Division of Compliance Assistance has the Environmental Compliance Assistance Program (CAP). CAP is a relatively new program that has had little to no evaluation and measurement. However, with limited state resources to be distributed to departments, it is imperative that programs be able to justify their existence. Due to this fact, I chose to evaluate the CAP for my capstone project.

Because inadequate data on outcomes is available at this time, I was unable to conduct a traditional summative evaluation or include any statistical analysis. Instead I chose to conduct a formative, or process, evaluation …

Brief 19: The Dean’S Role In Faculty Evaluation, New England Resource Center For Higher Education, University Of Massachusetts Boston

New England Resource Center for Higher Education Publications

Faculty work continues to change in response to the increased emphases on diversity requirements in undergraduate education, partnerships between academic and student affairs, and computer technology (O’Meara, et al, 2003). As even more is learned about strategies for the educational success of their students, faculty will be counted on to tailor their skills and pedagogies to new populations of students. At the same time, colleges and universities must keep pace with these changes by ensuring that expectations about faculty work are clearly defined and are reflected in evaluation and reward structures—and that faculty are supported in their efforts. The quality …