Education Commons^™

Journey Mapping: A New Approach To Extension Program Design And Evaluation, Jennifer Hawkins, Neil Linscheid, Somongkol Teng

The Journal of Extension

With origins in service and human-centered design and customer experience, journey mapping is a research and evaluation method that allows users to visualize the journey a person or group takes while engaging in a service, program, or system. Using this method, individuals provide feedback on their experience, highlighting successes and challenges along the way.

Minnesota Extension educators have utilized journey mapping in program design and evaluation contexts and have found great value in both. This article highlights three use cases which provide insight into lessons learned during the process and how Extension staff may use the tool in the future.

The Condensed Stem Survey As A Tool For Extension Educators, Jafeth E. Sanchez

The Journal of Extension

One Extension Specialist implemented a STEM pilot robotics program across three middle school settings. A program evaluation to provide guidance and recommendations for future development, implementation, and continued evaluation was conducted as part of a larger study. This process led to the development of a condensed STEM survey that can be used by Extension professionals on STEM dispositions among middle school youth.

Nurse Educator Certification: Overview And Evaluation Of The Canadian Association Of Schools Of Nursing Program, Karin Page-Cutrara, Patricia Bradley, Cynthia Baker

Quality Advancement in Nursing Education - Avancées en formation infirmière

The Canadian Association of Schools of Nursing (CASN) has spearheaded an education institute and fostered the growth of an accessible cadre of innovative educational programming that were built on identified national nursing educator competencies. The purpose of this article is to outline the development and structure of the CASN Canadian Nurse Educator Certification Program, share an analysis of one aspect of program evaluation data and summarize the program’s current value to nurse educators. The program offers flexible professional development for Canadian nurse educators through three online modules that prepare participants to sit the national certification exam and attain the designation …

Eyes Save Lives Water Safety Program For Parents And Caregivers: Program Design And Pilot Evaluation From Southern California, Rachel Love-Smith, William A. Koon, Lauren Tabios, Scott M. Bartell

International Journal of Aquatic Research and Education

Despite expert consensus and evidence-based preventative strategies against drowning, limited formal study exists on translating recommendations into practical and effective interventions. This paper describes the design of an education-based drowning prevention intervention and reports results from a pilot evaluation of the program’s effect on self-reported water-safe behaviors, attitudes, self-efficacy, and knowledge. Parents and caregivers attending children’s swim lessons in July and August 2018 participated in a brief water-safety education program. A pre-post-test design evaluated "Theory of Planned Behavior" indicators to assess for changes. We found significant increases in scores related to water safety knowledge, attitudes on maintaining arms reach distance …

A Quantitative Evaluation Of A Culturally Relevant Reading Intervention Program On Academic Achievement And Reading Self-Perception In An Urban High School In New Jersey, Jessica Urban

Seton Hall University Dissertations and Theses (ETDs)

The purpose of this study was to understand the possible effects that participation in a culturally relevant reading intervention program had on students’ reading growth and reading self-perception, when compared to students who did not participate in the program but demonstrated similar prior academic achievement. To assess the relationship between program participation and reading achievement, students’ scaled score growth and student growth percentile on the STAR Reading Assessment were compared and analyzed across 3 school years. In each sample, there was no evidence to suggest that the program influenced students’ scaled score or SGP. The multiple regression models revealed that …

Water Safety Education Programs In Culturally And Linguistically Diverse Seattle Communities: Program Design And Pilot Evaluation, William A. Koon, Elizabeth Bennett, Sarah Stempski, Jennifer Blitvich

International Journal of Aquatic Research and Education

Drowning is a public health concern that disproportionally affects children and minorities in Washington State. Community health educators from Seattle Children’s Hospital designed a Water Safety Education and Lifejacket Giveaway Program for low-income parents of preschool-aged children from culturally and linguistically diverse backgrounds. The program was interpreted into multiple languages and parents and children in attendance received free lifejackets. The mixed-methods pilot evaluation of this program found statistically significant relationships between language and self-reported parent swim skill level (English-speaker OR 4.6; 95%CI: 1.84 – 11.54); and confidence of keeping one’s child safe (English-speaker OR 3.34; 95%CI: 1.10 – 10.4). Additionally, …

Technically Speaking: Technical Skills Needed For Agricultural Communication Baccalaureate Graduates, Arthur Leal, Kati M. Lawson, Ricky W. Telg, Joy N. Rumble, Nicole Lamee Perez Stedman, Debbie Treise

Journal of Applied Communications

Technically Speaking: Technical Skills Needed for Agricultural Communication Baccalaureate Graduates

Abstract

The purpose of this national study was to assess the perceived importance of 57 technical skills identified in previous literature, and to determine entry-level, agricultural communication graduates’ ability to perform those technical skills as perceived by agricultural communication graduates, communication industry professionals, and agricultural communication faculty members. Participants from the three evaluation groups (n = 193) identified three of the most important technical skills needed by agricultural communication graduates. These skills were communicating in written form, concise and clear writing, and communicating verbally. Graduates placed a higher importance …

Exploring Beyond The Obvious: Social Skills Needed For Agricultural Communication Baccalaureate Graduates, Arthur Leal, Ricky W. Telg, Joy N. Rumble, Nicole Lamee Perez Stedman, Debbie M. Treise

Journal of Applied Communications

This national study sought to expand on current research to identify the importance of and graduates’ ability to perform selected social skills to aid in curricula evaluation and small program development. Using three evaluation groups – agricultural communication graduates, communication industry professionals, and agricultural communication faculty members – 193 individuals responded to the online survey. The most important social skills were those associated with having work values and transitioning into an organization to be a productive member in the workplace. Graduates placed a higher importance on social skills than the other two evaluation groups. All three evaluation groups showed some …

Engaging Stakeholders In Collaborative And Constructive Course Evaluation, Roger Jerabek, Rebecca Hartley, Nancy Shane, Renee Quintana

HSC Education Days

Implementing a coherent and coordinated curriculum, which prepares students for licensure exams and subsequent phases of their training, requires the concerted expertise and efforts of diverse stakeholders, including administrators, faculty, staff, and students. The Office of Program Evaluation, Education and Research (PEAR) is responsible for student evaluations of courses at the University of New Mexico School of Medicine (SOM). In 2016, members of PEAR collaborated with the SOM Curriculum Committee to restructure the preclinical course review process to engage committee members more fully in monitoring courses. This poster summarizes evaluation processes, shares information on how other medical schools review preclinical …

The ‘Just City’ Or Just A City? : Evaluating Social Justice And Equity In Planning Education., Wes Grooms

Electronic Theses and Dissertations

Contemporary evaluations of accredited planning education performance have eschewed the principles and methodologies of formal program evaluation and performance management. This dissertation tests hypotheses that this contributes to the lack of social equity and justice commitment, content, and inquiry on the part of accredited graduate planning degree programs, their clients, and administrators. The organizations, resources, and processes involved in the purveyance of accredited graduate planning education were conceptualized as a singular, evaluable program and illustrated in a series of program logic models. These models revealed sources of the inattentiveness to normative issues that past evaluations have evidenced, and informed assertions …

An Examination Of A Social And Emotional Learning Program And Implications For Diversity Development, Chimille E. Dillard

Dissertations

This paper evaluated the Second Step program used by the Galaxy school district and many of the surrounding school districts in the area as the sole social and emotional learning program for elementary and middle/junior high school students. Research was conducted to discover whether or not the Second Step program addressed the social and emotional skills students need when encountering racial and gender-diverse issues in their everyday lives. Both quantitative and qualitative methods (such as surveys; interviews with teachers, social workers, and administrators; and classroom observations) were used when collecting data throughout the research. It was concluded that the Second …

Starting At The End: Measuring Learning Using Retrospective Pre-Post Evaluations, Debi Lang, Judith A. Savageau

Judith A. Savageau

Blog post to AEA365, a blog sponsored by the American Evaluation Association (AEA) dedicated to highlighting Hot Tips, Cool Tricks, Rad Resources, and Lessons Learned for evaluators. The American Evaluation Association is an international professional association of evaluators devoted to the application and exploration of program evaluation, personnel evaluation, technology, and many other forms of evaluation. Evaluation involves assessing the strengths and weaknesses of programs, policies, personnel, products, and organizations to improve their effectiveness.

Exploring A Rural School District’S Freshman Academy Program Through Parent And Staff Member Perspectives, Dustin Morehead

Education Dissertations and Projects

This study used a qualitative approach to explore a rural school district’s freshman academy program through parent and staff member perspectives using Stufflebeam’s (2003) CIPP model of program evaluation. Interviews and questionnaire data provided information to answer the following research questions.

1. Context: What is the context within which the freshman academy program was developed and implemented?

2. Input: What alternative resources are available to enhance the structure of the freshman academy program?

3. Process: How are the objectives of the freshman academy program aligned with improving student attendance, academic performance, and promotion?

4. Product: What are the perceptions of …

A Comprehensive Evaluation Of The Teacher’S College Reading And Writing Project Balanced Literacy Instructional Framework And The Reading Proficiency Of Economically Disadvantaged Students, Latonya Elise Gaines-Montgomery

Education Dissertations and Projects

This dissertation was designed to provide a comprehensive evaluation of the Teacher’s College Reading and Writing Project (TCRWP) and its impact on the reading achievement of economically disadvantaged students. TCRWP was implemented at two high poverty schools (over 80% economically disadvantaged students) in southeastern North Carolina. Stufflebeam’s (2003) revised CIPP evaluation model was used to evaluate the program along with a convergent mixed-methods design. The data analysis revealed that TCRWP as well as the schools’ strategic plans were aligned to the schools’ assessed needs. Additionally, the analysis showed that implementation of TCRWP aligned to the schools’ initial implementation designs. The …

Program Evaluation Of A Competency-Based Online Model In Higher Education, Karen Digiacomo

Walden Dissertations and Doctoral Studies

In order to serve its nontraditional students, a university piloted a competency-based program as alternative method for its students to earn college credit. The purpose of this mixed-methods study was to conduct a summative program evaluation to determine if the program was successful in order to make decisions about program revision and expansion. The conceptual framework for the study was grounded in Knowles's adult learning theory and Bandura's social learning theory as they relate to adult learners being self-directed and self-motivated to complete their educational goals. The pilot program involved 60 students taking 12 different courses over 3 semesters. Quantitative …

Creating A Rural Nursing Workforce, Heidi Johnston

Doctor of Nursing Practice Projects

Background: Nursing students living in rural areas often encounter barriers, real or perceived, to receiving education. These students may be unable to leave home to obtain higher education due to expectations, financial issues, and geography (Robert Wood Johnson Foundation, 2010), thus contributing to a shortage of qualified nurses in rural communities. Great Basin College (GBC) recently implemented synchronized distance education Synchronized Distance Education (SDE) for the (AAS) nursing program, and there was a need to conduct a program evaluation in order to maintain/improve program quality. One goal of Healthy People 2020 (2014) is improving access to comprehensive, quality healthcare services. …

School Readiness Of First Grade Charter School Students: An Evaluation Of An Early Childhood Program, Dr Shandowlyon L. Hendricks-Williams

Dissertations

This program evaluation studied the effectiveness of an early childhood program as it relates to school readiness. The early childhood program of a charter school located in Milwaukee, Wisconsin had been operating for over thirty without an evaluation of its effectiveness. To examine the effectiveness of the early childhood program, seventy-two students were evaluated using a teacher-developed First Grade Readiness Checklist; the Measures of Academic Progress (MAP) Test and Success for All (SFA) Assessment. School readiness, as a multifaceted construct, included five domains: academic, behavioral, emotional, social and self-help-skills.

The results of the survey indicate that the early childhood program …

A Mixed Methods Program Evaluation Of Participant Perceptions Of The Residency Portfolio Component Of The Education Doctorate At Marshall University, Ashley White Stephens

Theses, Dissertations and Capstones

This mixed-methods study explored student, graduate, and faculty perceptions of the residency portfolio process in Marshall University’s Ed.D. Program and the degree to which the portfolio met the stated goals of the program. Data was collected via online surveys, student/graduate focus groups, and individual faculty interviews. One hundred eighteen students/graduates and 14 faculty members completed the survey. Eleven students/graduates participated in the two focus groups, and eight faculty members participated in individual interviews.

The seven stated program goals were further divided into 21 indicators. The survey asked participants to rate the degree to which the residency portfolio developed students’ abilities …

A Program Evaluation Of A Christian College Baccalaureate Program Utilizing Stufflebeam's Cipp Model, Victoria F. Hanchell

Education Dissertations and Projects

This dissertation was a program evaluation of an undergraduate program of study at a Christian institution of higher education. The college had not received a formal evaluation since the institution of their strategic planning in 2008. The program evaluation of this baccalaureate program was reviewed through the lens of the CIPP Evaluation Model (Stufflebeam, 2002). Through the CIPP Evaluation Model, the Context (C), Inputs (I), Processes (P), and Product (P) of this institution were evaluated.

Four research questions were developed to coincide with the four thematic areas of CIPP model. The four research questions were (1) Context: How were the …

Structural Approaches To Health Promotion: What Do We Need To Know About Policy And Environmental Change?, Lisa D. Lieberman, Shelley D. Golden, Jo Anne L. Earp

Department of Public Health Scholarship and Creative Works

Although the public health literature has increasingly called on practitioners to implement changes to social, environmental, and political structures as a means of improving population health, recent research suggests that articles evaluating organization, community, or policy changes are more limited than those focused on programs with individuals or their social networks. Even when these approaches appear promising, we do not fully understand whether they will benefit all population groups or can be successful in the absence of accompanying individually oriented programs. The role of this broad category of approaches, including both policy and environmental changes, in decreasing health disparities is …

Depaul University Mathematics And Science Partnership Evaluation Report, Steven R. Rogg

Steven R Rogg

The DePaul University IMSP was designed as a longitudinal cohort program. Two cohorts of up to 25 teachers each will be supported. The second cohort is offset by one calendar year. Each teacher will complete a sequence of 12 university graduate-level courses (48 quarter hours), over two and one-half years, leading to a Masters of Science in Science Education (MSSE) degree. Thus, all successful participants will meet or exceed requirements of the designation “highly qualified” as described in the MSSE proposal quoted here.

“The Masters of Science in Science Education program is designed to provide rich content-based professional development of …

Depaul University Mathematics And Science Partnership Internal Evaluator's Interim Report, Steven R. Rogg

Steven R Rogg

The DePaul University IMSP1 was designed as a longitudinal cohort program. Two cohorts of up to 25 teachers each will be supported. The second cohort is offset by one calendar year. Each teacher will complete a sequence of 12 university graduate-level courses (48 quarter hours), over two and one-half years, leading to a Masters of Science in Science Education (MSSE) degree. Thus, all successful participants will meet or exceed requirements of the designation “highly qualified” as described in the MSSE proposal quoted here.

“The Masters of Science in Science Education program is designed to provide rich content-based professional development of …

The Illinois Mathematics And Science Academy Research And Dissemination Network Academic Year 2002-03 Final Report To The Smithsonian Institution, Steven R. Rogg

Steven R Rogg

This document is a status report on the Illinois Mathematics and Science Academy’s (IMSA) Research and Dissemination Network, which is funded as a contract with the Smithsonian Institution. In response to significant recent changes in project organization and activities, this report traces key developments of the project over its ten-year history. The report concludes with a summary of accomplishments during the current 2002-03 academic year.

Museum Educators' Workshop Study: Attracting And Retaining Teachers In Museum-Sponsored Professional Development Programs, Steven R. Rogg

Steven R Rogg

In preparation for the Museum Educator’s Workshop, the Planning Team saw that a necessary first step would be to honor the perspectives of Chicago Public School (CPS) teachers and principals. Changes in Illinois Teacher Recertification requirements, changes within the CPS itself, and nation-wide developments in the teaching profession suggested that a fresh look at Chicago’s professional development landscape would be necessary. Indeed, many relevant questions about the role(s) of museums in teacher professional development were raised during initial Planning Team discussions. Here are just a few examples: Which organizations are the foremost providers of professional development for CPS teachers and …

Museum Educators' Workshop Study Highlights: Attracting And Retaining Teachers In Museum-Sponsored Professional Development Programs, Steven Rogg

Steven R Rogg

Following Phase I, of the Museums In the Park Study, the Planning Team used this information to design and conduct the Museum Educators’ Workshop event on March 15, 2002. Highlights of the Phase-I study were also presented to participants at the workshop event.

Maps-Ii Study Final Report For The Initiative “Museums And Public Schools” On Behalf Of Museums In The Park And Chicago Public Schools, Steven R. Rogg

Steven R Rogg

The Museums and Public Schools (MAPS) initiative intends to “create a lasting impact on teaching and learning by integrating museum resources into the educational process and serve as a national model.” It is conceived as a “sustained partnership of museums and schools, students and teachers,” engaging them in “authentic learning experiences.” This is to be accomplished primarily via the explicit incorporation of relevant (as indicated by the Chicago Academic Standards) cultural, historical, and scientific resources of Chicago’s world-class museums into the curriculum of Chicago Public Schools. The result is to be an experience of education that is powerfully rich, engaging, …

Xavier University's Discovering Life Science Program Evaluation Final Report, Steven R. Rogg

Steven R Rogg

This document is the final report of the external evaluation of the project entitled: Implementing Inquiry and Technology in a Biology Lab for Pre–service Teachers and Non-majors embodied in Xavier University’s laboratory course Biol-125: Discovering Life Science and funded under the National Science Foundation (NSF), Division of Undergraduate Education (DUE) of the Directorate for Education and Human Resources (HER.) award no. DUE#99-50373. The period of NSF funding for this two-year project of the NSF/HER/DUE Course, Curriculum and Laboratory Improvement Program was June 1, 1999 through May 31, 2001. There are several accomplishments that the University and the principal investigators can …

An Evaluative Study Of The Walter Panas High School Individualized Senior Experience Program (Wise), Ernest J. Piermarini

Seton Hall University Dissertations and Theses (ETDs)

.

Maps Study Final Report For The Program “Museums And Public Schools” On Behalf Of Museums In The Park And Chicago Public Schools, Steven R. Rogg

Steven R Rogg

Evaluation of the first year implementation of the Museums and Public schools (MAPS) initiative is reported. The MAPS initiative is described in its original proposal in the following way: “Guided by the Chicago and Illinois academic standards, (MAPS) …will, over time, make museum resources a creative and integral part of classroom learning and teaching. In so doing, this partnership will enhance teacher knowledge and skills, enrich student educational experiences and advance the educational attainment of all children in Chicago’s public schools. In short, this collaboration is an investment in Chicago’s future.”

Report On The Elementary Teacher Survey Pilot Study On Behalf Of The Columbus Urban Systemic Initiative, Steven R. Rogg

Steven R Rogg

This report completes the pilot study conducted by the Columbus Public Schools’ (CPS) Urban Systemic Initiative (USI)1 and the Center for the Advancement of Learning and Teaching in Mathematics Science and Technology (The Center@IMSA) of the Illinois Mathematics and Science Academy (IMSA). This initial pilot study was designed to test the Elementary Teacher Survey prepared by the USI Teacher Support Teams. A validation study, to follow in the spring, will seek evidence of program impact on teaching practices in science and mathematics classrooms. In other words, it will validate the findings of the Elementary Teacher Survey via direct classroom observation …