Educational Assessment, Evaluation, and Research Commons^™

Exploration Of Peer Learning In A Formal Cohort Healthcare Leadership Development Program, Melinda Marie Gruber

Dissertations

Many new and emerging leaders will move into leadership positions in healthcare as experienced leaders retire or move to other positions. These individuals need leadership development that supports them in becoming transformational change leaders. This study explored the topic of peer learning as a leadership development approach in a healthcare setting. The purpose was to better understand the role of peer learning in creating transformational leadership and healthcare change leaders.

This study utilized a qualitative case study approach to explore and understand how peer learning supports leadership development. The study focused on the key learning elements of an 18-month cohort-based …

Advancing Evaluation In Community Colleges: A Mixed Methods Case Study Of Outcomes-Based Assessment Training In Student Affairs, Tammy L. Russell

Dissertations

Many student affairs departments struggle to contribute to an institution’s evidence base of student learning. In part, this results from student affairs personnel not having adequate training in how to assess learning outside the classroom. This is a particular challenge for small community colleges, in which individual units (e.g., admissions or financial aid) may have only one or two employees. Failure to assess co-curricular learning poses challenges to institutions in meeting accreditation standards, placing them at risk for increased scrutiny and loss of state funding under a performance-based system. The purpose of this mixed methods study was to use a …

The Relationships Between Clergy Attachment Style, Leadership Style, And Clergy Professional Longevity, Marc Nelesen

Dissertations

This study investigates a relatively new area of research, namely, the relationship between attachment theory (Bowlby, 1969, 1973, 1980, 1988) and leadership theory. Attachment theory posits that human beings unconsciously established mental models of how relationships work. Depending on the kind and quality of early relational experiences, humans can associate feelings of security, anxiety, or avoidance with relationships. According to attachment theory, these associations are transferable and inform future relationships. Much of leadership theory suggests that relationships are a key component of effective leadership and may very well be the most important factor (Gardner et al., 2005). Recent quantitative studies …

It’S On Us: A Case Study Of Academic Integrity In A Mid-Western Community College, Ceceilia Parnther

Dissertations

Academic ethics and integrity are necessary elements of a quality education. The need for academic integrity education on campuses has been well documented (Bertram Gallant, 2008, 2016; Bertram Gallant & Drinan, 2006; Liebler, 2009; McCabe, Butterfield, & Trevino, 2004). Academic integrity is a cornerstone of the learning process (Bretag et al., 2014; Harp & Taietz, 1966). Higher education institutions have the opportunity to promote academic integrity and prevent academic misconduct on campus by providing clear guidelines, equitable resolutions, and student and faculty engagement. While researchers have examined four-year institutions approaches to academic integrity education, differences exist that are unique to …

Culturally Relevant Education For Rural Schools: Creating Relevancy In Rural America, Joshua J. Anderson

Dissertations

In this dissertation, I investigate the ways in which culturally relevant pedagogy is conceptualized and implemented by two secondary English Language Arts educators in one school district with a strong sense of rural identity. Culturally relevant pedagogy is considered by many professionals in the field of education to be an effective philosophy to inform instructional practices for narrowing the achievement gap of historically marginalized groups (Cummins, 1990; Gay, 2000; Ladson-Billings, 1994, 2000). A careful review of the literature on culturally relevant pedagogy reveals the discourse surrounding culturally relevant pedagogy has largely been dominated by urban voices (Cochran-Smith, 2003; Esposito & …

An Analysis Of Evaluation Practices Of Two Training Programs In The Healthcare Sector Using The New World Kirkpatrick Model, Michelle Woodhouse

Dissertations

The American Customer Satisfaction Index Report in 2015 indicated that service quality in the healthcare sector has declined even though the demand for healthcare service is rising. Companies invest billions of dollars annually to develop and implement customer service training programs; however, although companies evaluate their programs in order to continuously improve customer satisfaction, service quality is still on the decline. This may be because the evaluation process is neither formal nor comprehensive. Although the literature indicates that companies carry out evaluations, little is known about the actual evaluation process that is utilized to evaluate training programs, the levels at …

Correlates And Effects Of Data-Informed Decision-Making: An Empirical Examination Of The Loose Coupling Theory Using A National Data Set, Xingyuan Gao

Dissertations

The notion of schools as “loosely-coupled” organizations has been widely discussed in the research literature. Many argue that the loose coupling is either a protective mechanism for schools to buffer external pressure or a barrier to implementing new reforms. Against the backdrop of standards-based reform and accountability policies in the last 15 years, which focus on tightening the system as the way to improve K-12 schools, I conducted three related studies to empirically test the loose coupling theory by applying two-level hierarchical linear models to nationally representative data in the US.

In the first study I evaluated the loose coupling …

Digital Storytelling As Poetic Reflection In Occupational Therapy Education: An Empirical Study, Lisebet S. Skarpaas, Grete Jamissen, Cecilie Krüger, Vigdis Holmberg, Pip Hardy

The Open Journal of Occupational Therapy

Stories are powerful aids to reflection. Thus, the use of stories may be a pathway to enhanced reflective practice and clinical reasoning skills. The aim of this study was to evaluate whether and how digital storytelling can contribute to occupational therapy (OT) students’ learning through reflections on experiences from placement education. A cohort of OT students (n = 57) participated in a 2-day workshop to create digital stories. Data were generated through a questionnaire with a response rate of 100% of students who completed the workshop (n = 34). Quantitative analysis methods were used to reveal a level of agreement …

Building An Evaluation Model Of Academic Advising’S Impact On Progression, Persistence, And Retention Within University Settings, Abhik Roy

Dissertations

Academic advising is at a point in its maturation as a field of study where anecdotal evidence is no longer sufficient to inform the measure of effectiveness. As the area becomes more research-based, advising’s measurable impact should be based on an evaluative framework; no such structure currently exists. In this study, three methods were used to investigate this problem and ultimately to create a model and checklist. Firstly, a descriptive study was used to examine if there is an understanding of what evaluation is within the advising community, one where assessment has been the dominant practice. Secondly, a quasi-experimental design …

The Federal School Improvement Grant: Telling The Story Through Quantitative Outcomes, Gregg B. Dionne

Dissertations

Student success and the mitigation of achievement gaps has been a focus of the federal government since passage of the Elementary and Secondary Education Act of 1965. The federal School Improvement Grant (SIG) is the latest in federal policy inducements to address this.

To tell the story of SIG implementation in one Midwestern state, data was collected from two groups of SIG-eligible schools, one group which received SIG funding and the other group which did not. Data was collected over multiple years and included mathematics and reading outcomes as well as graduation, dropout, and attendance rates. Data was obtained for …

A Metaevaluation Of The Commission On Fire Accreditation International Accreditation Process, Stacy A. French

Dissertations

Fire and emergency services throughout the country are being required by local governmental authorities to provide efficient and effective services. In 1996, the International City-County Management Association (ICMA) and the International Association of Fire Chief (IAFC) executed a master trust agreement that established the Commission on Fire Accreditation International (CFAI) to award accreditation to those fire and emergency services that demonstrated efficiency and effectiveness in the services provided. As of this study, no documented research had been published that challenged the current CFAI Accreditation process to ensure the highest level of accountability and usefulness for both the public and fire …

Senegal's Language Problem: A Discourse Of Disparity, Monica Naida

Honors Theses

The purpose of this research is to assess the deficiencies of the Senegalese education system and to evaluate improvements to the system so that it works for the Senegalese, instead of against them. My research is mostly concerned with the process in which the French language is taught in schools. I explain these deficiencies in the education system through elucidation of the discourse used by the French colonizer, politicians, non-governmental organizations, teachers, and parents. My approach to this research includes an extensive literature review as well as my own personal observations during a faculty-led research trip to Dakar, Senegal during …

Progress In The Past Decade: An Examination Of The Precision Of Cluster Randomized Trials Funded By The U.S. Institute Of Education Sciences, Jessaca Spybrook, Ran Shi, Ben Kelcey

Research and Creative Activities Poster Day

This article examines the statistical precision of cluster randomized trials (CRTs) funded by the Institute of Education Sciences (IES). Specifically, it compares the total number of clusters randomized and the minimum detectable effect size (MDES) of two sets of studies, those funded in the early years of IES (2002–2004) and those funded in the recent years (2011–2013). Overall, the average precision in terms of MDES of studies in the recent cohort was more than double that of the early cohort (i.e. 0.48 compared to 0.23). The findings suggest a consistent and substantial increase in the precision of CRTs funded by …

Student Learning Outcomes: Tools, Planning, And Contribution To Institutional Goals, Kathy Collins

Assessment in Action Conference

On our campuses, students spend a significant amount of time outside of the formal classroom. What are we doing to creatively think about capturing this learning and evaluating it to enhance the student experience? There are numerous ways to develop assessment plans, tools, and learning outcomes to provide evidence of student learning. Even more important is preparing and supporting quality professionals in the field to do quality assessment work.

Are We There Yet? Assessing Our Progress In Assessment, Katharine Cummings

Assessment in Action Conference

This session will present a descriptive continuum to help determine progress in creating and implementing an assessment system. Attendees will have the opportunity to use the continuum to assess their own department's progress as well as to refine the descriptions included in the continuum.

Student Employment: Incorporating Learning On The Job, Kathy Collins

Assessment in Action Conference

Evaluations of a student's performance are often a required part of one's development. More importantly, they are an important part of a student's learning experience. This session will explore the creation of learning outcomes and tracking tools for student employment experiences across higher education.

Writing Observable And Measurable Learning Outcomes, Eli Collins-Brown

Assessment in Action Conference

This session will show how to write learning outcomes that are useful to the student and essential for faculty who want to improve student learning and assessment in their courses. Writing observable and measurable outcomes is not a difficult task once you learn the process to follow. By the end of this session, participants will be able to distinguish between content, learning activities and learning outcomes and apply the three-step process for writing observable and measurable learning outcomes.

Assessment At The College Level: Core Comptencies, Sue Caulfield

Assessment Grants

Sue Caulfield, from the School of Interdisciplinary Health Programs at Western Michigan University, shared this poster at the Assessment in Action Conference 2016 on April 8. She was the recipient of one of the 2015-2016 WMU Assessment Fellows Grants to conduct research on assessment of student learning outcomes. The focus of her project was to assess student writing in the College of Health and Human Services as a core competency across the college. This poster provided information regarding her assessment project.

Western Michigan University Assessment In Action Conference 2016, Office Of Assessment And Undergraduate Studies

Assessment in Action Conference

Included here is the schedule from the 7th Annual WMU Assessment in Action Conference 2016. The conference, sponsored by the Office of Assessment and Undergraduate Studies at Western Michigan University, is a one-day event where those new to outcomes assessment can come and learn fundamental knowledge about the field, but it is also a place where those who have worked as leaders in outcomes assessment can come and extend their knowledge and skills and network with colleagues. Conference offerings included learning opportunities on various assessment topics for both academic and student supports units.

Assessing Students Rule-Bound Writing Development, Kim Ballard

Assessment Grants

Kim Ballard, from the Writing Center at Western Michigan University, shared this poster at the Assessment in Action Conference 2016 on April 8. She was the recipient of one of the 2015-2016 WMU Assessment Fellows Grants to conduct research on assessment of student learning outcomes. The focus of her project was to help WMU students learn to incorporate rule-bound Lower Order Concerns into their personal writing style. This poster provided information regarding her assessment project.

The Effects Of Strengths-Based Curriculum On First-Year Students, Melissa Holman

Assessment Grants

Melissa Holman and Rachel Carlson, from the College of Education and Human Development at Western Michigan University, shared this poster at the Assessment in Action Conference 2016 on April 8. They were the recipients of one of the 2015-2016 WMU Assessment Fellows Grants to conduct research on assessment of student learning outcomes. The focus of this project was to expose WMU CEHD First Year Seminar students to a strengths-based curriculum, coach them to apply their strengths, expose the students to campus resources and supports, enhance their student experience to help with retention, and increase the self-reported level of intrinsic motivation. …

Evaluation Of The Master Of Arts Hybrid Program In Psychology, Denise Ross, Cynthia Pietras

Assessment Grants

Denise Ross and Cynthia Pietras, from the Department of Psychology at Western Michigan University, shared this poster at the Assessment in Action Conference 2016 on April 8. They were the recipients of one of the 2015-2016 WMU Assessment Fellows Grants to conduct research on assessment of student learning outcomes. The focus of their project was to measure the effectiveness of the Master of Arts Hybrid Program in Psychology including program satisfaction, content knowledge and professionalism. This poster provided information regarding their assessment project.

Student Learning Outcomes Of Involvement, Kate Bates

Assessment Grants

Kate Bates and Stephanie Beld, from the Department of Student Activities and Leadership Programs at Western Michigan University, shared this poster at the Assessment in Action Conference 2016 on April 8. They were the recipients of one of the 2015-2016 WMU Assessment Fellows Grants to conduct research on assessment of student learning outcomes. The focus of their project was to assess and compare the impact and learning outcomes of students involved in Registered Student Organizations and LeadCorp Interns that are directly advised by SALP staff. This poster provided information regarding their assessment project.

Making Academic Change Happen-Any Way We Can?, Julia Williams

Assessment in Action Conference

Within the higher education community, there are repeated calls for changing the way we educate our students. And yet, despite the development of research-based teaching strategies, innovative co-curricular projects, and many years of funding and development from a variety of foundations and corporations, change in higher education is not pervasive. The lack of systemic change points to an important problem with the approach to change that the higher education community has pursued thus far. Current change approaches have not fostered the necessary knowledge, skills, and abilities (KSA) in motivation, communication, collaboration, and persuasion that are the foundation for change on …

From Artifact To Assessment To Evaluation-Closing The Loop In Continuous Improvement, Julia Williams

Assessment in Action Conference

As faculty, we understand well the process by which we assess students and provide them with feedback on their work; in this way, we "close the loop" in order for students to learn and improve. The same process of assessment and feedback characterize the institutional improvement loop; by collecting and analyzing a variety of data, we can make informed decisions in order to make improvements. The challenge is to understand how classroom assessment activities map and can support continuous improvement at the program and institutional levels. In this workshop, we will explore multiple classroom assessment techniques in order to understand …

A Metaevaluation Of School Counseling Program Evaluations, Saeed Mohammed Almueed

Dissertations

School counseling programs have been recognized as an educational component that ultimately benefits student achievement at most developmental stages. Comprehensive school counseling programs are executed in alliance with a specific school counseling model, such as the Comprehensive Developmental Guidance model, or more recently, The American School Counselor Association National Model (ASCA, 2003, 2005, 2012). Although the school counseling literature reports positive outcomes associated with comprehensive school counseling programs, there are still challenges in their implementation and evaluation. Program evaluation as stressed in The ASCA National Model is to confirm the effectiveness and value of these programs and interventions. Yet, the …

The Relationship Between Student Achievement And Professional Learning Communities At The Middle School Level, Michael S. Burde

Dissertations

For nearly two decades, schools throughout the United States and beyond have utilized the Professional Learning Community (PLC) model to foster teacher collaboration in hopes of improving student achievement outcomes. At the turn of the century, much of the research suggested a positive relationship between student achievement outcomes and the implementation of PLC’s in the school setting. The more recent research suggests little to no relationship between PLC’s and student achievement outcomes.

In an effort to bring clarity to the conflicting research, data was collected from a sample of 12 schools which included 275 teachers and nearly 6,000 students. Teacher …

Crowd Sourced Product Reviews: A Study Of Evaluation Standards Used, Alexander W. Manga

Dissertations

People are using online product reviews and evaluations more and more (Chandler et al., 2013). As the usage of online reviews persists and more smart phone applications are created, the demand for online product review continues to increase; yet, there is no indication of the quality of these reviews. In fact, some online reviews have been found to be fraudulent and misleading. Many online product reviews come from Internet-based crowdsource organizations. Few studies have explored evaluation practices among these organizations, and as a result, it is unclear what, if any, evaluation standards are used by crowdsource reviewers, particularly those found …

Rubrics As A Tool For Reaching Explicitly Evaluative Conclusions: Implications For Evaluation Theory, Training, And Practice, Krystin S. R. Martens

Dissertations

Evaluation is the systematic determination of merit, worth, or significance. A core professional evaluator competency is to provide transparent and explicit evaluative conclusions. Yet, “understanding the reasoning process to establish evaluative conclusions drawn in practice has to be the field’s greatest unmet challenge” (Fournier, 1995, p. 1). This three-article dissertation studies rubrics as a tool that can assist in meeting the stated challenge when used by program evaluators to reach explicitly evaluative conclusions.

Study 1 provides an account of the history and etymology of the term rubric and provides an analysis of peer-reviewed program evaluation literature, specific to the extent …

The Experience Of Teachers And Deans In An Intensive Weekly Observation/Feedback Model, Kathleen A. Grinwis

Dissertations

This phenomenological study looked at the lived experiences of 12 teachers and deans participating in an intensive weekly observation/feedback model in several charter school academies. In this model, teachers and deans work to grow as educators and to reach their professional development goals. While we know that a major factor in increasing the proficiency rate of our students is improving teacher effectiveness, not as much is known about how to provide the necessary guidance for teachers’ professional growth and efficacy development. The challenge for leaders is to develop effective systems of supervision that support teachers and administrators as they work …