Educational Assessment, Evaluation, and Research Commons^™

Pandemic Pedagogy: Elements Of Online Supportive Course Design, Nate Brophy, Melissa A. Broeckelman-Post, Karin Nordin, Angela D. Miller, Michelle Buehl, Jeff Vomund

Journal of Communication Pedagogy

The purpose of this study was to identify which course design elements students perceive as supporting an easier transition to emergency remote teaching due to COVID-19, as well as to use those items to develop the Online Supportive Course Design (OSCD) measure. By asking students to rate their course with the easiest transition and hardest transition to emergency remote teaching, this study identified which structural elements were most important for supporting students during the transition. Using exploratory and confirmatory factor analyses, a seven-item measure was developed to operationalize OSCD, and initial validity was established by examining the relationships between OSCD, …

Western Michigan University Assessment Handbook: "Celebrating Student Learning", Office Of Institutional Effectiveness

Assessment Publications & Presentations

Western Michigan University (WMU) is committed to the success of our students. That success is predicated on the idea that students graduate from the university having added to the knowledge they had entering WMU. Assessing student learning is crucial to ensuring and documenting that students get the added value they should expect from the institution.

This Assessment Handbook is designed to help units carry out their assessment activities. It contains information, (from both internal and external sources), on how to write good assessment outcomes, answers to frequently asked assessment questions, resources available on campus, and some sample assessment tools, among …

Journal Of Communication Pedagogy, Complete Volume 4, 2021

Journal of Communication Pedagogy

This is the complete volume 4 of the Journal of Communication Pedagogy.

Asian International Students In U.S. Higher Education: A Secondary Data Analysis Of Satisfaction Levels And Willingness To Recommend Their Institution, Soongmin Chow

Dissertations

International students are integral to U.S. higher education. They bring talent and cultural diversity to U.S. campuses, contribute immensely to the U.S. economy, and create long-lasting political and academic links that aid public diplomacy in the long run (NAFSA, 2003). The U.S. has traditionally been the largest market for international students seeking quality higher education (Institute of International Education, 2018). However, reports show that the U.S. is slowly losing its market share of international students, and the number of new international students coming to the U.S. has been on the decline since 2016/17. Higher education institutions are most concerned over …

Curriculum Mapping For B.S. In Healthcare Services And Sciences, Janet Hahn

Assessment Grants

This project will build on the Healthcare Services and Sciences program competencies revised at a faculty retreat in February 2020. It will map the competencies along with a suggested student progression. WMU Essential Studies assessment data will be integrated into the curriculum map and overall program assessment plan.

Institutional Changes In Western Michigan University For Incorporation Of Education For Sustainability, Saman Khan

Dissertations

Higher Education institutions (HEIs) have the potential to be significant contributors in the pursuit of a sustainable world through the incorporation of Education for Sustainability (EFS). However, HEIs are entrenched with structures and values that are often resistant to change. The literature reveals that instructors’ beliefs and institutional contexts are the two main factors that impact the implementation of institutional change for sustainability education. Western Michigan University (WMU) has created new required curriculum “WMU Essential Studies” (WES) for undergraduate students and they have targeted sustainability as an essential learning outcome, by integrating and applying it in content courses. Using a …

Building And Maintaining Sanctuary Spaces Through Face To Face Writing Assessment, Jeffrey Austin, Ann Burke, Ellen Foley, Gretchen Rumohr

Teaching/Writing: The Journal of Writing Teacher Education

Seasoned secondary and college instructors discuss successful face-to-face assessment, especially in virtual settings. F2F assessment frees educators to co-create equitable literacy learning experiences with students, encourages agency, demystifies the grading process, develops the classroom community, and brings meaningful inquiry about writers’ own skills and practices, ultimately disrupting inequities and inequalities of traditional grading and creating “sanctuary spaces” for all writers.

Teacher Perceptions Regarding The Purpose Of K-12 Education, Peter M. Grostic

Dissertations

This study explored the perceptions of teachers regarding the purposes of K-12 education and the influence of belief sources on their perceptions. Purposes of K-12 education and the ways in which they have changed over time are topics for which researchers are concerned (Carpenter, 2005; Labaree, 2013). Addressing this concern, there is existing literature focused on understanding purposes through K-12 school mission statements (Schafft & Biddle, 2014; Stemler & Bebell, 2012), and a multitude of reflections regarding what K-12 education purposes should be (Biesta, 2015; Macallister, 2016; Robinson & Aronica, 2014). Less is known regarding what frontline K-12 education practitioners …

An Empirical Study Of Design Parameters For Planning Two-Level And Three-Level Cluster Randomized Trials To Detect Moderator Effects, Qi Zhang

Dissertations

In the last two decades, we have seen an increasing number of impact studies in education that are designed to detect a meaningful average treatment effect, which answers the what works question. Recently, researchers have started to consider how to expand the design of impact studies to answer questions regarding the treatment effect heterogeneity across different contexts, such as for whom and under what conditions programs work. Answering these questions is imperative in the quest to make evidence-based and context-relevant decisions to improve educational outcomes for all students.

Many of the impact studies utilize a cluster randomized trial (CRT). CRTs …

Assessing Student Employees' Career Readiness, Ewa Urban, Wayne Bond

Assessment Grants

The purpose of this project was to measure, using direct assessment data, student employees’ career readiness competencies gained through campus student employment. Career and Student Employment Services developed and delivered a career readiness certification program to 148 student employees in 14 WMU campus departments. The program was designed to teach students to articulate, through resumes and answers to interview questions, the career readiness competencies required by employers in all industries. These competencies include: critical thinking, communication, teamwork, technology application, leadership, professionalism, career management, and intercultural fluency.

To address the program learning outcomes, students participated in a face-to-face workshop, completed a …

An Exploration Of Preschool Choice With Low-Income Families: The Critical Role Of Positive Attitudes, Behavioral Norms And Control Beliefs, Laurel E. Schmitt

Dissertations

Since the 1960s preschool has been seen as a potential equalizer for children of poverty as they enter kindergarten and long term studies of state and federal preschools have documented positive impacts, especially for low-income students. What has yet to be deeply explored is guardians’ decision-making processes to explain the lack of enrollment even when the stated barriers are eliminated (Obi, 2011; Payne, 1994; Swartz, 1996).

The purpose of this qualitative study was to describe and interpret, through a phenomenological lens, how low income parents and guardians made decisions to enroll their child or dependent in a preschool program. I …

Parent And Guardian Perspectives Regarding Attendance: Evidence From A Governmental Early Childhood Education And Care Program, Rita L. Cruz Santelises

Dissertations

In 2013, the Dominican government began the implementation of a national plan called Quisqueya Empieza Contigo (QEC) (Exec. Order No. 102, 2013), aimed to fulfill the needs of children zero to five years old holistically. The National Institute of Comprehensive Care (INAIPI, acronym in Spanish) carries two of the most ambitious programs embedded in this national plan. Early Childhood is the governmental institution authorized to carry out this recent intervention. The intervention has increased coverage of early childhood services through two programs: Programmed Comprehensive Family Care centered on the community (Centro de Atención Familiar e Infancia, [CAFI]) and the Comprehensive …

Undergraduate Educational Research Experiences In The Study Of Interior Design, Julia Virginia Pimentel Jiménez

Dissertations

Designers create social constructions (experiences and interactions) for human beings among themselves and with and within interior environments to enhance meaning in people´s lives (Poldma, 2011). Those social constructions are created through the design process developed by the interior designer; that process relies heavily on design research. Therefore, it is at the undergraduate level that the passion for research should start for interior design (ID) students. Faculty in ID programs need to encourage that passion by engage students in meaningful learning experiences such as how to ask questions about users, functions, activities, and aesthetics.

This study explored what types of …

Saudi Arabian Science Teachers And Formative Assessment In The Gender Segregated Male School System, Khalid Abdullah Kariri

Dissertations

Formative assessment is a key pedagogical tool that allows teachers to make instructional assessments in real time for the improvement of student learning. It gives students the opportunity to provide evidence of their learning thus giving teachers assurances that their hard work is not in vain. Formative assessment is commonly practiced in Western schools, while most Saudi science classroom teachers rely on end-of-unit summative assessment. A review of the literature reveals that very little research has been done related to Saudi teachers’ use of formative assessment in science classrooms. The goal of this dissertation was to address this absence of …

Teachers’ Experiences In Schools That Serve Rural Communities In The Dominican Republic: Their Readiness To Respond To Challenges, Nidia Beatriz Columna Pérez

Dissertations

In 2016, the Dominican Institute for Evaluation and Research of Educational Quality (IDEICE), indicated educational inequalities due to the geographical location of schools in the Dominican Republic. Despite several policies enacted by the Ministry of Education, including curriculum and teacher credentialing reforms, success indicators such as completion rates and academic performance still suggest a major achievement gap. Limitations in understanding the unique characteristics of schools that serve student in rural communities contribute to education policies that may not be sufficiently sensitive to those circumstances. One particular area of insufficient understanding is the manner in which teachers experience teaching in schools …

Dominican Nursing Students’ Self-Reported Mastery Of International Nursing Competencies, Wady Ramirez

Dissertations

The Dominican health care system has many challenges to meet the legal and the population’s health care expectations (La Hoz, 2018; United States Agency for International Development, 2013). The purpose of this study was to evaluate how well Dominican nursing students, who have completed their internship but not yet defended their final career project, assessed themselves against a set of international nursing competencies. In addition, the purpose was to explore any differences in their self-assessments based on whether these students completed their internship at public health care centers or not. Finally, the goal was to determine to what extent do …

Journal Of Communication Pedagogy, Complete Volume, 2020

Journal of Communication Pedagogy

No abstract provided.

The Learning Experiences Of Practicing School Leadership Coaches: A Multiple Case Study, Dustin Anderson

Dissertations

In 2017, the US Department of Education awarded Western Michigan University (WMU) a Supporting Educator Effectiveness Development (SEED) grant to fund the High-Impact Leadership for School Renewal (HIL) Project. The purpose of the HIL Project is to recruit and prepare school leaders with the skills associated with instructional leadership for improving school conditions that support student achievement. Through the use of school leadership coaches (called Implementation Facilitators in the HIL Project) trained on an adaptive school leadership coaching model, the HIL Project seeks to address one of the most challenging aspects of school leadership: developing and sustaining the HIL Model …

Evaluation Competencies, Instruction, And Academic Leadership, Daniela C. Schroeter

Academic Leadership Academy

Background and Context

My primary research interests center on evaluation theory, methodology, practice, and capacity building. In particular, my current research focuses on evaluation competencies among public and nonprofit sector employees. In light of the 2018-2019 Academic Leadership Academy and Instructional Development grant, this poster revisits findings from a federal evaluator survey and examines: What evaluation and leadership competencies should be emphasized in the developments of public administrators?

Continuous Improvement In Academic Affairs, Jen Wells

Assessment in Action Conference

As faculty, we are asked to focus on teaching, research, and service; how we manage our work is often pre-determined by how we allocate time to these three elements. With that, the question is where assessment and continuous improvement fit. This presentation will offer a model of continuous improvement and ideas on how it can be integrated in your current work and not as a check the box exercise. We will also review how assessment can be scaffolded and implemented at the graduate level.

Best Practices For Teaching Discussion As Part Of High School Common Core State Standards, Mitchel Stengel, Leah Nolan, David Donnick, Wesley Skym, Anna M. Wright

Journal of Communication Pedagogy

Instructional discussion is a teaching method used in many classrooms across grade levels. In fact, the Common Core State Standards promote the use of instructional discussion in secondary classrooms (Common Core State Standards Initiative, 2018a). Students, however, are not always taught best practices for engaging in a discussion and may feel unprepared to participate. As a result, discussions may not produce the dynamic learning opportunity they are intended to foster. This essay provides 10 tips for high school teachers to prepare students in the high school classroom to engage in a meaningful classroom discussion effectively in order to ensure students …

Developing A Digital Voice: Embedding Digital Communication Platforms, Networks, And Technologies In The 21st-Century Classroom, James M. Proszek

Journal of Communication Pedagogy

Introductory communication courses are an invaluable resource for improving students’ abilities to speak confidently, passionately, and persuasively, while also inspiring them to become more engaged citizens. However, digital media present new opportunities and challenges for designing courses that are relevant to students’ personal and professional interests and goals. Instructors who incorporate digital communication platforms, networks, and technologies into their classrooms can better prepare students to meet the complex demands of the technologically-mediated 21st century. In this essay, I offer 10 best practices for developing students’ digital media literacies within multiple communication contexts.

Journal Of Communication Pedagogy, Complete Volume, 2019

Journal of Communication Pedagogy

No abstract provided.

Limited By Design: Expanding The Boundaries Of Schooling Policies From Demanded Passivity To Transformative Practice, Natalia T. Carvalho-Pinto

Masters Theses

Schooling is often imagined as the great equalizer and the primary venue towards personal and collective liberation. However, hegemonic ideals and practices have limited the ability for educators to craft and utilize policy in a way that best benefits their students. In this thesis, I utilize the state of Michigan’s Common Core curriculum to examine the limits beyond policy and practice. Specifically, I argue that the demands for student passivity and institutional measurable as signs of success, prohibit student growth. Throughout the document, I describe hope in the ability to instill a variety of transformative educational theories and practices that …

The Effect Of Item Stem And Response Option Length On The Item Analysis Outcomes Of A Career And Technical Education Multiple Choice Assessment, Tina M. Koepf

Dissertations

Critical decisions in Career and Technical Education (CTE) can be based on assessment outcomes, requiring an essential focus on continuous improvement initiatives to provide increased multiple choice (MC) assessment validity. Previous research has determined that the presence of flawed test items negatively impacts student success; therefore, an MC taxonomy has been established and used in the assessment industry. While rigorous and successful Career and Technical Education (CTE) programs that enroll high-level academic students exist, many CTE programs enroll students with a wide spectrum of academic ability. Because many CTE students often have inferior reading skills, it is necessary to take …

Empirical Estimates Of Design Parameters Used In A Priori Power Analyses For Planning School-Randomized Studies In Select Asian Countries, Ran Shi

Dissertations

A cluster-randomized trial (CRT) is one type of randomized controlled trial (RCT) that is often more feasible for evaluating the effectiveness of an educational intervention due to the multi-level structure of the data (e.g., students nested in schools). In order for a CRT to generate rigorous evidence, it is essential that is it adequately powered to detect an effect of a given size. As such, it is common for researchers to conduct a priori power analyses to determine how large a sample the CRTs will require to detect an effect of a given magnitude. Previous work has shown that two …

University Leaders’ Experiences In Advancing The Development And Transformation Of Emerging Saudi Public Universities, Abdulrahman Hamed Alsulami

Dissertations

For several decades, Saudi higher education comprised seven to eight public universities concentrated in the main cities of the country. Since the beginning of the new millennium, the Kingdom of Saudi Arabia has heavily invested in the higher education sector. Thus, it witnessed a remarkable rate of expansion from 8 to 28 higher education institutions during a relatively short period between 2003 and 2013. This renaissance in the sector involved several different processes, including transforming, merging, restructuring, and establishing new colleges and/or programs, administrative posts, and key components for inclusive and modern campuses.

From a contextual perspective, there is a …

Balancing Efficacy And Effectiveness With Philosophy, History, And Theory-Building In Occupational Therapy Education Research, Barbara Hooper, Jyothi Gupta, Andrea Bilics, Steven D. Taff

The Open Journal of Occupational Therapy

The preferred focus for education research in occupational therapy increasingly rests on studies that investigate efficacy and effectiveness in the teaching-learning context. While important, the almost exclusive promotion of outcomes-focused studies can come at the expense of other forms of inquiry, including philosophy, history, and theory-building. To fully inform education and enhance practice, outcomes-focused research needs the conceptual foundation provided by philosophical, historical, and theory-building studies. In this paper, the authors suggest that the research enterprise in occupational therapy education is in its infancy and, therefore, quite susceptible to shortcuts that head straight to outcomes. To address this issue, the …

Life Is A Lab: Developing A Communication Research Lab For Undergraduate And Graduate Education, Autumn P. Edwards, Chad Edwards, Patric R. Spence

Journal of Communication Pedagogy

Tips offered center on classroom discourse, curriculum choices, and potential assignments. In this article, we present tips for creating a thriving undergraduate and graduate communication research lab. Based on our experiences developing and co-directing the Communication and Social Robotics Labs (CSRLs), we offer 10 best practices for acquiring resources and recognition, building a strong lab community, and attaining faculty and student goals for scholarship and beyond. Our overarching approach is framed by Dewey’s (1916) pragmatist educational metaphysic, which stresses student- and subject-centered learning, enlarging experiences, and the co-construction of meaning and knowledge. Although our labs are focused on human-machine communication …

Using Freewriting In Public Speaking Courses To Remedy Student Apathy: An Unconventional Solution To A Common Problem, Flora Keshishian

Journal of Communication Pedagogy

Student apathy—a lack of motivation or mental presence in the classroom—is common in many academic institutions and courses of study. In Public Speaking courses, speech anxiety can be a factor that contributes to student apathy. To solve this problem, I suggest implementing an unconventional approach—in-class unguided longhand freewriting—that requires students to write nonstop about anything that comes to mind, without censoring or editing, during the first five minutes of each class session. I base this recommendation on my own observations of the students’ body language during the freewriting period, as well as my qualitative analysis of 95 students’ written feedback …