Educational Assessment, Evaluation, and Research Commons^™

The Effects Of Fluency Building On Undergraduate Student Performance, Lauren B. Shibley

Dissertations

Online learning has become integral to higher education, with enrollment steadily increasing over the past decade and accelerating during the COVID-19 pandemic. Research highlights the importance of flexibility, learner autonomy, and self-regulated learning skills in this environment, with studies demonstrating that strategies such as mastery-based, self-paced instruction, fluency training, and timely feedback support student engagement and academic success. Early work adapting personalized instruction for online use (Pear & Crone-Todd, 1999) and subsequent studies on fluency practice (Quigley et al., 2018; Urbina et al., 2019) emphasize how these supports can improve concept retention. Despite these advances, more quantitative research is needed …

The Need For ‘Soft Skills’ In Occupational Therapy Curricula: A Descriptive Analysis Of French Students’ Internship Comments, Cynthia Engels, Nadia Oubaya, Aliki Thomas

The Open Journal of Occupational Therapy

A competent occupational therapist needs soft skills. Although the French national occupational therapy (OT) curriculum lists 10 competences to be acquired, they do not include soft skills. The objectives of this study were to (a) Identify the proportion of soft skills in OT students’ internship comments written by internship tutors and (b) characterize the mentioned soft skills to help determine whether and which soft skills should be included in the new OT curriculum nationwide in France. This was a qualitative descriptive analysis of tutors’ comments on internship evaluations based on the framework method. Of the 1060 internship reports, 1035 (98%) …

Journal Of Communication Pedagogy, Complete Volume, 2025

Journal of Communication Pedagogy

No abstract provided.

Estimating And Applying Parameters Necessary To Plan Cluster Randomized Trials (Crts) And Multisite Cluster Randomized Trials (Mscrts), Dea Mulolli

Dissertations

Cluster randomized trials (CRTs) are commonly used to study the effectiveness of educational interventions. During the design phase of a study, it is critical for researchers to ensure their studies are adequately powered to detect meaningful treatment effects, including both main and moderator effects. Designing CRTs with adequate power to detect main and moderator effects requires accurate estimates of design parameters. This research aims to advance the literature on design parameters for power analyses, specifically focusing on empirical estimates of intraclass correlations (ICCs). The work consists of three research papers that examine the role of including the teacher level in …

From Pre-College Grads To Undergrads: Encouraging Full-Time Enrollment After Summer Programs, Meghan Buckley Ph.D.

Journal of College Access

This guest perspective argues that converting in-person summer pre-college program participants into matriculated, degree-seeking undergraduate students at that same institution is a multi-step process that involves: 1) strategic pre-college program recruitment, 2) a curated and well-rounded summer pre-college experience that is both academically rigorous and socially dynamic, and 3) continued and consistent post-program engagement. It also argues that summer pre-college programs should work intentionally with Admissions departments during pre- and post-program development to create the most effective recruiting and enrollment pipelines from pre-college to eventual matriculation

Associations Between Learning Environment And Study Satisfaction Across Time: Two Cross-Sectional Analyses Of Occupational Therapy Students, Gry Mørk, Susanne G. Johnson, Astrid Gramstad, Linda Stigen, Tove Carstensen, Tore Bonsaksen

The Open Journal of Occupational Therapy

There is increasing attention toward students’ satisfaction and how they perceive the quality of the program they attend. This study examined stability and change across time with regard to the relationships between learning environment factors and occupational therapy students’ satisfaction with the program. In the two consecutive cross-sectional analyses performed in this study, 163 second-year students and 193 third-year students from all six occupational therapy education programs in Norway participated. The Course Experience Questionnaire was used to assess learning environment factors and study satisfaction. The data were analyzed with Pearson’s correlation coefficient r and with hierarchical linear regression. Bivariate associations …

Bcm Assessment Update Application, Marie Moreno

Assessment Grants

This grant application seeks support for the BCM Department to address challenges in teaching professional writing in today’s educational landscape. The plan involves collaborating with the Haworth Communication Center, attending a webinar on teaching underprepared students, creating a workshop for students, and updating assessments in the BCM 1420 curriculum based on the results and experiences. Aligned with university goals, this proposal will empower faculty and students, foster community building, and promote equity and inclusion. It supports students’ retention, academic success, and intellectual and occupational well-being. Emphasizing continuous improvement and data-informed decision-making, the budget covers webinar expenses and workshop coordination.

The Value Of 360-Degree Assessment In Higher Education, Daniela Schroeter, Heather Jach Turner

Assessment Grants

This assessment project aims to examine the value of 360-degree assessment for higher education with the goals of (a) enhancing undergraduate and graduate students' learning experiences and outcomes, (b) developing an assessment toolbox for broad dissemination, (c) fostering curriculum alignment, and (d) contributing to program and unit level learning outcomes assessment while keeping a strong alignment with WMU’s strategic priorities. Funding will be applied toward strategic examination of data derived from exploratory implementation of 360-degree assessment within four School of Public Affairs and Administration courses. Dissemination products include a 360-degree assessment toolbox, presentations and reports, and possible journal manuscripts.

Refining The Fashion Merchandising And Design Program Assessment Components, Mary Simpson, Chitra Singh, Zee-Sun Yun

Assessment Grants

To establish a strong and consistent assessment foundation, a program level assessment plan needs to be reevaluated periodically. The overarching goal of this project is to refine the current assessment plan of the Fashion Merchandising and Design program, which includes three components: curriculum evaluation, student learning outcomes, and student exit survey. Particularly, this proposal addresses two main assessment focus areas: i) alignment of the capstone course outcomes and assessments to the program-level outcomes and ii) refining the student exit survey as a tool for program-level assessment. In addition, this project aligns with assessment goals of the program accreditation Textile and …

Closing The Loop: Data-Informed Decisions For Program Success, Megan Slayter

Measures of Success Series

Join Megan Slayter, Professor and Associate Director from the School of Theatre and Dance, as she shares about the multi-year process that she and her colleagues used to develop one example learning outcome to assess the Bachelor of Arts in Dance program, “students are able to articulate and apply a personal aesthetic related to their career goals”. Along the way, she will discuss the tools used for this process, and show how dance faculty integrated assessment data with understanding of the changing landscape of the field of dance to make data-informed decisions to prepare students for success in a wide …

Unpacking And Illustrating Coiro’S Multifaceted Heuristic Of Digital Reading Through The Development Of The Cot-R Assessment, Jodi Pilgrim, Sheri Vasinda

Reading Horizons: A Journal of Literacy and Language Arts

Although much research exists on digital reading, confusion about literacy terminology persists. Inspired by a recent article in Reading Research Quarterly, the authors explore a multifaceted heuristic of digital reading developed by Julie Coiro. The heuristic, which offers a way to systematically organize, label, and define complex terms, concepts, and practices related to digital reading experiences, served as a reference point to examine the authors’ journey of defining digital reading. Highlighting three aspects of Coiro’s heuristic--text, activity, and context--the authors begin by describing the development of an authentic online reading assessment instrument (COT-R), which focuses on elementary students’ processes of …

School Accountability Within The Dominican Republic: A Qualitative Study Of School Principals’ Beliefs And Knowledge, Massiel Cohen Camacho

Dissertations

The school accountability system in the Dominican Republic (DR) involves the use of several national assessments, the reporting of such data, and the training of principals on how to use such data as part of school improvement efforts. While this type of indicator accountability system does not include specific consequences, there is still significant measuring and reporting of student achievement data, with the implied connotation of teacher and principal responsibility for specific school outcomes. The problem addressed in this study was the lack of research on what school principals know about such school accountability in the DR, and how they …

Occupational Therapy Curricula Patterns For Acquired Brain Injury-Related Vision Disorders For Entry-Level Programs: A Survey, Laura Schmeiser, Alicia Reiser, Caitlyn Foy

The Open Journal of Occupational Therapy

Occupational therapists are among the first providers to encounter individuals after an acquired brain injury (ABI). Evidence suggests that most occupational therapists learn about ABI-related vision disorders from continuing education and on-the-job training. A better understanding of entry-level curricula patterns for ABI-related vision disorders is important because of their high prevalence and impact on occupational performance. A descriptive online survey was administered to occupational therapy educators at ACOTE-accredited entry-level programs to explore curricula patterns for ABI-related vision disorders. Of 1,391 occupational therapy educators invited to participate, 71 (5%) began the survey, and 66 met the inclusion criteria. Vision screening methods …

Take A Bite Out Of Health Disparities, Betty D. Dennis

Assessment Grants

In spring 2023, the College of Health and Human Services (CHHS) launched a new lunch and learn series called “Take a bite out of health disparities.” Speakers, internal and external to CHHS, are invited to lead informal conversations about four specialty topics to address the myriad of individual, environmental, and social factors that contribute to these various health disparities. We also discuss the intersectionality of race, gender, and sexual identity. The goal is to teach faculty, staff, and students in health services their role in teaching compassionate care. We will expand this series in 2023-2024 by adding new topics and …

Assessing Inspera Assessment, Matthew Ross

Assessment Grants

This mini grant will allow for preliminary assessment of Inspera Assessment software at WMU. The Norwegian company Inspera AS presents a more versatile digital assessment platform than the Respondus lockdown browser which is the current WMU platform. Specifically, Inspera offers MS Excel enabled examinations which is not possible with Respondus or similar platforms such as Proctorio or TopHat. However, assessing the capabilities of Inspera is expected to be a challenging, multidisciplinary, and time-consuming endeavor. This grant application requests funding for faculty time to document the capacity of Inspera Assessment to support WMU finance courses.

Equity Audits For Schools Within Restrictive Settings, Matthew Phillp Milanowski

Masters Theses

This project creates a framework and process for conducting facility wide equity audits for schools within juvenile justice and restrictive settings. To accomplish this, an extensive review of existing literature in both the field of education and the field of juvenile justice and existing frameworks and processes were reviewed to create the new framework, Milanowski’s (2023) Facility Wide – Equity Audit Framework, suitable for juvenile justice and restrictive settings. The new framework was then used to guide the development of a process, data collection tool, improvement planning tool, and fidelity instrument to evaluate the implementation of the overall process. This …

Data Storytelling Strategies, Kate Mcdowell

Measures of Success Series

By understanding storytelling dynamics, anyone can learn how to bring data stories to life. Data stories can help persuade decision-makers, but we need accessible tools for breaking down the dynamic process of storytelling into achievable steps. Based on ongoing research, this talk presents tools anyone can use, including:

-Introduction to storytelling thinking
-Classic advocacy arguments
-Evidence and forms of data for those arguments
-Narrative strategies that draw from common story structures
-Tone and tactics for engaging storytelling with different audience attitudes

One of the most critical things we can do to support institutions of higher education in challenging times is …

Centering Equity In Assessment: Theories, Models And Practices, Anne E. Lundquist

Measures of Success Series

Assessment data can be a valuable tool to explore inequities on campus and move to remedy them. But assessment itself is not apolitical or objective and the approaches we use and the mindfulness with which we conduct assessment can advance equity in higher education or perpetuate inequities and cause harm. This session will highlight the critical role of cultivating individual awareness as assessors; discuss the context and scholarly history of equity-centered and equity-minded assessment; share frameworks for considering various approaches to centering equity in assessment; and provide some examples of practice and resources. Participants will have an opportunity to reflect …

Journal Of Communication Pedagogy, Complete Volume, 2023

Journal of Communication Pedagogy

No abstract provided.

Heterogeneity Estimators In Random-Effects Meta-Analysis In Education, Qian Wang

Dissertations

Over the last four decades, meta-analysis has proven to be a vital analysis strategy in educational research for synthesizing research findings from different studies. When synthesizing studies in a meta-analysis, it is common to assume that the true underlying effect varies from study to study, as studies will differ in design, participants, interventions, or sample size that can lead to heterogeneity in their underlying effects. The magnitude of this heterogeneity between studies can be quantified as τ2 in a random-effects meta-analysis. Estimating the between-study heterogeneity (τ2) becomes an important part of random effects meta-analysis reporting, since this quantity plays a …

The Influence Of Course Format, Student Characteristics, And Perceived Teacher Communication And Behavior On Instructional Outcomes Before And During The Covid-19 Pandemic, Elizabeth E. Graham, Heather L. Walter, Tang Tang

Journal of Communication Pedagogy

Two studies examined instructional format (intact vs. hybrid and remote vs. online), classroom climate, student characteristics (engagement and communication apprehension), perceived teacher communication and behavior (teacher competence, clarity, caring), and their influence on instructional outcomes, including cognitive learning, communication satisfaction, and intent to persist in college pre-pandemic and during the pandemic. The findings highlight the important role teacher characteristics (caring, clarity, competence) played in instructional outcomes. This study also revealed that high levels of engagement signals students’ willingness to participate in the learning process. Students are a driving force in their own cognitive learning, communication satisfaction, and intent to persist …

Understanding Student Perspective’S Around Diversity, Equity, And Inclusion Within The School Of Social Work, Anna Yelick, Dee Sherwood

Assessment Grants

Diversity, equity, and inclusion (DEI) has become a prominent fixture within the social work profession, with educational and professional organizations paying closer attention to issues related to DEI. The Council on Social Work Education (CSWE), the governing body for accrediting social work education programs, has required social work programs to demonstrate a commitment to DEI in their implicit curriculum. Therefore, the School of Social Work is interested in understanding student perspectives and experiences of DEI efforts particularly within the implicit curriculum.

Celcis Assessment Plan/Process Revision, Eva Copija

Assessment Grants

This project will involve revising CELCIS assessment plan/process to make it more meaningful, measurable and manageable and to follow the guidelines of the Commission on English Program Accreditation (CEA), which recommended such revision in response to our 5-year interim report. The steps will include: revising learning outcomes for four kinds of courses at four different levels: elementary, intermediate, pre-advanced and advanced to make them more specific and measurable; aligning evaluation instruments with the learning outcomes; updating our model syllabi to make them reflect the correspondence between the learning outcomes and evaluation instruments, and redesigning progress reports given to students.

Teacher Evaluation In Saudi Arabia Relative To National And International Teacher Evaluation Standards And Best Practices, Suhayb Kattan

Dissertations

Teacher evaluation systems are essential in tracking the quality and effectiveness of teachers and education systems. This dissertation examines the teacher evaluation system in Saudi Arabia through multiple perspectives, including research-based frameworks for teacher evaluation, norms and best practices from OECD countries, and established Saudi Teaching Standards. An explanatory sequential mixed methods model was used. Data collection involved 643 responses to a teacher survey that covered working conditions, existence of professional learning communities, and teacher evaluation practices, methods, and uses. Following the survey, in-depth interviews were conducted with 11 teachers and 3 key informants.

Findings from this study indicate the …

Anti-Deficit Perspectives On Institutional Diversity Efforts, Ej Edney

Assessment in Action Conference

Institutions of higher learning are central to preparing people to shape the world in which we live. Yet widening opportunity gaps evidence a need for structural change that increases access and improves outcomes for all students. It is important to consider the lens through which practitioners assess and address the unique challenges and opportunities of an increasingly diverse student population. This session will focus on developing anti-deficit approaches to providing the kinds of opportunities that help solve our most pressing DEI challenges.

Itlc Lilly Online Conference, Veronica Rice Mccray

Assessment Grants

For 40 years, Lilly Conferences have provided opportunities for the presentation of the scholarship of teaching and learning. Conference participants are made up of faculty and administrators at various stages in their academic careers that come from across the world representing nearly every discipline found in higher education. The mission is to provide a forum to share and model a scholarly approach to teaching and learning that reports quality student learning outcomes while promoting professional development of faculty.

The main purpose of attending Lilly Online Conference is to learn new approaches to student assessment and refine existing approaches. The secondary …

Exploring That Fulbright Magic: A Transcendental Phenomenological Study Of Fulbright-Mescyt Alumni Who Return To The Dominican Republic, Joshabel De La Cruz

Dissertations

International higher education graduates may experience challenges related to reentry to their home countries as their expectations upon returning home may not match their reality (Alandejani, 2013; Butcher, 2002, Gaw, 2000). This study utilizes a transcendental phenomenological approach to understand the lived experiences of seven Fulbright-MESCYT alumni who completed U.S. graduate degree programs and returned home to the Dominican Republic (DR) between 2015 and 2018. The Fulbright-MESCYT Program in the DR is a joint initiative of the U.S. Embassy in Santo Domingo and the Dominican Ministry of Higher Education, Science and Technology (MESCYT) and adds funding for up to 10 …

English As A Foreign Language Preservice Teachers’ Technology Integration In Teaching Speaking Skills: A Study From Indonesia, I Putu Indra Kusuma

Dissertations

The novel coronavirus, namely COVID-19, has drastically forced schools and universities around the globe to implement emergency remote teaching (henceforth, ERT) in online forms. During this ERT, the personal computer, internet-accessible devices, and computer programs have expanded the opportunities of language learners to obtain more authentic materials and learning experiences. Moreover, technology enables students to record and store their speaking performance in digital forms, accommodating a new reform in English language teaching. Very little is known about how English as a foreign language (henceforth, EFL) preservice teachers, especially student teachers, implement technology in teaching speaking skills during their practice teaching. …

Three Essays On Us Phd Education And Applications Of Machine Learning Methods, Qing Zang

Dissertations

This study mainly talks about U.S. PhD education and applications of machine learning methods. On one hand, PhD education, as a way to cultivate future researchers, attracts a lot of attention. On the other hand, machine learning methods are utilized more and more often in academic research. This study, as an attempt, would like to contribute to these two fields. The first essay discusses whether education can reduce and eliminate discrimination. By using the data of PhD recipients’ earning in the U.S., we investigate if PhD education can shrink the earning gaps in three groups: Female vs male, disabled vs …

Journal Of Communication Pedagogy, Complete Volume 5, 2021

Journal of Communication Pedagogy

No abstract provided.