Educational Assessment, Evaluation, and Research Commons^™

Learning At Scale As Infrastructure: Lms Platforms, Data Pipelines, And Language-Based Evidence For Educational Measurement, Danielle S. Mcnamara, Michelle Banawan, Renu Balyan, Rod D. Roscoe, Tracy Arner

Chinese/English Journal of Educational Measurement and Evaluation | 教育测量与评估双语期刊

The increasing scale of digital learning environments has transformed the data available for educational measurement, learning analytics, and the learning sciences. However, learning at scale is often treated as a matter of sample size or novel analytic methods rather than as the outcome of institutional infrastructure that governs how learning data are generated, curated, transformed, and accessed. This paper offers an infrastructure-centered description of learning at scale, focusing on learning management systems (LMSs), platform-integrated tools, and data pipelines that produce research-ready educational data. As an illustrative exemplar, we draw on the design and operation of the Arizona State University Learning@Scale …

International Measures Of Student Growth In Mathematics And Science Achievement: The Timss 2023 Longitudinal International Database, Bethany Fishbein, Ummugul Bezirhan, Matthias Von Davier

Chinese/English Journal of Educational Measurement and Evaluation | 教育测量与评估双语期刊

The TIMSS 2023 Longitudinal International Database represents a major advancement in international large-scale assessment by providing the first student-level longitudinal extension of TIMSS. By linking achievement and contextual data from TIMSS 2023 with a follow-up data collection in 2024, the database enables direct measurement of student growth in mathematics and science over one year of schooling. The study follows cohorts from Grades 4 to 5 and Grades 8 to 9 across participating education systems. Rich contextual, curriculum, and process data support investigations into how instructional practices, system-level policies, student attitudes, and test-taking behaviors relate to learning trajectories. As a freely …

The Item Response Warehouse: What It Is, How To Use It, And Targets For Potential Improvements, Savira D. Nadela, Hansol Lee, Nishka Jain, Ayaan Gupta, Xingyi Zhang, Benjamin W. Domingue

Chinese/English Journal of Educational Measurement and Evaluation | 教育测量与评估双语期刊

The Item Response Warehouse (IRW) is a repository of harmonized item response datasets designed to support secondary analysis and methodological research in psychological and educational measurement. This paper serves as a practical guide for researchers interested in using the IRW. We describe the structure of IRW datasets and the quantitative and qualitative metadata available for dataset selection, and we demonstrate how researchers can navigate the IRW website to explore and compare available tables. We further show how the IRW R and Python packages can be used to filter datasets programmatically, download response-level data, and generate standardized citations for reproducible research …

Implementing Retrieval And Distributed Practice In A Rotating Block Schedule: Boosting Students’ Memory And Metacognition, Terra A. Caputo, Kaitlyn C. Hoffmann, Cindy Reagan, Guy D. Savastano, Brandon J. Foster, Kathryn Hallal, Kristin Miller-Gecsi, Thomas A. Yarcusko

Journal of Catholic Education

An all-boys secondary Jesuit Catholic school in the Midwest, recently transitioned to a rotating block schedule with the goal of supporting deeper learning for all students. Though the transition to longer class meetings helped achieve this goal, less frequent class meetings presented a new challenge in that it tended to exacerbate the natural “forgetting curve.” Retrieval practice, one of the most widely cited high-impact learning strategies to boost student memory, is most beneficial when used alongside spaced practice. A team of teachers implemented and tested the impacts of retrieval and distributed practice on memory in a rotating block schedule. Our …

Navigating Feedback In Collaborative Writing: The Impact Of Student Backgrounds And Expectations On Transitions To New Academic And Social Spaces, Lindsey Gruber, María Fernández–Agüero

Journal of Response to Writing

This article examines how international students navigate feedback from a supervisor while working on a group writing project in a diverse English medium of instruction (EMI) bachelor’s program at a public university in Denmark, where no formalized writing or language support resources are offered in the students’ first year of instruction. Data were collected in qualitative, semi-structured interviews with 11 students who were identified through a survey of a first-year bachelor of arts cohort. Results from the survey showed that despite using a supervision model of education, few students perceived changes in feedback compared to their secondary school experiences, and …

Future = Ai + Database: Educator’S Perspective On Ai Usage Within K-12 Classrooms, Seung Ho Jeon

Create@State

The integration of Artificial Intelligence (AI) tools in education is generating both opportunities and governance for K-12 systems across the United States. Conducted in collaboration with the Arkansas Department of Higher Education, this study examines educators’ perspectives on AI use in classrooms across multiple Arkansas school districts. The purpose is to inform the development of policy and oversight frameworks at the state and district levels. Educators completed an IRB-approved survey evaluating AI across five domains: instructional and administrative benefits, classroom concerns and potential downsides, trust and ethical considerations, governance and oversight structures, and professional support and training needs. Responses were …

A Performance And Quality Improvement Intervention Integrating Molecular Testing To Support Personalized Cancer Care In Lung And Thyroid Cancers, Suzanne Murray, Monica Augustyniak, John Vu, Elbert Y. Kuo, Manolo G. Pasia Jr., Sheri L. Rivera, Kelly M. Rodriguez, Vivek Subbiah, Patrice Lazure, Ecaterina E. Dumbrava

Advances in Cancer Education and Quality Improvement

Introduction: Molecular testing has been underutilized in the diagnosis and treatment of cancer patients, despite its potential to significantly impact clinical decision-making and resulting health outcomes.

Objectives: This project aimed to evaluate the process and impact of a performance/quality improvement (PI/QI) intervention to optimize the integration of molecular testing for patients with non-small cell lung cancer (NSCLC) or thyroid cancer (TC).

Methods: Physicians, advanced practice providers, and nurses were engaged in the PI/QI at 2 cancer centers (Site A and Site B) for up to 18 months following a pre-intervention needs assessment. Gaps identified at baseline informed …

Pembangunan Instrumen Literasi Pentaksiran Bilik Darjah Guru Bahasa Arab Di Sekolah Menengah, Norazida Ibrahim

Student Works (2020-2029)

Current educational transformations demand a paradigm shift from exam-oriented assessment to a more holistic Classroom-Based Assessment (CBA). However, the effectiveness of this implementation is limited by the absence of specific and validated instruments to measure CBA literacy within the context of Arabic language education in Malaysia. This gap results in the actual competency levels of teachers in this field being difficult to determine objectively, subsequently complicating the planning of precise professional development. Therefore, this study aims to develop and validate the Arabic Language Teacher’s Classroom Assessment Literacy (ALaTCAL) instrument based on Wilson’s (2005) Four-Building Blocks Model. The instrument encompasses the …

Teaching With S2scc-Ai: A Practical Framework For Sport Management Classrooms, Kimberly D. Bynum, Wendy T. Gillis

The COSMA Journal

ABSTRACT

Generative artificial intelligence (AI) technologies, including tools such as ChatGPT, Claude, and Perplexity, are radically changing how higher ed students approach their college learning experience. These shifts are especially impactful in undergraduate sport management programs, where employers expect graduates to demonstrate teamwork, critical thinking and digital literacy skills. As AI becomes embedded across sport industry functions such as event operations, marketing, analytics, and fan engagement, higher ed pedagogy must evolve to reflect the professional contexts students are preparing to enter. In this paper, Student-to-Student Co-Creation enhanced by AI (S2SCC-AI) is advanced as a practical, COSMA-aligned pedagogical framework for leveraging …

Investigating Racial Bias And Attribution Error In Grading Student Performance, Tony Reibel, Rachel Roegman

Mid-Western Educational Researcher

Standards-based grading (SBG) is a relatively recent alternative model of grading designed to increase the reliability of grading while reducing the influence of teacher biases that can distort student evaluations. This study investigated whether SBG mitigates race‑related bias and attribution errors through a mixed‑methods 3×2 factorial vignette experiment with in‑service teachers. A total of 219 teachers scored the same student essay using a common SBG rubric and provided a 1-4 proficiency score, a binary evaluation concerning success criteria and written feedback. “Learning profiles”– a description of the student’s current and past abilities – varied by tone (positive, negative, none: name-only) …

Managing The "Trauma Dump" In Personal Statement Writing, Faith Kurtyka, Amelia Harahap

Feminist Pedagogy

This critical commentary offers methods for helping students who may "trauma dump" in personal statements learn to write their stories for a wide audience in a way that preserves the writer's dignity.

Editorial: Academic Freedom: Embracing Diverse Voices, Margaret Grogan, Peter Tolmie, Jane Freedman, Scott Schaffer, John Offer, Andrea M. Feldpausch-Parker

Education Faculty Articles and Research

"The articles assembled in this Research Topic (RT) offer a timely discussion of a fundamental principle upon which both scientific endeavor and higher education are founded: academic freedom. While there is no single accepted definition of academic freedom, most scholars accept that there are three basic dimensions: the freedom to research in a scientifically agreed-upon and rigorous fashion; the freedom to express academic points of view; and the freedom to educate and to learn (Maassen et al., 2023). In this RT, the first and second of these dimensions are effectively grouped together around an interest in the latitude for scholars …

The Road To Senior Leadership: Senior-Level Administrative Women Leaders In Division I Intercollegiate Athletic Departments, Susan E. Richard

Electronic Theses and Dissertations 2020 - Present

This qualitative narrative study examined the career pathways and lived leadership experiences of women serving in senior-level administrative roles within Division I intercollegiate athletics, a traditionally male-dominated industry. Guided by a crucible leadership framework, the study explored how formative experiences shaped participants’ leadership development, professional advancement, and persistence. Nine women who currently or previously served as senior-level administrative leaders participated in the study. Data were collected using an adapted version of Seidman’s three-interview series, supplemented by document analysis and a demographic survey to support triangulation. Interviews were organized into three phases to chronologically capture participants’ career trajectories.

The findings are …

Lessons From The Field On The Science Of Reading: School And Classroom Stories Across Contexts

Occasional Paper Series

No abstract provided.

Bank Street School For Children’S Story Of Integrating Structured Phonics Into A Progressive Literacy Approach, Melanie Bryon, Douglas R. Knecht, Emily Linsay, Emily Schottland

Occasional Paper Series

This article explores how the Bank Street School for Children (SFC), a historically progressive institution rooted in child-centered, experiential learning, has successfully integrated structured phonics into its literacy program. Traditionally focused on whole language practices, SFC recognized inconsistencies in student reading outcomes and, beginning in 2017 undertook a multi-year evaluation of its literacy approach. Guided by the core values of child development and equity, and research in cognitive science, the school adopted a research-based phonics program, implementing it across Kindergarten through fourth grade over multiple years. This shift aimed to ensure all students—not just those with strong language backgrounds—gain the …

Thinking Narratively About Science Of Reading Forces, Moral Injury, And Teacherhood, Kyle C. Arlington

Occasional Paper Series

Stories of teachers’ classroom lives shape the public imagination of what it means to be a “good teacher,” yet these narratives are always partial, contextual, and entangled with broader cultural and institutional forces. This research essay narratively explores the experiences of Lisa, a veteran literacy teacher navigating Science of Reading (SoR) mandates in her elementary classroom. It examines how her identities, values, and visions for literacy teaching intersect with the discursive, material, and affective dynamics that shape how SoR unfolds in the context of Lisa’s classroom life. (Re)storying her experiences draws attention to the emotional toll and moral dissonance teachers …

All Flourishing Is Mutual: Cultivating A Gift Economy Of Literacy, Lindsey Lush, Melissa Kurtz

Occasional Paper Series

In this paper, two scholars and practicing elementary educators argue that the policies and practices of the Science of Reading (SoR) movement in early literacy education are being constructed with the logic of a market economy, shaped by neoliberal ideologies of individualism, scarcity, and competition. Compelled by our concerns for the bodies and beings of readers and reading teachers in the context of our Northeast Georgia public elementary school and provoked by our shared engagement with The Serviceberry, Indigenous scientist and scholar Robin Wall Kimmerer’s book on lessons from the natural world, we engage a postqualitative approach to emergent, relational …

When Science Of Reading Policy Meets Classroom Reality: The Nonsense Word Problem, Lisa Dewing-Birno, Luis Lopez

Occasional Paper Series

A central feature of many Science of Reading (SoR)-aligned curricula is the use of nonsense words in early literacy assessment to measure a student's ability to decode unfamiliar words using knowledge of letter-sound correspondences. However, the research base for using nonsense words as an instructional tool is much weaker and more contested. Through two narratives, we illustrate how the implementation of SoR instruction with nonsense words can be particularly problematic. We argue that effective literacy instruction demands what we call pedagogical clarity, the ability to integrate pedagogical practices with deep understanding of individual learners, their cultural and linguistic resources, and …

Uplifting The Legacy Of Black Teachers: Loving And Liberatory Pedagogies In A Science Of Reading Context, Natasha A. Thornton, Amanda L. Armstrong, Brooke Blacknall, Jordan Freeman, Elaine Nevers-Williams, Mukkaramah Smith

Occasional Paper Series

This article explores Black liberatory pedagogy (BLP) as a critical approach to navigating current Science of Reading (SoR) mandates, which are often restrictive and fail to honor the literacies and linguistic practices of Black children. Through the narratives of six educators—classroom teachers, teacher candidates, and teacher educators—the article examines how they have experienced and responded to the implementation of SoR standards and curriculum shifts. These stories also illuminate what becomes possible when teachers are in spaces that allow for autonomy, imagination, and culturally responsive pedagogy. The educators’ experiences, expertise, and cultural wisdom are centered, demonstrating how they enact BLP through …

Lessons From The Field On The Science Of Reading: An Introduction, Gail Boldt, Patricia Enciso

Occasional Paper Series

No abstract provided.