Educational Assessment, Evaluation, and Research Commons^™

Writing As A Process Of Inquiry In Autoethnography For Meaning-Making: Reflections And Some Points For Consideration, Niroj Dahal

The Qualitative Report

This article explores writing as a process of inquiry and meaning-making in the autoethnographic tradition, offering reflections on the recursive, emergent, and dialogical/dialectical nature of writing, along with some points for consideration. Drawing on perspectives from qualitative research and narrative inquiry (Riessman, 2008), I argue that autoethnographic writing serves as a method of inquiry and/or discovery, generating ontological, epistemological, and axiological-driven cultural meaning that functions as a site of reflection, interrogation, and re-storying of lived experiences. This recursive, often messy, and reflexive act allows researchers to excavate, analyze, and interpret their lived experiences. Rather than viewing writing as a final-stage …

Numeracy-Based Civic Education Model: Needs Analysis Through An Explanatory Sequential Design, Sulkipani Sulkipani, Kokom Komalasari, Sapriya Sapriya, Susan Fitriasari, Vina Amilia Suganda Makenun

Numeracy

The United Nations Sustainable Development Goals emphasize numeracy as essential for quality education, and require its integration across the curriculum, including into civic education (CE). However, the integration of numeracy in CE in Indonesian universities has not yet been clearly mapped out. This study aims to analyze the need for numeracy integration in CE as a basis for developing a numeracy-based CE learning model. Using a mixed method with an explanatory sequential design, the study involved a convenience sample of 225 students and 10 lecturers from various universities through surveys, interviews, observations, and documentation studies. Quantitative findings show that numeracy …

The Impact Of The Accelerated Model Pathways For Information Technology (Amp-It) Initiative, Meagan Mitchell Phd

Reports, Analyses, and other Publications

This report from Education Systems Center details the impact and strategic outcomes of the Accelerated Model Pathways for Information Technology (AMP-IT) initiative. Launched to strengthen Illinois' IT talent pipeline, the initiative focuses on expanding dual credit coursework, work-based learning, and strategic partnerships between school districts, higher education, and industry.

Don’T Tell Me How To Fact-Check; Show Me, And Let Me Try! A Media Literacy Intervention With Sixth-Graders, Thomas Nygren, Carl-Anton Werner Axelsson

Journal of Media Literacy Education

This study examines how different educational approaches related to "Fria Ordets Dag" (Free Speech Day), a media literacy program by the Swedish public service, affect the ability of 859 sixth-graders to evaluate news and misinformation. Findings indicate that verbal instructions from a professional fact-checker and animations to model online fact-checking were less effective than demonstrative, authentic video tutorials. Feedback and practice were also important. The intervention yielded mixed outcomes on students’ attitudes towards credible news sources, pointing to the necessity for educational designs that bolster fact-checking and source trust. The research emphasizes how large-scale school interventions to promote students’ navigation …

Equity And Participation In Careers Education: Insights From Australian Year 10 Students, Kylie Hillman, Ben Edwards, Daniel Edwards, Ali Radloff, Jessica Arnup

Vocational, adult and professional education research

Navigating pathways into education, training, and the workforce has always been challenging for young people. With the growing complexity of the world of work and varied post-secondary education pathways, providing support and guidance is crucial. In Australia, national policies such as the Australian Blueprint for Career Development, National Career Development Strategy, and the National Career Education Strategy aim to support young people's career readiness. Despite the acknowledged importance of careers education, there is limited national reporting on its current state in Australian secondary schools. This article explores the experiences of over 15,000 Year 10 students in Australian schools, using data …

Student Perspectives On Grading In Higher Education Stem Courses, Christopher Sean Burns, Daniela D.S. Digiacomo, Jennifer Pusateri, Katherine Ritchie, Christine Wusylko

Information Science Faculty Publications

Purpose

Despite a growing awareness of instructional practices that support student learning and well-being, higher education classrooms tend to still be dominated by the use of rigid approaches to assessment and course design. This study aims to understand the experiences of students in courses that implement a universal design for learning (UDL) pedagogical approach and an ungrading assessment approach. Design/methodology/approach

Leveraging a qualitative methodological approach, authors interviewed 13 graduate students in two library and information science technology courses and 11 undergraduate students in a computer science course in discrete mathematics about their experiences with ungrading within the context of UDL-designed …

Learning At Scale As Infrastructure: Lms Platforms, Data Pipelines, And Language-Based Evidence For Educational Measurement, Danielle S. Mcnamara, Michelle Banawan, Renu Balyan, Rod D. Roscoe, Tracy Arner

Chinese/English Journal of Educational Measurement and Evaluation | 教育测量与评估双语期刊

The increasing scale of digital learning environments has transformed the data available for educational measurement, learning analytics, and the learning sciences. However, learning at scale is often treated as a matter of sample size or novel analytic methods rather than as the outcome of institutional infrastructure that governs how learning data are generated, curated, transformed, and accessed. This paper offers an infrastructure-centered description of learning at scale, focusing on learning management systems (LMSs), platform-integrated tools, and data pipelines that produce research-ready educational data. As an illustrative exemplar, we draw on the design and operation of the Arizona State University Learning@Scale …

International Measures Of Student Growth In Mathematics And Science Achievement: The Timss 2023 Longitudinal International Database, Bethany Fishbein, Ummugul Bezirhan, Matthias Von Davier

Chinese/English Journal of Educational Measurement and Evaluation | 教育测量与评估双语期刊

The TIMSS 2023 Longitudinal International Database represents a major advancement in international large-scale assessment by providing the first student-level longitudinal extension of TIMSS. By linking achievement and contextual data from TIMSS 2023 with a follow-up data collection in 2024, the database enables direct measurement of student growth in mathematics and science over one year of schooling. The study follows cohorts from Grades 4 to 5 and Grades 8 to 9 across participating education systems. Rich contextual, curriculum, and process data support investigations into how instructional practices, system-level policies, student attitudes, and test-taking behaviors relate to learning trajectories. As a freely …

The Item Response Warehouse: What It Is, How To Use It, And Targets For Potential Improvements, Savira D. Nadela, Hansol Lee, Nishka Jain, Ayaan Gupta, Xingyi Zhang, Benjamin W. Domingue

Chinese/English Journal of Educational Measurement and Evaluation | 教育测量与评估双语期刊

The Item Response Warehouse (IRW) is a repository of harmonized item response datasets designed to support secondary analysis and methodological research in psychological and educational measurement. This paper serves as a practical guide for researchers interested in using the IRW. We describe the structure of IRW datasets and the quantitative and qualitative metadata available for dataset selection, and we demonstrate how researchers can navigate the IRW website to explore and compare available tables. We further show how the IRW R and Python packages can be used to filter datasets programmatically, download response-level data, and generate standardized citations for reproducible research …

Implementing Retrieval And Distributed Practice In A Rotating Block Schedule: Boosting Students’ Memory And Metacognition, Terra A. Caputo, Kaitlyn C. Hoffmann, Cindy Reagan, Guy D. Savastano, Brandon J. Foster, Kathryn Hallal, Kristin Miller-Gecsi, Thomas A. Yarcusko

Journal of Catholic Education

An all-boys secondary Jesuit Catholic school in the Midwest, recently transitioned to a rotating block schedule with the goal of supporting deeper learning for all students. Though the transition to longer class meetings helped achieve this goal, less frequent class meetings presented a new challenge in that it tended to exacerbate the natural “forgetting curve.” Retrieval practice, one of the most widely cited high-impact learning strategies to boost student memory, is most beneficial when used alongside spaced practice. A team of teachers implemented and tested the impacts of retrieval and distributed practice on memory in a rotating block schedule. Our …

Navigating Feedback In Collaborative Writing: The Impact Of Student Backgrounds And Expectations On Transitions To New Academic And Social Spaces, Lindsey Gruber, María Fernández–Agüero

Journal of Response to Writing

This article examines how international students navigate feedback from a supervisor while working on a group writing project in a diverse English medium of instruction (EMI) bachelor’s program at a public university in Denmark, where no formalized writing or language support resources are offered in the students’ first year of instruction. Data were collected in qualitative, semi-structured interviews with 11 students who were identified through a survey of a first-year bachelor of arts cohort. Results from the survey showed that despite using a supervision model of education, few students perceived changes in feedback compared to their secondary school experiences, and …

Future = Ai + Database: Educator’S Perspective On Ai Usage Within K-12 Classrooms, Seung Ho Jeon

Create@State

The integration of Artificial Intelligence (AI) tools in education is generating both opportunities and governance for K-12 systems across the United States. Conducted in collaboration with the Arkansas Department of Higher Education, this study examines educators’ perspectives on AI use in classrooms across multiple Arkansas school districts. The purpose is to inform the development of policy and oversight frameworks at the state and district levels. Educators completed an IRB-approved survey evaluating AI across five domains: instructional and administrative benefits, classroom concerns and potential downsides, trust and ethical considerations, governance and oversight structures, and professional support and training needs. Responses were …

A Performance And Quality Improvement Intervention Integrating Molecular Testing To Support Personalized Cancer Care In Lung And Thyroid Cancers, Suzanne Murray, Monica Augustyniak, John Vu, Elbert Y. Kuo, Manolo G. Pasia Jr., Sheri L. Rivera, Kelly M. Rodriguez, Vivek Subbiah, Patrice Lazure, Ecaterina E. Dumbrava

Advances in Cancer Education and Quality Improvement

Introduction: Molecular testing has been underutilized in the diagnosis and treatment of cancer patients, despite its potential to significantly impact clinical decision-making and resulting health outcomes.

Objectives: This project aimed to evaluate the process and impact of a performance/quality improvement (PI/QI) intervention to optimize the integration of molecular testing for patients with non-small cell lung cancer (NSCLC) or thyroid cancer (TC).

Methods: Physicians, advanced practice providers, and nurses were engaged in the PI/QI at 2 cancer centers (Site A and Site B) for up to 18 months following a pre-intervention needs assessment. Gaps identified at baseline informed …

Pembangunan Instrumen Literasi Pentaksiran Bilik Darjah Guru Bahasa Arab Di Sekolah Menengah, Norazida Ibrahim

Student Works (2020-2029)

Current educational transformations demand a paradigm shift from exam-oriented assessment to a more holistic Classroom-Based Assessment (CBA). However, the effectiveness of this implementation is limited by the absence of specific and validated instruments to measure CBA literacy within the context of Arabic language education in Malaysia. This gap results in the actual competency levels of teachers in this field being difficult to determine objectively, subsequently complicating the planning of precise professional development. Therefore, this study aims to develop and validate the Arabic Language Teacher’s Classroom Assessment Literacy (ALaTCAL) instrument based on Wilson’s (2005) Four-Building Blocks Model. The instrument encompasses the …

Teaching With S2scc-Ai: A Practical Framework For Sport Management Classrooms, Kimberly D. Bynum, Wendy T. Gillis

The COSMA Journal

ABSTRACT

Generative artificial intelligence (AI) technologies, including tools such as ChatGPT, Claude, and Perplexity, are radically changing how higher ed students approach their college learning experience. These shifts are especially impactful in undergraduate sport management programs, where employers expect graduates to demonstrate teamwork, critical thinking and digital literacy skills. As AI becomes embedded across sport industry functions such as event operations, marketing, analytics, and fan engagement, higher ed pedagogy must evolve to reflect the professional contexts students are preparing to enter. In this paper, Student-to-Student Co-Creation enhanced by AI (S2SCC-AI) is advanced as a practical, COSMA-aligned pedagogical framework for leveraging …

Investigating Racial Bias And Attribution Error In Grading Student Performance, Tony Reibel, Rachel Roegman

Mid-Western Educational Researcher

Standards-based grading (SBG) is a relatively recent alternative model of grading designed to increase the reliability of grading while reducing the influence of teacher biases that can distort student evaluations. This study investigated whether SBG mitigates race‑related bias and attribution errors through a mixed‑methods 3×2 factorial vignette experiment with in‑service teachers. A total of 219 teachers scored the same student essay using a common SBG rubric and provided a 1-4 proficiency score, a binary evaluation concerning success criteria and written feedback. “Learning profiles”– a description of the student’s current and past abilities – varied by tone (positive, negative, none: name-only) …

Managing The "Trauma Dump" In Personal Statement Writing, Faith Kurtyka, Amelia Harahap

Feminist Pedagogy

This critical commentary offers methods for helping students who may "trauma dump" in personal statements learn to write their stories for a wide audience in a way that preserves the writer's dignity.

Editorial: Academic Freedom: Embracing Diverse Voices, Margaret Grogan, Peter Tolmie, Jane Freedman, Scott Schaffer, John Offer, Andrea M. Feldpausch-Parker

Education Faculty Articles and Research

"The articles assembled in this Research Topic (RT) offer a timely discussion of a fundamental principle upon which both scientific endeavor and higher education are founded: academic freedom. While there is no single accepted definition of academic freedom, most scholars accept that there are three basic dimensions: the freedom to research in a scientifically agreed-upon and rigorous fashion; the freedom to express academic points of view; and the freedom to educate and to learn (Maassen et al., 2023). In this RT, the first and second of these dimensions are effectively grouped together around an interest in the latitude for scholars …

The Road To Senior Leadership: Senior-Level Administrative Women Leaders In Division I Intercollegiate Athletic Departments, Susan E. Richard

Electronic Theses and Dissertations 2020 - Present

This qualitative narrative study examined the career pathways and lived leadership experiences of women serving in senior-level administrative roles within Division I intercollegiate athletics, a traditionally male-dominated industry. Guided by a crucible leadership framework, the study explored how formative experiences shaped participants’ leadership development, professional advancement, and persistence. Nine women who currently or previously served as senior-level administrative leaders participated in the study. Data were collected using an adapted version of Seidman’s three-interview series, supplemented by document analysis and a demographic survey to support triangulation. Interviews were organized into three phases to chronologically capture participants’ career trajectories.

The findings are …

Bank Street School For Children’S Story Of Integrating Structured Phonics Into A Progressive Literacy Approach, Melanie Bryon, Douglas R. Knecht, Emily Linsay, Emily Schottland

Occasional Paper Series

This article explores how the Bank Street School for Children (SFC), a historically progressive institution rooted in child-centered, experiential learning, has successfully integrated structured phonics into its literacy program. Traditionally focused on whole language practices, SFC recognized inconsistencies in student reading outcomes and, beginning in 2017 undertook a multi-year evaluation of its literacy approach. Guided by the core values of child development and equity, and research in cognitive science, the school adopted a research-based phonics program, implementing it across Kindergarten through fourth grade over multiple years. This shift aimed to ensure all students—not just those with strong language backgrounds—gain the …

Lessons From The Field On The Science Of Reading: School And Classroom Stories Across Contexts

Occasional Paper Series

No abstract provided.

Thinking Narratively About Science Of Reading Forces, Moral Injury, And Teacherhood, Kyle C. Arlington

Occasional Paper Series

Stories of teachers’ classroom lives shape the public imagination of what it means to be a “good teacher,” yet these narratives are always partial, contextual, and entangled with broader cultural and institutional forces. This research essay narratively explores the experiences of Lisa, a veteran literacy teacher navigating Science of Reading (SoR) mandates in her elementary classroom. It examines how her identities, values, and visions for literacy teaching intersect with the discursive, material, and affective dynamics that shape how SoR unfolds in the context of Lisa’s classroom life. (Re)storying her experiences draws attention to the emotional toll and moral dissonance teachers …

All Flourishing Is Mutual: Cultivating A Gift Economy Of Literacy, Lindsey Lush, Melissa Kurtz

Occasional Paper Series

In this paper, two scholars and practicing elementary educators argue that the policies and practices of the Science of Reading (SoR) movement in early literacy education are being constructed with the logic of a market economy, shaped by neoliberal ideologies of individualism, scarcity, and competition. Compelled by our concerns for the bodies and beings of readers and reading teachers in the context of our Northeast Georgia public elementary school and provoked by our shared engagement with The Serviceberry, Indigenous scientist and scholar Robin Wall Kimmerer’s book on lessons from the natural world, we engage a postqualitative approach to emergent, relational …

When Science Of Reading Policy Meets Classroom Reality: The Nonsense Word Problem, Lisa Dewing-Birno, Luis Lopez

Occasional Paper Series

A central feature of many Science of Reading (SoR)-aligned curricula is the use of nonsense words in early literacy assessment to measure a student's ability to decode unfamiliar words using knowledge of letter-sound correspondences. However, the research base for using nonsense words as an instructional tool is much weaker and more contested. Through two narratives, we illustrate how the implementation of SoR instruction with nonsense words can be particularly problematic. We argue that effective literacy instruction demands what we call pedagogical clarity, the ability to integrate pedagogical practices with deep understanding of individual learners, their cultural and linguistic resources, and …

Uplifting The Legacy Of Black Teachers: Loving And Liberatory Pedagogies In A Science Of Reading Context, Natasha A. Thornton, Amanda L. Armstrong, Brooke Blacknall, Jordan Freeman, Elaine Nevers-Williams, Mukkaramah Smith

Occasional Paper Series

This article explores Black liberatory pedagogy (BLP) as a critical approach to navigating current Science of Reading (SoR) mandates, which are often restrictive and fail to honor the literacies and linguistic practices of Black children. Through the narratives of six educators—classroom teachers, teacher candidates, and teacher educators—the article examines how they have experienced and responded to the implementation of SoR standards and curriculum shifts. These stories also illuminate what becomes possible when teachers are in spaces that allow for autonomy, imagination, and culturally responsive pedagogy. The educators’ experiences, expertise, and cultural wisdom are centered, demonstrating how they enact BLP through …

Lessons From The Field On The Science Of Reading: An Introduction, Gail Boldt, Patricia Enciso

Occasional Paper Series

No abstract provided.

Assessing Scientific Literacy And Applied Anatomy Across The Biology Curriculum, Ash Heim, Vera Mcilvain

One University Assessment Celebration

No abstract provided.

Building A Sustainable Culture Of Assessment In Mae, Ben Akih Kumgeh, Xiyuan Liu, Karen Martinez Soto, Anupam Pandey, Mehmet Sarimurat

One University Assessment Celebration

No abstract provided.

Nutrition Science Graduate Students Engage In Assessment Practices In An Accredited Program, Claire Cooney, Nikki Beckwith

One University Assessment Celebration

No abstract provided.

Assessing The Art Of Directing Amahl And The Night Visitors, Klark Johnson

One University Assessment Celebration

No abstract provided.