Educational Assessment, Evaluation, and Research Commons^™

Evaluating The Impact Of The Kentucky Read To Achieve (Rta) Initiative On School Reading Performance, Nicholas Gage, Erin Hogan, Todd Whitney, Terrance M. Scott, Amy S. Lingo

Kentucky Teacher Education Journal: The Journal of the Teacher Education Division of the Kentucky Council for Exceptional Children

Kentucky reading achievement has remained below statewide goals, which prompted a revision to the Read to Achieve (RTA) initiative, a state-level grant-funded program aimed at improving student literacy outcomes. The revision prioritized the professional learning of administrators and K-3 reading instructional staff in the science of reading and the adoption of high-quality structured literacy-based resources and aligned intervention resources. This study uses nine years of panel data (2014–2015 through 2023–2024) from all public schools in Kentucky to evaluate whether the revised RTA initiative had a differential effect on school-level reading outcomes. We employ propensity score matching and a heterogeneous difference-in-differences …

Layers Of Representation: A Multidimensional Book Analysis, Mariah Pfundheller, Nikki Logan, Amy E. Lein, Sydney Bueno

Kentucky Teacher Education Journal: The Journal of the Teacher Education Division of the Kentucky Council for Exceptional Children

This study evaluates how educators interpret the Multidimensional Framework for Inclusive Literature (MDFIL), a tool for evaluating and selecting multicultural literature for their classrooms. Participants self-identified as current, former/retired, or student teachers, or as undergraduates pursuing a teaching license at the time of the survey. Incorporating multicultural literature into educational settings has a positive impact on children's development. Multicultural literature fosters feelings of acceptance, cultural awareness, and empathy among students. By exposing children to diverse cultural perspectives, multicultural literature not only enhances their understanding of their own identities but also cultivates a greater appreciation of others' experiences. The benefits of …

Pa 146: What Is Clear, What Is Fuzzy, And What Should We Do Next?, Jenelle Williams, Nicole Peterson

Michigan Reading Journal

Michigan’s Public Act 146 (PA 146), the state’s K–12 Literacy and Dyslexia Law, establishes new requirements for screening, evidence-based instruction, structured literacy practices, professional learning, and strengthened multi-tiered systems of support to improve reading outcomes. While the law provides detailed and prescriptive guidance for elementary schools—particularly regarding decoding-focused instruction aligned to the science of reading, universal screening, and intervention planning—its implications for grades 4–12 are less clearly defined. This article examines what is explicit in the legislation, what remains open to interpretation in secondary contexts, and how districts can move forward strategically as they prepare for full implementation by 2027–2028. …

Bank Street School For Children’S Story Of Integrating Structured Phonics Into A Progressive Literacy Approach, Melanie Bryon, Douglas R. Knecht, Emily Linsay, Emily Schottland

Occasional Paper Series

This article explores how the Bank Street School for Children (SFC), a historically progressive institution rooted in child-centered, experiential learning, has successfully integrated structured phonics into its literacy program. Traditionally focused on whole language practices, SFC recognized inconsistencies in student reading outcomes and, beginning in 2017 undertook a multi-year evaluation of its literacy approach. Guided by the core values of child development and equity, and research in cognitive science, the school adopted a research-based phonics program, implementing it across Kindergarten through fourth grade over multiple years. This shift aimed to ensure all students—not just those with strong language backgrounds—gain the …

All Flourishing Is Mutual: Cultivating A Gift Economy Of Literacy, Lindsey Lush, Melissa Kurtz

Occasional Paper Series

In this paper, two scholars and practicing elementary educators argue that the policies and practices of the Science of Reading (SoR) movement in early literacy education are being constructed with the logic of a market economy, shaped by neoliberal ideologies of individualism, scarcity, and competition. Compelled by our concerns for the bodies and beings of readers and reading teachers in the context of our Northeast Georgia public elementary school and provoked by our shared engagement with The Serviceberry, Indigenous scientist and scholar Robin Wall Kimmerer’s book on lessons from the natural world, we engage a postqualitative approach to emergent, relational …

When Science Of Reading Policy Meets Classroom Reality: The Nonsense Word Problem, Lisa Dewing-Birno, Luis Lopez

Occasional Paper Series

A central feature of many Science of Reading (SoR)-aligned curricula is the use of nonsense words in early literacy assessment to measure a student's ability to decode unfamiliar words using knowledge of letter-sound correspondences. However, the research base for using nonsense words as an instructional tool is much weaker and more contested. Through two narratives, we illustrate how the implementation of SoR instruction with nonsense words can be particularly problematic. We argue that effective literacy instruction demands what we call pedagogical clarity, the ability to integrate pedagogical practices with deep understanding of individual learners, their cultural and linguistic resources, and …

The Impact Of The Alabama Literacy Act On Rural Third-Grade Students, Autumn F. Blalock

College of Education

Low third-grade reading proficiency rates in Alabama prompted the passage of the Alabama Literacy Act (ALA) in 2019, which mandates systematic, explicit literacy instruction grounded in the Science of Reading. While the Act represents a substantial shift in instructional practice and state education policy, limited empirical research has examined its impact across school contexts, particularly in rural settings. The purpose of this quantitative, quasi-experimental study was to examine whether third-grade reading proficiency rates changed following implementation of the ALA and to compare outcomes between rural and non-rural schools and among rural students by socioeconomic status. Guided by the Simple View …

Impacts Of Literacy Programming During The Covid-19 And Recovery School Years, Julie Meredith

The Rural Educator

While numerous articles and research reports have focused on understanding the impact of COVID-19 recovery interventions on students in urban and rural schools, fewer have addressed the impact of school closures and efforts to recover lost learning time on children in rural schools. Children in rural areas faced challenges similar to their peers in urban and suburban areas, but infrastructure challenges in many rural places, such as lack of broadband, required tailored approaches guided by educators’ knowledge and connection to their communities. This article examines the impact of Save the Children’s school-age literacy program, supported by 21st Century Community Learning …

Leadership And Literacy Assessment Systems: A Multi-Case Study Of System Coherence And Assessment Use In Mississippi Elementary Schools, Kristin P. Walters

Theses and Dissertations--Educational Leadership Studies

This qualitative embedded multiple-case study examined how school-level literacy leadership shaped the coherence and use of literacy assessment systems in five Mississippi Elementary Schools. Situated within the context of Mississippi’s recent literacy gains and the policy environment emerging from the Literacy-Based Promotion Act, this study explored how literacy leaders guide assessment systems to support coherence between literacy instruction and assessment practice.

Data were collected through semi-structured interviews with 25 educators across five elementary schools in different districts. Analysis was conducted using descriptive and values coding organized into an analysis matrix that facilitated within-case and cross-case exploration of patterns in distributed …

New Hampshire Tcap, Riley Lane

Honors Theses and Capstones

No abstract provided.

Advanced Literacies In The 21st Century: Examining A Narrative-Based Video Game As A Stealth Assessment For Comprehension, Joseph Paul Fiorentini

UNLV Theses, Dissertations, Professional Papers, and Capstones

In our technology-rich 21st Century, the need for valid, reliable, and fair literacy assessments remains pertinent to the field of education. This study defines literacy as advanced literacy where comprehension is considered a holistic product of applying acquired knowledge, skills, or abilities (KSA) to contextualized situations. Conventional assessment methods have traditionally parceled out the construct into its component parts (i.e., vocabulary, phonics, fluency, etc.) as a means of understanding the meaning making process from a traditional literacy perspective. Stealth assessments utilize the Evidence-Centered Design (ECD) framework as a robust method for assessing complex constructs holistically within technology rich environments. Adapting …

The Impact Of Pre-Kindergarten Programs On Literacy Achievement In Primary Grades In Rural Southeast Alabama Title I Schools, Courtney Sonntonya Thorton

Theses and Dissertations

The purpose of this study was to examine how pre-kindergarten impacts the literacy achievement of students in Alabama Title I schools. This quantitative study employed a causal-comparative (ex post facto) research design to examine the impact of Alabama’s First-Class Pre-K (FCPK) program on early literacy and school readiness, as measured by the Dynamic Indicators of Basic Early Literacy Skills (DIBELS) and the Alabama Early Learning Inventory (AL ELI). The design was selected due to its appropriateness for studying naturally occurring groups and its capacity to explore potential cause-and-effect relationships without researcher-controlled intervention.

The independent variable was Pre-K attendance (attendee vs. …

Virginia Literacy Act Expansion: Implications For Middle Schools, Candace Bechtold, Joan A. Rhodes, Valerie J. Robnolt, David B. Naff, Kendall Hunt, Jan Collins

MERC Publications

This MERC research and policy review focuses on expansion of the Virginia Literacy Act (VLA) to include support for middle school students across the Commonwealth. It explores three questions:

1. What were trends in middle school literacy prior to the VLA expansion?
2. What state policies exist for middle school literacy achievement?
3. What does research say about literacy intervention at the middle school level?

It concludes with a series of key takeaways and recommendations for middle school literacy policy and practice.

Learning Through Play At School Ukraine: Final Research Report (Ukrainian Version), Rachel Parker, Amy Berry, David Jeffries, Prue Anderson, Oksana Zabolotna

Student learning processes

The Learning Through Play (LTP) at School Research Study Ukraine was a four-year intervention study funded by the LEGO Foundation and implemented by the Australian Council for Educational Research (ACER) and the Ukrainian Educational Research Association (UERA). The intervention was a two-year professional learning program that blended online, and face-to-face learning called the Teacher Innovative Play Program (TIPP). The TIPP was designed based on documented evidence that reports that teachers need opportunities to experiment and reflect to change practice. The study was guided by three research questions which were revised following the full-scale invasion of Ukraine by Russian armed forces …

Learning Through Play At School: Ukraine, 2019-2024 (Ukrainian Version), Rachel Parker, Amy Berry, Kellie Picker, David Jeffries, Prue Anderson, Oksana Zabolotna

Student learning processes

The Learning Through Play at School Research Study Ukraine was a four-year longitudinal intervention study funded by the LEGO Foundation and implemented by the Australian Council for Educational Research (ACER) and the Ukrainian Educational Research Association (UERA). The study was implemented between 2019 and 2024, during COVID-19 and the full-scale invasion of Ukraine by Russian armed forces. Despite, at times, insurmountable challenges, the professional learning intervention was successful in supporting most teachers to progress from a surface level understanding of learning through play to a deep level. In addition, almost all children’s literacy and social-emotional skills grew significantly from start …

Learning Through Play At School Ukraine: Final Research Report, Rachel Parker, Amy Berry, Kellie Picker, David Jeffries, Prue Anderson, Oksana Zabolotna

Student learning processes

The Learning Through Play (LTP) at School Research Study Ukraine was a four-year intervention study funded by the LEGO Foundation and implemented by the Australian Council for Educational Research (ACER) and the Ukrainian Educational Research Association (UERA). The intervention was a two-year professional learning program that blended online, and face-to-face learning called the Teacher Innovative Play Program (TIPP). The TIPP was designed based on documented evidence that reports that teachers need opportunities to experiment and reflect to change practice. The study was guided by three research questions which were revised following the full-scale invasion of Ukraine by Russian armed forces …

Effects Of Emotional And Behavioral Disorders And Executive Dysfunction On Literacy Achievement: Through The Lens Of Secondary-Level Education, Natalie Deutsch

Student Research Poster Presentations 2024

The study examined the effects of emotional and behavioral disorders (E/BD) and executive dysfunction on literacy achievement in secondary-level education. The research questions focused on behavior interventions for at-risk students with behavioral disorders, the association between E/BD signs and reading deficits, incorporating executive functioning skills into reading instruction, and the positive and negative effects of self-contained classrooms on students with EBD. The study found that accommodating the specific needs of students with E/BD and executive dysfunction led to a statistically significant increase in mean test scores. The methods involved tiered intervention programs within the Units of Study curriculum, executive functioning …

Understanding The Virginia Literacy Act, Candace Bechtold, Kimberly Bridges, David Naff, Joan A. Rhodes, Valerie Robnolt, Tara Davison, Suzanne Alexandre, Michael Crusco, Karli Johansen, Amber Butler, Allison Yandle, Jennifer Askue-Collins, Jean Samuel, Sharrie Merritte, Regina Frazier

MERC Publications

This research and policy brief from the Metropolitan Educational Research Consortium (MERC) offers an overview of the Virginia Literacy Act. It is structured to explore the following questions: 1) What are the recent trends in reading achievement in Virginia? 2) What are the policy implications of the VLA for Virginia school divisions? 3) What does the research say about Science of Reading (SoR)? 4) What core instructional programs are approved to meet the VLA? It concludes with a series of key takeaways and recommendations.

Click here to listen to our podcast episode on the Virginia Literacy Act and click here …

A Program Evaluation Of The Building Blocks Of Comprehension, Jessica H. Monroe

Doctor of Education Dissertations

This dissertation is a program evaluation of the Building Blocks of Comprehension vocabulary program, which was first implemented during the 2019-2020 school year by the English department at the school site. The study aimed to investigate the impact of morphological instruction on student vocabulary acquisition and reading comprehension. Chomsky’s (1975) Linguistic Theory, Marzano’s (2004) Six-Step Model of Vocabulary Introduction, and the Active View of Reading (Duke & Cartwright, 2021) were identified as theoretical frameworks for the program evaluation. Quantitative data from this mixed methods study were collected from pre and posttests, weekly quizzes, and unit assessments, and qualitative data were …

Research-Based English Language Arts (Ela) Instructional Practices: Characteristics Of Effective Ela Instructional Practices That Drive Student Achievement In Title I School Districts, Tequila Stamps

Dissertations of Practice

Children who attend and are educated in Title I School Districts often experience limited access to consistent research based and empirical English Language Arts (ELA) instruction. Consequently, such students are not adequately prepared for career and college readiness and typically underperform on standardized achievement tests. The purpose of this study is to explore the instructional strategies of middle school ELA teachers, who serve students at-risk of poor academic outcomes, yet support sustained student growth and achievement. It is to further identify a specific set of research-based strategies that foster student growth and achievement, particularly with students in Title I School …

Learning Through Play At School: Ukraine, 2019-2024, Rachel Parker, Amy Berry, Kellie Picker, David Jeffries, Prue Anderson, Oksana Zabolotna

Student learning processes

The Learning Through Play at School Research Study Ukraine was a four-year longitudinal intervention study funded by the LEGO Foundation and implemented by the Australian Council for Educational Research (ACER) and the Ukrainian Educational Research Association (UERA). The study was implemented between 2019 and 2024, during COVID-19 and the full-scale invasion of Ukraine by Russian armed forces. Despite, at times, insurmountable challenges, the professional learning intervention was successful in supporting most teachers to progress from a surface level understanding of learning through play to a deep level. In addition, almost all children’s literacy and social-emotional skills grew significantly from start …

Foundational Literacy And Numeracy: Using Learning Assessment Data In The Asia-Pacific Region. Policy Brief, Adeola Monty

Literacy and numeracy

This policy brief has been prepared by the Australian Council for Educational Research (ACER) for the UNESCO International Institute for Educational Planning (IIEP) Regional Conference, held in Manila from 5 to 7 November 2024. This brief is in response to the conference sub-theme of, ‘Learning, equity and well-being: foundational literacy, numeracy and the use of learning assessment data.’ This sits under the overarching conference theme, ‘Educational planning in Asia: Common vision and future prospects.’ The remainder of this paper is divided into 3 sections. It begins by outlining ACER’s definition of a learning assessment, followed by an overview of the …

Caregivers' Perceptions Of Covid-19 Educational Disruptions On Children With Developmental Language Disorder And Typically Developing Peers, Katherine Radville, Danika Pfeiffer, Karynn Sheranian, Julie Wolter, Jessie Ricketts, Tiffany L. Hogan

Communication Disorders & Special Education Faculty Publications

Purpose: Understanding the experiences of families of children with developmental language disorder (DLD) during COVID-19 educational disruptions is essential for designing responsive supports during pandemic recovery efforts and beyond. This qualitative study describes the experiences of families of first-and second-grade children with DLD during the pandemic as compared to the experiences of families of typically developing (TD) peers.

Method: A conventional content analysis approach was used to analyze caregivers’ written responses to open-ended questions regarding their perceptions of COVID-19 educational disruptions. Responses were analyzed separately by group: caregivers of children with DLD (n= 23) and caregivers of TD children (n= …

Narrowing The Achievement Gap: Culturally Responsive Teaching For African American Students, Haylee Batzer

Masters Projects

It is no surprise to educators that classrooms are filled with children of all different backgrounds. Most teacher preparation programs try their best to prepare educators to teach students of diversity and support inclusion in the classroom. However, educators are still finding themselves lacking the skills needed to incorporate culturally responsive teaching (CRT) into their classrooms. Students of all backgrounds need inclusive practices to be successful. It is important to all students that they feel supported and seen in the classroom, without these practices schools start to see a decline in graduation rates and an increase in dropout rates. Many …

The Overcoming Disadvantage In Early Childhood Study: Evaluation Of The Australian Literacy And Numeracy Foundation’S Early Language And Literacy Program. Summary Report, Dan Cloney, Kellie Picker, David Jeffries, Prue Anderson

Early Childhood Education

This report provides a summary of the completed Overcoming Disadvantage in Early Childhood (ODEC) longitudinal research study. The study was designed to evaluate the Australian Literacy and Numeracy Foundation’s (ALNF) Early Language and Literacy (EL&L) program by answering the research question: What is the effect of the EL&L program on the development of language and literacy skills in preschool aged children? An integral component of this study was the development of the Early Language and Literacy Developmental Index (ELLDI), a new tool to measure oral language and literacy learning. The development of the ELLDI was based on the recognised need …

Toward A Theory Of An Integrated Theoretical Approach Of Literacy For Black Boys, Aaron M. Johnson

Michigan Reading Journal

In the education landscape the literacy of Black boys is viewed from deficit framing. Often, educators, politicians, and laypeople point to scores on standardized assessments such as the MSTEP, NAEP, ACT, SAT, and NWEA, these tests only tell a part of the story. The part of the story that those assessments do tell is the abject failure of schools’ ability to engage Black boys in school-based literacy and catapult them into proficient and advanced proficient reading levels. The part of the story that those assessments do not tell is the literate lives that Black boys lead. Furthermore, schools do a …

Infographic: Australia’S Reading Results Within The International Context, Australian Council For Educational Research (Acer)

Teacher infographics

The new report, Progress in International Reading Literacy Study: Australia’s results from PIRLS 2021, reveals how the average reading performance of year 4 students in Australia compares to other countries. Find out more in today’s infographic.

Pirls 2021 Australian Year 4 Data [Sas], Kylie Hillman, Elizabeth O'Grady, Sima Rodrigues, Marina Schmid, Sue Thomson

Progress in International Reading Literacy Study (PIRLS)

This dataset (SAS zipped) is a data source for the report Progress in International Reading Literacy Study: Australia’s results from PIRLS 2021. Refer to the readme.txt file for details.

Pirls 2021 Australian Year 4 Data [Spss], Kylie Hillman, Elizabeth O'Grady, Sima Rodrigues, Marina Schmid, Sue Thomson

Progress in International Reading Literacy Study (PIRLS)

This dataset (SPSS zipped) is a data source for the report Progress in International Reading Literacy Study: Australia’s results from PIRLS 2021. Refer to the readme.txt file for details.

Pirls 2021 Australian Year 4 Data Readme [Text], Kylie Hillman, Elizabeth O'Grady, Sima Rodrigues, Marina Schmid, Sue Thomson

Progress in International Reading Literacy Study (PIRLS)

This readme file contains information on use of the datasets that form the data source for the report Progress in International Reading Literacy Study: Australia’s results from PIRLS 2021.