Educational Assessment, Evaluation, and Research Commons^™

Understanding The Virginia Literacy Act, Candace Bechtold, Kimberly Bridges, David Naff, Joan A. Rhodes, Valerie Robnolt, Tara Davison, Suzanne Alexandre, Michael Crusco, Karli Johansen, Amber Butler, Allison Yandle, Jennifer Askue-Collins, Jean Samuel, Sharrie Merritte, Regina Frazier

MERC Publications

This research and policy brief from the Metropolitan Educational Research Consortium (MERC) offers an overview of the Virginia Literacy Act. It is structured to explore the following questions: 1) What are the recent trends in reading achievement in Virginia? 2) What are the policy implications of the VLA for Virginia school divisions? 3) What does the research say about Science of Reading (SoR)? 4) What core instructional programs are approved to meet the VLA? It concludes with a series of key takeaways and recommendations.

Click here to listen to our podcast episode on the Virginia Literacy Act and click here …

Research-Based English Language Arts (Ela) Instructional Practices: Characteristics Of Effective Ela Instructional Practices That Drive Student Achievement In Title I School Districts, Tequila Stamps

Dissertations of Practice

Children who attend and are educated in Title I School Districts often experience limited access to consistent research based and empirical English Language Arts (ELA) instruction. Consequently, such students are not adequately prepared for career and college readiness and typically underperform on standardized achievement tests. The purpose of this study is to explore the instructional strategies of middle school ELA teachers, who serve students at-risk of poor academic outcomes, yet support sustained student growth and achievement. It is to further identify a specific set of research-based strategies that foster student growth and achievement, particularly with students in Title I School …

Foundational Literacy And Numeracy: Using Learning Assessment Data In The Asia-Pacific Region. Policy Brief, Adeola Monty

Literacy and numeracy

This policy brief has been prepared by the Australian Council for Educational Research (ACER) for the UNESCO International Institute for Educational Planning (IIEP) Regional Conference, held in Manila from 5 to 7 November 2024. This brief is in response to the conference sub-theme of, ‘Learning, equity and well-being: foundational literacy, numeracy and the use of learning assessment data.’ This sits under the overarching conference theme, ‘Educational planning in Asia: Common vision and future prospects.’ The remainder of this paper is divided into 3 sections. It begins by outlining ACER’s definition of a learning assessment, followed by an overview of the …

Toward The Next Generation Of Research In Adult Literacy Instruction, Rebecca Clark-Stallkamp, Barbara B. Lockee

Journal of Educational Technology Development and Exchange (JETDE)

In November 2019, the Program for the International Assessment of Adult Competencies (PIAAC) from 2017 (Institute of Education Sciences [IES], 2019) depicted no significant change in the concerning status of adult literacy in the US. More than 52% of adults between 16 and 45 scored below functionally literate levels. While shortcomings are attributed to various factors such as high attrition rates in program, ill-conceived policy planning, and more, significant focus is placed on the impact of effective instruction. The study reviews core cognitive component theory experimentation and instructional intervention research in adult literacy to explain contributions and limitations in current …

Effectiveness Of Automated Formative Feedback In An Online Tutorial For Promoting Summarizing, Veronika Barkela, Miriam Leuchter

Journal of Educational Technology Development and Exchange (JETDE)

We conducted a study with the aim to investigate the effectiveness of automated formative feedback in improving students’ ability to summarize. One-hundred and thirty-eight undergraduate students in an elementary education program were asked to summarize six scientific texts, with the experimental group (N=87) receiving automated formative feedback in a computer-based learning environment (FALB). FALB provides automated feedback about content coverage, copying words avoidance, redundancy avoidance, relevance, and length. Comparing the experimental group to a control group (N=51), results implied that summarizing skills could be fostered when interacting with FALB. In particular, the automated formative feedback promoted the adherence to the …

De Aquí, Y De Allá: Education, Culture, And Identity Development Of Transnational Latinas, Elizabeth Harris-Medina

Theses and Dissertations--Educational Policy Studies and Evaluation

De Aquí, y De Allá: Education, Culture, and Identity Development of Transnational Latinas This ethnographic case study examines the experiences of three transnational Latina women, descendants of families from Degollado, Jalisco, Mexico, exploring how their migration history and educational backgrounds influence their life trajectories. Focusing on these three women, the study aims to better understand their challenges and inform the development of resources to support their success in the U.S. education system. Using ethnographic interviews and Ecological Systems Theory, the research highlights how places and social systems shape views and life paths, offering insights into how best to support these …

Application Of Multicultural Literature In The Early Childhood Classroom, Deborah Wheeler, Jennifer Hill

Journal of English Learner Education

Culture equates to identity; therefore, the implementation of multicultural literature in the early childhood curriculum is an essential method for securing children’s concept of self and cultural identity. This qualitative study explored the implementation of multicultural literature in early childhood classrooms, and the research included questions pertaining to multicultural literature training, instructional methods, and barriers encountered. The purpose of the study was to answer questions regarding teachers use of multicultural literature in the classroom, how often teachers read multicultural literature and how teachers integrated multicultural literature into instruction. An additional question inquired about what multicultural books titles were teachers reading …

Best Practices For English Learners With Disabilities In Us Schools – A Systematic Review, Samiratu Bashiru, Jennifer E. Smith

Journal of English Learner Education

This systematic review investigated best practices for enhancing academic achievement among English Learners with Disabilities (ELDs) in US schools. By examining 17 peer-reviewed articles and comparing them to the CEC 2014 Quality Indicators, the study identifies significant practices, including culturally responsive methods, technology integration, evidence-based strategies, addressing service delivery challenges, and improving assessment tools. This review has limitations related to inconsistent terminology and highlights the need for standardized language and continued research. It recommends integrating culturally responsive practices, leveraging technology, and refining inclusive assessment tools. This review provides educators, policymakers, and researchers insights, emphasizing ongoing teacher development and policy alignment …

Asset-Based Teaching; Uncover, Cultivate, And Empower Students’ Uniqueness, Stephanie K. Knight, Marjaneh Gilpatrick, Tracy Vasquez

Journal of English Learner Education

As instructors who are in tune with their learners learning and communication styles as well as their family and cultural backgrounds, it makes sense that they view their students’ skills and abilities from an asset-based lens. This article provides the readers with some tactics on how to develop and nurture that growth mindset.

When we consider the assets students bring to individual classrooms, the teaching becomes more personalized and relevant to their learning needs. By implementing these teaching practices, instructors are uncovering, cultivating, and empowering their students’ unique abilities. Ultimately students are able to apply their knowledge, skills, and abilities …

6 Strategies To Increase Your Classroom And School’S Culture And Climate, Stacey Keown-Murray, Rob Carroll, Kristi Livingston

Kentucky Teacher Education Journal: The Journal of the Teacher Education Division of the Kentucky Council for Exceptional Children

Creating a positive culture and climate in the classroom and school environment is crucial for fostering student engagement, well-being, and academic success. This article presents six effective strategies that educators can implement to enhance the culture and climate within their classrooms and schools. The strategies focus on promoting a sense of belonging, establishing clear expectations, fostering positive relationships, celebrating diversity, empowering student voice, and encouraging collaboration and teamwork. By implementing these strategies, educators can cultivate a supportive and inclusive environment that nurtures the holistic development of students and promotes a positive learning experience. The abstract provides a concise overview of …

The Santa Ana Youth Media Project: Ypar And Media Advocacy, Jorge F. Rodriguez

Education Faculty Articles and Research

The Santa Ana Youth Media Project (SAYMP) was born during the summer of 2019 and grew from a need, expressed by youth, for more critical media literacy that could further amplify and focus on narratives that reflect how youth navigate their personal, cultural-social, and economic environments. Our media projects consist of intentional participative research and journalistic designs that document stories using tools such as narrative inquiry, Youth Participatory Action Research (YPAR) and video/media production to visually capture the narratives of youth and community within the city of Santa Ana and its larger Orange County context. Our goal is to develop …

Teaching Phonics Mastery Through The Use Of Differentiated And Instructional Strategies, Ashley Honeyman

Theses/Capstones/Creative Projects

This capstone reports the effectiveness of using differentiated instructional and assessment strategies to improve student understanding in phonics mastery. Based on pretest data that analyzed understanding of short u consonant-vowel-consonant (CVC) words, phonics instruction was implemented to meet the needs of students in whole-group and small-group settings. This unit consisted of five whole-group lessons over short u blending and segmentation. In addition to the whole group learning, specific students were pulled for small-group intervention. The unit concluded with a post-assessment that tested student understanding on real and nonsense CVC words; these assessments were implemented to assess if the integration of …

The Use Of Culturally Relevant Pedagogy In Esol Classes, Beth A. O. Haddinger

Graduate Theses and Dissertations

This dissertation is organized into five distinct chapters addressing multiple aspects of learning and engagement as it relates to English Language Learners (ELLs) in the classroom. First, the problem of practice is identified and explored. We, as educators, must look closely at instructional and systemic issues, actionable elements, broader strategies of improvement, and leverage, which refers to the ability of a program to motivate students and to generate a sense of practical value in academics. The next aspect of this dissertation proposal reviews the existing research literature. This literature review focuses on the specific learning needs of ELL students. Specifically …

Lessons Learned About Evaluating Fairness From A Data Challenge To Automatically Score Naep Reading Items, Maggie Beiting-Parrish, John Whitmer

Chinese/English Journal of Educational Measurement and Evaluation | 教育测量与评估双语期刊

Natural language processing (NLP) is widely used to predict human scores for open-ended student assessment responses in various content areas (Johnson et al., 2022). Ensuring algorithmic fairness based on student demographic background factors is crucial (Madnani et al., 2017). This study presents a fairness analysis of six top-performing entries from a data challenge involving 20 NAEP reading comprehension items that were initially analyzed for fairness based on race/ethnicity and gender. This study describes additional fairness evaluation including English Language Learner Status (ELLs), Individual Education Plans, and Free/Reduced-Price Lunch. Several items showed lower accuracy for predicted scores, particularly for ELLs. This …

Implementing Transformative Education With Participatory Action Research: A Review, Niroj Dahal

The Qualitative Report

I write this review of the book, Implementing Transformative Education with Participatory Action Research, for readers, writers, and novice and veteran researchers in various social sciences disciplines and educational landscapes. The book explores using Participatory Action Research (PAR) to implement transformative education. The book argues that PAR can be used to create contextualized, sustainable, and student-centered learning environments. It offers invaluable insights from experts who have actively worked on innovative approaches to school transformation. The book also provides practical guidance and research-based strategies to help scholars effectively navigate challenges and implement transformative education. Overall, the book is a valuable …

Schoolteachers In Out-Of-School Hours Education: Blurring Professional Ideology In Recent Times, Dr. M Monjurul Islam, Mohammed Shamsul Hoque, Wan Mazlini Othman, Saraswathy Thurairaj Phd, Dr. Ghadah Al Murshidi, Latha Ravindran

The Qualitative Report

Teachers’ professional ideology and their involvement in out-of-school hours (OoSH) practices have been questioned in recent times. This study explores how schoolteachers understand their professional ideology in relation to their OoSH practices and how they explain their participation in private tutoring in addition to formal schooling. This study deploys a qualitative approach using in-depth semi-structured interviews with nine secondary school teachers in Bangladesh. The thematic analysis highlights a substantial gap between Bangladeshi school teachers’ professional ideologies and their involvement in private tutoring. The findings from the study reveal that the respondents perceive their dual roles as schoolteachers and tutors as …

An Illuminative Evaluation Of Two Models Of Reading Intervention Used In Middle Schools, Tachier M. Rezac

Dissertations and Doctoral Documents, University of Nebraska-Lincoln, 2023–

Intervention research often investigates the curriculum or methods used to support learners, while less attention is given to the model of those interventions. The purpose of this study was to evaluate the efficacy of two models of reading intervention, and to better understand how they are serving middle school students. Working from a critical pragmatic lens, I employed illuminative evaluation methods to investigate three research questions: (a) What are the demographic profiles of students enrolled in reading intervention in grades seven and eight; (b) What are the differences in gains for students enrolled in the traditional intervention and reading lab …

High-Growth Elementary Schools In Arkansas Based On Performance On The Act Aspire Examinations, Sarah C. Mckenzie

Arkansas Education Reports

This section highlights elementary schools across the state whose students demonstrated high growth on the Arkansas ACT Aspire exams. The ACT Aspire was administered to students in grades 3 through 10 in April 2023 in Math and ELA courses which include English, Writing, and Reading. Each table in this section presents the Top 20 schools for the noted subject area and school level. In addition, these tables include the region in which the schools are located, the grades served at the school, the weighted achievement score, and the content growth score in that particular subject. The level of the schools, …

The “Reading Wars” Are Back: What Are The Implications For Adolescent Literacy?, Jenelle Williams

Michigan Reading Journal

This article unpacks the current political and educational debates around the Science of Reading, Simple View of Reading, and Active View of Reading. In the article, the author describes evidence-based reading practices for adolescents and connects them to components of the Active View of Reading. Finally, the author provides a rationale for caution in over-applying research-based approaches for early literacy with adolescents.

Toward A Theory Of An Integrated Theoretical Approach Of Literacy For Black Boys, Aaron M. Johnson

Michigan Reading Journal

In the education landscape the literacy of Black boys is viewed from deficit framing. Often, educators, politicians, and laypeople point to scores on standardized assessments such as the MSTEP, NAEP, ACT, SAT, and NWEA, these tests only tell a part of the story. The part of the story that those assessments do tell is the abject failure of schools’ ability to engage Black boys in school-based literacy and catapult them into proficient and advanced proficient reading levels. The part of the story that those assessments do not tell is the literate lives that Black boys lead. Furthermore, schools do a …

More Than Phonics To Teach Spelling, Clare Iacono

2021-2030 ACER Research Conferences

This poster presents research into using more than phonics to teach students, in the middle primary school years, to spell. It uses document analyses and grounded theory to consider two research questions: Could instruction in metacognition and self regulation also improve skills in spelling? Is there evidence of instruction in metacognition and self regulation in current spelling lessons?

Unpacking And Illustrating Coiro’S Multifaceted Heuristic Of Digital Reading Through The Development Of The Cot-R Assessment, Jodi Pilgrim, Sheri Vasinda

Reading Horizons: A Journal of Literacy and Language Arts

Although much research exists on digital reading, confusion about literacy terminology persists. Inspired by a recent article in Reading Research Quarterly, the authors explore a multifaceted heuristic of digital reading developed by Julie Coiro. The heuristic, which offers a way to systematically organize, label, and define complex terms, concepts, and practices related to digital reading experiences, served as a reference point to examine the authors’ journey of defining digital reading. Highlighting three aspects of Coiro’s heuristic--text, activity, and context--the authors begin by describing the development of an authentic online reading assessment instrument (COT-R), which focuses on elementary students’ processes of …

Focused On Freedom: Exploring The Potential Of Grading Contracts To Support Writers In The Secondary English Language Arts Classroom, Margaret Mcgregor Fluharty

English Theses & Dissertations

Drawing on qualitative methods, I engaged in a practitioner inquiry (Cochran-Smith & Lytle, 2009) to investigate the use of contract grading to promote educational freedom (hooks, 2009; Love, 2020) in the post-secondary writing classroom. In addition, I explored the potential of this practice in the secondary English language arts setting.

To better understand the perspectives of both post-secondary writing instructors and secondary English teachers on the use of grading contracts, I conducted focus groups and engaged in artifact analysis (Billups, 2019). Results showed that post-secondary instructors who utilized grading contracts in their classroom saw changes primarily in their students’ engagement …

Empowering Chinese Students To Regain The “Voice” Via Vygotsky’S Zpd Integrated With The Socratic Seminar, Zhengjie Li Dr.

Journal of English Learner Education

Many Chinese students studying in the United States (U.S.) today report that they do not have a “voice.” They feel marginalized because of a lack of communicative competence in English and their inability to understand Western cultures, especially during their first year in the U.S. (Ching et al.). Some Chinese students are unable to adapt to the academic environment in American high schools, which leads to feelings of exclusion. To smooth this transitional period, this study suggests that the scaffolding (see Bruner, 1978, 1985) from ESL teachers in both verbal and written forms be implemented before students are placed into …

Effectiveness Of English Learners Computer-Based Testing Accommodations: A Meta-Analysis, Tuba Gezer Dr., Claudia Flowers, Richard Lambert

Journal of English Learner Education

With the increased number of English learners (ELs) participating in large-scale state testing, there has been an increased focus on fairness in testing for these students. Test accommodations have shown promise in eliminating barriers and improving accessibility, and computer-based testing (CBT) allows individual customization of tests with built-in accessibility features. Most research on testing accommodations focuses on paper-based tests, but CBT is the most predominant mode of delivering large-scale state assessments. This study aims to synthesize research on the validity and effectiveness of CBT accommodations for EL students. Meta-analysis methodology was used to summarize the findings from previous CBT studies. …

Accelerate Beginner English Learner’S Writing Skills From Day One, Eugenia F. Krimmel Ed.D.

Journal of English Learner Education

This article addresses the customary practice of delaying teaching of writing for Beginner English Learners (BELs) which often results in slowing writing development. Barriers preventing teachers from earlier writing instruction include a belief BELs cannot produce written English before learned orally first, a lack of teaching writing know-how, and few level-appropriate materials for older BELs. The systematic approach ALL Beginner Learners of English (ABLE) Writing Method is a solution to build both teachers’ confidence and BELs’ phonics, spelling, and writing skills from day one. The basic premise of the ABLE Writing Method is that if one is able to think, …

Pirls 2021 Australian Year 4 Data [Sas], Kylie Hillman, Elizabeth O'Grady, Sima Rodrigues, Marina Schmid, Sue Thomson

Progress in International Reading Literacy Study (PIRLS)

This dataset (SAS zipped) is a data source for the report Progress in International Reading Literacy Study: Australia’s results from PIRLS 2021. Refer to the readme.txt file for details.

Pirls 2021 Australian Year 4 Data [Spss], Kylie Hillman, Elizabeth O'Grady, Sima Rodrigues, Marina Schmid, Sue Thomson

Progress in International Reading Literacy Study (PIRLS)

This dataset (SPSS zipped) is a data source for the report Progress in International Reading Literacy Study: Australia’s results from PIRLS 2021. Refer to the readme.txt file for details.

Pirls 2021 Australian Year 4 Data Readme [Text], Kylie Hillman, Elizabeth O'Grady, Sima Rodrigues, Marina Schmid, Sue Thomson

Progress in International Reading Literacy Study (PIRLS)

This readme file contains information on use of the datasets that form the data source for the report Progress in International Reading Literacy Study: Australia’s results from PIRLS 2021.

Beyond Certification: Innovative Strategies To Tackle The Teacher Shortage, Abbigail Lp Morris

Kentucky Teacher Education Journal: The Journal of the Teacher Education Division of the Kentucky Council for Exceptional Children

This article challenges educational leaders to look beyond alternative routes for teaching certification and more towards an increased collaboration between districts and universities to help alleviate the teacher shortage issue in Kentucky. It specifically highlights the works of Omaha Public School District and the University of Nebraska Omaha as a model for proactive teacher pipeline.