Educational Assessment, Evaluation, and Research Commons^™

Effects Of Measurement Error In Student Pre-Post Test Score On The Recovery Of The Estimates Of Teachers Value-Added Scores, Merlin J. Kamgue

Graduate Theses and Dissertations

Abstract Background: Value-added models (VAMs) are statistical tools used to gauge a teacher’s impact on student performance by analyzing standardized test scores. These models project students’ future performance based on past scores and compare the projection to actual outcomes, accounting for differences in student backgrounds. However, the standard error of measurement (SEM) inherent in all measurement tools is often overlooked in VAMs. Aims and Objectives: This study aims to investigate the impact of test reliability on teacher and school score estimates within a Bayesian framework. We will precisely manipulate the reliability of standardized tests by adjusting the standard error of …

Using Improvement Science To Reduce Student Retention In High School Through School-Based Mentoring, Ellen B. Borland

All Dissertations

The disproportionate demographics among retained students must be addressed. School-based mentoring has been recognized as an effective tool for motivating and supporting students at-risk of not graduating on time. This research aimed to explore the impact of a school-based mentoring program on positive student outcomes, specifically academic achievement, among high school students at-risk of not graduating on time. This study followed twenty-three students and mentors throughout the school year, and examined the association between school-based mentoring and grade level retention or promotion. The results were compared to the same group of students and their performance during the previous school year, …

Christian School Leaders’ Perspectives On Identifying And Hiring High-Quality Teachers, Alison Johnson, Rian R. Djita, Lynn E. Swaner

Education Reform Faculty and Graduate Students Publications

Teacher quality is one of the most important factors influencing a student’s educational outcomes, yet scant research has examined teacher hiring and quality in Protestant Christian schools. In this qualitative work, we thematically analyze interviews about Christian schools’ teacher hiring practices with a group of 12 leaders from 10 member schools in the Association of Christian Schools International. We find that these 10 schools generally follow a standard hiring process. The qualifications they seek in teachers could be arranged into a pyramid, where the base—the most fundamental quality—is demonstration of authentic belief in Protestant Christian doctrines. After faith, school leaders …

Creating A Framework For Sustainable Research And Extension Engagements In An Education Institution Funded By The Local Community, Ernesto L. Bastida Jr., Cecilia Raquel C. Alvaran, Rudy Bhonne R. De Lara, Jerbert M. Abargos, Jhonies G. Saysi, Kenneth A. Auxillos-Cualbar, Lodelio D. Millo

ASEAN Journal of Community Engagement

The role of higher educational institutions (HEI) in securing a sustainable future for all is not only limited to quality instruction but also includes development-focused research and need-based extension services. Pursuant to national and international commitment and policies, these three fundamental functions of HEIs are mandated to be aligned with the 17 Sustainable Development Goals to intensify their roles in knowledge creation and commercialization while protecting the planet. The City of Dasmariñas, through the Kolehiyo ng Lungsod ng Dasmariñas (KLD) as its locally funded HEI, has taken initial steps to strengthen its sustainable governance through competitive research initiatives and extension …

Innovative Education: Comparing The Success Of Stem And Traditional School Models, Timothy W. Kennedy

Education Theses and Dissertations

Abstract

This research study investigates the impacts of four specialized STEM education models—T-STEM (Texas Science, Technology, Engineering, and Mathematics), P-TECH (Pathways in Technology), Early College High Schools (ECHS), and New Tech Network schools (NTN) on student performance in Texas high schools. By analyzing aggregate student data collected by the state, this study compares the academic outcomes of students in these STEM-focused schools with those in traditional curriculum schools using ANCOVA (Analysis of Covariance) and Logistic Regression. The findings reveal mixed results: while some specialized STEM models show enhanced performance in STEM and other academic subjects, others do not consistently outperform …

Developing Early Literacy Screening Assessments And Corresponding Interventions, Sarah A. Coutts

Masters Projects

The topic of this project entails baseline assessments and corresponding interventions for kindergarten and first-grade students attending Newaygo Elementary School. Concerns of students failing to meet grade-level reading expectations continue to rise as achievement gaps grow. “Struggling readers are likely to experience difficulties across content areas, are at a higher risk for grade retention, are more likely to drop out of school before high school completion, and are less likely to pursue post-secondary education” (Ford et al., 2018, p. 207). This project aims to develop systematic baseline assessments and interventions to support students’ academic needs. Markovitz et al. (2021) emphasize …

U.S. Undergraduate Test-Optional Policies For International Applicants During The Covid Pandemic: An Exploration Of Admissions Webpages, Sugene Cho-Baker, Guangming Ling, José Sotelo, Olasumbo Oluwalana

Chinese/English Journal of Educational Measurement and Evaluation | 教育测量与评估双语期刊

Although the adoption of test-optional policies (TOPs) has risen, there is little research documenting the types of TOPs (e.g., test-blind, test-optional) utilized across higher educational institutions, particularly for international applicants, who have been traditionally required to submit additional application components (e.g., proof of English language proficiency [ELP]). Using the content of undergraduate admissions webpages from 518 U.S. 4-year universities, the current study examined how standardized test policies are implemented in admissions for international applicants. We found that only 2.5% of the institutions explicitly required ACT/SAT scores, whereas 43.1% stated ACT/SAT scores as optional requirements for admissions. Some institutions provided unclear …

We Think, We Smell, We Remember: The Effect Of Smell On Memory For Chemistry Lab Learning, Michael A. Marino, Francine Wisnewski, Catherine Reilly, Andre Alexis

BCES: Faculty Presentations

The traditional five senses are the primary receptors of external stimuli for the brain. While tactile learning and visual observations are integral to the chemistry laboratory, olfaction is a sense that should be considered part of an educator's repertoire. Previous studies have discovered that our sense of smell plays a significant role in triggering memories. Moreover, specific scents like vanillin can prompt anamneses to recall previous experiences. A sample of 61 college students was employed for a three-week pretest-posttest control group experimental design. In the first week, participants conducted a chemical reaction to synthesize isoamyl acetate, the familiar and nontoxic …

Sociocultural Environment And Agency In Identity Construction Of English Language Teachers, Bharat Prasad Neupane , Phd

The Qualitative Report

Identity is an emerging field in educational research focusing on how teacher education programs, training, reflective practices, and short-term interventions impact the identity negotiation of teachers (Gautam, 2018). However, this study reports how different levels of sociocultural environments influence teachers and what initiatives they take for professional development and identity construction. Drawing on Wenger’s (1998) notion of communities of practice and Norton’s (2013) investing, this study sought to uncover the interchange of the development of learning communities and teachers by investigating the life history of four secondary-level English language teachers derived through informal conversations and in-depth interviews. Teachers’ life stories …

Longitudinal Investigation Of Early Mathematical Achievement And Classroom Strategic Diversity: A Replication And Extension Study, Douglas H. Clements, Yixiao Dong, Crystal A. Day-Hess, Julie Sarama

Early Childhood Special Education: Faculty Scholarship

Developing solution strategies, effortful procedures that students employ to solve a specific problem, is an important mathematical goal. Studies have documented intraindividual strategy variability and its significance for learning, but only some have addressed the interindividual strategic diversity across students within a classroom. This study analyzed classroom strategy diversity using assessments of 527 kindergartens to 2nd-grade students. Latent growth modeling analysis revealed that the best fit was a spline model featuring two phases of linear growth with different growth rates (i.e., one in Kindergarten, the other from Kindergarten spring to second grade). A growth mixture modeling analysis demonstrated that only …

Accuracy And Effectiveness Of An Orchestration Tool On Instructors' Interventions And Groups' Collaboration, Luettamae Lawrence, Emma Mercier, Taylor Tucker Parks, Nigel Bosch, Luc Paquette

Instructional Technology and Learning Sciences Faculty Publications

This paper presents the development of a novel orchestration tool that predicts collaborative problem-solving (CPS) behaviors of undergraduate engineering groups and investigates the use of that tool by instructors. We explore the impact of receiving real-time, machine-learning, model-based prompts on 1) instructors' orchestration strategies, which are strategies instructors use to manage and facilitate collaborative activities, and 2) groups' participation, including how groups are engaged in CPS activities. The orchestration tool is a dashboard that notifies instructors of–and advises them on–monitoring and intervening with groups who may need collaborative support and guidance. We describe the accuracy of the models in predicting …

The Influence Of Misconceptions On Pedagogical Choices Of Secondary Science Teachers: An Embedded Case Study, Tracey Beyer

Dissertations

This case study, using phenomenography within science disciplines, examines how educators' experiences with misconceptions affect teaching methods in high school physics, chemistry, and biology. Based on constructivist and interpretive theories it highlights that personal experiences shape learning and involve continuously reconstructing knowledge. The shared misconceptions of 13 educators across science disciplines reveal how those experiences influenced both their content knowledge and instructional practices. The findings indicate that educators who openly acknowledge and learn from their past experiences with misconceptions are better equipped to recognize and address gaps in understanding, an asset to furthering student learning. This research highlights the importance …

Educator Feedback On A Farm Tractor And Machinery Safety Training Program: Implications For Program Content And Success, Linda Fetzer, Brenna Butler, Judd Michael

Journal of Extension

This article provides results from a survey of instructors who have offered the National Safe Tractor and Machinery Operation Program (NSTMOP) to youth planning to work in agriculture. Youth younger than age 16 who wish to be employed on non-family farms are required to complete an approved safety training program to operate tractors and other powered machinery. A survey of educators who offered the NSTMOP program was conducted to learn more about their successes, challenges, and feedback related to the instructor training course and program materials. Results provide direction to the instructors’ programmatic needs with respect to teaching safety-related topics.

Perceived Beef Producer Challenges And Competencies For A Value-Added Beef Extension Program, Sarah J. Al-Mazroa Smith, Greg Miller

Journal of Extension

As markets are changing in the beef industry, producers are seeking new opportunities for value-added beef production. A select group of beef industry experts and experienced beef producers have come to consensus regarding challenges that producers face in the current marketplace. They identified competencies that would be a positive addition to a value-added beef Extension program. Competencies and challenges were organized to enable Extension specialists to create a new Extension program framework.

Workshop Wine Wednesdays: Improving Knowledge And Motivations About Local Wines., Aude A. Watrelot, Sarah Al-Mazroa Smith, Sarah L. Francis

Journal of Extension

The grape and wine industry in Iowa is based on non-Vitis vinifera grapes, which are not well-known by consumers and come with their own set of challenges, such as promotion. The Wine Wednesdays workshop focused on promoting awareness and knowledge of local wines and grapes. Results indicate gain in self-perceived knowledge and intention of behavior changes toward local grapes and wines. These workshops also participate in the development of relationships among wineries, which is overall beneficial for the local grape and wine industry.

Self-Directed Learning In A Qualitative Research Methods Course For Doctoral Students, Amy L. Damrow, Krittika Grau, Brandon Pettry, Karen Plaster, Adepeju Prince

The Qualitative Report

This paper describes (1) the reasoning behind a self-directed learning assignment in an advanced qualitative research methods course, and (2) doctoral students’ experiences with that assignment. Drawing on instructor and student perspectives, a professor and four doctoral students collaborated to reflect and report on the process and product of one assignment within a course. The doctoral students approached the assignment in unique ways: delving into one specific research methodology, comparing multiple research designs, and exploring current uses of qualitative research at a research conference. The piece contributes to the body of literature about students’ and instructors’ experiences in graduate qualitative …

Predicting Educator Perceptions Of Tennessee's Teacher Evaluation System: The Role Of Teacher Gender, Years Of Experience, And School Level Taught, Leonida T. Bell

Doctoral Dissertations and Projects

This quantitative, correlational study aims to determine if a predictive relationship exists between teacher perceptions of Tennessee's teacher evaluation and the linear combination of teacher gender, years of experience, and school-level taught (elementary, middle, high). Although teachers have recognized the current teacher evaluation system, many educators expressed concerns about it. This study is vital in determining teachers' perceptions of the evaluation system. Participants of this study included a sample of 108 certified elementary, middle, and high school teachers from one of the public school districts in southwestern Tennessee. Data were collected via an anonymous, self-paced online survey utilizing a modified …

Embracing Social-Emotional Learning And Nurturing Character: A Systematic Review Of Intersectional-Eq Strategies For Educational Leaders, Leticia G. Candelaria-Archuleta

Teacher Education, Educational Leadership & Policy ETDs

The COVID-19 pandemic expanded education beyond traditional academics, highlighting the importance of social-emotional learning (SEL) and character education (CE) for positive youth outcomes. This study examined the role of educational leadership in implementing SEL and CE in schools through a term coined Intersectional-EQ. This study centered on a cutting-edge approach using grey literature, specifically doctoral dissertations, to capture current trends in unprecedented times. A systematic review through Covidence, guided by PRISMA and PICO frameworks, was conducted. Findings highlight the impact of leadership on SEL and CE through an intersectional lens. Future work is aimed to support holistic student growth by …

Adaptive Screen Capture Video Analysis, Ugesh Egala

Electrical and Computer Engineering ETDs

This thesis presents a system for analyzing student activities during class sessions to gain insights into the learning process. A dataset consisting of 14 screen recordings, with 2 videos labeled across two stages, was used for training, validation, and testing. The methodology employs adaptive sampling, initially at 10 frames per minute to identify active regions, followed by detailed analysis at 1 frame per second using OCR to detect typing activities through character changes. The results demonstrate over a 50% reduction in computational load while maintaining high accuracy in detecting student engagement. A total of 26 hours of screen capture videos …

Journal Of Educational Leadership In Action, Volume 9, Issue 2, Full Issue, Lindenwood University

Journal of Educational Leadership in Action

No abstract provided.

Unpacking The Science Of Reading Research, Greta Rollo, Kellie Picker

Literacy and numeracy

The science of reading (SoR) is a term used for a body of evidence encompassing multi-disciplinary research from education, cognitive psychology, linguistics, and neuroscience. This evidence points to six key constructs that contribute to proficient reading: oral language, phonological awareness including phonemic awareness, phonics, fluency, vocabulary and reading comprehension. Research around these constructs provides researchers and teachers with an evidence base of the knowledge, skills and strategies involved in competent reading and describes how reading develops in both typical and atypical readers. This paper synthesises evidence reviews conducted by ACER researchers that unpack the science of reading. The aim of …

Authentic Assessment For Children With Language Considerations: Early Identification And Connection To Services, Karen Zyskind, Marisa Macy

Perspectives on Early Childhood Psychology and Education

Early identification of delay or disability is critical in the early years when children are developing. Yet practices for early identification are often rife with challenges for the families of young children. Part C of the Infants and Toddlers with Disabilities Program of the Individuals with Disabilities Education Improvement Act (IDEA) was authorized almost 40 years ago, mandating that children with developmental disability or developmental delay be identified and fairly assessed to obtain high quality early intervention services. An overview of the components of Fair Assessment and legal requirements are highlighted in this article. An outline for recommended practices and …

Educator Perspectives On A Kindergarten Entry Assessment: Implementation Experiences, Support, And Data Utilization, T. Scott Holcomb, Zhi Li, Richard Lambert, Angela Ferrara

Perspectives on Early Childhood Psychology and Education

This mixed methods study provides insight into practitioner attitudes and experiences with the North Carolina Kindergarten Entry Assessment (NC KEA) and helps determine what resources are needed to support intended use of the assessment. The survey and follow-up interviews allowed researchers to gather quantitative and qualitative data to gain a more in-depth understanding of each individual’s unique views. While most teachers felt prepared to implement the KEA, the majority did not find assessment data useful. Interviews highlighted the lack of understanding regarding the purpose of the assessment and the frustration that can follow this type of misunderstanding.

Authentic Assessment For Early Childhood Intervention: In-Vivo & Virtual Practices For Interdisciplinary Professionals, Stephen J. Bagnato, Marisa Macy, Carmen Dionne, Nora Smith, Jackie Robinson Brock, Tracy Larson, Maria Londono, Antonio Fevola, Mary Beth Bruder, Jamie Cranmer

Perspectives on Early Childhood Psychology and Education

Abstract

The pandemic has exposed the many glaring difficulties inherent in implementing effective assessment and intervention for young children with neurodevelopmental delays and disabilities in our respective countries, but, especially in the US. The urgency for innovative models of assessment linked to interdisciplinary services and supports in both remote and in-vivo settings became prominent. Yet, the commitment to developmentally-appropriate practice (DAP), assessment linked to intervention, is the hallmark of ECI, whether virtual or in-vivo.

However, interdisciplinary professionals have rallied during these challenging times by displaying creativity, compassion, and superb clinical judgment in providing responsive services via both virtual and in-vivo …

Link Virtual Forum On Authentic Assessment For Early Childhood Intervention: Interdisciplinary & International Consensus, Stefano J. Bagnato, Marisa Macy, Nora Smith, Carmen Dionne, Mary Beth Bruder, Maria Londono, Jackie Robinson Brock, Antonio Fevola, Tracy Larson

Perspectives on Early Childhood Psychology and Education

The LINK Virtual Forum on Authentic Assessment for Early Childhood Intervention: Interdisciplinary & International Consensus was orchestrated through a series of virtual focus-groups during the pandemic in 2021-2022. This new strategy for conducting a more robust national/international consumer social validity study gathered practice-based evidence from the field using national and international expert panel focus groups and an expert panel forum to survey Authentic Assessment experts and users. Uniquely, these deliberations relied upon the Nominal Group Technique (NGT) among participants to reach consensus decisions and Qualtrics survey results. The decision-making process addressed types of assessment measures that address early childhood …

Demographic Study Of College Of Sciences At University Of Nevada, Las Vegas, Laura Seo, Nastasija Damjanovic, Angelica Amansec, Aika Dietz, Monika Neda

Spectra Undergraduate Research Journal

In the United States, STEM-related industries are among the fastest-growing. Our study examines the enrollment of students in the College of Sciences (CoS) and the demographics of the student bodies in both undergraduate and graduate programs from 2010 to 2021 at the University of Nevada, Las Vegas (UNLV). Using the method of least squares, a polynomial fit model was used to find trends as well as to calculate enrollment predictions for the years 2025 and 2030. Our results demonstrate that, currently, the UNLV CoS is male dominant in the graduate program and female dominant in the undergraduate program. However, female …

A Critically Self-Reflexive Model For Leader Professional Development: Centering Intersectionality, Aubrey H. Wang, Margaret Grogan

Education Faculty Books and Book Chapters

This concluding chapter describes one way to think about leadership development for a new generation of educational leaders with intersectional identities. Leaders who are committed to Critical Leadership Praxis (CLP) (Pak & Ravitch, 2021) need ongoing professional learning to remain true to their transformative mission. Wang and Grogan point out the limitations of traditional models of professional learning in education leadership and outline why it is imperative that leaders are encouraged to author their own professional identity anchored in their personal identities. They propose storytelling as a critically reflective leadership development tool and describe their process and concept. By combining …

Introduction: Leading Social Change From The Lived Experience Of Intersectionality, Margaret Grogan, Aubrey H. Wang

Education Faculty Books and Book Chapters

This introductory chapter explains why education leadership for social change is an urgent priority and how principals, superintendents and other leaders who identify as anti-racist, inclusive, and activist can conceptualize their work. To frame the examples of Critical Leadership Praxis (CLP), (Pak & Ravitch, 2021) that the seven practitioner-scholars write about, Grogan and Wang describe the current context of leadership expectations and review the development of leadership theories alternative to the mainstream discourse. They outline current theories of intersectionality, and consider how storytelling and counter stories can illuminate the value of lived experiences of multiple marginality. This introduction also describes …

Language Equity In The Undergraduate Classroom: Fostering Language Diversity In The World Of Standard Academic English., Gabriela Johnson

Higher Learning Research Communications

In this essay, I explore the complex intersection of language, identity, and education with a particular focus on the importance of fostering linguistic equity in higher education settings. It is imperative for higher education institutions to reevaluate language-related practices and foster linguistic diversity and equity. Drawing upon linguistic theories and real-world examples, I highlight how language is deeply intertwined with personal identity, culture, and heritage. Various English dialects, such as African American Vernacular English, Chicano English, and others, are highlighted as valid linguistic expressions rather than deviations from a supposed standard. The role of standard academic English (SAE) in academia …

Hard Or Soft: An Exploration Of What Skills A Sport Management Student Is Lacking, Ashley Ryder, Jillian Mcniff Villemaire, Taylor Behl

The COSMA Journal

An important measure of success of sport management programs in higher education is how prepared students are for their professional careers. Programs often include various experiential learning opportunities such as internships in their curriculum to improve student employability. However, there is still concern that students may not be prepared for success in their internships and in the field. The purpose of this study was to identify which skills sport management student interns needed the most improvement, according to their intern supervisor. Using a single institution, this study analyzed intern supervisor’s questionnaire responses from 2017-2022 at a small, private college in …