Educational Assessment, Evaluation, and Research Commons^™

Testing Measurement Invariance In Multilevel Data With Unequal Cross-Level Factor Structures, Lihua Yang

Graduate Theses and Dissertations

The test of measurement invariance (MI) investigates whether observed items measure a construct in the same way across different groups or over times. Examining MI is a prerequisite for multiple group comparisons in psychological tests (Schmitt & Kuljanin, 2008). With the prevalence of multilevel data in educational research (e.g., students nested within schools), establishing MI across multiple groups or waves of nested data has brought increasing attention. Two popular techniques for the test of multilevel MI include the multiple-group multilevel confirmatory factor analysis (MMCFA) and the design-based approaches. The MMCFA approach estimates sample covariance matrices at different levels separately. The …

Does Grit Matter? A Correlational Study Of The Relationship Between Grit-S Assessment Scores And Student Retention In Undergraduate Online Programs, Kay Best Murphy

Graduate Theses and Dissertations

Historically, colleges and universities have used intelligence-based admissions tests to select students who demonstrate the intelligence to succeed academically. These institutions also have employed strategies to help students stay in school and graduate. However, despite tests and support strategies, the National Center for Education Statistics in 2018 reported a six-year completion rate of about 60% of first-time, full-time bachelor’s degree-seeking students for the 2010 cohort, including both traditional and online students. One study shows retention in online classes can be 10% to 15% lower than in traditional face-to-face courses (Carr, 2000). Meanwhile, higher education institutions today face increasing pressure to …

Positioning Of English Language Learners And Its Power On Classroom Learning Opportunities And Interactions, Hawraa Nafea Hameed Alzouwain

Graduate Theses and Dissertations

In this qualitative study, the researcher investigated four aspects of positioning used by teacher and ESL students in a mid-south state of the United States. This study was based on the Positioning Theory of Davies and Harré (1990). The study aimed to explore various types of positioning used by the participants and how they impacted social interactions among the students and between them and their teacher. The researcher used four questions to outline the scope of the research, focused on: 1) how ELLs’ different positioning in the ESL classroom promoted or limited their learning opportunities; 2) how the ELL teacher …

Leadership Succession And Onboarding Processes Of: Mid-West United States International Baccalaureate (Ib) Primary Years Program (Pyp) Schools, Mary Nandra Kay Campbell

Graduate Theses and Dissertations

The International Baccalaureate (IB) Primary Years Programme (PYP) model of education is unique and comprehensive, and so is the PYP principal. This qualitative study examined the perceptions of Mid-West United States IB PYP leaders related to leadership succession, the onboarding processes experienced by the new leaders, and the effective leadership traits possessed by the new leaders. This study involved a phenomenological study in nature. A criterion sampling approach was used to identify six participants of the study. A semi-structured interviewing protocol allowed elaboration by participants and to discover aspects not originally considered. The key findings included the following: lack of …

Heterogeneous Impacts Across Schools In The First Four Years Of The Louisiana Scholarship Program, Patrick J. Wolf

Education Reform Faculty and Graduate Students Publications

The Louisiana Scholarship Program (LSP) is a school voucher initiative that offers publicly- funded scholarships to students from economically-disadvantaged families to attend a participating private school of their choice. While school choice theory suggests that market- based reforms such as the LSP should improve student outcomes, experimental evaluations of the program instead find significant negative effects of the program on math and reading scores after its first year. Those effects diminish to insignificant differences by the end of the third year before becoming negative again in the fourth year. Our study builds on previous work with an exploratory analysis of …

The Effects Of The Louisiana Scholarship Program On Student Achievement After Four Years, Jonathan Mills, Patrick J. Wolf

Education Reform Faculty and Graduate Students Publications

The Louisiana Scholarship Program (LSP) offers publicly-funded vouchers to students in low-performing schools with family income no greater than 250 percent of the poverty line, allowing them to enroll in participating private schools. Established in 2008 as a pilot program in New Orleans, the LSP was expanded statewide in 2012. In this study, we estimate the achievement impacts of ever using an LSP voucher to enroll in one’s first-choice private school over the four year period spanning from 2012-13 (Year 1) through 2015-16 (Year 4). In contrast to our previous research, which indicated large initial negative achievement effects of the …

The Effect Of The Louisiana Scholarship Program On College Entrance, Heidi Holmes Erickson, Jonathan Mills, Patrick J. Wolf

Education Reform Faculty and Graduate Students Publications

The Louisiana Scholarship Program (LSP) is a private school voucher program available to families who have incomes no greater than 250 percent of the federal poverty line and whose children attend a low performing public school. It began as a pilot program in New Orleans in 2008 and was expanded statewide in 2012. Previous evaluations of the LSP generally found negative impacts of the program on math and English language arts test scores. In this study, we evaluate the effects of the program on college enrollment for the first cohort of students eligible to enter college by 2017-18. Using lottery …

Do You Get Cream With Your Choice? Characteristics Of Students Who Moved Into Or Out Of The Louisiana Scholarship Program, Yujie Sude, Patrick J. Wolf

Education Reform Faculty and Graduate Students Publications

Private school choice programs often are accused of failing to serve disadvantaged students. Critics claim that participating private schools “skim the cream off the top” by admitting only the best students and “push out” students who are the most difficult to teach. This study tests these student selection hypotheses in the context of the Louisiana Scholarship Program (LSP). We find LSP applicants are less advantaged than their public school peers regarding their family socioeconomic status and initial test scores. No consistent evidence indicates that the LSP private schools are “skimming the cream” or “pushing out” students based on their family …

Assessing The Impact Of Holocaust Education On Adolescents’ Civic Values: Experimental Evidence From Arkansas, Mathew Lee, Molly I. Beck

Education Reform Faculty and Graduate Students Publications

American adults overwhelmingly agree that the Holocaust should be taught in schools, yet few studies investigate the potential benefits of Holocaust education. We evaluate the impact of Holocaust education on several civic outcomes, including “upstander” efficacy (willingness to intervene on behalf of others), likelihood of exercising civil disobedience, empathy for the suffering of others, and tolerance of others with different values and lifestyles. We recruit students from two local high schools and randomize access to the Arkansas Holocaust Education Conference, where students have the chance to hear from a Holocaust survivor and to participate in breakout sessions with leading Holocaust …

A Good Investment: The Updated Productivity Of Public Charter Schools In Eight U.S. Cities, Corey Deangelis, Patrick J, Wolf, Larry Maloney, Jay May

Education Reform Faculty and Graduate Students Publications

In 2015-16, the United states spent over $660 billion on its public education system in hopes of providing children with greater opportunities to excel academically and to improve their life trajectories. While public education dollars have risen at a relatively fast pace historically, future challenges, including underfunded pension liabilities, suggest policymakers should economize wherever possible. Meanwhile, the number of public charter schools has increased exponentially. from 1991 to 2018, charter school legislation passed in 44 states and the nation’s capital, and student enrollment in charters increased to around 3.2 million. Since educational resources are limited, we examine which types of …

The Effects Of Regulations On Private School Choice Program Participation: Experimental Evidence From California And New York, Corey Deangelis, Lindsey Burke, Patrick J. Wolf

Education Reform Faculty and Graduate Students Publications

Although private school voucher programs provide subsidies to students for tuition and other education-related costs, private school leaders weigh program participation against any associated regulatory costs. The higher the regulatory costs of participation, the less likely a private school is to participate in a school voucher program. Since we do not know with certainty which regulations will be viewed by school leaders as more or less costly, we explore whether specific regulations that are common to private school choice programs do or do not deter likely voucher program participation.

We use surveys to randomly assign different regulations to 4,825 private …

A Longitudinal Analysis Of Volunteerism Activities For Individuals Educated In Public And Private Schools, Albert Cheng, David Sikkink

Education Reform Faculty and Graduate Students Publications

Previous studies offer evidence that U.S. public and private high schools differentially influence volunteerism in adolescence. However, these studies are typically cross-sectional and only consider whether the individual volunteered or not. We address patterns of volunteering from adolescence into adulthood and the kind of volunteering activity in which individuals engage. We also theorize that distinctive civic values within public and private schools together with their respective organizational ties to other civic organizations channel students into particular volunteering activities. Relying on a longitudinal, nationally-representative sample of U.S. adolescents, we track volunteering from adolescence into young adulthood and identify the types of …

Private School Choice And Character: More Evidence From Milwaukee, Corey Deangelis, Patrick J. Wolf

Education Reform Faculty and Graduate Students Publications

We examine the effects of Milwaukee’s school voucher program on adult criminal activity and paternity suits. Using matched student-level data, we find that exposure to the program in 8th or 9th grade predicts lower rates of conviction for criminal activity and lower rates of paternity suits by ages 25 to 28. Specifically, exposure to the MPCP is associated with a reduction of around 53 percent in drug convictions, 86 percent in property damage convictions, and 38 percent in paternity suits. The program effects tend to be largest for males and students with lower levels of academic achievement at baseline.

Altered Attitudes And Actions: Social-Emotional Effects Of Multiple Arts Field Trips, Angela Watson, Jay Greene, Heidi Holmes Erickson, Molly Beck

Education Reform Faculty and Graduate Students Publications

In recent decades, institutions, teachers, and students report a decline in field trip attendance. The impact of this decline on educational and societal outcomes such as social-emotional skill acquisition is unknown. Social-emotional learning (SEL) are skills thought to be important to life and relationship success and are associated with better long-term student outcomes. This study describes the results of the first-ever longitudinal experiment of the effects of multiple arts- related field trips on elementary school students of color in a large urban school district. Treated students attended field trips to an art museum, a live theater production, and a symphony …

Does Art Make You Smart? A Longitudinal Experiment Of The Effects Of Multiple Arts- Focused Field Trips, Heidi Holmes Erickson, Jay Greene, Angela Watson, Molly I. Beck

Education Reform Faculty and Graduate Students Publications

This paper presents second year results from the first ever multi-visit, longitudinal experiment on the benefits from arts-focused field trips. Students in fourth and fifth grades in ten elementary schools in a large urban school district were randomly assigned to receive three arts-related field trips throughout the school year, including an art museum, a live theater production, and a symphony performance or to serve as a control. We find that treatment students exhibit higher levels of school engagement as measured by students’ behavioral infractions and self-reported engagement. We also find that treatment students perform significantly better on their end of …

An Evaluation Of The Educational Impact Of College Campus Visits:A Randomized Experiment, Elsie Swanson, Katherine Kopotic, Gema Zamarro, Jonathan Mills, Jay Greene, Gary Ritter

Education Reform Faculty and Graduate Students Publications

We hypothesize that a lack of experience with college poses a non-trivial barrier to college access for historically underrepresented students. We study whether visits to a college campus during the eighth grade can reduce these psychological barriers to college access. Using an experimental design, we study whether college visits affect students’ knowledge about college, postsecondary intentions, college-going behaviors, academic engagement, and ninth grade course enrollment decisions. We recruited 885 students across 15 schools who participated in our project during the academic year 2017-2018. We randomized students within schools to either a treatment or control condition. Students in the control condition …

Local Labor Market Conditions, Principals’ Leadership, Conscientiousness, And Beginning Teacher Turnover: A Study During The Great Recession, Dillon Fuchsman, Gema Zamarro

Education Reform Faculty and Graduate Students Publications

An abundance of literature sheds light on which factors determine teacher turnover, but it has yet to consider the role that local labor market conditions may play in teachers’ turnover decisions and how these labor market conditions may influence the quality of teachers who might be retained. The effect of local labor market conditions on teacher turnover could be relevant especially in times of high economic instability like the Great Recession. To study the determinants of teacher turnover, we match the Beginning Teacher Longitudinal Study (BTLS) with local unemployment rates from the USC Great Recession Indicators Database (GRID). We also …

Teacher Agency And The Implementation Of Restorative Justice, Jeffrey Hunt

Graduate Theses and Dissertations

The purpose of this mixed methods study was to examine the implementation of Restorative Justice in an urban central California high school through the lens of administrators, and teacher perceptions of agency, campus climate, and impact of the implementation. The participating school in this study defined their implementation of Restorative Justice as Restorative Practices. The Quality Implementation Framework (Durlak, Meyers, & Wandersman, 2012) guided the development of the literature review and created the framework for the study. This mixed-methods sequential explanatory study examined the relationship between teacher perceptions of agency, school climate, and the implementation of Restorative Practices. Teachers at …

Refining Effective Instructional Strategies Through Professional Learning Communities, James Kevin Hancock

Graduate Theses and Dissertations

The purpose of this study is to examine the effectiveness of professional learning communities by comparing practices and strategies of content and grade level teams in middle schools. Utilizing data from student assessment, comparison of teams in this middle school was conducted to determine practices and conversations that have an impact on teachers’ decisions about student learning. Understanding phenomenon that drives effective decision-making processes in teams of teachers creates an environment where shared leadership produces professional learning communities that are sustainable and systemic.

A qualitative approach was conducted in the form of a case study to capture themes relevant to …

Why Career And Technical Education Teachers Contribute Intellectual Capital To Open Education Repositories: A Case Study, Kelley J. Manley

Graduate Theses and Dissertations

High quality Career and Technical Education (CTE) teachers are necessary in order to prepare students to fill the gap in the nation’s technical workforce. Technical skills taught by high school CTE teachers assist students as they continue their education in post-secondary technical schools. Post-secondary CTE teachers assist students in their preparation for future high-wage, high-demand technical careers. One of the many challenges reported by CTE teachers is the time-consuming development of relevant curriculum. The open education resource (OER) movement has been reported in research to alleviate some of these challenges for teachers, but research is lacking in the area of …

Effects Of Task Clarification And An Adaptive Computer Software On Implementation Of Mand Training Using An Ipad® As A Speech Generated Device, Ashley Mckenzie Parnell

Graduate Theses and Dissertations

Mand training is an evidence-based instructional method and a primary focus in behavioral language training for children with autism. A rapidly growing research base supports manding training using hand-held computing technologies (e.g., iPad®, iPod®) as speech generating devices (SGD) for establishing a manding repertoire in children with autism. To ensure optimal learning efficacy and efficiency, procedures must be implemented with high levels of accuracy, which requires that staff be well-trained. However, research evaluating methods for training staff to implement mand training procedures with the iPad® and application Proloquo2Go™ as an SGD has not yet been conducted. Therefore, this study examined …

Exploring School Counselors’ Narratives Of Cacrep Accredited Online Education Programs, Rebecca Van Der Hagen

Graduate Theses and Dissertations

Online education is a growing part of academia. The number of online school-counseling programs is also increasing and beginning to include face-to-face and online programs. Little research describes online education and even less discusses online school-counseling programs. The purpose of this study was to examine and interpret participants’ experiences of being trained and graduating from a CACREP online school-counseling master’s program, as well as how their training prepared them for their current role as a school counselor. A qualitative inquiry was conducted to understand online school-counseling programs and reported how six professional school counselors perceived their online program with a …

Teacher Perception And Their Understanding Of Progress Monitoring Throughout A Longitudinal Assessment System, Rena A. Duewel

Graduate Theses and Dissertations

The purpose of this qualitative study was to examine the phenomenon of teacher perception and their understanding of progress monitoring throughout a longitudinal assessment system. This monitoring of student progress is to enhance their academic skills in mathematics and provide necessary interventions for growth as measured on a longitudinal assessment system through fidelity of implementation of interventions processed through progress monitoring. Data was collected from participant responses through interviews, a demographic survey, and focus groups. Interview respondents participated in a closed-door, face-to-face interview. The survey was used to collect specific demographic data to provide a concise snapshot of each individual …

Long-Term Outcomes Of Low Achieving Third Grade Readers, Sarah Mckenzie, Emily Jordan, Charlene A. Reid

Policy Briefs

This brief examines long-term academic outcomes for students who demonstrate low reading achievement in third grade. Following three cohorts of students from third grade through early high school, we find that students who are behind in third grade are unlikely to ever read proficiently. Economically disadvantaged students, Black students, and male students demonstrate less improvement in reading achievement over time than other types of students.

The Effects Of Regulations On Private School Choice Program Participation: Experimental Evidence From Florida, Corey Deangelis, Lindsey Burke, Patrick Wolf

Education Reform Faculty and Graduate Students Publications

When deciding whether to participate in a private school choice program, private school leaders weigh additional financial benefits against additional regulatory costs. In theory, raising the costs associated with entering private school choice programs should reduce the likelihood that individual schools participate in those programs. However, very little empirical evidence exists evaluating this idea. While a few studies suggest that more highly regulated programs are correlated with lower levels of school participation, none have established causal relationships between these factors, and none have determined which program regulations are the most costly. Because it is nearly impossible to randomly assign program …

Further Validation Of Survey Effort Measures Of Relevant Character Skills: Results From A Sample Of High School Students, Gema Zamarro, Malachi Nichols, Angela Duckworth, Sidney D'Mello

Education Reform Faculty and Graduate Students Publications

Character skills, including conscientiousness, grit or self-control are important determinants of relevant life outcomes. However, researchers struggle to find valid measures of these skills and many existing datasets lack any measures of them at all. This limits research on how these important skills could be better supported and developed. Recent research has shown the potential of parametrizations of survey effort measures as proxy measures of character skills related to conscientiousness, to either complement other collected measures or to add to datasets that lack such measures. This study provides further validation of these survey effort measures in a sample of high …

The Impact Of A Learning Community On The Perceived Wellness Of First Year Doctor Of Physical Therapy Students, Angela Mae Holland

Graduate Theses and Dissertations

Healthcare education guides students in obtaining skills to promote health in others. In working towards this goal, graduate students in healthcare programs potentially suffer from increased stress while undergoing the rigor of a medically based academic program. The purpose of this study was to determine if the addition of a learning community program had an effect on the perceived wellness of first year doctor of physical therapy students. A repeated measures quasi-experimental design was used to answer the three research questions, which guided the investigation. Three groups of participants completed the study, one serving as the experimental group with the …

Introducing The Academic Discipline Of Agricultural Communications To The United Kingdom: A Needs Analysis, Sara Kathryn Maples

Graduate Theses and Dissertations

There is a current need to identify and describe opinions of prospective employers and current agricultural students about the prospects of developing an agricultural communications academic discipline in the U.K. An understanding of the competencies employers would expect of agricultural communications graduates, as well as an understanding of what students would expect to learn, would form the conceptualization and development of the discipline in the U.K. A total of 22 agricultural communications professionals and 67 agricultural students from across the United Kingdom completed the survey. Collected data showed agricultural students and agricultural communications professionals answers overall were not statistically different. …

Impact Of The Implementation Of Class-Wide Function-Related Intervention Teams On Adolescent Student Behavior, Dana Renee Speight

Graduate Theses and Dissertations

Disproportionality in discipline has been well-documented in the research literature (Achilles, McLaughlin, & Croninger, 2007; Losen & Gillespie, 2012; Gregory, Skiba, & Mediratta, 2017; Skiba, Peterson, & Williams, 1997). Students from diverse ethnic backgrounds and students with disabilities are removed from their classrooms more frequently than their Caucasian peers without disabilities (Losen & Gillespie, 2012). This disparate removal of students from diverse ethnic backgrounds and students with disabilities has spurned education stakeholders to call for removal of punitive policies and replacement with positive behavior interventions and supports. This study sought to evaluate the impact of Class-Wide Function-related Intervention Teams (CW-FIT) …

2017 Pulaski County Education Report Card, Sarah C. Mckenzie, Gary W. Ritter

Education Report Card

There are many things that contribute to a ‘good’ school, but we believe student academic growth is perhaps the most meaningful measure of school performance or school effectiveness. Many Pulaski County schools had high growth at one or two school levels, and there is evidence of variation in growth rates between schools within the same districts. We recommend district and school leaders examine where their students are not demonstrating high growth, examine high growth schools to see what those schools are doing differently, and consider how they can further support learning for their students.