Educational Assessment, Evaluation, and Research Commons^™

Outstanding Educational Performance Awards: Highlighting High-Achieving Arkansas Schools, 2015, Charlene A. Reid, Gary W. Ritter

Arkansas Education Reports

In this report, we are presenting a list of the top 25 schools in each area. In some cases, these “top 25 lists” will contain more than 25 schools as some schools’ GPA scores will be identical. This is not a new phenomenon, as we also exceeded 25 schools in previous reports when using the percent proficient and advanced metric as an indicator for student achievement; however, there are fewer ties using the more precise GPA measure.

Science exams were only administered in grades 5, 7, and to students completing Biology. There are very different performance patterns by grade: Fifth …

Effects Of Dual-Language Immersion On Students’ Academic Performance, Jennifer L. Steele, Robert O. Slater, Gema Zamarro, Trey Miller, Jennifer Li, Susan Burkhauser, Michael Bacon

Education Reform Faculty and Graduate Students Publications

Using data from seven cohorts of language immersion lottery applicants in a large, urban school district, we estimate the causal effects of immersion on students’ test scores in reading, mathematics, and science, and on English learners’ (EL) reclassification. We estimate positive intent-to-treat (ITT) effects on reading performance in fifth and eighth grades, ranging from 13 to 22 percent of a standard deviation, reflecting 7 to 9 months of learning. We find little benefit in terms of mathematics and science performance, but also no detriment. By sixth and seventh grade, lottery winners’ probabilities of remaining classified as EL are three to …

Discipline Disproportionalities In Schools: The Relationship Between Student Characteristics And School Disciplinary Outcomes, Kaitlin Anderson, Gary W. Ritter

Education Reform Faculty and Graduate Students Publications

According to a 2014 report from the US Department of Education’s Office for Civil Rights, black students represent only 15% of students across the nation, but 35% of students suspended once are black, 44% of students suspended more than once are black, and 36% of expelled students are black. These disparate disciplinary aggregate outcomes, while troubling, do not provide as much information as policymakers need. In this study, we exploit three years of student-level discipline data from Arkansas to assess the extent to which black students or other minority students were more likely to receive certain types of punishments, even …

Outstanding Educational Performance Awards: Highlighting High-Achieving Arkansas Schools, 2015, Charlene A. Reid, Gary W. Ritter

Arkansas Education Reports

In this report, we are presenting a list of the top 25 schools in each area. In some cases, these “top 25 lists” will contain more than 25 schools as some schools’ GPA scores will be identical. This is not a new phenomenon, as we also exceeded 25 schools in previous reports when using the percent proficient and advanced metric as an indicator for student achievement; however, there are fewer ties using the more precise GPA measure.

Science exams were only administered in grades 5, 7, and to students completing Biology. There are very different performance patterns by grade: Fifth …

Outstanding Educational Performance Awards: Highlighting High-Achieving Arkansas Schools, 2015, Charlene A. Reid, Gary W. Ritter

Arkansas Education Reports

In this report, we are presenting a list of the top 25 schools in each area. In some cases, these “top 25 lists” will contain more than 25 schools as some schools’ GPA scores will be identical. This is not a new phenomenon, as we also exceeded 25 schools in previous reports when using the percent proficient and advanced metric as an indicator for student achievement; however, there are fewer ties using the more precise GPA measure.

Science exams were only administered in grades 5, 7, and to students completing Biology. There are very different performance patterns by grade: Fifth …

Outstanding Educational Performance Awards: Highlighting High-Achieving Arkansas Schools, 2015, Charlene A. Reid, Gary W. Ritter

Arkansas Education Reports

In this report, we are presenting a list of the top 25 schools in each area. In some cases, these “top 25 lists” will contain more than 25 schools as some schools’ GPA scores will be identical. This is not a new phenomenon, as we also exceeded 25 schools in previous reports when using the percent proficient and advanced metric as an indicator for student achievement; however, there are fewer ties using the more precise GPA measure.

Science exams were only administered in grades 5, 7, and to students completing Biology. There are very different performance patterns by grade: Fifth …

Outstanding Educational Performance Awards: Highlighting High-Achieving Arkansas Schools, 2015, Charlene A. Reid, Gary W. Ritter

Arkansas Education Reports

In this report, we are presenting a list of the top 25 schools in each area. In some cases, these “top 25 lists” will contain more than 25 schools as some schools’ GPA scores will be identical. This is not a new phenomenon, as we also exceeded 25 schools in previous reports when using the percent proficient and advanced metric as an indicator for student achievement; however, there are fewer ties using the more precise GPA measure.

Science exams were only administered in grades 5, 7, and to students completing Biology. There are very different performance patterns by grade: Fifth …

Arkansas Science Benchmark, Eoc Biology And Itbs Test Results 2014-15, Sarah C. Mckenzie, Gary W. Ritter

Policy Briefs

The Arkansas Department of Education (ADE) has released the 2014-15 Benchmark Science and ITBS (Iowa Test of Basic Skills) results. PARCC results of Literacy and Math will be released later this fall. The following brief highlights the results of these tests, compares achievement scores over time, and provides a glimpse of regional achievement results for the following exams:  Benchmark Science Exam (Grades 5 and 7)  End-of-Course Biology Exam  Iowa Test of Basic Skills (Grades 1 and 2)

Falling Below The Line: Minimum Subgroup Size And Special Education Enrollment, Sivan Tuchman

Education Reform Faculty and Graduate Students Publications

The No Child Left Behind Act of 2001 (NCLB) brought high-stakes accountability testing into every American public school with the goal of 100 percent proficiency for all students. Making annual yearly progress (AYP) toward this proficiency goal for the total student population as well as at-risk subgroups was required in order for schools to avoid possible sanctions, such as school restructuring. In implementing NCLB, states had flexibility to determine the minimum size of these subgroups as to provide statistical reliability and accountability for as many schools as possible. If a school did not meet the state’s minimum subgroup size, the …

Aspire In Arkansas?, Sarah C. Mckenzie, Gary W. Ritter

Policy Briefs

On June 22, 2015, Governor Hutchinson communicated with Johnny Key, State Commissioner of Education, his request for the state’s removal from PARCC by June 30th. This back and forth over student assessment has raised many questions for educators, students, and parents. This brief will review the history behind annual assessments, address the differences between PARCC and ACT/ACT Aspire, and suggest the scores Arkansas’ students would receive if ACT Aspire is administered next school year

The Educational Benefits Of Cultural Institutions, Brian Kisida

Graduate Theses and Dissertations

A significant portion of the education children receive occurs outside of the traditional classroom and produces outcomes not typically captured by standardized achievement tests. This dissertation is part of an effort to expand the educational venues and outcomes educational researchers rigorously examine. In particular, I present the key results from experimental studies of the effects of school tours to the Crystal Bridges Museum of American Art in Bentonville, AR., and to the Museum of Discovery in Little Rock, AR.

Chapter 1 focuses on arts exposure and critical thinking outcomes. A problem for the arts’ role in education has been a …

The Effectiveness Of Cash Transfers As A Policy Instrument In K-16 Education, Jonathan Norman Mills

Graduate Theses and Dissertations

Cash transfers, defined as direct transfers of purchasing power from an institution or individual to another individual, are an increasingly popular policy instrument both abroad and in the United States. This dissertation investigates how two educational interventions utilizing cash transfers affect participating students. The first, the Louisiana Scholarship Program, is a statewide program offering publicly financed scholarships for low income students attending poorly performing public schools to attend K-12 private schools. The second program, the Arkansas Academic Challenge Scholarship, is a state financed broad-based merit-aid scholarship for students in college within the state of Arkansas. In general, the results presented …

Differentiation Revealed: A Multiple-Methods Qualitative Study On The Implementation Of Differentiated Instruction In A Mixed-Ability Elementary Classroom, Curtis James Cunningham

Graduate Theses and Dissertations

Differentiated instruction as a philosophical approach to teaching has been around for decades. In recent weeks differentiation has come under fire as being an approach to teaching that is simply too difficult for teachers to implement. While teachers may attend a workshop or take a graduate class on the topic of differentiation and choose not to embrace the philosophy, there are also teachers who have successfully implemented differentiation. The argument against differentiation is based on the amount of effort required to simultaneously implement all components of differentiation.

To address these concerns the following question provided guidance for the present multi-method …

No Excuses Charter Schools: A Meta-Analysis Of The Experimental Evidence On Student Achievement, Albert Cheng, Collin Hitt, Brian Kisida, Jonathan N. Mills

Education Reform Faculty and Graduate Students Publications

While charter schools differ widely in philosophy and pedagogical views, the United States’s most famous urban charter schools typically use the No Excuses approach. Enrolling mainly poor and minority students, these schools feature high academic standards, strict disciplinary codes, extended instructional time, and targeted supports for low-performing students. The strenuous and regimented style is controversial amongst some scholars, but others contend that the No Excuses approach is needed to rapidly close the achievement gap. We conduct the first meta-analysis of the achievement impacts of No Excuses charter schools. Focusing on experimental studies, we find that No Excuses charter schools significantly …

Non-Cognitive Abilities And Spanish Regional Differences In Student Performance In Pisa 2009, Ildefonso Mendez, Gema Zamarro, Jose G. Clavel, Collin Hitt

Education Reform Faculty and Graduate Students Publications

The goal of this paper is to analyze the role that non-cognitive skills and, in particular, regional differences in those skills, play on the observed differences in 15-year-old student’s academic performance, across Spanish regions, on PISA 2009. Previous research has shown the relevance of differences in student’s personal, family and school characteristics in accounting for academic differences across Spanish regions but it has also found that a sizeable part of the observed differences remained unexplained. We have found that differences in the distribution of certain non-cognitive skills associated to academic performance like focus, perseverance and resilience play a prominent role …

The Intergenerational Transmission Of Noncognitive Skills And Their Effect On Education And Employment Outcomes, Ildefonso Mendez, Gema Zamarro

Education Reform Faculty and Graduate Students Publications

We use information on second-generation migrants to study the existence of a cultural component on the formation process of noncognitive skills and its effect on education and employment outcomes. Our measures of noncognitive skills include: personality traits that children are encouraged to learn and civic capital. Individuals whose cultural heritage places a lower value on child qualities positively associated to the conscientiousness personality factor report lower education, worse occupational status and lower wages on average. Individuals with a higher inherited civic capital declare a higher educational level, but we find no effect of civic capital on adult labor market outcomes.

How Can We Accurately Measure Whether Students Are Gaining Relevant Outcomes In Higher Education?, Tatiana Melguizo, Gema Zamarro, Tatiana Velasco, Fabio Sanchez

Education Reform Faculty and Graduate Students Publications

The main objective of this study is to empirically test a number of theory-based models (i.e. fixed effects (FE), random effects (RE), and aggregated residuals (AR)) to measure both, the generic knowledge as well as the degree attainment rates and early labor outcomes, gained by students in different programs and institutions in higher education. There are four main findings: First, the results of the paper confirm the need of using models that address the issue of student selection into programs and institutions in order to avoid biased estimates. Second, our findings provide suggestive evidence in favor of using FE models. …

Comparisons Of Student Perceptions Of Teacher's Performance In The Classroom: Using Parametric Anchoring Vignette Methods For Improving Comparability, Hana Vonkova, Gema Zamarro, Vera Deberg, Collin Hitt

Education Reform Faculty and Graduate Students Publications

Self-reports are an indispensable source of information in education research but might be affected by reference group bias if the frame of reference (i.e. implicit standards), used to answer the questions, differs across students. The anchoring vignettes method was introduced, in other areas of social science, precisely to correct for this source of bias. However, studies that make use of this approach in education are rare and more research is needed to study its potential. This paper uses data from PISA 2012 to investigate the use of the parametric model of the anchoring vignettes method to correct for differential implicit …

Collective Bargaining And District Costs For Teacher Health Insurance: An Examination Of The Data From The Bls And Wisconsin, Robert M. Costrell

Education Reform Faculty and Graduate Students Publications

District costs for teachers’ health insurance are, on average, higher than employer costs for private-sector professionals. How much of this is attributable to collective bargaining? This paper examines the question using data from the National Compensation Survey (NCS) of the Bureau of Labor Statistics (BLS) and the state of Wisconsin. In addition, the impact of collective bargaining on employer costs is decomposed into the impact on total premiums and the employer’s share of those premiums. The BLS data show that unionization is associated with higher total premiums, higher employer costs, and lower employee contributions in both the public and private …

Comparing Schools: From Value Added To Sound Policy, Jeffery Richmond Dean

Graduate Theses and Dissertations

Over the last twenty years, value added measures (VAMs) have proliferated in education research and policy. Whether applied to teachers, schools, or districts, VAMs have attempted to measure the contribution made by a unit of interest toward observed student outcomes, typically test scores in literacy and math. At the same time, a small number of states have developed methods to formally compare schools on those outcomes, and such methods may be used and intended in ways that qualify them as a kind of VAM. My primary interest is to evaluate the properties of a similar schools model I develop in …

Impact Of Professional Learning Community Design On Teacher Instruction, Carol Jeanette Turner

Graduate Theses and Dissertations

This descriptive case study closely examined a professional learning community in an Arkansas middle school. The site was selected because the school was removed from the state's school improvement list after implementing professional learning communities. The purpose of the study was to determine how the design of a professional learning community impacts teacher instruction in a middle school setting. The literature reviewed included historical perspective, definitions and characteristics of professional learning communities, teacher professional development, and teacher effect on student achievement. Eight teachers, one principal, and one instructional facilitator were interviewed about the professional learning communities in their school. The …

Long-Term Impact Of Teacher Training For Mexican English-Language Teachers, Rochelle Keogh

Graduate Theses and Dissertations

The purpose of this study was to determine the long-term impact of the Summer Workshop for English Teachers. Moving beyond participant satisfaction surveys and even measures of participant learning outcomes, this project sought to describe the ways that teachers implemented their program training after returning to Mexico and what affect that had in their classrooms, their schools, and the wider English-teaching community. I surveyed 203 former Summer Workshop participants and conducted focus group interviews with 18 more who attended the professional development training at a U.S. host institution between 2002 and 2013. The data showed that the participants were using …

Assessing Vocabulary Of Children: Investigating The Evaluation And Instruction Of Basic Concepts, Rebecca Elizabeth Smith

Graduate Theses and Dissertations

Vocabulary knowledge of preschool children is a key factor in predicting literacy success in elementary school (Hammer, Farkas, & Maczuga, 2010). However, few deliberate attempts to teach basic concept vocabulary have been studied (Bowers & Schwarz, 2013; Wilson, 2004). The purpose of this research is to determine if large group explicit instruction with interactive activities of specific basic concept vocabulary will increase preschool children's understanding of basic concept terms when measured by a standardized basic concept assessment. This research will also assess the validity of a basic concept-curriculum based measure (BC-CBM) as an efficient tool to monitor a child's understanding …

An Investigation Of Perceptions Of Program Quality Support Of Adult Basic Education Programs In Arkansas, Gary William Udouj

Graduate Theses and Dissertations

This study was designed to identify the degree to which the directors of adult basic education programs in Arkansas perceive they have program quality support, as evidenced by a well-defined mission and role in the community, a management system, human resources management, and a suitable learning environment. To collect data for this study, NSCALL's Evidence-based program self-assessment (2006) was modified and administered electronically. Thirty-nine administrators of adult education programs funded by state and federal grants under the Arkansas Department of Career Education were invited to participate. The survey consisted of 40 questions scored on a 5-point Likert type scale, four …

Principals' Perceptions Of Incompetent Teachers: Incidence Rates, Characteristics, And Barriers To Dismissal In Missouri, Christopher A. Grauf

Graduate Theses and Dissertations

Research suggests that hiring and retaining high quality teachers is probably the most important school related factor in providing a quality education for students, as well as improving student achievement. Because of the importance of providing all students with highly capable and qualified teachers, this study explored characteristics of incompetent teachers and barriers to their dismissal to help school leaders better understand, and hopefully reverse, the negative impact caused by incompetent teachers. The three goals of this study were to develop a more complete understanding of: 1) characteristics that cause teachers to be identified as incompetent; 2) barriers to removing …

The Impact Of Latino Growth On Educational Institutions In Northwest Arkansas From 1990- 2010: Two Decades Of Change In Curriculum Design, Educational Resources And Services For Latino Students, Aíxa García Mont

Graduate Theses and Dissertations

With the changing demographics nationwide of Latinos moving from urban traditional

settlements sites to non-traditional settlement sites such as Arkansas (Pew Hispanic Research Group, 2013; Smith, 2014; Smith and Furuseth, 2005) Arkansas is now part of the new south or El Nuevo South (Smith and Furuseth, 2005). Although Arkansas is a non-traditional receiving state it is one of the states with the largest growing Latino population (Pew Hispanic Research Group, 2013). Northwest Arkansas in particular has the largest concentration of Latinos to date with the area being host to some of the largest companies in the United States, such as …

Teachers' Sense Of Efficacy: Examining The Relationship Of Teacher Efficacy And Student Achievement, Nouf Abdullah Alrefaei

Graduate Theses and Dissertations

The purpose of this study was to investigate which teachers’ characteristics have an impact on teachers’ sense of efficacy. In addition, the relationship between mathematics and science fifth grade teachers’ sense of efficacy and student achievement was examined. Two characteristics related to teachers were examined: teachers’ years of teaching experience and teachers’ highest degree. Participants included 62 mathematics and science teachers from three school districts in Northwest Arkansas. When comparing fifth grade mathematics and science teachers’ efficacy beliefs based on their highest degree, a significant difference in teachers’ efficacy beliefs was found based on their degrees. Teachers with a Bachelor …

Teacher Survey: Common Core Standards, Sarah C. Mckenzie, Gary W. Ritter

Policy Briefs

The Common Core State Standards (CCSS) for K-12 English language arts (ELA) and mathematics were adopted by the Arkansas State Board of Education in July 2010. Teachers have been implementing CCSS in their classrooms for several years, and this spring students across the state are being assessed on CCSS through the PARCC assessments. In February 2015, Governor Hutchinson announced the formation of a Council on Common Core Review, and the Office for Education Policy began a survey of Arkansas public school teachers to gather their opinions on this important topic. In this brief, we will share the preliminary findings from …

2015 Legislative Summary, Sarah C. Mckenzie, Gary W. Ritter

Policy Briefs

The 90th General Assembly opened its Regular Session on January 12 and recessed on April 9. Meetings of the House and Senate education committees were usually standing room only for discussions of a broad range of bills on early childhood, K-12, and higher education issues. The purpose of this policy brief is to review the K-12 bills that garnered the most attention and have been signed into law by firstterm Governor Asa Hutchinson. These highlights are organized into several categories as shown in This Brief

Grading Arkansas’ Schools, Sarah C. Mckenzie, Gary W. Ritter

Policy Briefs

Report Cards for Arkansas schools released by the Arkansas Department of Education contain valuable information for stakeholders. As in past years, the report cards outline student demographics and academic achievement, as well as rates of attendance, graduation, dropout, grade inflation and college remediation. Report cards also contain information on teacher quality and school environment indicators. There are a few new pieces of information provided this year, specifically a school rating which assigns a letter grade to schools.