Educational Assessment, Evaluation, and Research Commons^™

Next Generation Science Standards, Sarah C. Mckenzie, Gary W. Ritter

Policy Briefs

This policy brief provides an overview of the Next Generation Science Standards (NGSS), voluntary state science standards that are intended to improve the quality of science instruction in the U.S. The brief discusses the history of science standards, the development of the NGSS and its current status, arguments for and against the standards, and the status of the NGSS in Arkansas.

Interview With Andreas Schleicher, Padraig O'Malley, Andreas Schleicher

New England Journal of Public Policy

This interview took place on March 17, 2014, in Washington, DC, with Andreas Schleicher, Director of Education and Skills, and Special Advisor on Education Policy to the Secretary-General at the Organisation for Economic Co-operation and Development (OECD). Schleicher is responsible for the Directorate of Education and Skills’ research, analysis, and publication of the Program for International Student Assessment (PISA), the OECD Survey of Adult Skills (PIAAC), the OECD Teaching and Learning International Survey (TALIS), and the development and analysis of benchmarks on the performance of education systems. The OECD reports on PISA, PIAAC, and TALIS were released between December 3, …

School Reform In Canada And Florida: A Study Of Contrast, Catherine S. Boehme

New England Journal of Public Policy

Alberta and Florida have instituted school reform initiatives over the past fifteen years in an effort to improve the quality of their schools. Alberta has focused on systemic improvement by engaging the community in educational needs assessment, raising the high standards of teacher preparation, and improving effective instructional practices through professional development. Florida’s efforts have concentrated on holding students, teachers, schools, and districts accountable for high-stakes testing results by increasing the number and rigor of required assessments and increasing the negative consequences for low achievement scores. The 2012 PISA scores reveal that Alberta’s students are maintaining their high rankings relative …

Massachusetts Schooling Matters: Good News, Contributing Factors, Challenges, Persistent Problems, Kathleen J. Skinner, Paul Toner

New England Journal of Public Policy

Massachusetts public schools have performed at the highest levels on national and international benchmarked reading, mathematics, and science assessments. The Commonwealth’s population demographics related to educational attainment, employment, and family income coupled with factors within the control of the state, districts, or schools, such as highly qualified and unionized teachers, average school-district size, defined time on learning, universal health care coverage for all children, state funding for pre-K–12 schooling, curriculum articulation through statewide standards, and high participation in college admissions exams, have contributed to academic success. Massachusetts schools, however, still face challenges in narrowing existing achievement gaps, reducing the emphasis …

Editor's Note, Padraig O'Malley

New England Journal of Public Policy

On December 3, 2013, when the Organisation for Economic Co-operation and Development (OECD) released its Programme for International Student Assessment (PISA) scores, the ranking of the United States as number 27 on the global scoreboard elicited little surprise among teachers, educational professionals, academics, and educational policymakers. The usual platitudes were trotted out—no mention that the United States’ standing was getting any worse, just which other countries were passing us by. We were stuck at a perennial average.

The results are in a sense a metaphor of the slow decline of the United State since the 1970s from a position of …

What Can Pisa Tell Us About U.S. Education Policy?, Linda Darling-Hammond

New England Journal of Public Policy

Despite years of attention to “reform” in the United States, overall achievement on international assessments such as PISA has not improved during the period from 2000 to 2012. Reforms focused on high-stakes testing attached to sanctions, expansions of charter schools, and a market-based approach to teaching have been unsuccessful in changing outcomes. Meanwhile, growing childhood poverty, along with increasing segregation, income inequality, and disparities in school spending, have expanded the opportunity gap. Lessons from other nations and successful states indicate that systematic government investments in high-need schools along with capacity-building that improves the knowledge and skills of educators and the …

International Education Comparisons: How American Education Reform Is The New Status Quo, Randi Weingarten

New England Journal of Public Policy

The United States participates in international studies comparing school systems across the world. Reformers have largely ignored the lessons from these studies about what works best to educate children, and a strategy of test-based accountability has become the new status quo. This article analyzes the failed policy ideas reformers keep pushing on our schools that have been shown across the globe to be unsuccessful in the areas of school choice and competition, teacher quality and evaluation, an engaging curriculum, and equity. Research examines what top performing countries do to help students succeed, as well as what works in districts across …

Getting To The Core And Evolving The Education Reform Movement To A System Of Continuous Improvement, Fernando M. Reimers, Eleonora Villegas-Reimers

New England Journal of Public Policy

This article places the most recent study of PISA (Programme for International Student Assessment) in historical perspective, reviewing the role of international comparisons in efforts to build public education systems as key institutions of democratic societies. It discusses the findings for the United States, examining differences with other participating countries. It also looks at a paradox. Despite the high priority education has received in the United States in the past two decades, the country underperformed in a number of indicators in the PISA in comparison with many other countries participating in the study. The authors explain the findings as the …

The National Commission On Education Excellence And Equity: Hypotheses About Movement Building, Christopher Edley Jr.

New England Journal of Public Policy

In 2013, the congressionally chartered national Commission on Education Equity and Excellence issued unanimous recommendations for P–12 policy changes at the federal, state, and local levels. This remarkably broad consensus, with unusual pragmatism and concreteness, is comprehensive in its scope and predominantly research based. As a clarion call and reform strategy, the commission report, For Each and Every Child, is a successor to A Nation at Risk (1983); the commission’s grand if not grandiose intention was to provide a framework for the next decade or more of nationwide policy struggle. This article, after briefly summarizing the recommendations, focuses on …

The Influence Of Community Demographics On Student Achievement On The Connecticut Mastery Test In Mathematics And English Language Arts In Grade 3 Through 8, Albert Nii Lartey Sackey Jr.

Seton Hall University Dissertations and Theses (ETDs)

Student achievement has been measured in the United States for decades through the use of standardized state assessments. The purpose of this study was to examine which combination of 15 out-of-school community demographic variables best predicted and accounted for the most variance in a Connecticut school district’s percentages of students scoring goal or above on the 2010 Connecticut Mastery Test (CMT) for the third through eighth grade in Mathematics (Math) and English Language Arts (ELA). Analyses were conducted using both a simultaneous regression model and a hierarchical regression model. This study looked at the entire population of districts that were …

Implementing Common Assessment: Lessons And Models From Amac Developed By The Australian Medical Assessment Collaboration, Daniel Edwards

Higher education research

The aim of this document is to provide insight into the implementation of common assessments in higher education in order to assist in future work on conducting these kinds of projects. The discussion here draws heavily on the AMAC experience, attempting to broaden the learning from this project for use in future collaborations. The focus of this project has been on medical education, and as such, much of the detail is related to this field. However, it is hoped that the general ideas discussed here can be seen as informative for other fields and disciplines in higher education and at …

Student Motives For Taking Online Courses In Educational Administration, Theodore J. Kowalski, David Alan Dolph, Ila Phillip Young

Educational Leadership Faculty Publications

This study was conducted with students enrolled in a master’s degree program in educational administration at a private research university that offered all required courses in both online and in-class formats. The purposes were to determine (a) the extent to which online courses were selected, (b) the level of importance students placed on four common motives for taking online courses, and (c) levels of association between the importance of values and two demographic variables (employment level and years of teaching experience). The extent to which students took online courses varied considerably. Convenience and flexibility were the most important motives and …

A Study Of Alternative Education Programs In The State Of Missouri, Ronald Joshua Ladd

Dissertations

The focus of this study was to examine the characteristics of alternative programs in the state of Missouri and to determine whether a statistical difference in the persistence to graduation rate existed between the two variations of programs. When identifying the characteristics, several commonalities emerged. These commonalities could be the focus of future studies to determine a list of best-practices among alternative programs. When focusing on the statistical element of this study, the two programs in question were revolving door and one-way programs. For the purpose of this study, a revolving door style program was defined as one that assesses …

Best Practice Teacher Education Programs And Australia’S Own Programs, Lawrence Ingvarson, Kate Reid, Sarah Buckley, Elizabeth Kleinhenz, Geoff N. Masters, Glenn Rowley

Initial Teacher education

This report was prepared by the Australian Council for Educational Research (ACER) to support the work of the Teacher Education Ministerial Advisory Group (TEMAG). ACER was requested to undertake evidence-based research and benchmarking of world’s best practice teacher education programs against Australia’s own programs, which included: (a) identifying best practice principles for the design, delivery and assessment of teacher education programs; and (b) articulating the features of teacher education programs that most effectively support successful transition to effective practice.

Discrepancies In Discipline Of Middle School Students By Gender: A Comparison Of Principal Candidates’ Responses To Vignettes, And Teacher Perceptions, Jill Lukefahr-Farrar

Dissertations

Discipline in schools exists so that there are guidelines to ensure safety and learning. Administrators and teachers give students consequences based upon discipline guidelines made by the school districts’ board of education. The discipline administered can be subjective. In a suburban mid-western school district, alarming trends in the amount of discipline referrals of male students both in the primary investigator’s middle school and in the other middle schools within the researched district were recognized. The purpose of this mixed methods study is to analyze and understand if gender discrepancies exist in discipline for middle school students among aspiring administrators, practicing …

Deciding On Science: An Analysis Of Higher Education Science Student Major Choice Criteria, Stephen Wilson White

Dissertations

The number of college students choosing to major in science, technology, engineering, and math (STEM) in the United States affects the size and quality of the American workforce (Winters, 2009). The number of graduates in these academic fields has been on the decline in the United States since the 1960s, which, according to Lips and McNeil (2009), has resulted in a diminished ability of the United States to compete in science and engineering on the world stage. The purpose of this research was to learn why students chose a STEM major and determine what decision criteria influenced this decision. According …

A Grounded Theory Study Of The Experiences Of Early Childhood Educators Implementing Action Research As A Professional Development Method, Donna James

Doctoral Dissertations and Projects

The purpose of this systematic grounded theory study was to gain insight through the experiences of early childhood educators and their perceptions as they implemented action research as a professional development method. This study focused on the process of implementing action research as a professional development method and strived to answer questions related to the possible future use of this model in other educational settings while describing educator experiences, perceptions and beliefs. Data collection included interviews, observations, and journals. Detailed procedures for analysis were employed during the study with three phases of coding: Open, Axial, and Selective. Data was analyzed …

Our Grades Were Broken: Overcoming Barriers And Challenges To Implementing Standards-Based Grading, Randal Peters, Tom Buckmiller

Journal of Educational Leadership in Action

The purpose of this study was to describe the barriers and challenges school leaders face as they implement a standards-based grading (SBG) system. The researchers used a multiple case study methodology to investigate how key school leaders described their implementation journey at three schools that differed in size, demographics, and location. Purposeful sampling was used to identify key administrators at three different schools who were in the process of implementing a SBG system. Data were collected primarily via semi-structured interviews. In the analysis, researchers used three phases: horizontalization, thematizing, and textural-structural synthesis. Each of the three schools had very different …

Examining Effective Characteristics Of Professional Development In K-12 Education Since The Inception Of The No Child Left Behind Act Of 2002: A Meta-Analytic Investigation, Eugene M. Thomas, Karen H. Larwin

Journal of Educational Leadership in Action

With the dire financial crisis facing our national and state economy, schools are forced to reduce budgets while simultaneously improve program delivery. Professional development is the mechanism that is generally used to facilitate improving educational delivery and subsequently student achievement results. This investigation examines the influence of professional development on student achievement since No Child Left Behind. Results indicate that professional development can have a moderate impact on student achievement. A number of moderators were found to have a positive significant impact on this effect including the level of students, the duration of the professional development, the discipline area focus …

Professional Development: The Use Of Nonverbal Communication During Class Lecture, Dustin York

Journal of Educational Leadership in Action

Teachers’ nonverbal communication has a vital role within the classroom environment. This literary review examined (1) a historical perspective of teachers’ nonverbal communication, (2) the relationship between students’ perceptions of their learning and teachers’ nonverbal communication, (3) the relationship between standardized measurements of student learning and teachers’ nonverbal communication, and (4) the relationship between students’ perceptions of teacher credibility based on the teachers’ nonverbal communication. Findings in the literary study suggest that teachers’ nonverbal communication is beneficial to students’ academic success. This review has outlined elements of nonverbal communication a teacher could use to benefit student learning. Using the findings …

An Investigation Of Teacher Evaluation Systems And How They Can Be Transformed To Improve Teaching And Learning: A Change Leadership Plan, Kelly O'Brien

Dissertations

Numerous states have contributed to the overhaul of teacher evaluation systems by imposing mandatory guidelines for the development of new measures. The purpose of this Change Leadership plan was to build upon my research “Principal Perspectives on the Current State of the Art of Teacher Evaluations: A Program Evaluation” which revealed a need to investigate how teacher evaluation systems could be transformed by integrating technology to streamline the process and thus improve teaching and learning. Therefore, this Change Leadership plan aimed to address two important questions. How is technology being used within current teacher evaluation systems? Within current teacher evaluation …

Passnote: A Feedback Tool For Improving Student Success Outcomes, Bethany A. Croton, James E. Willis Iii, Jason D. Fish

Teaching and Learning Technologies Publications

When Purdue University faculty asked for assistance in composing feedback messages to students, Information Technology at Purdue (ITaP) developed PassNote, a feedback tool that integrates good practice into the process of providing formative assessments. PassNote gives faculty customizable feedback prompts (snippets) and lets them connect students with information and links to services such as tutoring,Supplemental Instruction, library resources, technology tools, and workshops. PassNote "message starters" are often incomplete, allowing instructors to include course-specific information such as office hours and departmental resources.

Project-Based Learning As A Means For Meeting The Needs Of 21st Century Students In Common Core States, Scott Ragsdale

Dissertations

The call for the reform of public education in the United States of America has come from stakeholders of all kinds. This study compares two seemingly opposing approaches to the reform of public education. The bureaucratic approach is represented by the mass adoption of the Common Core State Standards (CCSS). The grassroots approach is represented by the International Society for Technology in Education Standards for Students (ISTE Standards-S). It was important to identify and analyze an instructional practice with enough potential rigor to meet the demands of both the CCSS and the ISTE Standards-S. The study analyzed the potential ability …

Forgiveness Education And Bullying Prevention And Intervention: Benefits For Bullies, Victims And Schools, Amy Carlon, Suzanne Freedman, Nicole Skaar

Journal of Educational Leadership in Action

Over the past 50 years, attitudes toward incidences of bullying in the schools have shifted significantly. Previously, bullying was seen as an expected and normal part of a child's development and school experience. Some even believed bullying wasn't harmful, that it assisted in character-building, and was simply "part of growing up" (Smith & Brain, 2000, p. 3). In recent decades, however, the negative effects of bullying have been more widely recognized, and there is growing acceptance that experiences of bullying often lead to negative outcomes, such as poor physical and psychological health, for those who are victimized (Due et al., …

Thinking It Through: Australian Students’ Skills In Creative Problem Solving, Lisa De Bortoli, Greg Macaskill

OECD Programme for International Student Assessment (PISA) Australia

In every PISA survey, students from every participating country are assessed in the core domains of mathematics, science and reading literacy. In addition to assessing these literacy domains, the OECD proposes additional assessments in other domains. In PISA 2003, a paper-based assessment of cross- disciplinary problem solving was first assessed, when it was included as a core domain. In PISA 2012, problem solving was once again assessed, this time as an optional computer-based assessment.

The focus of the PISA 2012 assessment of problem solving was: Are today’s 15-year-old students acquiring the problem-solving skills that will prepare them to meet the …

Whispers Of Hope: Urban Christ-Centered Education, Kristy A. Brown

Dissertations, Theses and Capstone Projects

The purpose of this qualitative case study was to explore the culture of an urban Christ-centered day school. the participants in the study included five administrators, fourteen teachers, five staff members, two board members, two donors, six parents, twelve students, and three alumni. The data collection process included 49 semi-structured interviews, 20 participant observations, and seven documents that were analyzed. By using a critical ethnographic lens, this study was able to identify how Freedom Academy integrated a Christian worldview, used the ethic of care, and implemented culturally relevant pedagogy into the curriculum. By combining these characteristics, Freedom Academy demonstrated their …

Validation Of The Scores Of The Instructional Pedagogical And Instructional Student Engagement Components Of Fidelity Of Implementation, Sandra F. Naoom

USF Tampa Graduate Theses and Dissertations

Students cannot benefit from what they do not experience. Multiple reasons exist for why an intervention may not be delivered as it was designed. In this era of educational accountability and limited dollars to go around, understanding how an intervention is delivered in the classroom is key to understanding program outcomes. In order to assess whether a program has been implemented as intended, an assessment of fidelity is needed. However assessing fidelity is complex given varying conceptual interpretations, which then fosters inconsistent application of methods to measure the construct. Additionally the methods for validating fidelity measures are still unclear. The …

Schools Of Innovation, Sarah C. Mckenzie, Gary W. Ritter

Policy Briefs

Act 601, passed in April 2013, allows for schools to apply to become “schools of innovation.” Accepted schools receive flexibility from certain regulations in order to facilitate the use of innovative approaches to teaching and learning. In this policy brief, we discuss the history of Act 601, similar models in other states and their results, the application and approval process, the 2014-15 schools of innovation, and the role of the Office of Innovation for Education in supporting schools of innovation.

Providing The Fuel (And Passing The Flame), Todd Pagano

Journal of Science Education for Students with Disabilities

At the risk of opening with a cliché statement- at the heart of the most effective mentor is a burning passion. The fuel for this passion is a desire to convince, not just try to, but actually convince your mentee that you care about their success (be it in the classroom, career, or personal life). I am guilty of believing in, and living by, this cliché. However, despite passion being my primary motivator, I am not unwilling to admit that rationale for mentoring can sometimes transcend this ethically normative line of thinking. I believe that there are also sometimes quantitative, …

Ex Ovo Omnia, Todd Pagano

Journal of Science Education for Students with Disabilities

One of history’s most diverse thinkers metaphorically depicted humanity’s dangerous reliance on nonrenewable energy resources as an unborn chick in an egg. American philosopher, poet, scientist, and mathematician, Buckminster Fuller, described the nutrients in an egg as the temporary and extinguishable support required for the development of an unhatched chick. Once the nutrients are depleted, the chick must break from its shell and cultivate its own mechanism for survival. Symbolically, he explained that the human population must view the use of earth’s finite resources as the nutriment in an egg that can be provisionally relied upon in order to provide …