Educational Assessment, Evaluation, and Research Commons^™

Editor's Note, Jonathan Silin

Occasional Paper Series

No abstract provided.

Understanding Teacher Turnover In Two Charter Schools: Principal Dispositions And Practices, Dana L. Bickmore, Margaret Mary Sulentic Dowell

Educational Psychology, Leadership, and Higher Education Faculty Research

US charter schools experience higher rates of teacher turnover than traditional public schools. The purpose of this study was to examine charter principals’ professional dispositions and practices that might contribute to teacher turnover. Specifically we asked – How do charter school principal professional dispositions and practices affect school working conditions and impact teacher commitment to remain or leave a charter schools? The study design was an embedded three-year case study of principal leadership in two charter schools. Data sources included principal and teacher interviews, school observations, and artifacts. Themes were derived from two constant comparative analyses, one of principal dispositions, …

What Remuneration Levels Should Apply To Highly Accomplished And Lead Teacher Certification, Lawrence Ingvarson

Teacher workforce and careers

This expert witness report was commissioned by the Queensland Teachers’ Union in April, 2018 as part of evidence to be presented in a submission to the Queensland Industrial Relations Commission. The purpose of this report was to review research that would assist the Commission in arriving at its decision regarding appropriate remuneration levels for certified Highly Accomplished and Lead Teachers.

High School Options And Post-Secondary Student Success: The Catholic School Advantage, David J. Fleming, Stéphane Lavertu, William Crawford

Journal of Catholic Education

Recognizing that post-secondary student attainment and achievement is of increasing import for economic success, this study compares the post-secondary performance of students who attended public and private high schools. The results generally indicate that students who attended Catholic high schools had higher college GPAs, were more likely to graduate, and were more likely to graduate with a STEM degree. This Catholic school advantage was wide-ranging, benefiting many subgroups of students, including non-white, low income, urban, and low-achieving students. We controlled for a rich set of factors and conducted sensitivity analyses to establish the strength of these results.

Outstanding Educational Performance Awards: Highlighting High-Growth Arkansas Schools, 2017, Charlene A. Reid, Sarah C. Mckenzie

Arkansas Education Reports

This section highlights high-growth schools across Arkansas based on the ACT Aspire examinations in Math and English Language Arts (ELA) for the 2016-2017 academic year. For these awards, we consider schools that serve free or reduced lunch to at least 66% of the student body. High-poverty schools are ranked by school level (Elementary, Middle, or High) based on Overall Growth (Math and ELA combined), as well as for growth in each content area independently. High-poverty schools are also ranked within each region of the state. Tables include the region in which the school is located, the number of test takers, …

Traversing Across Learning Environments And The Need For A Single Data Standard In Digital Learning Environments, Liam Mcnamara

Current Issues in Emerging eLearning

As Big Data becomes ever present in many industries, in education it presents a particularly interesting problem as many technologies begin to develop, data standards become variant. This raises the issue that ad-hoc data standards present discontinuity across platforms particularly in the analysis and interpretation of data collected in Personalised Learning Environments. This presents an ethical dilemma when this data becomes actionable and active in decision making regarding a learners’ progress and advancement. This article asserts that there exists a hypothetical dilemma in the predicament that ad-hoc data standards result in potentially misleading or erroneous interpretations that have longitudinal effects …

Covariates In Factor Mixture Modeling: Investigating Measurement Invariance Across Unobserved Groups, Yan Wang

USF Tampa Graduate Theses and Dissertations

Factor mixture modeling (FMM) has been increasingly used to investigate unobserved population heterogeneity. This Monte Carlo simulation study examined the issue of measurement invariance testing with FMM when there are covariate effects. Specifically, this study investigated the impact of excluding and misspecifying covariate effects on the class enumeration and measurement invariance testing with FMM. Data were generated based on three FMM models where the covariate had impact on the latent class membership only (population model 1), both the latent class membership and the factor (population model 2), and the latent class membership, the factor, and one item (population model 3). …

Designing Rubrics For Authentic Assessment, Kathryn Richardson, Anne-Marie Chase

Initial Teacher education

This presentation looks at the steps in developing authentic rubrics, from determining the constructs that will be assessed; breaking down the constructs into a set of broad capabilities that need to be observed; transferring capabilities into indicative behaviours (indicators or criteria); and determining the different levels of proficiency.

Infographic: Indicators Of Student Engagement, Dominique Russell

Teacher infographics

The Western Australian Government recently surveyed 1812 students across Years 3 to 12 on student engagement. Here, we look at some of the results of this survey for students in Years 7 to 12.

Outstanding Educational Performance Awards: Highlighting High-Growth Arkansas, Schools, 2017, Charlene A. Reid, Gary W. Ritter

Arkansas Education Reports

This section highlights [high] schools across the state whose students demonstrated high growth on the Arkansas ACT Aspire exams. The ACT Aspire was administered to students in grades [7] through [12] in April 2017 in Math and ELA courses which include English, Writing, and Reading.

Does Audience Matter? Comparing Teachers' And Non-Teachers' Application And Perception Of Quality Rubrics For Evaluating Open Educational Resources, Min Yuan, Mimi Recker

Instructional Technology and Learning Sciences Faculty Publications

While many rubrics have been developed to guide people in evaluating the quality of Open Educational Resources (OER), few studies have empirically investigated how different people apply and perceive such rubrics. This study examines how participants (22 teachers and 22 non-teachers) applied three quality rubrics (comprised of a total of 17 quality indicators) to evaluate 20 OER, and how they perceived the utility of these rubrics. Results showed that both teachers and non-teachers found some indicators more difficult to apply, and displayed different response styles on different indicators. In addition, teachers gave higher overall ratings to OER, but non-teachers' ratings …

Pre-Service Teachers’ Perspectives On How The Use Of Toon Comic Books During Guided Reading Influenced Learning By Struggling Readers, Ewa Mcgrail, Alicja Rieger, Gina M. Doepker, Samantha Mcgeorge

SANE journal: Sequential Art Narrative in Education

The study presented in this article examines the use of comic books, specifically the TOON comic books during guided reading instruction. The instruction was provided to struggling readers by the Literacy Center at a comprehensive university in southeastern United States. What most pre-service teachers in this study agreed upon was that comic books served as an effective tool for getting their students interested in reading. Reading comic books with tutors as partners in conversation with the struggling readers in this study was also a powerful medium for facilitating students’ literacy skills development, particularly in the areas of reading fluency and …

From Access To Quality: Improving Learning Outcomes In South Asia, Amit Kaushik

International Developments

ACER India is working with partners across South Asia to ensure inclusive and quality education for all. Amit Kaushik reports on progress.

Implementing Large-Scale Education Assessments, Geoff N. Masters

International Developments

ACER is helping education researchers, policymakers and practitioners understand the issues related to the inception, design, implementation and reporting of large-scale education assessments, as Geoff Masters explains.

A Review Of Tools And Techniques For Data-Enabled Formative Assessment, Rob Nyland

University Author Recognition Bibliography: 2018

The purpose of this literature review is to understand the current state of research on tools that collect data for the purpose of formative assessment. We were interested in identifying the types of data collected by these tools, how these data were processed, and how the processed data were presented to the instructor or student for the purpose of formative assessment. We identified two categories of data: machine graded and activity stream data. The data were processed using three methods: unprocessed activity streams, descriptive data analysis, and data mining. Processed data were presented to students through reports and real-time feedback, …

A Mixed Methods Comparative Analysis Of The Implementation Of The Multi-Tiered Systems Of Support In Missouri Elementary Public Schools, Laura Smith

Dissertations

This study consisted of a mixed-methods comparative analysis of the implementation of the Multi-Tiered Systems of Support (MTSS) in public school districts in the state of Missouri. The researcher surveyed nine public school districts similar in demographics of socio-economic representation, free and reduced lunch percentage, and average daily fund expended to educate students. One district administrator responsible for the implementation of MTSS represented each school district. In the qualitative component of the study, the researcher utilized an original electronic survey to gather insights into the unique implementation path each district employed. Coding and analysis resulted in identification of themes, similarities, …

Faculty Development Initiatives: A Prerequisite For Capacity Building And Enhanced Productivity In A Medical Institution, Rehana Rehman, Hassan Mehmood, Syeda Fatima, Irfanullah Baig, Zohaib Rana, Mohammad Iqbal

Department of Biological & Biomedical Sciences

Objective: To determine the contribution of teaching, learning and assessment forum's initiatives on professional development of faculty and staff.
Methods: This retrospective study was conducted at the Department of Biological and Biomedical Sciences, Aga Khan University, Karachi, from July to December 2016, and comprised teaching, learning and assessment activities carried out from 2012 to 2015. The responses acquired from feedback evaluation were recorded at the end of activity on a Likert-type scale ranging from 1-5. Positive responses were presented for each variable with respective activity type across the study years. The association of the effectiveness of teaching, learning …

Polycommit: Building Better Habits Through Gamification, Elliot Fiske

Master's Theses

Computer-assisted learning is older than Turing machines, and constantly evolves as technology improves. While some teachers are resistant to using technology in the classroom, “e-learning” techniques are becoming more common in almost every school, from K-12 to universities. As technology becomes more widespread, it becomes crucial to examine the various methodologies of computer-assisted learning and find the techniques that are most effective.

This paper explores the effectiveness of one such methodology, spaced repetition. This technique applies to homework assignments available to students online. We include an exploration of several existing apps that use this technique, and introduce our own novel …

Explanatory Case Study: Transitions Of Highly Mobile Students From Military Families To Public Non-Military Elementary Schools, Courtney Williams

CUP Ed.D. Dissertations

The purpose of this explanatory case study is to review the supports provided by public elementary schools for highly mobile students from military families. When military families are uprooted and move to new locations, the children are forced to form new social ties as well as adapt to a new curriculum and learning objectives. The research questions that were addressed in the research for this study included: (a) How are issues of military mobility addressed at the study school sites so students are academically and socially successful? (b) What problems are noted by school staff when working with highly mobile …

The Effects Of An Elementary Stem Intervention On Fourth-Grade Outcomes In Language Arts And Math, Rhonda Stitham

CUP Ed.D. Dissertations

The purpose of this study was to examine if a relationship existed between two schools with regard to science, technology, engineering, and math (STEM) and the growth scores from the Northwest Evaluation Assessment (NWEA). The research questions that guided this study were: (a) To what extent, if any, will students that have STEM intervention one day per week demonstrate increased NWEA English language scores on state tests? and (b) To what extent, if any, will students that have STEM intervention one day per week demonstrate increased NWEA mathematics scores on state tests? Kinesthetic learning was used to develop an understanding …

Five Years Of Video-Based Assessment Data: Lessons From A Teacher Education Program, Peter D. Wiens, Matthew D. Gromlich

Teaching and Learning Faculty Research

Teacher education programs are under considerable pressure to evaluate their effectiveness in training new teachers. Over the last several decades there have been repeated calls for more systematic research on preservice teacher preparation programs. One institution has heeded this call, using the Video Assessment of Interactions and Learning (VAIL: Jamil, Sabol, Hamre, & Pianta, 2015) to annually assess teacher noticing of teacher student interactions in preservice teachers. While there was no significant difference in first-test and last-test VAIL scores, VAIL scores were shown to be related to final college GPA. Additionally, there was a difference in student effort on the …

District-Wide Instructional Initiative Framework, Jessica Charles, Tracy Fray Oliver, Doug Knecht, Emily Sharrock

All Faculty and Staff Papers and Presentations

Describes the Bank Street Education Center's District-wide Instructional Initiative Framework, a tool that guides the Center's partnership work with school districts who are engaged in a process of instructional improvement. The Framework was developed out of research on district improvement, organizational development, school leadership, and professional learning, as well as the Center's own experience implementing large-scale district reform in the largest school district in the nation: New York City.

The Effect Of Animated Self-Concept Videos On Hispanic Fifth-Grade Students Self-Concept, Richard Hill

Doctoral Dissertations and Projects

Studies have documented a major downturn in the self-concept of fifth-grade students as they transition to middle school (Twenge & Crocker, 2000). Two of the major risk factors are being female and Hispanic (Cavazos-Rehg & DeLucia-Waa, 2009). Various interventions have been tried with limited success. The purpose of the present study is to use an animated self-concept video series to test if an animated self-concept video series could support and/or increase the self-concept of fifth-grade students, particularly those in the Hispanic and female risk categories. The study population (N = 192) was a convenience sample drawn from a sample size …

A Phenomenological Study Of Educators' Perspectives Of School Climate In Secondary Schools Implementing Positive Behavior Intervention And Support, Tory Lawrence

Doctoral Dissertations and Projects

Positive Behavior Intervention and Support (PBIS) is a school-wide initiative implemented in many schools across the United States as an approach for addressing discipline concerns and promoting a positive school climate. This study used a phenomenological design to examine the school climate perceptions of 13 staff member from three secondary schools from two school districts in the southeastern region of North Carolina that were implementing PBIS with fidelity. The transformative learning theory, which explains how knowledge may be obtained from lived experiences of individuals, guided the research study in examining three research questions: (a) How do select secondary school staff …

Exploring The Relationship Between Students' Sense Of Community, Student Satisfaction, And Doctoral Program Retention, Adam Roberson

Doctoral Dissertations and Projects

This is a study examining the interaction between certain doctoral student engagement indicators (peer, institution, curriculum, faculty, spirituality) and student satisfaction. The scope is to understand if student sense of community is a significant moderator to this interaction in order to address the issue of student attrition. It is important to understand these interactions and the influence of sense of community so that institutions of higher education better analyze student commitment. The outcomes of this study may be used as a means to design and implement engagement strategies that are effective in student retention and completion. Doctoral students were invited …

Poverty And Empowerment Discourse In Utah Dual Immersion Classrooms, Lauren Johnson

Undergraduate Honors Theses

This paper considers the discourse, or communication, that occurs in dual immersion programs in Utah. I take a sociocultural perspective to address the question of whether and how these programs are meeting the unique needs of the students enrolled in them. I consider two tasks frequently viewed in five consecutive days of filming: mirroring/repeated phrases and partner talk. Findings suggest that although they have promise, they often do not meet the intended aims of comprehension and language development. The findings also show that these tasks do little to empower participants. The conclusions and implications suggest that commonly accepted tasks in …

Understanding The Learning & Advocacy Needs Of A Twice-Exceptional Student Through A Strengths-Based Lens: A Case Study In California, Lisa Krausz

Dissertations, Masters Theses, Capstones, and Culminating Projects

Twice-exceptional students possess both high ability and learning disabilities. The complex interaction of their gifts and disabilities perplexes both educators and parents. Educators often use a deficit approach when working with these learners; new research calls for multi-dimensional, strengths-based approaches to engage these students. Strengths-based approaches draw upon student strengths, interests, and talents to help address their disabilities. In this study, information was gathered from a mixed-methods, strengths-based approach to gauge a student’s strengths, interests, talents and disabilities to add to the research on traditional assessment and intervention approaches. The researcher also explored how parents’ understanding of their child aligned …

Effectiveness Of Bite-Sized Lecture On Student Learning Outcomes, Noi Sian Koh, Swapna Gottipati, Venky Shankararaman

Research Collection School Of Computing and Information Systems

Bite-Sized teaching approach uses relatively small learning units with short term focused activities. The paper presents the effectiveness of Bite-Sized lecture pedagogy on learning outcomes for an analytics course offered by the School of Information Technology at Nanyang Polytechnic. The methodology involves breaking a typical 1 hour lecture into 3 to 4 short lectures followed by related tutorial / practical exercises relevant to each respective short lecture. The results from the exercises shows statistically significant improvements in the assessed learning outcomes for the Bite-Sized lecture over the traditional one hour lecture. 75% of the surveyed respondents agreed that the speed …

Pink And Dude Chefs: Effectiveness Of An After-School Nutrition Knowledge And Culinary Skills Program For Middle School Students To Increase Fruit And Vegetable Consumption, Alyssa S. Vaziri

Master's Theses

The rate of overweight and obesity among adolescents aged 12-19 years has more than tripled since 1980, and disproportionately impacts low-income and marginalized populations. Reduction in adolescent obesity rates may result in decreased health risks, decrease healthcare costs, and increased quality of life. Effective intervention methods for adolescent participants have incorporated nutrition knowledge and culinary skill building into afterschool programs. This study examines whether building knowledge, skills, and confidence through a culinary intervention can improve adolescent participants’ choices of healthful foods through increased fruit and vegetable intake.

Pink and Dude Chefs (PDC) is an afterschool nutrition education and culinary skills …

The Trade-Off Between Graduate Student Research And Teaching: A Myth?, Erin E. Shortlidge, Sarah L. Eddy

Biology Faculty Publications and Presentations

Many current faculty believe that teaching effort and research success are inversely correlated. This trade-off has rarely been empirically tested; yet, it still impedes efforts to increase the use of evidence-based teaching (EBT), and implement effective teaching training programs for graduate students, our future faculty. We tested this tradeoff for graduate students using a national sample of life science PhD students. We characterize how increased training in EBT impacts PhD students' confidence in their preparation for a research career, in communicating their research, and their publication number. PhD students who invested time into EBT did not suffer in confidence in …