Open Access. Powered by Scholars. Published by Universities.®

Education Commons

Open Access. Powered by Scholars. Published by Universities.®

Articles 1 - 6 of 6

Full-Text Articles in Education

Developing Reading Instruction Observation Protocols For Special Education Teachers, Laura Ann Moylan May 2021

Developing Reading Instruction Observation Protocols For Special Education Teachers, Laura Ann Moylan

Boise State University Theses and Dissertations

Considerable resources have been invested in identifying effective reading instruction methods for students with disabilities. Unfortunately, students are not routinely receiving instruction aligned with these practices, impacting their ability to reach their potential. To improve reading instruction, teachers need to receive observation feedback and evaluations reflecting instructional practices shown to be effective. One way to ensure teachers are provided with feedback consistent with evidence based reading instruction is to develop observation protocols aligned to these practices. This dissertation addresses this problem with three distinct, yet interconnected, articles detailing the development of reading instruction observation protocols designed to provide accurate teacher …


Validity Of A Special Education Teacher Observation System, Evelyn S. Johnson, Angela Crawford, Laura A. Moylan, Yuzhu Zheng Jan 2020

Validity Of A Special Education Teacher Observation System, Evelyn S. Johnson, Angela Crawford, Laura A. Moylan, Yuzhu Zheng

Early and Special Education Faculty Publications and Presentations

This manuscript describes the comprehensive validation work undertaken to develop the Recognizing Effective Special Education Teachers (RESET) observation system, which was designed to provide evaluations of special education teachers’ ability to effectively implement evidence-based practices and to provide specific, actionable feedback to teachers on how to improve instruction. Following the guidance for developing effective educator evaluation systems, we employed the Evidence-Centered Design framework, articulated the claims and inferences to be made with RESET, and conducted a series of studies to collect evidence to evaluate its validity. Our efforts and results to date are described, and implications for practice and further …


Variance And Reliability In Special Educator Observation Rubrics, Angela R. Crawford, Evelyn S. Johnson, Laura A. Moylan, Yuzhu Zheng Dec 2019

Variance And Reliability In Special Educator Observation Rubrics, Angela R. Crawford, Evelyn S. Johnson, Laura A. Moylan, Yuzhu Zheng

Early and Special Education Faculty Publications and Presentations

This study describes the development and initial psychometric evaluation of the Recognizing Effective Special Education Teachers (RESET) observation instrument. The study uses generalizability theory to compare two versions of a rubric, one with general descriptors of performance levels and one with item-specific descriptors of performance levels, for evaluating special education teacher implementation of explicit instruction. Eight raters (four for each version of the rubric) viewed and scored videos of explicit instruction in intervention settings. The data from each rubric were analyzed with a four facet, crossed, mixed-model design to estimate the variance components and reliability indices. Results show lower unwanted …


Developing An Explicit Instruction Special Education Teacher Observation Rubric, Evelyn S. Johnson, Yuzhu Zheng, Angela R. Crawford, Laura A. Moylan May 2019

Developing An Explicit Instruction Special Education Teacher Observation Rubric, Evelyn S. Johnson, Yuzhu Zheng, Angela R. Crawford, Laura A. Moylan

Early and Special Education Faculty Publications and Presentations

In this study, we developed an Explicit Instruction special education teacher observation rubric that details the elements of explicit instruction, and tested its psychometric properties using many-faceted Rasch measurement (MFRM). Video observations of classroom instruction from 30 special education teachers across three states were collected. External raters (n = 15) were trained to observe and evaluate instruction using the rubric, and assigned scores of ‘implemented’, ‘partially implemented’ or ‘not implemented’ for each of the items. Analyses showed that the item, teacher, lesson and rater facets achieved high psychometric quality for the instrument. Implications for research and practice are discussed.


Developing A Comprehension Instruction Observation Rubric, Evelyn S. Johnson, Laura A. Moylan, Angela Crawford, Yuzhu Zheng Jan 2019

Developing A Comprehension Instruction Observation Rubric, Evelyn S. Johnson, Laura A. Moylan, Angela Crawford, Yuzhu Zheng

Early and Special Education Faculty Publications and Presentations

In this study, we developed a Reading for Meaning special education teacher observation rubric that details the elements of evidence-based comprehension instruction and tested its psychometric properties using many-faceted Rasch measurement (MFRM). Video observations of classroom instruction from 10 special education teachers across three states during the 2015- 16 school year were collected. External raters (n=4) were trained to observe and evaluate instruction using the rubric, and assign scores of ‘implemented’, ‘partially implemented’ or ‘not implemented’ for each of the items. Analyses showed that the item, teacher, lesson and rater facets achieved high psychometric quality for the instrument. Teacher performance …


Examining Interrater Agreement Analyses Of A Pilot Special Education Observation Tool, Evelyn S. Johnson, Carrie L. Semmelroth Nov 2012

Examining Interrater Agreement Analyses Of A Pilot Special Education Observation Tool, Evelyn S. Johnson, Carrie L. Semmelroth

Early and Special Education Faculty Publications and Presentations

This paper reports the results of interrater agreement analyses on a pilot special education teacher evaluation instrument, the Recognizing Effective Special Education Teachers (RESET) Observation Tool (OT). Using evidence-based instructional practices as the basis for the evaluation, the RESET OT is designed for the spectrum of different instructional needs found within special education classrooms. The RESET OT informs what Danielson (2011) maintains are the two features of a teacher evaluation system 1) ensuring teacher quality and 2) promoting professional development. In June 2012, six special education teachers participated in a data coding session using the pilot RESET OT to evaluate …