Open Access. Powered by Scholars. Published by Universities.®

Education Commons

Open Access. Powered by Scholars. Published by Universities.®

Educational Psychology

Brigham Young University

Reliability

Articles 1 - 5 of 5

Full-Text Articles in Education

The Effect Of Raters And Rating Conditions On The Reliability Of The Missionary Teaching Assessment, Abigail Christine Ure Dec 2010

The Effect Of Raters And Rating Conditions On The Reliability Of The Missionary Teaching Assessment, Abigail Christine Ure

Theses and Dissertations

This study investigated how 2 different rating conditions, the controlled rating condition (CRC) and the uncontrolled rating condition (URC), effected rater behavior and the reliability of a performance assessment (PA) known as the Missionary Teaching Assessment (MTA). The CRC gives raters the capability to manipulate (pause, rewind, fast-forward) video recordings of an examinee's performance as they rate while the URC does not give them this capability (i.e., the rater must watch the recording straight through without making any manipulations). Few studies have compared the effect of these two rating conditions on ratings. Ryan et al. (1995) analyzed the impact of …


Investigating The Reliability And Construct Validity Of A Measure Of Preservice Teachers' Self-Efficacy For Tpack, Nicolette Michelle Smith Jul 2010

Investigating The Reliability And Construct Validity Of A Measure Of Preservice Teachers' Self-Efficacy For Tpack, Nicolette Michelle Smith

Theses and Dissertations

The TPACK framework is becoming increasingly pervasive in teacher education. Researchers and practitioners have been seeking reliable and valid ways to measure the constructs associated with the TPACK framework. This study describes the results of both an item review and the reliability and construct validity investigation of the scores from an instrument measuring self-efficacy for the constructs in the TPACK framework. Content-matter experts and the literature were used in order to perform the item review, while both an exploratory and a confirmatory factor analysis were performed in order to assess construct validity. Cronbach's alpha and Raykov's rho were used to …


Estimating The Reliability Of Concept Map Ratings Using A Scoring Rubric Based On Three Attributes, Laura Jimenez Jul 2010

Estimating The Reliability Of Concept Map Ratings Using A Scoring Rubric Based On Three Attributes, Laura Jimenez

Theses and Dissertations

Concept maps provide a way to assess how well students have developed an organized understanding of how the concepts taught in a unit are interrelated and fit together. However, concept maps are challenging to score because of the idiosyncratic ways in which students organize their knowledge (McClure, Sonak, & Suen, 1999). The construct a map or C-mapping" task has been shown to capture students' organized understanding. This "C-mapping" task involves giving students a list of concepts and asking them to produce a map showing how these concepts are interrelated. The purpose of this study was twofold: (a) to determine to …


Reliability Of Pre-Service Physical Education Teachers' Coding Of Teaching Videos Using Studiocode Analysis Software, Keven Prusak, Brigham Dye, Charles R. Graham, Susan Graser Jan 2010

Reliability Of Pre-Service Physical Education Teachers' Coding Of Teaching Videos Using Studiocode Analysis Software, Keven Prusak, Brigham Dye, Charles R. Graham, Susan Graser

Faculty Publications

This study examines the coding reliability and accuracy of pre-service teachers in a teaching methods class using digital video (DV)-based teaching episodes and Studiocode analysis software. Student self-analysis of DV footage may offer a high tech solution to common shortfalls of traditional systematic observation and reflection practices by increasing the amount, timeliness, and accuracy of performance feedback. What is yet to be determined is whether students can reliably and accurately analyze such footage. Using Studiocode software, student analyses were compared to those of experts to determine coding reliability and content accuracy. The results of this study indicate that with less …


Reliability Of Pre-Service Teachers Coding Of Teaching Videos Using Video-Annotation Tools, Brigham R. Dye Jul 2007

Reliability Of Pre-Service Teachers Coding Of Teaching Videos Using Video-Annotation Tools, Brigham R. Dye

Theses and Dissertations

Teacher education programs that aspire to helping pre-service teachers develop expertise must help students engage in deliberate practice along dimensions of teaching expertise. However, field teaching experiences often lack the quantity and quality of feedback that is needed to help students engage in meaningful teaching practice. The limited availability of supervising teachers makes it difficult to personally observe and evaluate each student teacher's field teaching performances. Furthermore, when a supervising teacher debriefs such an observation, the supervising teacher and student may struggle to communicate meaningfully about the teaching performance. This is because the student teacher and supervisor often have very …