Education Commons^™

I’Ve (Urn)Ed This: An Application And Criterion-Based Evaluation Of The Urnings Algorithm, Ted Daisher

Doctoral Dissertations

There is increased interest in personalized learning and making e-learning environments more adaptable. Some e-learning systems may use an Item Response Theory (IRT)-based assessment system. An important distinction between assessment and learning contexts is that learner proficiency is expected to remain constant across an assessment, while it is expected to change over time in a learning context. Constant learner proficiency during an assessment enables conventional approaches to estimating person and item parameters using IRT. These IRT-based systems could be abandoned for alternative approaches to modeling learners and system learning content, but assessments may provide more functions than adapting learning material …

Bringing Learning Back In: Examining Three Psychometric Models For Evaluating Learning Progression Theories, Duy Pham

Doctoral Dissertations

Learning progressions provide potentially valuable information to teachers about how to develop a scope and sequence for a group of learning objectives. However, for the learning progressions to be valuable, the progressions must be supported. Although there are several approaches and models that can be used to evaluate the validity of a learning progression, there is a dearth of research examining the advantages and limitations of each approach. The purpose of this study was to examine a multi-dimensional item response theory model and two cognitive diagnostic models (DINA and HO-DINA) for evaluating two learning progressions via a simulation study. In …

Evaluating Irt- And Ctt-Based Methods Of Estimating Classification Consistency And Accuracy Indices From Single Administrations, Nina Deng

Open Access Dissertations

Three decision consistency and accuracy (DC/DA) methods, the Livingston and Lewis (LL) method, LEE method, and the Hambleton and Han (HH) method, were evaluated. The purposes of the study were (1) to evaluate the accuracy and robustness of these methods, especially when their assumptions were not well satisfied, (2) to investigate the " true" DC/DA indices in various conditions, and (3) to assess the impact of choice of reliability estimate on the LL method.

Four simulation studies were conducted. Study 1 looked at various test lengths. Study 2 focused on local item dependency (LID). Study 3 checked the consequences of …