Open Access. Powered by Scholars. Published by Universities.®

Education Commons

Open Access. Powered by Scholars. Published by Universities.®

Theses/Dissertations

Doctoral Dissertations

Educational Assessment, Evaluation, and Research

Decision Accuracy

Publication Year

Articles 1 - 2 of 2

Full-Text Articles in Education

Investigation Repeater Effects On Small-Sample Equating: Include Or Exclude?, Hongyu Diao Jul 2018

Investigation Repeater Effects On Small-Sample Equating: Include Or Exclude?, Hongyu Diao

Doctoral Dissertations

In licensure testing programs, some examinees might attempt the test multiple times till they are satisfied with their final score, those who take the same test repeatedly are referred to as repeaters. Previous studies suggested that repeaters should be removed from the total sample before implementing equating procedures for two reasons: 1) repeater group is distinguishable from the non-repeater group and the total group, 2) repeaters may memorize anchor items and cause an item drift in common items in the non-equivalent anchor test (NEAT) design. However, removing repeaters might not be the best solution if the testing program only has …


Subscore Reliability And Classification Consistency: A Comparison Of Five Methods, Fen Fan Nov 2016

Subscore Reliability And Classification Consistency: A Comparison Of Five Methods, Fen Fan

Doctoral Dissertations

Previous studies focused on reporting subscores themselves; however, most proficiency tests are criterion-referenced, reporting classification consistency and accuracy of student placement into performance categories within each subdomain are thus more suitable. Therefore, the primary purpose of this study was to investigate the decision consistency (DC) and decision accuracy (DA) of student placement into performance categories within each of the subdomains measured by the test of interest. A second purpose of this study was to compare the performance of five subscoring methods under some realistic conditions in terms of subscore reliability and classification. To do so, a simulation study was designed …