Open Access. Powered by Scholars. Published by Universities.®

Education Commons

Open Access. Powered by Scholars. Published by Universities.®

PDF

Dissertations

Theses/Dissertations

Western Michigan University

2014

Educational Assessment, Evaluation, and Research

Item keys

Articles 1 - 1 of 1

Full-Text Articles in Education

A Monte Carlo Study Of The Optimal Rank Order Relationship With Criterion Scores, Hongyan Cui Dec 2014

A Monte Carlo Study Of The Optimal Rank Order Relationship With Criterion Scores, Hongyan Cui

Dissertations

Appropriate scoring methods for tests should be based on theories of the construct domains of such tests (Messick, 1989). This is called structural fidelity (Loevinger, 1957), a necessary but not sufficient condition for construct validity (Keith & Kranzler, 1999). A situation reaction test (SRT) consists of items with alternatives to be ranked according to subjects’ best judgment. Traditional rank scoring methods assume unidimensionality, implying one scoring key for each item – a single external criterion. This is not appropriate when items elicit multidimensional responses determined by subjects’ best judgments based on possibly multiple internal criteria. The purpose of this study …