Education Commons^™

Examining The Effect Of Item-Writing Flaws On The Psychometric Parameters Of Pharmacy Therapeutics Examinations, Veronica P. Shuford

Theses and Dissertations

Colleges and schools of pharmacy (C/SOP) use direct measures of assessment to provide evidence of student learning, with multiple-choice questions (MCQs) being one the most common formats used in health sciences education to assess students’ knowledge, skills, and abilities (Pate & Caldwell, 2014). This study examined the occurrence of item-writing flaws (IWFs) in the Clinical Therapeutics Module (CTM) sequence of courses at a college of pharmacy at an academic health center in the southeastern United States. The goals of the study were to: (1) identify the most common item-writing flaws on examinations in the CTM sequence of courses, (2) determine …

The Effect Of Item Stem And Response Option Length On The Item Analysis Outcomes Of A Career And Technical Education Multiple Choice Assessment, Tina M. Koepf

Dissertations

Critical decisions in Career and Technical Education (CTE) can be based on assessment outcomes, requiring an essential focus on continuous improvement initiatives to provide increased multiple choice (MC) assessment validity. Previous research has determined that the presence of flawed test items negatively impacts student success; therefore, an MC taxonomy has been established and used in the assessment industry. While rigorous and successful Career and Technical Education (CTE) programs that enroll high-level academic students exist, many CTE programs enroll students with a wide spectrum of academic ability. Because many CTE students often have inferior reading skills, it is necessary to take …

An Investigation Of Subtest Score Equating Methods Under Classical Test Theory And Item Response Theory Frameworks, Minjeong Shin

Doctoral Dissertations

Test scores are usually equated only at the total score level. If a test mainly measures a single trait, indicating that the test is essentially unidimensional, equating at the total score level could be the best choice. However, when a test is composed of subtests having negligible relationships among them, separate equating for each subtest offers the best choice. Given a moderate amount of correlations among the subtests, performing individual equating for each subtest may be misleading in that it ignores the relationship of the subtests. This study applied and compared several possible subtest score equating methods based on classical …

Evaluating Irt- And Ctt-Based Methods Of Estimating Classification Consistency And Accuracy Indices From Single Administrations, Nina Deng

Open Access Dissertations

Three decision consistency and accuracy (DC/DA) methods, the Livingston and Lewis (LL) method, LEE method, and the Hambleton and Han (HH) method, were evaluated. The purposes of the study were (1) to evaluate the accuracy and robustness of these methods, especially when their assumptions were not well satisfied, (2) to investigate the " true" DC/DA indices in various conditions, and (3) to assess the impact of choice of reliability estimate on the LL method.

Four simulation studies were conducted. Study 1 looked at various test lengths. Study 2 focused on local item dependency (LID). Study 3 checked the consequences of …

The Longitudinal Factor Structure Of Parent Involvement And Its Impact On Academic Achievement: Findings From The Ecls-K Dataset, Hui-Fang Chen

Electronic Theses and Dissertations

The critical role of parent involvement has been endorsed by educators and educational policy in the United States. However, various definitions and approaches to assess parent involvement have yielded inconsistent conclusions regarding the impact of parent involvement on child development and failed to provide foundations for practitioners. These contradictory findings, at least in part, reflected that parent involvement is a multidimensional construct which should be captured by many behaviors and activities as well as the limitations of using classical test theory to develop/identify items to assess parent involvement.

This study conducted both CTT and IRT to identify optimal items for …