Open Access. Powered by Scholars. Published by Universities.®
- Institution
- Publication
- Publication Type
Articles 1 - 5 of 5
Full-Text Articles in Education
Assessing Differential Item Functioning And Differential Test Functioning In An Academic Motivation Scale Using Item Response Theory Methods, Gerald J. Bean
Assessing Differential Item Functioning And Differential Test Functioning In An Academic Motivation Scale Using Item Response Theory Methods, Gerald J. Bean
International Journal of School Social Work
Social work researchers and practitioners who use measurement instruments to make data-informed decisions need to ensure those decisions are based on items and scales that are free from possible bias or undesirable differential functioning. In this study, we provide an example of how a set of Item Response Theory (IRT) statistical methods and tools can be used by social work measurement researchers to assess differential item (DIF) and scale (DTF) functioning. For the example, we explored the possible race, gender, and family composition differential functioning of a scale—the Academic Motivation Scale (AMS)—developed for use by school social workers. The data …
Development And Validation Of The Statistics Assessment Of Graduate Students, Dammika Lakmal Walpitage
Development And Validation Of The Statistics Assessment Of Graduate Students, Dammika Lakmal Walpitage
Doctoral Dissertations
This study developed the Statistics Assessment of Graduate Students (SAGS) instrument, and established its preliminary item characteristics, reliability, and validity evidence. Even though there are limited number of assessments available for measuring different aspects of statistical cognition, these previously available assessments have numerous limitations. The SAGS instrument was developed using Rasch modeling approach to create a new measure of statistical research methodology knowledge of graduate students in education and other behavioral and social sciences. Thirty-five multiple-choice questions were written with stems representing applied research situations and response options distinguishing between appropriate use of various statistical tests or procedures. A focus …
The Effects Of Scaling On Trends Of Development: Classical Test Theory And Item Response Theory, Weldon Z. Smith
The Effects Of Scaling On Trends Of Development: Classical Test Theory And Item Response Theory, Weldon Z. Smith
College of Education and Human Sciences: Dissertations, Theses, and Student Research
The scale metrics used in educational testing are often arbitrary, and this can impact interpretation of scores on measurements. Both classical test theory sum scores and item response theory estimates measure the same underlying dimension, but differences in the two scales may lead one to be more preferential than the other in interpreting data. Mismatch between individual ability and test difficulty can further result in difficulties in correctly interpreting trends of development in longitudinal data. A previous limited simulation by Embretson (2007) demonstrated that classical test theory sum scores result in misinterpretation of linear trends of development, and that item …
A Monte Carlo Study Investigating Missing Data, Differential Item Functioning, And Effect Size, Phyllis Lorena Garrett
A Monte Carlo Study Investigating Missing Data, Differential Item Functioning, And Effect Size, Phyllis Lorena Garrett
Educational Policy Studies Dissertations
ABSTRACT A MONTE CARLO STUDY INVESTIGATING MISSING DATA, DIFFERENTIAL ITEM FUNCTIONING, AND EFFECT SIZE by Phyllis Garrett The use of polytomous items in assessments has increased over the years, and as a result, the validity of these assessments has been a concern. Differential item functioning (DIF) and missing data are two factors that may adversely affect assessment validity. Both factors have been studied separately, but DIF and missing data are likely to occur simultaneously in real assessment situations. This study investigated the Type I error and power of several DIF detection methods and methods of handling missing data for polytomous …
The Impact Of Multidimensionality On The Detection Of Differential Bundle Functioning Using Sibtest., Terris Raiford-Ross
The Impact Of Multidimensionality On The Detection Of Differential Bundle Functioning Using Sibtest., Terris Raiford-Ross
Educational Policy Studies Dissertations
In response to public concern over fairness in testing, conducting a differential item functioning (DIF) analysis is now standard practice for many large-scale testing programs (e.g., Scholastic Aptitude Test, intelligence tests, licensing exams). As highlighted by the Standards for Educational and Psychological Testing manual, the legal and ethical need to avoid bias when measuring examinee abilities is essential to fair testing practices (AERA-APA-NCME, 1999). Likewise, the development of statistical and substantive methods of investigating DIF is crucial to the goal of designing fair and valid educational and psychological tests. Douglas, Roussos and Stout (1996) introduced the concept of item bundle …