Open Access. Powered by Scholars. Published by Universities.®

Education Commons

Open Access. Powered by Scholars. Published by Universities.®

Educational Assessment, Evaluation, and Research

Prof Ray Adams

Selected Works

Item response theory

Articles 1 - 9 of 9

Full-Text Articles in Education

Modelling Mathematics Problem Solving Item Responses Using A Multidimensional Irt Model, Margaret Wu, Ray Adams Sep 2006

Modelling Mathematics Problem Solving Item Responses Using A Multidimensional Irt Model, Margaret Wu, Ray Adams

Prof Ray Adams

This research examined students' responses to mathematics problem- solving tasks and applied a general multidimensional IRT model at the response category level. In doing so, cognitive processes were identified and modelled through item response modelling to extract more information than would be provided using conventional practices in scoring items. More specifically, the study consisted of two parts. The first part involved the development of a mathematics problem-solving framework that was theoretically grounded, drawing upon research in mathematics education and cognitive psychology. The framework was then used as the basis for item development. The second part of the research involved the …


The Mixed-Coefficients Multinomial Logit Model : A Generalized Form Of The Rasch Model, Ray Adams, Margaret Wu Dec 2005

The Mixed-Coefficients Multinomial Logit Model : A Generalized Form Of The Rasch Model, Ray Adams, Margaret Wu

Prof Ray Adams

Since Rasch's introduction of his item response models, there has been a proliferation of extensions and alternatives, each of which has a different name and different matching software package. The proliferation of models has, in some ways, been a hindrance to practitioners. This paper presents a generalised item response model that provides a unifying framework for a large class of Rasch-type models. The advantages of a single framework include mathematical elegance, generality in a single software package, and a facilitation of the development, testing, and comparison of new models. The unified model is a multidimensional item response model, the specification …


Reliability As A Measurement Design Effect, Ray Adams Dec 2004

Reliability As A Measurement Design Effect, Ray Adams

Prof Ray Adams

Test reliability is a concept central to classical test theory and it is commonly stated as a requirement that a test attain a certain level of reliability before it be considered of sufficient quality for practical use. This article discusses the role of reliability in item response theory, and in particular the role of reliability in contexts where matrix sampling designs are used and concern is with the estimation of population parameters rather than the measurement of individuals. The concept of a measurement design effect is introduced. This concept parallels the concept of sampling design effects, in that it describes …


The Implications Of Halo Effects And Item Dependencies For Objective Measurement, T Mcnamara, Ray Adams Dec 1999

The Implications Of Halo Effects And Item Dependencies For Objective Measurement, T Mcnamara, Ray Adams

Prof Ray Adams

Analysis of data from performance-based language tests presents the problem of dealing appropriately with bundles of items that are linked to particular tasks. The authors use recent developments in Rasch modelling which allow analysis of bundles of items (or sets of ratings) to examine the extent of dependence between items and ratings, and they explore the implications of those dependences on the assessments. Data from two performance assessments are used in two studies of this problem.


Interpreting The Parameters Of A Multidimensional Rasch Model, W Wang, M Wilson, Ray Adams Dec 1999

Interpreting The Parameters Of A Multidimensional Rasch Model, W Wang, M Wilson, Ray Adams

Prof Ray Adams

This chapter introduces the multidimensional random coefficient multinomial logit model (MRCML) which can be applied to multidimensional polytomous test items. Two examples of real data analyses are followed to demonstrates the applications of the MRCML. A detailed discussion is made of interpretation of item parameters, in comparision to those derived from their corresponding unidimensional Rasch measurement models. Finally, it provides some guidelines for constructing scoring matrices and the corresponding models to aid parameter interpretation.


Acer Conquest: Generalised Item Response Modelling Software, Margaret Wu, Ray Adams, M Wilson Dec 1997

Acer Conquest: Generalised Item Response Modelling Software, Margaret Wu, Ray Adams, M Wilson

Prof Ray Adams

ACER Conquest is a computer program for fitting item response and latent regression models. It provides a comprehensive and flexible range of item response models to analysts, allowing them to examine the properties of performance assessment, traditional assessments and rating scales. This manual examines ACER ConQuest in detail, includes a tutorial and coverage of technical matters.


Measuring Individual Differences In Change With Multidimensional Rasch Models, W Wang, M Wilson, Ray Adams Dec 1997

Measuring Individual Differences In Change With Multidimensional Rasch Models, W Wang, M Wilson, Ray Adams

Prof Ray Adams

Item response models have been developed to explore change measurement, including those proposed by Fischer and his colleagues. In this article the authors propose another multidimensional Rasch model, the multidimensional random coefficient multinomial logit (MRCML) model. All these models are briefly reviewed and compared. The MRCML can be applied to not only polytomous items but also investigation of variations in item difficulties. Based on variations in difficulties across occasions and items, five kinds of models are proposed. Some simulation studies were conducted to examine parameter recovery of the MRCML model under various testing situations. All the parameters were recovered very …


The Multidimensional Random Coefficients Multinomial Logit Model, Ray Adams, M Wilson, W Wang Dec 1996

The Multidimensional Random Coefficients Multinomial Logit Model, Ray Adams, M Wilson, W Wang

Prof Ray Adams

A multidimensional Rasch-type item response model, the multidimensional random coefficients multinomial logit model, is presented as an extension to the Adams and Wilson (1996) random coefficients multinomial logit model. The model is developed in a form that permits generalization to the multidimensional case of a wide class of Rasch models, including the simple logistic model, Masters' partial credit model, Wilson's ordered partition model, and Fischer's linear logistic model. Moreover, the model includes several existing multidimensional models as special cases, including Whitely's multicomponent latent trait model, Andersen's multidimensional Rasch model for repeated testing, and Embretson's multidimensional Rasch model for learning and …


Multilevel Item Response Models: An Approach To Errors In Variables Regression, Ray Adams, M Wilson, Margaret Wu Dec 1996

Multilevel Item Response Models: An Approach To Errors In Variables Regression, Ray Adams, M Wilson, Margaret Wu

Prof Ray Adams

In this article the authors show how certain analytic problems that arise when one attempts to use latent variables as outcomes in regression analyses can be addressed by taking a multilevel perspective on item response modelling.