Open Access. Powered by Scholars. Published by Universities.®

Education Commons

Open Access. Powered by Scholars. Published by Universities.®

Selected Works

Measurement techniques

Prof Ray Adams

Articles 1 - 7 of 7

Full-Text Articles in Education

Self-Review For Higher Education Institutions, Nathan Zoanetti, Patrick Griffin, Ray Adams Dec 2005

Self-Review For Higher Education Institutions, Nathan Zoanetti, Patrick Griffin, Ray Adams

Prof Ray Adams

This paper describes a plausible values imputation approach for deriving population scores on several language proficiency domains. The approach harnessed a multi-dimensional item response analysis combining student responses, rater judgements and student background variables. The target population was grade one and grade two primary school students enrolled in the Hong Kong schooling system. The raters were local teachers of English employed within the sampled schools. The primary objective of this research was to impute plausible values for data where no data was provided or where rater data was deemed suspect. By necessity, a secondary objective of this study was to …


Reliability As A Measurement Design Effect, Ray Adams Dec 2004

Reliability As A Measurement Design Effect, Ray Adams

Prof Ray Adams

Test reliability is a concept central to classical test theory and it is commonly stated as a requirement that a test attain a certain level of reliability before it be considered of sufficient quality for practical use. This article discusses the role of reliability in item response theory, and in particular the role of reliability in contexts where matrix sampling designs are used and concern is with the estimation of population parameters rather than the measurement of individuals. The concept of a measurement design effect is introduced. This concept parallels the concept of sampling design effects, in that it describes …


Measuring Individual Differences In Change With Multidimensional Rasch Models, W Wang, M Wilson, Ray Adams Dec 1997

Measuring Individual Differences In Change With Multidimensional Rasch Models, W Wang, M Wilson, Ray Adams

Prof Ray Adams

Item response models have been developed to explore change measurement, including those proposed by Fischer and his colleagues. In this article the authors propose another multidimensional Rasch model, the multidimensional random coefficient multinomial logit (MRCML) model. All these models are briefly reviewed and compared. The MRCML can be applied to not only polytomous items but also investigation of variations in item difficulties. Based on variations in difficulties across occasions and items, five kinds of models are proposed. Some simulation studies were conducted to examine parameter recovery of the MRCML model under various testing situations. All the parameters were recovered very …


Applications Of Item Response Theory In The Third International Mathematics And Science Study, E Gonzalez, Ray Adams, Marg Wu Dec 1996

Applications Of Item Response Theory In The Third International Mathematics And Science Study, E Gonzalez, Ray Adams, Marg Wu

Prof Ray Adams

The Third International Mathematics and Science Study (TIMSS) is a survey of mathematics and science achievement sponsored by the International Association for the Evaluation of Educational Achievement. With more than 45 participating countries, three target populations, more than thirty languages, 15,000 schools, more than half a million students, TIMSS is the largest and most ambitious international study of educational achievement ever undertaken. Students participating in the assessment were administered one of eight achievement tests that contain items in mathematics and science, using a variety of item formats. As TIMSS is an international study, many audiences will look at the results …


Rasch Models Of Multidimensionality Between Items And Within Items, W Wen-Chung, M Wilson, Ray Adams Dec 1996

Rasch Models Of Multidimensionality Between Items And Within Items, W Wen-Chung, M Wilson, Ray Adams

Prof Ray Adams

This chapter focuses on Rasch measurement and extends it to multidimensional Rasch models. The author first clarifies multidimensionality at two levels: the item level and the test level. With this two way classification, three kinds of tests are formed: undimensional tests, multidimensional between-item tests, and multidimensional within-item tests. The author describes a multidimensional Rasch model, the multidimensional random coefficients multinomial logit (MRCML) model, for multidimensional tests. The model, when applied to multidimensional between-item tests, is more efficient than are unidimensional models in terms of model fit and reliability indices. The model can also be applied to investigate scale interaction of …


Bias In Weighted Likelihood Estimation When Using The Rasch Model, D Roberts, Ray Adams Dec 1996

Bias In Weighted Likelihood Estimation When Using The Rasch Model, D Roberts, Ray Adams

Prof Ray Adams

There are three methods of maximum likelihood estimation that are commonly used with Rasch item response models: Joint maximum likelihood, which provides point estimates for both person and item parameters; conditional maximum likelihood, which produces estimates for the item parameters only, and marginal maximum likelihood, which produces estimates of the item parameters and parameters of the distribution from which it has been assumed that the persons have been sampled. A number of approaches have been suggested for obtaining ability estimates for subsequent use in reporting or analysis when either conditional or marginal methods have been used to obtain the item …


Student Progress, Charting Of, Geoff Masters, Ray Adams, M Wilson Dec 1993

Student Progress, Charting Of, Geoff Masters, Ray Adams, M Wilson

Prof Ray Adams

This article looks at the charting of students' progress. It examines learning as an active process, conventional achievement testing, testing for conceptual understanding, constructing ordered outcome categories, and collecting observations.