Open Access. Powered by Scholars. Published by Universities.®

Education Commons

Open Access. Powered by Scholars. Published by Universities.®

Selected Works

Prof Ray Adams

Selected Works

Assessment

Articles 1 - 6 of 6

Full-Text Articles in Education

The Influence Of Equating Methodology On Reported Trends In Pisa, Eveline Gebhardt, Ray Adams Dec 2006

The Influence Of Equating Methodology On Reported Trends In Pisa, Eveline Gebhardt, Ray Adams

Prof Ray Adams

In 2005 PISA published trend indicators that compared the results of PISA 2000 and PISA 2003. This paper explores the extent to which the outcomes of these trend analyses are sensitive to the choice of test equating methodologies, the choice of regression models and the choice of linking items. To establish trends, PISA equated its 2000 and 2003 tests using a methodology based on Rasch Modelling that involved estimating linear transformations that mapped 2003 Rasch-scaled scores to the previously established PISA 2000 Rasch-scaled scores. This paper compares the outcomes of this approach with an alternative, which involves the joint Rasch …


The Impact Of Differential Investment Of Student Effort On The Outcomes Of International Studies, J Butler, Ray Adams Dec 2006

The Impact Of Differential Investment Of Student Effort On The Outcomes Of International Studies, J Butler, Ray Adams

Prof Ray Adams

International comparative assessments of student achievement, such as Trends in Mathematics and Science (TIMSS) and Programme for International Student Achievement (PISA) are becoming increasingly important in the development of evidence-based education policy. The potentially far-reaching influence of such studies underscores the need for these assessments to be valid and reliable. In education, increasing recognition is being given to motivational factors which impact on student learning. This research considers a possible threat to the validity of such studies by investigating the influence the amount of effort invested by test-takers has on their outcomes. Reassuringly, it is found that the reported expenditure …


Modelling Mathematics Problem Solving Item Responses Using A Multidimensional Irt Model, Margaret Wu, Ray Adams Sep 2006

Modelling Mathematics Problem Solving Item Responses Using A Multidimensional Irt Model, Margaret Wu, Ray Adams

Prof Ray Adams

This research examined students' responses to mathematics problem- solving tasks and applied a general multidimensional IRT model at the response category level. In doing so, cognitive processes were identified and modelled through item response modelling to extract more information than would be provided using conventional practices in scoring items. More specifically, the study consisted of two parts. The first part involved the development of a mathematics problem-solving framework that was theoretically grounded, drawing upon research in mathematics education and cognitive psychology. The framework was then used as the basis for item development. The second part of the research involved the …


Application Of Multivariate Rasch Models In International Large-Scale Educational Assessments, Ray Adams, Margaret Wu, C Carstensen Dec 2005

Application Of Multivariate Rasch Models In International Large-Scale Educational Assessments, Ray Adams, Margaret Wu, C Carstensen

Prof Ray Adams

In large-scale educational assessments, such as the Programme for International Student Assessment (PISA) and the Trends in International Mathematics and Science Study (TIMSS), a primary concern is with the estimation of the population-level characteristics of a number of latent variables and the relationships between latent variables and other variables. Typically these studies are undertaken in contexts in which there are constraints on sample size and individual student response time, yet there are high expectations with regard to the breadth of content coverage. These demands and constraints have resulted in such studies using rotated-booklet designs, with each student responding to a …


Measuring Student Knowledge And Skills : The Pisa 2000 Assessment Of Reading, Mathematical And Scientific Literacy, Andreas Schieicher, Claudia Tamassia, Geoff Masters, Ray Adams Dec 1999

Measuring Student Knowledge And Skills : The Pisa 2000 Assessment Of Reading, Mathematical And Scientific Literacy, Andreas Schieicher, Claudia Tamassia, Geoff Masters, Ray Adams

Prof Ray Adams

The report explains the content that students need to acquire, the processes that need to be performed, and the contexts in which knowledge and skills are applied. Each of the assessment domains is illustrated with a broad range of sample items in this report.


International Student Assessment For The New Millennium, Ray Adams Apr 1998

International Student Assessment For The New Millennium, Ray Adams

Prof Ray Adams

The author briefly describes the OECD initiated project, 'Program for International Student Assessment' (PISA), in which over 100,000 15 year old students from 4000 schools in 26 countries will participate. A major focus of the project is the assessment of wider knowledge, skills and competencies in literacy, mathematics and science areas.