Open Access. Powered by Scholars. Published by Universities.®

Education Commons™

Open Access. Powered by Scholars. Published by Universities.®

Educational Assessment, Evaluation, and Research

Selected Works

Selected Works

2000

Test items

Articles 1 - 3 of 3

Full-Text Articles in Education

The Implications Of Halo Effects And Item Dependencies For Objective Measurement, T Mcnamara, Ray Adams Dec 1999

The Implications Of Halo Effects And Item Dependencies For Objective Measurement, T Mcnamara, Ray Adams

Prof Ray Adams

Analysis of data from performance-based language tests presents the problem of dealing appropriately with bundles of items that are linked to particular tasks. The authors use recent developments in Rasch modelling which allow analysis of bundles of items (or sets of ratings) to examine the extent of dependence between items and ratings, and they explore the implications of those dependences on the assessments. Data from two performance assessments are used in two studies of this problem.

Go to article

Interpreting The Parameters Of A Multidimensional Rasch Model, W Wang, M Wilson, Ray Adams Dec 1999

Interpreting The Parameters Of A Multidimensional Rasch Model, W Wang, M Wilson, Ray Adams

Prof Ray Adams

This chapter introduces the multidimensional random coefficient multinomial logit model (MRCML) which can be applied to multidimensional polytomous test items. Two examples of real data analyses are followed to demonstrates the applications of the MRCML. A detailed discussion is made of interpretation of item parameters, in comparision to those derived from their corresponding unidimensional Rasch measurement models. Finally, it provides some guidelines for constructing scoring matrices and the corresponding models to aid parameter interpretation.

Go to article

Item Panelling, Or Cognitive Walk-Through, Ross Turner Dec 1999

Item Panelling, Or Cognitive Walk-Through, Ross Turner

Ross Turner

Item panelling is a process with a long history at ACER. Essentially the same process is referred to in the US Cognitive Laboratory literature as a ‘cognitive walk-through’. Test development agencies in the UK use the phrase ‘item shredding’ to describe essentially the same process. Item panelling is one of a number of essential steps in the development of high quality test items. It is a means of subjecting draft test material to the scrutiny of experts who can provide a rigorous evaluation of the quality of the material, and where appropriate can propose ways in which the material may …

Go to article