Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 11 of 11
Full-Text Articles in Education
Torch Plus : Tests Of Reading Comprehension Plus, Tom Lumley, Andrew Stephanou
Torch Plus : Tests Of Reading Comprehension Plus, Tom Lumley, Andrew Stephanou
Dr Tom Lumley
A set of reading tests designed to assist teachers of students from Year 3 to Year 10 in their assessment of students' reading comprehension skills.
The Effect Of Test-Taker Gender, Audience And Topic On Task Performance In Tape-Mediated Assessment Of Speaking., Tom Lumley, Barry O'Sullivan
The Effect Of Test-Taker Gender, Audience And Topic On Task Performance In Tape-Mediated Assessment Of Speaking., Tom Lumley, Barry O'Sullivan
Dr Tom Lumley
Performance in tests of spoken language can be influenced by a wide range of features of both task and participants. This article hypothesises that there may be effects on performance attributable to an interaction of variables such as the task topic, the gender of the person presenting the topic and the gender of the candidate. In contrast to previous studies, which have examined speaking tests involving face-to-face interaction, this study considered the issue in a tape-mediated test delivered in a language laboratory, with no interlocutor present, but where stimulus material is presented by one or more speakers, one of whom …
Assessment Criteria In A Large-Scale Writing Test: What Do They Really Mean To The Raters?, Tom Lumley
Assessment Criteria In A Large-Scale Writing Test: What Do They Really Mean To The Raters?, Tom Lumley
Dr Tom Lumley
The process of rating written language performance is still not well understood, despite a body of work investigating this issue over the last decade or so (e.g., Cumming, 1990; Huot, 1990; Vaughan, 1991; Weigle, 1994a; Milanovic et al., 1996). The purpose of this study is to investigate the process by which raters of texts written by ESL learners make their scoring decisions using an analytic rating scale designed for multiple test forms. The context is the Special Test of English Proficiency (step), which is used by the Australian government to assist in immigration decisions. Four trained, experienced and reliable step …
The Effect Of Test-Taker Sex, Audience And Topic On Task Performance In Tape-Mediated Assessment Of Speaking, Tom Lumley, Barry O'Sullivan
The Effect Of Test-Taker Sex, Audience And Topic On Task Performance In Tape-Mediated Assessment Of Speaking, Tom Lumley, Barry O'Sullivan
Dr Tom Lumley
There is growing interest in the effect on candidate performance of characteristics of the interlocutor in tests of speaking. A range of variables associated with the interlocutor may cause systematic variation in linguistic performance, and consequently in scores awarded. This paper hypothesises that there may be effects on performance attributable to an interaction of these variables; in the present study, the task topic, the sex of the person presenting the topic and the sex of the candidate. This investigated in the context of a tape-mediated test of speaking, where no interlocutor is actually present; instead, stimulus material is presented by …
The Process Of The Assessment Of Writing Performance : The Rater's Perspective, Tom Lumley
The Process Of The Assessment Of Writing Performance : The Rater's Perspective, Tom Lumley
Dr Tom Lumley
This study investigates the process of rating texts written by adult ESL learners. Four experienced raters provided think-aloud protocols describing the rating process for a set of 24 texts. The think-aloud data allowed analysis of the sequence of rating, raters' interpretations of the scoring categories, and difficulties raters faced. The study reveals the complexity of the rating process, whereby raters struggle to resolve a tension between the wordings (or rules) of the rating scale and their complex, initial, intuitive impression of the text. Rating requires training to provide reliable measurement. The study also demonstrates that caution is needed in interpreting …
Conflicting Perspectives On The Role Of Test Preparation In Relation To Learning, Tom Lumley, Bernadette Stoneman
Conflicting Perspectives On The Role Of Test Preparation In Relation To Learning, Tom Lumley, Bernadette Stoneman
Dr Tom Lumley
Reports on the development of a learning package for a newly introduced test in Hong Kong, the Graduating Students' Language Proficiency Assessment (GSLPA)-English. Examines reactions of teachers and students to the learning package during piloting of the materials.
Linguistic And Cultural Norms In Language Testing : A Case Study, Annie Brown, Tom Lumley
Linguistic And Cultural Norms In Language Testing : A Case Study, Annie Brown, Tom Lumley
Dr Tom Lumley
Users of English in Asia may not have the same need to aspire to a ' standard' form of English. It may be more appropriate for them to develop a communicative competence employing the sociolinguistic and cultural norms of the region. Taking such an approach in the development of tests of English proficiency involves rethinking basic assumptions. This paper considers these issues in the context of a test of English proficiency developed for use with English teachers in Indonesia
The Judgements Of Language-Trained Raters And Doctors In A Test Of English For Health Professionals, Tom Lumley
The Judgements Of Language-Trained Raters And Doctors In A Test Of English For Health Professionals, Tom Lumley
Dr Tom Lumley
Research to date has produced conflicting findings concerning the relative harshness and other characteristics of language- trained raters versus 'naive' native speaker or occupational expert raters. This question is considered in the context of a recent standard- setting project carried out for the Occupational English Test, an occupation specific test of English for overseas- trained health professionals. 20 audio recordings of role plays from recent administrations of the tests were each rated by 10 trained ESL raters and 10 medical practitioners. Broad similarities in judgements indicate reliance on ESL-trained raters can be justified.
Reading Comprehension Sub-Skills: Teachers' Perceptions Of Content In An Eap Test, Tom Lumley
Reading Comprehension Sub-Skills: Teachers' Perceptions Of Content In An Eap Test, Tom Lumley
Dr Tom Lumley
This study examines the place of sub skills in English as second language (ESL) syllabus and test design, with particular attention to the enduring influence of Munby (1978). Rasch analysis of item difficulty and the use of Rasch Item Response Theory (IRT) are discussed.
Mapping Abilities And Skill Levels Using Rasch Techniques, Annie Brown, Catherine Elder, Tom Lumley, Tim Mcnamara, Joy Mcqueen
Mapping Abilities And Skill Levels Using Rasch Techniques, Annie Brown, Catherine Elder, Tom Lumley, Tim Mcnamara, Joy Mcqueen
Dr Tom Lumley
The ongoing interest in investigating the use of Item Response Theory (IRT) methods, involving the Rasch model, in language testing research and the development of language tests has encouraged the authors to explore the nature of this approach and to introduce some research on its validation.
The Nllia Esl Development Project And Assessment In The Curriculum, Tom Lumley, Penny Mckay
The Nllia Esl Development Project And Assessment In The Curriculum, Tom Lumley, Penny Mckay
Dr Tom Lumley
This article outlines the ESL Development or the ESL Profiles Project, abbreviated terms for the National Languages and Literacy Institute of Australia (NLLIA) ESL Development Project: Language and Literacy in Schools. A brief introduction to the project and two of its principal components: the ESL Bandscales and the Exemplar Assessment Activities with accompanying Observation Guides for each macro-skill, are included in this article.