Open Access. Powered by Scholars. Published by Universities.®
Bilingual, Multilingual, and Multicultural Education Commons™
Open Access. Powered by Scholars. Published by Universities.®
- Keyword
-
- English (11)
- Tests (8)
- Language tests (7)
- Second language (5)
- Language (4)
-
- Students (4)
- Assessment (3)
- Evaluation (3)
- Postsecondary education (3)
- Rasch model (3)
- Reading (3)
- Testing (3)
- Examiners (2)
- Learning (2)
- Literacy (2)
- Migrants (2)
- Oral language (2)
- Rating scales (2)
- Research (2)
- Secondary education (2)
- Test development (2)
- Vocational English (2)
- Ability (1)
- Ability testing (1)
- Academic achievement (1)
- Adults (1)
- Analaysis (1)
- Case studies (1)
- Comprehension (1)
- Cultural differences (1)
- Publication Year
- File Type
Articles 1 - 21 of 21
Full-Text Articles in Bilingual, Multilingual, and Multicultural Education
Introdução, Tom Lumley
What Information From Pisa Is Useful For Teachers? How Can Pisa Help Our Students To Become More Proficient?, Juliette Mendelovits, Dara Searle, Tom Lumley
What Information From Pisa Is Useful For Teachers? How Can Pisa Help Our Students To Become More Proficient?, Juliette Mendelovits, Dara Searle, Tom Lumley
Dr Tom Lumley
A frequent objection to large-scale testing programs, both national and international, is that they are used as an instrument of control, rather than as a means of providing information to effect change. Moreover, concerns about large-scale testing often take the form of objection to the specific characteristics of the assessments as being prescriptive and proscriptive, leading to a narrowing of the curriculum and the spectre of 'teaching to the test' to the exclusion of more important educational content. Taking PISA reading literacy as its focus, this paper proposes, on the contrary, that a coherent assessment system is valuable in so …
Torch Plus : Tests Of Reading Comprehension Plus, Tom Lumley, Andrew Stephanou
Torch Plus : Tests Of Reading Comprehension Plus, Tom Lumley, Andrew Stephanou
Dr Tom Lumley
A set of reading tests designed to assist teachers of students from Year 3 to Year 10 in their assessment of students' reading comprehension skills.
The Effect Of Test-Taker Gender, Audience And Topic On Task Performance In Tape-Mediated Assessment Of Speaking., Tom Lumley, Barry O'Sullivan
The Effect Of Test-Taker Gender, Audience And Topic On Task Performance In Tape-Mediated Assessment Of Speaking., Tom Lumley, Barry O'Sullivan
Dr Tom Lumley
Performance in tests of spoken language can be influenced by a wide range of features of both task and participants. This article hypothesises that there may be effects on performance attributable to an interaction of variables such as the task topic, the gender of the person presenting the topic and the gender of the candidate. In contrast to previous studies, which have examined speaking tests involving face-to-face interaction, this study considered the issue in a tape-mediated test delivered in a language laboratory, with no interlocutor present, but where stimulus material is presented by one or more speakers, one of whom …
Research Methods In Language Testing, Tom Lumley, Annie Brown
Research Methods In Language Testing, Tom Lumley, Annie Brown
Dr Tom Lumley
No abstract provided.
Assessing Second Language Writing: The Rater’S Perspective, Tom Lumley
Assessing Second Language Writing: The Rater’S Perspective, Tom Lumley
Dr Tom Lumley
This study investigates the process of rating texts written by adult ESL learners. Four experienced raters provided think-aloud protocols describing the rating process for a set of 24 texts. The think-aloud data allowed analysis of the sequence of rating, raters' interpretations of the scoring categories, and difficulties raters faced. The study reveals the complexity of the rating process, whereby raters struggle to resolve a tension between the wordings (or rules) of the rating scale and their complex, initial, intuitive impression of the text. Rating requires training to provide reliable measurement. The study also demonstrates that caution is needed in interpreting …
Assessing English For Employment In Hong Kong, Tom Lumley, David Qian
Assessing English For Employment In Hong Kong, Tom Lumley, David Qian
Dr Tom Lumley
No abstract provided.
Assessment Criteria In A Large-Scale Writing Test: What Do They Really Mean To The Raters?, Tom Lumley
Assessment Criteria In A Large-Scale Writing Test: What Do They Really Mean To The Raters?, Tom Lumley
Dr Tom Lumley
The process of rating written language performance is still not well understood, despite a body of work investigating this issue over the last decade or so (e.g., Cumming, 1990; Huot, 1990; Vaughan, 1991; Weigle, 1994a; Milanovic et al., 1996). The purpose of this study is to investigate the process by which raters of texts written by ESL learners make their scoring decisions using an analytic rating scale designed for multiple test forms. The context is the Special Test of English Proficiency (step), which is used by the Australian government to assist in immigration decisions. Four trained, experienced and reliable step …
The Effect Of Test-Taker Sex, Audience And Topic On Task Performance In Tape-Mediated Assessment Of Speaking, Tom Lumley, Barry O'Sullivan
The Effect Of Test-Taker Sex, Audience And Topic On Task Performance In Tape-Mediated Assessment Of Speaking, Tom Lumley, Barry O'Sullivan
Dr Tom Lumley
There is growing interest in the effect on candidate performance of characteristics of the interlocutor in tests of speaking. A range of variables associated with the interlocutor may cause systematic variation in linguistic performance, and consequently in scores awarded. This paper hypothesises that there may be effects on performance attributable to an interaction of these variables; in the present study, the task topic, the sex of the person presenting the topic and the sex of the candidate. This investigated in the context of a tape-mediated test of speaking, where no interlocutor is actually present; instead, stimulus material is presented by …
Experimenting With Uncertainty: Essays In Honour Of Alan Davies
Experimenting With Uncertainty: Essays In Honour Of Alan Davies
Dr Tom Lumley
This festschrift brings together 28 invited papers surveying the state of the art in language testing from a perspective which combines technical and broader applied linguistics insights. The papers cover issues ranging from construct definition to the design and applications of language tests, including their importance as a means of exploring larger issues in language teaching, language learning and language policy. The volume locates work in language testing in a context of social, political and ethical issues at a time when testing is increasingly expected to be publicly accountable
The Process Of The Assessment Of Writing Performance : The Rater's Perspective, Tom Lumley
The Process Of The Assessment Of Writing Performance : The Rater's Perspective, Tom Lumley
Dr Tom Lumley
This study investigates the process of rating texts written by adult ESL learners. Four experienced raters provided think-aloud protocols describing the rating process for a set of 24 texts. The think-aloud data allowed analysis of the sequence of rating, raters' interpretations of the scoring categories, and difficulties raters faced. The study reveals the complexity of the rating process, whereby raters struggle to resolve a tension between the wordings (or rules) of the rating scale and their complex, initial, intuitive impression of the text. Rating requires training to provide reliable measurement. The study also demonstrates that caution is needed in interpreting …
Conflicting Perspectives On The Role Of Test Preparation In Relation To Learning, Tom Lumley, Bernadette Stoneman
Conflicting Perspectives On The Role Of Test Preparation In Relation To Learning, Tom Lumley, Bernadette Stoneman
Dr Tom Lumley
Reports on the development of a learning package for a newly introduced test in Hong Kong, the Graduating Students' Language Proficiency Assessment (GSLPA)-English. Examines reactions of teachers and students to the learning package during piloting of the materials.
Linguistic And Cultural Norms In Language Testing : A Case Study, Annie Brown, Tom Lumley
Linguistic And Cultural Norms In Language Testing : A Case Study, Annie Brown, Tom Lumley
Dr Tom Lumley
Users of English in Asia may not have the same need to aspire to a ' standard' form of English. It may be more appropriate for them to develop a communicative competence employing the sociolinguistic and cultural norms of the region. Taking such an approach in the development of tests of English proficiency involves rethinking basic assumptions. This paper considers these issues in the context of a test of English proficiency developed for use with English teachers in Indonesia
The Effect Of Interlocutor And Assessment Mode Variables In Overseas Assessments Of Speaking Skills In Occupational Settings, T Mcnamara, Tom Lumley
The Effect Of Interlocutor And Assessment Mode Variables In Overseas Assessments Of Speaking Skills In Occupational Settings, T Mcnamara, Tom Lumley
Dr Tom Lumley
The increasing demand for performance assessment of speaking skills in second languages has led to logistic complications, for example, the delivery of tests in overseas locations. One solution to the problem has been to train native interlocutors to carry out a series of oral interactions with the candidate, with assessment from audiorecordings of the test session postponed and conducted centrally by a small team of trained raters. But these procedures raise questions about the effect of such facets of the assessment situation as interlocutor variables and the quality of the audiotape recording. This article examines these issues in the context …
Profiling Esl Children: How Teachers Interpret And Use National And State Assessment Frameworks, M Breen, C Barratt-Pugh, B Derewianka, H House, C Hudson, Tom Lumley, M Rohl
Profiling Esl Children: How Teachers Interpret And Use National And State Assessment Frameworks, M Breen, C Barratt-Pugh, B Derewianka, H House, C Hudson, Tom Lumley, M Rohl
Dr Tom Lumley
No abstract provided.
Specific-Purpose Language Performance Tests : Task And Interaction, Tom Lumley, Annie Brown
Specific-Purpose Language Performance Tests : Task And Interaction, Tom Lumley, Annie Brown
Dr Tom Lumley
Oral performance tests designed to assess candidates' ability to function in a particular professional role typically involve role plays which simulate aspects of professional interaction between a candidate, in his/her professional role, and an interlocutor, in the role of client or consumer of the professional services. This paper reports on an investigation into the role which expert professional informants can play in providing post hoc content validation of tasks used in this kind of occupation-specific test, focusing on both the content of the tasks and the behaviour of the interlocutors. The study draws on data from the oral interaction component …
The Judgements Of Language-Trained Raters And Doctors In A Test Of English For Health Professionals, Tom Lumley
The Judgements Of Language-Trained Raters And Doctors In A Test Of English For Health Professionals, Tom Lumley
Dr Tom Lumley
Research to date has produced conflicting findings concerning the relative harshness and other characteristics of language- trained raters versus 'naive' native speaker or occupational expert raters. This question is considered in the context of a recent standard- setting project carried out for the Occupational English Test, an occupation specific test of English for overseas- trained health professionals. 20 audio recordings of role plays from recent administrations of the tests were each rated by 10 trained ESL raters and 10 medical practitioners. Broad similarities in judgements indicate reliance on ESL-trained raters can be justified.
A New Approach To Standard-Setting In Language Assessment, Tom Lumley, B Lynch, T Mcnamara
A New Approach To Standard-Setting In Language Assessment, Tom Lumley, B Lynch, T Mcnamara
Dr Tom Lumley
In this paper the authors consider a standard setting exercise involving the Occupational English Test, a specific purpose test of English as a second language for health professionals. The Australian test is used as part of the screening of immigrant and refugee health professionals prior to the resumption of their professional careers in their new country of residence.
Reading Comprehension Sub-Skills: Teachers' Perceptions Of Content In An Eap Test, Tom Lumley
Reading Comprehension Sub-Skills: Teachers' Perceptions Of Content In An Eap Test, Tom Lumley
Dr Tom Lumley
This study examines the place of sub skills in English as second language (ESL) syllabus and test design, with particular attention to the enduring influence of Munby (1978). Rasch analysis of item difficulty and the use of Rasch Item Response Theory (IRT) are discussed.
Mapping Abilities And Skill Levels Using Rasch Techniques, Annie Brown, Catherine Elder, Tom Lumley, Tim Mcnamara, Joy Mcqueen
Mapping Abilities And Skill Levels Using Rasch Techniques, Annie Brown, Catherine Elder, Tom Lumley, Tim Mcnamara, Joy Mcqueen
Dr Tom Lumley
The ongoing interest in investigating the use of Item Response Theory (IRT) methods, involving the Rasch model, in language testing research and the development of language tests has encouraged the authors to explore the nature of this approach and to introduce some research on its validation.
The Nllia Esl Development Project And Assessment In The Curriculum, Tom Lumley, Penny Mckay
The Nllia Esl Development Project And Assessment In The Curriculum, Tom Lumley, Penny Mckay
Dr Tom Lumley
This article outlines the ESL Development or the ESL Profiles Project, abbreviated terms for the National Languages and Literacy Institute of Australia (NLLIA) ESL Development Project: Language and Literacy in Schools. A brief introduction to the project and two of its principal components: the ESL Bandscales and the Exemplar Assessment Activities with accompanying Observation Guides for each macro-skill, are included in this article.