Open Access. Powered by Scholars. Published by Universities.®

Education Commons

Open Access. Powered by Scholars. Published by Universities.®

Articles 1 - 13 of 13

Full-Text Articles in Education

Class 6 Proficiency In Afghanistan 2013: Outcomes Of A Learning Assessment Of Mathematical, Reading And Writing Literacy, Tom Lumley, Juliette Mendelovits, Rachel Stanyon, Ross Turner, Maurice Walker Mar 2015

Class 6 Proficiency In Afghanistan 2013: Outcomes Of A Learning Assessment Of Mathematical, Reading And Writing Literacy, Tom Lumley, Juliette Mendelovits, Rachel Stanyon, Ross Turner, Maurice Walker

Dr Tom Lumley

In 2012, the Ministry of Education, Afghanistan, engaged the Australian Council for Educational Research (ACER) as a partner to support the development of a national learning assessment program in Afghanistan. To achieve this goal, the Learning Assessment unit of the Ministry of Education and ACER have collaborated to design and implement the Monitoring Trends in Educational Growth (MTEG) program in Afghanistan. MTEG is designed as a long-term monitoring program with one focus on trends in achievement outcomes in single class levels over time, and another focus on the growth of achievement in cohorts throughout the school cycle, from Class 3 …


Reading For The New Era: Assessing Reading In A Digital Environment, Dara Searle, Tom Lumley, Juliette Mendelovits Sep 2013

Reading For The New Era: Assessing Reading In A Digital Environment, Dara Searle, Tom Lumley, Juliette Mendelovits

Dr Tom Lumley

No abstract provided.


Session O - Do Boys And Girls Read Differently Online? Evidence From Pisa 2009 Digital Reading Assessment, Tom Lumley, Dara Ramalingam, Juliette Mendelovits Sep 2013

Session O - Do Boys And Girls Read Differently Online? Evidence From Pisa 2009 Digital Reading Assessment, Tom Lumley, Dara Ramalingam, Juliette Mendelovits

Dr Tom Lumley

Concurrent Session Block 3


Print And Digital Reading In Pisa 2009 : Comparison And Contrast, Juliette Mendelovits, Dara Ramalingam, Tom Lumley Feb 2013

Print And Digital Reading In Pisa 2009 : Comparison And Contrast, Juliette Mendelovits, Dara Ramalingam, Tom Lumley

Dr Tom Lumley

PISA was administered for the fourth time in 2009. Since in each administration, one of reading, maths or science is chosen as the major domain, the 2009 survey marked the first time that a domain (in this case, reading) was revisited as the major focus of the assessment. This allowed a full review of the framework for reading literacy and the inclusion of new elements to reflect the way that reading has changed since 2000 (OECD, 2009). One such change is the increasing prevalence of digital texts. The assessment of digital reading in the PISA 2009 cycle, undertaken by 19 …


A Framework For Predicting Item Difficulty In Reading Tests, Tom Lumley, Alla Routitsky, Juliette Mendelovits, Dara Ramalingam Mar 2012

A Framework For Predicting Item Difficulty In Reading Tests, Tom Lumley, Alla Routitsky, Juliette Mendelovits, Dara Ramalingam

Dr Tom Lumley

Results on reading tests are typically reported on scales composed of levels, each giving a statement of student achievement or proficiency. The PISA reading scales provide broad descriptions of skill levels associated with reading items, intended to communicate to policy makers and teachers about the reading proficiency of students at different levels. However, the described scales are not explicitly tied to features that predict difficulty. Difficulty is thus treated as an empirical issue, using a post hoc solution, while a priori estimates of item difficulty have tended to be unreliable. Understanding features influencing the difficulty of reading tasks has the …


What Information From Pisa Is Useful For Teachers? How Can Pisa Help Our Students To Become More Proficient?, Juliette Mendelovits, Dara Searle, Tom Lumley Dec 2008

What Information From Pisa Is Useful For Teachers? How Can Pisa Help Our Students To Become More Proficient?, Juliette Mendelovits, Dara Searle, Tom Lumley

Dr Tom Lumley

A frequent objection to large-scale testing programs, both national and international, is that they are used as an instrument of control, rather than as a means of providing information to effect change. Moreover, concerns about large-scale testing often take the form of objection to the specific characteristics of the assessments as being prescriptive and proscriptive, leading to a narrowing of the curriculum and the spectre of 'teaching to the test' to the exclusion of more important educational content. Taking PISA reading literacy as its focus, this paper proposes, on the contrary, that a coherent assessment system is valuable in so …


The Effect Of Test-Taker Sex, Audience And Topic On Task Performance In Tape-Mediated Assessment Of Speaking, Tom Lumley, Barry O'Sullivan Oct 2001

The Effect Of Test-Taker Sex, Audience And Topic On Task Performance In Tape-Mediated Assessment Of Speaking, Tom Lumley, Barry O'Sullivan

Dr Tom Lumley

There is growing interest in the effect on candidate performance of characteristics of the interlocutor in tests of speaking. A range of variables associated with the interlocutor may cause systematic variation in linguistic performance, and consequently in scores awarded. This paper hypothesises that there may be effects on performance attributable to an interaction of these variables; in the present study, the task topic, the sex of the person presenting the topic and the sex of the candidate. This investigated in the context of a tape-mediated test of speaking, where no interlocutor is actually present; instead, stimulus material is presented by …


Linguistic And Cultural Norms In Language Testing : A Case Study, Annie Brown, Tom Lumley Dec 1997

Linguistic And Cultural Norms In Language Testing : A Case Study, Annie Brown, Tom Lumley

Dr Tom Lumley

Users of English in Asia may not have the same need to aspire to a ' standard' form of English. It may be more appropriate for them to develop a communicative competence employing the sociolinguistic and cultural norms of the region. Taking such an approach in the development of tests of English proficiency involves rethinking basic assumptions. This paper considers these issues in the context of a test of English proficiency developed for use with English teachers in Indonesia


The Judgements Of Language-Trained Raters And Doctors In A Test Of English For Health Professionals, Tom Lumley Dec 1994

The Judgements Of Language-Trained Raters And Doctors In A Test Of English For Health Professionals, Tom Lumley

Dr Tom Lumley

Research to date has produced conflicting findings concerning the relative harshness and other characteristics of language- trained raters versus 'naive' native speaker or occupational expert raters. This question is considered in the context of a recent standard- setting project carried out for the Occupational English Test, an occupation specific test of English for overseas- trained health professionals. 20 audio recordings of role plays from recent administrations of the tests were each rated by 10 trained ESL raters and 10 medical practitioners. Broad similarities in judgements indicate reliance on ESL-trained raters can be justified.


A New Approach To Standard-Setting In Language Assessment, Tom Lumley, B Lynch, T Mcnamara Dec 1993

A New Approach To Standard-Setting In Language Assessment, Tom Lumley, B Lynch, T Mcnamara

Dr Tom Lumley

In this paper the authors consider a standard setting exercise involving the Occupational English Test, a specific purpose test of English as a second language for health professionals. The Australian test is used as part of the screening of immigrant and refugee health professionals prior to the resumption of their professional careers in their new country of residence.


Reading Comprehension Sub-Skills: Teachers' Perceptions Of Content In An Eap Test, Tom Lumley Dec 1992

Reading Comprehension Sub-Skills: Teachers' Perceptions Of Content In An Eap Test, Tom Lumley

Dr Tom Lumley

This study examines the place of sub skills in English as second language (ESL) syllabus and test design, with particular attention to the enduring influence of Munby (1978). Rasch analysis of item difficulty and the use of Rasch Item Response Theory (IRT) are discussed.


Mapping Abilities And Skill Levels Using Rasch Techniques, Annie Brown, Catherine Elder, Tom Lumley, Tim Mcnamara, Joy Mcqueen Dec 1991

Mapping Abilities And Skill Levels Using Rasch Techniques, Annie Brown, Catherine Elder, Tom Lumley, Tim Mcnamara, Joy Mcqueen

Dr Tom Lumley

The ongoing interest in investigating the use of Item Response Theory (IRT) methods, involving the Rasch model, in language testing research and the development of language tests has encouraged the authors to explore the nature of this approach and to introduce some research on its validation.


The Nllia Esl Development Project And Assessment In The Curriculum, Tom Lumley, Penny Mckay Dec 1991

The Nllia Esl Development Project And Assessment In The Curriculum, Tom Lumley, Penny Mckay

Dr Tom Lumley

This article outlines the ESL Development or the ESL Profiles Project, abbreviated terms for the National Languages and Literacy Institute of Australia (NLLIA) ESL Development Project: Language and Literacy in Schools. A brief introduction to the project and two of its principal components: the ESL Bandscales and the Exemplar Assessment Activities with accompanying Observation Guides for each macro-skill, are included in this article.