Education Commons^™

Beyond Pisa : Improving Student Outcomes, Geoff Masters

Prof Geoff Masters AO

The latest PISA results indicate that we must focus on strategies to improve what happens in every classroom, every day of the school week if we are to improve student outcomes, says Geoff Masters.

What’S The Story? Making Sense Of Conflicting Literacy And Numeracy Results, Juliette Mendelovits

Juliette Mendelovits

No abstract provided.

Some Reflections On Teaching And Learning From Numeracy And Mathematical Literacy Assessments, Dave Tout

David (Dave) Tout

No abstract provided.

Does It All Add Up? What’S The Story With Mathematical Literacy And Numeracy? Where To Next?, Ross Turner, Dave Tout

David (Dave) Tout

Australia’S Performance In Pisa And Piaac – Key Messages For Education And Training, Sue Thomson, Dave Tout

David (Dave) Tout

No abstract provided.

Australia’S Performance In Pisa And Piaac – Key Messages For Education And Training, Sue Thomson, Dave Tout

Dr Sue Thomson

No abstract provided.

Does It All Add Up? What’S The Story With Mathematical Literacy And Numeracy? Where To Next?, Ross Turner, Dave Tout

Ross Turner

Reading Between The Lines. What’S The Story With Reading Literacy? Where To Next?, Sue Thomson

Dr Sue Thomson

No abstract provided.

Australia’S Performance In Pisa And Piaac – Key Messages For Education And Training, Sue Thomson, Dave Tout

Dr Sue Thomson

No abstract provided.

Lessons From Pisa For Mathematical Literacy, Ross Turner

Ross Turner

Unfinished Business : Pisa Shows Indigenous Youth Are Being Left Behind, Tony Dreise, Sue Thomson

Dr Sue Thomson

The latest international assessment of students’ mathematical, scientific and reading literacy – the Programme for International Student Assessment (PISA) – shows that the gap between Indigenous and non-Indigenous students has remained the same for the last decade. In short, Indigenous 15-yearolds remain approximately two-and-a-half years behind their non-Indigenous peers in schooling.

This essay provides a précis of the results and analysis of some of the issues; it compares Indigenous performance in 2012 with that from previous PISA cycles; and discusses a range of implications for policy and practice.

Pisa Problems, Christopher Tienken

Christopher Tienken

Questioning The Standards Of Literacy And Numeracy, David Tout, Juliette Mendelovits

David (Dave) Tout

David Tout and Juliette Mendelovits examine why we receive such differing reports on the literacy and numeracy skills of young Australians.

Questioning The Standards Of Literacy And Numeracy, David Tout, Juliette Mendelovits

Juliette Mendelovits

David Tout and Juliette Mendelovits examine why we receive such differing reports on the literacy and numeracy skills of young Australians.

Reading In Online Environments, Juliette Mendelovits

Juliette Mendelovits

Juliette Mendelovits examines the results of an international assessment of 15-year-old students’ ability to read digital texts.

A Teacher's Guide To Pisa Mathematical Literacy, Sue Thomson, Kylie Hillman, Lisa De Bortoli

Kylie Hillman

This report focuses on mathematical literacy and is one of a series of three reports on Australian students' performance in PISA. The report provides an overview of the PISA mathematics framework and Australia's results in the PISA 2003 international assessment. Also included are mathematics items released for public viewing after the PISA 2003 assessment and examples of responses, marking guides and comparisons of results with other countries. The context behind achievement, e.g. attitudes, engagement and learning strategies, is also presented.

A Teacher's Guide To Pisa Scientific Literacy, Sue Thomson, Kylie Hillman, Lisa De Bortoli

Kylie Hillman

This report focuses on Australian students' performance on the PISA items that have been released in Scientific Literacy. It includes an overview of the PISA Scientific Literacy Framework, Australian students' results in the 2006 international assessment, examples of responses and marking guides and the context behind achievement, e.g. attitudes, engagement and motivation, and recognition of environmental issues.

A Teacher's Guide To Pisa Reading Literacy, Sue Thomson, Kylie Hillman, Lisa De Bortoli

Kylie Hillman

This report focuses on Australian students' performance on the PISA items that have been released in reading literacy. It includes an overview of the PISA Reading Framework, Australia's results in the PISA 2009 international assessment , examples of responses and marking guides, and the context behind achievement, e.g. enjoyment of reading, how often they read and high-level strategies for learning.

A Teacher's Guide To Pisa Reading Literacy, Sue Thomson, Kylie Hillman, Lisa De Bortoli

Dr Sue Thomson

This report focuses on Australian students' performance on the PISA items that have been released in reading literacy. It includes an overview of the PISA Reading Framework, Australia's results in the PISA 2009 international assessment , examples of responses and marking guides, and the context behind achievement, e.g. enjoyment of reading, how often they read and high-level strategies for learning.

On The Use Of Rotated Context Questionnaires In Conjunction With Multilevel Item Response Models, Raymond J. Adams, Petra Lietz, Alla Berezner

Dr Petra Lietz

On The Use Of Rotated Context Questionnaires In Conjunction With Multilevel Item Response Models, Raymond Adams, Petra Lietz, Alla Berezner

Professor Ray Adams

Background: While rotated test booklets have been employed in large-scale assessments to increase the content coverage of the assessments, rotation has not yet been applied to the context questionnaires administered to respondents.

Methods: This paper describes the development of a methodology that uses rotated context questionnaires in conjunction with multilevel item response models and plausible values. In order to examine the impact of this methodology on the continuity of the results, PISA 2006 data for nine heterogeneous countries were rescaled after having been restructured to simulate the outcomes of the use of different rotated context questionnaire designs.

Results: Results revealed …

Measure For Measure : A Review Of Outcomes Of School Education In Australia, John Ainley, Eveline Gebhardt

Dr John Ainley

There have been a plethora of research reports providing information about the achievements of students in Australian schools and how those achievements differ among jurisdictions and among groups of students. However, each report has often been viewed in isolation from other similar studies. This report is intended to provide an integrated appraisal of the results of the international and national achievement surveys conducted since 1994 but with some references to earlier studies. In addition to limiting the task to manageable proportions, this time span corresponds to the widespread introduction of modern measurement methods so that there is a better basis …

Some Drivers Of Test Item Difficulty In Mathematics : An Analysis Of The Competency Rubric, Ross Turner, Ray J. Adams

Professor Ray Adams

This paper is concerned with the empirical validation of the competency rubric described in another paper presented at the same conference: Turner, Ross (April 2012). Some drivers of test item difficulty in mathematics. Paper presented at the Annual Meeting of the American Educational Research Association (AERA), Vancouver, 13-17 April 2012 http://research.acer.edu.au/pisa/4/ Using items developed for the PISA 2012 survey, and data collected as part of an extensive field trial of the PISA tasks conducted during 2011 in some 67 countries, the authors use multidimensional Rasch modelling and latent regression to examine the following three questions: 1. What is the level …

A Framework For Predicting Item Difficulty In Reading Tests, Tom Lumley, Alla Routitsky, Juliette Mendelovits, Dara Ramalingam

Dr Alla Routitsky

Results on reading tests are typically reported on scales composed of levels, each giving a statement of student achievement or proficiency. The PISA reading scales provide broad descriptions of skill levels associated with reading items, intended to communicate to policy makers and teachers about the reading proficiency of students at different levels. However, the described scales are not explicitly tied to features that predict difficulty. Difficulty is thus treated as an empirical issue, using a post hoc solution, while a priori estimates of item difficulty have tended to be unreliable. Understanding features influencing the difficulty of reading tasks has the …

Print And Digital Reading In Pisa 2009 : Comparison And Contrast, Juliette Mendelovits, Dara Ramalingam, Tom Lumley

Dara Ramalingam

PISA was administered for the fourth time in 2009. Since in each administration, one of reading, maths or science is chosen as the major domain, the 2009 survey marked the first time that a domain (in this case, reading) was revisited as the major focus of the assessment. This allowed a full review of the framework for reading literacy and the inclusion of new elements to reflect the way that reading has changed since 2000 (OECD, 2009). One such change is the increasing prevalence of digital texts. The assessment of digital reading in the PISA 2009 cycle, undertaken by 19 …

Large-Scale Group Score Assessments: Past, Present, And Future, B Naemi, E Gonzalez, J Bertling, A Betancourt, J Burrus, P Kyllonen, J Minsky, Petra Lietz, E Klieme, S Vieluf, J Lee, R Roberts

Dr Petra Lietz

he influence of large-scale group score assessments on research, policy, and practice in education has increased dramatically over the past few decades. The goal of this chapter is to provide an overview of the value and scope of this program of research. The chapter begins by providing an overview of the history of large-scale assessment. Next, it focuses on current research and development surrounding the National Assessment of Educational Progress (NAEP, a government-mandated assessment in the United States) and the Programme for International Student Assessment (PISA, a large-scale survey and assessment commission by the Organisation for Economic Co-operation and Development, …

Large-Scale Group Score Assessments: Past, Present, And Future, Petra Lietz

Dr Petra Lietz

The influence of large-scale group score assessments on research, policy, and practice in education has increased dramatically over the past few decades. The goal of this chapter is to provide an overview of the value and scope of this program of research. The chapter begins by providing an overview of the history of large-scale assessment. Next, it focuses on current research and development surrounding the National Assessment of Educational Progress (NAEP, a government-mandated assessment in the United States) and the Programme for International Student Assessment (PISA, a large-scale survey and assessment commission by the Organisation for Economic Co-operation and Development, …

Print And Digital Reading In Pisa 2009 : Comparison And Contrast, Juliette Mendelovits, Dara Ramalingam, Tom Lumley

Dr Tom Lumley

PISA was administered for the fourth time in 2009. Since in each administration, one of reading, maths or science is chosen as the major domain, the 2009 survey marked the first time that a domain (in this case, reading) was revisited as the major focus of the assessment. This allowed a full review of the framework for reading literacy and the inclusion of new elements to reflect the way that reading has changed since 2000 (OECD, 2009). One such change is the increasing prevalence of digital texts. The assessment of digital reading in the PISA 2009 cycle, undertaken by 19 …

How Well Do Young People Deal With Contradictory And Unreliable Information On Line? What The Pisa Digital Reading Assessment Tells Us, Tom Lumley, Juliette Mendelovits

Dr Tom Lumley

There is sometimes an assumption that young people, as ‘digital natives’, are able to use online information effectively, including selecting and negotiating digital texts that are not only relevant for what they need, but also are likely to provide reliable information. This paper examines the question of how well young people are in fact able to recognise whether information is likely to be trustworthy. While some small-scale work has been done in this area, this paper draws on data from the first large-scale international assessment of online reading, the Digital Reading Assessment (DRA) that was part of the Organisation for …

Using Mathematical Competencies To Predict Item Difficulty In Pisa, Ross Turner, J Dossey, W Blum, M Niss

Ross Turner