Education Commons^™

Within And Between School Variation In Achievement On The Programme For International Student Assessment (Pisa) In Australia: Pisa Australia Technical Paper, John Ainley, Greg Macaskill, Sue Thomson

OECD Programme for International Student Assessment (PISA) Australia

Australian secondary school students vary widely in their academic achievement. Using the scores from the Programme for International Student Achievement (PISA) in 2018, for example, the range from the 5th to the 95th percentile of student reading scores in Australia was 359 points compared to the OECD average of 327 points (OECD, 2019a; Thomson et al., 2019). This considerable range in achievement scores has been described as reflecting a long tail in the distribution of achievement. In this paper, attention is focused on the variation in the achievement scores of 15-year-old students in Australia based on data from PISA 2018. …

Australian 15-Year-Old Students Living In An Integrated World, Lisa De Bortoli, Catherine Underwood, Sarah Richardson

OECD Programme for International Student Assessment (PISA) Australia

Global competence is defined in the Programme for International Student Assessment (PISA) as a multidimensional capacity that encompasses the ability to examine issues of local, global and cultural significance; understand and appreciate the perspectives and worldviews of others; engage in open, appropriate and effective interactions across cultures; and take action for collective well-being and sustainable development (OECD, 2020). This report focuses on aspects of the global competence module in the PISA 2018 Student Questionnaire and the School Questionnaire. It examines aspects of data collected from student and principal self-reports from the Australian perspective. This report focuses on the similarities between …

Australia: Pisa Australia—Excellence And Equity?, Sue Thomson

OECD Programme for International Student Assessment (PISA) Australia

Australia’s education system reflects its history of federalism. State and territory governments are responsible for administering education within their jurisdiction and across the sector comprising government (public), Catholic systemic and other independent schooling systems. They collaborate on education policy with the federal government. Over the past two decades the federal government has taken a greater role in funding across the education sector, and as a result of this involvement and the priorities of federal governments of the day, Australia now has one of the highest rates of non-government schooling in the OECD. Funding equity across the sectors has become a …

What Pisa Tells Us About Our Preparedness For Remote Learning, Sue Thomson

Teacher columnist - Sue Thomson

Within just a few weeks, the nature of teaching and learning has been flipped, nationally and internationally. The COVID-19 crisis has propelled schools to an online learning environment, to ways of teaching and learning that we were only just experimenting with until now. How do we make the most of this crisis?

Assessing Social And Emotional Skills, Sue Thomson

Teacher columnist - Sue Thomson

In this edited version of her presentation at ACER’s Research Conference Dr Sue Thomson looks at the assessment of social and emotional skills in an increasingly fast-changing and diverse world.

Pisa Australia In Focus Number 1: Sense Of Belonging At School, Lisa De Bortoli

OECD Programme for International Student Assessment (PISA) Australia

PISA has established a profile of what 15-year-old students can do and what they are like as learners. Gaining an understanding about the non-cognitive aspects, including students’ motivation, engagement and beliefs, for achieving success in school and in the future is another important goal of PISA. This report seeks to explore an aspect of students’ more general attitudes towards school, specifically their sense of belonging at school.

Single-Sex Schooling And Girls’ Achievement In Australia, Katherine Dix

Gender and education

Data from research studies such as the Progress in International Reading Literacy Study (PIRLS), the Programme for International Student Assessment (PISA), Trends in Mathematics and Science Study (TIMSS), and NAPLAN have been utilised to compare girls’ and boys’ academic achievement in single-sex and co-educational schools. The data sets, which inform policy monitoring by identifying key performance measures and evaluating progress towards educational goals for Australian students by international standards, are examined to identify any gender biases in Australian and international trends in reading and mathematics for Years 3-4 to Year 9 students. The effects of socio-economic status, year level and …

Pisa 2015: Financial Literacy In Australia, Sue Thomson, Lisa De Bortoli

OECD Programme for International Student Assessment (PISA) Australia

The main focus of the Programme for International Student Assessment (PISA) financial literacy assessment is on measuring the proficiency of 15-year-old students in demonstrating and applying the knowledge and skill that they have learned in and out of school. Like other PISA domains, financial literacy is assessed using an instrument designed to provide data that are valid, reliable and interpretable. PISA is an international comparative assessment of student achievement directed by the Organisation for Economic Co-operation and Development (OECD). PISA measures how well 15-year-olds, who are nearing the end of their compulsory schooling in most participating educational systems, are prepared …

Review Of Years 9 To 12 Tasmania : Final Report, Geoff N. Masters, Kathryn Moyle, Sheldon Rothman, Hilary Hollingsworth, Bill Perrett, Paul R. Weldon, Kate Perkins, Justin Brown, Ali Radloff, Patricia Freeman, Sofi Damianidis

Policy Analysis and Program Evaluation

The Tasmanian Government is currently implementing significant reforms to improve students’ retention and attainment in Tasmania’s schools. There is a concern in the Tasmanian community however, that their students’ performances are among the lowest in the nation. Reasons nominated for these results include weak literacy and numeracy levels; low attendance rates; high anxiety around transitions between Year 10 and Year 11 by some students, especially among those living outside of the larger cities; students seeking alternative education options; and family, financial, health and carer based issues. It is against this backdrop that the Australian Council for Educational Research (ACER) was …

Pisa 2015 : A First Look At Australia’S Results, Sue Thomson, Lisa De Bortoli, Catherine Underwood

OECD Programme for International Student Assessment (PISA) Australia

The Programme for International Student Assessment (PISA) is an international comparative study of student achievement directed by the Organisation for Economic Co-operation and Development (OECD). PISA 2015 represents the sixth such study since PISA was first conducted in 2000. Seventy-two OECD countries or partner economies participated in PISA 2015. In Australia, PISA is managed by the Australian Council for Educational Research (ACER) and is jointly funded by the Australian Government and the state and territory governments. The goal of PISA is to measure how well 15-year-olds, who are nearing the end of their compulsory schooling in most participating educational systems, …

Pisa 2015 : A First Look At Australia’S Results Data Tables [Excel] [Data Set], Sue Thomson, Lisa De Bortoli, Catherine Underwood

OECD Programme for International Student Assessment (PISA) Australia

The data tables for the report PISA 2015 : a first look at Australia's results (2016). This report provided a first look at the results from PISA 2015, and focused on the achievement results in scientific, reading and mathematical literacy.

A Review Of International Large-Scale Assessments In Education: Assessing Component Skills And Collecting Contextual Data, John Cresswell, Ursula Schwantner, Charlotte Waters

OECD Programme for International Student Assessment (PISA)

The OECD has initiated PISA for Development (PISA-D) in response to the rising need of developing countries to collect data about their education systems and the capacity of their student bodies. This report aims to compare and contrast approaches regarding the instruments that are used to collect data on (a) component skills and cognitive instruments, (b) contextual frameworks, and (c) the implementation of the different international assessments, as well as approaches to include children who are not at school, and the ways in which data are used. It then seeks to identify assessment practices in these three areas that will …

Financing The Future: Australian Students’ Results In The Pisa 2012 Financial Literacy Assessment, Sue Thomson

OECD Programme for International Student Assessment (PISA) Australia

This report reveals that Australia is in the top five in the world’s first international assessment of young people’s financial literacy. Conducted in 2012 as part of the Programme for International Student Assessment (PISA) of the OECD with support from the Australian Securities and Investments Commission as the Australian Government agency responsible for financial literacy, the supplementary PISA financial literacy assessment measured 15-year-olds’ knowledge of personal finances and ability to apply it to financial problems. A total of 29 000 students from 18 countries and economies participated in the assessment, including approximately 3300 Australian students from 768 schools. According to …

Described Proficiency Scales And Learning Metrics, Ross Turner

Assessment GEMS

We see the process of educational measurement as one of defining dimensions of educational progression and locating learners on those dimensions. Such dimensions are variously referred to as proficiency scales or learning metrics. When we measure something using a scale we can express how much of a given attribute is possessed by that something. We use a scale of centimetres or inches to describe the length of an object. We use a scale of hours and minutes to describe an amount of time. This is also the case for educational measurement: when we measure proficiency in a subject area we …

Comparison Of Piaac And Pisa Frameworks For Numeracy And Mathematical Literacy, Iddo Gal, David Tout

OECD Programme for International Student Assessment (PISA)

This paper describes key aspects of the frameworks for the assessment of adult numeracy and mathematical literacy in PIAAC and PISA, which are OECD two flagship programs for international comparative assessment of competencies. The paper examines commonalities and differences in how the constructs of adult numeracy and mathematical literacy were assessed in PIAAC and PISA, and sketches selected challenges associated with interpretation of results from these surveys.

Unfinished Business: Pisa Shows Indigenous Youth Are Being Left Behind, Tony Dreise, Sue Thomson

Indigenous Education Research

The latest international assessment of students’ mathematical, scientific and reading literacy – the Programme for International Student Assessment (PISA) – shows that the gap between Indigenous and non-Indigenous students has remained the same for the last decade. In short, Indigenous 15-year olds remain approximately two-and-a-half years behind their non-Indigenous peers in schooling.

This essay provides a précis of the results and analysis of some of the issues; it compares Indigenous performance in 2012 with that from previous PISA cycles; and discusses a range of implications for policy and practice.

A Teacher's Guide To Pisa Mathematical Literacy, Sue Thomson, Kylie Hillman, Lisa De Bortoli

OECD Programme for International Student Assessment (PISA) Australia

This report focuses on mathematical literacy and is one of a series of three reports on Australian students' performance in PISA. The report provides an overview of the PISA mathematics framework and Australia's results in the PISA 2003 international assessment. Also included are mathematics items released for public viewing after the PISA 2003 assessment and examples of responses, marking guides and comparisons of results with other countries. The context behind achievement, e.g. attitudes, engagement and learning strategies, is also presented.

A Teacher's Guide To Pisa Scientific Literacy, Sue Thomson, Kylie Hillman, Lisa De Bortoli

OECD Programme for International Student Assessment (PISA) Australia

This report focuses on Australian students' performance on the PISA items that have been released in Scientific Literacy. It includes an overview of the PISA Scientific Literacy Framework, Australian students' results in the 2006 international assessment, examples of responses and marking guides and the context behind achievement, e.g. attitudes, engagement and motivation, and recognition of environmental issues.

A Teacher's Guide To Pisa Reading Literacy, Sue Thomson, Kylie Hillman, Lisa De Bortoli

OECD Programme for International Student Assessment (PISA) Australia

This report focuses on Australian students' performance on the PISA items that have been released in reading literacy. It includes an overview of the PISA Reading Framework, Australia's results in the PISA 2009 international assessment , examples of responses and marking guides, and the context behind achievement, e.g. enjoyment of reading, how often they read and high-level strategies for learning.

Measure For Measure : A Review Of Outcomes Of School Education In Australia, John Ainley, Eveline Gebhardt

Assessment and Reporting

There have been a plethora of research reports providing information about the achievements of students in Australian schools and how those achievements differ among jurisdictions and among groups of students. However, each report has often been viewed in isolation from other similar studies. This report is intended to provide an integrated appraisal of the results of the international and national achievement surveys conducted since 1994 but with some references to earlier studies. In addition to limiting the task to manageable proportions, this time span corresponds to the widespread introduction of modern measurement methods so that there is a better basis …

Some Drivers Of Test Item Difficulty In Mathematics : An Analysis Of The Competency Rubric, Ross Turner, Ray J. Adams

OECD Programme for International Student Assessment (PISA)

This paper is concerned with the empirical validation of the competency rubric described in another paper presented at the same conference: Turner, Ross (April 2012). Some drivers of test item difficulty in mathematics. Paper presented at the Annual Meeting of the American Educational Research Association (AERA), Vancouver, 13-17 April 2012 http://research.acer.edu.au/pisa/4/

Using items developed for the PISA 2012 survey, and data collected as part of an extensive field trial of the PISA tasks conducted during 2011 in some 67 countries, the authors use multidimensional Rasch modelling and latent regression to examine the following three questions: 1. What is the …

A Framework For Predicting Item Difficulty In Reading Tests, Tom Lumley, Alla Routitsky, Juliette Mendelovits, Dara Ramalingam

OECD Programme for International Student Assessment (PISA)

Results on reading tests are typically reported on scales composed of levels, each giving a statement of student achievement or proficiency. The PISA reading scales provide broad descriptions of skill levels associated with reading items, intended to communicate to policy makers and teachers about the reading proficiency of students at different levels. However, the described scales are not explicitly tied to features that predict difficulty. Difficulty is thus treated as an empirical issue, using a post hoc solution, while a priori estimates of item difficulty have tended to be unreliable. Understanding features influencing the difficulty of reading tasks has the …

How Well Do Young People Deal With Contradictory And Unreliable Information On Line? What The Pisa Digital Reading Assessment Tells Us, Tom Lumley, Juliette Mendelovits

OECD Programme for International Student Assessment (PISA)

There is sometimes an assumption that young people, as ‘digital natives’, are able to use online information effectively, including selecting and negotiating digital texts that are not only relevant for what they need, but also are likely to provide reliable information. This paper examines the question of how well young people are in fact able to recognise whether information is likely to be trustworthy. While some small-scale work has been done in this area, this paper draws on data from the first large-scale international assessment of online reading, the Digital Reading Assessment (DRA) that was part of the Organisation for …

Print And Digital Reading In Pisa 2009 : Comparison And Contrast, Juliette Mendelovits, Dara Ramalingam, Tom Lumley

OECD Programme for International Student Assessment (PISA)

PISA was administered for the fourth time in 2009. Since in each administration, one of reading, maths or science is chosen as the major domain, the 2009 survey marked the first time that a domain (in this case, reading) was revisited as the major focus of the assessment. This allowed a full review of the framework for reading literacy and the inclusion of new elements to reflect the way that reading has changed since 2000 (OECD, 2009). One such change is the increasing prevalence of digital texts. The assessment of digital reading in the PISA 2009 cycle, undertaken by 19 …

Some Drivers Of Test Item Difficulty In Mathematics, Ross Turner

OECD Programme for International Student Assessment (PISA)

This paper is one of four contributions to the symposium session at the AERA’s 2012 Annual Meeting titled Exploring Reading and Mathematics Item Difficulty: Teaching and Learning Implications of PISA Survey Data. The author presents a rubric used to analyse mathematics test items developed for use in the OECD’s PISA survey. The rubric focuses on a set of mathematical competencies that are components of mathematical literacy. The work on which this report is based suggests that demand for activation of these competencies functions as a significant driver of item difficulty, which potentially has implications for the teaching and learning of …

Pisa 2009 Technical Report, John Cresswell (Ed)

OECD Programme for International Student Assessment (PISA)

PISA is methodologically highly complex, requiring intensive collaboration among many stakeholders. The successful implementation of PISA depends on the use, and sometimes further development, of state-of-the-art methodologies and technologies. The PISA 2009 Technical Report describes those methodologies, along with other features that have enabled PISA to provide high quality data to support policy formation and review. The descriptions are provided at a level that will enable review and, potentially, replication of the implemented procedures and technical solutions to problems. This report contains a description of the theoretical underpinning of the complex techniques used to create the PISA 2009 Database, which …

The Performance Of Students In The Australian Capital Territory On Pisa: Report To The Act Department Of Education And Training, Sue Thomson, Lisa De Bortoli

OECD Programme for International Student Assessment (PISA) Australia

The purpose of this report is to examine the performance of ACT students in the Programme for International Student Assessment (PISA) over the three cycles: Reading literacy in 2000, Mathematical literacy in 2003 and Scientific literacy in 2006. The report provides an opportunity to examine achievement within the territory, in comparison to the rest of the country and internationally.

Effects Of Item Positions On Their Difficulty And Discrimination : A Study In Pisa Science Data Across Test Language And Countries, Luc T. Le

OECD Programme for International Student Assessment (PISA)

This study was based on a four-cluster rotation design of 13 linked test booklets from PISA 2006 science data. It investigated effects of item positions on their difficulty and discrimination parameter estimates obtained from one and two parameter IRT Partial Credit models. The analyses were done separately for 57 test language groups from 53 countries with a total of about 340,000 students.

The results revealed that for all of the test language groups the items tended to become more difficult when they were located later in the test. However, a high linear relationship between the item difficulty estimates by the …