Educational Assessment, Evaluation, and Research Commons^™

School Improvement Tool Elaborations: Student Engagement And Wellbeing. Background Report And Literature Review, Fabienne Van Der Kleij, Pauline Taylor-Guy, Tanya Vaughan, Marijne Medhurst, Christina Rogers

School and system improvement

This literature review outlines the evidence that underpins the development of a set of evidence-informed elaborations, or specific practices, that support student engagement and wellbeing across the 9 domains of the National School Improvement Tool (NSIT). These observable, measurable practices to support student engagement and wellbeing have been developed from a review of relevant literature in the areas of socio-emotional learning (SEL), health and wellbeing, student engagement and a sense of belonging, and motivations for engagement. They also take account of commissioned research reports by the Queensland Department of Education and the Department's (2018) approach to student learning and wellbeing …

Collective Efficacy Tracking Tool. Development Framework 2023, Kerry Elliott, Hilary Hollingsworth

Educational leadership

Collective efficacy has become a prominent feature in educational policy and practice with growing evidence that a strong sense of collective efficacy amongst educators leads to better outcomes for students. With growing interest in the importance of collective efficacy and how to cultivate it, the Collective Efficacy Tracking Tool was created to address challenges associated with understanding, diagnosing, and developing collective efficacy. This Framework describes the development of the Collective Efficacy Tracking Tool, defining collective efficacy in a way that it can be operationalised to leverage improvement efforts. The Framework and accompanying Collective Efficacy Tracking Tool provide a practical resource …

Pisa In Brief 2022: Student Performance And Equity In Education, Lisa De Bortoli, Catherine Underwood, Sue Thomson

OECD Programme for International Student Assessment (PISA) Australia

The Programme for International Student Assessment (PISA) is an assessment that measures the knowledge and skills of 15-year-old students, an age at which they have nearly completed compulsory schooling. PISA assesses young adults’ ability to apply their knowledge and skills to real-life problems and situations rather than how well they have learned a specific curriculum. This PISA in Brief report provides a summary of student performance in the PISA 2022 assessment and tells us about their capacity to apply knowledge and skills in the domains of reading, mathematical, and scientific literacy.

Pisa 2022. Reporting Australia’S Results. Volume I: Student Performance And Equity In Education, Lisa De Bortoli, Catherine Underwood, Sue Thomson

OECD Programme for International Student Assessment (PISA) Australia

The Programme for International Student Assessment (PISA) is an international comparative study of student performance directed by the Organisation for Economic Co-operation and Development (OECD). PISA measures 3 core domains of reading literacy, mathematical literacy, and scientific literacy. The assessment focuses on young people’s ability to apply their knowledge and skills to real-world problems and situations. The term ‘literacy’ reflects a focus on broader skills. As a concept, literacy is more than simply being able to read and write. Eighty-one countries or economies, involving around 690,000 students, participated in PISA 2022. In Australia, 743 schools and a total of 13,437 …

Supporting Schools’ And Teachers’ Use Of Assessment To Inform Learning Of All Students, Ursula Schwantner, Soumaya Maghnouj

Global education monitoring

Issue 5 of the series Using assessment data in education policy and practice: Examples from the Asia-Pacific documents 4 case studies of promising and effective policies or practices on how education systems can better support teachers and schools in effectively integrating assessment practices in the teaching and learning process, to identify and meaningfully address every learner’s needs. In particular, the case studies show how different tools, approaches and policies help promote and reinforce the use of assessment to support more learner-centred and differentiated approaches to teaching and learning. 1. Using the Progressive Achievement approach to develop data-informed schools by Marc …

Technology In Education: A Case Study On Lao People's Democratic Republic, Yung Nietschke, Anna Dabrowski

International Education Research

This paper was commissioned by the Global Education Monitoring Report as background information for the development of the 2023 Global Education Monitoring (GEM) Report: technology and education, Southeast Asia. Digital technology has the potential to transform learning and offer a solution to persistent challenges in equity of access and quality of learning for all students. COVID-19 has accelerated the adoption of technology to deliver alternative modes of education. It has also put the spotlight on the digital divide that technology creates. This Case Study explores the progress of technology integration in the education sector in Lao PDR in line with …

The Overcoming Disadvantage In Early Childhood Study: Evaluation Of The Australian Literacy And Numeracy Foundation’S Early Language And Literacy Program. Summary Report, Dan Cloney, Kellie Picker, David Jeffries, Prue Anderson

Early Childhood Education

This report provides a summary of the completed Overcoming Disadvantage in Early Childhood (ODEC) longitudinal research study. The study was designed to evaluate the Australian Literacy and Numeracy Foundation’s (ALNF) Early Language and Literacy (EL&L) program by answering the research question: What is the effect of the EL&L program on the development of language and literacy skills in preschool aged children? An integral component of this study was the development of the Early Language and Literacy Developmental Index (ELLDI), a new tool to measure oral language and literacy learning. The development of the ELLDI was based on the recognised need …

Supporting The Quality Of Digital Learning: Project Brief, Abha Bhagat

ACER India

Khan Academy introduced the Science Essentials Course to build a strong foundation in fundamental concepts among learners using deep conceptual videos. The course consists of learning videos and exercises - the videos help strengthen conceptual understanding for students, while the element of focused practice allows learners to retrieve concepts learnt, make mistakes, receive feedback, and in the process, master skills. The Australian Council for Educational Research (India) reviewed a sample of videos and exercises in physics, chemistry, and biology of the Science Essentials Course for students in grades 11 and 12.

A Policy Monitoring Framework To Prepare For, Respond To, And Recover From Education In Emergencies, Pina Tarricone, Kemran Mestan, Ian Teo

International Education Research

The COVID-19 pandemic has highlighted how widespread emergencies can disrupt national education systems and schooling. To assist policy decision-making and monitoring, a rapid review of over 200 documents relating to education in emergencies (EiE) was conducted, with a specific focus on the COVID-19 pandemic. The purpose of the review is to support policymakers, largely in developing countries, to develop policies that promote education system resiliency with a focus on monitoring those policies. From the analysis and synthesis of evidence a new framework has been produced, which assists policymakers by organising the complexity of relevant concerns. This Policy Monitoring Framework (PMF) …

Halt Certification: Reducing The Workload, Increasing The Rigour And Cutting The Cost, Lawrence Ingvarson, Hilary Hollingsworth

Teacher workforce and careers

In December 2022, federal, state and territory education ministers released a National Teacher Workforce Action Plan to improve teacher supply and retention in the profession. While recognising the important role that Highly Accomplished and Lead Teacher (HALT) certification could play, the plan also recognised that the current approach to certification was cumbersome for teachers and called for it to be ‘streamlined’. At the request of the education ministers, the Australian Institute for Teaching and School Leadership (AITSL) has produced a revised Framework for the Certification of HALT Teachers. Guided by the Framework, certifying authorities across state and territory school systems …

National Assessment Program: Ict Literacy 2022: Public Report, Tim Friedman, Kate O'Malley, Zachary Watts, Kristy Osborne, Louise Ockwell, Laila Helou

ICT - Digital Literacy

This public report documents the findings of the sixth National Assessment Program ICT Literacy (NAP–ICT Literacy) assessment cycle. In reporting national key performance measures (KPMs) of Australian students’ ICT literacy, the NAP–ICT Literacy assessment provides a way to monitor progress towards the Alice Springs (Mparntwe) Education Goals for Young Australians. Goal 2 of the Alice Springs (Mparntwe) Education Declaration is that “all young Australians become confident and creative individuals, successful lifelong learners, and active and informed members of the community” (Education Council 2019, p. 6). The elaboration of this goal highlights the importance of young Australians’ digital and ICT literacy …

School-Based Interventions That Support Mental Health And Psychosocial Wellbeing In Low- And Middle-Income Countries, Syeda Kashfee Ahmed, Anna Dabrowski, Katherine Dix, Toby Carslake

Global education monitoring

It is encouraging to see a focus on student mental health increasingly reflected in international education policies. However, the growing number of school-based mental health and wellbeing programs makes it challenging to identify quality interventions that effectively support student mental health, and even harder to identify evidence-based programs that link mental health support to learning. There is also a lack of comprehensive evidence on the effectiveness of mental health and wellbeing interventions in relation to student academic outcomes, particularly in low- and middle-income countries (LMIC). In response to renewed interest in understanding how the education sector can provide effective mental …

The Australian Council For Educational Research (Acer) Response To The Australian Universities Accord Panel Interim Report, Australian Council For Educational Research (Acer)

Higher education research

The Australian Council for Educational Research (ACER) recognises the importance of universities, and the higher education sector more broadly, to the prosperity and success of Australia. ACER welcomes the intent and focus of the Universities Accord in creating a system that enables all Australians to consider the option of university education and be supported in embracing this opportunity. In our submission to the Accord Panel, we would like to provide reflection and insight into the following key areas:

• Recognising the higher education ‘life cycle’ begins well before university enrolment.
• Continuing to build the emphasis on equality of opportunity and equity-focussed …

Professional Learning Conversations: Adaptive Expertise For Schools. Supplementary Digital Materials, Helen Timperley

Educational leadership

School leaders face complex challenges, that typically have multiple causes and often persist despite everyone’s best attempts to address them. Addressing complex challenges requires juggling both the big picture, and the specific parts of the challenge. Without a roadmap, this process is fraught and unlikely to succeed in improving outcomes. In order to make a difference, schools need adaptive expertise; a skill which can be learnt through professional conversations and inquiry. In Leading professional conversations, Emeritus Professor Helen Timperley deftly outlines the key enablers for effective professional conversations – relationships, resources, processes, knowledge and culture – which support teachers to …

The National Student Assessment 2022 In Bangladesh. Key Findings & Learnings, Directorate Of Primary Education Bangladesh

Assessment and Reporting

This fact sheet highlights the key findings of the National Student Assessment (NSA) 2022, a sample-based assessment in Bangladesh, covering 3,357,233 students in grade 3 and 3,604,586 students in grade 5. The NSA project is a partnership of the Monitoring and Evaluation Division. Directorate of Primary Education. Ministry of Primary and Mass Education, UNICEF, UKAID and Australian Council for Educational Research (India) as technical agency.

Building A World-Class Learning System: Insights From Some Top-Performing School Systems, Geoff N. Masters

School and system improvement

The result of a multi-year study, this book explores how five school systems - British Columbia, Estonia, Finland, Hong Kong and South Korea - have been rethinking and reforming their schools systems. It addresses questions including: What policies need to be in place for every child to experience an engaging and supportive learning environment that motivates not only high performance but a desire to keep learning? What do students really need to know and be able to do to thrive in a changing world? How can systems engage in ongoing improvement while also cultivating innovation? The book provides a framework …

Pirls 2021 Australian Year 4 Data [Sas], Kylie Hillman, Elizabeth O'Grady, Sima Rodrigues, Marina Schmid, Sue Thomson

Progress in International Reading Literacy Study (PIRLS)

This dataset (SAS zipped) is a data source for the report Progress in International Reading Literacy Study: Australia’s results from PIRLS 2021. Refer to the readme.txt file for details.

Pirls 2021 Australian Year 4 Data [Spss], Kylie Hillman, Elizabeth O'Grady, Sima Rodrigues, Marina Schmid, Sue Thomson

Progress in International Reading Literacy Study (PIRLS)

This dataset (SPSS zipped) is a data source for the report Progress in International Reading Literacy Study: Australia’s results from PIRLS 2021. Refer to the readme.txt file for details.

Pirls 2021 Australian Year 4 Data Readme [Text], Kylie Hillman, Elizabeth O'Grady, Sima Rodrigues, Marina Schmid, Sue Thomson

Progress in International Reading Literacy Study (PIRLS)

This readme file contains information on use of the datasets that form the data source for the report Progress in International Reading Literacy Study: Australia’s results from PIRLS 2021.

The National Student Assessment 2022 In Bangladesh. Grades 3 And 5, Directorate Of Primary Education Bangladesh

Assessment and Reporting

The National Student Assessment (NSA) 2022 was a sample-based assessment in Bangladesh, measuring the learning levels of Bangladeshi students in Bangla and Mathematics covering 3,357,233 students in grade 3 and 3,604,586 students in grade 5. It was the seventh round of the national assessments in primary education in Bangladesh, conducted after five years and the most comprehensive national-level learning assessment after the global COVID-19 pandemic. The sampling method at school level was multistage stratified probability proportional to size method, and at student level was equal probability systematic random sampling derived from Annual Primary School Census (APSC) 2021 database.The report outlines …

Building Capacity For Quality Teaching Rounds – Victoria. Final Report, Tanya Vaughan, Sarah Richardson, Toby Carslake, Trisha Reimers, Greg Macaskill, Toby Newton, Nathan Zoanetti, Andrew Mannion, Martin Murphy

Professional learning for teachers and school leaders

The Australian Council for Educational Research (ACER) was commissioned by the Teachers and Teaching Research Centre (TTRC) at the University of Newcastle to conduct an independent randomised controlled trial (RCT), with the goal of examining effects of Quality Teaching Rounds (QTR) on student outcomes and teachers’ practice in Victorian high schools. A total of 19 schools participated in Quality Teaching Rounds in 2022, with 20 schools in the wait list control. Data were gathered in an ongoing manner during the evaluation with: Progressive Assessment Tests in Mathematics (PAT-M) and reading (PAT-R) – baseline and follow up; student self-efficacy and aspiration …

Progress In International Reading Literacy Study: Australia’S Results From Pirls 2021, Kylie Hillman, Elizabeth O'Grady, Sima Rodrigues, Marina Schmid, Sue Thomson

Progress in International Reading Literacy Study (PIRLS)

Progress in International Reading Literacy Study (PIRLS) is a large-scale assessment that measures how effective countries are in teaching reading literacy. Conducted every five years since 2001 (with Australia participating since 2011), PIRLS provides information about how to improve teaching and learning so that young students become accomplished and self-sufficient readers. In Australia, almost 5,500 Year 4 students participated in PIRLS 2021. These students completed tests in reading comprehension and answered questionnaires on their background and experiences in learning reading at school. To inform educational policy in the participating countries, alongside the assessment of reading literacy, PIRLS also routinely collects …

Implementing Effective Tiered Interventions In Secondary Schools: Survey Of School And Support Staff, Paul R. Weldon, Jonathan Heard, Jessica Thompson, Tanya Stephenson

Literacy and Numeracy

An online survey and a series of interviews were focused on students in Years 7 to 9 who lack the foundational literacy and numeracy skills that are required to engage with a secondary curriculum, in schools where most students have these skills. These students are referred to throughout this report as struggling students. The students in scope are likely to struggle to engage in classes without significant differentiation on the part of classroom teachers, and the skill disparity may be so great that differentiating lessons for them is not feasible. The project sought to address 4 questions: What methods and/or …

Acer 2021-2022 Annual Report, Australian Council For Educational Research (Acer)

ACER Annual Reports

No abstract provided.

Mid-Term Evaluation Report (Final): Global Education Monitoring (Gem) Centre Phase 3, Valerie Haugen

Monitoring Learning

This report provides findings and recommendations from the external mid-term evaluation of Phase 3 of the Global Education Monitoring (GEM Centre) - a long-term partnership between the Australian Council for Educational Research (ACER) and the Australian Government’s Department of Foreign Affairs and Trade (DFAT). The goal of the GEM Centre is to improve learning, by ensuring that education policies, practices and investments are influenced by high-quality evidence. The aim of the mid-term evaluation was to enable reflection on the long-term partnership through the GEM Centre. The findings highlight the successes and achievements of the GEM Centre over the past decade, …

Analysis Of Early Childhood Education And Learning Outcomes In The Pacific, Dan Cloney, Yung Nietschke, Jeffery Marshall

Early Childhood Education

There is strong evidence supporting early childhood education (ECE) programmes as an effective way to support children to have the best start in life, especially for the most disadvantaged children. When high‐quality programmes are established – where quality is assured, and barriers to participation eliminated – large positive effects are observed that are sustained into adulthood. Indeed, substantial positive returns on public investment in ECE programmes are reported. When low‐quality programmes are taken to scale in the market, however, smaller effects or no effects are observed. This is attributed to failure to get quality right. And when quality is too …

Pirls 2021 Australian Year 4 Data Tables [Excel], Kylie Hillman, Elizabeth O'Grady, Sima Rodrigues, Marina Schmid, Sue Thomson

Progress in International Reading Literacy Study (PIRLS)

No abstract provided.

School Improvement Tool, Australian Council For Educational Research (Acer)

School and system improvement

Research shows the powerful impact that school leadership teams can have in improving the quality of teaching and learning. Effective leaders create cultures of high expectations, provide clarity about what teachers are to teach and students are to learn, establish strong professional learning communities, and lead ongoing school-wide efforts to improve teaching practices. The School Improvement Tool describes the practices of highly effective schools and school leaders. The SIT assists schools to review and reflect on their strategies to improve the quality of classroom teaching and learning. It supports school-wide conversations – including with families, school governing bodies, local communities, …

School Improvement Tool: A Summary Of The Underpinning Research, Christina Rogers, Fabienne Van Der Kleij, Pauline Taylor-Guy

School and system improvement

In 2023, ACER published the School Improvement Tool (SIT), the second iteration of the National School Improvement Tool (NSIT). A comprehensive review of international research was undertaken to inform the development of the SIT which consists of nine inter-related domains that describe the practices of highly effective schools and leaders. This document provides a summary of research evidence that underpins each of the nine domains of the SIT. Acknowledging interdependencies between domains, it presents a narrative of key evidence and research-based considerations for each domain. Further detail about the evidence for each domain can be found in the School Improvement …

Reform Challenges In School Education, Geoff N. Masters

School and system improvement

The central thesis of this paper has been that the challenges now confronting schools globally will require fundamental reforms of the external frameworks within which schools work. Today’s challenges to better prepare young people for the future and to ensure that every student learns successfully will not be met by simply expecting teachers to change what they do or by making minor adjustments to current curricula, assessment, examination, reporting and credentialling arrangements. Today’s challenges require deep reforms and a willingness to reimagine—in other words, to ‘transform’ existing learning systems. This is essential because the external frameworks within which teachers and …