Educational Assessment, Evaluation, and Research | Open Access Articles

Pirls 2021 Australian Year 4 Data [Spss], Kylie Hillman, Elizabeth O'Grady, Sima Rodrigues, Marina Schmid, Sue Thomson

Progress in International Reading Literacy Study (PIRLS)

This dataset (SPSS zipped) is a data source for the report Progress in International Reading Literacy Study: Australia’s results from PIRLS 2021. Refer to the readme.txt file for details.

Go to article

Pirls 2021 Australian Year 4 Data Readme [Text], Kylie Hillman, Elizabeth O'Grady, Sima Rodrigues, Marina Schmid, Sue Thomson

Progress in International Reading Literacy Study (PIRLS)

This readme file contains information on use of the datasets that form the data source for the report Progress in International Reading Literacy Study: Australia’s results from PIRLS 2021.

Go to article

Building Capacity For Quality Teaching Rounds – Victoria. Final Report, Tanya Vaughan, Sarah Richardson, Toby Carslake, Trisha Reimers, Greg Macaskill, Toby Newton, Nathan Zoanetti, Andrew Mannion, Martin Murphy

Professional learning for teachers and school leaders

The Australian Council for Educational Research (ACER) was commissioned by the Teachers and Teaching Research Centre (TTRC) at the University of Newcastle to conduct an independent randomised controlled trial (RCT), with the goal of examining effects of Quality Teaching Rounds (QTR) on student outcomes and teachers’ practice in Victorian high schools. A total of 19 schools participated in Quality Teaching Rounds in 2022, with 20 schools in the wait list control. Data were gathered in an ongoing manner during the evaluation with: Progressive Assessment Tests in Mathematics (PAT-M) and reading (PAT-R) – baseline and follow up; student self-efficacy and aspiration …

Go to article

International Comparison Of Tertiary Education Systems, Ian Teo, Michelle Hsien, Sarah Buckley, Anita Roberts

Higher education research

This report is designed to review high performing tertiary systems internationally (Germany, Norway, the United Kingdom, Korea, Singapore and New Zealand) and compare these systems to Australia. This review highlights best practice in international tertiary education systems as well as system weaknesses by considering the following criteria for each country of interest: Tertiary education system performance, including participation, attainment, labour market outcomes, and public and private returns for tertiary education; The national context, including the shape of the broader education system, and relevant demographic and economic characteristics; The structure of tertiary education systems, including linkages between higher education and vocational …

Go to article

The National Student Assessment 2022 In Bangladesh. Grades 3 And 5, Directorate Of Primary Education Bangladesh

Assessment and Reporting

The National Student Assessment (NSA) 2022 was a sample-based assessment in Bangladesh, measuring the learning levels of Bangladeshi students in Bangla and Mathematics covering 3,357,233 students in grade 3 and 3,604,586 students in grade 5. It was the seventh round of the national assessments in primary education in Bangladesh, conducted after five years and the most comprehensive national-level learning assessment after the global COVID-19 pandemic. The sampling method at school level was multistage stratified probability proportional to size method, and at student level was equal probability systematic random sampling derived from Annual Primary School Census (APSC) 2021 database.The report outlines …

Go to article

Progress In International Reading Literacy Study: Australia’S Results From Pirls 2021, Kylie Hillman, Elizabeth O'Grady, Sima Rodrigues, Marina Schmid, Sue Thomson

Progress in International Reading Literacy Study (PIRLS)

Progress in International Reading Literacy Study (PIRLS) is a large-scale assessment that measures how effective countries are in teaching reading literacy. Conducted every five years since 2001 (with Australia participating since 2011), PIRLS provides information about how to improve teaching and learning so that young students become accomplished and self-sufficient readers. In Australia, almost 5,500 Year 4 students participated in PIRLS 2021. These students completed tests in reading comprehension and answered questionnaires on their background and experiences in learning reading at school. To inform educational policy in the participating countries, alongside the assessment of reading literacy, PIRLS also routinely collects …

Go to article

Implementing Effective Tiered Interventions In Secondary Schools: Survey Of School And Support Staff, Paul R. Weldon, Jonathan Heard, Jessica Thompson, Tanya Stephenson

Literacy and numeracy

An online survey and a series of interviews were focused on students in Years 7 to 9 who lack the foundational literacy and numeracy skills that are required to engage with a secondary curriculum, in schools where most students have these skills. These students are referred to throughout this report as struggling students. The students in scope are likely to struggle to engage in classes without significant differentiation on the part of classroom teachers, and the skill disparity may be so great that differentiating lessons for them is not feasible. The project sought to address 4 questions: What methods and/or …

Go to article

Submission In Response To The Teacher Education Expert Panel Discussion Paper, Australian Council For Educational Research (Acer)

Shaping educational policy

This submission in response to the 2023 Teacher Education Expert Panel Discussion Paper argues that improving teacher quality requires a system-wide, career-long approach to teacher education rather than a narrow focus on initial teacher education (ITE) programs. While supporting rigorous ITE standards, evidence-based content, robust assessment, and consistent accreditation, ACER contends that teacher preparation must be understood within a broader continuum encompassing recruitment, induction, mentoring, professional learning, career progression, and retention. Drawing on Australian and international research, the submission highlights the importance of supportive workplace conditions, structured early-career support, and coherent professional pathways to strengthen teacher workforce sustainability and effectiveness. …

Go to article

Engaging Young Female Students In Digital Technology Programs: Part Two, Kristy Osborne, Rachel Felgate, Sarah Buckley

Digital learning research

This report is part of a larger project commissioned by CSIRO and designed to highlight the enablers and barriers to young female students engaging with digital technology through a primary research project. This research aimed to gain insight from teachers, students and tertiary educators in order to trace the pathway from primary through to tertiary digital technology education. The perspectives of these stakeholders are compared with the findings from Part One of the project. Part Two of the larger project relates to a primary research project designed to gain further insight into the factors that facilitate and hinder young female …

Go to article

Infographic: Basic Literacy Skills And The Gap Between Male And Female Students, Jo Earp

Teacher infographics

NAPLAN’s National Minimum Standard is the ‘agreed minimum acceptable standard of knowledge and skills without which a student will have difficulty making sufficient progress at school’. Ahead of the 2023 tests, we compare the percentage of male and female students in year 9 achieving at or above the standard in Literacy, over time.

Go to article

Infographic: Basic Skills And The Gap Between Indigenous And Non-Indigenous Students, Jo Earp

Teacher infographics

In the National Assessment Program — Literacy and Numeracy (NAPLAN) tests, the national minimum standard (NMS) is the ‘agreed minimum acceptable standard of knowledge and skills without which a student will have difficulty making sufficient progress at school’. This infographic looks at the performance of Indigenous and non-Indigenous students in Year 9, over time.

Go to article

Acer 2021-2022 Annual Report, Australian Council For Educational Research (Acer)

ACER Annual Reports

No abstract provided.

Go to article

Mid-Term Evaluation Report (Final): Global Education Monitoring (Gem) Centre Phase 3, Valerie Haugen

Monitoring Learning

This report provides findings and recommendations from the external mid-term evaluation of Phase 3 of the Global Education Monitoring (GEM Centre) - a long-term partnership between the Australian Council for Educational Research (ACER) and the Australian Government’s Department of Foreign Affairs and Trade (DFAT). The goal of the GEM Centre is to improve learning, by ensuring that education policies, practices and investments are influenced by high-quality evidence. The aim of the mid-term evaluation was to enable reflection on the long-term partnership through the GEM Centre. The findings highlight the successes and achievements of the GEM Centre over the past decade, …

Go to article

Analysis Of Early Childhood Education And Learning Outcomes In The Pacific, Dan Cloney, Yung Nietschke, Jeffery Marshall

Early Childhood Education

There is strong evidence supporting early childhood education (ECE) programmes as an effective way to support children to have the best start in life, especially for the most disadvantaged children. When high‐quality programmes are established – where quality is assured, and barriers to participation eliminated – large positive effects are observed that are sustained into adulthood. Indeed, substantial positive returns on public investment in ECE programmes are reported. When low‐quality programmes are taken to scale in the market, however, smaller effects or no effects are observed. This is attributed to failure to get quality right. And when quality is too …

Go to article

Iea International Civic And Citizenship Education Study 2022: Assessment Framework, Wolfram Schulz, Julian Fraillon, Bruno Losito, Gabriella Agrusti, John Ainley, Valeria Damiani, Tim Friedman

Civics and Citizenship Assessment

The International Civic and Citizenship Education Study (ICCS) investigates the preparation of young people to undertake their roles as citizens. It gathers and analyzes data from representative national samples on students’ conceptual knowledge and understanding of civics and citizenship, as well as their attitudes to, and engagement with, aspects of civics and citizenship. ICCS builds on a succession of IEA studies in this field dating back to 1971, and especially since 2009. The 2022 study has been developed to build on previous perspectives on, and monitor changes in, such enduring issues as: levels of civic knowledge and understanding; patterns of …

Go to article

Gtf Global Tracer Survey 2022 (Year 7) - Survey Instrument Items, Australia Awards Global Tracer Facility

Australia Awards Global Tracer Facility

This survey instrument for the Year 7 Global Tracer Facility (GTF) Global Tracer Survey 2022 outlines the survey sections, area of focus, type of question and response options. The questions in the survey relate to the Australian development scholarship/fellowship which participants have previously completed.

Go to article

School Improvement Tool, Australian Council For Educational Research (Acer)

School and system improvement

Research shows the powerful impact that school leadership teams can have in improving the quality of teaching and learning. Effective leaders create cultures of high expectations, provide clarity about what teachers are to teach and students are to learn, establish strong professional learning communities, and lead ongoing school-wide efforts to improve teaching practices. The School Improvement Tool describes the practices of highly effective schools and school leaders. The SIT assists schools to review and reflect on their strategies to improve the quality of classroom teaching and learning. It supports school-wide conversations – including with families, school governing bodies, local communities, …

Go to article

Reform Challenges In School Education, Geoff N. Masters

School and system improvement

The central thesis of this paper has been that the challenges now confronting schools globally will require fundamental reforms of the external frameworks within which schools work. Today’s challenges to better prepare young people for the future and to ensure that every student learns successfully will not be met by simply expecting teachers to change what they do or by making minor adjustments to current curricula, assessment, examination, reporting and credentialling arrangements. Today’s challenges require deep reforms and a willingness to reimagine—in other words, to ‘transform’ existing learning systems. This is essential because the external frameworks within which teachers and …

Go to article

School Improvement Tool: Literature Review, Fabienne Van Der Kleij, Pauline Taylor-Guy, Christina Rogers

School and system improvement

The School Improvement Tool (SIT) identifies practices of highly effective schools and schools which have undergone substantial improvement, based on evidence from the international literature. It is made up of nine inter-related domains, or areas of practice. This literature review presents a thematic synthesis of the research evidence across the nine domains of the School Improvement Tool. This review underpinned the development of the School Improvement Tool, as the Second iteration of the National School Improvement Tool.

Go to article

Pirls 2021 Australian Year 4 Data Tables [Excel], Kylie Hillman, Elizabeth O'Grady, Sima Rodrigues, Marina Schmid, Sue Thomson

Progress in International Reading Literacy Study (PIRLS)

No abstract provided.

Go to article

Technical Support For A Micro-Scholarship Programme To Improve Learning: Project Brief, Bikramjit Sen

ACER India

Sri Aurobindo Society (SAS), one of the largest Indian non-government organisations launched the AuroScholar, a micro-scholarship initiative for students in grades 1 to 12 in India. The scholarships are expected to improve student motivation and encourage positive behavioural patterns which are critical for improving engagement in learning, eventually leading to better outcomes. The Australian Council for Educational Research (India) provided technical support in improving the quality of the 10-minute, daily, curriculum-aligned qualifying quiz for the scholarship. Students are awarded a micro-scholarship of INR 50 upon correctly answering 80% questions in each quiz.

Go to article

School Improvement Tool: A Summary Of The Underpinning Research, Christina Rogers, Fabienne Van Der Kleij, Pauline Taylor-Guy

School and system improvement

In 2023, ACER published the School Improvement Tool (SIT), the second iteration of the National School Improvement Tool (NSIT). A comprehensive review of international research was undertaken to inform the development of the SIT which consists of nine inter-related domains that describe the practices of highly effective schools and leaders. This document provides a summary of research evidence that underpins each of the nine domains of the SIT. Acknowledging interdependencies between domains, it presents a narrative of key evidence and research-based considerations for each domain. Further detail about the evidence for each domain can be found in the School Improvement …

Go to article

Rethinking Assessment In Response To Generative Artificial Intelligence, Jacob Pearce, Neville Chiavaroli

Higher education research

The use of decision-making support tools during assessments, such as electronic differential diagnosis in examinations, is just the tip of the iceberg when it comes to how technology is currently changing assessment practice. We have reached a transformative stage in the development of artificial intelligence (AI). We can no longer rely on non-invigilated assessments and submitted ‘artefacts’ to demonstrate student learning and competence. This is bringing many long-term demands on educators, course coordinators and curriculum designers, forcing us to rethink assessment approaches. Going forward, we see an important distinction between ‘assisted’ assessments and ‘unassisted’ assessments. With the recent increase and …

Go to article

Equity And Equality In Learning In Asia-Pacific: What Do Results From Large-Scale Assessments Tell Us? Gender In Focus Policy Brief, Syeda Kashfee Ahmed, Anna Dabrowski, Jacqueline Cheng, Victoria Klimova, Isabella Mccallum

Global education monitoring

This policy brief investigates gender disparities in learning outcomes and the factors contributing to these disparities as identified in large-scale assessment data in Southeast Asia. It additionally provides a set of recommendations aimed at enhancing equitable student learning outcomes while advocating for comprehensive support of gender-based interventions within educational quality initiatives, spanning both systemic and school-level support. The findings presented in this brief are drawn from large-scale assessment (LSA) datasets and secondary analysis of these sources. For more detailed information regarding the large-scale assessments in Southeast Asia, please refer to the appendix section.

Go to article

National Assessment Program: Ict Literacy 2022: Technical Report, Dominique Hall, Kate O'Malley, Renee Kwong, Emma Camus, Tim Friedman, Kristy Osborne, Zachary Watts, Dulce Lay

ICT - Digital Literacy

This report describes the various technical, operational and administrative procedures of the NAP– ICT Literacy 2022 assessment. It should be read in conjunction with the NAP–ICT Literacy 2022 Public Report, which presents a summary of the cognitive and contextual analysis of the data collected in the 2022 cycle. The assessment instrument used in NAP–ICT Literacy 2022 was based on the design principles established for NAP–ICT Literacy 2005, which continued through the assessment cycles in 2008, 2011, 2014 and 2017. The assessment was computer-based and included a broad range of task formats including multiple-choice, short text response, and simulated and authentic …

Go to article

Acer 2020-2021 Annual Report, Australian Council For Educational Research (Acer)

ACER Annual Reports

No abstract provided.

Go to article

School Leadership That Cultivates Collective Efficacy: Emerging Insights 2022, Kerry Elliott, Hilary Hollingsworth, Aiden Thornton, Liz Gillies, Katherine Henderson

Educational leadership

The work of the Menzies School Leadership Incubator suggests we need a new approach to leadership that supports school leaders to better manage transformational change and deepen collaborative capacity necessary to cultivate collective efficacy to improve student learning outcomes. This paper provides a description of the work of the Menzies School Leadership Incubator (“the Incubator’) and insights generated so far. The Incubator has identified five leadership domains which underpin the leadership of Collective Efficacy; Understanding Collective Efficacy Systems; Leadership Change; Leadership Team, and Leadership Collaborative Capacity.

Go to article

Remote Learning For Students With A Disability: Game Changer Or Moment In Time? Literature Review, Marijne Medhurst, Maya Conway, Kathryn Richardson

School and system improvement

This literature review draws from Australian and international research into the impact of remote learning for students with disability, published between March 2020 and April 2022. The literature relates to pedagogical services provided by early childhood services and schools to support students with disability, rather than therapeutic services. The social implications for students are reviewed along with educational factors, and implications for inclusion and support by schools. Following an overview of the legal and policy frameworks supporting the education of students with disability, this review investigates benefits, challenges and opportunities for both remote learning and transition back to in-person educational …

Go to article

Effects Of Remote Learning On Mental Health And Socialisation. Literature Review, Anna Dabrowski, Pru Mitchell

School and system improvement

This literature review focuses on the effects of remote learning on mental health, including acute mental health issues and possible ongoing implications for student wellbeing and socialisation. It provides an overview of some of the challenges that can impact on the mental health and relationships of young people, many of which have accelerated or become more complex during the COVID-19 pandemic. In the light of concern about rising antisocial behaviour and extremism there is a focus on socialisation and self-regulation on return to school post-pandemic. In the face of limited Australian research on these topics, the review takes a global …

Go to article

Schools As Community Hubs. Literature Review, Ian Teo, Pru Mitchell, Fabienne Van Der Kleij, Anna Dabrowski

School and system improvement

This literature review focuses on community hub models that include an education setting. The goals of these hubs go beyond improving academic outcomes, and look also to the health and wellbeing of their community. This review explores the ways in which education communities operate as welcoming and enriching places that connect, share, and learn with, not only students, families, and educators, but also their wider community. It focuses on a specific model of school-community partnership, typically known as a school community hub. Core features of community hubs are presented as people, partnerships, place and programs. Benefits and challenges of community …

Go to article

Full-Text Articles in Educational Assessment, Evaluation, and Research

Pirls 2021 Australian Year 4 Data [Spss], Kylie Hillman, Elizabeth O'Grady, Sima Rodrigues, Marina Schmid, Sue Thomson

Progress in International Reading Literacy Study (PIRLS)

Pirls 2021 Australian Year 4 Data Readme [Text], Kylie Hillman, Elizabeth O'Grady, Sima Rodrigues, Marina Schmid, Sue Thomson

Progress in International Reading Literacy Study (PIRLS)

Building Capacity For Quality Teaching Rounds – Victoria. Final Report, Tanya Vaughan, Sarah Richardson, Toby Carslake, Trisha Reimers, Greg Macaskill, Toby Newton, Nathan Zoanetti, Andrew Mannion, Martin Murphy

Professional learning for teachers and school leaders

International Comparison Of Tertiary Education Systems, Ian Teo, Michelle Hsien, Sarah Buckley, Anita Roberts

Higher education research

The National Student Assessment 2022 In Bangladesh. Grades 3 And 5, Directorate Of Primary Education Bangladesh

Assessment and Reporting

Progress In International Reading Literacy Study: Australia’S Results From Pirls 2021, Kylie Hillman, Elizabeth O'Grady, Sima Rodrigues, Marina Schmid, Sue Thomson

Progress in International Reading Literacy Study (PIRLS)

Implementing Effective Tiered Interventions In Secondary Schools: Survey Of School And Support Staff, Paul R. Weldon, Jonathan Heard, Jessica Thompson, Tanya Stephenson

Literacy and numeracy

Submission In Response To The Teacher Education Expert Panel Discussion Paper, Australian Council For Educational Research (Acer)

Shaping educational policy

Engaging Young Female Students In Digital Technology Programs: Part Two, Kristy Osborne, Rachel Felgate, Sarah Buckley

Digital learning research

Infographic: Basic Literacy Skills And The Gap Between Male And Female Students, Jo Earp

Teacher infographics

Infographic: Basic Skills And The Gap Between Indigenous And Non-Indigenous Students, Jo Earp

Teacher infographics

Acer 2021-2022 Annual Report, Australian Council For Educational Research (Acer)

ACER Annual Reports

Mid-Term Evaluation Report (Final): Global Education Monitoring (Gem) Centre Phase 3, Valerie Haugen

Monitoring Learning

Analysis Of Early Childhood Education And Learning Outcomes In The Pacific, Dan Cloney, Yung Nietschke, Jeffery Marshall

Early Childhood Education

Iea International Civic And Citizenship Education Study 2022: Assessment Framework, Wolfram Schulz, Julian Fraillon, Bruno Losito, Gabriella Agrusti, John Ainley, Valeria Damiani, Tim Friedman

Civics and Citizenship Assessment

Gtf Global Tracer Survey 2022 (Year 7) - Survey Instrument Items, Australia Awards Global Tracer Facility

Australia Awards Global Tracer Facility

School Improvement Tool, Australian Council For Educational Research (Acer)

School and system improvement

Reform Challenges In School Education, Geoff N. Masters

School and system improvement

School Improvement Tool: Literature Review, Fabienne Van Der Kleij, Pauline Taylor-Guy, Christina Rogers

School and system improvement

Pirls 2021 Australian Year 4 Data Tables [Excel], Kylie Hillman, Elizabeth O'Grady, Sima Rodrigues, Marina Schmid, Sue Thomson

Progress in International Reading Literacy Study (PIRLS)

Technical Support For A Micro-Scholarship Programme To Improve Learning: Project Brief, Bikramjit Sen

ACER India

School Improvement Tool: A Summary Of The Underpinning Research, Christina Rogers, Fabienne Van Der Kleij, Pauline Taylor-Guy

School and system improvement

Rethinking Assessment In Response To Generative Artificial Intelligence, Jacob Pearce, Neville Chiavaroli

Higher education research

Equity And Equality In Learning In Asia-Pacific: What Do Results From Large-Scale Assessments Tell Us? Gender In Focus Policy Brief, Syeda Kashfee Ahmed, Anna Dabrowski, Jacqueline Cheng, Victoria Klimova, Isabella Mccallum

Global education monitoring

National Assessment Program: Ict Literacy 2022: Technical Report, Dominique Hall, Kate O'Malley, Renee Kwong, Emma Camus, Tim Friedman, Kristy Osborne, Zachary Watts, Dulce Lay

ICT - Digital Literacy

Acer 2020-2021 Annual Report, Australian Council For Educational Research (Acer)

ACER Annual Reports

School Leadership That Cultivates Collective Efficacy: Emerging Insights 2022, Kerry Elliott, Hilary Hollingsworth, Aiden Thornton, Liz Gillies, Katherine Henderson

Educational leadership

Remote Learning For Students With A Disability: Game Changer Or Moment In Time? Literature Review, Marijne Medhurst, Maya Conway, Kathryn Richardson

School and system improvement

Effects Of Remote Learning On Mental Health And Socialisation. Literature Review, Anna Dabrowski, Pru Mitchell

School and system improvement

Schools As Community Hubs. Literature Review, Ian Teo, Pru Mitchell, Fabienne Van Der Kleij, Anna Dabrowski

School and system improvement