Educational Assessment, Evaluation, and Research Commons^™

Pairwise Comparison Method Toolkit. A Toolkit For Countries To Measure Global Learning Outcomes., United Nations Educational, Scientific And Cultural Organization (Unesco), Australian Council For Educational Research (Acer)

Global education monitoring

This toolkit has been co-authored by the Global Education Monitoring (GEM) Centre at the Australian Council for Education Research (ACER) and the United Nations Educational, Scientific and Cultural Organization (UNESCO) Institute for Statistics (UIS). ACER provides technical support to UIS, which has been mandated to monitor the progress of countries towards achieving Sustainable Development Goal 4 (SDG 4) in education to “ensure inclusive and equitable quality education and to promote lifelong learning opportunities for all” (United Nations, 2021). The GEM Centre sponsors and contributes to public goods and activities that facilitate education systems reporting against SDG 4 in a globally …

Collaboration In East Africa: A Contextualised Approach To Defining The Construct, Claire Scoular, David Alelah Otieno

Assessment and Reporting

Collaboration has been highlighted internationally as a key skill for learning, working, and living in the twenty-first century. However, to teach it well, enhance its performance, and measure its growth, it is essential to have a clear and consistent definition of the skill. There are a number of frameworks that describe collaboration in a way that is meaningful to learning and growth. Despite some differences across frameworks, it is clear there is a common core set of contributing subskills. This suggests that collaboration is of global interest, and that there are components that transcend national or cultural specificities. Notwithstanding, definitions …

Supporting Schools’ And Teachers’ Use Of Assessment To Inform Learning Of All Students, Ursula Schwantner, Soumaya Maghnouj

Global education monitoring

Issue 5 of the series Using assessment data in education policy and practice: Examples from the Asia-Pacific documents 4 case studies of promising and effective policies or practices on how education systems can better support teachers and schools in effectively integrating assessment practices in the teaching and learning process, to identify and meaningfully address every learner’s needs. In particular, the case studies show how different tools, approaches and policies help promote and reinforce the use of assessment to support more learner-centred and differentiated approaches to teaching and learning. 1. Using the Progressive Achievement approach to develop data-informed schools by Marc …

Technology In Education: A Case Study On Lao People's Democratic Republic, Yung Nietschke, Anna Dabrowski

International Education Research

This paper was commissioned by the Global Education Monitoring Report as background information for the development of the 2023 Global Education Monitoring (GEM) Report: technology and education, Southeast Asia. Digital technology has the potential to transform learning and offer a solution to persistent challenges in equity of access and quality of learning for all students. COVID-19 has accelerated the adoption of technology to deliver alternative modes of education. It has also put the spotlight on the digital divide that technology creates. This Case Study explores the progress of technology integration in the education sector in Lao PDR in line with …

Mid-Term Evaluation Report (Final): Global Education Monitoring (Gem) Centre Phase 3, Valerie Haugen

Monitoring Learning

This report provides findings and recommendations from the external mid-term evaluation of Phase 3 of the Global Education Monitoring (GEM Centre) - a long-term partnership between the Australian Council for Educational Research (ACER) and the Australian Government’s Department of Foreign Affairs and Trade (DFAT). The goal of the GEM Centre is to improve learning, by ensuring that education policies, practices and investments are influenced by high-quality evidence. The aim of the mid-term evaluation was to enable reflection on the long-term partnership through the GEM Centre. The findings highlight the successes and achievements of the GEM Centre over the past decade, …

International Standard Setting Exercise, Australian Council For Educational Research (Acer)

Monitoring Learning

The GEM Centre provides technical support to the United Nations Educational, Scientific and Cultural Organization (UNESCO) Institute for Statistics (UIS), which has been mandated to monitor the progress of countries towards achieving the education goals of Sustainable Development Goal 4 (SDG 4). The International Standard Setting Exercise (ISSE) was undertaken to harmonise quantitative data across assessment programs, and to provide substantive information about children’s learning levels and progress benchmarked against international standards. The goal of the ISSE was to place thresholds on empirical reading and mathematics Learning Progression Scales for the Minimum Proficiency Level at the end of lower primary …

Minimum Proficiency Levels Unpacked, Australian Council For Educational Research (Acer)

Monitoring Learning

This document draws together work from several initiatives to establish Minimum Proficiency Levels (MPLs) for reading and mathematics, for global use in pursuit of the Sustainable Development Goal in Education, SDG 4.1, with a specific focus on indicator 4.1.1. Three educational levels are referred to in this paper as ‘end of lower primary’, ‘end of primary’ and ‘end of lower secondary’. The MPLs are described and elaborated in four ways: nutshell statements; expanded statements; domains, constructs and descriptors; and sample items. A detailed account of the history and evolution of the Minimum Proficiency Levels is provided in Appendix A

An Innovative Method For Teachers To Formatively Assess Writing Online, Dr Sandy Heldsinger, Stephen Humphry

2021-2030 ACER Research Conferences

Assessment is an integral component of effective teaching and a teacher’s professional judgement influences all routine aspects of their work. In the last 20 years, there has been considerable work internationally to support teachers in using assessment to improve student learning. However, there is a pressing issue that impedes teacher professional judgement being exploited to its full potential. The issue relates to teacher assessments in the context of extended performances such as essays and arises from the complexity of obtaining reliable or consistent teacher assessments of students’ work. Literature published in the United States, England and Australia details evidence of …

Using Pat Data To Inform Teaching And Learning, Marc Kralj, Rachel Felgate, Shani Sniedze, Caithlin Power, Grant Barclay, Darren Leech

2021-2030 ACER Research Conferences

ACER works with thousands of Australian schools to set up Progressive Achievement Test (PAT) functionality, assign and administer tests, and to assist teachers to understand and interrogate the resulting test data and act upon findings. This session provides participants with an opportunity to hear about a school’s journey, and discuss this with the ACER team and our PAT school guest. ACER researchers have evaluated and documented assessment implementation and professional development opportunities, observing this school’s ability to track student and educator progress over time, which is a critical element in ACER’s Progressive Achievement approach. ACER’s educational consultants will demonstrate how …

Reimagining Classroom Assessment And Feedback To Meet Learner Needs, Fabienne Van Der Kleij

2021-2030 ACER Research Conferences

The power of classroom assessment and feedback to improve student learning outcomes has long been recognised. Yet, decades of research have yielded disappointing and often conflicting outcomes. This presentation challenges traditional conceptions of classroom assessment and feedback as teacher-driven practices. To meet learner needs better, it proposes a student-centred perspective in which students are active and have agency. By drawing on an extensive study of feedback reviews, this presentation illustrates how conceptualisations of feedback have changed over recent decades. This paper provides key insights into how classroom assessment and feedback practices can be changed in ways that are sustainable, afford …

Reimagining The Purpose Of Assessment, Geoff N. Masters

2021-2030 ACER Research Conferences

Assessment is commonly understood as the process of judging how well students have learnt what they have been taught. It comes at the end of a sequence that begins with a curriculum or course syllabus. Teachers are expected to deliver this body of specified content, students are expected to learn it, and assessment is the process of judging and grading students on how well they have learnt what teachers have taught. This is a common view of assessment among students, parents and many teachers. I will argue in this presentation that this traditional understanding of what it means to learn …

Research Conference 2022: Reimagining Assessment: Proceedings And Program, Kylie Burns (Ed.)

2021-2030 ACER Research Conferences

The focus of this year’s Research Conference is on the use of assessment to support improved teaching and learning. The conference is titled ‘reimagining assessment’ because we believe there is a need to transform the essential purposes of educational assessment to provide better information about the deep conceptual learning, skills, competencies, and personal attributes that teachers and schools now have as objectives for student learning and development. Reimagined assessments must now be focused on monitoring learning across this broader range of intended outcomes and provide quality information about the points individuals have reached in their long-term development.

Gem Centre: Completion Report For Phase 2 Funding, 2017–2020, Australian Council For Educational Research

Monitoring Learning

In 2014, the Australian Council for Educational Research (ACER) and the Australian Government’s Department of Foreign Affairs and Trade (DFAT) established a partnership under the Global Education Monitoring Centre. Since then, there have been two funding periods: Phase 1 from 2014–2017 and Phase 2 from 2017–2020. Phase 3 will cover 2020–2023. This report documents the completion of Phase 2 funding and describes the shared priorities of DFAT and ACER through the GEM Centre, followed by the objectives and key outcomes of the work program during this period. The outcomes and lessons learned, together with findings from the GEM Centre mid-term …

How Might We Identify And Measure Learning Progression In History?, Louise Zarmati

2021-2030 ACER Research Conferences

In this session, Dr Zarmati will share her research on efforts to map and describe progress in the learning area of History.

Learning progression is a continuum that measures advances in learning by tracking development from early learning to more sophisticated levels of mastery. Mathematics relies on an understanding of empirical knowledge and concepts in a hierarchical sequence; students need to understand (or master) one mathematical concept before they can proceed to the next. In comparison, progress of understanding in history is not necessarily hierarchical because it is based on mastery of concepts and skills rather than historical knowledge, which …

Identifying And Monitoring Progress In Collaboration Skills, Claire Scoular

2021-2030 ACER Research Conferences

The nature of skills such as collaboration is complex, particularly given that there are internal processes at play. Inferences need to be made to interpret explicit behaviours observed from intentionally designed assessment tasks. This paper centres on the approach to develop hypotheses of skill development into validated learning progressions using assessment data. Understanding a skill from a growth perspective is essential for the effective teaching and development of the skill. The application of Item Response Theory (IRT) allows the interpretation of assessment data as levels of proficiency that we can use to map or monitor progress in collaborative skills.

Research Conference 2021: Excellent Progress For Every Student: Proceedings And Program, Australian Council For Educational Research

2021-2030 ACER Research Conferences

The focus of the 2021 Australian Council for Educational Research (ACER) Research Conference is on evidence-based strategies for ensuring that every student makes excellent ongoing progress in their learning. This is an important topic because many students in our schools do not make good, steady progress. Some slip behind and fall increasingly behind the longer they are in school. By the middle years of school, this contributes to significant levels of student disengagement. ACER has invited a number of leading educational researchers to join us to share the findings of their research relevant to this topic. An important conclusion of …

Measuring The Impact Of A Girls Education Program In Zambia

International Developments

The Zambian Girls 2030: Realizing My Potential program was initiated in 2016 through a partnership between the Ministry of General Education (MoGE) and UNICEF. The program aims to ensure better educational and employment outcomes for Zambian girls through various educational interventions at the secondary school level. The ACER evaluation will shed light on the results achieved against the targeted objectives and the potential for expansion of the program.

Nepal Shifts To The Testing Of Higher Order Skills

International Developments

An overhaul of the examination system in Nepal focuses on standardisation of exams and assessing higher order thinking skills at the end of basic education.

Improving Learning Outcomes Through Teacher Development

International Developments

The Australian Government’s Department of Foreign Affairs and Trade (DFAT) has commissioned ACER to conduct the Teacher Development Multi-Year Series, a long-term, multi-country study to determine the extent to which Australian investments improve teaching quality and student learning. Countries involved include Timor-Leste, the three-year study focuses on Apoio Lideransa liuhusi Mentoria no Aprendizajen (ALMA) as part of the Australia-Timor-Leste Partnership for Human Development) - previously known as the Professional Learning Program; Lao PDR; and the Vanuatu Education Sector Program (VESP).

Acer And Unicef Partner In Assessment And Evaluation

International Developments

In 2020, ACER signed two significant Long-Term Agreements (LTA) with UNICEF. One involves design, implementation and reporting on large-scale national and regional learning assessments in the Asia-Pacific region and the other covers technical assistance in the evaluation of education programs and interventions in countries under UNICEF’s Eastern and Southern Africa Regional Office (ESARO) and Regional Office for South Asia (ROSA).

Uncovering Learning Inequities In Southeast Asia

International Developments

Results released from the Southeast Asia Primary Learning Metrics (SEAPLM) 2019 show alarming inequities in learning outcomes for children. While some students are excelling, others are falling far behind and are unlikely to catch up. Without foundational skills in reading, mathematics and writing, these students are likely to be disadvantaged well into their adult lives.

Monitoring Progress Towards The Sdgs, Ursula Schwantner, Juliette F. Mendelovits, Maurice Walker

International Developments

Measuring where students are at in their learning is critical for determining whether the world is on track to meet Sustainable Development Goal (SDG) 4. ACER’s contribution to SDG 4 is spearheaded through the work of the GEM Centre, a long-term partnership with the Australian Government's Department of Foreign Affairs and Trade (DFAT). At the core of the GEM Centre's contribution is the development of technically sound and internationally comparable learning metrics that enable education stakeholders to align assessment systems with global SDG monitoring and reporting.

International Developments (No.10) 2021

International Developments

This issue of International Developments summarises the research evidence gathered through the work of the Australian Council for Educational Research (ACER) and the impact of specific projects around the globe.

Gem Centre: Pathways To Impact, Australian Council For Educational Research

Global education monitoring

The Global Education Monitoring (GEM) Centre is a long-term, strategic partnership between the Australian Council for Educational Research (ACER) and the Australian Government’s Department of Foreign Affairs and Trade (DFAT). While supporting education monitoring initiatives around the world, the GEM Centre has a strategic focus on improving learning in the Indo-Pacific region and provides technical support to enable monitoring of progress towards United Nations Sustainable Development Goal (SDG) 4 by 2030.

Enhancing The National Assessment System To Improve Learning Outcomes In Bhutan: Case Study 2020-2021, Anu Radha Sharma, Anannya Chakraborty, Arjun Kumar Gurung

Assessment and Reporting

To measure the efficacy of school sector interventions, Bhutan Council for School Examinations and Assessment (BCSEA) partnered with Australian Council for Educational Research (India) to strengthen its National Education Assessment (NEA) for obtaining evidence on learning, monitoring the progress of learning outcomes, understanding associations between context and achievement, and differences in achievement between groups. Eventually, the assessment reform will support measuring learning at the key stages of grades 3, 6, and 9. This case study report presents an overview of this project.

Assessment Of General Capabilities: Skills For The 21st-Century Learner. Final Report, Claire Scoular, Dara Ramalingam, Daniel Duckworth, Jonathan Heard

Assessment and Reporting

This report describes a project of the Centre for Assessment Reform and Innovation (CARI) at the Australian Council for Educational Research (ACER) to develop an approach for teaching and assessing general capabilities, also known as 21st century skills, in the classroom. The report is divided into two parts. Part one presents an overview of ACER’s approach to skills development. This approach is underpinned by the identification of three evident needs: to understand development, to monitor growth, and to ensure alignment across curriculum, assessment, and pedagogy. Part Two outlines how the approach is applied in the context of assessment. An assessment …

Pacific Islands Literacy And Numeracy Assessment, Australian Council For Educational Research

Assessment GEMS

The overall purpose of Pacific Islands Literacy and Numeracy Assessment (PILNA) is to support the improvement of education outcomes of students in the Pacific Island countries. It does this by generating cognitive and contextual data to monitor learning outcome, as well as facilitating ongoing collaborative efforts. PILNA measures the numeracy and literacy achievement of students at the end of Year 4 and Year 6. PILNA also supports participating countries to achieve Sustainable Development Goals. Specifically, SDG 4.1, which aims to have ‘all girls and boys complete free, equitable and quality primary and secondary education leading to relevant and effective learning …

The Southern And Eastern Africa Consortium For Monitoring Educational Quality, Australian Council For Educational Research

Assessment GEMS

The Southern and Eastern Africa Consortium for Monitoring Educational Quality (SACMEQ) carries out large-scale cross-national research studies in member countries in the Southern and Eastern Africa region. SACMEQ aims to assess the conditions of schooling and performance levels of learners and teachers in the areas of literacy and numeracy.

Latest From Acer International Offices

International Developments

ACER works through its international offices to deliver a diverse range of results-oriented projects. They are often implemented in partnership with global and local development partners with the goal to advance education outcomes and improve learning.

The Role Of Learning Progressions In Global Scales, Ray Adams

International Developments

Learning progressions are valuable tools for the international assessment community. Ray Adams reports.