Education Commons^™

The Scottish Government International Development Fund: Designing A New International Development Inclusive Education Programme, Alexander Towne, Desmond Bermingham

International Education Research

This document was commissioned by the Scottish Government following a review of Scotland’s approach to international development in the wake of Covid-19, and incorporates a needs analysis and evidence, review, a detailed description of the global and national policy contexts relevant to partner country education systems and inputs from partner country governments, civil society and development partners on their priorities for investment in Inclusive Education. Drawing on these inputs, the report proposes a focus for the Scottish Government’s inclusive education programme on learners with disabilities and girls and young women, which is due to begin implementation in 2024. It also …

Education Out Loud Case Study: The Gear Alliance, Alexander Towne, Sladana Krstic, Sam Boering

International Education Research

This case study is part of a larger body of work funded by the Global Partnership for Education’s (GPE) Education Out Loud (EOL) programme. It explores the advocacy and policy influencing (API) activities of the GEAR Alliance, a transnational alliance of four East African civil society organisations (CSO) receiving funding from EOL, and the process, results and impact of action research project they conducted in partnership with MDF/ Australian Council for Education Research (ACER), an EOL ‘Global Learning Partner’ (GLP). EOL is the GPEs fund for advocacy and social accountability. The fund aims to support CSOs to be active and …

Collective Efficacy Tracking Tool. Development Framework 2023, Kerry Elliott, Hilary Hollingsworth

Educational leadership

Collective efficacy has become a prominent feature in educational policy and practice with growing evidence that a strong sense of collective efficacy amongst educators leads to better outcomes for students. With growing interest in the importance of collective efficacy and how to cultivate it, the Collective Efficacy Tracking Tool was created to address challenges associated with understanding, diagnosing, and developing collective efficacy. This Framework describes the development of the Collective Efficacy Tracking Tool, defining collective efficacy in a way that it can be operationalised to leverage improvement efforts. The Framework and accompanying Collective Efficacy Tracking Tool provide a practical resource …

Supporting Schools’ And Teachers’ Use Of Assessment To Inform Learning Of All Students, Ursula Schwantner, Soumaya Maghnouj

Global education monitoring

Issue 5 of the series Using assessment data in education policy and practice: Examples from the Asia-Pacific documents 4 case studies of promising and effective policies or practices on how education systems can better support teachers and schools in effectively integrating assessment practices in the teaching and learning process, to identify and meaningfully address every learner’s needs. In particular, the case studies show how different tools, approaches and policies help promote and reinforce the use of assessment to support more learner-centred and differentiated approaches to teaching and learning. 1. Using the Progressive Achievement approach to develop data-informed schools by Marc …

Reform Challenges In School Education, Geoff N. Masters

School and system improvement

The central thesis of this paper has been that the challenges now confronting schools globally will require fundamental reforms of the external frameworks within which schools work. Today’s challenges to better prepare young people for the future and to ensure that every student learns successfully will not be met by simply expecting teachers to change what they do or by making minor adjustments to current curricula, assessment, examination, reporting and credentialling arrangements. Today’s challenges require deep reforms and a willingness to reimagine—in other words, to ‘transform’ existing learning systems. This is essential because the external frameworks within which teachers and …

Equity And Equality In Learning In Asia-Pacific: What Do Results From Large-Scale Assessments Tell Us? Gender In Focus Policy Brief, Syeda Kashfee Ahmed, Anna Dabrowski, Jacqueline Cheng, Victoria Klimova, Isabella Mccallum

Global education monitoring

This policy brief investigates gender disparities in learning outcomes and the factors contributing to these disparities as identified in large-scale assessment data in Southeast Asia. It additionally provides a set of recommendations aimed at enhancing equitable student learning outcomes while advocating for comprehensive support of gender-based interventions within educational quality initiatives, spanning both systemic and school-level support. The findings presented in this brief are drawn from large-scale assessment (LSA) datasets and secondary analysis of these sources. For more detailed information regarding the large-scale assessments in Southeast Asia, please refer to the appendix section.

Teacher Professional Development For Disability Inclusion In Low- And Middle-Income Asia-Pacific Countries: An Evidence And Gap Map, Syeda Kashfee Ahmed, David Jeffries, Anannya Chakraborty, Toby Carslake, Petra Lietz, Budiarti Rahayu, David Armstrong, Amit Kaushik, Kris Sundarsagar

Assessment and Reporting

In the Asia‐Pacific region, around one‐third of the children who are out‐of‐school have a disability and given that teacher readiness and capability are key contributors for inclusive education, it is high time for a mapping of disability inclusive teacher professional development (TPD) interventions in this region. The key objective of this evidence and gap map (EGM) is to locate evidence on interventions for in‐service TPD focussing on education for the inclusion of students with a disability in low‐ and middle‐income countries (LMICs) in the Asia‐Pacific region. A broad range of bibliographic databases and repositories were searched electronically to identify the …

Teachers’ Assessment Literacy And Design Competence Framework, Sladana Krstic, Sarah Manlove, Sarah Richardson

2021-2030 ACER Research Conferences

Teachers play a central role in facilitating learning and empowering learners (Pastore & Andrade, 2019). They must possess a high level of assessment literacy to properly fulfil their role of implementing teaching and facilitating students’ learning (Hattie, 2009). Without it, the quality of educational provision can be impacted (Looney et al., 2018). The expectations placed on teachers in relation to their assessment knowledge and skills tend to focus on their ability to design and implement assessment with students, and to use assessment data to inform teaching practices (Brookhart, 2011). Much of the emphasis in the literature is on the mechanical …

Assessing Reading: How Assessment Can Be Used To Target Teaching And Enhance Understanding Of Reading Comprehension, Sandra Knowles

2021-2030 ACER Research Conferences

The skills demonstrated by a proficient reader are not easy to untangle. Current research acknowledges that reading comprehension is a highly complex area of ability, one that needs to be understood as the coordination of several integrated processes. Using example test questions and data, this presentation explores how assessment can help us make sense of reading comprehension in a way that curricula and commonly used teaching strategies cannot. Assessment is evidence that informs us about the skills involved in the reading process, how they relate to each other, and how they develop in complexity. When assessment is understood in this …

Sharing And Securing Learners' Performance Standards Across Schools, Richard Kimbell

2021-2030 ACER Research Conferences

Assessing learners’ performance makes very different demands upon teachers depending on the purpose and the context of the assessment. But common to all assessment is some sense of what ‘quality’ looks like. Most often teachers engage in formative assessments in the classroom, and the familiar standards of the classroom are adequate for this purpose. However if teachers are to undertake external, nationally regulated assessment then some sense of a national standard of quality is required. But there are very limited mechanisms by which teachers can acquire this understanding, so they use their best judgement, and standards vary from school to …

An Innovative Method For Teachers To Formatively Assess Writing Online, Dr Sandy Heldsinger, Stephen Humphry

2021-2030 ACER Research Conferences

Assessment is an integral component of effective teaching and a teacher’s professional judgement influences all routine aspects of their work. In the last 20 years, there has been considerable work internationally to support teachers in using assessment to improve student learning. However, there is a pressing issue that impedes teacher professional judgement being exploited to its full potential. The issue relates to teacher assessments in the context of extended performances such as essays and arises from the complexity of obtaining reliable or consistent teacher assessments of students’ work. Literature published in the United States, England and Australia details evidence of …

Using Pat Data To Inform Teaching And Learning, Marc Kralj, Rachel Felgate, Shani Sniedze, Caithlin Power, Grant Barclay, Darren Leech

2021-2030 ACER Research Conferences

ACER works with thousands of Australian schools to set up Progressive Achievement Test (PAT) functionality, assign and administer tests, and to assist teachers to understand and interrogate the resulting test data and act upon findings. This session provides participants with an opportunity to hear about a school’s journey, and discuss this with the ACER team and our PAT school guest. ACER researchers have evaluated and documented assessment implementation and professional development opportunities, observing this school’s ability to track student and educator progress over time, which is a critical element in ACER’s Progressive Achievement approach. ACER’s educational consultants will demonstrate how …

Reimagining Classroom Assessment And Feedback To Meet Learner Needs, Fabienne Van Der Kleij

2021-2030 ACER Research Conferences

The power of classroom assessment and feedback to improve student learning outcomes has long been recognised. Yet, decades of research have yielded disappointing and often conflicting outcomes. This presentation challenges traditional conceptions of classroom assessment and feedback as teacher-driven practices. To meet learner needs better, it proposes a student-centred perspective in which students are active and have agency. By drawing on an extensive study of feedback reviews, this presentation illustrates how conceptualisations of feedback have changed over recent decades. This paper provides key insights into how classroom assessment and feedback practices can be changed in ways that are sustainable, afford …

Reimagining The Purpose Of Assessment, Geoff N. Masters

2021-2030 ACER Research Conferences

Assessment is commonly understood as the process of judging how well students have learnt what they have been taught. It comes at the end of a sequence that begins with a curriculum or course syllabus. Teachers are expected to deliver this body of specified content, students are expected to learn it, and assessment is the process of judging and grading students on how well they have learnt what teachers have taught. This is a common view of assessment among students, parents and many teachers. I will argue in this presentation that this traditional understanding of what it means to learn …

Teacher Development Multi-Year Studies: Impact Of Covid-19 On Teaching Practices In Lao Pdr, Timor-Leste And Vanuatu: A Discussion Paper For Practitioners And Policymakers, Aris Huang, Debbie Wong, Elizabeth Cassity, Jennie Chainey

Education Analytics Service

The COVID-19 pandemic caused significant disruptions to education systems around the world. Many governments responded abruptly, quickly closing schools and transitioning to home learning. This paper explores the impact of extended school closures due to COVID-19 on teaching and student learning in three countries – Lao People’s Democratic Republic (Laos), Timor-Leste and Vanuatu. This research extends the Australian Government’s Department of Foreign Affairs and Trade (DFAT)’s multi-year Teacher Development Studies, which are commissioned under the Evaluation Analytics Service (EAS). This study series involves the investigation of DFAT-funded teacher development initiatives in Laos, Timor-Leste and Vanuatu to understand the extent to …

Beyond Letters And Numbers: The Covid-19 Pandemic And Foundational Literacy And Numeracy In Indonesia, Jeaniene Spink, Dan Cloney, Amy Berry

International Education Research

In 2020, with the COVID-19 pandemic spreading across Indonesia and around the world, INOVASI (the Innovation for Indonesia’s School Children) and the Indonesian Ministry of Education, Culture, Research and Technology (MoECRT) initiated a study of foundational literacy and numeracy learning by Indonesian students and the impact of the pandemic on this learning. The Australian Council for Educational Research (ACER) provided technical support. The study developed descriptions of literacy and numeracy achievement levels, referencing both global proficiency frameworks and Indonesia’s curriculum and assessment standards. Student results were benchmarked against descriptors of skills for the Global Proficiency Framework (GPF) Minimum Proficiency Levels …

Protocol: Teacher Professional Development For Disability Inclusion In Low- And Middle-Income Asia-Pacific Countries: An Evidence And Gap Map, Syeda Kashfee Ahmed, David Jeffries, Anannya Chakraborty, Petra Lietz, Amit Kaushik, Budiarti Rahayu, David Armstrong, Kris Sundarsagar

Assessment and Reporting

According to prior research, teacher readiness and capability are key contributors for successful transition towards disability inclusive education, yet in-service teacher professional development for disability inclusion remains an under-researched area. The key objective of this evidence and gap map (EGM) is to locate evidence on interventions for disability inclusion focused teacher professional development (TPD) in low-to-middle-income-countries (LMICs) in the Asia-Pacific region. As such, it will illustrate different levels of evidence for TPD interventions as well as where there is no evidence (i.e., gaps). In other words, the EGM can make agencies aware where they might be operating in an area …

Infographic: Global Status Of Teachers, Dominique Russell

Teacher infographics

A survey of education officials and union leaders from all levels of education in 94 countries has given insight into how the teacher profession is viewed at a global scale. In this infographic, we share some of the survey responses in relation to K-12 settings.

The Swans/Ables Project: A Set Of Resources Developed Collaboratively With Teachers To Support The Teaching And Learning Of Students With Additional Learning Needs, Toshiko Kamei

2021-2030 ACER Research Conferences

The inclusion of students with additional learning needs in schooling is part of policy and practice in Australia. However, it has been well documented that teachers lack the resources and training to meaningfully include students with additional learning needs in the full range of learning in their classrooms. The SWANs (Students with Additional Needs) program of work aimed to fill this gap through developing assessments based on learning progressions to provide targeted information to support the teaching and learning of all students, including students with additional learning needs. The development and implementation of the SWANs/ABLES suite of resources illustrates how …

How Might We Identify And Measure Learning Progression In History?, Louise Zarmati

2021-2030 ACER Research Conferences

In this session, Dr Zarmati will share her research on efforts to map and describe progress in the learning area of History.

Learning progression is a continuum that measures advances in learning by tracking development from early learning to more sophisticated levels of mastery. Mathematics relies on an understanding of empirical knowledge and concepts in a hierarchical sequence; students need to understand (or master) one mathematical concept before they can proceed to the next. In comparison, progress of understanding in history is not necessarily hierarchical because it is based on mastery of concepts and skills rather than historical knowledge, which …

Leading System Transformation: A Work In Progress, Greg Whitby, Maura Manning, Gavin Hays

2021-2030 ACER Research Conferences

Internationally, the COVID-19 pandemic has profoundly disrupted the education sector. While NSW has avoided the longer periods of remote learning that our colleagues in Victoria and other countries have experienced, we have nonetheless been provoked to reflect on the nature of schooling and the systemic support we provide to transform the learning of each student and enrich the professional lives of staff within our Catholic learning community. At Catholic Education Diocese of Parramatta (CEDP), a key pillar of our approach is to create conditions that enable everyone to be a leader. Following the initial lockdown period in 2020 when students …

Interpreting Learning Progress Using Assessment Scores: What Is There To Gain?, Nathan Zoanetti

2021-2030 ACER Research Conferences

Using assessment scores to quantify gains and growth trajectories for individuals and groups can provide a valuable lens on learning progress for all students. This paper summarises some commonly observed patterns of progress and illustrates these using data from ACER’s Progressive Achievement Test (PAT) assessments. While growth trajectory measurement requires scores for the same individuals over at least three but preferably more occasions, scores from only two occasions are naturally more readily available. The difference between two successive scores is usually referred to as gain. Some common approaches and pitfalls when interpreting individual student gain data are illustrated. It is …

Using Assessment Data To Improve Equity: How Teachers Use Insights From The Scottish National Standardised Assessments, Sarah Richardson, Sladana Krstic

2021-2030 ACER Research Conferences

Evidence-based decision-making is regarded as an important indicator of quality in schools around the world. Using data gathered from assessments, in conjunction with other insights, can help school leaders and teachers better meet the needs of learners. In schools that cater to disadvantaged learners, using data to design targeted interventions plays an important role in improving equity. In this paper we report on a study with five schools in Scotland. All schools had learner cohorts characterised by multiple layers of disadvantage. Informed by the theoretical underpinnings of sensemaking theory, we investigated how teachers and school leaders used data from the …

Identifying And Monitoring Progress In Collaboration Skills, Claire Scoular

2021-2030 ACER Research Conferences

The nature of skills such as collaboration is complex, particularly given that there are internal processes at play. Inferences need to be made to interpret explicit behaviours observed from intentionally designed assessment tasks. This paper centres on the approach to develop hypotheses of skill development into validated learning progressions using assessment data. Understanding a skill from a growth perspective is essential for the effective teaching and development of the skill. The application of Item Response Theory (IRT) allows the interpretation of assessment data as levels of proficiency that we can use to map or monitor progress in collaborative skills.

Exploring Excellence In Indigenous Education In Queensland Secondary Schools, Marnee Shay, Jodie Miller, Suraiya Abdul Hameed

2021-2030 ACER Research Conferences

In the national and international landscape, there is very limited exploration of cultural constructs of excellence, in particular, in Indigenous contexts. This pilot study aimed to centre the voices of Indigenous people in conceptualising excellence in Indigenous education, as well as to share understandings between Indigenous and non-Indigenous practitioners. Qualitative data collection methods were used including collaborative yarning, storying, and semi-structured interviews. Data were analysed using cross-case analysis to examine the views of educators across three school sites. Indigenous participants highlighted the importance of nurturing culture and identity; building up young people; and, building a culture of inclusivity and belonging. …

Evidencing Creativity And Curiosity In Ib Schools, Sarah Richardson, Sladana Krstic

2021-2030 ACER Research Conferences

There is growing recognition of the importance of learners gaining transversal or 21st-century attributes in order to thrive in the contemporary world. This poses a number of challenges for educators. First, to what extent are transversal attributes innate, or do they include a combination of traits and skills? Second, what can teachers do to help nurture these attributes in learners? Third, how can the existence or strengthening of attributes be recognised? In this paper, we draw on work that we are doing for the International Baccalaureate Organisation to define conceptual frameworks for creativity and curiosity. Our goal is to enable …

Applying Empirical Learning Progressions For A Holistic Approach To Evidence-Based Education: Swans/Ables, Emily White

2021-2030 ACER Research Conferences

Learning progressions have become an increasing topic of interest for researchers, educational organisations and schools as they can describe the expected pathway of learning within a content area to allow for targeted teaching and learning at all levels of ability. However, there is substantial variation in how learning progressions are developed and to what extent teachers can use them to inform their practices. The ABLES/SWANS tools (Students with Additional Needs/Abilities Based Learning and Education Support) are an example of how an empirical learning progression can be applied to support teachers’ ability to not only target teaching to a student’s zone …

Learning Progressions As Models And Tools For Supporting Classroom Assessment, Alicia C. Alonzo

2021-2030 ACER Research Conferences

Like all models, learning progressions (LPs) provide simplified representations of complex phenomena. One key simplification is the characterisation of student thinking in terms of levels. This characterisation is both essential for large-scale applications, such as informing standards, but potentially problematic for smaller-scale applications. In this paper, I describe a program of research designed to explore the smaller-scale use of LPs as supports for teacher classroom assessment practices in light of this simplification. Based on this research, I conclude that LP levels may serve as a generative heuristic, particularly when teachers are engaged with evidence of the limitations of LP levels …

Karmel Oration: Excellent Progress For All: A Function Of Year-Level Curriculum Or Evidenced-Based Learning Progressions?, Dianne Siemon

2021-2030 ACER Research Conferences

Excellent progress for all students is an ambitious but necessary goal if we are to improve the life choices of all students. At the moment, we are not serving all our students well despite the best efforts of teachers. We need to look further afield to the curriculum and assessment regimes that drive current practice. Grouping students by ability and offering a watered-down curriculum for some is not the answer. Evidenced-based learning progressions that point to what is important in ensuring all students build a deep, well-connected understanding of mathematics over time is what is needed to support reform at …

This Time Without ‘Feeling’: Children’S Intuitive Theories Of Art As A Logical Basis For Learning Progression In Visual Arts, Karen Maras

2021-2030 ACER Research Conferences

Learning in Visual Arts has traditionally been framed as an experiential process in which feeling and intuition complement the development of aesthetic knowledge. However, while art can be about feelings and processes that develop students’ expressive capacities, the complexity of art understanding and thinking extends beyond this narrow common-sense assumption. I argue that this assumption, which is represented in the Australian Curriculum: The Arts (ACARA, 2015), and even more firmly resonates in recent proposals for the revision of this curriculum (ACARA, 2021), obfuscates the conceptual and theoretical bases on which students make progress in art understanding. This paper examines the …