Education Commons^™

Acer Models Of Writing: Changing The Assessment Mindset, Juliette Mendelovits, Judy Nixon

2021-2030 ACER Research Conferences

This presentation outlines different models of writing assessment that have a proven track record in various programs delivered by ACER. These models include holistic scoring, and partial analytical scoring on a number of criteria. The writing prompts for these models assume extended pieces of writing. The presentation will also introduce a new and alternative model of writing assessment that ACER has implemented in several large-scale assessments. This model is built on shorter pieces of writing from each student, designed to give more accurate and diverse insights into students’ proficiency in writing in a range of text types, within the constraints …

Reimagining The Purpose Of Assessment, Geoff N. Masters

2021-2030 ACER Research Conferences

Assessment is commonly understood as the process of judging how well students have learnt what they have been taught. It comes at the end of a sequence that begins with a curriculum or course syllabus. Teachers are expected to deliver this body of specified content, students are expected to learn it, and assessment is the process of judging and grading students on how well they have learnt what teachers have taught. This is a common view of assessment among students, parents and many teachers. I will argue in this presentation that this traditional understanding of what it means to learn …

Research Conference 2022: Reimagining Assessment: Proceedings And Program, Kylie Burns (Ed.)

2021-2030 ACER Research Conferences

The focus of this year’s Research Conference is on the use of assessment to support improved teaching and learning. The conference is titled ‘reimagining assessment’ because we believe there is a need to transform the essential purposes of educational assessment to provide better information about the deep conceptual learning, skills, competencies, and personal attributes that teachers and schools now have as objectives for student learning and development. Reimagined assessments must now be focused on monitoring learning across this broader range of intended outcomes and provide quality information about the points individuals have reached in their long-term development.

Teacher Development Multi-Year Studies: Impact Of Covid-19 On Teaching Practices In Lao Pdr, Timor-Leste And Vanuatu: A Discussion Paper For Practitioners And Policymakers, Aris Huang, Debbie Wong, Elizabeth Cassity, Jennie Chainey

Education Analytics Service

The COVID-19 pandemic caused significant disruptions to education systems around the world. Many governments responded abruptly, quickly closing schools and transitioning to home learning. This paper explores the impact of extended school closures due to COVID-19 on teaching and student learning in three countries – Lao People’s Democratic Republic (Laos), Timor-Leste and Vanuatu. This research extends the Australian Government’s Department of Foreign Affairs and Trade (DFAT)’s multi-year Teacher Development Studies, which are commissioned under the Evaluation Analytics Service (EAS). This study series involves the investigation of DFAT-funded teacher development initiatives in Laos, Timor-Leste and Vanuatu to understand the extent to …

Development Of A Transcript To Record Learner Creativity And Curiosity, Prue Anderson, Toby Carslake, Anit Cherian, Bethany Davies, Laura Good, Jonathan Heard, Sladana Krstic, Brendan Mcginley, Dara Ramalingam, Sarah Richardson, Claire Scoular, Shani Sniedze, Jennifer Star

Assessment and Reporting

Funded with generous support by the Jacobs Foundation, the ultimate goal of this project was to develop transcripts to track learner progress in the domains of creativity and curiosity. To support this overarching goal, the research team sought to define creativity and curiosity in language that would resonate with learners and teachers and that would be appropriate across numerous cultural settings. The result of the project is a series of prototype materials and resources, specifically: literature reviews, frameworks, enabling environment summaries, reflective quizzes and transcripts. Based on insights from the literature reviews, the researchers developed frameworks to define the constructs …

School Improvement Tool Elaborations: Student Engagement And Wellbeing, Australian Council For Educational Research (Acer), Queensland Department Of Education

School and system improvement

What happens in schools can have a great and lasting impact on the future wellbeing and outcomes for young people. Schools therefore play an important role in supporting students’ engagement and wellbeing. These elaborations are intended to support the work of schools by providing further specificity about the practices in each of the nine domains of the School Improvement Tool (previously National School Improvement Tool) that optimise student engagement and wellbeing and, in turn, impact on achievement. Commissioned by the Queensland Department of Education, the elaborations provide an evidence-based framework to guide practice by teachers, school leaders and education systems …

Teacher Development Multi-Year Studies. Using Classroom Observations To Investigate And Understand Teaching Quality: Initial Lessons Learned, Hilary Hollingsworth, Debbie Wong

Education Analytics Service

This paper presents some initial lessons learned about the use of classroom observation data as a key form of evidence regarding improved teaching quality in a multi-year teacher development study series. This study series, commissioned by the Australian Government’s Department of Foreign Affairs and Trade (DFAT), involves the investigation of teacher development initiatives that are primarily designed to support the implementation of new primary curriculum in Lao People’s Democratic Republic (Laos), Timor-Leste and Vanuatu. The overall aim of the study series is to understand the extent to which the Australian investment has improved teaching quality and student learning. This paper …

Teacher Development Multi-Year Study Series. Vanuatu: Interim Report 2, Elizabeth Cassity, Jennie Chainey, Jacqueline Cheng, Debbie Wong

Education Analytics Service

The Australian Government is supporting the Government of Vanuatu through its Vanuatu Education Support Program (VESP) to undertake long-term education reforms. A key focus of these reforms is the rollout of a new national curriculum in conjunction with the National Language Policy (2012), intended to improve teaching quality and student learning outcomes for students in the primary and early secondary years of education. Part of a multi-year study series, the Education Analytics Service (EAS) is investigating how the VESP is making a difference to these teaching and learning outcomes.

Vanuatu: Policy Insights From A Multi-Year Teaching And Learning Study Series, Elizabeth Cassity, Debbie Wong

Education Analytics Service

The Australian Government is supporting significant education reforms in Vanuatu. This policy note summarises findings on primary school teacher practice and student learning outcomes, during the first phase of major curriculum changes. Key findings include the need for consistent investment in ongoing professional learning given that new content and pedagogies require significant change and learning for teachers and other education actors. In addition, better engagement with school communities builds understanding of the reforms and encourages greater parental involvement in education. Part of a multi-year study, the Education Analytics Service is investigating how the Vanuatu Education Support Program (VESP) is making …

Reporting Student Progress: What Might It Look Like?, Hilary Hollingsworth, Jonathan Heard, Anthony Hockey, Tegan Knuckey

2021-2030 ACER Research Conferences

The Communicating Student Learning Progress review produced by ACER in 2019 set out recommendations for schools and systems to improve the way schools report on student learning, in particular learning progress. Two case study schools from Victoria – a Catholic primary school and government secondary school – discuss changes they’ve made to their student reporting processes, in response to the review’s recommendations. Further research is recommended into how schools are rethinking reporting to engage students and parents in monitoring learning growth.

The Swans/Ables Project: A Set Of Resources Developed Collaboratively With Teachers To Support The Teaching And Learning Of Students With Additional Learning Needs, Toshiko Kamei

2021-2030 ACER Research Conferences

The inclusion of students with additional learning needs in schooling is part of policy and practice in Australia. However, it has been well documented that teachers lack the resources and training to meaningfully include students with additional learning needs in the full range of learning in their classrooms. The SWANs (Students with Additional Needs) program of work aimed to fill this gap through developing assessments based on learning progressions to provide targeted information to support the teaching and learning of all students, including students with additional learning needs. The development and implementation of the SWANs/ABLES suite of resources illustrates how …

How Might We Identify And Measure Learning Progression In History?, Louise Zarmati

2021-2030 ACER Research Conferences

In this session, Dr Zarmati will share her research on efforts to map and describe progress in the learning area of History.

Learning progression is a continuum that measures advances in learning by tracking development from early learning to more sophisticated levels of mastery. Mathematics relies on an understanding of empirical knowledge and concepts in a hierarchical sequence; students need to understand (or master) one mathematical concept before they can proceed to the next. In comparison, progress of understanding in history is not necessarily hierarchical because it is based on mastery of concepts and skills rather than historical knowledge, which …

Supporting Science Teaching Practice With Learning Progressions, Erin Furtak

2021-2030 ACER Research Conferences

Learning progressions are often used as foundations for curriculum and assessment. At the same time, as representations of the development of student ideas and practices, they can also serve as maps to support teachers during instruction. This paper describes a program of research in which my colleagues and I have investigated how learning progressions can support high school science teachers in cycles of co-designing formative assessments.

Rethinking Measurement For Accountable Assessment, Mark Wilson

2021-2030 ACER Research Conferences

The underlying model for most formal educational measurement (e.g. standardised tests) is based on a very simple model: the student takes a test (possibly alongside other students). The complications of there being an instructional plan, actual instruction, interpretation of the outcome, and formulation of next steps, are all bypassed in considering how to model the process of measurement. There are some standard exceptions, of course: a pre-test/post-test context will involve two measurements, and attention to gain score, or similar. However, if we wish to design measurement to hold to Lehrer’s (2021) definition of ‘accountable assessment’ – as ‘actionable information for …

Making Excellent Progress In Early Reading: How Can The Identification Of Essential Skills And Concepts Help?, Dara Ramalingam, Prue Anderson, Sandra Knowles, Danielle Anzai, Greta Rollo

2021-2030 ACER Research Conferences

The ability to read and understand text is fundamental to full participation in modern adult life (Olson, 1977; Elwert, 2001). It is essential to educational progress across domains, but increased literacy levels are also linked to positive outcomes in terms of employment and health. Given its critical role both in the facilitation of learning in all domains, and in many aspects of life beyond school, it is imperative that we give students the best possible chance to develop their reading skills. This paper uses early reading as a case study for examining how the identification and explication of essential skills …

Leading System Transformation: A Work In Progress, Greg Whitby, Maura Manning, Gavin Hays

2021-2030 ACER Research Conferences

Internationally, the COVID-19 pandemic has profoundly disrupted the education sector. While NSW has avoided the longer periods of remote learning that our colleagues in Victoria and other countries have experienced, we have nonetheless been provoked to reflect on the nature of schooling and the systemic support we provide to transform the learning of each student and enrich the professional lives of staff within our Catholic learning community. At Catholic Education Diocese of Parramatta (CEDP), a key pillar of our approach is to create conditions that enable everyone to be a leader. Following the initial lockdown period in 2020 when students …

Interpreting Learning Progress Using Assessment Scores: What Is There To Gain?, Nathan Zoanetti

2021-2030 ACER Research Conferences

Using assessment scores to quantify gains and growth trajectories for individuals and groups can provide a valuable lens on learning progress for all students. This paper summarises some commonly observed patterns of progress and illustrates these using data from ACER’s Progressive Achievement Test (PAT) assessments. While growth trajectory measurement requires scores for the same individuals over at least three but preferably more occasions, scores from only two occasions are naturally more readily available. The difference between two successive scores is usually referred to as gain. Some common approaches and pitfalls when interpreting individual student gain data are illustrated. It is …

Using Assessment Data To Improve Equity: How Teachers Use Insights From The Scottish National Standardised Assessments, Sarah Richardson, Sladana Krstic

2021-2030 ACER Research Conferences

Evidence-based decision-making is regarded as an important indicator of quality in schools around the world. Using data gathered from assessments, in conjunction with other insights, can help school leaders and teachers better meet the needs of learners. In schools that cater to disadvantaged learners, using data to design targeted interventions plays an important role in improving equity. In this paper we report on a study with five schools in Scotland. All schools had learner cohorts characterised by multiple layers of disadvantage. Informed by the theoretical underpinnings of sensemaking theory, we investigated how teachers and school leaders used data from the …

Identifying And Monitoring Progress In Collaboration Skills, Claire Scoular

2021-2030 ACER Research Conferences

The nature of skills such as collaboration is complex, particularly given that there are internal processes at play. Inferences need to be made to interpret explicit behaviours observed from intentionally designed assessment tasks. This paper centres on the approach to develop hypotheses of skill development into validated learning progressions using assessment data. Understanding a skill from a growth perspective is essential for the effective teaching and development of the skill. The application of Item Response Theory (IRT) allows the interpretation of assessment data as levels of proficiency that we can use to map or monitor progress in collaborative skills.

Exploring Excellence In Indigenous Education In Queensland Secondary Schools, Marnee Shay, Jodie Miller, Suraiya Abdul Hameed

2021-2030 ACER Research Conferences

In the national and international landscape, there is very limited exploration of cultural constructs of excellence, in particular, in Indigenous contexts. This pilot study aimed to centre the voices of Indigenous people in conceptualising excellence in Indigenous education, as well as to share understandings between Indigenous and non-Indigenous practitioners. Qualitative data collection methods were used including collaborative yarning, storying, and semi-structured interviews. Data were analysed using cross-case analysis to examine the views of educators across three school sites. Indigenous participants highlighted the importance of nurturing culture and identity; building up young people; and, building a culture of inclusivity and belonging. …

Learning Progressions As Models And Tools For Supporting Classroom Assessment, Alicia C. Alonzo

2021-2030 ACER Research Conferences

Like all models, learning progressions (LPs) provide simplified representations of complex phenomena. One key simplification is the characterisation of student thinking in terms of levels. This characterisation is both essential for large-scale applications, such as informing standards, but potentially problematic for smaller-scale applications. In this paper, I describe a program of research designed to explore the smaller-scale use of LPs as supports for teacher classroom assessment practices in light of this simplification. Based on this research, I conclude that LP levels may serve as a generative heuristic, particularly when teachers are engaged with evidence of the limitations of LP levels …

Karmel Oration: Excellent Progress For All: A Function Of Year-Level Curriculum Or Evidenced-Based Learning Progressions?, Dianne Siemon

2021-2030 ACER Research Conferences

Excellent progress for all students is an ambitious but necessary goal if we are to improve the life choices of all students. At the moment, we are not serving all our students well despite the best efforts of teachers. We need to look further afield to the curriculum and assessment regimes that drive current practice. Grouping students by ability and offering a watered-down curriculum for some is not the answer. Evidenced-based learning progressions that point to what is important in ensuring all students build a deep, well-connected understanding of mathematics over time is what is needed to support reform at …

This Time Without ‘Feeling’: Children’S Intuitive Theories Of Art As A Logical Basis For Learning Progression In Visual Arts, Karen Maras

2021-2030 ACER Research Conferences

Learning in Visual Arts has traditionally been framed as an experiential process in which feeling and intuition complement the development of aesthetic knowledge. However, while art can be about feelings and processes that develop students’ expressive capacities, the complexity of art understanding and thinking extends beyond this narrow common-sense assumption. I argue that this assumption, which is represented in the Australian Curriculum: The Arts (ACARA, 2015), and even more firmly resonates in recent proposals for the revision of this curriculum (ACARA, 2021), obfuscates the conceptual and theoretical bases on which students make progress in art understanding. This paper examines the …

How Education Gets In The Way Of Learning, Geoff N. Masters

2021-2030 ACER Research Conferences

The formal structures and processes of school education – including the organisation of the school curriculum, processes for assessing student learning, methods of reporting performance, and the uses to which student results are put – are often inconsistent with what is now known about the best ways to promote human learning. Rather than being designed to maximise every student’s learning, these structures and processes often reflect 20th century priorities, including the use of school education to sort and select students into different education and training destinations, and future careers. This sorting function of schooling is becoming increasingly irrelevant in knowledge …

Research Conference 2021: Excellent Progress For Every Student: Proceedings And Program, Australian Council For Educational Research

2021-2030 ACER Research Conferences

The focus of the 2021 Australian Council for Educational Research (ACER) Research Conference is on evidence-based strategies for ensuring that every student makes excellent ongoing progress in their learning. This is an important topic because many students in our schools do not make good, steady progress. Some slip behind and fall increasingly behind the longer they are in school. By the middle years of school, this contributes to significant levels of student disengagement. ACER has invited a number of leading educational researchers to join us to share the findings of their research relevant to this topic. An important conclusion of …

Investigating The Impact Of Learning Through Play At School

International Developments

Learning Through Play at School is a pioneering research study that investigates how playful approaches to teaching and learning are applied in the classroom. The four-year study provides an opportunity to expand understanding of learning through play at school in Ukraine and the impact on teachers and students.

Developing Strategic Plans For An Aligned Approach To 21st Century Skills Integration, Claire Scoular, Ian Teo

Assessment and Reporting

This report describes an online course developed to support education systems to build an aligned and sustainable approach to integration of 21st Century Skills (21CS). 21CS are those skills that are considered particularly important to succeed in today’s knowledge-based society in which innovation and technology are predominant. Prominent examples include critical thinking, creative thinking, and collaboration, and such skills need to be better understood in order for them to be integrated. While different countries may have their own frameworks or priorities surrounding 21CS, a consistent approach to integration can still be achieved with a shared understanding from all stakeholders within …

Timor-Leste: Policy Insights From A Multi-Year Teaching And Learning Study Series, Jennie Chainey, Elizabeth Cassity

Education Analytics Service

The Australian Government is supporting significant education reforms in Timor-Leste. This policy note summarises findings on primary school teacher practice and student learning outcomes during the phased introduction of major curriculum changes. Key areas identified for action include the need to promote inclusive classroom practices and address capacity gaps in this area. In addition, establish measures to ensure effective school leadership and school practices continue once the Apoiu Lideransa liuhosi Mentoria no Aprendizajen (ALMA) program support ceases or there are institutional changes. Part of a multi-year study, the Education Analytics Service is investigating how ALMA is making a difference to …

Teacher Development Multi-Year Study Series. Vanuatu: Interim Report 1, Elizabeth Cassity, Jacqueline Cheng, Debbie Wong

Education Analytics Service

The Government of Vanuatu is undertaking significant primary education reforms, including major curriculum changes, to improve equitable access to and the quality of education. Since 2016, a new primary education curriculum has been introduced by stages, accompanied by a suite of in-service teacher training. The new curriculum promotes teaching practices that support new pedagogies focused on student-centred learning and community support, language transition and class-based assessment practices. These reforms are being supported by the Australian Government, through its Vanuatu Education Support Program (VESP). The Australian Government's Department of Foreign Affairs and Trade (DFAT) has commissioned a study to investigate how …

Competency-Based Learning, Mee Young Han

Teacher India

Mee Young Han suggests that an effort to define educational competencies is required in India at each level, and reaching a consensus about these definitions is an important task for the education community in the country.