Education Commons^™

Reimagining The Purpose Of Assessment, Geoff N. Masters

2021-2030 ACER Research Conferences

Assessment is commonly understood as the process of judging how well students have learnt what they have been taught. It comes at the end of a sequence that begins with a curriculum or course syllabus. Teachers are expected to deliver this body of specified content, students are expected to learn it, and assessment is the process of judging and grading students on how well they have learnt what teachers have taught. This is a common view of assessment among students, parents and many teachers. I will argue in this presentation that this traditional understanding of what it means to learn …

Research Conference 2022: Reimagining Assessment: Proceedings And Program, Kylie Burns (Ed.)

2021-2030 ACER Research Conferences

The focus of this year’s Research Conference is on the use of assessment to support improved teaching and learning. The conference is titled ‘reimagining assessment’ because we believe there is a need to transform the essential purposes of educational assessment to provide better information about the deep conceptual learning, skills, competencies, and personal attributes that teachers and schools now have as objectives for student learning and development. Reimagined assessments must now be focused on monitoring learning across this broader range of intended outcomes and provide quality information about the points individuals have reached in their long-term development.

Reporting Student Progress: What Might It Look Like?, Hilary Hollingsworth, Jonathan Heard, Anthony Hockey, Tegan Knuckey

2021-2030 ACER Research Conferences

The Communicating Student Learning Progress review produced by ACER in 2019 set out recommendations for schools and systems to improve the way schools report on student learning, in particular learning progress. Two case study schools from Victoria – a Catholic primary school and government secondary school – discuss changes they’ve made to their student reporting processes, in response to the review’s recommendations. Further research is recommended into how schools are rethinking reporting to engage students and parents in monitoring learning growth.

The Swans/Ables Project: A Set Of Resources Developed Collaboratively With Teachers To Support The Teaching And Learning Of Students With Additional Learning Needs, Toshiko Kamei

2021-2030 ACER Research Conferences

The inclusion of students with additional learning needs in schooling is part of policy and practice in Australia. However, it has been well documented that teachers lack the resources and training to meaningfully include students with additional learning needs in the full range of learning in their classrooms. The SWANs (Students with Additional Needs) program of work aimed to fill this gap through developing assessments based on learning progressions to provide targeted information to support the teaching and learning of all students, including students with additional learning needs. The development and implementation of the SWANs/ABLES suite of resources illustrates how …

How Might We Identify And Measure Learning Progression In History?, Louise Zarmati

2021-2030 ACER Research Conferences

In this session, Dr Zarmati will share her research on efforts to map and describe progress in the learning area of History.

Learning progression is a continuum that measures advances in learning by tracking development from early learning to more sophisticated levels of mastery. Mathematics relies on an understanding of empirical knowledge and concepts in a hierarchical sequence; students need to understand (or master) one mathematical concept before they can proceed to the next. In comparison, progress of understanding in history is not necessarily hierarchical because it is based on mastery of concepts and skills rather than historical knowledge, which …

Supporting Science Teaching Practice With Learning Progressions, Erin Furtak

2021-2030 ACER Research Conferences

Learning progressions are often used as foundations for curriculum and assessment. At the same time, as representations of the development of student ideas and practices, they can also serve as maps to support teachers during instruction. This paper describes a program of research in which my colleagues and I have investigated how learning progressions can support high school science teachers in cycles of co-designing formative assessments.

Rethinking Measurement For Accountable Assessment, Mark Wilson

2021-2030 ACER Research Conferences

The underlying model for most formal educational measurement (e.g. standardised tests) is based on a very simple model: the student takes a test (possibly alongside other students). The complications of there being an instructional plan, actual instruction, interpretation of the outcome, and formulation of next steps, are all bypassed in considering how to model the process of measurement. There are some standard exceptions, of course: a pre-test/post-test context will involve two measurements, and attention to gain score, or similar. However, if we wish to design measurement to hold to Lehrer’s (2021) definition of ‘accountable assessment’ – as ‘actionable information for …

Making Excellent Progress In Early Reading: How Can The Identification Of Essential Skills And Concepts Help?, Dara Ramalingam, Prue Anderson, Sandra Knowles, Danielle Anzai, Greta Rollo

2021-2030 ACER Research Conferences

The ability to read and understand text is fundamental to full participation in modern adult life (Olson, 1977; Elwert, 2001). It is essential to educational progress across domains, but increased literacy levels are also linked to positive outcomes in terms of employment and health. Given its critical role both in the facilitation of learning in all domains, and in many aspects of life beyond school, it is imperative that we give students the best possible chance to develop their reading skills. This paper uses early reading as a case study for examining how the identification and explication of essential skills …

Leading System Transformation: A Work In Progress, Greg Whitby, Maura Manning, Gavin Hays

2021-2030 ACER Research Conferences

Internationally, the COVID-19 pandemic has profoundly disrupted the education sector. While NSW has avoided the longer periods of remote learning that our colleagues in Victoria and other countries have experienced, we have nonetheless been provoked to reflect on the nature of schooling and the systemic support we provide to transform the learning of each student and enrich the professional lives of staff within our Catholic learning community. At Catholic Education Diocese of Parramatta (CEDP), a key pillar of our approach is to create conditions that enable everyone to be a leader. Following the initial lockdown period in 2020 when students …

Interpreting Learning Progress Using Assessment Scores: What Is There To Gain?, Nathan Zoanetti

2021-2030 ACER Research Conferences

Using assessment scores to quantify gains and growth trajectories for individuals and groups can provide a valuable lens on learning progress for all students. This paper summarises some commonly observed patterns of progress and illustrates these using data from ACER’s Progressive Achievement Test (PAT) assessments. While growth trajectory measurement requires scores for the same individuals over at least three but preferably more occasions, scores from only two occasions are naturally more readily available. The difference between two successive scores is usually referred to as gain. Some common approaches and pitfalls when interpreting individual student gain data are illustrated. It is …

Using Assessment Data To Improve Equity: How Teachers Use Insights From The Scottish National Standardised Assessments, Sarah Richardson, Sladana Krstic

2021-2030 ACER Research Conferences

Evidence-based decision-making is regarded as an important indicator of quality in schools around the world. Using data gathered from assessments, in conjunction with other insights, can help school leaders and teachers better meet the needs of learners. In schools that cater to disadvantaged learners, using data to design targeted interventions plays an important role in improving equity. In this paper we report on a study with five schools in Scotland. All schools had learner cohorts characterised by multiple layers of disadvantage. Informed by the theoretical underpinnings of sensemaking theory, we investigated how teachers and school leaders used data from the …

Accountable Assessment, Richard Lehrer

2021-2030 ACER Research Conferences

There is widespread agreement about the importance of accounting for the extent to which educational systems advance student learning. Yet, the forms and formats of accountable assessments often ill serve students and teachers; the summative judgements of student performance that are typically employed to indicate proficiencies on benchmarks of student learning commonly fail to capture student performance in ways that are specific and actionable for teachers. Timing is another key barrier to the utility of summative assessment. In the US, summative evaluations occur at the end of the school year and may serve future students, but do not help teachers …

Identifying And Monitoring Progress In Collaboration Skills, Claire Scoular

2021-2030 ACER Research Conferences

The nature of skills such as collaboration is complex, particularly given that there are internal processes at play. Inferences need to be made to interpret explicit behaviours observed from intentionally designed assessment tasks. This paper centres on the approach to develop hypotheses of skill development into validated learning progressions using assessment data. Understanding a skill from a growth perspective is essential for the effective teaching and development of the skill. The application of Item Response Theory (IRT) allows the interpretation of assessment data as levels of proficiency that we can use to map or monitor progress in collaborative skills.

Exploring Excellence In Indigenous Education In Queensland Secondary Schools, Marnee Shay, Jodie Miller, Suraiya Abdul Hameed

2021-2030 ACER Research Conferences

In the national and international landscape, there is very limited exploration of cultural constructs of excellence, in particular, in Indigenous contexts. This pilot study aimed to centre the voices of Indigenous people in conceptualising excellence in Indigenous education, as well as to share understandings between Indigenous and non-Indigenous practitioners. Qualitative data collection methods were used including collaborative yarning, storying, and semi-structured interviews. Data were analysed using cross-case analysis to examine the views of educators across three school sites. Indigenous participants highlighted the importance of nurturing culture and identity; building up young people; and, building a culture of inclusivity and belonging. …

Evidencing Creativity And Curiosity In Ib Schools, Sarah Richardson, Sladana Krstic

2021-2030 ACER Research Conferences

There is growing recognition of the importance of learners gaining transversal or 21st-century attributes in order to thrive in the contemporary world. This poses a number of challenges for educators. First, to what extent are transversal attributes innate, or do they include a combination of traits and skills? Second, what can teachers do to help nurture these attributes in learners? Third, how can the existence or strengthening of attributes be recognised? In this paper, we draw on work that we are doing for the International Baccalaureate Organisation to define conceptual frameworks for creativity and curiosity. Our goal is to enable …

Applying Empirical Learning Progressions For A Holistic Approach To Evidence-Based Education: Swans/Ables, Emily White

2021-2030 ACER Research Conferences

Learning progressions have become an increasing topic of interest for researchers, educational organisations and schools as they can describe the expected pathway of learning within a content area to allow for targeted teaching and learning at all levels of ability. However, there is substantial variation in how learning progressions are developed and to what extent teachers can use them to inform their practices. The ABLES/SWANS tools (Students with Additional Needs/Abilities Based Learning and Education Support) are an example of how an empirical learning progression can be applied to support teachers’ ability to not only target teaching to a student’s zone …

Learning Progressions As Models And Tools For Supporting Classroom Assessment, Alicia C. Alonzo

2021-2030 ACER Research Conferences

Like all models, learning progressions (LPs) provide simplified representations of complex phenomena. One key simplification is the characterisation of student thinking in terms of levels. This characterisation is both essential for large-scale applications, such as informing standards, but potentially problematic for smaller-scale applications. In this paper, I describe a program of research designed to explore the smaller-scale use of LPs as supports for teacher classroom assessment practices in light of this simplification. Based on this research, I conclude that LP levels may serve as a generative heuristic, particularly when teachers are engaged with evidence of the limitations of LP levels …

Karmel Oration: Excellent Progress For All: A Function Of Year-Level Curriculum Or Evidenced-Based Learning Progressions?, Dianne Siemon

2021-2030 ACER Research Conferences

Excellent progress for all students is an ambitious but necessary goal if we are to improve the life choices of all students. At the moment, we are not serving all our students well despite the best efforts of teachers. We need to look further afield to the curriculum and assessment regimes that drive current practice. Grouping students by ability and offering a watered-down curriculum for some is not the answer. Evidenced-based learning progressions that point to what is important in ensuring all students build a deep, well-connected understanding of mathematics over time is what is needed to support reform at …

This Time Without ‘Feeling’: Children’S Intuitive Theories Of Art As A Logical Basis For Learning Progression In Visual Arts, Karen Maras

2021-2030 ACER Research Conferences

Learning in Visual Arts has traditionally been framed as an experiential process in which feeling and intuition complement the development of aesthetic knowledge. However, while art can be about feelings and processes that develop students’ expressive capacities, the complexity of art understanding and thinking extends beyond this narrow common-sense assumption. I argue that this assumption, which is represented in the Australian Curriculum: The Arts (ACARA, 2015), and even more firmly resonates in recent proposals for the revision of this curriculum (ACARA, 2021), obfuscates the conceptual and theoretical bases on which students make progress in art understanding. This paper examines the …

Developing An Assessment Of Oral Language And Literacy: Measuring Growth In The Early Years, Dan Cloney, Kellie Picker

2021-2030 ACER Research Conferences

Children develop rapidly in their early years. A crucial component of this development is a child’s ability to learn and use language. Even before they enter formal education, children have learned much about oral language and literacy through meaningful interactions with others, and from their life experiences. Children, however, do not develop at the same pace – some children arrive in early childhood education and care (ECEC) programs more advanced while others require additional support. Recent reviews of the assessment tools available to ECEC educators show a lack of good quality measurement and a reliance on checklist style inventories or …

How Education Gets In The Way Of Learning, Geoff N. Masters

2021-2030 ACER Research Conferences

The formal structures and processes of school education – including the organisation of the school curriculum, processes for assessing student learning, methods of reporting performance, and the uses to which student results are put – are often inconsistent with what is now known about the best ways to promote human learning. Rather than being designed to maximise every student’s learning, these structures and processes often reflect 20th century priorities, including the use of school education to sort and select students into different education and training destinations, and future careers. This sorting function of schooling is becoming increasingly irrelevant in knowledge …

Research Conference 2021: Excellent Progress For Every Student: Proceedings And Program, Australian Council For Educational Research

2021-2030 ACER Research Conferences

The focus of the 2021 Australian Council for Educational Research (ACER) Research Conference is on evidence-based strategies for ensuring that every student makes excellent ongoing progress in their learning. This is an important topic because many students in our schools do not make good, steady progress. Some slip behind and fall increasingly behind the longer they are in school. By the middle years of school, this contributes to significant levels of student disengagement. ACER has invited a number of leading educational researchers to join us to share the findings of their research relevant to this topic. An important conclusion of …

Building The Capacity Of Teachers For Supporting 21st-Century Learning, Jenny Gore, Michelle Ware, Sui-Linn White, Lee-Anne Collins, Lloyd Bowen, Carole Hansen

2009 - 2019 ACER Research Conferences

Quality Teaching Rounds (QTR) was first conceptualised by Julie Bowe and Jenny Gore in 2007. It involves teachers working in professional learning communities (PLCs) to reflect on their classroom practice through the lens of the quality teaching model. This teacher-led process builds capacity for quality teaching with novice and experienced teachers alike. Following a set of protocols and adhering to essential features of the approach, one PLC member teaches a lesson, observed by all others. The lesson is coded individually and then collaboratively analysed, using the shared language of the model. This poster presentation graphically highlights evidence from several research …

A Model For How Students Choose Or Reject Subjects At School And What It Means For Science, Tracey-Ann Palmer

2009 - 2019 ACER Research Conferences

There has been concern expressed by educators, researchers and policymakers that too few students are choosing science in their final years of school. Science study at school has been linked to the supply of a scientifically skilled and literate workforce necessary for Australia’s prosperity into the 21st century. This study breaks new ground in exploring how students choose subjects for their final years of school and applying this to the choice of science. Specific strategies are suggested to encourage students to continue studying science at the time subjects are chosen.

Fostering Metacognitive Skills: A Longitudinal Cohort Study, Paul Welch, Annie Van Homrigh

2009 - 2019 ACER Research Conferences

Metacognitive awareness, which is part of self regulated learning, includes the domains of knowledge of cognition and regulation of cognition. Students with effective metacognitive skills are more aware of their strengths and weaknesses and strive to further improve their learning skills. This longitudinal cohort study uses the Junior Metacognitive Awareness Inventory (Jr. MAI) to measure student metacognitive awareness across Years 7 to 10 in a north Queensland girls’ Catholic college.

Negotiation Strategies To Support Misbehaving Kindergarten Children: The ‘Deal’ Strategy, Mariana Boules

2009 - 2019 ACER Research Conferences

This presentation reports on a strategy implemented at a kindergarten to negotiate behavioural changes with children while developing an attitude of personal accountability for progressing the kindergarten program. The method used involved the child being asked their favourite fruit, the name of which is then used as a code for a deal on a behavioural change.

Evaluating I2s2: An Inquiry-Based Indigenous Science Program For Years 5 To 9, Caja Gilbert

2009 - 2019 ACER Research Conferences

The Indigenous STEM Education Project, funded by BHP Billiton and implemented by CSIRO, aims to increase participation and achievement of Aboriginal and Torres Strait Islander students in science, technology, engineering and mathematics (STEM) education and career pathways. It consists of six programs that cater to the diversity of students as they progress through primary, secondary and tertiary education and into employment. One of these programs is I2S2 (Inquiry for Indigenous Science Students). I2S2 is an inquiry-based science program for Years 5 to 9 that has involved over 7600 Aboriginal and Torres Strait Islander students and 1154 teachers since 2016. It …

How Teachers Engage With Student Assessment Data: Understanding Antecedents To Data-Driven Decision Making, Cynthia P. Raffe, Dennis Alonzo, University Of New South Wales

2009 - 2019 ACER Research Conferences

In recent years, education systems internationally have been encouraging data-use initiatives with the aim of improving student learning through data-driven decision making (DDDM). The use of student assessment data in particular has been promoted to guide teaching practices and progress student learning. Despite this, the adoption of data-use practices by New South Wales classroom teachers has been slow. The study qualitatively examined two core foundational activities that affect New South Wales classroom teachers’ use of student assessment data, referred to as assessment data collection (ADC) practices, and assessment data analysis (ADA) practices. Specifically, the study sought to answer: What are …

Karmel Oration: On With The 21st Century! Preparing Australian Education For The 2020s And Beyond, Neil Selwyn

2009 - 2019 ACER Research Conferences

It is rare that the education community gets the chance to think seriously about the future. The 2019 Research Conference theme therefore gives us a welcome opportunity to be future-focused and forward-thinking. This presentation will preface the conference by reflecting on some pressing issues that Australian education is set to face over the next decade. In particular, we will explore a series of substantial challenges that are likely to come to the fore during the 2020s. These include: making a persuasive case for retaining traditional models of ‘school’ and ‘teacher’ in the face of compelling alternatives; developing broader notions of …

Key Skills For The 21st Century: An Evidence-Based Review, Esther Doecke, Quentin Maire

2009 - 2019 ACER Research Conferences

It is vital that education systems deliver quality outcomes for all young people and prepare them well for their future in the economy and society. To do so, many systems have traditionally had a strong focus on developing academic skills, particularly in literacy and numeracy. In recent years, education systems have developed greater expectations that schools will also equip young people with a broader set of skills for the 21st century (e.g. creativity, critical thinking, problem-solving). This paper addresses these developments and the challenges they present. Building on an evidence-based review, this paper asks what are the key skills required …