Education Commons^™

Teachers’ Assessment Literacy And Design Competence Framework, Sladana Krstic, Sarah Manlove, Sarah Richardson

2021-2030 ACER Research Conferences

Teachers play a central role in facilitating learning and empowering learners (Pastore & Andrade, 2019). They must possess a high level of assessment literacy to properly fulfil their role of implementing teaching and facilitating students’ learning (Hattie, 2009). Without it, the quality of educational provision can be impacted (Looney et al., 2018). The expectations placed on teachers in relation to their assessment knowledge and skills tend to focus on their ability to design and implement assessment with students, and to use assessment data to inform teaching practices (Brookhart, 2011). Much of the emphasis in the literature is on the mechanical …

Assessing Reading: How Assessment Can Be Used To Target Teaching And Enhance Understanding Of Reading Comprehension, Sandra Knowles

2021-2030 ACER Research Conferences

The skills demonstrated by a proficient reader are not easy to untangle. Current research acknowledges that reading comprehension is a highly complex area of ability, one that needs to be understood as the coordination of several integrated processes. Using example test questions and data, this presentation explores how assessment can help us make sense of reading comprehension in a way that curricula and commonly used teaching strategies cannot. Assessment is evidence that informs us about the skills involved in the reading process, how they relate to each other, and how they develop in complexity. When assessment is understood in this …

Sharing And Securing Learners' Performance Standards Across Schools, Richard Kimbell

2021-2030 ACER Research Conferences

Assessing learners’ performance makes very different demands upon teachers depending on the purpose and the context of the assessment. But common to all assessment is some sense of what ‘quality’ looks like. Most often teachers engage in formative assessments in the classroom, and the familiar standards of the classroom are adequate for this purpose. However if teachers are to undertake external, nationally regulated assessment then some sense of a national standard of quality is required. But there are very limited mechanisms by which teachers can acquire this understanding, so they use their best judgement, and standards vary from school to …

An Innovative Method For Teachers To Formatively Assess Writing Online, Dr Sandy Heldsinger, Stephen Humphry

2021-2030 ACER Research Conferences

Assessment is an integral component of effective teaching and a teacher’s professional judgement influences all routine aspects of their work. In the last 20 years, there has been considerable work internationally to support teachers in using assessment to improve student learning. However, there is a pressing issue that impedes teacher professional judgement being exploited to its full potential. The issue relates to teacher assessments in the context of extended performances such as essays and arises from the complexity of obtaining reliable or consistent teacher assessments of students’ work. Literature published in the United States, England and Australia details evidence of …

Using Pat Data To Inform Teaching And Learning, Marc Kralj, Rachel Felgate, Shani Sniedze, Caithlin Power, Grant Barclay, Darren Leech

2021-2030 ACER Research Conferences

ACER works with thousands of Australian schools to set up Progressive Achievement Test (PAT) functionality, assign and administer tests, and to assist teachers to understand and interrogate the resulting test data and act upon findings. This session provides participants with an opportunity to hear about a school’s journey, and discuss this with the ACER team and our PAT school guest. ACER researchers have evaluated and documented assessment implementation and professional development opportunities, observing this school’s ability to track student and educator progress over time, which is a critical element in ACER’s Progressive Achievement approach. ACER’s educational consultants will demonstrate how …

Reimagining Classroom Assessment And Feedback To Meet Learner Needs, Fabienne Van Der Kleij

2021-2030 ACER Research Conferences

The power of classroom assessment and feedback to improve student learning outcomes has long been recognised. Yet, decades of research have yielded disappointing and often conflicting outcomes. This presentation challenges traditional conceptions of classroom assessment and feedback as teacher-driven practices. To meet learner needs better, it proposes a student-centred perspective in which students are active and have agency. By drawing on an extensive study of feedback reviews, this presentation illustrates how conceptualisations of feedback have changed over recent decades. This paper provides key insights into how classroom assessment and feedback practices can be changed in ways that are sustainable, afford …

Reimagining The Purpose Of Assessment, Geoff N. Masters

2021-2030 ACER Research Conferences

Assessment is commonly understood as the process of judging how well students have learnt what they have been taught. It comes at the end of a sequence that begins with a curriculum or course syllabus. Teachers are expected to deliver this body of specified content, students are expected to learn it, and assessment is the process of judging and grading students on how well they have learnt what teachers have taught. This is a common view of assessment among students, parents and many teachers. I will argue in this presentation that this traditional understanding of what it means to learn …

The Swans/Ables Project: A Set Of Resources Developed Collaboratively With Teachers To Support The Teaching And Learning Of Students With Additional Learning Needs, Toshiko Kamei

2021-2030 ACER Research Conferences

The inclusion of students with additional learning needs in schooling is part of policy and practice in Australia. However, it has been well documented that teachers lack the resources and training to meaningfully include students with additional learning needs in the full range of learning in their classrooms. The SWANs (Students with Additional Needs) program of work aimed to fill this gap through developing assessments based on learning progressions to provide targeted information to support the teaching and learning of all students, including students with additional learning needs. The development and implementation of the SWANs/ABLES suite of resources illustrates how …

How Might We Identify And Measure Learning Progression In History?, Louise Zarmati

2021-2030 ACER Research Conferences

In this session, Dr Zarmati will share her research on efforts to map and describe progress in the learning area of History.

Learning progression is a continuum that measures advances in learning by tracking development from early learning to more sophisticated levels of mastery. Mathematics relies on an understanding of empirical knowledge and concepts in a hierarchical sequence; students need to understand (or master) one mathematical concept before they can proceed to the next. In comparison, progress of understanding in history is not necessarily hierarchical because it is based on mastery of concepts and skills rather than historical knowledge, which …

Leading System Transformation: A Work In Progress, Greg Whitby, Maura Manning, Gavin Hays

2021-2030 ACER Research Conferences

Internationally, the COVID-19 pandemic has profoundly disrupted the education sector. While NSW has avoided the longer periods of remote learning that our colleagues in Victoria and other countries have experienced, we have nonetheless been provoked to reflect on the nature of schooling and the systemic support we provide to transform the learning of each student and enrich the professional lives of staff within our Catholic learning community. At Catholic Education Diocese of Parramatta (CEDP), a key pillar of our approach is to create conditions that enable everyone to be a leader. Following the initial lockdown period in 2020 when students …

Interpreting Learning Progress Using Assessment Scores: What Is There To Gain?, Nathan Zoanetti

2021-2030 ACER Research Conferences

Using assessment scores to quantify gains and growth trajectories for individuals and groups can provide a valuable lens on learning progress for all students. This paper summarises some commonly observed patterns of progress and illustrates these using data from ACER’s Progressive Achievement Test (PAT) assessments. While growth trajectory measurement requires scores for the same individuals over at least three but preferably more occasions, scores from only two occasions are naturally more readily available. The difference between two successive scores is usually referred to as gain. Some common approaches and pitfalls when interpreting individual student gain data are illustrated. It is …

Using Assessment Data To Improve Equity: How Teachers Use Insights From The Scottish National Standardised Assessments, Sarah Richardson, Sladana Krstic

2021-2030 ACER Research Conferences

Evidence-based decision-making is regarded as an important indicator of quality in schools around the world. Using data gathered from assessments, in conjunction with other insights, can help school leaders and teachers better meet the needs of learners. In schools that cater to disadvantaged learners, using data to design targeted interventions plays an important role in improving equity. In this paper we report on a study with five schools in Scotland. All schools had learner cohorts characterised by multiple layers of disadvantage. Informed by the theoretical underpinnings of sensemaking theory, we investigated how teachers and school leaders used data from the …

Identifying And Monitoring Progress In Collaboration Skills, Claire Scoular

2021-2030 ACER Research Conferences

The nature of skills such as collaboration is complex, particularly given that there are internal processes at play. Inferences need to be made to interpret explicit behaviours observed from intentionally designed assessment tasks. This paper centres on the approach to develop hypotheses of skill development into validated learning progressions using assessment data. Understanding a skill from a growth perspective is essential for the effective teaching and development of the skill. The application of Item Response Theory (IRT) allows the interpretation of assessment data as levels of proficiency that we can use to map or monitor progress in collaborative skills.

Exploring Excellence In Indigenous Education In Queensland Secondary Schools, Marnee Shay, Jodie Miller, Suraiya Abdul Hameed

2021-2030 ACER Research Conferences

In the national and international landscape, there is very limited exploration of cultural constructs of excellence, in particular, in Indigenous contexts. This pilot study aimed to centre the voices of Indigenous people in conceptualising excellence in Indigenous education, as well as to share understandings between Indigenous and non-Indigenous practitioners. Qualitative data collection methods were used including collaborative yarning, storying, and semi-structured interviews. Data were analysed using cross-case analysis to examine the views of educators across three school sites. Indigenous participants highlighted the importance of nurturing culture and identity; building up young people; and, building a culture of inclusivity and belonging. …

Evidencing Creativity And Curiosity In Ib Schools, Sarah Richardson, Sladana Krstic

2021-2030 ACER Research Conferences

There is growing recognition of the importance of learners gaining transversal or 21st-century attributes in order to thrive in the contemporary world. This poses a number of challenges for educators. First, to what extent are transversal attributes innate, or do they include a combination of traits and skills? Second, what can teachers do to help nurture these attributes in learners? Third, how can the existence or strengthening of attributes be recognised? In this paper, we draw on work that we are doing for the International Baccalaureate Organisation to define conceptual frameworks for creativity and curiosity. Our goal is to enable …

Applying Empirical Learning Progressions For A Holistic Approach To Evidence-Based Education: Swans/Ables, Emily White

2021-2030 ACER Research Conferences

Learning progressions have become an increasing topic of interest for researchers, educational organisations and schools as they can describe the expected pathway of learning within a content area to allow for targeted teaching and learning at all levels of ability. However, there is substantial variation in how learning progressions are developed and to what extent teachers can use them to inform their practices. The ABLES/SWANS tools (Students with Additional Needs/Abilities Based Learning and Education Support) are an example of how an empirical learning progression can be applied to support teachers’ ability to not only target teaching to a student’s zone …

Learning Progressions As Models And Tools For Supporting Classroom Assessment, Alicia C. Alonzo

2021-2030 ACER Research Conferences

Like all models, learning progressions (LPs) provide simplified representations of complex phenomena. One key simplification is the characterisation of student thinking in terms of levels. This characterisation is both essential for large-scale applications, such as informing standards, but potentially problematic for smaller-scale applications. In this paper, I describe a program of research designed to explore the smaller-scale use of LPs as supports for teacher classroom assessment practices in light of this simplification. Based on this research, I conclude that LP levels may serve as a generative heuristic, particularly when teachers are engaged with evidence of the limitations of LP levels …

Karmel Oration: Excellent Progress For All: A Function Of Year-Level Curriculum Or Evidenced-Based Learning Progressions?, Dianne Siemon

2021-2030 ACER Research Conferences

Excellent progress for all students is an ambitious but necessary goal if we are to improve the life choices of all students. At the moment, we are not serving all our students well despite the best efforts of teachers. We need to look further afield to the curriculum and assessment regimes that drive current practice. Grouping students by ability and offering a watered-down curriculum for some is not the answer. Evidenced-based learning progressions that point to what is important in ensuring all students build a deep, well-connected understanding of mathematics over time is what is needed to support reform at …

This Time Without ‘Feeling’: Children’S Intuitive Theories Of Art As A Logical Basis For Learning Progression In Visual Arts, Karen Maras

2021-2030 ACER Research Conferences

Learning in Visual Arts has traditionally been framed as an experiential process in which feeling and intuition complement the development of aesthetic knowledge. However, while art can be about feelings and processes that develop students’ expressive capacities, the complexity of art understanding and thinking extends beyond this narrow common-sense assumption. I argue that this assumption, which is represented in the Australian Curriculum: The Arts (ACARA, 2015), and even more firmly resonates in recent proposals for the revision of this curriculum (ACARA, 2021), obfuscates the conceptual and theoretical bases on which students make progress in art understanding. This paper examines the …

How Education Gets In The Way Of Learning, Geoff N. Masters

2021-2030 ACER Research Conferences

The formal structures and processes of school education – including the organisation of the school curriculum, processes for assessing student learning, methods of reporting performance, and the uses to which student results are put – are often inconsistent with what is now known about the best ways to promote human learning. Rather than being designed to maximise every student’s learning, these structures and processes often reflect 20th century priorities, including the use of school education to sort and select students into different education and training destinations, and future careers. This sorting function of schooling is becoming increasingly irrelevant in knowledge …

Research Conference 2021: Excellent Progress For Every Student: Proceedings And Program, Australian Council For Educational Research

2021-2030 ACER Research Conferences

The focus of the 2021 Australian Council for Educational Research (ACER) Research Conference is on evidence-based strategies for ensuring that every student makes excellent ongoing progress in their learning. This is an important topic because many students in our schools do not make good, steady progress. Some slip behind and fall increasingly behind the longer they are in school. By the middle years of school, this contributes to significant levels of student disengagement. ACER has invited a number of leading educational researchers to join us to share the findings of their research relevant to this topic. An important conclusion of …

Building The Capacity Of Teachers For Supporting 21st-Century Learning, Jenny Gore, Michelle Ware, Sui-Linn White, Lee-Anne Collins, Lloyd Bowen, Carole Hansen

2009 - 2019 ACER Research Conferences

Quality Teaching Rounds (QTR) was first conceptualised by Julie Bowe and Jenny Gore in 2007. It involves teachers working in professional learning communities (PLCs) to reflect on their classroom practice through the lens of the quality teaching model. This teacher-led process builds capacity for quality teaching with novice and experienced teachers alike. Following a set of protocols and adhering to essential features of the approach, one PLC member teaches a lesson, observed by all others. The lesson is coded individually and then collaboratively analysed, using the shared language of the model. This poster presentation graphically highlights evidence from several research …

Karmel Oration: On With The 21st Century! Preparing Australian Education For The 2020s And Beyond, Neil Selwyn

2009 - 2019 ACER Research Conferences

It is rare that the education community gets the chance to think seriously about the future. The 2019 Research Conference theme therefore gives us a welcome opportunity to be future-focused and forward-thinking. This presentation will preface the conference by reflecting on some pressing issues that Australian education is set to face over the next decade. In particular, we will explore a series of substantial challenges that are likely to come to the fore during the 2020s. These include: making a persuasive case for retaining traditional models of ‘school’ and ‘teacher’ in the face of compelling alternatives; developing broader notions of …

Key Skills For The 21st Century: An Evidence-Based Review, Esther Doecke, Quentin Maire

2009 - 2019 ACER Research Conferences

It is vital that education systems deliver quality outcomes for all young people and prepare them well for their future in the economy and society. To do so, many systems have traditionally had a strong focus on developing academic skills, particularly in literacy and numeracy. In recent years, education systems have developed greater expectations that schools will also equip young people with a broader set of skills for the 21st century (e.g. creativity, critical thinking, problem-solving). This paper addresses these developments and the challenges they present. Building on an evidence-based review, this paper asks what are the key skills required …

Assessing Computational Thinking, Daniel Duckworth

2009 - 2019 ACER Research Conferences

This paper provides some context for the role of computation thinking (CT) in the Australian Curriculum, an abridged literature review of CT as a problem-solving framework from the International Computer and Information Literacy Study (ICILS) 2018 assessment framework and some examples of how CT has been used to solve real-world problems. Finally, this paper presents ways to teach and assess CT.

Assessing And Understanding Social And Emotional Skills: The Oecd Study On Social And Emotional Skills, Sue Thomson

2009 - 2019 ACER Research Conferences

In an increasingly fast-changing and diverse world, the importance of developing social and emotional skills is becoming more evident. The large body of accumulated evidence shows that these skills have strong relationships with life outcomes and they have been referred to as a key component of 21st century skills. The Organisation for Economic Co-operation and Development (OECD) Study on Social and Emotional Skills is a new international assessment of these skills in students at primary and secondary schools. This study also gathers information on students’ families, schools and community learning contexts, aiming to provide information about the conditions or practices …

Digital Literacy: Myths And Realities, Julian Fraillon

2009 - 2019 ACER Research Conferences

Digital literacy, under a wide variety of names, is routinely classified as a 21st-century skill and is frequently reported as an area of high priority in school education systems internationally. In comparison with students in other countries, Australian students have high levels of access to digital technologies both at and outside of school. With this access comes the expectations that students will be highly-proficient users of digital technologies and that schools will use digital technologies in transformative ways to support student learning. This session will examine how concepts of digital literacy have developed over time, what data from large-scale assessments …

The Science Behind The Art Of Teaching: Evaluation As Inspiration, Michele Bruniges Am

2009 - 2019 ACER Research Conferences

Teachers across Australia inspire students to love learning. Our best teachers are constantly evaluating their impact on learning outcomes and adapting their practice – balancing the art and science of teaching. As we move rapidly towards the third decade of the 21st century, there is more pressure than ever for all teachers to deliver both deep discipline knowledge and the skills students need to survive and thrive in the workplace of the future. We need to use technology and data to support teachers to maximise learning outcomes for their students. This has to be done in a way that helps …

21st Century Skills: Realising The Potential Of The Australian Curriculum, Robert Randall

2009 - 2019 ACER Research Conferences

The Melbourne Declaration on Educational Goals for Young Australians (Melbourne Declaration) (MCEETYA, 2008) proposed that the Australian Curriculum (and state or territory and local curriculum) develop: a solid foundation in knowledge, understanding, skills and values on which further learning and adult life can be built; deep knowledge, understanding, skills and values that will enable advanced learning and an ability to create new ideas and translate them into practical applications; and general capabilities that underpin flexible and analytical thinking, a capacity to work with others and an ability to move across subject disciplines to develop new expertise. The Australian Curriculum, approved …

Digital Literacy Skill Development: Prescriptive Learning Analytics Assessment Model, Elspeth Mckay

2009 - 2019 ACER Research Conferences

There is a broad awareness of how information communications technology (ICT) digital literacy impacts everyday life. In schools, use of ICT tools has become mandatory. These tools include computers, tablets and mobile phones. These smart devices are used to send emails, browse the internet and make video calls. It is essential for teachers to identify student digital literacy levels through classroom activities and when to implement flexible ePedagogies for students who need help. This presentation will provide easy-to-follow steps to manage learning analytics to determine digital literacy skill levels. Learning analytics can be used for a range of purposes: to …