Educational Assessment, Evaluation, and Research Commons^™

The Contribution Of Learning Trajectories To Enacting The Early Years Learning Framework V2.0, Caroline Cohrssen

2021-2030 ACER Research Conferences

The Early Years Learning Framework for Australia v2.0 (EYLF) guides pedagogy and practice with children aged from birth to 5 years and states that ‘over time, children engage with increasingly complex ideas’. With 5 learning outcomes and 8 principles of practice, this requires educators to be highly skilled in facilitating children’s engagement with increasingly complex ideas. It also assumes that all educators recognise children’s demonstrations of understanding, and know what knowledge (or capabilities) likely preceded this understanding, and what comes next. As a framework, this specific information is missing from the EYLF. Learning trajectories may assist educators to recognise demonstrations …

Understanding Early Cognitive Development: Using Pat Early Years To Support Student Learning, Sandra Knowles

2021-2030 ACER Research Conferences

The correlation between early cognitive and psychosocial development is well established. For this reason, some measurement tools, such as UNICEF’s Early Childhood Development Index (ECDI2030), provide a single score as an overall indicator of a child’s development because performing poorly in one area is likely to mean inadequate development across all areas. While these broad indicators can be useful at a system level, understanding children’s development in discrete domain areas is essential for meaningful intervention. This presentation will explore how measurement tools, such as ACER’s Progressive Achievement Tests (PAT) for the Early Years, can be used to support targeted intervention …

Mathematical Mindsets: Fostering Student Engagement And Positive Mindsets Through The Use Of Challenging Tasks, Alison Hall

2021-2030 ACER Research Conferences

This paper explores the planned use of challenging mathematical tasks. These tasks provide the opportunity for students to improve mathematical thinking by working on problems that they do not yet know how to answer. This research involved a heterogeneous class of year 3 students from a Catholic parish primary school in the northern suburbs of Melbourne. A rubric was also developed to use in conjunction with these tasks, to support discussions with students, broaden their strategies in finding solutions and thereby improve their conceptual understanding. These pedagogical approaches were found to support the improvement of both students’ conceptual understanding in …

Assessment Is Coming And The Early Childhood Sector Must Lead The Way, Dan Cloney

2021-2030 ACER Research Conferences

Assessment is a core component of quality early childhood practice. It is explicitly highlighted in the new Early Years Leanring Framework V2.0 and is a standard within Quality Area 1 of the National Quality Standard. In everyday early childhood education and care (ECEC) settings, and in initial teacher education, assessment is often limited to observational and narrative-driven approaches. Recent reviews of the literature highlight that there are few other assessment tools readily available to educators. What assessment looks like in early childhood is changing. The Commonwealth, as part of the Preschool Reform Funding Agreement, is developing, trialling, and implementing a …

Partnerships In Early Childhood Education: Engaging Families In Professional Conversations, Simone Griggs, Greta Rollo

2021-2030 ACER Research Conferences

Effective monitoring of learning and development involves integrating multiple perspectives from a child’s parents, carers, family, and their educators. A collaborative approach between educators and families not only recognises the family’s critical importance in their child’s life but it has also been shown to benefit children with learning difficulties, delays and behavioural concerns (Parenting Research Centre, 2012; Prior et al., 2011). Efforts made towards the integration of multiple perspectives can also support stronger inclusion of diverse families into communities of early childhood education and care. However, discussions with parents and carers about issues regarding their children’s development can be a …

More Than Phonics To Teach Spelling, Clare Iacono

2021-2030 ACER Research Conferences

This poster presents research into using more than phonics to teach students, in the middle primary school years, to spell. It uses document analyses and grounded theory to consider two research questions: Could instruction in metacognition and self regulation also improve skills in spelling? Is there evidence of instruction in metacognition and self regulation in current spelling lessons?

Developing A Learning Progression For Teachers To Support Effective Thinking And Self-Regulation, Hannah Campos Remon, Adam Kuss

2021-2030 ACER Research Conferences

Brisbane Grammar School has undertaken four years of systematic research to develop a learning progression to support teachers in the development of their students’ capacity for learning, including self-regulation. The learning progression offers a comprehensive, learning-focused tool for teachers to consider how their students are developing as learners over time. Whilst it is not intended to be prescriptive or exhaustive, or to produce a grade for ‘learning’, it offers a purposeful sampling of important components of effective thinking.

The Impact Of Dog-Assisted Wellbeing Interventions On Student Motivation And Engagement In The School Setting, Yvonne Howard

2021-2030 ACER Research Conferences

This poster summarises a proposed mixed methods study conducted by a researcher teacher to understand the impact of a therapy dog working in a co-educational day school through two research questions: What are the social and emotional benefits of a school-wide dog-assisted wellbeing intervention for students? How does a dog-assisted wellbeing intervention influence students' motivation and affective engagement at school?

Teaching, Teaching, Wherefore Art Thou? Exploring The Artistry In Teaching, Sean Casham

2021-2030 ACER Research Conferences

Teachers do unforgivably complex work, and part of this complexity is the artistry in teaching practice. This poster outlines research on artistry in teaching involving a literature review and a qualitative multi-site case study design across New South Wales, ACT and the Northern Territory.

Seeing In: Qualitative Shifts In Children’S Critical Understanding Of Their Artworks, Janna Adams Tess

2021-2030 ACER Research Conferences

This poster outlines research to better understand the continuity of children’s learning in primary school Visual Arts, so that art can be better taught and learned. Research Questions include: What do children’s critical judgements of the meaning and value of their artworks reveal about their role and development as artists? How do these critical judgements change from early to late childhood?

Wellbeing Policies And Practices Within A Primary School Context, Lyle Righetti

2021-2030 ACER Research Conferences

This poster outlines research to explore current mental health and wellbeing policies and programs for primary-aged students, and to examine primary teachers’ perceptions of school-based social and emotional learning (SEL) practices in relation to wellbeing policies and programs.

Transdisciplinary Stem Enactment: An Exploratory Case Study In The Queensland Context, Kristie Schulz

2021-2030 ACER Research Conferences

Enacting STEM education in Australian schools is an ambitious task, in a climate of unclear definitions and little implementation advice. Should STEM education simply refer to an umbrella-term of subjects that Australian students need to improve in, or could a cross-disciplinary pedagogy that engages students in authentic problem-solving be realised? This poster outlines a project in which Parklands Christian College designed and enacted a transdisciplinary student-centred ideology of STEM education in 2017. The program has continually evolved using a transdisciplinary pedagogical framework.

Student Drawings: An Ai-Eschewed Means To Show Curriculum-Based Change, Anne Knowles

2021-2030 ACER Research Conferences

This poster focuses on the use of drawings as a way to illustrate change. It presents research undertaken in the Pacific Group of Christian Schools (PGCS) exploring how supplementing curriculums with Personal Viewpoints Pedagogy (PVP) practices has led to change in self-prioritisation which positively influences prosocial behaviour. This Poster reports the use of student representations of thinking through drawings to provide evidence of this change. It shows that student-generated drawings could be used to gauge other-focused thinking, represented as self-conceit, conditional, unconditional, and sacrificial choices in response to socially problematic situations. Learner-generated drawings are a non-textual format offering a window …

Research Conference 2023: Becoming Lifelong Learners. Proceedings And Program, Kylie Burns (Ed.)

2021-2030 ACER Research Conferences

We know learning in the early years sets the foundations for people’s ongoing academic, cognitive and socio-emotional development. Education across those formative first 12 years is currently segmented, with children often starting fresh in new systems. How can each of us make learning in the early childhood and primary years more effective? Research Conference 2023 will examine research around how we can improve the continuity of learning from birth to 12 years. It will bring together leading international and Australian researchers to provide insights into the best ways to identify, conceptualise, develop and assess these new linkages for learning.

Teachers’ Assessment Literacy And Design Competence Framework, Sladana Krstic, Sarah Manlove, Sarah Richardson

2021-2030 ACER Research Conferences

Teachers play a central role in facilitating learning and empowering learners (Pastore & Andrade, 2019). They must possess a high level of assessment literacy to properly fulfil their role of implementing teaching and facilitating students’ learning (Hattie, 2009). Without it, the quality of educational provision can be impacted (Looney et al., 2018). The expectations placed on teachers in relation to their assessment knowledge and skills tend to focus on their ability to design and implement assessment with students, and to use assessment data to inform teaching practices (Brookhart, 2011). Much of the emphasis in the literature is on the mechanical …

Assessing Reading: How Assessment Can Be Used To Target Teaching And Enhance Understanding Of Reading Comprehension, Sandra Knowles

2021-2030 ACER Research Conferences

The skills demonstrated by a proficient reader are not easy to untangle. Current research acknowledges that reading comprehension is a highly complex area of ability, one that needs to be understood as the coordination of several integrated processes. Using example test questions and data, this presentation explores how assessment can help us make sense of reading comprehension in a way that curricula and commonly used teaching strategies cannot. Assessment is evidence that informs us about the skills involved in the reading process, how they relate to each other, and how they develop in complexity. When assessment is understood in this …

Evidence-Informed Early Language And Literacy Practice: Implementation Of A New Formative Assessment For Early Language And Literacy Development, Sarah Groom, Mary-Ruth Mendel, Eric Brace, Philippa Pryor

2021-2030 ACER Research Conferences

With one in five Australian children starting school developmentally vulnerable, there is a need in this critical period for visibility over children’s oral language and early literacy development. The Australian Literacy and Numeracy Foundation (ALNF) partnered with a Northern Territory primary school to implement the Early Language and Literacy Development Index (ELLDI), a newly-created valid and reliable assessment which places children on a progression scale for oral language and early literacy development and provides meaningful, accessible recommendations for educational practice. Twenty-three children in the school’s transition cohort were measured using the ELLDI at the beginning and end of the school …

Making Learning Visible: Moving From Nouns To Verbs, Diane Debacker

2021-2030 ACER Research Conferences

This presentation focuses on the need to make learning visible for all constituents – learners, educators, employers, policymakers and future employees – with a focus on the work of the Center for Certification and Competency-Based Education (C3Be) at the University of Kansas (USA). As K–12 and higher education move to a post-pandemic world, it’s imperative we find different ways to identify learner outcomes and evaluate learning. By moving from nouns to verbs; by moving from course titles to competencies; by moving from transcripts to learner outcomes, learning becomes visible. International educator and founding director of C3Be, Dr Diane DeBacker shows …

Assessment Moderation: Is It Fit For Purpose?, Lenore Adie

2021-2030 ACER Research Conferences

This presentation outlines the different practices and purposes of assessment moderation and analyses the benefits and issues of these. Two projects are presented; each seeks to improve teacher judgement. Both attempt to redefine what we mean by moderation and how moderation can be conducted to reach diverse and dispersed groups. The first draws on a current Australian Research Council project that is exploring the development of scaled exemplars, the use of commentaries of judgement decisions, and the use of digital platforms to support teachers grading student work. The second draws on the work of the Graduate Teacher Performance Assessment (GTPA) …

The Transformational Change Of Adaptive Assessment, Jarrod Hingston, Toby Newton

2021-2030 ACER Research Conferences

Organisational change theory often discusses the differences between adaptive change and transformational change; adaptive change being the process of incremental shifts that are intended to drive improvement, while transformational change requires major alterations in processes. In 2019, ACER embarked on a mission to develop a new adaptive testing and reporting system, with the goal of delivering an assessment that would improve the precision of results for every student. While the intention was to introduce an adaptive change in the assessments, the project truly transformed the way that ACER delivers assessments and reports results, a result recognised by the project being …

Sharing And Securing Learners' Performance Standards Across Schools, Richard Kimbell

2021-2030 ACER Research Conferences

Assessing learners’ performance makes very different demands upon teachers depending on the purpose and the context of the assessment. But common to all assessment is some sense of what ‘quality’ looks like. Most often teachers engage in formative assessments in the classroom, and the familiar standards of the classroom are adequate for this purpose. However if teachers are to undertake external, nationally regulated assessment then some sense of a national standard of quality is required. But there are very limited mechanisms by which teachers can acquire this understanding, so they use their best judgement, and standards vary from school to …

An Innovative Method For Teachers To Formatively Assess Writing Online, Dr Sandy Heldsinger, Stephen Humphry

2021-2030 ACER Research Conferences

Assessment is an integral component of effective teaching and a teacher’s professional judgement influences all routine aspects of their work. In the last 20 years, there has been considerable work internationally to support teachers in using assessment to improve student learning. However, there is a pressing issue that impedes teacher professional judgement being exploited to its full potential. The issue relates to teacher assessments in the context of extended performances such as essays and arises from the complexity of obtaining reliable or consistent teacher assessments of students’ work. Literature published in the United States, England and Australia details evidence of …

Using Pat Data To Inform Teaching And Learning, Marc Kralj, Rachel Felgate, Shani Sniedze, Caithlin Power, Grant Barclay, Darren Leech

2021-2030 ACER Research Conferences

ACER works with thousands of Australian schools to set up Progressive Achievement Test (PAT) functionality, assign and administer tests, and to assist teachers to understand and interrogate the resulting test data and act upon findings. This session provides participants with an opportunity to hear about a school’s journey, and discuss this with the ACER team and our PAT school guest. ACER researchers have evaluated and documented assessment implementation and professional development opportunities, observing this school’s ability to track student and educator progress over time, which is a critical element in ACER’s Progressive Achievement approach. ACER’s educational consultants will demonstrate how …

Reimagining Classroom Assessment And Feedback To Meet Learner Needs, Fabienne Van Der Kleij

2021-2030 ACER Research Conferences

The power of classroom assessment and feedback to improve student learning outcomes has long been recognised. Yet, decades of research have yielded disappointing and often conflicting outcomes. This presentation challenges traditional conceptions of classroom assessment and feedback as teacher-driven practices. To meet learner needs better, it proposes a student-centred perspective in which students are active and have agency. By drawing on an extensive study of feedback reviews, this presentation illustrates how conceptualisations of feedback have changed over recent decades. This paper provides key insights into how classroom assessment and feedback practices can be changed in ways that are sustainable, afford …

Acer Models Of Writing: Changing The Assessment Mindset, Juliette Mendelovits, Judy Nixon

2021-2030 ACER Research Conferences

This presentation outlines different models of writing assessment that have a proven track record in various programs delivered by ACER. These models include holistic scoring, and partial analytical scoring on a number of criteria. The writing prompts for these models assume extended pieces of writing. The presentation will also introduce a new and alternative model of writing assessment that ACER has implemented in several large-scale assessments. This model is built on shorter pieces of writing from each student, designed to give more accurate and diverse insights into students’ proficiency in writing in a range of text types, within the constraints …

Reimagining The Purpose Of Assessment, Geoff N. Masters

2021-2030 ACER Research Conferences

Assessment is commonly understood as the process of judging how well students have learnt what they have been taught. It comes at the end of a sequence that begins with a curriculum or course syllabus. Teachers are expected to deliver this body of specified content, students are expected to learn it, and assessment is the process of judging and grading students on how well they have learnt what teachers have taught. This is a common view of assessment among students, parents and many teachers. I will argue in this presentation that this traditional understanding of what it means to learn …

Research Conference 2022: Reimagining Assessment: Proceedings And Program, Kylie Burns (Ed.)

2021-2030 ACER Research Conferences

The focus of this year’s Research Conference is on the use of assessment to support improved teaching and learning. The conference is titled ‘reimagining assessment’ because we believe there is a need to transform the essential purposes of educational assessment to provide better information about the deep conceptual learning, skills, competencies, and personal attributes that teachers and schools now have as objectives for student learning and development. Reimagined assessments must now be focused on monitoring learning across this broader range of intended outcomes and provide quality information about the points individuals have reached in their long-term development.

Reporting Student Progress: What Might It Look Like?, Hilary Hollingsworth, Jonathan Heard, Anthony Hockey, Tegan Knuckey

2021-2030 ACER Research Conferences

The Communicating Student Learning Progress review produced by ACER in 2019 set out recommendations for schools and systems to improve the way schools report on student learning, in particular learning progress. Two case study schools from Victoria – a Catholic primary school and government secondary school – discuss changes they’ve made to their student reporting processes, in response to the review’s recommendations. Further research is recommended into how schools are rethinking reporting to engage students and parents in monitoring learning growth.

The Swans/Ables Project: A Set Of Resources Developed Collaboratively With Teachers To Support The Teaching And Learning Of Students With Additional Learning Needs, Toshiko Kamei

2021-2030 ACER Research Conferences

The inclusion of students with additional learning needs in schooling is part of policy and practice in Australia. However, it has been well documented that teachers lack the resources and training to meaningfully include students with additional learning needs in the full range of learning in their classrooms. The SWANs (Students with Additional Needs) program of work aimed to fill this gap through developing assessments based on learning progressions to provide targeted information to support the teaching and learning of all students, including students with additional learning needs. The development and implementation of the SWANs/ABLES suite of resources illustrates how …

How Might We Identify And Measure Learning Progression In History?, Louise Zarmati

2021-2030 ACER Research Conferences

In this session, Dr Zarmati will share her research on efforts to map and describe progress in the learning area of History.

Learning progression is a continuum that measures advances in learning by tracking development from early learning to more sophisticated levels of mastery. Mathematics relies on an understanding of empirical knowledge and concepts in a hierarchical sequence; students need to understand (or master) one mathematical concept before they can proceed to the next. In comparison, progress of understanding in history is not necessarily hierarchical because it is based on mastery of concepts and skills rather than historical knowledge, which …