Educational Assessment, Evaluation, and Research Commons^™

What Australian Students Say About Transition To Secondary School. Final Report, Shani Sniedze, Rachel Felgate, Elizabeth O'Grady, Sarah Buckley, Petra Lietz

Wellbeing

Life Education Australia's Being Healthy Being Active project involved the collection of student voice related to the concept of school transition and the move from primary to secondary school. Students from around Australia participated in 82 focus groups, or student forums, to discuss their own positive experiences, as well as perceived needs and challenges related to their move to secondary school. Section One of this report is a literature review and environmental scan on student transition from primary to secondary school. Section Two describes the methods used to design and administer the Student Forums. This includes a description of the …

Australian General Practice Training Program: National Report On The 2021 National Registrar Survey, Rebecca Taylor, Leyna Clarke, Ali Radloff

Higher education research

The Australian General Practice Training National Registrar Survey (AGPT NRS) is an annual, national survey of GP registrars currently training in the AGPT program. It collects information via an online questionnaire about registrar satisfaction, experience and future career plans. It also collects information about registrars’ demographics and training contexts and other aspects of their training experience. This survey is part of the Department of Health’s (the Department) monitoring and quality improvement activities. The information collected in the AGPT NRS can be used to assure the quality of training provision in the program, enables continuous improvement and allows responses to be …

Online Training On Formative Assessment For Early Language, Literacy, And Numeracy (Elln) In The Philippines: Final Report, Rti International

Teacher education

This report describes findings and lessons learned from an online teacher training course in the Philippines. "Becoming a Learning Detective" is a 5-day online course that focuses on the design and use of formative assessment to improve literacy and numeracy outcomes in Kindergarten to Grade 3 (K–3) classrooms. The emphasis is on classroom-based assessment strategies that are embedded within daily teaching and learning experiences, involving an active partnership between teacher and students. The course brings together asynchronous and synchronous elements, as well as whole group, small group, and individual learning experiences. The course was implemented for the first time among …

Infographic: Student Effort When Taking Tests, Jo Earp

Teacher infographics

A new issue of Snapshots, from the Australian Council for Education Research (ACER), looks at self-reported levels of effort students invested in the PISA (Programme for International Student Assessment) 2018 test. Today’s infographic looks at the percentage of students in 20 participating countries and economies who indicated they would have invested more effort in the test if it counted towards their school marks.

Teachers Report Card 2021: Teachers’ Perceptions Of Education And Their Profession, Australian College Of Educators

Australian College of Educators - National

Teachers play a central role in the development of Australia’s young people. It is essential that their voices are heard by those who make and decide policy, and by others who influence their learning and development. The NEiTA-ACE Teachers Report Card 2021is based on a survey of amplifying the voices of teachers on the state of education and on their profession.

Australian 15-Year-Old Students Living In An Integrated World, Lisa De Bortoli, Catherine Underwood, Sarah Richardson

OECD Programme for International Student Assessment (PISA) Australia

Global competence is defined in the Programme for International Student Assessment (PISA) as a multidimensional capacity that encompasses the ability to examine issues of local, global and cultural significance; understand and appreciate the perspectives and worldviews of others; engage in open, appropriate and effective interactions across cultures; and take action for collective well-being and sustainable development (OECD, 2020). This report focuses on aspects of the global competence module in the PISA 2018 Student Questionnaire and the School Questionnaire. It examines aspects of data collected from student and principal self-reports from the Australian perspective. This report focuses on the similarities between …

Infographic: Psychological Distress Among Young People, Jo Earp

Teacher infographics

A new Mission Australia and Black Dog Institute report has analysed Mission Australia Youth Survey findings from 2012-20 to better understand psychological distress faced by 15- to 19-year-olds in Australia. Data show there has been a significant increase in the proportion of young people experiencing mental health challenges. Find out more in today’s infographic.

Infographic: Having A Desk And A Quiet Place To Study, Jo Earp

Teacher infographics

Whether it's completing homework assignments, preparing for exams, or being required to study remotely during the COVID-19 pandemic, teenage students often need to complete school work at home. But, how many have access to a desk and a quiet place to study? What about those from the most disadvantaged backgrounds?

Infografik: Meja Belajar Dan Sudut Yang Hening Untuk Belajar, Jo Earp

Teacher Southeast Asia

Baik untuk mengerjakan tugas sekolah, persiapan sebelum ujian, atau diharuskan untuk melakukan proses belajar jarak jauh akibat pandemi COVID-19, setiap pelajar di usia remaja kerap perlu menyelesaikan pekerjaan sekolah di rumah masing-masing. Namun, seberapa banyak anak yang memiliki akses kepada meja belajar pribadi dan ketenangan yang mereka butuhkan untuk belajar? Bagaimana dengan mereka yang berasal dari latar belakang yang paling tidak beruntung?

Evidence Of Impact Underpinning Life Education Programs, Katherine Dix, Syeda Kashfee Ahmed, Toby Carslake, Shani Sniedze

Wellbeing

This rapid evaluation of core Life Education programs conducted by the Australian Council for Educational Research (ACER) in June 2021 is an independent investigation that demonstrates the evidence base underpinning Life Education programs in primary schools Australia-wide. It presents a national snapshot by drawing upon existing Life Education-specific evaluation data, existing ACER student wellbeing data, and accepted best practice in the field of student health and wellbeing education. The project addressed the key evaluation questions: How are core Life Education programs underpinned by evidence-based best practice, and how are core Life Education programs impacting primary-aged student wellbeing outcomes that align …

2018 Australian Talis-Pisa Link Report, Kylie Hillman, Sue Thomson

OECD Teaching and Learning International Survey (TALIS)

Australia was one of nine countries and economies to participate in the 2018 TALIS-PISA link study, together with Cuidad Autónoma de Buenos Aires (Argentina), Colombia, the Czech Republic, Denmark, Georgia, Malta, Turkey and Viet Nam. This study involved coordinating the samples of schools that participated in the Program of International Student Assessment (PISA, a study of the performance of 15-year-old students) and the Teaching and Learning International Survey (TALIS, a study that surveys teachers and principals in lower secondary schools) in 2018. A sample of teachers from schools that were selected to participate in PISA were invited to respond to …

Gem Centre: Completion Report For Phase 2 Funding, 2017–2020, Australian Council For Educational Research

Monitoring Learning

In 2014, the Australian Council for Educational Research (ACER) and the Australian Government’s Department of Foreign Affairs and Trade (DFAT) established a partnership under the Global Education Monitoring Centre. Since then, there have been two funding periods: Phase 1 from 2014–2017 and Phase 2 from 2017–2020. Phase 3 will cover 2020–2023. This report documents the completion of Phase 2 funding and describes the shared priorities of DFAT and ACER through the GEM Centre, followed by the objectives and key outcomes of the work program during this period. The outcomes and lessons learned, together with findings from the GEM Centre mid-term …

Research Snapshot: Unicef Philippines Early Childhood Education Kindergarten To Grade 4 Longitudinal Study, Rachel Parker, Jacqueline H. S. Cheng, Prue Anderson, Dan Cloney, Adeola Monty

Early Childhood Education

The Philippines Early Childhood Care and Development (ECCD) Longitudinal Study was a major research investment by UNICEF, the Philippines Department of Education, and the Australian Government. It was designed to investigate the impact of one of the most significant education reforms in Philippines history: the introduction of the Kindergarten year as part of the K-12 Basic Education System. It offers useful insights into the impact of Philippines Mother Tongue-Based Multilingual Education (MTB-MLE) and key language transition points for students from Kindergarten to Grade 4. This longitudinal study measured not only the impact of Kindergarten, but also the contribution that preschool …

Reporting Student Progress: What Might It Look Like?, Hilary Hollingsworth, Jonathan Heard, Anthony Hockey, Tegan Knuckey

2021-2030 ACER Research Conferences

The Communicating Student Learning Progress review produced by ACER in 2019 set out recommendations for schools and systems to improve the way schools report on student learning, in particular learning progress. Two case study schools from Victoria – a Catholic primary school and government secondary school – discuss changes they’ve made to their student reporting processes, in response to the review’s recommendations. Further research is recommended into how schools are rethinking reporting to engage students and parents in monitoring learning growth.

The Swans/Ables Project: A Set Of Resources Developed Collaboratively With Teachers To Support The Teaching And Learning Of Students With Additional Learning Needs, Toshiko Kamei

2021-2030 ACER Research Conferences

The inclusion of students with additional learning needs in schooling is part of policy and practice in Australia. However, it has been well documented that teachers lack the resources and training to meaningfully include students with additional learning needs in the full range of learning in their classrooms. The SWANs (Students with Additional Needs) program of work aimed to fill this gap through developing assessments based on learning progressions to provide targeted information to support the teaching and learning of all students, including students with additional learning needs. The development and implementation of the SWANs/ABLES suite of resources illustrates how …

How Might We Identify And Measure Learning Progression In History?, Louise Zarmati

2021-2030 ACER Research Conferences

In this session, Dr Zarmati will share her research on efforts to map and describe progress in the learning area of History.

Learning progression is a continuum that measures advances in learning by tracking development from early learning to more sophisticated levels of mastery. Mathematics relies on an understanding of empirical knowledge and concepts in a hierarchical sequence; students need to understand (or master) one mathematical concept before they can proceed to the next. In comparison, progress of understanding in history is not necessarily hierarchical because it is based on mastery of concepts and skills rather than historical knowledge, which …

Supporting Science Teaching Practice With Learning Progressions, Erin Furtak

2021-2030 ACER Research Conferences

Learning progressions are often used as foundations for curriculum and assessment. At the same time, as representations of the development of student ideas and practices, they can also serve as maps to support teachers during instruction. This paper describes a program of research in which my colleagues and I have investigated how learning progressions can support high school science teachers in cycles of co-designing formative assessments.

Rethinking Measurement For Accountable Assessment, Mark Wilson

2021-2030 ACER Research Conferences

The underlying model for most formal educational measurement (e.g. standardised tests) is based on a very simple model: the student takes a test (possibly alongside other students). The complications of there being an instructional plan, actual instruction, interpretation of the outcome, and formulation of next steps, are all bypassed in considering how to model the process of measurement. There are some standard exceptions, of course: a pre-test/post-test context will involve two measurements, and attention to gain score, or similar. However, if we wish to design measurement to hold to Lehrer’s (2021) definition of ‘accountable assessment’ – as ‘actionable information for …

Making Excellent Progress In Early Reading: How Can The Identification Of Essential Skills And Concepts Help?, Dara Ramalingam, Prue Anderson, Sandra Knowles, Danielle Anzai, Greta Rollo

2021-2030 ACER Research Conferences

The ability to read and understand text is fundamental to full participation in modern adult life (Olson, 1977; Elwert, 2001). It is essential to educational progress across domains, but increased literacy levels are also linked to positive outcomes in terms of employment and health. Given its critical role both in the facilitation of learning in all domains, and in many aspects of life beyond school, it is imperative that we give students the best possible chance to develop their reading skills. This paper uses early reading as a case study for examining how the identification and explication of essential skills …

Leading System Transformation: A Work In Progress, Greg Whitby, Maura Manning, Gavin Hays

2021-2030 ACER Research Conferences

Internationally, the COVID-19 pandemic has profoundly disrupted the education sector. While NSW has avoided the longer periods of remote learning that our colleagues in Victoria and other countries have experienced, we have nonetheless been provoked to reflect on the nature of schooling and the systemic support we provide to transform the learning of each student and enrich the professional lives of staff within our Catholic learning community. At Catholic Education Diocese of Parramatta (CEDP), a key pillar of our approach is to create conditions that enable everyone to be a leader. Following the initial lockdown period in 2020 when students …

Interpreting Learning Progress Using Assessment Scores: What Is There To Gain?, Nathan Zoanetti

2021-2030 ACER Research Conferences

Using assessment scores to quantify gains and growth trajectories for individuals and groups can provide a valuable lens on learning progress for all students. This paper summarises some commonly observed patterns of progress and illustrates these using data from ACER’s Progressive Achievement Test (PAT) assessments. While growth trajectory measurement requires scores for the same individuals over at least three but preferably more occasions, scores from only two occasions are naturally more readily available. The difference between two successive scores is usually referred to as gain. Some common approaches and pitfalls when interpreting individual student gain data are illustrated. It is …

Using Assessment Data To Improve Equity: How Teachers Use Insights From The Scottish National Standardised Assessments, Sarah Richardson, Sladana Krstic

2021-2030 ACER Research Conferences

Evidence-based decision-making is regarded as an important indicator of quality in schools around the world. Using data gathered from assessments, in conjunction with other insights, can help school leaders and teachers better meet the needs of learners. In schools that cater to disadvantaged learners, using data to design targeted interventions plays an important role in improving equity. In this paper we report on a study with five schools in Scotland. All schools had learner cohorts characterised by multiple layers of disadvantage. Informed by the theoretical underpinnings of sensemaking theory, we investigated how teachers and school leaders used data from the …

Accountable Assessment, Richard Lehrer

2021-2030 ACER Research Conferences

There is widespread agreement about the importance of accounting for the extent to which educational systems advance student learning. Yet, the forms and formats of accountable assessments often ill serve students and teachers; the summative judgements of student performance that are typically employed to indicate proficiencies on benchmarks of student learning commonly fail to capture student performance in ways that are specific and actionable for teachers. Timing is another key barrier to the utility of summative assessment. In the US, summative evaluations occur at the end of the school year and may serve future students, but do not help teachers …

Identifying And Monitoring Progress In Collaboration Skills, Claire Scoular

2021-2030 ACER Research Conferences

The nature of skills such as collaboration is complex, particularly given that there are internal processes at play. Inferences need to be made to interpret explicit behaviours observed from intentionally designed assessment tasks. This paper centres on the approach to develop hypotheses of skill development into validated learning progressions using assessment data. Understanding a skill from a growth perspective is essential for the effective teaching and development of the skill. The application of Item Response Theory (IRT) allows the interpretation of assessment data as levels of proficiency that we can use to map or monitor progress in collaborative skills.

Evidencing Creativity And Curiosity In Ib Schools, Sarah Richardson, Sladana Krstic

2021-2030 ACER Research Conferences

There is growing recognition of the importance of learners gaining transversal or 21st-century attributes in order to thrive in the contemporary world. This poses a number of challenges for educators. First, to what extent are transversal attributes innate, or do they include a combination of traits and skills? Second, what can teachers do to help nurture these attributes in learners? Third, how can the existence or strengthening of attributes be recognised? In this paper, we draw on work that we are doing for the International Baccalaureate Organisation to define conceptual frameworks for creativity and curiosity. Our goal is to enable …

Applying Empirical Learning Progressions For A Holistic Approach To Evidence-Based Education: Swans/Ables, Emily White

2021-2030 ACER Research Conferences

Learning progressions have become an increasing topic of interest for researchers, educational organisations and schools as they can describe the expected pathway of learning within a content area to allow for targeted teaching and learning at all levels of ability. However, there is substantial variation in how learning progressions are developed and to what extent teachers can use them to inform their practices. The ABLES/SWANS tools (Students with Additional Needs/Abilities Based Learning and Education Support) are an example of how an empirical learning progression can be applied to support teachers’ ability to not only target teaching to a student’s zone …

Learning Progressions As Models And Tools For Supporting Classroom Assessment, Alicia C. Alonzo

2021-2030 ACER Research Conferences

Like all models, learning progressions (LPs) provide simplified representations of complex phenomena. One key simplification is the characterisation of student thinking in terms of levels. This characterisation is both essential for large-scale applications, such as informing standards, but potentially problematic for smaller-scale applications. In this paper, I describe a program of research designed to explore the smaller-scale use of LPs as supports for teacher classroom assessment practices in light of this simplification. Based on this research, I conclude that LP levels may serve as a generative heuristic, particularly when teachers are engaged with evidence of the limitations of LP levels …

Karmel Oration: Excellent Progress For All: A Function Of Year-Level Curriculum Or Evidenced-Based Learning Progressions?, Dianne Siemon

2021-2030 ACER Research Conferences

Excellent progress for all students is an ambitious but necessary goal if we are to improve the life choices of all students. At the moment, we are not serving all our students well despite the best efforts of teachers. We need to look further afield to the curriculum and assessment regimes that drive current practice. Grouping students by ability and offering a watered-down curriculum for some is not the answer. Evidenced-based learning progressions that point to what is important in ensuring all students build a deep, well-connected understanding of mathematics over time is what is needed to support reform at …

This Time Without ‘Feeling’: Children’S Intuitive Theories Of Art As A Logical Basis For Learning Progression In Visual Arts, Karen Maras

2021-2030 ACER Research Conferences

Learning in Visual Arts has traditionally been framed as an experiential process in which feeling and intuition complement the development of aesthetic knowledge. However, while art can be about feelings and processes that develop students’ expressive capacities, the complexity of art understanding and thinking extends beyond this narrow common-sense assumption. I argue that this assumption, which is represented in the Australian Curriculum: The Arts (ACARA, 2015), and even more firmly resonates in recent proposals for the revision of this curriculum (ACARA, 2021), obfuscates the conceptual and theoretical bases on which students make progress in art understanding. This paper examines the …

Developing An Assessment Of Oral Language And Literacy: Measuring Growth In The Early Years, Dan Cloney, Kellie Picker

2021-2030 ACER Research Conferences

Children develop rapidly in their early years. A crucial component of this development is a child’s ability to learn and use language. Even before they enter formal education, children have learned much about oral language and literacy through meaningful interactions with others, and from their life experiences. Children, however, do not develop at the same pace – some children arrive in early childhood education and care (ECEC) programs more advanced while others require additional support. Recent reviews of the assessment tools available to ECEC educators show a lack of good quality measurement and a reliance on checklist style inventories or …