Educational Assessment, Evaluation, and Research Commons^™

Development Of A Transcript To Record Learner Creativity And Curiosity, Prue Anderson, Toby Carslake, Anit Cherian, Bethany Davies, Laura Good, Jonathan Heard, Sladana Krstic, Brendan Mcginley, Dara Ramalingam, Sarah Richardson, Claire Scoular, Shani Sniedze, Jennifer Star

Assessment and Reporting

Funded with generous support by the Jacobs Foundation, the ultimate goal of this project was to develop transcripts to track learner progress in the domains of creativity and curiosity. To support this overarching goal, the research team sought to define creativity and curiosity in language that would resonate with learners and teachers and that would be appropriate across numerous cultural settings. The result of the project is a series of prototype materials and resources, specifically: literature reviews, frameworks, enabling environment summaries, reflective quizzes and transcripts. Based on insights from the literature reviews, the researchers developed frameworks to define the constructs …

Learning Through Play At School: A Framework For Policy And Practice, Rachel Parker, Bo Stjerne Thomsen, Amy Berry

Student learning processes

Learning through play has emerged as an important strategy to promote student engagement, inclusion, and holistic skills development beyond the preschool years. Policy makers, researchers and educators have promoted the notion that learning though play is developmentally appropriate - as it leverages school-age children’s innate curiosity while easing the often difficult transition from preschool to school. However, there is a dearth of evidence and practical guidance on how learning through play can be employed effectively in the formal school context, and the conditions that support success. This paper addresses the disconnect between policy, research and practice by presenting a range …

Infographic: Measures Taken During School Closures, Dominique Russell

Teacher infographics

An OECD survey explored how 27 education systems across the globe responded during school closures in 2020. This infographic shows how widely nine different measures were used for at least one level of schooling to target students at risk of exclusion from distance education platforms.

Student Views On Starting High School, Dominique Russell

Teacher infographics

Forums held with students in Years 6, 7 and 8 in Australia on the topic of starting high school have shed light on what concerns them the most about the transition process, and what has been helpful to them along the way. Here, we share some comments from the students.

Within And Between School Variation In Achievement On The Programme For International Student Assessment (Pisa) In Australia: Pisa Australia Technical Paper, John Ainley, Greg Macaskill, Sue Thomson

OECD Programme for International Student Assessment (PISA) Australia

Australian secondary school students vary widely in their academic achievement. Using the scores from the Programme for International Student Achievement (PISA) in 2018, for example, the range from the 5th to the 95th percentile of student reading scores in Australia was 359 points compared to the OECD average of 327 points (OECD, 2019a; Thomson et al., 2019). This considerable range in achievement scores has been described as reflecting a long tail in the distribution of achievement. In this paper, attention is focused on the variation in the achievement scores of 15-year-old students in Australia based on data from PISA 2018. …

Teacher Development Multi-Year Studies. Using Case Studies To Investigate And Understand Teaching Quality And Student Learning: Initial Lessons Learned, Jennie Chainey, Debbie Wong, Elizabeth Cassity, Hilary Hollingsworth

Education Analytics Service

This paper presents some initial lessons learned about the use of case studies as a key form of evidence regarding teaching quality and student learning in a multi-year teacher development study series. This study series, commissioned by the Australian Government’s Department of Foreign Affairs and Trade (DFAT), involves the investigation of teacher development initiatives in Lao People’s Democratic Republic (Laos), Timor-Leste and Vanuatu. The overall aim of the study series is to understand the extent to which the Australian investment has improved teaching quality and student learning. This paper discusses the processes used to design, implement, analyse and report case …

Teacher Development Multi-Year Studies. Insights On The Challenges Of Data Availability For Measuring And Reporting On Student Learning Outcomes, Elizabeth Cassity, Debbie Wong

Education Analytics Service

Student learning outcomes are an important source of evidence regarding improved teaching quality. A multi-year teacher development study series was commissioned by the Australian Government’s Department of Foreign Affairs and Trade (DFAT) to investigate teacher development initiatives in Lao People’s Democratic Republic (Laos), Timor-Leste and Vanuatu. The overall aim of the study series is to understand the extent to which the Australian investment has improved teaching quality and student learning. This paper outlines the different approaches to sourcing and using data in each country context, and then presents initial insights about the challenges associated with the limited availability of data …

Teacher Development Multi-Year Study Series. Report Highlights. Vanuatu: Interim Report 2, Elizabeth Cassity, Jennie Chainey, Jacqueline Cheng, Debbie Wong

Education Analytics Service

The Teacher Development Multi-Year Study for Vanuatu seeks to answer the question: To what extent does Australia’s aid investment produce improved teaching quality and improved student learning? The 3 specific questions are: 1. To what extent has the investment improved teaching quality in Vanuatu? 2. To what extent has the investment in teacher training and mentoring supported effective implementation of Vanuatu’s new curriculum? 3. To what extent have teacher training and support activities led to improved learning outcomes? The study adopts a mixed methods approach using qualitative case study data and quantitative student assessment data from the Vanuatu Standardised Test …

Iea International Civic And Citizenship Education Study 2022: Assessment Framework [Early Online Version], Wolfram Schulz, Julian Fraillon, John Ainley, Bruno Losito, Valeria Damiani, Tim Friedman

Civics and Citizenship Assessment

The International Civic and Citizenship Study (ICCS) 2022 continues IEA’s investigation into the ways in which young people understand and are prepared to be citizens in a world where contexts of democracy and civic participation continue to change. This assessment framework provides insight into the study’s conceptual background, cognitive, affective-behavioral and contextual content, and assessment design. It also describes content relevant for the measurement of the United Nations’ Sustainable Development Goals (SDGs) that is related to Global Citizenship Education (GCED) and Education for Sustainable Development (ESD). Countries that participated in ICCS 2009, ICCS 2016, and ICCS 2022 will be able …

Ways Of Orienting Secondary Schools To Becoming Learning Communities, Jennifer Bryce

Lifelong learning

This paper focuses on work carried out over the past two years at the Australian Council for Educational Research for a project entitled: Improving the Foundations for Lifelong Learning in Secondary Schools. Lifelong learning at secondary school level in particular is concerned with keeping students engaged in learning at school and developing in students those characteristics that will make learning an integral part of their lives when they leave school. To a large extent this involves developing the idea of schools as learning communities. The research is underpinned by an exploration of issues through the extensive literature on lifelong learning …

Acer 2019-2020 Annual Report, Australian Council For Educational Research (Acer)

ACER Annual Reports

No abstract provided.

Learning Recovery And Addressing The Learning Crisis In The Asia Pacific: Policy Brief, Pina Tarricone, Kemran Mestan, Ian Teo, Yung Nietschke

Global education monitoring

The COVID-19 pandemic has disrupted education for approximately 1.2 billion students across the Asia-Pacific, and forced the closure of many schools, precipitating a transition towards remote learning, albeit with uneven access and quality (UNESCO, 2021; Global Education Evidence Advisory Panel, 2022), and threatening to deepen the ‘learning crisis’ that already existed, particularly for the most vulnerable learners. As education systems in the Asia-Pacific seek to recover the learning loss due to the pandemic and address the broader learning crisis, it is incumbent on governments to identify appropriate recovery strategies in the short term. Also, governments need to support education system …

The Overcoming Disadvantage In Early Childhood Study: Evaluation Of The Australian Literacy And Numeracy Foundation’S Early Language And Literacy Program. Final Report, Dan Cloney, Kellie Picker, David Jeffries, Prue Anderson

Early Childhood Education

The Overcoming Disadvantage in Early Childhood (ODEC) study is a longitudinal evaluation of the Australian Literacy and Numeracy Foundation’s (ALNF) Early Language and Literacy (EL&L) program. The study was designed to answer the research question: What is the effect of the EL&L program on the development of language and literacy skills in preschool aged children? An integral component of this study was to develop a new measure of oral language and literacy - the Early Language and Literacy Developmental Index (ELLDI). The ELLDI was developed in recognition of the need for a best practice measure of oral language and literacy …

What Australian Students Say About Transition To Secondary School. Final Report, Shani Sniedze, Rachel Felgate, Elizabeth O'Grady, Sarah Buckley, Petra Lietz

Wellbeing

Life Education Australia's Being Healthy Being Active project involved the collection of student voice related to the concept of school transition and the move from primary to secondary school. Students from around Australia participated in 82 focus groups, or student forums, to discuss their own positive experiences, as well as perceived needs and challenges related to their move to secondary school. Section One of this report is a literature review and environmental scan on student transition from primary to secondary school. Section Two describes the methods used to design and administer the Student Forums. This includes a description of the …

Australian General Practice Training Program: National Report On The 2021 National Registrar Survey, Rebecca Taylor, Leyna Clarke, Ali Radloff

Higher education research

The Australian General Practice Training National Registrar Survey (AGPT NRS) is an annual, national survey of GP registrars currently training in the AGPT program. It collects information via an online questionnaire about registrar satisfaction, experience and future career plans. It also collects information about registrars’ demographics and training contexts and other aspects of their training experience. This survey is part of the Department of Health’s (the Department) monitoring and quality improvement activities. The information collected in the AGPT NRS can be used to assure the quality of training provision in the program, enables continuous improvement and allows responses to be …

Online Training On Formative Assessment For Early Language, Literacy, And Numeracy (Elln) In The Philippines: Final Report, Rti International

Initial Teacher education

This report describes findings and lessons learned from an online teacher training course in the Philippines. "Becoming a Learning Detective" is a 5-day online course that focuses on the design and use of formative assessment to improve literacy and numeracy outcomes in Kindergarten to Grade 3 (K–3) classrooms. The emphasis is on classroom-based assessment strategies that are embedded within daily teaching and learning experiences, involving an active partnership between teacher and students. The course brings together asynchronous and synchronous elements, as well as whole group, small group, and individual learning experiences. The course was implemented for the first time among …

Infographic: Student Effort When Taking Tests, Jo Earp

Teacher infographics

A new issue of Snapshots, from the Australian Council for Education Research (ACER), looks at self-reported levels of effort students invested in the PISA (Programme for International Student Assessment) 2018 test. Today’s infographic looks at the percentage of students in 20 participating countries and economies who indicated they would have invested more effort in the test if it counted towards their school marks.

Teachers Report Card 2021: Teachers’ Perceptions Of Education And Their Profession, Australian College Of Educators

Australian College of Educators - National

Teachers play a central role in the development of Australia’s young people. It is essential that their voices are heard by those who make and decide policy, and by others who influence their learning and development. The NEiTA-ACE Teachers Report Card 2021is based on a survey of amplifying the voices of teachers on the state of education and on their profession.

Australian 15-Year-Old Students Living In An Integrated World, Lisa De Bortoli, Catherine Underwood, Sarah Richardson

OECD Programme for International Student Assessment (PISA) Australia

Global competence is defined in the Programme for International Student Assessment (PISA) as a multidimensional capacity that encompasses the ability to examine issues of local, global and cultural significance; understand and appreciate the perspectives and worldviews of others; engage in open, appropriate and effective interactions across cultures; and take action for collective well-being and sustainable development (OECD, 2020). This report focuses on aspects of the global competence module in the PISA 2018 Student Questionnaire and the School Questionnaire. It examines aspects of data collected from student and principal self-reports from the Australian perspective. This report focuses on the similarities between …

Infographic: Psychological Distress Among Young People, Jo Earp

Teacher infographics

A new Mission Australia and Black Dog Institute report has analysed Mission Australia Youth Survey findings from 2012-20 to better understand psychological distress faced by 15- to 19-year-olds in Australia. Data show there has been a significant increase in the proportion of young people experiencing mental health challenges. Find out more in today’s infographic.

Infographic: Having A Desk And A Quiet Place To Study, Jo Earp

Teacher infographics

Whether it's completing homework assignments, preparing for exams, or being required to study remotely during the COVID-19 pandemic, teenage students often need to complete school work at home. But, how many have access to a desk and a quiet place to study? What about those from the most disadvantaged backgrounds?

Infografik: Meja Belajar Dan Sudut Yang Hening Untuk Belajar, Jo Earp

Teacher Southeast Asia

Baik untuk mengerjakan tugas sekolah, persiapan sebelum ujian, atau diharuskan untuk melakukan proses belajar jarak jauh akibat pandemi COVID-19, setiap pelajar di usia remaja kerap perlu menyelesaikan pekerjaan sekolah di rumah masing-masing. Namun, seberapa banyak anak yang memiliki akses kepada meja belajar pribadi dan ketenangan yang mereka butuhkan untuk belajar? Bagaimana dengan mereka yang berasal dari latar belakang yang paling tidak beruntung?

2018 Australian Talis-Pisa Link Report, Kylie Hillman, Sue Thomson

OECD Teaching and Learning International Survey (TALIS)

Australia was one of nine countries and economies to participate in the 2018 TALIS-PISA link study, together with Cuidad Autónoma de Buenos Aires (Argentina), Colombia, the Czech Republic, Denmark, Georgia, Malta, Turkey and Viet Nam. This study involved coordinating the samples of schools that participated in the Program of International Student Assessment (PISA, a study of the performance of 15-year-old students) and the Teaching and Learning International Survey (TALIS, a study that surveys teachers and principals in lower secondary schools) in 2018. A sample of teachers from schools that were selected to participate in PISA were invited to respond to …

Evidence Of Impact Underpinning Life Education Programs, Katherine Dix, Syeda Kashfee Ahmed, Toby Carslake, Shani Sniedze

Wellbeing

This rapid evaluation of core Life Education programs conducted by the Australian Council for Educational Research (ACER) in June 2021 is an independent investigation that demonstrates the evidence base underpinning Life Education programs in primary schools Australia-wide. It presents a national snapshot by drawing upon existing Life Education-specific evaluation data, existing ACER student wellbeing data, and accepted best practice in the field of student health and wellbeing education. The project addressed the key evaluation questions: How are core Life Education programs underpinned by evidence-based best practice, and how are core Life Education programs impacting primary-aged student wellbeing outcomes that align …

Gem Centre: Completion Report For Phase 2 Funding, 2017–2020, Australian Council For Educational Research

Monitoring Learning

In 2014, the Australian Council for Educational Research (ACER) and the Australian Government’s Department of Foreign Affairs and Trade (DFAT) established a partnership under the Global Education Monitoring Centre. Since then, there have been two funding periods: Phase 1 from 2014–2017 and Phase 2 from 2017–2020. Phase 3 will cover 2020–2023. This report documents the completion of Phase 2 funding and describes the shared priorities of DFAT and ACER through the GEM Centre, followed by the objectives and key outcomes of the work program during this period. The outcomes and lessons learned, together with findings from the GEM Centre mid-term …

Research Snapshot: Unicef Philippines Early Childhood Education Kindergarten To Grade 4 Longitudinal Study, Rachel Parker, Jacqueline H. S. Cheng, Prue Anderson, Dan Cloney, Adeola Monty

Early Childhood Education

The Philippines Early Childhood Care and Development (ECCD) Longitudinal Study was a major research investment by UNICEF, the Philippines Department of Education, and the Australian Government. It was designed to investigate the impact of one of the most significant education reforms in Philippines history: the introduction of the Kindergarten year as part of the K-12 Basic Education System. It offers useful insights into the impact of Philippines Mother Tongue-Based Multilingual Education (MTB-MLE) and key language transition points for students from Kindergarten to Grade 4. This longitudinal study measured not only the impact of Kindergarten, but also the contribution that preschool …

Reporting Student Progress: What Might It Look Like?, Hilary Hollingsworth, Jonathan Heard, Anthony Hockey, Tegan Knuckey

2021-2030 ACER Research Conferences

The Communicating Student Learning Progress review produced by ACER in 2019 set out recommendations for schools and systems to improve the way schools report on student learning, in particular learning progress. Two case study schools from Victoria – a Catholic primary school and government secondary school – discuss changes they’ve made to their student reporting processes, in response to the review’s recommendations. Further research is recommended into how schools are rethinking reporting to engage students and parents in monitoring learning growth.

The Swans/Ables Project: A Set Of Resources Developed Collaboratively With Teachers To Support The Teaching And Learning Of Students With Additional Learning Needs, Toshiko Kamei

2021-2030 ACER Research Conferences

The inclusion of students with additional learning needs in schooling is part of policy and practice in Australia. However, it has been well documented that teachers lack the resources and training to meaningfully include students with additional learning needs in the full range of learning in their classrooms. The SWANs (Students with Additional Needs) program of work aimed to fill this gap through developing assessments based on learning progressions to provide targeted information to support the teaching and learning of all students, including students with additional learning needs. The development and implementation of the SWANs/ABLES suite of resources illustrates how …

How Might We Identify And Measure Learning Progression In History?, Louise Zarmati

2021-2030 ACER Research Conferences

In this session, Dr Zarmati will share her research on efforts to map and describe progress in the learning area of History.

Learning progression is a continuum that measures advances in learning by tracking development from early learning to more sophisticated levels of mastery. Mathematics relies on an understanding of empirical knowledge and concepts in a hierarchical sequence; students need to understand (or master) one mathematical concept before they can proceed to the next. In comparison, progress of understanding in history is not necessarily hierarchical because it is based on mastery of concepts and skills rather than historical knowledge, which …

Supporting Science Teaching Practice With Learning Progressions, Erin Furtak

2021-2030 ACER Research Conferences

Learning progressions are often used as foundations for curriculum and assessment. At the same time, as representations of the development of student ideas and practices, they can also serve as maps to support teachers during instruction. This paper describes a program of research in which my colleagues and I have investigated how learning progressions can support high school science teachers in cycles of co-designing formative assessments.