Educational Assessment, Evaluation, and Research Commons^™

Queensland Teacher Workload Study: Final Report To The Queensland Teachers’ Union, Sheldon Rothman, Lawrence Ingvarson, Darren Matthews

Teacher workforce and careers

The Australian Council for Educational Research (ACER) conducted an online survey of members on behalf of the Queensland Teachers’ Union (QTU). The survey was open to teachers, school leaders (principals and assistant principals) and heads of program working in Queensland government schools. It was based on one conducted for the Victorian branch of the Australian Education Union (AEU) in 2016 and the AEU – Tasmanian Branch in 2017. The survey of the work of union members in Queensland government schools focussed on the hours of work by school staff, staff perceptions of their work, and the relationship between work practices …

Risky Business: Pilot Of The Social Norms Program For Secondary Schools, Katherine Dix, Toby Carslake

Wellbeing

Intent on contributing to drug and alcohol education in secondary schools, Life Education set out in 2017 to explore the viability of using a social norms approach that confronted young people's misconceptions about risk-taking behaviours amongst their peers. A literature review (Ahmed, Mitchell & Trevitt, 2018) provided strong foundations for developing and piloting Australia's first social norms-based drug and alcohol program for secondary school students. Norms are considered to have a behavioural dimension – how the majority of people in a group behave – as well as an attitudinal dimension – how this majority believes they and others should behave. …

The Japan University Experience Survey (Jues), Darren Matthews, Leyna Clarke

Higher education research

An overview of the Japan University Experience Survey (JUES) including its background and aims, and the ACER - Kawaijuku Group partnership. The presentation discusses the development, delivery, reporting and results of the survey, and considers Japanese and Australian UES/SES comparisons and the potential for benchmarking.

Acer 2016-2017 Annual Report, Australian Council For Educational Research (Acer)

ACER Annual Reports

No abstract provided.

Enhancing Teaching And Learning Through Design Practice, Lori Lockyer

2009 - 2019 ACER Research Conferences

Design is part of a teacher’s practice on a daily basis. Teachers are constantly designing and redesigning learning experiences for their students. However, the notions of the teacher as designer or ‘teacher design practice’ are rarely used as frameworks within teacher education or continuing professional learning. In fact, ‘teacher design thinking’, that is, how school teachers think about and engage in design practice has been an under-researched area. Design thinking has the potential to provide teachers with a scaffold to reflect upon contextual and evidence-based factors when designing learning experiences for their students. However, we need to know how teachers …

Equipping Teachers With Tools To Assess And Teach General Capabilities, Claire Scoular

2009 - 2019 ACER Research Conferences

There is wide recognition that students need to be equipped with appropriate social and cognitive skills demanded by society and the workforce. The unresolved question is how to do this. Many education systems globally are addressing this demand by including skills such as critical thinking, problem-solving, collaboration, and creativity into curriculum documents or supplementary materials. However, there is little research to guide educators in teaching such skills at school level. The need to develop practical solutions for assessing and teaching social and cognitive skills, broadly classified under the umbrella ‘21st-century skills’ or ‘general capabilities’, is ever increasing. An integrated approach …

Acer Research Conference Proceedings (2018), Australian Council For Educational Research (Acer)

2009 - 2019 ACER Research Conferences

There is no shortage of opinion about more and less effective ways of teaching. Schools are continually presented with strategies, programs and approaches that claim to be ‘research-based’, ‘evidence-based’ or even ‘brainbased’. Vocal advocates of particular teaching methods promote their proposed solutions in the media. But how many of these programs and methods have solid foundations in research? And how can teachers and school leaders distinguish exaggerated marketing claims from teaching strategies shown through research to be effective in improving student outcomes? Research Conference 2018 examines research evidence around teaching practices that make a difference. It brings together leading international …

Implementing Large-Scale Education Assessments, Geoff N. Masters

International Developments

ACER is helping education researchers, policymakers and practitioners understand the issues related to the inception, design, implementation and reporting of large-scale education assessments, as Geoff Masters explains.

Challenges In Stem Learning In Australian Schools, Michael J. Timms, Kathryn Moyle, Paul R. Weldon, Pru Mitchell

Policy Insights

Australian STEM education seems caught in a whirlpool of problems that are contributing to one another. Student engagement and performance in STEM are declining, but we do not have the supply of qualified teachers we need to improve learning. The STEM curriculum is unbalanced and fragmented, leading to less interest among students. It is not possible to break out of the downward cycle from within the current system and it requires policy changes that address the issues raised in this report. This means developing well-considered, systemic and joined-up policies that address the following challenges: Improving student outcomes, building the STEM …

Challenges In Stem Learning In Australian Schools: Literature And Policy Review, Michael J. Timms, Kathryn Moyle, Paul R. Weldon, Pru Mitchell

Program monitoring and evaluation

This literature and policy review outlines the complex context related to STEM learning in Australian schools and focuses on student outcomes, the teacher workforce and the curriculum. This paper also sheds light on possible policy directions by examining lessons from other countries. STEM education is a broad enterprise that starts in early childhood education, continues through the years of schooling and extends into tertiary education supported by contributions from extracurricular and enrichment activities, science centres and museums. However, the focus in this document is on primary and secondary schooling. Australian STEM education seems caught in a whirlpool of problems that …

Principal Performance Improvement Tool, Geoff N. Masters Ao

School and system improvement

What is a highly effective school principal, and what do they do that makes them so effective? The Principal Performance Improvement Tool (PPIT) sets out to answer these questions. It provides a point of reference that principals can use to reflect on their current practices and to identify areas in which their work could be still more effective.

Development Of Reporting Scales For Reading And Mathematics: A Report Describing The Process For Building The Uis Reporting Scales, Ross Turner, Ray Adams, Ursula Schwantner, Dan Cloney, Claire Scoular, Prue Anderson, Alexander Daraganov, Jen Jackson, Sandra Knowles, Gayl O'Connor, Pam Munro-Smith, Stavroula Zoumboulis, Pauline Rogers

Monitoring Learning

As a technical partner of the UNESCO Institute for Statistics, ACER-GEM has created reporting scales for reading and maths, with the intention of enabling countries to examine and report the outcomes of their assessment activities using a common framework. This report gives the theoretical and contextual background to the scales, and describes the steps in the drafting process.

Learning Assessment: Foundation Level, Australian Council For Educational Research (Acer)

Education Analytics Service

The purpose of this module is to provide introductory information about learning assessments – what they are, their purpose, and how the results of learning assessments can influence education policy. It provides a foundation to engage in this topic and apply advice from staff with operational or expert levels of knowledge in education. On successful completion of this module you will gain the ability to apply practical knowledge of learning assessments in order to make valuable contributions to the field.

The Teaching And Learning International Survey 2018: Australian Non-Response Bias Analysis Report, Katherine Dix, Toby Carslake, Elizabeth O'Grady

OECD Teaching and Learning International Survey (TALIS)

This non-response bias analysis (NRBA) report was produced due to lower than expected response rates for Australian primary and secondary schools and teachers to the 2018 Teaching and Learning International Survey (TALIS) surveys. Analysis demonstrates that Australia’s International Standard Classification of Education (ISCED) 1 (primary) and 2 (secondary) respondents are representative of the broader school and teacher populations. At the school-level, there was no statistically significant bias across stratification variables between the ISCED 1 and 2 participating schools and original selected samples.

Protocol For A Systematic Review: Interventions For Anxiety In School-Aged Children With Autism Spectrum Disorder (Asd): A Mixed Methods Systematic Review, Petra Lietz, Julie Kos, Katherine Dix, Jenny Trevitt, Mirko Uljarevic, Elizabeth O'Grady

Student learning processes

This review aims to synthesise evidence about interventions to reduce anxiety symptoms in school-aged children with autism spectrum disorder (ASD). While clinical studies will not be excluded per se, this review seeks to move beyond interventions that are relevant only for clinical practice and care in clinical settings and prioritise studies that draw out implications for school-aged children that will help their functioning in real-world settings such as school and the home. To achieve this aim, the review will employ a mixed-methods systematic review which can accommodate the anticipated diverse types of available studies. These studies are likely to use …

The Art Of Item Writing: Cross-Curricular Testing At Acer 1964-2014, Doug Mccurry, John Harding

ACER Research Monographs

This monograph is about the development of a distinctive style of cross-curricular testing that was developed at the Australian Council for Educational Research in the 1960s and 1970s, and is still in use in some testing programs presently. The impetus for this kind of test development was the decision of the Menzies government to award 10,000 scholarships each year for students to study at Years 11 and 12 through a test called The Commonwealth Secondary Scholarship Examination (CSSE). The testing program ran for 10 years, during which around one million candidates sat the test. This monograph attempts to demonstrate the …

Lifting Achievement Levels And Improving The Return On Australia’S Investment In Schooling : Submission To The Review To Achieve Educational Excellence In Australian Schools (Chair: Mr David Gonski), Australian Council For Educational Research (Acer)

Program monitoring and evaluation

Many students in our schools are not learning as well as they could because they are not being given learning opportunities at an appropriate level of challenge. Instead, students are grouped by year level (age) and teachers deliver curricula assumed to be appropriate for all students in the same year of school. However, the most advanced ten per cent of students in any year of school are five to six years ahead of the least advanced ten per cent. For less advanced students, the year-level curriculum is often too far ahead. Many are judged to be underperforming year after year, …

A Study Of Work Practices In Tasmanian Government Schools: Final Report To The Australian Education Union – Tasmanian Branch, Sheldon Rothman, Lawrence C. Ingvarson, Paul R. Weldon, Ali Radloff, Darren Matthews

Teacher workforce and careers

The Australian Council for Educational Research (ACER) conducted an online survey of members on behalf of the Tasmanian Branch of the Australian Education Union (AEU). The survey, which was open to teachers, school leaders (principals and assistant principals) and education support staff working in Tasmanian government schools and offices, was available to the majority of members of the Union in August 2017, and remained open for four weeks during Term 3. The survey was based on one conducted for the Victorian branch of the AEU in 2016. The survey of the work of union members in Tasmanian government schools focussed …

Review Of The Postgraduate Research Experience Questionnaire (Preq): Final Report, Ali Radloff, Darren Matthews, Yan Bibby, Daniel Edwards

Higher education research

A review of the Postgraduate Research Experience Questionnaire (PREQ) was conducted by the Australian Council for Educational Research (ACER) on behalf of the Commonwealth Department of Education and Training. The PREQ was developed in 1999 to collect information on core aspects of the HDR experience, and is currently administered as part of the Graduate Outcomes Survey (GOS) which is conducted with recent graduates from Australian higher education institutions. The PREQ currently provides information to government, universities and other stakeholders that help inform improvements to the quality of HDR training. This project was conducted in two phases. Phase 1 of the …

The Case For Urgency: Advocating For Indigenous Voice In Education, Kevin P. Gillan, Suzanne Mellor, Jacynta Krakouer

Australian Education Review

In 2004 the Australian Council for Educational Research (ACER) published an Australian Education Review (AER) on Indigenous Education: The Case for Change: A review of contemporary research on Indigenous education outcomes, AER 47 (Mellor & Corrigan, 2004). In the 13 years since its publication, the state of Indigenous education outcomes has remained substantially unaltered. All the social indicators demonstrate that Australia’s First Nations people continue to be the most socio-economically disadvantaged population cohort in Australian society. This is after decades of continued policy efforts by successive Commonwealth, state and territory governments to ameliorate Indigenous education disadvantage. We still struggle with …

Assessment Online: Informing Teaching And Learning, Geoff N. Masters Ao

Teacher columnist – Geoff Masters

Online assessments are capable of providing significantly improved feedback to teaching and learning. Experience in schools is demonstrating the potential of online assessment – provided the foundations are right.

Acer 2015-2016 Annual Report, Australian Council For Educational Research (Acer)

ACER Annual Reports

No abstract provided.

Promoting Long-Term Learning Progress, Geoff N. Masters Ao

Teacher columnist – Geoff Masters

How well do we help students recognise and reflect on the long-term progress they make at school? Could progress in school mathematics learning be more like progress in music learning? Professor Geoff Masters AO discusses.

Timss 2015 Australian Year 4 Data [Sas & Spss], Sue Thomson, Nicole Wernert, Elizabeth O'Grady, Sima Rodrigues

TIMSS 2015

This dataset is available for download as a zipped file

SAS & SPSS

This is a data source for the report TIMSS 2015: Reporting Australia’s results.

Timss 2015 Australian Year 8 Data [Sas & Spss], Sue Thomson, Nicole Wernert, Elizabeth O'Grady, Sima Rodrigues

TIMSS 2015

Dataset is available for download as zipped file.

SAS and SPSS

This is a data source for the report TIMSS 2015: Reporting Australia’s results.

Evaluation Of The In2science Peer Mentoring Program: Final Report, Julie Kos, Jacynta Krakouer, Sheldon Rothman

Program monitoring and evaluation

Large-scale studies of 15-year-old school students show associations between students’ attitudes toward science learning and their levels of achievement (Ainley, Kos, & Nicholas, 2008). One model for improving students’ attitudes towards science and mathematics learning has been the provision of peer mentoring. The In2science program uses a peer mentoring approach to engage secondary school students in science and mathematics study. Working with the classroom teacher, university students serve as mentors and help students with their learning and build relationships in a small group or a whole class. Mentors talk to students about studying science (or another STEM area) at university …

Assessment And Feedback In Higher Education: A Review Of Literature For The Higher Education Academy, Brad Jackel, Jacob Pearce, Ali Radloff, Daniel Edwards

Higher education research

This literature review has been undertaken for the Higher Education Academy (HEA). It explores recent scholarly contributions in the area of assessment and feedback in higher education (HE). The report is structured as follows. The introduction provides some background and a context for the approach taken to developing this review and the ‘lens’ through which the review was undertaken. The review then comprises three broad sections: ‘The fundamentals’ – a section that explores the significant principles underpinning best practice in assessment. ‘Practice and innovations’ – an exploration of recent literature that demonstrates the kinds of assessment practice currently being undertaken …

National Assessment Program: Sample Assessment: Civics And Citizenship Report: Years 6 And 10: 2016, Julian Fraillon, Eveline Gebhardt, Judy Nixon, Louise Ockwell, Tim Friedman, Michelle Robins, Mark Mcandrew

Civics and Citizenship Assessment

Under the National Assessment Program, the Civics and Citizenship sample assessment is administered to a representative sample of Year 6 and Year 10 students every three years. It is conducted under the auspices of the Education Council. The National Assessment Program – Civics and Citizenship assesses students’ skills, knowledge and understandings of Australia’s system of government, civic institutions and the values which underpin Australia’s democracy. It also provides an indication of student attitudes and their engagement in civic-related activities at school and in the community. This report presents the findings of the fifth National Assessment Program – Civics and Citizenship …

Review Of The Piaac Numeracy Assessment Framework: Final Report, Dave Tout, Diana Coben, Vince Geiger, Lynda Ginsburg, Kees Hoogland, Terry Maguire, Sue Thomson, Ross Turner

Vocational, adult and professional education research

The Programme for the International Assessment of Adult Competencies (PIAAC) is an international assessment of the proficiency of adults (aged 16-65 years) in key information processing skills (reading, numeracy and Problem Solving in Technology-Rich Environments). The PIAAC Survey of Adult Skills has revealed that a considerable number of adults in OECD countries possess only limited literacy and numeracy skills. The OECD is currently reviewing the content of the frameworks and cognitive assessment instruments for the 2nd cycle of PIAAC ready for delivery in 2021-22. This report is the result of a review of the numeracy construct and assessment in PIAAC. …

Teachers Report Card: Teachers' Perceptions Of Education And Their Profession, Australian College Of Educators

Australian College of Educators - National

The inaugural ASG-ACE Teachers Report Card, a joint initiative between ASG and the Australian College of Educators (ACE) surveyed teachers on a range of issues including testing, curriculum, stress, wellbeing, support, engagement, satisfaction, technology and opportunity at schools. The report confirmed teachers are passionate about their job, with 96 per cent of respondents saying they find teaching rewarding, and 91 per cent of teachers either 'very satisfied' or 'satisfied' with their profession. Nine out of 10 teachers reported a sense of pride about their profession and speak positively about their jobs to their friends and family. This is not surprising …