Educational Assessment, Evaluation, and Research Commons^™

20-Year Slide In Maths And Science Learning, Geoff N. Masters Ao

Teacher columnist – Geoff Masters

With the release of results from the four-yearly Trends in International Mathematics and Science Study (TIMSS), Geoff Masters discusses what it will take to lift levels of mathematics and science learning in Australian schools.

Timss 2015 : A First Look At Australia's Results, Sue Thomson, Nicole Wernert, Elizabeth O'Grady, Sima Rodrigues

TIMSS 2015

The goal of TIMSS is to provide comparative information about educational achievement across countries to improve teaching and learning in mathematics and science. It is designed, broadly, to align with the mathematics and science curricula in the participating education systems and countries, and focuses on assessment at Year 4 and Year 8. It also provides comparative perspectives on trends in achievement in the context of different education systems, school organisational approaches and instructional practices; and to enable this, TIMSS collects a rich array of background data from students, schools and teachers, and also collects data about the education systems themselves. …

Reform And The Senior Secondary School, Geoff N. Masters Ao

Teacher columnist – Geoff Masters

Traditional ways of thinking about learning, assessment and educational qualifications are being challenged. Professor Geoff Masters AO discusses the three challenges that a senior secondary school can expect to face.

School Staff Workload Study: Final Report To The Australian Education Union – Victorian Branch, Paul R. Weldon, Lawrence Ingvarson

School and system improvement

The School Staff Workload Study was commissioned by the Victorian branch of the Australian Education Union (the Union) in March 2016. The study involved the design and delivery of an online survey by the Australian Council for Educational Research (ACER). The survey was a census of the Union membership and was open to the majority of members in Term 2, June 2016. The survey targeted three groups: teachers, school leaders (Principal class), and education support staff. The survey was intended to provide a detailed picture of the workload of the Union membership and, by extension, Victorian government school staff. Attention …

Mapping Progress – Using Data For Teaching And Learning, Geoff N. Masters Ao

Teacher columnist – Geoff Masters

It’s important to keep in mind that there are three central uses of data in school education. Professor Geoff Masters AO discusses.

Sharing The Stories Of Near Novices To Impact Mainstream Change, Bronwyn Stuckey

2009 - 2019 ACER Research Conferences

This case study research is designed to examine the ways in which teachers are bringing gameful practices into their classrooms as part of a STEM learning agenda. It is hypothesised that one of the best persons to inform or improve the practice of novices is a near novice; someone who was most recently themselves a novice. In many case study programs, we hold up exemplary practitioners as models, but these experts may be too far removed in their levels of expertise to impact the practice of true novices. Experts and evangelists might be useful in creating vision for change, but …

Promoting Girls’ And Boys’ Engagement And Participation In Senior Secondary Stem Fields And Occupational Aspirations, Helen Watt

2009 - 2019 ACER Research Conferences

Sufficient numbers of people with science and mathematics qualifications are needed for continuing growth in productivity and industry innovation. The Australian Industry Group (2015, p. 5) cautioned, ‘the pipeline of STEM skills to the workforce remains perilous’ because participation in sciences and advanced mathematics at school and university is in decline, participation is not comparable with other nations, and our students underperform in major international studies. Gender differences in enrolments and career plans continue to fuel the concern of researchers with interest in gender equity. Many have argued girls prematurely restrict their options by discontinuing particular STEM subjects in adolescence, …

Improving Quality Education And Children’S Learning Outcomes And Effective Practices In The Eastern And Southern Africa Region : Rwanda : Country Case Study, Ursula Schwantner

Monitoring Learning

This case study of Rwanda provides an understanding of the specific practices implemented to measure and improve the literacy and numeracy learning outcomes of Rwandan primary school children in the long term. An important development regarding the quality standards and assurance programme of education in Rwanda is the 2011 introduction of Learning Achievement in Rwandan Schools (LARS). This case study outlines the main purposes and components of LARS, the main findings regarding effective strategies and factors from the LARS baseline report and the capacity building component of LARS.

Improving Quality Education And Children’S Learning Outcomes And Effective Practices In The Eastern And Southern Africa Region : Zimbabwe : Country Case Study, Elizabeth Cassity

Monitoring Learning

This case study of Zimbabwe provides an understanding of the specific practices implemented to measure and improve the literacy and numeracy learning outcomes of Zimbabwean primary school children in the long term. It explores emerging trends from the 2014 Zimbabwe Early Learning Assessment (ZELA) in student learning outcomes and the provision of textbooks and teaching materials procured through the Education Development Fund (EDF). It also reviews the multiyear programme of an intensive capacity-building partnership with the Zimbabwe School Examinations Council (ZIMSEC) and the Australian Council for Educational Research (ACER). The capacity-building programme supports the longterm sustainability of ZELA through system …

A Collaborative Approach To National Assessment In Saudi Arabia

International Developments

A collaborative assessment project involving the Australian Council for Educational Research (ACER) and Saudi Arabia’s Public Education Evaluation Commission (PEEC) has involved the rapid development of national sample assessments of students in Grades 3 and 6 in Mathematics and Science.

Mapping Progress : Using Data For Teaching And Learning, Geoff N. Masters

International Developments

In a world of rapidly expanding data, it is important to keep in mind that there are three central uses of data in school education. Geoff Masters explains.

International Developments (No.6) 2016

International Developments

In this issue of International Developments we look at the purposeful collection of educational data through progressive achievement testing to enable teachers to establish where students are in their long-term learning, diagnose individual strengths and weaknesses, identify the best next steps for action, decide on appropriate evidence-based interventions, monitor the progress students make over time, and evaluate the effectiveness of their own teaching decisions and approaches. We also explore how a new primary years assessment is helping teachers, curriculum designers and policymakers to better measure the learning achievement of students in South East Asia; investigate the impact of a professional …

Translating Stem Education Research Into Practice, Christine Rosicka

Professional learning for teachers and school leaders

This translational research project from the Centre for Education Policy and Practice sought evidence-based practical applications, programs or interventions that can be implemented in the primary classroom to address STEM learning. A literature search for STEM education interventions in primary years was undertaken in order to identify integrated STEM programs that have had a proven impact on student outcomes. This paper outlines the scope and methodology of the review. It then considers the findings in terms of four key themes and translates them into short messages for teachers. The recent literature on STEM education was found to centre around four …

Acer 2014-2015 Annual Report, Australian Council For Educational Research (Acer)

ACER Annual Reports

The annual report of the Australian Council for Educational Research 2014-15 includes a spotlight on ACER's work in assessment reform and innovation, digital technologies, understanding the teaching workforce, Indigenous Australians, improving equity, education monitoring, and recognition of success. The report details commissioned research and staff publications.

Victorian Teacher Supply And Demand Report 2012 And 2013, Paul R. Weldon, Chandra Shah, Glenn Rowley

School and system improvement

This report provides forecasts of the supply and demand for teachers in Victoria from 2014 to 2020. The teaching workforce includes all teachers from K to 12. This is the tenth in the series of such reports, the first of which was released in 2001. Unlike previous reports, this one includes a section on Early Childhood and has more extensive analysis of the future demand for teachers in the state.

Five Challenges In Australian School Education, Geoff N. Masters Ao

Policy Insights

There is no shortage of challenges in school education. Some of the biggest challenges we face can appear frustratingly intractable. Despite reform efforts, regular government reviews and ongoing calls for change, progress in addressing our most significant challenges is often slow and solutions continue to elude us. In this paper Professor Geoff Masters discusses five significant challenges facing school education.

1. Equipping students for the 21st Century, including by increasing reading, mathematical and scientific literacy levels;
2. Reducing disparities between Australia's schools, particularly along socioeconomic lines, by ensuring that every student has access to an excellent school and excellent teaching;
3. Reducing the …

Investigating The Relationship Between Equity And Graduate Outcomes In Australia, Sarah Richardson, Dawn Bennett, Lynne Roberts

Higher education research

Australian higher education equity policy focusses mostly on access and participation with the implicit assumption that disadvantage will be ameliorated through educational achievement. Less is known as to whether patterns of disadvantage continue post-completion. In a context in which graduate employability is becoming an important yardstick against which to measure institutional effectiveness, this question is of fundamental importance to higher education equity practitioners and policymakers. This study employed Commonwealth graduate outcome data to investigate relationships between disadvantage and graduate outcomes in Australia, with disadvantage defined as a graduate belonging to one or more of the following groups – low SES, …

Is There Another Way To Think About Schooling?, Geoff N. Masters Ao

Teacher columnist – Geoff Masters

There is a well-established way of thinking about schooling. But is there another way? Professor Geoff Masters AO discusses.

Class 6 School Factors In Afghanistan 2013 : The Relationship Between School Factors And Student Outcomes From A Learning Assessment Of Mathematical, Reading And Writing Literacy, Tim Friedman, Sally Robertson, Stephanie Templeton, Maurice Walker

Monitoring Trends in Educational Growth (MTEG)

In 2012, the Ministry of Education, Afghanistan, engaged the Australian Council for Educational Research (ACER) as a partner to support the development of a national learning assessment program in Afghanistan. To achieve this goal, the Learning Assessment unit of the Ministry of Education and ACER have collaborated to design and implement the Monitoring Trends in Educational Growth (MTEG) program in Afghanistan. MTEG is designed as a long-term monitoring program with one focus on trends in achievement outcomes in single class levels over time, and another focus on the growth of achievement in cohorts throughout the school cycle, from Class 3 …

Gender And Sex Differences In Student Participation, Achievement And Engagement In Mathematics, Sarah Buckley

Student learning processes

Research in neuroscience, psychology and education explores gender differences in achievement and learning in many different ways with different implications for educators and policymakers. This paper presents some of the literature from these three research fields. Rather than being an exhaustive review, This paper provides a brief synthesis of relevant issues when considering gender in education. The paper has three main sections. The first section presents data on gender differences in mathematics participation, achievement and engagement in Australia. Note that for the purposes of this paper, the term ‘engagement’ will be used to describe students’ motivated involvement with mathematics, particularly …

Southeast Asia Primary Learning Metrics (Sea-Plm) : Global Citizenship Domain Assessment Framework, Rachel Parker, Julian Fraillon

Assessment and Reporting

This assessment framework forms part of the Southeast Asia Primary Learning Metrics (SEAPLM) assessment program and outlines an approach to assessing global citizenship. The purpose of this assessment framework is to articulate the basic structure of the global citizenship domain as part of SEA-PLM. It provides a description of the constructs to be measured. It also outlines the design and content of the measurement instruments and describes how measures generated by those instruments relate to the constructs. It combines theory and practice to describe “both the ‘what’ and the ‘how’” (Jago, 2009, p. 1) of the SEA-PLM assessment of global …

Southeast Asia Primary Learning Metrics: Audit Of Curricula, Australian Council For Educational Research (Acer)

Assessment and Reporting

An early step in developing an assessment framework for the Southeast Asia Primary Learning Metrics (SEA-PLM) was determining how to design and construct a single assessment program across all ASEAN member countries. This step needed to take account of the similarities and differences in the curriculum frameworks in each country for the four domains to be assessed through SEA-PLM: Mathematics, Reading, Writing and Global Citizenship. This account was achieved through an audit of the curriculum materials from 11 ASEAN countries, comprising those countries already participating in the SEA-PLM field trial, and others likely to join SEAPLM in the future. The …

The ‘Long Tail’ Of Underachievement, Geoff N. Masters Ao

Teacher columnist – Geoff Masters

One of the biggest challenges educators face is to find better ways to meet the learning needs of the many students who fall behind in our schools, fail to meet year-level expectations (often year after year) and, as a consequence, become increasingly disengaged, writes Professor Geoff Masters AO.

National Research On The Postgraduate Student Experience : Case Presentation: Volume 1: First Year Postgraduate Student Experience, Gary Hamlin, Shelley Kinash, Linda Crane, Amy Bannatyne, Madelaine-Marie Judd, Ashley Stark, Bill Eckersley, Helen Partridge, Ken Udas

Higher education research

This is volume one of a set of case studies that explore the postgraduate student experience. The theme of this case study is first year postgraduate student experience and is based on experiences derived from student engagement breakfasts, interviews, and focus groups with 366 people across the stakeholder groups of postgraduate students, educators, and university executives from 26 institutions. The case studies constitute part of the output from the project, Engaging postgraduate students and supporting higher education to enhance the 21st century student experience.

National Research On The Postgraduate Student Experience : Case Presentation : Volume 2 : Postgraduate Student Diversity, Bill Eckersley, Linda Crane, Shelley Kinash, Amy Bannatyne, Gary Hamlin, Helen Partridge, Sarah Richardson, Harry Rolf, Ken Udas

Higher education research

This is volume two of a set of three case studies that explore the postgraduate student experience. The theme of this case study is postgraduate student diversity and is based on experiences derived from student engagement breakfasts, interviews, and focus groups with 366 people across the stakeholder groups of postgraduate students, educators, and university executives from 26 institutions. The case studies constitute part of the output from the project, Engaging postgraduate students and supporting higher education to enhance the 21st century student experience.

Iea International Civic And Citizenship Education Study 2016 Assessment Framework, Wolfram Schulz, John Ainley, Julian Fraillon, Bruno Losito, Gabriella Agrusti

Civics and Citizenship Assessment

The purpose of the International Civic and Citizenship Education Study (ICCS) is to investigate the ways in which young people are prepared to undertake their roles as citizens in a range of countries in the second decade of the 21th century. ICCS 2016 is a continuation of this study, which was initiated in 2009. The development of a framework for ICCS 2016 needed to take account of recent developments and ongoing challenges. The international project team identified areas related to civics and citizenship education, which had either gained more attention in recent years or were regarded as relevant, but which …

A Global Measure Of Digital And Ict Literacy Skills, John Ainley, Wolfram Schulz, Julian Fraillon

ICT - Digital Literacy

Digital and ICT literacy is considered an important competence for full participation in a knowledge economy and an information society. Consequently, interest at national and international level has emerged to explore the best ways of measuring the extent to which, and how equitably, competence in this area is being achieved. This paper reviews the definitions of digital and ICT literacy that have been adopted in cross-national studies, investigates the approaches to the assessment of digital and ICT literacy that have been employed in those studies and articulates the criteria that should guide the development of a global measure of digital …

National School Improvement Tool, Geoff N. Masters

School and system improvement

Research is revealing the powerful impact that school leadership teams can have in improving the quality of teaching and learning. Effective leaders create cultures of high expectations, provide clarity about what teachers are to teach and students are to learn, establish strong professional learning communities and lead ongoing efforts to improve teaching practices. The National School Improvement Tool brings together findings from international research into the practices of highly effective schools and school leaders. The Tool assists schools to review and reflect on their efforts to improve the quality of classroom teaching and learning. It supports school-wide conversations – including …

National Learning And Teaching Resource Audit And Classification Final Report, Philip Hider, Barney Dalgarno, Sue Bennett, Ying-Hsang Liu, Carole Gerts, Carla Daws, Barbara Spiller, Pru Mitchell, Robert Parkes, Raylee Macaulay

Information Management

The Australian Office for Learning and Teaching's (OLT) research repository is used to disseminate the results of higher education research. This is the final report of a project that investigated how the resources in the research repository should be described and indexed so that they could be accessed more effectively. The project team ascertained which attributes of the resources needed to be described and how they should be described, developed a metadata schema, selected and/or created appropriate indexing vocabularies and reindexed the resources.

A 21st Century Curriculum, Geoff N. Masters Ao

Teacher columnist – Geoff Masters

One of the biggest challenges we face in school education is to identify and develop the knowledge, skills and attributes required for life and work in the 21st Century, writes Professor Geoff Masters AO.