Educational Assessment, Evaluation, and Research Commons^™

Learning From Mistakes, Geoff N. Masters Ao

Teacher columnist – Geoff Masters

A willingness to acknowledge and learn from failure is essential for all progress, writes Professor Geoff Masters AO.

Five Challenges In Australian School Education, Geoff N. Masters Ao

Policy Insights

There is no shortage of challenges in school education. Some of the biggest challenges we face can appear frustratingly intractable. Despite reform efforts, regular government reviews and ongoing calls for change, progress in addressing our most significant challenges is often slow and solutions continue to elude us. In this paper Professor Geoff Masters discusses five significant challenges facing school education.

1. Equipping students for the 21st Century, including by increasing reading, mathematical and scientific literacy levels;
2. Reducing disparities between Australia's schools, particularly along socioeconomic lines, by ensuring that every student has access to an excellent school and excellent teaching;
3. Reducing the …

Investigating The Relationship Between Equity And Graduate Outcomes In Australia, Sarah Richardson, Dawn Bennett, Lynne Roberts

Higher education research

Australian higher education equity policy focusses mostly on access and participation with the implicit assumption that disadvantage will be ameliorated through educational achievement. Less is known as to whether patterns of disadvantage continue post-completion. In a context in which graduate employability is becoming an important yardstick against which to measure institutional effectiveness, this question is of fundamental importance to higher education equity practitioners and policymakers. This study employed Commonwealth graduate outcome data to investigate relationships between disadvantage and graduate outcomes in Australia, with disadvantage defined as a graduate belonging to one or more of the following groups – low SES, …

Higher Education Standards Panel Consultation : Transparency Of Higher Education Admissions Processes: Response From The Australian Council For Educational Research, Daniel Edwards, Brad Jackel, Australian Council For Educational Research (Acer)

Higher education research

This document has been prepared by the Australian Council for Educational Research (ACER) in response to the Higher Education Standards Panel’s Consultation on the Transparency of Higher Education Admissions Processes. In developing the document, ACER has drawn on previous experience working in admissions research and admissions testing, and on discussions over time with universities in Australia as a result of this work relating to the issues of relevance to this consultation. This document explores four key areas identified by ACER as critical to improving the admissions processes of higher education providers in Australia. In developing this document, we have approached …

Mapping Researcher Mobility: Measuring Research Collaboration Among Apec Economies, Ali Radloff

Higher education research

Researcher mobility is an important form of cross-border education (CBE). It has the potential to generate significant benefits for economies as expert scholars and scientists come together to solve some of the most pressing challenges in the contemporary world. Among members of the Asia-Pacific Economic Community (APEC) researcher mobility can strengthen ties between economies and enable the minimisation of barriers to economic growth and sustainability. There are not currently any comparable or rigorous data available on researcher mobility among APEC economies. Proxy measures are needed to gain a sense of the extent to which researchers in APEC economies are collaborating …

Is There Another Way To Think About Schooling?, Geoff N. Masters Ao

Teacher columnist – Geoff Masters

There is a well-established way of thinking about schooling. But is there another way? Professor Geoff Masters AO discusses.

Infographic: Teachers Working In Australian School Libraries, Jo Earp

Teacher infographics

What is the percentage of Australian teachers working in school libraries? Are those teachers mainly female or male? Find out in this infographic.

Infographic: Time Spent On Homework, Danielle Meloney

Teacher infographics

How much time do 15-year-olds spend per week on homework and other tasks set by teachers after school? An OECD report explored.

Reviewing Measurement Invariance Of Questionnaire Constructs In Cross-National Research: Examples From Iccs 2016, Wolfram Schulz

Civics and Citizenship Assessment

nternational studies face the challenge of obtaining comparable measures across diverse national contexts, which are characterized by differences with regard to many factors such as language, culture, and educational contexts. In addition, in many countries there may also be differences across sub-national contexts (for example across regions or language groups). International studies in the field of education are increasingly incorporating ways of assessing the measurement invariance of the data obtained from tests or questionnaire used in these programs. In particular with regard to questionnaire items, there is a growing body of research indicating that questionnaire formats such as Likert-type rating …

Aboriginal Early Childhood Education: Why Attendance And True Engagement Are Equally Important, Jacynta Krakouer

Indigenous Education Research

The Australian government has increasingly recognised the importance of quality early childhood education (ECE) for Aboriginal and Torres Strait Islanders, as noted in a variety of policy documents such as the Council of Australian Governments (COAG) Closing the Gap targets of the Rudd government in 2008, the Aboriginal and Torres Strait Islander Education Action Plan 2010-2014, and the National Aboriginal and Torres Strait Islander Education Strategy 2015 (Tye, 2014; Dreise & Thomson, 2014; Education Council, 2015). However, the focus in Aboriginal ECE is still on improving access to, and attendance at ECE centres in Australia rather than highlighting the …

Class 6 School Factors In Afghanistan 2013 : The Relationship Between School Factors And Student Outcomes From A Learning Assessment Of Mathematical, Reading And Writing Literacy, Tim Friedman, Sally Robertson, Stephanie Templeton, Maurice Walker

Monitoring Trends in Educational Growth (MTEG)

In 2012, the Ministry of Education, Afghanistan, engaged the Australian Council for Educational Research (ACER) as a partner to support the development of a national learning assessment program in Afghanistan. To achieve this goal, the Learning Assessment unit of the Ministry of Education and ACER have collaborated to design and implement the Monitoring Trends in Educational Growth (MTEG) program in Afghanistan. MTEG is designed as a long-term monitoring program with one focus on trends in achievement outcomes in single class levels over time, and another focus on the growth of achievement in cohorts throughout the school cycle, from Class 3 …

Monitoring Trends In Educational Growth In Afghanistan : Class 6 School Factors 2013, Australian Council For Educational Research (Acer)

Monitoring Trends in Educational Growth (MTEG)

In 2012, the Ministry of Education, Afghanistan, engaged the Australian Council for Educational Research (ACER) as a partner to support the development of a national learning assessment program in Afghanistan. To achieve this goal, the Learning Assessment unit of the Ministry of Education and ACER have collaborated to design and implement the Monitoring Trends in Educational Growth (MTEG) program in Afghanistan. MTEG is designed as a long-term monitoring program with one focus on trends in achievement outcomes in single class levels over time, and another focus on the growth of achievement in cohorts throughout the school cycle, from Class 3 …

Gender And Sex Differences In Student Participation, Achievement And Engagement In Mathematics, Sarah Buckley

Student learning processes

Research in neuroscience, psychology and education explores gender differences in achievement and learning in many different ways with different implications for educators and policymakers. This paper presents some of the literature from these three research fields. Rather than being an exhaustive review, This paper provides a brief synthesis of relevant issues when considering gender in education. The paper has three main sections. The first section presents data on gender differences in mathematics participation, achievement and engagement in Australia. Note that for the purposes of this paper, the term ‘engagement’ will be used to describe students’ motivated involvement with mathematics, particularly …

System-Level Assessment And Educational Policy, John Cresswell

Assessment GEMS

Education ministries throughout the world are integrating educational assessment into their education reform processes. Education reform is not a straight-line activity, and assessment can both inform the discussion on policy reform and give an indication of the effectiveness of policies that have been implemented. Three different types of assessment are used in the educational process: classroom assessment, examinations and system-level assessment. Each type has a different purpose. While the focus of both classroom assessments and examinations is to measure the learning outcomes of individuals, for system-level assessment the focus is to describe the characteristics of the population as a whole …

Southeast Asia Primary Learning Metrics (Sea-Plm) : Global Citizenship Domain Assessment Framework, Rachel Parker, Julian Fraillon

Assessment and Reporting

This assessment framework forms part of the Southeast Asia Primary Learning Metrics (SEAPLM) assessment program and outlines an approach to assessing global citizenship. The purpose of this assessment framework is to articulate the basic structure of the global citizenship domain as part of SEA-PLM. It provides a description of the constructs to be measured. It also outlines the design and content of the measurement instruments and describes how measures generated by those instruments relate to the constructs. It combines theory and practice to describe “both the ‘what’ and the ‘how’” (Jago, 2009, p. 1) of the SEA-PLM assessment of global …

Infographic: Principals’ Experiences Of Offensive Behaviour, Danielle Meloney

Teacher infographics

A 2015 study looked at the percentage of Australian principals who have had negative experiences in the workplace. Here are some of the results.

Getting All Children Off To A Good Start, Geoff N. Masters Ao

Teacher columnist – Geoff Masters

One of the biggest challenges we face in improving quality and equity in our schools is to better address the learning needs of the many children who, on entry to school, are at risk of being locked into trajectories of long-term low achievement, writes Professor Geoff Masters AO.

Solomon Islands Standardised Tests Of Achievement (Sista). English And Mathematics. Year 4 And Year 6. Report 1 Main Study 2015, Australian Council For Educational Research (Acer)

Assessment and Reporting

The SISTA program is a key monitoring tool of the Solomon Islands Ministry of Education and Human Resource Development and has the capacity to serve multiple functions to a wide range of educational stakeholders. This report provides analysis of year 4 and year 6 Literacy and Numeracy of SISTA 2015. It is both a technical report for NEAD that includes descriptions of the processes followed in data analysis and reporting and the theoretical underpinnings of the analysis, a summary of the findings of the analysis and the implications for further analysis; and a report for the wider MEHRD staff that …

Southeast Asia Primary Learning Metrics: Audit Of Curricula, Australian Council For Educational Research (Acer)

Assessment and Reporting

An early step in developing an assessment framework for the Southeast Asia Primary Learning Metrics (SEA-PLM) was determining how to design and construct a single assessment program across all ASEAN member countries. This step needed to take account of the similarities and differences in the curriculum frameworks in each country for the four domains to be assessed through SEA-PLM: Mathematics, Reading, Writing and Global Citizenship. This account was achieved through an audit of the curriculum materials from 11 ASEAN countries, comprising those countries already participating in the SEA-PLM field trial, and others likely to join SEAPLM in the future. The …

Infographic: Popular Sports Amongst Youngsters, Jo Earp

Teacher infographics

Looking to set up a lunchtime or afterschool sports club this year? This infographic might offer some inspiration. Here are the three most popular sports Australian six-to 13-year-olds like to participate in.

The ‘Long Tail’ Of Underachievement, Geoff N. Masters Ao

Teacher columnist – Geoff Masters

One of the biggest challenges educators face is to find better ways to meet the learning needs of the many students who fall behind in our schools, fail to meet year-level expectations (often year after year) and, as a consequence, become increasingly disengaged, writes Professor Geoff Masters AO.

Are The Kids Alright? Young Australians In Their Middle Years : Final Summary Report Of The Australian Child Wellbeing Project, Gerry Redmond, Jennifer Skattebol, Peter Saunders, Petra Lietz, Gabriella Zizzo, Elizabeth O'Grady, Mollie Tobin, Vanessa Maurici, Jasmine Huynh, Anna Moffat, Melissa Wong, Bruce Bradbury, Kelly Roberts

Wellbeing

Compared with the early years and adolescence, young people in their middle years (ages 8-14 years) have received relatively little attention from policymakers other than in the space of academic achievement, where national curriculums have been developed, and a national testing regime is in place. Yet there is growing recognition that this is a critical time when young people experience rapid physical and mental development, in addition to facing a significant transition from primary to secondary school. The Australian Child Wellbeing Project (ACWP) asked young people about their lives and wellbeing during this crucial period. Wellbeing can be seen as …

Developing A Global Health Assessment Collaboration: Ancillary Report, Daniel Edwards, Jacob Pearce, David Wilkinson

Higher education research

This document reports on a project designed to develop an assessment collaboration between medical schools in both Australia and the United Kingdom. The project was funded by the Office for Learning and Teaching (OLT), utilising surplus funding from a broader assessment collaboration project – the Australian Medical Assessment Collaboration (OLT ID12-2482). The Global Health Assessment Collaboration (GHAC) involved five universities in Australia and the United Kingdom (UK). It developed an assessment framework and item specifications, undertook assessment item drafting workshops, built in a process of review and resulted in the development of a focused suite of assessment items. This report …

National Research On The Postgraduate Student Experience : Case Presentation: Volume 1: First Year Postgraduate Student Experience, Gary Hamlin, Shelley Kinash, Linda Crane, Amy Bannatyne, Madelaine-Marie Judd, Ashley Stark, Bill Eckersley, Helen Partridge, Ken Udas

Higher education research

This is volume one of a set of case studies that explore the postgraduate student experience. The theme of this case study is first year postgraduate student experience and is based on experiences derived from student engagement breakfasts, interviews, and focus groups with 366 people across the stakeholder groups of postgraduate students, educators, and university executives from 26 institutions. The case studies constitute part of the output from the project, Engaging postgraduate students and supporting higher education to enhance the 21st century student experience.

National Research On The Postgraduate Student Experience : Case Presentation : Volume 2 : Postgraduate Student Diversity, Bill Eckersley, Linda Crane, Shelley Kinash, Amy Bannatyne, Gary Hamlin, Helen Partridge, Sarah Richardson, Harry Rolf, Ken Udas

Higher education research

This is volume two of a set of three case studies that explore the postgraduate student experience. The theme of this case study is postgraduate student diversity and is based on experiences derived from student engagement breakfasts, interviews, and focus groups with 366 people across the stakeholder groups of postgraduate students, educators, and university executives from 26 institutions. The case studies constitute part of the output from the project, Engaging postgraduate students and supporting higher education to enhance the 21st century student experience.

Iea International Civic And Citizenship Education Study 2016 Assessment Framework, Wolfram Schulz, John Ainley, Julian Fraillon, Bruno Losito, Gabriella Agrusti

Civics and Citizenship Assessment

The purpose of the International Civic and Citizenship Education Study (ICCS) is to investigate the ways in which young people are prepared to undertake their roles as citizens in a range of countries in the second decade of the 21th century. ICCS 2016 is a continuation of this study, which was initiated in 2009. The development of a framework for ICCS 2016 needed to take account of recent developments and ongoing challenges. The international project team identified areas related to civics and citizenship education, which had either gained more attention in recent years or were regarded as relevant, but which …

Pisa 2015 : A First Look At Australia’S Results Data Tables [Excel] [Data Set], Sue Thomson, Lisa De Bortoli, Catherine Underwood

OECD Programme for International Student Assessment (PISA) Australia

The data tables for the report PISA 2015 : a first look at Australia's results (2016). This report provided a first look at the results from PISA 2015, and focused on the achievement results in scientific, reading and mathematical literacy.

Literature Review Relating To The Current Context And Discourse Surrounding Indigenous Early Childhood Education, School Readiness And Transition Programs To Primary School, Jacynta Krakouer

Indigenous Education Research

Since the educational experiences of Aboriginal Australians are often framed from a ‘deficit’ perspective, whereby the failures of Indigenous people to engage with the mainstream educational system are seen as the ‘problem’, an alternative approach to Indigenous early childhood education discourse is preferable. This alternative approach highlights the strengths that many Aboriginal children possess when commencing school, strengths that may result from Indigenous child-rearing practices. Consequently, this literature review utilises a strengths-based perspective for Aboriginal early childhood education and school readiness, noting that Aboriginal children are frequently expected to adapt to a foreign educational system whereby school expectations differ from …

National School Improvement Tool, Geoff N. Masters

School and system improvement

Research is revealing the powerful impact that school leadership teams can have in improving the quality of teaching and learning. Effective leaders create cultures of high expectations, provide clarity about what teachers are to teach and students are to learn, establish strong professional learning communities and lead ongoing efforts to improve teaching practices. The National School Improvement Tool brings together findings from international research into the practices of highly effective schools and school leaders. The Tool assists schools to review and reflect on their efforts to improve the quality of classroom teaching and learning. It supports school-wide conversations – including …

What The Staff In Australia’S Schools Surveys Tell Us About Teachers Working In School Libraries, Paul R. Weldon

School and system improvement

This report analyses the 2007, 2010 and 2013 Staff in Australia's Schools (SiAS) survey results to produce profiles of primary and secondary teachers who are working in a library role. It compares the findings about numbers of teachers working in a library role with the overall teacher cohort in terms of location, school sector and socio-economic status of schools. It also profiles teachers working in a library role in terms of their average age, gender, level of tertiary study and basis of work. It makes particular mention of early career teachers in libraries and teachers working out of field in …