Educational Assessment, Evaluation, and Research Commons^™

Buk Bilong Pikinini Literacy Program Evaluation 2018: Evaluation Report, Dan Cloney, Prue Anderson

Dr Dan Cloney

Buk bilong Pikinini (BbP) provides access to early childhood education and care (ECEC) programs with a specific focus on English language literacy for children from vulnerable communities in Papua New Guinea. This is highly relevant, given the fact that there is likely an over-representation of illiteracy in disadvantaged households and few opportunities for children within those households to be ready for a school system with English as the language of instruction. Established in 2007, BbP has been in operation for more than 10 years and has opened 17 library sites in that time. This evaluation provides evidence about the likely …

Effective Child-Focused Education And Nurturing Care Interventions, Jen Jackson, Syeda Kashfee Ahmed, Toby Carslake, Petra Lietz

Monitoring Learning

Child-focused education and nurturing care interventions provide learning support directly to the child. In line with the International Standard Classification of Education (ISCED Level 0), the support is typically provided by either centre- or home-based Early Childhood Education and Care (ECEC) services outside the child’s family and includes an educative and caring component with an active child development element. The 35 child-focused interventions in this review (of a total of 109 studies; see further details under background) occurred in 29 countries in five regions – the widest geographical spread of all intervention types under consideration. The most frequently represented countries …

Income Supplementation Interventions In Economically Developing Countries, Jen Jackson, Syeda Kashfee Ahmed, Toby Carslake, Petra Lietz

Monitoring Learning

Income supplementation interventions provide cash transfers directly to the parents/families of young children, with the objective of improving learning and other outcomes. Interventions of this type directly address poverty as the origin of many of the challenges to children’s learning in economically developing contexts. Such programs seek to affect positively child wellbeing and readiness to learn as well as the home learning environments. These effects can be achieved by using the additional income, for example, to support centre-based childcare or school attendance, to buy more nutritious food or to enable parents to spend more time with their children. The eight …

Pacific Islands Literacy & Numeracy Assessment 2018 Regional Report, Pacific Community Educational Quality And Assessment Programme

Assessment and Reporting

The Pacific Islands Literacy and Numeracy Assessment (PILNA) was developed by SPC’s Educational Quality & Assessment Programme (EQAP) to provide a snapshot of how Pacific youth are faring in the skills essential to progress through school and life - reading, writing, numbers, operations, measurements and data. The 2018 assessment is the third to be conducted since 2012, and covers Year 4 and Year 6 students from across 15 Pacific Island countries: Cook Islands, Federated States of Micronesia, Fiji, Kiribati, Marshall Islands, Nauru, Niue, Palau, Papua New Guinea, Samoa, Solomon Islands, Tokelau, Tonga, Tuvalu and Vanuatu. Findings include growth in both …

Integrating The Findings From The National Assessment Of Student Achievement Into The Policy Process: An Experience From Nepal, Lekha Nath Poudel, Gopal Prasad Bhattarai

Assessment and Reporting

This paper presents the experiences from Nepal on how the findings from the National Assessment of Student Achievement (NASA) have been integrated into policy processes. The purpose of this brief paper is twofold: to give an overview of the process of the National Assessment of Student Achievement, and to describe how the results were disseminated to different stakeholders to incorporate the findings into the design of policy processes. In doing so, the case study highlights how the assessment findings have been used to design and implement policies and programs in education.

From Access To Quality: Improving Learning Outcomes In South Asia, Amit Kaushik

International Developments

ACER India is working with partners across South Asia to ensure inclusive and quality education for all. Amit Kaushik reports on progress.

Learning Assessment: Practitioner Level, Australian Council For Educational Research (Acer)

Education Analytics Service

This Practitioner level module is designed to ensure that all staff members who engage with and lead policy dialogue with international and domestic partners are informed about the benefits and risks of participating in learning assessments and the key design and implementation issues. It is recommended that staff complete the Learning Assessment: Foundation level module as background information to this Practitioner level module. Topics covered in this module include the development of learning assessments; the benefits and risks of participating in international or regional assessments; the key design and implementation issues of national assessments; measuring and reporting results; costs; assessment …

Learning Assessment: Foundation Level, Australian Council For Educational Research (Acer)

Education Analytics Service

The purpose of this module is to provide introductory information about learning assessments – what they are, their purpose, and how the results of learning assessments can influence education policy. It provides a foundation to engage in this topic and apply advice from staff with operational or expert levels of knowledge in education. On successful completion of this module you will gain the ability to apply practical knowledge of learning assessments in order to make valuable contributions to the field.

Keeping The Learning Going: Using Mobile Technology To Enhance Learning Transfer, Corinne Brion

Educational Leadership Faculty Publications

Every year billions of dollars are spent on development aid and training around the world. Little attention is paid, however, to the sustainability of the various interventions. Some studies suggest that technology usage can serve as an effective post-learning intervention to enhance the transfer of learning. Currently, there is a limited body of research examining how best to follow up after an educational professional development program in Africa. This qualitative exploratory study sought to address the gap in education development policy by examining three schools in Ghana, West Africa. This study helps increase our understanding of how technology can promote …

Teacher Development Multi-Year Studies: Conceptual Framework, Hilary Hollingsworth, Elizabeth Cassity, Debbie Wong, Jacqueline Cheng

Teacher education

The purpose of this conceptual framework for DFAT’s teacher development multi-year study series is to improve the following elements across the series: clarity on the purpose of the series; consistency in terminology and methodology; connections to give the ability to draw common conclusions and explain differences; communication to create a shared understanding of the series and each stakeholder’s role and responsibility, and to use internal and external means to engage strategically and disseminate findings. To date, Timor-Leste, Vanuatu and Laos have committed to undertake multi-year studies of their teacher development investments.

Investing In Teachers, Adeola Capel, Hilary Hollingsworth, Elizabeth Kleinhenz, Alison Lonsdale, Yung Nietschke, Rachel Parker, Kate Reid, Jeaniene Spink, Mollie Tobin, Mary Fearnley-Sander, Jacinta Overs

Dr Kate Reid

This evaluation compares evidence from the literature with Australia’s experience in supporting teacher development in a range of developing countries. It uses case studies to good effect in explaining choices made, the extent to which expectations were or were not met, and the lessons for future Australian assistance for teacher development. The evaluation found mixed results. In cooperation with governments and other donors, Australia has made positive contributions, such as improving teacher frameworks and curriculums, and training teachers through a range of interventions. However, there is room to improve—for example, in enhancing policy, strengthening analysis and negotiating new investments—so teacher …

Investing In Teachers, Adeola Capel, Hilary Hollingsworth, Elizabeth Kleinhenz, Alison Lonsdale, Yung Nietschke, Rachel Parker, Kate Reid, Jeaniene Spink, Mollie Tobin, Mary Fearnley-Sander, Jacinta Overs

Dr Hilary Hollingsworth

This evaluation compares evidence from the literature with Australia’s experience in supporting teacher development in a range of developing countries. It uses case studies to good effect in explaining choices made, the extent to which expectations were or were not met, and the lessons for future Australian assistance for teacher development. The evaluation found mixed results. In cooperation with governments and other donors, Australia has made positive contributions, such as improving teacher frameworks and curriculums, and training teachers through a range of interventions. However, there is room to improve—for example, in enhancing policy, strengthening analysis and negotiating new investments—so teacher …

Monitoring Trends In Educational Growth: Assessment Framework For Afghanistan, Acer Centre For Global Education Monitoring (Acer-Gem)

Monitoring Trends in Educational Growth (MTEG)

The Monitoring Trends in Educational Growth (MTEG) program aims to achieve the breadth and rigour of large-scale international surveys while also addressing the unique needs and context of Afghanistan. The MTEG program will provide an ongoing measure of students’ educational progress at key stages of learning: middle primary school (Class 3), towards the end of primary school (Class 6), and towards the end of compulsory secondary schooling (Class 9). This MTEG assessment framework provides a statement and discussion about what the assessment intends to measure and lays out the principles upon which it has been built. It outlines an approach …

Pisa For Development Technical Strand A: Enhancement Of Pisa Cognitive Instruments, Ray J. Adams, John Cresswell

OECD Programme for International Student Assessment (PISA)

The OECD is planning to enhance existing PISA assessment instruments in reading, mathematics and science so that they will be more suitable to the context of developing countries. The main purpose of this paper is to identify the main technical issues associated with this aim. The paper reports detailed analysis of the existing PISA item pool and its suitability for countries which have students of average limited capacity. The paper cautions that the fit of developing country data to the PISA model is not good and that modifications to address some of the deviations should be explored. The use of …

Understanding Pisa And Its Impact On Policy Initiative: A Review Of The Evidence, Petra Lietz, Mollie Tobin, Dita Nugroho

Dr Petra Lietz

Supporting Teacher Development : Literature Review, Kate Reid, Elizabeth Kleinhenz

Dr Elizabeth Kleinhenz (retired)

This literature review identifies and evaluates evidence on the effectiveness of approaches to improving teacher quality in developing countries. It examines four categories of assistance for improving teacher quality: teacher development policies, pre-service education and training, in-service professional development, and school-based support. As far as possible, the review highlights practices that demonstrate effectiveness.

Supporting Teacher Development : Literature Review, Kate Reid, Elizabeth Kleinhenz

Dr Kate Reid

This literature review identifies and evaluates evidence on the effectiveness of approaches to improving teacher quality in developing countries. It examines four categories of assistance for improving teacher quality: teacher development policies, pre-service education and training, in-service professional development, and school-based support. As far as possible, the review highlights practices that demonstrate effectiveness.

Class 6 Proficiency In Afghanistan 2013: Outcomes Of A Learning Assessment Of Mathematical, Reading And Writing Literacy, Tom Lumley, Juliette Mendelovits, Rachel Stanyon, Ross Turner, Maurice Walker

Maurice Walker

In 2012, the Ministry of Education, Afghanistan, engaged the Australian Council for Educational Research (ACER) as a partner to support the development of a national learning assessment program in Afghanistan. To achieve this goal, the Learning Assessment unit of the Ministry of Education and ACER have collaborated to design and implement the Monitoring Trends in Educational Growth (MTEG) program in Afghanistan. MTEG is designed as a long-term monitoring program with one focus on trends in achievement outcomes in single class levels over time, and another focus on the growth of achievement in cohorts throughout the school cycle, from Class 3 …

Research Into The Financing Of Technical And Vocational Education And Training (Tvet) In The Pacific : Papua New Guinea : Country Report, Robert Horne, Ken Ngangan, Simaima Tavil-Melachon, Justin Brown

Dr Justin Brown

This report provides a detailed analysis of the financing of Technical and Vocational Education and Training (TVET) in Papua New Guinea (PNG). The report is part of the study Research into the Financing of TVET in the Pacific initiated through Australia’s aid program in 2012. As well as PNG, the overall study involves six other Pacific countries; Fiji; Kiribati; Samoa; Solomon Islands; Tonga; and Vanuatu. The overall study team developed a general framework and set of data collection instruments to guide the work. Individual country teams adapted the general framework and instruments to meet national circumstances. PNG is by far …

Evaluation Of Ict In Education In Papua Province (Acdp-045): Final Report, Susanne Owen, John Hunt, Eda Simanjuntak, Eko Sediyono, Prapto Yuwono, Sri Yulianto, Wigati Yektinintys Modouw

ACER Indonesia

The Evaluation of Information and Communication Technologies (ICT) in Education in Papua Province study is a large-scale research project for the Republic of Indonesia’s Education Sector Analytical and Capacity Development Partnership (ACDP). The key objectives of the Study are: to measure the effectiveness of the TV-Edukasi (Education) (TV-E) and other ICT programs in the Province and to determine their impact on the learning outcomes of school children and adult learners; and to make recommendations to plan for further ICT in education initiatives.

Assessments To Support Quality Teaching And Learning, Charlotte Waters

International Developments

The focus of post-2015 development goals on educational quality for all is directing attention to assessments that support quality teaching and learning, as Charlotte Waters explains.

Class 6 Proficiency In Afghanistan 2013: Outcomes Of A Learning Assessment Of Mathematical, Reading And Writing Literacy, Tom Lumley, Juliette Mendelovits, Rachel Stanyon, Ross Turner, Maurice Walker

Dr Tom Lumley

In 2012, the Ministry of Education, Afghanistan, engaged the Australian Council for Educational Research (ACER) as a partner to support the development of a national learning assessment program in Afghanistan. To achieve this goal, the Learning Assessment unit of the Ministry of Education and ACER have collaborated to design and implement the Monitoring Trends in Educational Growth (MTEG) program in Afghanistan. MTEG is designed as a long-term monitoring program with one focus on trends in achievement outcomes in single class levels over time, and another focus on the growth of achievement in cohorts throughout the school cycle, from Class 3 …

Class 6 Proficiency In Afghanistan 2013: Outcomes Of A Learning Assessment Of Mathematical, Reading And Writing Literacy, Tom Lumley, Juliette Mendelovits, Rachel Stanyon, Ross Turner, Maurice Walker

Juliette Mendelovits

In 2012, the Ministry of Education, Afghanistan, engaged the Australian Council for Educational Research (ACER) as a partner to support the development of a national learning assessment program in Afghanistan. To achieve this goal, the Learning Assessment unit of the Ministry of Education and ACER have collaborated to design and implement the Monitoring Trends in Educational Growth (MTEG) program in Afghanistan. MTEG is designed as a long-term monitoring program with one focus on trends in achievement outcomes in single class levels over time, and another focus on the growth of achievement in cohorts throughout the school cycle, from Class 3 …

Class 6 Proficiency In Afghanistan 2013: Outcomes Of A Learning Assessment Of Mathematical, Reading And Writing Literacy, Tom Lumley, Juliette Mendelovits, Rachel Stanyon, Ross Turner, Maurice Walker

Ross Turner

In 2012, the Ministry of Education, Afghanistan, engaged the Australian Council for Educational Research (ACER) as a partner to support the development of a national learning assessment program in Afghanistan. To achieve this goal, the Learning Assessment unit of the Ministry of Education and ACER have collaborated to design and implement the Monitoring Trends in Educational Growth (MTEG) program in Afghanistan. MTEG is designed as a long-term monitoring program with one focus on trends in achievement outcomes in single class levels over time, and another focus on the growth of achievement in cohorts throughout the school cycle, from Class 3 …

Supporting Teacher Development : Literature Review, Kate Reid, Elizabeth Kleinhenz

Teacher education

This literature review identifies and evaluates evidence on the effectiveness of approaches to improving teacher quality in developing countries. It examines four categories of assistance for improving teacher quality: teacher development policies, pre-service education and training, in-service professional development, and school-based support. As far as possible, the review highlights practices that demonstrate effectiveness.

Monitoring Trends In Educational Growth Class 6 Student Questionnaire Prepared In 2013 For The Ministry Of Education, Afghanistan: Source Version - English, Australian Council For Educational Research (Acer)

Monitoring Trends in Educational Growth (MTEG)

This student context questionnaire for year 6 students in Afghanistan, is a product of ACER’s Monitoring Trends in Educational Growth (MTEG) service. The questionnaire covers questions about the student, his/her family, schooling and interests.

Monitoring Trends In Educational Growth Class 6 Student Questionnaire Prepared In 2013 For The Ministry Of Education, Afghanistan : Translated Version - Pashto, Australian Council For Educational Research (Acer)

Monitoring Trends in Educational Growth (MTEG)

This student context questionnaire for year 6 students in Afghanistan, is a product of ACER’s Monitoring Trends in Educational Growth (MTEG) service. The questionnaire covers questions about the student, his/her family, schooling and interests. The questionnaire has been translated into the Afghani language of Pashto.

Monitoring Trends In Educational Growth Class 6 School Principal Questionnaire Prepared In 2013 For The Ministry Of Education, Afghanistan : Translated Version - Pashto, Australian Council For Educational Research (Acer)

Monitoring Trends in Educational Growth (MTEG)

This school context questionnaire for year 6 principals in Afghanistan, is produced by ACER’s Monitoring Trends in Educational Growth (MTEG) service. The questionnaire covers questions about the principal and his/her school. It has been translated into the Afghani language Pashto.

Monitoring Trends In Educational Growth In Afghanistan : Class 6 2013, Australian Council For Educational Research (Acer)

Monitoring Trends in Educational Growth (MTEG)

This document is a brief summary of the reading, writing and mathematical proficiency of year 6 students from Afghanistan who took part in the Monitoring Trends in Educational Growth (MTEG) study.

Monitoring Trends In Educational Growth Class 6 Student Questionnaire Prepared In 2013 For The Ministry Of Education, Afghanistan : Translated Version - Dari, Australian Council For Educational Research (Acer)

Monitoring Trends in Educational Growth (MTEG)

This student context questionnaire for year 6 students in Afghanistan, is a product of ACER’s Monitoring Trends in Educational Growth (MTEG) service. The questionnaire covers questions about the student, his/her family, schooling and interests. It has been translated into the Afghani language of Dari.