Educational Assessment, Evaluation, and Research Commons^™

Development Of Educational Quality Mapping Instruments (Ip-Snp) In West Java, Rina Mutaqinah, Bambang Sumintono, Yanti Triatna

International Conference on Assessment and Learning (ICAL)

Decision-making must be based on valid data, as well as decision-making in the field of education. It is very important to have a valid instrument, therefore it is necessary to develop an educational quality mapping instrument that can measure the achievement of the quality of education. This instrument was developed based on educational quality standards, namely the competency quality of graduates, content, process, assessment, educators and education personnel, infrastructure, management, and financing. The purpose of this study was to obtain an instrument that has high validity. The educational quality mapping instrument (IP-SNP) uses a rating scale, collecting data through a …

Teacher Development Multi-Year Study Series. Report Highlights. Vanuatu: Interim Report 2, Elizabeth Cassity, Jennie Chainey, Jacqueline Cheng, Debbie Wong

Education Analytics Service

The Teacher Development Multi-Year Study for Vanuatu seeks to answer the question: To what extent does Australia’s aid investment produce improved teaching quality and improved student learning? The 3 specific questions are: 1. To what extent has the investment improved teaching quality in Vanuatu? 2. To what extent has the investment in teacher training and mentoring supported effective implementation of Vanuatu’s new curriculum? 3. To what extent have teacher training and support activities led to improved learning outcomes? The study adopts a mixed methods approach using qualitative case study data and quantitative student assessment data from the Vanuatu Standardised Test …

Research Snapshot: Unicef Philippines Early Childhood Education Kindergarten To Grade 4 Longitudinal Study, Rachel Parker, Jacqueline H. S. Cheng, Prue Anderson, Dan Cloney, Adeola Monty

Early Childhood Education

The Philippines Early Childhood Care and Development (ECCD) Longitudinal Study was a major research investment by UNICEF, the Philippines Department of Education, and the Australian Government. It was designed to investigate the impact of one of the most significant education reforms in Philippines history: the introduction of the Kindergarten year as part of the K-12 Basic Education System. It offers useful insights into the impact of Philippines Mother Tongue-Based Multilingual Education (MTB-MLE) and key language transition points for students from Kindergarten to Grade 4. This longitudinal study measured not only the impact of Kindergarten, but also the contribution that preschool …

Rethinking Measurement For Accountable Assessment, Mark Wilson

2021-2030 ACER Research Conferences

The underlying model for most formal educational measurement (e.g. standardised tests) is based on a very simple model: the student takes a test (possibly alongside other students). The complications of there being an instructional plan, actual instruction, interpretation of the outcome, and formulation of next steps, are all bypassed in considering how to model the process of measurement. There are some standard exceptions, of course: a pre-test/post-test context will involve two measurements, and attention to gain score, or similar. However, if we wish to design measurement to hold to Lehrer’s (2021) definition of ‘accountable assessment’ – as ‘actionable information for …

Accountable Assessment, Richard Lehrer

2021-2030 ACER Research Conferences

There is widespread agreement about the importance of accounting for the extent to which educational systems advance student learning. Yet, the forms and formats of accountable assessments often ill serve students and teachers; the summative judgements of student performance that are typically employed to indicate proficiencies on benchmarks of student learning commonly fail to capture student performance in ways that are specific and actionable for teachers. Timing is another key barrier to the utility of summative assessment. In the US, summative evaluations occur at the end of the school year and may serve future students, but do not help teachers …

The Southeast Asia Primary Learning Metrics Program, Australian Council For Educational Research

Assessment GEMS

The Southeast Asia Primary Learning Metrics Program (SEA-PLM) is a regional assessment of Grade 5 students in six Southeast Asian countries. SEA-PLM was initiated in 2012 by the Southeast Asian Ministers of Education Association (SEAMEO) and the United Nations Children’s Fund (UNICEF). The first main cycle of SEA-PLM was implemented in 2019, with future cycles intended. All member countries of SEAMEO can choose to participate in SEA-PLM. The first six participating countries were: Cambodia, Lao PDR, Malaysia, Myanmar, Philippines and Viet Nam. SEA-PLM measures curricula and cross-curricula knowledge, skills and understanding in the domains of mathematics, reading, writing and global …

Learning Through Play Experience Tool: Guidelines For General Use Of The Learning Through Play Experience Tool, Lisa Van Beeck

Monitoring Learning

The aim of the Learning through Play (LtP) Experience Tool is to see a play experience through the eyes of a child and use this to understand the texture of the child’s experience. The LtP Experience Tool is not designed to rate or evaluate the child. It is an observational tool used to collect data on a child’s play experience by empathising with a child and how they respond to the play experience. These guidelines provide an overview of the purpose of the LtP Experience Tool and how to use it to understand a child’s play experience. The guidelines are …

Pacific Islands Literacy And Numeracy Assessment, Australian Council For Educational Research

Assessment GEMS

The overall purpose of Pacific Islands Literacy and Numeracy Assessment (PILNA) is to support the improvement of education outcomes of students in the Pacific Island countries. It does this by generating cognitive and contextual data to monitor learning outcome, as well as facilitating ongoing collaborative efforts. PILNA measures the numeracy and literacy achievement of students at the end of Year 4 and Year 6. PILNA also supports participating countries to achieve Sustainable Development Goals. Specifically, SDG 4.1, which aims to have ‘all girls and boys complete free, equitable and quality primary and secondary education leading to relevant and effective learning …

The Impact Of The Ib Primary Years Programme (Pyp) On Student Wellbeing And Other Related Social-Emotional Learning Outcomes, Katherine Dix, Shani Sniedze

Wellbeing

This study investigated the impact of the International Baccalaureate (IB) Primary Years Programme (PYP) on student wellbeing and related outcomes. The PYP, an educational framework for children ages 3–12, offers a holistic education focusing on whole-child development through an inquiry-driven approach. It does so through multiple programmatic elements that include leadership and teacher professional development, to deliver an inclusive curriculum in classrooms that builds transdisciplinary skills, culminating in the development of students’ international-mindedness, critical thinking and attributes of the IB learner profile.

The Southeast Asia Primary Learning Metrics Program: Thinking Globally In A Regional Context, Unicef, Southeast Asian Ministers Of Education Organization (Seameo)

Assessment and Reporting

The Southeast Asia Primary Learning Metrics (SEA-PLM) program is a regional assessment that aims to set a common approach to assessing the learning outcomes of students at Grade 5. As an alternative to international large-scale assessments and national assessments, SEA-PLM has developed a set of assessment and survey instruments for the Southeast Asian region. Designed to be a system-level monitoring tool of educational quality and equity, SEA-PLM covers four domains: mathematics, reading, writing and global citizenship. The assessment also includes questionnaires that gather important contextual information from students, parents, teachers and school principals. A key feature of the SEA-PLM assessment …

The Science Behind The Art Of Teaching: Evaluation As Inspiration, Michele Bruniges Am

2009 - 2019 ACER Research Conferences

Teachers across Australia inspire students to love learning. Our best teachers are constantly evaluating their impact on learning outcomes and adapting their practice – balancing the art and science of teaching. As we move rapidly towards the third decade of the 21st century, there is more pressure than ever for all teachers to deliver both deep discipline knowledge and the skills students need to survive and thrive in the workplace of the future. We need to use technology and data to support teachers to maximise learning outcomes for their students. This has to be done in a way that helps …

Educational Reform – Scottish Style!, David Leng

2009 - 2019 ACER Research Conferences

The government in Scotland has made education their defining mission, setting out a clear framework for improvement based on four key aims as articulated in the National Improvement Framework (2015). One improvement driver is Assessing Children’s Progress. This new approach to assessment has been developed to integrate curriculum, assessment (particularly classroom assessment) and pedagogy. Teacher professional judgement has been central to this, and national initiatives have focused on supporting and strengthening it. In this context, the Scottish National Standardised Assessments (SNSA) was launched in 2017, and is a national assessment tool to support improvement in classroom practice while still providing …

Enhancing Teaching And Learning Through Design Practice, Lori Lockyer

2009 - 2019 ACER Research Conferences

Design is part of a teacher’s practice on a daily basis. Teachers are constantly designing and redesigning learning experiences for their students. However, the notions of the teacher as designer or ‘teacher design practice’ are rarely used as frameworks within teacher education or continuing professional learning. In fact, ‘teacher design thinking’, that is, how school teachers think about and engage in design practice has been an under-researched area. Design thinking has the potential to provide teachers with a scaffold to reflect upon contextual and evidence-based factors when designing learning experiences for their students. However, we need to know how teachers …

Opening Or Closing Doors For Students? Equity And Data-Driven Decision-Making, Amanda Datnow

2009 - 2019 ACER Research Conferences

Data-driven decision-making is key pillar of educational reform initiatives in countries across the globe. While approaches to data use vary, the theory of action underlying these efforts is often similar. The common idea is that when leaders and teachers are knowledgeable about how to use data, they will become more effective in reviewing their existing capacities, identifying weaknesses, and charting plans for improvement. In the classroom, data can inform how teachers plan lessons, identify concepts for re-teaching, and differentiate instruction. For all these reasons, data use has significant implications for teaching and leadership. Ensuring equitable opportunities and outcomes for all …

The Case For Urgency: Advocating For Indigenous Voice In Education, Kevin P. Gillan, Suzanne Mellor, Jacynta Krakouer

Australian Education Review

In 2004 the Australian Council for Educational Research (ACER) published an Australian Education Review (AER) on Indigenous Education: The Case for Change: A review of contemporary research on Indigenous education outcomes, AER 47 (Mellor & Corrigan, 2004). In the 13 years since its publication, the state of Indigenous education outcomes has remained substantially unaltered. All the social indicators demonstrate that Australia’s First Nations people continue to be the most socio-economically disadvantaged population cohort in Australian society. This is after decades of continued policy efforts by successive Commonwealth, state and territory governments to ameliorate Indigenous education disadvantage. We still struggle with …

Solomon Islands Standardised Tests Of Achievement (Sista). English And Mathematics. Year 4 And Year 6. Report 1 Main Study 2015, Australian Council For Educational Research (Acer)

Assessment and Reporting

The SISTA program is a key monitoring tool of the Solomon Islands Ministry of Education and Human Resource Development and has the capacity to serve multiple functions to a wide range of educational stakeholders. This report provides analysis of year 4 and year 6 Literacy and Numeracy of SISTA 2015. It is both a technical report for NEAD that includes descriptions of the processes followed in data analysis and reporting and the theoretical underpinnings of the analysis, a summary of the findings of the analysis and the implications for further analysis; and a report for the wider MEHRD staff that …

Solomon Islands Standardised Tests Of Achievement (Sista). English And Mathematics. Year 4 And Year 6. Report 1 Main Study 2013, Australian Council For Educational Research (Acer)

Assessment and Reporting

The SISTA program is a key monitoring tool of the Solomon Islands Ministry of Education and Human Resource Development and has the capacity to serve multiple functions to a wide range of educational stakeholders. This report provides analysis of year 4 and year 6 Literacy and Numeracy of SISTA 2013. The SISTA results contain a wealth of data about how well students have responded to items that are indicators of curriculum attainment. The observed improvements in overall performances may be attributed to: a. Better tests and improved alignment of the tests with the target population; and b. In the case …

Kidsmatter Primary Evaluation: Technical Report And User Guide, Katherine Dix, John P. Keeves, Phillip T. Slee, Michael J. Lawson, Alan Russell, Helen Askell-Williams, Grace Skrzypiec, Laurence Owens, Barbara Spears

Student learning processes

This Technical Report and User Guide is the culmination of an evaluation investigating the effectiveness of KidsMatter Primary, involving over 5000 participants in 100 Australian primary schools over a two year period. It brings together an extensive data gathering exercise and presents technical aspects of the statistical and thematic analyses used in the KidsMatter Evaluation Final. The series of data files and the analysis in which the files have been used, are from the KidsMatter Evaluation Whole Cohort Longitudinal Study (predominantly quantitative data) and the Stakeholder and Student Voice Studies (qualitative data), in addition to data obtained from Project Officers …

Teaching Reading: Literature Review: A Review Of The Evidence-Based Research Literature On Approaches To The Teaching Of Literacy, Particularly Those That Are Effective In Assisting Students With Reading Difficulties, Ken Rowe, National Inquiry Into The Teaching Of Literacy (Australia)

School and system improvement

Underlying a key purpose of the present review is the conviction that claims about what constitute effective literacy teaching, and of reading in particular, should be grounded in findings from rigorous evidence-based research. To this end, the present review of the research literature on teaching practices for students, with and without reading difficulties, relies largely, though not exclusively, on well-designed meta analytic syntheses that: (a) partial out methodological artefacts from the effect sizes; and (b) base their analyses on the actual procedures and components of instruction used in the studies reviewed. Following a brief outline of the background and purposes …

Measuring School Effects Across Grades, Njora Hungi

Shannon Research Press

This study investigates the issue of the value-added components of the education provided across Grade 3 and Grade 5 in primary schools in South Australia and how these components could be measured. The study shows that it is very difficult to identify effective or ineffective schools because the amount of variance left unexplained at the school-level is small. As a solution to this problem, it is more meaningful to identify effective or ineffective schools when the school effects are expressed in terms of years of learning that a student spends at school.

An Examination Of Some Aspects Of Grade Placement Of Children, Australian Council For Educational Research (Acer)

Information Bulletin

The three investigations reported here deal with three aspects of the grade placement of children of the same age. Originally, they were carried out as independent projects, but as the conclusions became obvious it was seen that they were really closely related. The first attempts to answer the question "How many children pass through all stages of primary education without repeating a stage?”. The second compares the achievements in reading skills of children in the same grade but of different ages. The third is purely factual and compares the performances of children who are repeating a grade with those of …

Reform In The Primary School., J. M. Braithwaite, C. R. Mcrae, R. G. Staines

Future of Education

The pamphlet suggests reforms to primary school education as every Australian state there had been successive revisions of the course of study, all expressing a shift of emphasis away from monotonous grind and repetition, and towards such occupations as art, handwork, music, and physical education. But the movement towards better things was slow. [p. 5, ed]

We have seen that, during primary school years, the child grows in four main ways-physically, intellectually, emotionally and socially. The function of the primary school is to ensure successful growth of all four kinds. It is a fair criticism of the average school that …

The Length Of The Teacher's Professional Life, Kenneth Stewart Cunningham

Australian Educational Studies

The figures given in this paper are based on data supplied by five of the Australian States. The aim of the investigation was to obtain some indication of the average length of service of teachers employed by the State Education Departments. The method used was to ascertain the age on retirement, the length of service, and the cause of retirement of each teacher who ceased to be employed by the various Departments during the years 1928, 1929 and 1930. (p.1)