Education Commons^™

Assessing Computational Thinking, Daniel Duckworth

2009 - 2019 ACER Research Conferences

This paper provides some context for the role of computation thinking (CT) in the Australian Curriculum, an abridged literature review of CT as a problem-solving framework from the International Computer and Information Literacy Study (ICILS) 2018 assessment framework and some examples of how CT has been used to solve real-world problems. Finally, this paper presents ways to teach and assess CT.

Teaching And Assessing The General Capabilities In A Secondary School Context, Loren Clarke, Melissa Hughes

2009 - 2019 ACER Research Conferences

Education researchers, policymakers and private enterprise agree that, in addition to content knowledge, students in the 21st century need to acquire particular skills to equip them for active citizenship in the modern world. This is a real challenge for teachers today: how do they teach and assess the skills needed to live and work in the 21st century? This paper will explore the development of Eltham High School’s focus on teaching and assessment of collaboration, problem-solving, and critical thinking over the past seven years. It will explore the development of the assessment program, its connection to the school and state …

Assessing Computational Thinking, Daniel Duckworth

Daniel Duckworth

This paper provides some context for the role of computation thinking (CT) in the Australian Curriculum, an abridged literature review of CT as a problem-solving framework from the International Computer and Information Literacy Study (ICILS) 2018 assessment framework and some examples of how CT has been used to solve real-world problems. Finally, this paper presents ways to teach and assess CT.

Assessment Of Children As Confident And Involved Learners In Early Childhood Education And Care: Literature Review, Dan Cloney, Jen Jackson, Pru Mitchell

Early Childhood Education

This literature review is one of a series of reviews to support Victorian early childhood professionals to assess children’s learning and development in relation to the five Learning and Development Outcomes in the Victorian Early Years Learning and Development Framework (VEYLDF). This literature review documents the research that underpins and defines learning for children from birth to eight years, and outlines children’s trajectory as confident and involved learners. The resource aims to equip early childhood professionals with the knowledge to identify and assess children’s progress towards the VEYLDF Outcome: 'Children are confident and involved learners'.

Review Of The Piaac Numeracy Assessment Framework: Final Report, Dave Tout, Diana Coben, Vince Geiger, Lynda Ginsburg, Kees Hoogland, Terry Maguire, Sue Thomson, Ross Turner

Ross Turner

The Programme for the International Assessment of Adult Competencies (PIAAC) is an international assessment of the proficiency of adults (aged 16-65 years) in key information processing skills (reading, numeracy and Problem Solving in Technology-Rich Environments). The PIAAC Survey of Adult Skills has revealed that a considerable number of adults in OECD countries possess only limited literacy and numeracy skills. The OECD is currently reviewing the content of the frameworks and cognitive assessment instruments for the 2nd cycle of PIAAC ready for delivery in 2021-22. This report is the result of a review of the numeracy construct and assessment in PIAAC. …

Designing Rubrics For Authentic Assessment, Kathryn Richardson, Anne-Marie Chase

Dr Anne-Marie Chase

This presentation looks at the steps in developing authentic rubrics, from determining the constructs that will be assessed; breaking down the constructs into a set of broad capabilities that need to be observed; transferring capabilities into indicative behaviours (indicators or criteria); and determining the different levels of proficiency.

Equitable Learning Assessments For Students With Disabilities (Neqmap Thematic Review), Anannya Chakraborty, Amit Kaushik, Unesco Office Bangkok And Regional Bureau For Education In Asia And The Pacific

Assessment and Reporting

Asia-Pacific is home to 690 million persons with a disability. Persons with disabilities experience lower educational opportunities as children and therefore also face fewer opportunities as adults. Children with disabilities experience barriers to participating in education that result in enrolment rate drops of up to 53 per cent between primary and secondary education, making it increasingly difficult for persons with disabilities to secure employment. Low participation rates and other barriers have a serious impact on the learning achievement and learning outcomes of learners with disabilities. This thematic review provides an overview of the existing inclusive education policies and practices in …

Review Of The Piaac Numeracy Assessment Framework: Final Report, Dave Tout, Diana Coben, Vince Geiger, Lynda Ginsburg, Kees Hoogland, Terry Maguire, Sue Thomson, Ross Turner

David (Dave) Tout

The Programme for the International Assessment of Adult Competencies (PIAAC) is an international assessment of the proficiency of adults (aged 16-65 years) in key information processing skills (reading, numeracy and Problem Solving in Technology-Rich Environments). The PIAAC Survey of Adult Skills has revealed that a considerable number of adults in OECD countries possess only limited literacy and numeracy skills. The OECD is currently reviewing the content of the frameworks and cognitive assessment instruments for the 2nd cycle of PIAAC ready for delivery in 2021-22. This report is the result of a review of the numeracy construct and assessment in PIAAC. …

Developing A Global Health Assessment Collaboration: Ancillary Report, Daniel Edwards, Jacob Pearce, David Wilkinson

Dr Daniel Edwards

This document reports on a project designed to develop an assessment collaboration between medical schools in both Australia and the United Kingdom. The project was funded by the Office for Learning and Teaching (OLT), utilising surplus funding from a broader assessment collaboration project – the Australian Medical Assessment Collaboration (OLT ID12-2482). The Global Health Assessment Collaboration (GHAC) involved five universities in Australia and the United Kingdom (UK). It developed an assessment framework and item specifications, undertook assessment item drafting workshops, built in a process of review and resulted in the development of a focused suite of assessment items. This report …

Equipping Teachers With Tools To Assess And Teach General Capabilities, Claire Scoular

2009 - 2019 ACER Research Conferences

There is wide recognition that students need to be equipped with appropriate social and cognitive skills demanded by society and the workforce. The unresolved question is how to do this. Many education systems globally are addressing this demand by including skills such as critical thinking, problem-solving, collaboration, and creativity into curriculum documents or supplementary materials. However, there is little research to guide educators in teaching such skills at school level. The need to develop practical solutions for assessing and teaching social and cognitive skills, broadly classified under the umbrella ‘21st-century skills’ or ‘general capabilities’, is ever increasing. An integrated approach …

Communicating Student Learning Progress: What Does That Mean And Can It Make A Difference?, Hilary Hollingsworth, Jonathan Heard

2009 - 2019 ACER Research Conferences

Traditionally in schools, the main method of communicating students’ academic performance has been the summative end-of-semester report, and the focus of much of this communication has centred on reporting achievement against year-level standards. While semester reporting largely remains established practice, the advent of new school management systems has seen schools embrace a practice known as ‘continuous reporting’. Though well-intended, early analysis would suggest that the potential benefits of this relatively new process are inconsistently understood, and reveal a confusion between progressive instalments of feedback versus feedback on student progress. Such confusion may be indicative of other gaps in the organisational …

Equipping Teachers With Tools To Assess And Teach General Capabilities, Claire Scoular

Dr Claire Scoular

There is wide recognition that students need to be equipped with appropriate social and cognitive skills demanded by society and the workforce. The unresolved question is how to do this. Many education systems globally are addressing this demand by including skills such as critical thinking, problem-solving, collaboration, and creativity into curriculum documents or supplementary materials. However, there is little research to guide educators in teaching such skills at school level. The need to develop practical solutions for assessing and teaching social and cognitive skills, broadly classified under the umbrella ‘21st-century skills’ or ‘general capabilities’, is ever increasing. An integrated approach …

Communicating Student Learning Progress: What Does That Mean And Can It Make A Difference?, Hilary Hollingsworth, Jonathan Heard

Jonathan Heard

Traditionally in schools, the main method of communicating students’ academic performance has been the summative end-of-semester report, and the focus of much of this communication has centred on reporting achievement against year-level standards. While semester reporting largely remains established practice, the advent of new school management systems has seen schools embrace a practice known as ‘continuous reporting’. Though well-intended, early analysis would suggest that the potential benefits of this relatively new process are inconsistently understood, and reveal a confusion between progressive instalments of feedback versus feedback on student progress. Such confusion may be indicative of other gaps in the organisational …

Communicating Student Learning Progress: What Does That Mean And Can It Make A Difference?, Hilary Hollingsworth, Jonathan Heard

Dr Hilary Hollingsworth

Traditionally in schools, the main method of communicating students’ academic performance has been the summative end-of-semester report, and the focus of much of this communication has centred on reporting achievement against year-level standards. While semester reporting largely remains established practice, the advent of new school management systems has seen schools embrace a practice known as ‘continuous reporting’. Though well-intended, early analysis would suggest that the potential benefits of this relatively new process are inconsistently understood, and reveal a confusion between progressive instalments of feedback versus feedback on student progress. Such confusion may be indicative of other gaps in the organisational …

Learning Progressions In Acer's Work, Charlotte Waters

Monitoring Learning

This document has been developed to provide background to ACER’s learning progressions; to explain the terminology that is being used in this work; and to describe how learning progressions are being incorporated into various aspects of ACER’s work.

Designing Rubrics For Authentic Assessment, Kathryn Richardson, Anne-Marie Chase

Teacher education

This presentation looks at the steps in developing authentic rubrics, from determining the constructs that will be assessed; breaking down the constructs into a set of broad capabilities that need to be observed; transferring capabilities into indicative behaviours (indicators or criteria); and determining the different levels of proficiency.

Sharing Session #2: Penilaian Pendidikan Berbasis Kinerja [Performance Based Educational Assessment], Acer Indonesia

Assessment and Reporting

Topik untuk Sharing Session ini adalah mengenai Penilaian Berbasis Kinerja di Ruang Kelas: (i) Apa yang dimaksud dengan PBK, (ii) bagaimana cara kita mendesain penggunaannya di ruang kelas, serta (iii) apa saja ragam teknik penerapannya. Topik ini menarik untuk diangkat karena sepertinya ada demand untuk memahami dengan lebih baik cara penerapannya di kegiatan pembelajaran. Seperti sudah kita ketahui bersama, Kurikulum 2013 menerapkan model pembelajaran yang menekankan pada pencapaian kompetensi peserta didiknya. Metode pembelajaran seperti ini tentunya memerlukan metode penilaian yang berbeda dari sebelumnya. Karena tidak semata menghitung jumlah jawaban benar atau salah di atas kertas, tapi bagaimana guru mampu menilai …

Iowa Agricultural Educators’ Current And Perceived Grading Practices, Jenny Ann Lichty, Michael S. Retallick

Journal of Research in Technical Careers

Literature on grading reveals that grading practices have not changed much since they were first introduced. However, with alternative approaches, such as standards-based grading, being introduced, it is important to look at how agricultural educators are using grades to evaluate student learning. The purpose of this study was to determine the grading practices of Iowa high school agricultural educators. The accessible population consisted of 236 high school agricultural educators. Findings were based on responses of 157 (69.8%) educators who responded to the study via an online questionnaire. These agricultural educators used a variety of learning approaches, and their beliefs aligned …

Inquiry-Based Learning: Assessing Students' Science Inquiry Skills, Abha Bhagat

Teacher India

Inquiry-based approaches to teaching yield substantial benefits to students, but assessment of students' science inquiry skills indicate more emphasis is needed on the development of inquiry-based teaching and learning in the classroom.

Review Of The Piaac Numeracy Assessment Framework: Final Report, Dave Tout, Diana Coben, Vince Geiger, Lynda Ginsburg, Kees Hoogland, Terry Maguire, Sue Thomson, Ross Turner

Transition and Post-School Education and Training

The Programme for the International Assessment of Adult Competencies (PIAAC) is an international assessment of the proficiency of adults (aged 16-65 years) in key information processing skills (reading, numeracy and Problem Solving in Technology-Rich Environments). The PIAAC Survey of Adult Skills has revealed that a considerable number of adults in OECD countries possess only limited literacy and numeracy skills. The OECD is currently reviewing the content of the frameworks and cognitive assessment instruments for the 2nd cycle of PIAAC ready for delivery in 2021-22. This report is the result of a review of the numeracy construct and assessment in PIAAC. …

Developing A Global Health Assessment Collaboration: Ancillary Report, Daniel Edwards, Jacob Pearce, David Wilkinson

Higher education research

This document reports on a project designed to develop an assessment collaboration between medical schools in both Australia and the United Kingdom. The project was funded by the Office for Learning and Teaching (OLT), utilising surplus funding from a broader assessment collaboration project – the Australian Medical Assessment Collaboration (OLT ID12-2482). The Global Health Assessment Collaboration (GHAC) involved five universities in Australia and the United Kingdom (UK). It developed an assessment framework and item specifications, undertook assessment item drafting workshops, built in a process of review and resulted in the development of a focused suite of assessment items. This report …

Session P: Assessing General Capabilities, Julian Fraillon, Juliette Mendelovits

Juliette Mendelovits

There is growing interest in general capabilities and cross-curricular learning outcomes such as literacy in information and communication technologies, creative thinking and collaborative and individual problem-solving. As the expectation for such competencies to be taught in schools has increased, so has the need for teachers and schools to validly and reliably assess student learning in those areas, and to report on them in ways that teaching and learning. In this presentation examine the challenges of assessing on student learning and learning growth capabilities and cross-curricular learning present approaches used in research some of these challenges and reflect can be applied …

Session P: Assessing General Capabilities, Julian Fraillon, Juliette Mendelovits

Julian Fraillon

There is growing interest in general capabilities and cross-curricular learning outcomes such as literacy in information and communication technologies, creative thinking and collaborative and individual problem-solving. As the expectation for such competencies to be taught in schools has increased, so has the need for teachers and schools to validly and reliably assess student learning in those areas, and to report on them in ways that teaching and learning. In this presentation examine the challenges of assessing on student learning and learning growth capabilities and cross-curricular learning present approaches used in research some of these challenges and reflect can be applied …

Assessing General Capabilities, Julian Fraillon, Juliette Mendelovits

2009 - 2019 ACER Research Conferences

There is growing interest in general capabilities and cross-curricular learning outcomes such as literacy in information and communication technologies, creative thinking and collaborative and individual problem-solving. As the expectation for such competencies to be taught in schools has increased, so has the need for teachers and schools to validly and reliably assess student learning in those areas, and to report on them in ways that teaching and learning. In this presentation examine the challenges of assessing on student learning and learning growth capabilities and cross-curricular learning present approaches used in research some of these challenges and reflect can be applied …

Acer Research Conference Proceedings (2015), Acer

2009 - 2019 ACER Research Conferences

It is indeed timely that Research Conference 2015 addresses the theme Learning Assessments: Designing the future. It is six years since our Research Conference considered issues in assessment, and the landscape is being significantly transformed. Not only is Australia’s school curriculum changing, but related issues of teaching quality and assessment practice are hot topics here and in many other countries. This transforming landscape includes changes in thinking about the fundamental purposes of assessment; growing demands for the assessment of a broader range of student skills and capabilities; and new technologies that allow us to gather and visualise information about student …

Report On The Concurrent Validity And Inter-Rater Reliability Studies Of Uwezo, Acer

Monitoring Learning

In 2014 ACER through the Centre for Global Education Monitoring (GEM) worked with Results for Development (R4D) to conduct a broad evaluation the testing tools and processes of four citizen-led learning assessments: The Annual Status of Education Report (ASER) in India, Beekunko in Mali, Jàngandoo in Senegal, and Uwezo in Kenya, Tanzania, and Uganda. As part of this evaluation ACER designed two small quasi-experimental studies to investigate the concurrent validity and inter-rater reliability of Uwezo.

• The concurrent validity study explored the relationship between performance on Uwezo and performance on EGRA/EGMA (ie instruments that themselves have confirmed validity and reliability).
• The …

Improving Consistency In Teacher Judgements : An Investigation For The Department Of Education, Victoria, Marion Meiers, Clare Ozolins, Phillip Mckenzie

Dr Phillip McKenzie (retired)

The Australian Council for Educational Research (ACER) was commissioned by the Department of Education in Victoria to undertake an investigation of current best-practice approaches to ensuring consistency of teacher judgements against P-10 state-wide standards.

The investigation encompassed national and international approaches that had been implemented or were under development. A key objective of the investigation was that the approaches identified should be based on current information, research and best practice, and that they should be supportive of the continued development of a learning and assessment culture in Victorian schools. The report of the investigation was required to provide key baseline …

Student Assessments In India, Richa Jain

International Developments

ACER is working with social enterprise Gray Matters to deliver strong student assessments for school improvement in India. Richa Jain reports.

International Developments (No.4) 2014

International Developments

Table of contents for this issue: (a) Supporting educational progress for all learners; (b) Student assessments in India; (c) Pacific; (d) Educational progress for all; (e) Informing policy in developing countries; (f) Building connections in South East Asia; (g) Improving learning in China; (h) Current international projects.

Governance Models For Collaborations Involving Assessment, Australian Medical Assessment Collaboration (Amac), Ben Canny, Hamish Coates

Higher education research

This paper is driven by a desire to improve assessment in higher education to yield better outcomes for communities, professions and individuals. The analysis unfolds within the field of medicine but is conceptualised to be of much broader relevance to other professional fields and academic disciplines. The focus is on assessment during the course as opposed to assessment for admissions or licensing purposes. The interest in assessment is not simply to produce practitioners, but to develop better practitioners. As well, the remarks are bounded by the context of universities in Australia and hence the complex but important assumption of academic …