Educational Assessment, Evaluation, and Research Commons^™

Reporting Student Learning, Hilary Hollingsworth, Jonathan Heard

NSW Curriculum Review

This paper is one of six research ‘backgrounders’ to support the 2018–20 review of the New South Wales (NSW) curriculum. It focuses on reporting student learning, which has been identified as an area of interest in the review. This paper seeks to present an evidence base, based on a rapid review of relevant research literature, to inform considerations related to student reporting practice reform.

Communicating Student Learning Progress: A Review Of Student Reporting In Australia. Findings In Brief, Hilary Hollingsworth, Jonathan Heard, Paul R. Weldon

Assessment and Reporting

The Communicating Student Learning Progress project was initiated to investigate questions relating to the effectiveness of current methods of communicating student progress, the extent to which they are valued by stakeholders, whether they are considered to provide quality information about student learning, and whether there are alternative designs for these activities that might be more effective. The project took place over a three-year period from July 2016 to June 2019.

Communicating Student Learning Progress: A Review Of Student Reporting In Australia, Hilary Hollingsworth, Jonathan Heard, Paul R. Weldon

Assessment and Reporting

The Communicating Student Learning Progress project was initiated to investigate questions relating to the effectiveness of current methods of communicating student progress, the extent to which they are valued by stakeholders, whether they are considered to provide quality information about student learning, and whether there are alternative designs for these activities that might be more effective. The project took place over a three-year period from July 2016 to June 2019.

Preparing For Life In A Digital World: The Iea International Computer And Information Literacy Study 2018 International Report, Julian Fraillon, John Ainley, Wolfram Schulz, Tim Friedman, Daniel Duckworth

ICT - Digital Literacy

The second cycle of ICILS in 2018 (ICILS 2018) continued to investigate students’ computer and information literacy (CIL) and also investigated students’ computational thinking (CT). This dimension involves conceptualising problems (through algorithmic or systems thinking) and operationalising solutions (creating, implementing, and evaluating computer-based responses to problems). The inclusion of CT as an option in ICILS 2018 reflects recent interest by educators, researchers, and policymakers in the value of CT in schooling. ICILS 2018 studied how these components of digital competence related to each other and to the school and out-of-school contexts that support learning with and about computer technology. This …

Learning Practice Guide, Jen Jackson, Kate Noble, Jeanne Marie Iorio, Dan Cloney, Pru Mitchell

Early Childhood Education

The first section of this Learning Practice Guide reminds early childhood professionals of the theory and pedagogy that underpins day-to-day practice, and helps them find ways to recognise children’s confidence and involvement in learning as a key component of their professional practice. The second section describes eight scenarios to prompt professional reflection, and illustrate ways in which early childhood professionals can improve their practice in relation to the VEYLDF Learning and Development Outcome: Children are confident and involved learners.

Assessing Computational Thinking, Daniel Duckworth

2009 - 2019 ACER Research Conferences

This paper provides some context for the role of computation thinking (CT) in the Australian Curriculum, an abridged literature review of CT as a problem-solving framework from the International Computer and Information Literacy Study (ICILS) 2018 assessment framework and some examples of how CT has been used to solve real-world problems. Finally, this paper presents ways to teach and assess CT.

Teaching And Assessing The General Capabilities In A Secondary School Context, Loren Clarke, Melissa Hughes

2009 - 2019 ACER Research Conferences

Education researchers, policymakers and private enterprise agree that, in addition to content knowledge, students in the 21st century need to acquire particular skills to equip them for active citizenship in the modern world. This is a real challenge for teachers today: how do they teach and assess the skills needed to live and work in the 21st century? This paper will explore the development of Eltham High School’s focus on teaching and assessment of collaboration, problem-solving, and critical thinking over the past seven years. It will explore the development of the assessment program, its connection to the school and state …

Equitable Learning Assessments For Students With Disabilities (Neqmap Thematic Review), Anannya Chakraborty, Amit Kaushik, Unesco Office Bangkok And Regional Bureau For Education In Asia And The Pacific

Assessment and Reporting

Asia-Pacific is home to 690 million persons with a disability. Persons with disabilities experience lower educational opportunities as children and therefore also face fewer opportunities as adults. Children with disabilities experience barriers to participating in education that result in enrolment rate drops of up to 53 per cent between primary and secondary education, making it increasingly difficult for persons with disabilities to secure employment. Low participation rates and other barriers have a serious impact on the learning achievement and learning outcomes of learners with disabilities. This thematic review provides an overview of the existing inclusive education policies and practices in …

Equipping Teachers With Tools To Assess And Teach General Capabilities, Claire Scoular

2009 - 2019 ACER Research Conferences

There is wide recognition that students need to be equipped with appropriate social and cognitive skills demanded by society and the workforce. The unresolved question is how to do this. Many education systems globally are addressing this demand by including skills such as critical thinking, problem-solving, collaboration, and creativity into curriculum documents or supplementary materials. However, there is little research to guide educators in teaching such skills at school level. The need to develop practical solutions for assessing and teaching social and cognitive skills, broadly classified under the umbrella ‘21st-century skills’ or ‘general capabilities’, is ever increasing. An integrated approach …

Iowa Agricultural Educators’ Current And Perceived Grading Practices, Jenny Ann Lichty, Michael S. Retallick

Journal of Research in Technical Careers

Literature on grading reveals that grading practices have not changed much since they were first introduced. However, with alternative approaches, such as standards-based grading, being introduced, it is important to look at how agricultural educators are using grades to evaluate student learning. The purpose of this study was to determine the grading practices of Iowa high school agricultural educators. The accessible population consisted of 236 high school agricultural educators. Findings were based on responses of 157 (69.8%) educators who responded to the study via an online questionnaire. These agricultural educators used a variety of learning approaches, and their beliefs aligned …

Review Of The Piaac Numeracy Assessment Framework: Final Report, Dave Tout, Diana Coben, Vince Geiger, Lynda Ginsburg, Kees Hoogland, Terry Maguire, Sue Thomson, Ross Turner

Vocational, adult and professional education research

The Programme for the International Assessment of Adult Competencies (PIAAC) is an international assessment of the proficiency of adults (aged 16-65 years) in key information processing skills (reading, numeracy and Problem Solving in Technology-Rich Environments). The PIAAC Survey of Adult Skills has revealed that a considerable number of adults in OECD countries possess only limited literacy and numeracy skills. The OECD is currently reviewing the content of the frameworks and cognitive assessment instruments for the 2nd cycle of PIAAC ready for delivery in 2021-22. This report is the result of a review of the numeracy construct and assessment in PIAAC. …

Assessing General Capabilities, Julian Fraillon, Juliette Mendelovits

2009 - 2019 ACER Research Conferences

There is growing interest in general capabilities and cross-curricular learning outcomes such as literacy in information and communication technologies, creative thinking and collaborative and individual problem-solving. As the expectation for such competencies to be taught in schools has increased, so has the need for teachers and schools to validly and reliably assess student learning in those areas, and to report on them in ways that teaching and learning. In this presentation examine the challenges of assessing on student learning and learning growth capabilities and cross-curricular learning present approaches used in research some of these challenges and reflect can be applied …

Acer Research Conference Proceedings (2015), Acer

2009 - 2019 ACER Research Conferences

It is indeed timely that Research Conference 2015 addresses the theme Learning Assessments: Designing the future. It is six years since our Research Conference considered issues in assessment, and the landscape is being significantly transformed. Not only is Australia’s school curriculum changing, but related issues of teaching quality and assessment practice are hot topics here and in many other countries. This transforming landscape includes changes in thinking about the fundamental purposes of assessment; growing demands for the assessment of a broader range of student skills and capabilities; and new technologies that allow us to gather and visualise information about student …

Student Assessments In India, Richa Jain

International Developments

ACER is working with social enterprise Gray Matters to deliver strong student assessments for school improvement in India. Richa Jain reports.

International Developments (No.4) 2014

International Developments

Table of contents for this issue: (a) Supporting educational progress for all learners; (b) Student assessments in India; (c) Pacific; (d) Educational progress for all; (e) Informing policy in developing countries; (f) Building connections in South East Asia; (g) Improving learning in China; (h) Current international projects.

Evaluating An Instruction Program With Various Assessment Measures, Sarah Gewirtz

Libraries Staff Publications

Purpose: This paper demonstrates how the author’s library was able to enhance the collaborative learning and teaching environment, with secondary goals to improve teaching effectiveness and increase sharing among librarians of ideas and techniques used in First Year Student sessions.

Design/methodology/approach: This paper describes the various measures of assessment (peer-to-peer, student feedback and self-reflection) that the College of St. Benedict (CSB) and St. John’s University (SJU) Libraries implemented in 2011. The methods were used to improve teaching by listening to peers, getting feedback from students and by also doing self-reflection. Many librarians were able to make changes that were beneficial …

Assessing Student Learning: Why Reform Is Overdue, Geoff N. Masters

Assessment and Reporting

Advances in our understanding of human learning require new approaches to assessing and monitoring student learning. Much assessment thinking has changed little over the past fifty years. The field continues to be dominated by twentieth century introductory textbook concepts, including such dichotomies as formative versus summative assessment, criterion-referenced versus norm-referenced testing, quantitative versus qualitative assessment, informal versus formal assessment – distinctions that often hamper rather than promote clear thinking about assessment. Assessment practice also has changed little over this period. Traditional, high-stakes examinations continue to dominate what is taught and learnt in many of our schools and universities. Greater use …

Discovering And Developing Diverse Stem Talent: Enabling Academically Talented Urban Youth To Flourish, Stephanie Pace Marshall, Glenn W. "Max" Mcgee, Eric Mclaren, Catherine C. Veal

Publications & Research

The Growing Excellence Gap in K-12 Education, Plucker, Burroughs, and Song (2010) provided compelling evidence that "the presence of an excellence gap is demonstrated on both national and state assessments of student performance," with "economically disadvantaged, English Language Learners, and historically underprivileged minorities representing a smaller proportion of students scoring at the highest levels of achievement" (p. 28). Three "case stories" of students from IMSA illuminate some of the (a) challenges and opportunities inherent in igniting STEM talent in urban youth and ensuring their success; (b) principles for designing and creating learning experiences and environments that ignite and nurture the …

Master Teachers’ Critical Practice And Student Learning Strategies: A Case Study In An Urban School District, Greg G. Paulmann

Antioch University Dissertations & Theses

Job embedded professional development in the K-12 education setting has long been discussed and debated. This study builds on standards of critical reflection and thinking using the National Institute for Excellence in Education’s Teacher Advancement Program’s master teacher model as a conduit between theory and practice. A study of professional development design based on student learning strategies became worthy of review. The master teacher, through field testing and critical reflection, isolates critical elements necessary to transform teaching practice around student learning strategies. The work of the master teacher is situated as a leader of change within a professional learning community. …

Performance Enhancement Of The Task Assessment Process Through The Application Of An Electronic Performance Support System, Alistair B. Campbell

Theses: Doctorates and Masters

Higher education in Australia, as for many other countries, has changed greatly over the last 20 years at all levels and in many areas of operation including teaching, learning and assessment. The driving forces for these changes have been both internal and external, and have included factors such as: the increasing student population; the increasing use of part-time staff; a reduction in government funding; an increased expectation of institutional accountability; and the growing access and use of information and communication technologies (ICT) in teaching and learning. Assessment has not escaped these changes but in many cases has not kept up …

Improving Consistency In Teacher Judgements : An Investigation For The Department Of Education, Victoria, Marion Meiers, Clare Ozolins, Phillip Mckenzie

School and system improvement

The Australian Council for Educational Research (ACER) was commissioned by the Department of Education in Victoria to undertake an investigation of current best-practice approaches to ensuring consistency of teacher judgements against P-10 state-wide standards.

The investigation encompassed national and international approaches that had been implemented or were under development. A key objective of the investigation was that the approaches identified should be based on current information, research and best practice, and that they should be supportive of the continued development of a learning and assessment culture in Victorian schools. The report of the investigation was required to provide key baseline …

Assessment During The Early And Middle Years: Getting The Basics Right, Ken Rowe

Student learning processes

Following a contextual introduction and a brief discussion of the fundamental importance of monitoring growth, this paper draws from emerging evidence-based research findings and ‘state-of-the art’ practice in assessment and reporting of students’ developmental and learning progress. The paper argues that the monitoring of individual progress over time requires both diagnostic and developmental assessments of such progress on well-constructed empirical scales (or quantitative ‘maps’) that are qualitatively described. The use of such ‘maps’ enables early detection of potential ‘risk factors’, and the monitoring of both individuals and groups across the years of schooling. Such ‘maps’ and their reporting products constitute …

Using Data To Support Learning In Schools : Students, Teachers, Systems, Gabrielle Matters

Australian Education Review

AER 49 examines the issues raised by the ACER Research Conference 2005: Using Data to Support Learning. It analyses the conference papers, distils the essence of the conference 'conversations', and contextualises them in the light of a survey of the broader Australian and international literature on using data to support learning. Section 1 sets the context by providing definitions and an organisational framework. Section 2 discusses some purposes for collecting and analysing educational data, and considers the role of data in professional work. It addresses issues associated with identifying potential data sources, including consideration of the decision-making required to locate …

Teaching Reading: Literature Review: A Review Of The Evidence-Based Research Literature On Approaches To The Teaching Of Literacy, Particularly Those That Are Effective In Assisting Students With Reading Difficulties, Ken Rowe, National Inquiry Into The Teaching Of Literacy (Australia)

School and system improvement

Underlying a key purpose of the present review is the conviction that claims about what constitute effective literacy teaching, and of reading in particular, should be grounded in findings from rigorous evidence-based research. To this end, the present review of the research literature on teaching practices for students, with and without reading difficulties, relies largely, though not exclusively, on well-designed meta analytic syntheses that: (a) partial out methodological artefacts from the effect sizes; and (b) base their analyses on the actual procedures and components of instruction used in the studies reviewed. Following a brief outline of the background and purposes …

Teaching Reading: Report And Recommendations, Ken Rowe, National Inquiry Into The Teaching Of Literacy (Australia)

School and system improvement

The objectives of the Inquiry were to review and analyse recent national and international research about literacy teaching approaches; identify the extent to which prospective teachers are provided with reading teaching approaches and skills that are effective in the classroom and have the opportunities to develop and practise the skills required to implement effective classroom reading programs; identify the ways in which research evidence on literacy teaching and policies in Australian schools can best inform classroom teaching practice and support teacher professional learning; examine the effectiveness of assessment methods being used to monitor the progress of students' early reading learning; …

Investigating The Links Between Teacher Professional Development And Student Learning Outcomes, Marion Meiers, Lawrence Ingvarson

Professional learning for teachers and school leaders

This report, in two volumes, describes an investigation of the links between teacher professional development and student learning outcomes. The study, funded by the Australian Government, provides a review of the research literature and of national and international initiatives linking professional development with student outcomes. It provides detailed case studies of the school-based trials of ten professional development programs in a number of different sites. It examines the repeated measures of student achievement from students in the classes of teachers in the school-based trials. Analysis and discussion of a common questionnaire completed by teachers in the school-based trials is provided. …

Fair And Meaningful Measures? A Review Of Examination Procedures In The Nsw Higher School Certificate, Geoff N. Masters

Assessment and Reporting

In September 1997 the New South Wales government introduced a number of significant reforms to the Higher School Certificate (HSC). The broad objectives of the 'new' HSC, which was implemented for the first time in 2000-01, are to increase the rigour and quality of the HSC curriculum; ensure HSC marks fairly reflect the standards achieved by students; provide more informative reports of students' HSC achievements; and enhance the chances for more equitable educational outcomes. Although the new HSC incorporates reforms of both HSC curricula and methods of assessing and reporting student achievement, the focus of this review is on new …

Mcas Morass, William C. Levin

Bridgewater Review

No abstract provided.

Workshop Manual: Implementing Developmental Assessment., Margaret Forster, Geoff N. Masters

Assessment Resource Kit

This workshop manual has been developed as a resource for curriculum coordinators in schools, staff in curriculum and assessment support roles in regional and central offices, and others interested in the professional development of teachers in the areas of assessment and reporting. The manual provides resources for a single workshop Implementing developmental assessment. It is part of the Assessment Resource Kit (ARK), a series of magazines on assessment and reporting issues and methods. Workshop contents: Implementing developmental assessment: workshop overview. Section 1: Progress maps Section 2: Assessment methods Section 3: Judging and recording Section 4: Estimating attainment Section 5: Reporting.

Paper And Pen: Assessment Resource Kit, Margaret Forster, Geoff N. Masters

Assessment Resource Kit

A common method of assessment is to present students with a series of questions or prompts and to use students' written responses as evidence of their levels of knowledge, competence, understanding or attitude. We refer to assessments of this kind as 'paper and pen ' assessments. This issue on paper and pen assessment in the Assessment Resource Kit (ARK) magazine series contains five articles: 1. What is paper and pen assessment? 2. A variety of answer formats; 3. Teacher designed paper and pen assessments; 4. Professionally developed tests; 5. Designing paper and pen assessments.