Open Access. Powered by Scholars. Published by Universities.®

Educational Assessment, Evaluation, and Research Commons™

Open Access. Powered by Scholars. Published by Universities.®

Australian Council for Educational Research (ACER)

2022

Discipline
Keyword
Publication
Publication Type
File Type

Articles 1 - 30 of 45

Full-Text Articles in Educational Assessment, Evaluation, and Research

School Leadership That Cultivates Collective Efficacy: Emerging Insights 2022, Kerry Elliott, Hilary Hollingsworth, Aiden Thornton, Liz Gillies, Katherine Henderson Nov 2022

School Leadership That Cultivates Collective Efficacy: Emerging Insights 2022, Kerry Elliott, Hilary Hollingsworth, Aiden Thornton, Liz Gillies, Katherine Henderson

Educational leadership

The work of the Menzies School Leadership Incubator suggests we need a new approach to leadership that supports school leaders to better manage transformational change and deepen collaborative capacity necessary to cultivate collective efficacy to improve student learning outcomes. This paper provides a description of the work of the Menzies School Leadership Incubator (“the Incubator’) and insights generated so far. The Incubator has identified five leadership domains which underpin the leadership of Collective Efficacy; Understanding Collective Efficacy Systems; Leadership Change; Leadership Team, and Leadership Collaborative Capacity.

Go to article

Remote Learning For Students With A Disability: Game Changer Or Moment In Time? Literature Review, Marijne Medhurst, Maya Conway, Kathryn Richardson Nov 2022

Remote Learning For Students With A Disability: Game Changer Or Moment In Time? Literature Review, Marijne Medhurst, Maya Conway, Kathryn Richardson

School and system improvement

This literature review draws from Australian and international research into the impact of remote learning for students with disability, published between March 2020 and April 2022. The literature relates to pedagogical services provided by early childhood services and schools to support students with disability, rather than therapeutic services. The social implications for students are reviewed along with educational factors, and implications for inclusion and support by schools. Following an overview of the legal and policy frameworks supporting the education of students with disability, this review investigates benefits, challenges and opportunities for both remote learning and transition back to in-person educational …

Go to article

Effects Of Remote Learning On Mental Health And Socialisation. Literature Review, Anna Dabrowski, Pru Mitchell Nov 2022

Effects Of Remote Learning On Mental Health And Socialisation. Literature Review, Anna Dabrowski, Pru Mitchell

School and system improvement

This literature review focuses on the effects of remote learning on mental health, including acute mental health issues and possible ongoing implications for student wellbeing and socialisation. It provides an overview of some of the challenges that can impact on the mental health and relationships of young people, many of which have accelerated or become more complex during the COVID-19 pandemic. In the light of concern about rising antisocial behaviour and extremism there is a focus on socialisation and self-regulation on return to school post-pandemic. In the face of limited Australian research on these topics, the review takes a global …

Go to article

Schools As Community Hubs. Literature Review, Ian Teo, Pru Mitchell, Fabienne Van Der Kleij, Anna Dabrowski Nov 2022

Schools As Community Hubs. Literature Review, Ian Teo, Pru Mitchell, Fabienne Van Der Kleij, Anna Dabrowski

School and system improvement

This literature review focuses on community hub models that include an education setting. The goals of these hubs go beyond improving academic outcomes, and look also to the health and wellbeing of their community. This review explores the ways in which education communities operate as welcoming and enriching places that connect, share, and learn with, not only students, families, and educators, but also their wider community. It focuses on a specific model of school-community partnership, typically known as a school community hub. Core features of community hubs are presented as people, partnerships, place and programs. Benefits and challenges of community …

Go to article

Pairwise Comparison Method: Concept Note, Australian Council For Educational Research Nov 2022

Pairwise Comparison Method: Concept Note, Australian Council For Educational Research

Global education monitoring

The paper sets out several approaches, both statistical and non-statistical, by which jurisdictions may choose to link their assessments to the global standards for reporting. One of these, the Pairwise Comparison Method (PCM), was first set out in Lazendic (2019). This concept note provides further details on the PCM and the work that has taken place since 2019 to enable the approach to be operationalised. The PCM relies on the Learning Progression Scales (LPSs) for reading and mathematics, developed by the Australian Council for Educational Research (ACER). A full description of the development of the scales is provided in the …

Go to article

Australian General Practice Training Program: National Report On The 2022 National Registrar Survey, Rebecca Taylor, Leyna Clarke, Ali Radloff Nov 2022

Australian General Practice Training Program: National Report On The 2022 National Registrar Survey, Rebecca Taylor, Leyna Clarke, Ali Radloff

Higher education research

The Australian General Practice Training National Registrar Survey (AGPT NRS) is an annual, national survey of GP registrars currently training in the AGPT program. It collects information via an online questionnaire about registrar satisfaction, experience and future career plans. It also collects information about registrars’ demographics and training contexts and other aspects of their training experience. This survey is part of the Department of Health and Aged Care’s (the Department) monitoring and quality improvement activities. From June 27 until August 12, 2022, the Australian Council for Educational Research (ACER) administered the AGPT NRS to registrars enrolled in active training on …

Go to article

Review Of The Australian Core Skills Framework And Digital Literacy Skills Framework And Relevant Assessment Tools. Final Report, Louise Wignall, Anita Roberts, Jana Scomazzon Nov 2022

Review Of The Australian Core Skills Framework And Digital Literacy Skills Framework And Relevant Assessment Tools. Final Report, Louise Wignall, Anita Roberts, Jana Scomazzon

Transition and Post-School Education and Training

This is the final report of a project commissioned in 2020 by the then Department of Education, Skills and Employment to review the Australian Core Skills Framework (ACSF) and Digital Literacy Skills Framework (DLSF) and tools available to support assessment using these frameworks. The review explored the development and history of the ACSF and DLSF, their use and application in the Australian context and examined features of selected international adult skills frameworks and curriculum. Through this desktop research and range of consultation activities with stakeholders, the Australian Council for Educational Research (ACER) has investigated current use of the ACSF and …

Go to article

International Standard Setting Exercise, Australian Council For Educational Research (Acer) Nov 2022

International Standard Setting Exercise, Australian Council For Educational Research (Acer)

Monitoring Learning

The GEM Centre provides technical support to the United Nations Educational, Scientific and Cultural Organization (UNESCO) Institute for Statistics (UIS), which has been mandated to monitor the progress of countries towards achieving the education goals of Sustainable Development Goal 4 (SDG 4). The International Standard Setting Exercise (ISSE) was undertaken to harmonise quantitative data across assessment programs, and to provide substantive information about children’s learning levels and progress benchmarked against international standards. The goal of the ISSE was to place thresholds on empirical reading and mathematics Learning Progression Scales for the Minimum Proficiency Level at the end of lower primary …

Go to article

Validity Evidence Based On Content: Controversies And Quantification, Agung Santoso, Alice Whita Savira, Robertus Landung Eko Prihatmoko Oct 2022

Validity Evidence Based On Content: Controversies And Quantification, Agung Santoso, Alice Whita Savira, Robertus Landung Eko Prihatmoko

International Conference on Assessment and Learning (ICAL)

Validity is a crucial issue in test development because it represents the accuracy of test score interpretation in describing the measured attribute or construct. Among validity evidence that can be collected to support test score interpretation, the one based on test content incited controversies. The content-based validity evidence includes analyses of the relationship between test content and the construct the test purported to measure. Some authors opposed the use of such evidence in the validation process, arguing that the evidence can only provide hypotheses to be tested in the subsequent processes. Other authors argued that the content validation process provided …

Go to article

Development Of Educational Quality Mapping Instruments (Ip-Snp) In West Java, Rina Mutaqinah, Bambang Sumintono, Yanti Triatna Oct 2022

Development Of Educational Quality Mapping Instruments (Ip-Snp) In West Java, Rina Mutaqinah, Bambang Sumintono, Yanti Triatna

International Conference on Assessment and Learning (ICAL)

Decision-making must be based on valid data, as well as decision-making in the field of education. It is very important to have a valid instrument, therefore it is necessary to develop an educational quality mapping instrument that can measure the achievement of the quality of education. This instrument was developed based on educational quality standards, namely the competency quality of graduates, content, process, assessment, educators and education personnel, infrastructure, management, and financing. The purpose of this study was to obtain an instrument that has high validity. The educational quality mapping instrument (IP-SNP) uses a rating scale, collecting data through a …

Go to article

A Formative Evaluation Of The Program For Student Representatives In A University Discipline Panel, Diana Genevive Layag Oct 2022

A Formative Evaluation Of The Program For Student Representatives In A University Discipline Panel, Diana Genevive Layag

International Conference on Assessment and Learning (ICAL)

The university employs a representation of different sectors in the academic community when dealing with major student conduct violations. Among them is the representative of the students. At the time of the study, the student representatives were qualified students who were recruited and trained to become part of the university discipline case conference panel. Upon successful completion of the training, these students were appointed to be members of a program for the pool of student representatives who sit as part of the university adjudicating body, which makes decisions for the university student discipline cases. Terminally, the researcher wanted to improve …

Go to article

Item Development And Psychometric Testing Of Work Stress Scale, Andhita Ramadhania Pristiawati, Laura Francisca Sudarnoto, Angela Oktavia Suryani Oct 2022

Item Development And Psychometric Testing Of Work Stress Scale, Andhita Ramadhania Pristiawati, Laura Francisca Sudarnoto, Angela Oktavia Suryani

International Conference on Assessment and Learning (ICAL)

In 2020, the COVID-19 pandemic demanded employees work from home (Ishak & Mangundjaya, 2020). The work-from-home regulation provides several advantages, including high work flexibility. However, this regulation also creates excessive workloads and requires employees to work overtime due to various challenges from superiors with short deadlines. This situation encouraged researchers to develop an accurate psychological scale to identify the employees/ working stress. The scale comprised physical and mental individual responses to managing their uncomfortable work environment. It consists of 48 items measuring four dimensions: role overload, role conflict, role ambiguity, and role responsibility. The participants responded to the items by …

Go to article

Is It Necessary To Use Two-Way Items? Testing The Effects Of Using Favourable And Unfavourable Items, Sukaesi Marianti, Dera Kariema, Puri Intan Larasati, Dhia Ulfah Purwati, Nur Hasanah Oct 2022

Is It Necessary To Use Two-Way Items? Testing The Effects Of Using Favourable And Unfavourable Items, Sukaesi Marianti, Dera Kariema, Puri Intan Larasati, Dhia Ulfah Purwati, Nur Hasanah

International Conference on Assessment and Learning (ICAL)

The topic of ethnicity is a topic that is often discussed in research, especially psychology research. Considering that Indonesia is a country with many ethnicities, therefore, ethnicity is a very important and relevant topic to be discussed in many studies. In this regard, robust tests measuring ethnicity are needed to collect data and further the data can be validly interpreted. The purpose of this study was to psychometrically evaluate the effects of the method of using two-way items (favorable and unfavorable) on two scales, Ethnic Experience and Ethnic Identity. This evaluation will lead to an evaluation of possible new factors …

Go to article

Transforming Assessment And Learning: Making The System Work. Proceeding Of The 2022 International Conference On Assessment And Learning, Acer Indonesia Oct 2022

Transforming Assessment And Learning: Making The System Work. Proceeding Of The 2022 International Conference On Assessment And Learning, Acer Indonesia

International Conference on Assessment and Learning (ICAL)

No abstract provided.

Go to article

Confirmatory Factor Analysis Of The Perception Of Academic Stress Scale (Pas), Damajanti Kusuma Dewi, Miftakhul Jannah, Ira Darmawanti Oct 2022

Confirmatory Factor Analysis Of The Perception Of Academic Stress Scale (Pas), Damajanti Kusuma Dewi, Miftakhul Jannah, Ira Darmawanti

International Conference on Assessment and Learning (ICAL)

Stress is a condition that must be experienced by humans, including students. This happens because every student will always be faced with a condition to meet the demands of the environment. Students will experience stress if they feel they do not have the ability to meet these academic demands. Therefore, an instrument is needed that can measure academic stress felt by students. This study aims to test the construct validity of the Perception of Academic Stress Scale (PAS)-Adaptation of Bedewy & Gabriel. Before conducting factor analysis, the adaptation and modification process of the instrument was carried out. The adaptation process …

Go to article

Minimum Proficiency Levels Unpacked, Australian Council For Educational Research (Acer) Oct 2022

Minimum Proficiency Levels Unpacked, Australian Council For Educational Research (Acer)

Monitoring Learning

This document draws together work from several initiatives to establish Minimum Proficiency Levels (MPLs) for reading and mathematics, for global use in pursuit of the Sustainable Development Goal in Education, SDG 4.1, with a specific focus on indicator 4.1.1. Three educational levels are referred to in this paper as ‘end of lower primary’, ‘end of primary’ and ‘end of lower secondary’. The MPLs are described and elaborated in four ways: nutshell statements; expanded statements; domains, constructs and descriptors; and sample items. A detailed account of the history and evolution of the Minimum Proficiency Levels is provided in Appendix A

Go to article

Validation Of The Child And Adult Social Support Scale (Casss) Which Measures Social Support In The Indonesian Version, Endah Mastuti, Fajrianthi, Fitri Andriani Oct 2022

Validation Of The Child And Adult Social Support Scale (Casss) Which Measures Social Support In The Indonesian Version, Endah Mastuti, Fajrianthi, Fitri Andriani

International Conference on Assessment and Learning (ICAL)

Social support has an important role, so that students in online learning can reduce the various problems they face. Social support here comes from parents, teachers, classmates, close friends, and the school itself as an institution. Based on this, it is necessary to do research related to social support to get an overview of the support from whom students need in online learning. Furthermore, this can be used as input to intervene in the problems faced by students. To conduct this research, it is necessary to have a measuring tool to conduct social support research. One of the comprehensive measuring …

Go to article

Relationship Between Students’ Economic, Cultural, And Social Status, School Climate And Student Achievement In Indonesia, Alejandra Osses-Vargas, Ursula Schwantner, Ray Adams, Nicole Wernert Oct 2022

Relationship Between Students’ Economic, Cultural, And Social Status, School Climate And Student Achievement In Indonesia, Alejandra Osses-Vargas, Ursula Schwantner, Ray Adams, Nicole Wernert

International Conference on Assessment and Learning (ICAL)

PISA 2018 data shows that, in Indonesia, the relationship between students’ economic, cultural, and social status and their scores on reading achievement is weak. However, there is great variation between schools in average reading achievement with over 40% of the explainable variation in reading achievement being between-schools. In addition, in Indonesia, there is low social diversity across schools (students within schools are likely to be of similar economic, cultural, and social background). These conditions raise the question of whether school factors play a role – specifically whether school climate has a compensating, mediating or moderating effect on the relationship between …

Go to article

Readiness, Response, And Recovery: The Impacts Of Covid-19 On Education Systems In Asia, Anna Dabrowski, Yung Nietschke, Syeda Kashfee Ahmed, Amy Berry, Maya Conway Sep 2022

Readiness, Response, And Recovery: The Impacts Of Covid-19 On Education Systems In Asia, Anna Dabrowski, Yung Nietschke, Syeda Kashfee Ahmed, Amy Berry, Maya Conway

Monitoring Learning

This review provides insights into COVID-19 responses in educational systems in Asia, and to understand which policies and practices were already in place to contribute to system readiness and resilience. Although the evidence base remains scarce, reflecting on the different system and school-level responses in Asia provides opportunity to identify gaps in current policies and research, and consider new ways in which countries in Asia can strengthen their educational systems into the future. It considers what makes an education system resilient, and the importance of school level practices. It uses an analytical framework to review readiness, response and recovery, and …

Go to article

Teachers’ Assessment Literacy And Design Competence Framework, Sladana Krstic, Sarah Manlove, Sarah Richardson Aug 2022

Teachers’ Assessment Literacy And Design Competence Framework, Sladana Krstic, Sarah Manlove, Sarah Richardson

2021-2030 ACER Research Conferences

Teachers play a central role in facilitating learning and empowering learners (Pastore & Andrade, 2019). They must possess a high level of assessment literacy to properly fulfil their role of implementing teaching and facilitating students’ learning (Hattie, 2009). Without it, the quality of educational provision can be impacted (Looney et al., 2018). The expectations placed on teachers in relation to their assessment knowledge and skills tend to focus on their ability to design and implement assessment with students, and to use assessment data to inform teaching practices (Brookhart, 2011). Much of the emphasis in the literature is on the mechanical …

Go to article

Assessing Reading: How Assessment Can Be Used To Target Teaching And Enhance Understanding Of Reading Comprehension, Sandra Knowles Aug 2022

Assessing Reading: How Assessment Can Be Used To Target Teaching And Enhance Understanding Of Reading Comprehension, Sandra Knowles

2021-2030 ACER Research Conferences

The skills demonstrated by a proficient reader are not easy to untangle. Current research acknowledges that reading comprehension is a highly complex area of ability, one that needs to be understood as the coordination of several integrated processes. Using example test questions and data, this presentation explores how assessment can help us make sense of reading comprehension in a way that curricula and commonly used teaching strategies cannot. Assessment is evidence that informs us about the skills involved in the reading process, how they relate to each other, and how they develop in complexity. When assessment is understood in this …

Go to article

Evidence-Informed Early Language And Literacy Practice: Implementation Of A New Formative Assessment For Early Language And Literacy Development, Sarah Groom, Mary-Ruth Mendel, Eric Brace, Philippa Pryor Aug 2022

Evidence-Informed Early Language And Literacy Practice: Implementation Of A New Formative Assessment For Early Language And Literacy Development, Sarah Groom, Mary-Ruth Mendel, Eric Brace, Philippa Pryor

2021-2030 ACER Research Conferences

With one in five Australian children starting school developmentally vulnerable, there is a need in this critical period for visibility over children’s oral language and early literacy development. The Australian Literacy and Numeracy Foundation (ALNF) partnered with a Northern Territory primary school to implement the Early Language and Literacy Development Index (ELLDI), a newly-created valid and reliable assessment which places children on a progression scale for oral language and early literacy development and provides meaningful, accessible recommendations for educational practice. Twenty-three children in the school’s transition cohort were measured using the ELLDI at the beginning and end of the school …

Go to article

Making Learning Visible: Moving From Nouns To Verbs, Diane Debacker Aug 2022

Making Learning Visible: Moving From Nouns To Verbs, Diane Debacker

2021-2030 ACER Research Conferences

This presentation focuses on the need to make learning visible for all constituents – learners, educators, employers, policymakers and future employees – with a focus on the work of the Center for Certification and Competency-Based Education (C3Be) at the University of Kansas (USA). As K–12 and higher education move to a post-pandemic world, it’s imperative we find different ways to identify learner outcomes and evaluate learning. By moving from nouns to verbs; by moving from course titles to competencies; by moving from transcripts to learner outcomes, learning becomes visible. International educator and founding director of C3Be, Dr Diane DeBacker shows …

Go to article

Assessment Moderation: Is It Fit For Purpose?, Lenore Adie Aug 2022

Assessment Moderation: Is It Fit For Purpose?, Lenore Adie

2021-2030 ACER Research Conferences

This presentation outlines the different practices and purposes of assessment moderation and analyses the benefits and issues of these. Two projects are presented; each seeks to improve teacher judgement. Both attempt to redefine what we mean by moderation and how moderation can be conducted to reach diverse and dispersed groups. The first draws on a current Australian Research Council project that is exploring the development of scaled exemplars, the use of commentaries of judgement decisions, and the use of digital platforms to support teachers grading student work. The second draws on the work of the Graduate Teacher Performance Assessment (GTPA) …

Go to article

The Transformational Change Of Adaptive Assessment, Jarrod Hingston, Toby Newton Aug 2022

The Transformational Change Of Adaptive Assessment, Jarrod Hingston, Toby Newton

2021-2030 ACER Research Conferences

Organisational change theory often discusses the differences between adaptive change and transformational change; adaptive change being the process of incremental shifts that are intended to drive improvement, while transformational change requires major alterations in processes. In 2019, ACER embarked on a mission to develop a new adaptive testing and reporting system, with the goal of delivering an assessment that would improve the precision of results for every student. While the intention was to introduce an adaptive change in the assessments, the project truly transformed the way that ACER delivers assessments and reports results, a result recognised by the project being …

Go to article

Sharing And Securing Learners' Performance Standards Across Schools, Richard Kimbell Aug 2022

Sharing And Securing Learners' Performance Standards Across Schools, Richard Kimbell

2021-2030 ACER Research Conferences

Assessing learners’ performance makes very different demands upon teachers depending on the purpose and the context of the assessment. But common to all assessment is some sense of what ‘quality’ looks like. Most often teachers engage in formative assessments in the classroom, and the familiar standards of the classroom are adequate for this purpose. However if teachers are to undertake external, nationally regulated assessment then some sense of a national standard of quality is required. But there are very limited mechanisms by which teachers can acquire this understanding, so they use their best judgement, and standards vary from school to …

Go to article

An Innovative Method For Teachers To Formatively Assess Writing Online, Dr Sandy Heldsinger, Stephen Humphry Aug 2022

An Innovative Method For Teachers To Formatively Assess Writing Online, Dr Sandy Heldsinger, Stephen Humphry

2021-2030 ACER Research Conferences

Assessment is an integral component of effective teaching and a teacher’s professional judgement influences all routine aspects of their work. In the last 20 years, there has been considerable work internationally to support teachers in using assessment to improve student learning. However, there is a pressing issue that impedes teacher professional judgement being exploited to its full potential. The issue relates to teacher assessments in the context of extended performances such as essays and arises from the complexity of obtaining reliable or consistent teacher assessments of students’ work. Literature published in the United States, England and Australia details evidence of …

Go to article

Using Pat Data To Inform Teaching And Learning, Marc Kralj, Rachel Felgate, Shani Sniedze, Caithlin Power, Grant Barclay, Darren Leech Aug 2022

Using Pat Data To Inform Teaching And Learning, Marc Kralj, Rachel Felgate, Shani Sniedze, Caithlin Power, Grant Barclay, Darren Leech

2021-2030 ACER Research Conferences

ACER works with thousands of Australian schools to set up Progressive Achievement Test (PAT) functionality, assign and administer tests, and to assist teachers to understand and interrogate the resulting test data and act upon findings. This session provides participants with an opportunity to hear about a school’s journey, and discuss this with the ACER team and our PAT school guest. ACER researchers have evaluated and documented assessment implementation and professional development opportunities, observing this school’s ability to track student and educator progress over time, which is a critical element in ACER’s Progressive Achievement approach. ACER’s educational consultants will demonstrate how …

Go to article

Reimagining Classroom Assessment And Feedback To Meet Learner Needs, Fabienne Van Der Kleij Aug 2022

Reimagining Classroom Assessment And Feedback To Meet Learner Needs, Fabienne Van Der Kleij

2021-2030 ACER Research Conferences

The power of classroom assessment and feedback to improve student learning outcomes has long been recognised. Yet, decades of research have yielded disappointing and often conflicting outcomes. This presentation challenges traditional conceptions of classroom assessment and feedback as teacher-driven practices. To meet learner needs better, it proposes a student-centred perspective in which students are active and have agency. By drawing on an extensive study of feedback reviews, this presentation illustrates how conceptualisations of feedback have changed over recent decades. This paper provides key insights into how classroom assessment and feedback practices can be changed in ways that are sustainable, afford …

Go to article

Acer Models Of Writing: Changing The Assessment Mindset, Juliette Mendelovits, Judy Nixon Aug 2022

Acer Models Of Writing: Changing The Assessment Mindset, Juliette Mendelovits, Judy Nixon

2021-2030 ACER Research Conferences

This presentation outlines different models of writing assessment that have a proven track record in various programs delivered by ACER. These models include holistic scoring, and partial analytical scoring on a number of criteria. The writing prompts for these models assume extended pieces of writing. The presentation will also introduce a new and alternative model of writing assessment that ACER has implemented in several large-scale assessments. This model is built on shorter pieces of writing from each student, designed to give more accurate and diverse insights into students’ proficiency in writing in a range of text types, within the constraints …

Go to article

Next Last