Open Access. Powered by Scholars. Published by Universities.®

Educational Assessment, Evaluation, and Research Commons™

Open Access. Powered by Scholars. Published by Universities.®

Australian Council for Educational Research (ACER)

2009 - 2019 ACER Research Conferences

Discipline
Keyword
Publication Year

Articles 1 - 30 of 106

Full-Text Articles in Educational Assessment, Evaluation, and Research

Building The Capacity Of Teachers For Supporting 21st-Century Learning, Jenny Gore, Michelle Ware, Sui-Linn White, Lee-Anne Collins, Lloyd Bowen, Carole Hansen Aug 2019

Building The Capacity Of Teachers For Supporting 21st-Century Learning, Jenny Gore, Michelle Ware, Sui-Linn White, Lee-Anne Collins, Lloyd Bowen, Carole Hansen

2009 - 2019 ACER Research Conferences

Quality Teaching Rounds (QTR) was first conceptualised by Julie Bowe and Jenny Gore in 2007. It involves teachers working in professional learning communities (PLCs) to reflect on their classroom practice through the lens of the quality teaching model. This teacher-led process builds capacity for quality teaching with novice and experienced teachers alike. Following a set of protocols and adhering to essential features of the approach, one PLC member teaches a lesson, observed by all others. The lesson is coded individually and then collaboratively analysed, using the shared language of the model. This poster presentation graphically highlights evidence from several research …

Go to article

How Teachers Engage With Student Assessment Data: Understanding Antecedents To Data-Driven Decision Making, Cynthia P. Raffe, Dennis Alonzo, University Of New South Wales Aug 2019

How Teachers Engage With Student Assessment Data: Understanding Antecedents To Data-Driven Decision Making, Cynthia P. Raffe, Dennis Alonzo, University Of New South Wales

2009 - 2019 ACER Research Conferences

In recent years, education systems internationally have been encouraging data-use initiatives with the aim of improving student learning through data-driven decision making (DDDM). The use of student assessment data in particular has been promoted to guide teaching practices and progress student learning. Despite this, the adoption of data-use practices by New South Wales classroom teachers has been slow. The study qualitatively examined two core foundational activities that affect New South Wales classroom teachers’ use of student assessment data, referred to as assessment data collection (ADC) practices, and assessment data analysis (ADA) practices. Specifically, the study sought to answer: What are …

Go to article

Key Skills For The 21st Century: An Evidence-Based Review, Esther Doecke, Quentin Maire Aug 2019

Key Skills For The 21st Century: An Evidence-Based Review, Esther Doecke, Quentin Maire

2009 - 2019 ACER Research Conferences

It is vital that education systems deliver quality outcomes for all young people and prepare them well for their future in the economy and society. To do so, many systems have traditionally had a strong focus on developing academic skills, particularly in literacy and numeracy. In recent years, education systems have developed greater expectations that schools will also equip young people with a broader set of skills for the 21st century (e.g. creativity, critical thinking, problem-solving). This paper addresses these developments and the challenges they present. Building on an evidence-based review, this paper asks what are the key skills required …

Go to article

Assessing Computational Thinking, Daniel Duckworth Aug 2019

Assessing Computational Thinking, Daniel Duckworth

2009 - 2019 ACER Research Conferences

This paper provides some context for the role of computation thinking (CT) in the Australian Curriculum, an abridged literature review of CT as a problem-solving framework from the International Computer and Information Literacy Study (ICILS) 2018 assessment framework and some examples of how CT has been used to solve real-world problems. Finally, this paper presents ways to teach and assess CT.

Go to article

What Can Early Childhood Education And Care Settings Teach Us About Skills For The 21st Century?, Dan Cloney, Kellie Picker Aug 2019

What Can Early Childhood Education And Care Settings Teach Us About Skills For The 21st Century?, Dan Cloney, Kellie Picker

2009 - 2019 ACER Research Conferences

Early childhood education and care (ECEC) settings are naturally oriented towards promoting 21st century skills. This can be seen in Australia, where learning is defined as the development of identity, social and emotional skills, problem-solving, and communication skills. A 21st century orientation is also seen in the playbased pedagogies implemented in ECEC settings. A gap, however, exists in the ability of the ECEC sector to communicate its successes. This gap relates to the lack of measurement tools to quantify the quality of the adult–child interactions in ECEC settings, and children’s growth in these 21 century skills and abilities. This paper …

Go to article

Assessment In The Interpersonal Domain: Experiences From Empathy Assessment In Medical Education, Neville Chiavaroli Aug 2019

Assessment In The Interpersonal Domain: Experiences From Empathy Assessment In Medical Education, Neville Chiavaroli

2009 - 2019 ACER Research Conferences

Frameworks for the teaching and assessment of 21st-century skills commonly recognise the importance of learning and skill development in the interpersonal domain. They also usually acknowledge the challenge of reliably and validly assessing students in this domain. In the field of medical education and in selecting students for medical courses, the concept of empathy has become central to representing the particular interpersonal understandings and skills expected of students and practising doctors. Attempts to assess these attributes during medical training are just as challenging as in school contexts. This presentation draws on several years’ experience of working with medical educators to …

Go to article

Assessing And Understanding Social And Emotional Skills: The Oecd Study On Social And Emotional Skills, Sue Thomson Aug 2019

Assessing And Understanding Social And Emotional Skills: The Oecd Study On Social And Emotional Skills, Sue Thomson

2009 - 2019 ACER Research Conferences

In an increasingly fast-changing and diverse world, the importance of developing social and emotional skills is becoming more evident. The large body of accumulated evidence shows that these skills have strong relationships with life outcomes and they have been referred to as a key component of 21st century skills. The Organisation for Economic Co-operation and Development (OECD) Study on Social and Emotional Skills is a new international assessment of these skills in students at primary and secondary schools. This study also gathers information on students’ families, schools and community learning contexts, aiming to provide information about the conditions or practices …

Go to article

Digital Literacy: Myths And Realities, Julian Fraillon Aug 2019

Digital Literacy: Myths And Realities, Julian Fraillon

2009 - 2019 ACER Research Conferences

Digital literacy, under a wide variety of names, is routinely classified as a 21st-century skill and is frequently reported as an area of high priority in school education systems internationally. In comparison with students in other countries, Australian students have high levels of access to digital technologies both at and outside of school. With this access comes the expectations that students will be highly-proficient users of digital technologies and that schools will use digital technologies in transformative ways to support student learning. This session will examine how concepts of digital literacy have developed over time, what data from large-scale assessments …

Go to article

Teaching And Assessing The General Capabilities In A Secondary School Context, Loren Clarke, Melissa Hughes Aug 2019

Teaching And Assessing The General Capabilities In A Secondary School Context, Loren Clarke, Melissa Hughes

2009 - 2019 ACER Research Conferences

Education researchers, policymakers and private enterprise agree that, in addition to content knowledge, students in the 21st century need to acquire particular skills to equip them for active citizenship in the modern world. This is a real challenge for teachers today: how do they teach and assess the skills needed to live and work in the 21st century? This paper will explore the development of Eltham High School’s focus on teaching and assessment of collaboration, problem-solving, and critical thinking over the past seven years. It will explore the development of the assessment program, its connection to the school and state …

Go to article

Using Learning Analytics To Measure 21st-Century Skills, Dragan Gašević Aug 2019

Using Learning Analytics To Measure 21st-Century Skills, Dragan Gašević

2009 - 2019 ACER Research Conferences

The unprecedented opportunities to collect data about learning and contexts in which learning occurs has attracted great attention in education. The use of data analytics and machine learning methods have offered much potential to address many relevant questions in education. This talk will focus on the use of learning analytics to measure 21st-century skills in education and outline the types of data commonly used. It will also discuss approaches that are used for analysis and modelling of relevant learning processes and outline the ways in which learning analytics can be used to track learning progression and how the validity of …

Go to article

The Science Behind The Art Of Teaching: Evaluation As Inspiration, Michele Bruniges Am Aug 2019

The Science Behind The Art Of Teaching: Evaluation As Inspiration, Michele Bruniges Am

2009 - 2019 ACER Research Conferences

Teachers across Australia inspire students to love learning. Our best teachers are constantly evaluating their impact on learning outcomes and adapting their practice – balancing the art and science of teaching. As we move rapidly towards the third decade of the 21st century, there is more pressure than ever for all teachers to deliver both deep discipline knowledge and the skills students need to survive and thrive in the workplace of the future. We need to use technology and data to support teachers to maximise learning outcomes for their students. This has to be done in a way that helps …

Go to article

Digital Literacy Skill Development: Prescriptive Learning Analytics Assessment Model, Elspeth Mckay Aug 2019

Digital Literacy Skill Development: Prescriptive Learning Analytics Assessment Model, Elspeth Mckay

2009 - 2019 ACER Research Conferences

There is a broad awareness of how information communications technology (ICT) digital literacy impacts everyday life. In schools, use of ICT tools has become mandatory. These tools include computers, tablets and mobile phones. These smart devices are used to send emails, browse the internet and make video calls. It is essential for teachers to identify student digital literacy levels through classroom activities and when to implement flexible ePedagogies for students who need help. This presentation will provide easy-to-follow steps to manage learning analytics to determine digital literacy skill levels. Learning analytics can be used for a range of purposes: to …

Go to article

Educational Reform – Scottish Style!, David Leng Aug 2019

Educational Reform – Scottish Style!, David Leng

2009 - 2019 ACER Research Conferences

The government in Scotland has made education their defining mission, setting out a clear framework for improvement based on four key aims as articulated in the National Improvement Framework (2015). One improvement driver is Assessing Children’s Progress. This new approach to assessment has been developed to integrate curriculum, assessment (particularly classroom assessment) and pedagogy. Teacher professional judgement has been central to this, and national initiatives have focused on supporting and strengthening it. In this context, the Scottish National Standardised Assessments (SNSA) was launched in 2017, and is a national assessment tool to support improvement in classroom practice while still providing …

Go to article

Using Measures Of Quality To Improve The Learning Outcomes Of All Children, Dan Cloney Aug 2018

Using Measures Of Quality To Improve The Learning Outcomes Of All Children, Dan Cloney

2009 - 2019 ACER Research Conferences

There is compelling evidence that high-quality early childhood education and care (ECEC) programs can act to narrow achievement gaps attributed to social inequality. This evidence is typically observed in model programs, designed by experts and offered to vulnerable families outside the market. In everyday settings, where market forces may price families out of certain programs or poor local availability may preclude attendance, ECEC programs do not appear to deliver these significant gains or close these gaps. There is a need to continually improve quality in all ECEC settings to deliver on the potential of early education. It is unclear, however, …

Go to article

Enhancing Teaching And Learning Through Design Practice, Lori Lockyer Aug 2018

Enhancing Teaching And Learning Through Design Practice, Lori Lockyer

2009 - 2019 ACER Research Conferences

Design is part of a teacher’s practice on a daily basis. Teachers are constantly designing and redesigning learning experiences for their students. However, the notions of the teacher as designer or ‘teacher design practice’ are rarely used as frameworks within teacher education or continuing professional learning. In fact, ‘teacher design thinking’, that is, how school teachers think about and engage in design practice has been an under-researched area. Design thinking has the potential to provide teachers with a scaffold to reflect upon contextual and evidence-based factors when designing learning experiences for their students. However, we need to know how teachers …

Go to article

Equipping Teachers With Tools To Assess And Teach General Capabilities, Claire Scoular Aug 2018

Equipping Teachers With Tools To Assess And Teach General Capabilities, Claire Scoular

2009 - 2019 ACER Research Conferences

There is wide recognition that students need to be equipped with appropriate social and cognitive skills demanded by society and the workforce. The unresolved question is how to do this. Many education systems globally are addressing this demand by including skills such as critical thinking, problem-solving, collaboration, and creativity into curriculum documents or supplementary materials. However, there is little research to guide educators in teaching such skills at school level. The need to develop practical solutions for assessing and teaching social and cognitive skills, broadly classified under the umbrella ‘21st-century skills’ or ‘general capabilities’, is ever increasing. An integrated approach …

Go to article

Assessing Accomplished Teaching With Reliability And Validity: The Acer Portfolio Project, Lawrence Ingvarson Aug 2018

Assessing Accomplished Teaching With Reliability And Validity: The Acer Portfolio Project, Lawrence Ingvarson

2009 - 2019 ACER Research Conferences

We know that good teachers are worth their weight in gold. But if good teaching is to be truly valued, the teaching profession must be able to demonstrate that it can evaluate itself in ways that are reliable, valid and fair. This capacity is central to any profession. It is also central to lifting the status of teaching, rewarding accomplished teaching and enabling teaching to complete with other professions for our ablest graduates. Recent OECD reports emphasise the necessity of strengthening the teaching profession, which depends upon widespread use of evidence-based teaching practices. Building the capacity for evaluation is the …

Go to article

Communicating Student Learning Progress: What Does That Mean And Can It Make A Difference?, Hilary Hollingsworth, Jonathan Heard Aug 2018

Communicating Student Learning Progress: What Does That Mean And Can It Make A Difference?, Hilary Hollingsworth, Jonathan Heard

2009 - 2019 ACER Research Conferences

Traditionally in schools, the main method of communicating students’ academic performance has been the summative end-of-semester report, and the focus of much of this communication has centred on reporting achievement against year-level standards. While semester reporting largely remains established practice, the advent of new school management systems has seen schools embrace a practice known as ‘continuous reporting’. Though well-intended, early analysis would suggest that the potential benefits of this relatively new process are inconsistently understood, and reveal a confusion between progressive instalments of feedback versus feedback on student progress. Such confusion may be indicative of other gaps in the organisational …

Go to article

The Role Of Evidence In Teaching And Learning, Geoff N. Masters Ao Aug 2018

The Role Of Evidence In Teaching And Learning, Geoff N. Masters Ao

2009 - 2019 ACER Research Conferences

Highly-effective teaching requires evidence-informed decision making at crucial points in the teaching process. First, effective teachers use quality evidence to establish the points individual learners have reached in their learning. This enables teachers to identify starting points for further teaching and learning and to ensure that each student is given learning opportunities at an appropriate level of challenge. In contrast, much teaching instead assumes all students will be appropriately challenged by common year-level curricula. The process of establishing and understanding where students are in their learning often requires detailed diagnostic evidence of individual misunderstandings and obstacles to learning progress. Second, …

Go to article

Acer Research Conference Proceedings (2018), Australian Council For Educational Research (Acer) Aug 2018

Acer Research Conference Proceedings (2018), Australian Council For Educational Research (Acer)

2009 - 2019 ACER Research Conferences

There is no shortage of opinion about more and less effective ways of teaching. Schools are continually presented with strategies, programs and approaches that claim to be ‘research-based’, ‘evidence-based’ or even ‘brainbased’. Vocal advocates of particular teaching methods promote their proposed solutions in the media. But how many of these programs and methods have solid foundations in research? And how can teachers and school leaders distinguish exaggerated marketing claims from teaching strategies shown through research to be effective in improving student outcomes? Research Conference 2018 examines research evidence around teaching practices that make a difference. It brings together leading international …

Go to article

Opening Or Closing Doors For Students? Equity And Data-Driven Decision-Making, Amanda Datnow Aug 2017

Opening Or Closing Doors For Students? Equity And Data-Driven Decision-Making, Amanda Datnow

2009 - 2019 ACER Research Conferences

Data-driven decision-making is key pillar of educational reform initiatives in countries across the globe. While approaches to data use vary, the theory of action underlying these efforts is often similar. The common idea is that when leaders and teachers are knowledgeable about how to use data, they will become more effective in reviewing their existing capacities, identifying weaknesses, and charting plans for improvement. In the classroom, data can inform how teachers plan lessons, identify concepts for re-teaching, and differentiate instruction. For all these reasons, data use has significant implications for teaching and leadership. Ensuring equitable opportunities and outcomes for all …

Go to article

Promoting Girls’ And Boys’ Engagement And Participation In Senior Secondary Stem Fields And Occupational Aspirations, Helen Watt Aug 2016

Promoting Girls’ And Boys’ Engagement And Participation In Senior Secondary Stem Fields And Occupational Aspirations, Helen Watt

2009 - 2019 ACER Research Conferences

Sufficient numbers of people with science and mathematics qualifications are needed for continuing growth in productivity and industry innovation. The Australian Industry Group (2015, p. 5) cautioned, ‘the pipeline of STEM skills to the workforce remains perilous’ because participation in sciences and advanced mathematics at school and university is in decline, participation is not comparable with other nations, and our students underperform in major international studies. Gender differences in enrolments and career plans continue to fuel the concern of researchers with interest in gender equity. Many have argued girls prematurely restrict their options by discontinuing particular STEM subjects in adolescence, …

Go to article

Sharing The Stories Of Near Novices To Impact Mainstream Change, Bronwyn Stuckey Aug 2016

Sharing The Stories Of Near Novices To Impact Mainstream Change, Bronwyn Stuckey

2009 - 2019 ACER Research Conferences

This case study research is designed to examine the ways in which teachers are bringing gameful practices into their classrooms as part of a STEM learning agenda. It is hypothesised that one of the best persons to inform or improve the practice of novices is a near novice; someone who was most recently themselves a novice. In many case study programs, we hold up exemplary practitioners as models, but these experts may be too far removed in their levels of expertise to impact the practice of true novices. Experts and evangelists might be useful in creating vision for change, but …

Go to article

Hacking Assessment, Phillip Dawson Aug 2015

Hacking Assessment, Phillip Dawson

2009 - 2019 ACER Research Conferences

Hackers exploit weaknesses in a system to achieve their own goals. In this paper I argue that hacking presents a significant threat to the growing world of online assessment. This threat needs to be addressed through a variety of means; technological anti-hacking approaches will not be sufficient. The most effective ways to prevent hacking may be changes to the assessment tasks themselves to make hacking less tempting; these approaches also have a range of positive side effects in terms of authenticity, transparency of criteria, and ensuring tasks involve work beyond the exam. I conclude with a brief exploration of the …

Go to article

Assessing General Capabilities, Julian Fraillon, Juliette Mendelovits Aug 2015

Assessing General Capabilities, Julian Fraillon, Juliette Mendelovits

2009 - 2019 ACER Research Conferences

There is growing interest in general capabilities and cross-curricular learning outcomes such as literacy in information and communication technologies, creative thinking and collaborative and individual problem-solving. As the expectation for such competencies to be taught in schools has increased, so has the need for teachers and schools to validly and reliably assess student learning in those areas, and to report on them in ways that teaching and learning. In this presentation examine the challenges of assessing on student learning and learning growth capabilities and cross-curricular learning present approaches used in research some of these challenges and reflect can be applied …

Go to article

Translating Rich Learning Assessments Into Certified Results And University Selection Devices, Gabrielle Matters Aug 2015

Translating Rich Learning Assessments Into Certified Results And University Selection Devices, Gabrielle Matters

2009 - 2019 ACER Research Conferences

There are challenges in designing a set of high-quality processes in senior assessment and tertiary entrance that meet the needs of future senior secondary school students and future users of the certified results of learning assessments. Assessment and selection arrangements should look to the future rather than backwards to arrangements that might have existed in the past or that presently operate, unexamined, in other places. Teachers need to be convinced that the richness of students’ learning assessments will not be lost or transmogrified in any new processes for grading or ranking. A set of principles should guide the design of …

Go to article

The Move To Naplan Online: The Advantages And The Road Ahead, Stanley Rabinowitz Aug 2015

The Move To Naplan Online: The Advantages And The Road Ahead, Stanley Rabinowitz

2009 - 2019 ACER Research Conferences

The task of developing and delivering the National Assessment Program — Literacy and Numeracy (NAPLAN) online presents enormous challenges. Nonetheless, the benefits of taking this on are well worth the efforts. With a tailored test design, NAPLAN online will provide a better measure of the Australian Curriculum, more precise results and a significantly faster turnaround of those results. NAPLAN will begin its delivery online in 2017, with an opt-in period until 2019. To ensure readiness, a large amount of research is being conducted through the Australian Curriculum, Assessment and Reporting Authority to inform the development process. This presentation will address …

Go to article

Stealth Assessment In Video Games, Val Shute Aug 2015

Stealth Assessment In Video Games, Val Shute

2009 - 2019 ACER Research Conferences

Games can be powerful vehicles to support learning, but their success in education hinges on getting the assessment part right. In this presentation, I will explore how games can use stealth assessment to measure and support the learning of competencies critical for the future. I will discuss what stealth assessment is, why it is important, and how to develop and accomplish it. I will also provide examples within the context of a game called Physics Playground that I designed and developed with my team. I’ll share what has been learned by recent research on stealth assessments in games, including: Does …

Go to article

Assessment In Interactive Learning Environments, Michael Timms, Jason Lodge Aug 2015

Assessment In Interactive Learning Environments, Michael Timms, Jason Lodge

2009 - 2019 ACER Research Conferences

There is an increasing interest in using digital technologies to create interactive learning environments (ILEs) that both teach and assess student skills that are hard or impossible to assess using ‘static’ items such as traditional, multiple-choice questions. These interactive learning environments try to do two things simultaneously: firstly, to monitor the learning of the student in real time, providing feedback to help the student progress through the learning task; and secondly, to use the information gathered during the learning to make judgements about where the student is in learning of the topic. Essentially, ILEs draw upon the same source of …

Go to article

Measuring What Matters: Challenges And Opportunities In Assessing Science Proficiency, James W. Pellegrino Aug 2015

Measuring What Matters: Challenges And Opportunities In Assessing Science Proficiency, James W. Pellegrino

2009 - 2019 ACER Research Conferences

A key challenge in shaping science learning for the future will be to develop new measures of learning that take into account what it means to be proficient in science (Pellegrino, 2013). The emergent view on proficiency, grounded in learning sciences research, emphasises using and applying knowledge in the context of disciplinary practice. Referred to as knowledge-in-use, this perspective on science proficiency is a centrepiece of the United States’ National Research Council’s (NRC) Framework for K–12 Science Education (NRC, 2012), embodied in the new US national standards (NGSS Lead States, 2013) and emphasised in the recently released NRC report on …

Go to article

Next Last