Open Access. Powered by Scholars. Published by Universities.®
- Keyword
-
- United States (4)
- Assessment (3)
- Evaluation (3)
- Aboriginal students (2)
- Assessment tasks (2)
-
- Australia (2)
- Cheating (2)
- General capabilities (2)
- Literacy (2)
- Mathematics achievement (2)
- NAPLAN online (2)
- NZ (2)
- New Zealand (2)
- Numeracy (2)
- Online assessment (2)
- Stealth assessments (2)
- Student assessment (2)
- ACARA (1)
- ACER’s Centre for Assessment Reform Innovation (1)
- Aboriginal education (1)
- Anti-cheating (1)
- Anti-hacking (1)
- Assessment and Teaching of 21st-Century Skills (ATC21S) project (1)
- Assessment and reporting (1)
- Assessment decision making (1)
- Assessment methods (1)
- Assessment practice (1)
- Assessment standards (1)
- Australian Tertiary Admission Rank (ATAR) (1)
- Berkeley Evaluation and Assessment Research (BEAR) Center (1)
Articles 1 - 18 of 18
Full-Text Articles in Education
Hacking Assessment, Phillip Dawson
Hacking Assessment, Phillip Dawson
2009 - 2019 ACER Research Conferences
Hackers exploit weaknesses in a system to achieve their own goals. In this paper I argue that hacking presents a significant threat to the growing world of online assessment. This threat needs to be addressed through a variety of means; technological anti-hacking approaches will not be sufficient. The most effective ways to prevent hacking may be changes to the assessment tasks themselves to make hacking less tempting; these approaches also have a range of positive side effects in terms of authenticity, transparency of criteria, and ensuring tasks involve work beyond the exam. I conclude with a brief exploration of the …
Assessing General Capabilities, Julian Fraillon, Juliette Mendelovits
Assessing General Capabilities, Julian Fraillon, Juliette Mendelovits
2009 - 2019 ACER Research Conferences
There is growing interest in general capabilities and cross-curricular learning outcomes such as literacy in information and communication technologies, creative thinking and collaborative and individual problem-solving. As the expectation for such competencies to be taught in schools has increased, so has the need for teachers and schools to validly and reliably assess student learning in those areas, and to report on them in ways that teaching and learning. In this presentation examine the challenges of assessing on student learning and learning growth capabilities and cross-curricular learning present approaches used in research some of these challenges and reflect can be applied …
Translating Rich Learning Assessments Into Certified Results And University Selection Devices, Gabrielle Matters
Translating Rich Learning Assessments Into Certified Results And University Selection Devices, Gabrielle Matters
2009 - 2019 ACER Research Conferences
There are challenges in designing a set of high-quality processes in senior assessment and tertiary entrance that meet the needs of future senior secondary school students and future users of the certified results of learning assessments. Assessment and selection arrangements should look to the future rather than backwards to arrangements that might have existed in the past or that presently operate, unexamined, in other places. Teachers need to be convinced that the richness of students’ learning assessments will not be lost or transmogrified in any new processes for grading or ranking. A set of principles should guide the design of …
The Move To Naplan Online: The Advantages And The Road Ahead, Stanley Rabinowitz
The Move To Naplan Online: The Advantages And The Road Ahead, Stanley Rabinowitz
2009 - 2019 ACER Research Conferences
The task of developing and delivering the National Assessment Program — Literacy and Numeracy (NAPLAN) online presents enormous challenges. Nonetheless, the benefits of taking this on are well worth the efforts. With a tailored test design, NAPLAN online will provide a better measure of the Australian Curriculum, more precise results and a significantly faster turnaround of those results. NAPLAN will begin its delivery online in 2017, with an opt-in period until 2019. To ensure readiness, a large amount of research is being conducted through the Australian Curriculum, Assessment and Reporting Authority to inform the development process. This presentation will address …
Stealth Assessment In Video Games, Val Shute
Stealth Assessment In Video Games, Val Shute
2009 - 2019 ACER Research Conferences
Games can be powerful vehicles to support learning, but their success in education hinges on getting the assessment part right. In this presentation, I will explore how games can use stealth assessment to measure and support the learning of competencies critical for the future. I will discuss what stealth assessment is, why it is important, and how to develop and accomplish it. I will also provide examples within the context of a game called Physics Playground that I designed and developed with my team. I’ll share what has been learned by recent research on stealth assessments in games, including: Does …
Assessment In Interactive Learning Environments, Michael Timms, Jason Lodge
Assessment In Interactive Learning Environments, Michael Timms, Jason Lodge
2009 - 2019 ACER Research Conferences
There is an increasing interest in using digital technologies to create interactive learning environments (ILEs) that both teach and assess student skills that are hard or impossible to assess using ‘static’ items such as traditional, multiple-choice questions. These interactive learning environments try to do two things simultaneously: firstly, to monitor the learning of the student in real time, providing feedback to help the student progress through the learning task; and secondly, to use the information gathered during the learning to make judgements about where the student is in learning of the topic. Essentially, ILEs draw upon the same source of …
Assessment Standards, ‘Intentional Alignment’, And Dialogic Inquiry, Claire Wyatt-Smith
Assessment Standards, ‘Intentional Alignment’, And Dialogic Inquiry, Claire Wyatt-Smith
2009 - 2019 ACER Research Conferences
Internationally, the policy move towards standards-aligned instruction is gaining momentum. In Australia, standards have assumed unprecedented prominence in education policy relating both to classroom practice and to teacher preparation and career progression. The move is also evident in the United States, where the lure of standards to inform improvement is clear: significant investment has been committed to longitudinal research to examine at state and district levels the desirable conditions for implementing standards, their impact on developing college- and career-ready teachers, and in turn, the impact on teacher instruction and student outcomes. Moves such as this are occurring in the absence …
Measuring What Matters: Challenges And Opportunities In Assessing Science Proficiency, James W. Pellegrino
Measuring What Matters: Challenges And Opportunities In Assessing Science Proficiency, James W. Pellegrino
2009 - 2019 ACER Research Conferences
A key challenge in shaping science learning for the future will be to develop new measures of learning that take into account what it means to be proficient in science (Pellegrino, 2013). The emergent view on proficiency, grounded in learning sciences research, emphasises using and applying knowledge in the context of disciplinary practice. Referred to as knowledge-in-use, this perspective on science proficiency is a centrepiece of the United States’ National Research Council’s (NRC) Framework for K–12 Science Education (NRC, 2012), embodied in the new US national standards (NGSS Lead States, 2013) and emphasised in the recently released NRC report on …
Should Generic Curriculum Capabilities Be Assessed?, Rosemary Hipkins
Should Generic Curriculum Capabilities Be Assessed?, Rosemary Hipkins
2009 - 2019 ACER Research Conferences
Both Australia and New Zealand have recently taken up the idea of ‘key competencies’ (‘capabilities’ in the Australian national curriculum) initially proposed by the Organisation for Economic Co-operation and Development. In both countries we have made them our own by adapting them to suit our own educational contexts. People often say that these capabilities won’t be taken seriously unless they are assessed. So whether, and how, to assess them continue to be vexed questions. In this paper I argue that capabilities are more appropriately seen as changing the curriculum rather than adding to it. If we are serious about preparing …
Collaborative Problem-Solving: Assessment And Reporting, Patrick Griffin
Collaborative Problem-Solving: Assessment And Reporting, Patrick Griffin
2009 - 2019 ACER Research Conferences
This practical session will present a live administration of interactive collaborative problem-solving assessment and reporting. The presenter will demonstrate example tasks and reports. Audience representatives will have the opportunity to role-play as students being assessed across a range of social and cognitive skills associated with collaborative problem-solving. The discussion will then explore how these social and cognitive skills can be incorporated into the teaching program, enabling higher-order skills to be assessed in key learning areas across the curriculum.
Pisa: Behind The Headlines And Past The Rankings, Sue Thomson, Chris Wardlaw
Pisa: Behind The Headlines And Past The Rankings, Sue Thomson, Chris Wardlaw
2009 - 2019 ACER Research Conferences
Whenever the results of the Programme for International Student Assessment (PISA) are announced, media headlines are full of reports about rankings, about how many countries Australia is outperformed by and outperforms. In early rounds of PISA, Australia ranked among the top 10 countries across all three education domains assessed. However, over time Australia’s position has declined, rather than improved, and Australia no longer sits in the top 10 of any of the assessed domains. This presentation will go behind the headlines and past the rankings, to look at where Australia has declined, and look at how we can improve outcomes …
Reflecting On Teacher Research On Assessment: Challenges And Innovations For The Future, Marie Brennan
Reflecting On Teacher Research On Assessment: Challenges And Innovations For The Future, Marie Brennan
2009 - 2019 ACER Research Conferences
The theme of the 2015 Excellence in Professional Practice Conference (EPPC), held by ACER in May, was Improving assessments of student learning. A review of content and presentations for EPPC showed up some important trends and issues for further analysis and discussion. In a significant number of schools, the focus on assessment was well integrated into an overall school improvement plan or approach. In other schools, the school process overwhelmed the focus on assessment, and at times even overshadowed the focus of the study to be shared. One group of presentations focused on using existing instruments in ways that advanced …
Learning Assessments: Designing The Future, Geoff N. Masters
Learning Assessments: Designing The Future, Geoff N. Masters
2009 - 2019 ACER Research Conferences
Processes for assessing student learning are undergoing fundamental transformation.This presentation will consider three developments which can be expected to shape how student learning is assessed in the future. First is fundamental change in how assessment is conceptualised and approached, with a focus on monitoring learning. Second is growing interest in the assessment of a broader range of skills and attributes than those addressed in most current assessment efforts. Third is advances in technology which are opening the door to new ways of gathering information about student learning, including through records of real-time interactions in online learning environments. In ACER’s Centre …
Creating Stealth Assessments, Val Shute, Michael Timms
Creating Stealth Assessments, Val Shute, Michael Timms
2009 - 2019 ACER Research Conferences
In this workshop, participants will learn how to create stealth assessments to measure student performance during interactions within computer-based learning environments, like digital games or intelligent tutoring systems. These measures are then used to estimate various competencies, including hard-to-measure constructs like creativity, persistence, problem-solving and systems thinking. First, we will explain how evidence-centred design can be used as a theoretical approach to designing such assessments. Next, we’ll illustrate how evidence-centred design was applied in the development of stealth assessment within a particular game (using the example of Plants vs. Zombies 2). Participants will have a chance to create their …
Improving Assessment For Indigenous Students, Alison Quin
Improving Assessment For Indigenous Students, Alison Quin
2009 - 2019 ACER Research Conferences
This workshop will introduce a teaching scenario and existing unit of work built around Indigenous culturally inclusive practices. Participants will work in small groups to devise assessment items in a scaffolded process. The development of assessment tasks will be informed by clarifying Indigenous education, the process of building relationships between schools and Indigenous communities that contribute to co-developed units of work, and principles of Indigenous culturally inclusive practice such as place-based, community-grounded and group production practices.
New Measures For An Old Friend: A Learning Progression For Ict Literacy, Mark Wilson
New Measures For An Old Friend: A Learning Progression For Ict Literacy, Mark Wilson
2009 - 2019 ACER Research Conferences
This workshop will present new thinking and new results from the work of the Assessment and Teaching of 21st-Century Skills (ATC21S) project, on the learning progression for information and communications technology literacy — learning in digital networks. This project, initially sponsored by Cisco, Intel and Microsoft, aimed to help educators around the world enable students with the skills to succeed in future career and college goals. The workshop will be structured to show the how the development of the new ideas and measures for ICT literacy followed the logic of the assessment system developed by the Berkeley Evaluation and Assessment …
Assessing Young Children's Literacy And Mathematics Understandings, Collette Taylor, Joanne Mulligan, Maurice Walker, Prue Anderson, Marion Meiers
Assessing Young Children's Literacy And Mathematics Understandings, Collette Taylor, Joanne Mulligan, Maurice Walker, Prue Anderson, Marion Meiers
2009 - 2019 ACER Research Conferences
Current research indicates that young children are capable of developing mathematical concepts and reasoning much earlier than previously considered. Moderated by Professor Collette Tayler, this symposium on assessing young children's literacy and mathematics understandings is in three parts. Firstly the authors explore the Pattern and Structure Assessment (PASA). PASA is an early mathematical assessment interview which focuses on a range of concepts and processes and is linked with mathematical attainment in the ACER Progressive Achievement Tests in Maths (PATMaths). Secondly, the authors report on the piloting of an early-years technology-based tool called the Digital Early Reading and Mathematics Assessment (DERMA). …
Acer Research Conference Proceedings (2015), Acer
Acer Research Conference Proceedings (2015), Acer
2009 - 2019 ACER Research Conferences
It is indeed timely that Research Conference 2015 addresses the theme Learning Assessments: Designing the future. It is six years since our Research Conference considered issues in assessment, and the landscape is being significantly transformed. Not only is Australia’s school curriculum changing, but related issues of teaching quality and assessment practice are hot topics here and in many other countries. This transforming landscape includes changes in thinking about the fundamental purposes of assessment; growing demands for the assessment of a broader range of student skills and capabilities; and new technologies that allow us to gather and visualise information about student …