Education Commons^™

Educational Reform – Scottish Style!, David Leng

2009 - 2019 ACER Research Conferences

The government in Scotland has made education their defining mission, setting out a clear framework for improvement based on four key aims as articulated in the National Improvement Framework (2015). One improvement driver is Assessing Children’s Progress. This new approach to assessment has been developed to integrate curriculum, assessment (particularly classroom assessment) and pedagogy. Teacher professional judgement has been central to this, and national initiatives have focused on supporting and strengthening it. In this context, the Scottish National Standardised Assessments (SNSA) was launched in 2017, and is a national assessment tool to support improvement in classroom practice while still providing …

Growth To Achievement: On-Demand Resources For Teachers, Christine Cawsey Am, John Hattie, Geoff N. Masters Ao

Monitoring Learning

A central finding of the Review to Achieve Educational Excellence in Australian Schools (the Excellence Review) was that learning progressions can help teachers tailor their teaching to support students’ achievement through continuous learning growth. Aligned, online and on-demand assessments, combined with professional learning and resources, will aid the use and interpretation of learning progressions in order to maximise the learning growth and attainment of every student every year. The Commonwealth Minister for Education and Training has established an expert reference panel to shape a shared vision for this important work and provide advice on how to take it forward. The …

Keystroke Dynamics: Utilizing Keyprint Biometrics To Identify Users In Online Courses, Jay Richards Young

Theses and Dissertations

This study examined the potential use of keystroke dynamics to create keyprints (typing fingerprints) to authenticate individuals in online assessment situations. The implications of this study are best understood in terms of the keystroke behavioral biometric. While previous studies considered the degree to which keystroke typing patterns are unique, this study was set up to determine how well keyprints are able to identify individuals when typing under various treatment conditions (copy typing, free typing, and typing with mild or moderate impediments). While authentication can be difficult when attempting to correctly identify individual users, the results of this study indicate that …

Does The Type Of Assessment Feedback I Give Make A Difference?: The Impact Of Qualitative And Quantitative Assessment Feedback, Maria T. Northcote, Anthony Williams, Phil Fitzsimmons, Peter W. Kilgour

Maria Northcote

Feedback provided to postgraduate students about their assessment tasks influences the way in which they reflect on their learning and themselves personally. In particular, the nature of the feedback and the way in which its dissemination is sequenced and timed can further impact how students incorporate, or don't incorporate, assessment advice into their future learning, a process referred to by Duncan (2007) as "feed-forward". Despite the value placed on assessment feedback by academic teaching staff, it often has minimal impact on students' learning (Sadler, 2010).

Past research into the impact of qualitative and quantitative feedback on student learning established that …

Does The Type Of Assessment Feedback I Give Make A Difference?: The Impact Of Qualitative And Quantitative Assessment Feedback, Maria T. Northcote, Anthony Williams, Phil Fitzsimmons, Peter W. Kilgour

Peter Kilgour

Feedback provided to postgraduate students about their assessment tasks influences the way in which they reflect on their learning and themselves personally. In particular, the nature of the feedback and the way in which its dissemination is sequenced and timed can further impact how students incorporate, or don't incorporate, assessment advice into their future learning, a process referred to by Duncan (2007) as "feed-forward". Despite the value placed on assessment feedback by academic teaching staff, it often has minimal impact on students' learning (Sadler, 2010).

Past research into the impact of qualitative and quantitative feedback on student learning established that …

Does The Type Of Assessment Feedback I Give Make A Difference?: The Impact Of Qualitative And Quantitative Assessment Feedback, Maria T. Northcote, Anthony Williams, Phil Fitzsimmons, Peter W. Kilgour

Anthony Williams

Feedback provided to postgraduate students about their assessment tasks influences the way in which they reflect on their learning and themselves personally. In particular, the nature of the feedback and the way in which its dissemination is sequenced and timed can further impact how students incorporate, or don't incorporate, assessment advice into their future learning, a process referred to by Duncan (2007) as "feed-forward". Despite the value placed on assessment feedback by academic teaching staff, it often has minimal impact on students' learning (Sadler, 2010). Past research into the impact of qualitative and quantitative feedback on student learning established that …

National Assessment Program : Civics And Citizenship 2013 Year 6 And Year 10 : Technical Report, Kate O'Malley, Eveline Gebhardt, Renee Chow, Martin Murphy, Wolfram Schulz, Judy Nixon, Julian Fraillon

Dr Martin Murphy

In 1999, the State, Territory and Commonwealth Ministers of Education, meeting as the tenth Ministerial Council on Education, Employment, Training and Youth Affairs (MCEETYA), agreed to the National Goals for Schooling in the Twenty-first Century. Subsequently, MCEETYA agreed to report on progress toward the achievement of the National Goals on a nationally-comparable basis, via the National Assessment Program (NAP). As part of NAP, a three-yearly cycle of sample assessments in primary science, civics and citizenship and ICT was established. The three previous cycles of NAP – CC were conducted in 2004, 2007 and 2010. As a result of a 2010 …

Using Comparative Judgement And Online Technologies In The Assessment And Measurement Of Creative Performance And Capability, Pina Tarricone, Christopher P. Newhouse

Research outputs 2014 to 2021

In this paper we argue that comparative judgement delivered by online technologies is a viable, valid and highly reliable alternative to traditional analytical marking. In the past, comparative judgement has been underused in educational assessment and measurement, particularly in large-scale testing, mainly due to the lack of supporting technologies to facilitate the large number of judgements and judges. We describe the foundations of comparative judgement and dispel many of the old issues regarding its use in regards to time, cost and training for large-scale assessment. Studies in the use of comparative judgement and online technologies for the assessment and measurement …

A Qualitative Case Study Of Strategies For Choosing And Evaluating Alternative Assessments In Online Higher Education, Robert James Streff

Walden Dissertations and Doctoral Studies

Studies have shown that not all students are assessed effectively using standard testing formats. However, it is unclear what alternative methodology would be useful to determine whether students have acquired the skills necessary for today's global market. This research study's purpose was to understand the processes instructors use when choosing and designing alternative assessments in higher education online courses to measure student performance. Using Gagné's conditions of learning and Bloom's Taxonomy as a framework to understand these processes, this qualitative case study examined 8 participants teaching online at Midwestern public universities. Interview data and course artifacts, including syllabi, rubrics, assessments, …

National Assessment Program : Civics And Citizenship 2013 Year 6 And Year 10 : Technical Report, Kate O'Malley, Eveline Gebhardt, Renee Chow, Martin Murphy, Wolfram Schulz, Judy Nixon, Julian Fraillon

Julian Fraillon

In 1999, the State, Territory and Commonwealth Ministers of Education, meeting as the tenth Ministerial Council on Education, Employment, Training and Youth Affairs (MCEETYA), agreed to the National Goals for Schooling in the Twenty-first Century. Subsequently, MCEETYA agreed to report on progress toward the achievement of the National Goals on a nationally-comparable basis, via the National Assessment Program (NAP). As part of NAP, a three-yearly cycle of sample assessments in primary science, civics and citizenship and ICT was established. The three previous cycles of NAP – CC were conducted in 2004, 2007 and 2010. As a result of a 2010 …

National Assessment Program : Civics And Citizenship Years 6 And 10 Report 2013, Julian Fraillon, Wolfram Schulz, Judy Nixon, Eveline Gebhardt

Julian Fraillon

This report presents the findings of the 2013 National Assessment Program – Civics and Citizenship (NAP – CC) and is conducted under the auspices of the Standing Council on School Education and Early Childhood (SCSEEC) Education Council. Under the National Assessment Program, the Civics and Citizenship sample assessment is administered to a representative sample of Year 6 and Year 10 students on a triennial cycle. After three rounds of assessments – which were undertaken in 2004, 2007 and 2010 – this report looks at the 2013 assessment and examines emerging trends. The National Assessment Program – Civics and Citizenship measures …

Hacking Assessment, Phillip Dawson

2009 - 2019 ACER Research Conferences

Hackers exploit weaknesses in a system to achieve their own goals. In this paper I argue that hacking presents a significant threat to the growing world of online assessment. This threat needs to be addressed through a variety of means; technological anti-hacking approaches will not be sufficient. The most effective ways to prevent hacking may be changes to the assessment tasks themselves to make hacking less tempting; these approaches also have a range of positive side effects in terms of authenticity, transparency of criteria, and ensuring tasks involve work beyond the exam. I conclude with a brief exploration of the …

The Move To Naplan Online: The Advantages And The Road Ahead, Stanley Rabinowitz

2009 - 2019 ACER Research Conferences

The task of developing and delivering the National Assessment Program — Literacy and Numeracy (NAPLAN) online presents enormous challenges. Nonetheless, the benefits of taking this on are well worth the efforts. With a tailored test design, NAPLAN online will provide a better measure of the Australian Curriculum, more precise results and a significantly faster turnaround of those results. NAPLAN will begin its delivery online in 2017, with an opt-in period until 2019. To ensure readiness, a large amount of research is being conducted through the Australian Curriculum, Assessment and Reporting Authority to inform the development process. This presentation will address …

National Assessment Program : Civics And Citizenship 2013 Year 6 And Year 10 : Technical Report, Kate O'Malley, Eveline Gebhardt, Renee Chow, Martin Murphy, Wolfram Schulz, Judy Nixon, Julian Fraillon

Dr Wolfram Schulz

In 1999, the State, Territory and Commonwealth Ministers of Education, meeting as the tenth Ministerial Council on Education, Employment, Training and Youth Affairs (MCEETYA), agreed to the National Goals for Schooling in the Twenty-first Century. Subsequently, MCEETYA agreed to report on progress toward the achievement of the National Goals on a nationally-comparable basis, via the National Assessment Program (NAP). As part of NAP, a three-yearly cycle of sample assessments in primary science, civics and citizenship and ICT was established. The three previous cycles of NAP – CC were conducted in 2004, 2007 and 2010. As a result of a 2010 …

National Assessment Program : Civics And Citizenship Years 6 And 10 Report 2013, Julian Fraillon, Wolfram Schulz, Judy Nixon, Eveline Gebhardt

Dr Wolfram Schulz

This report presents the findings of the 2013 National Assessment Program – Civics and Citizenship (NAP – CC) and is conducted under the auspices of the Standing Council on School Education and Early Childhood (SCSEEC) Education Council. Under the National Assessment Program, the Civics and Citizenship sample assessment is administered to a representative sample of Year 6 and Year 10 students on a triennial cycle. After three rounds of assessments – which were undertaken in 2004, 2007 and 2010 – this report looks at the 2013 assessment and examines emerging trends. The National Assessment Program – Civics and Citizenship measures …

Lessons Learned From Teaching Data Analytics In A Fully Online Mode At Postgraduate Level, Daniel Mcsweeney, Markus Hoffmann, Geraldine Gray, Laura Keyes

Stream 3: Digital Campus and Universal Design

This paper reports on the experiences of developing and delivering the online MSc. in Business Intelligence and Data Mining between 2010 and 2013. We outline our rationale for the selection of Adobe Connect as a synchronous classroom tool and discuss our use of the moodle virtual learning environment to support asynchronous learning and communication. We also discuss some of the key changes in approaches to teaching and assessment and the challenges that were faced by academics in adapting classroom based courses to an online distance education environment. We conclude by examining student interactions with the synchronous and asynchronous delivery technologies …

Reducing Cheating Opportunities In Online Test, Dale Varble

Atlantic Marketing Journal

Abstract

This paper focuses on reducing cheating opportunities of online test assessment. Increasing use of online test in all course presentation formats (online, blended/hybrid or facilitated) has elevated faculty concerns of cheating. Efforts by educators to reduce cheating have been ongoing and with some success but, as the results of a study reported here more is needed.

Two sections of a course, one online and one onsite were offered the same semester, with the same instructor, syllabus, textbook and tests. The online students took all tests online. The onsite students took all exams online except the last two tests and …

The Use Of On-Line Computer Adaptive Testing To Raise Standardized Test Scores, Edward L. King, Kathleen Ronca, Nieves Aguilera

Bronx EdTech Showcase 2014

Nursing school graduates are under pressure to pass the RN-NCLEX Exam on the first attempt since New York State monitors the results and uses them to evaluate the school’s nursing programs. Since the RN-NCLEX Exam is a standardized test, we sought a method to make our students better test takers. The use of on-line computer adaptive testing has raised our student’s standardized test scores at the end of the nursing course.

National Assessment Program : Civics And Citizenship Years 6 And 10 Report 2013, Julian Fraillon, Wolfram Schulz, Judy Nixon, Eveline Gebhardt

Civics and Citizenship Assessment

This report presents the findings of the 2013 National Assessment Program – Civics and Citizenship (NAP – CC) and is conducted under the auspices of the Standing Council on School Education and Early Childhood (SCSEEC) Education Council. Under the National Assessment Program, the Civics and Citizenship sample assessment is administered to a representative sample of Year 6 and Year 10 students on a triennial cycle. After three rounds of assessments – which were undertaken in 2004, 2007 and 2010 – this report looks at the 2013 assessment and examines emerging trends. The National Assessment Program – Civics and Citizenship measures …

National Assessment Program : Civics And Citizenship 2013 Year 6 And Year 10 : Technical Report, Kate O'Malley, Eveline Gebhardt, Renee Chow, Martin Murphy, Wolfram Schulz, Judy Nixon, Julian Fraillon

Civics and Citizenship Assessment

In 1999, the State, Territory and Commonwealth Ministers of Education, meeting as the tenth Ministerial Council on Education, Employment, Training and Youth Affairs (MCEETYA), agreed to the National Goals for Schooling in the Twenty-first Century. Subsequently, MCEETYA agreed to report on progress toward the achievement of the National Goals on a nationally-comparable basis, via the National Assessment Program (NAP). As part of NAP, a three-yearly cycle of sample assessments in primary science, civics and citizenship and ICT was established. The three previous cycles of NAP – CC were conducted in 2004, 2007 and 2010. As a result of a 2010 …

Student Equity: Discouraging Cheating In Online Courses, Timothy B. Michael, Melissa A. Williams

Administrative Issues Journal

As online programs at conventional universities continue to expand, administrators and faculty face new challenges. Academic dishonesty is nothing new, but an online testing environment requires different strategies and tactics from what we have had to consider in the past. Our university has recently adapted successful face-toface programs in financial management, both graduate and undergraduate, for delivery in a fully-online format. This paper discusses our experiences moving to a new environment, the challenges of student attempts to cheat and plagiarize, and techniques that we have found to prevent both cheating on high-stakes assessments and plagiarism.We present a number of essential …

Harnessing Technology To Make Learning (And Teaching) More Fun., Barry Ryan, Julie Dunne

Conference papers

This paper describes how various technologies were introduced into foundation science modules both to enhance student engagement and feedback, and also to cope with increased teaching workload. It mostly deals with freely available software or tools available through a VLP (virtual learning platform, e.g. Blackboard or Moodle), but also includes audience response ‘Clickers’ which were purchased. The technologies discussed are user-friendly and do not require advanced IT skills. The paper includes successes, but also includes some less successful attempts to integrate technology and explores the possible reasons.

As third level funding is reduced, many academics are coming under increased pressure …

A Breath Of Fresh Air: Reflecting On The Changing Practices Of Assessment Online, Meg O'Reilly

Dr Meg O'Reilly

Prior to a flight we are reminded that in an emergency we are to place the oxygen mask on our own faces before we place them on a child to ensure we can assist the child. Unfortunately, with regard to teacher learning. ..we spend a great deal of time placing oxygen masks on other people's faces while we ourselves are suffocating" (Zederayko & Ward, 1999: 36 [28]). To breathe in some new ideas on assessment for learners in the changing online world, academic staff need to have time, energy and will for fresh reflections and collective dialogue upon their innovations. …

Using Cross-Disciplinary Action Learning Sets When Designing Online Assessment, Meg O'Reilly

Dr Meg O'Reilly

The drive to find appropriate ways to integrate online technologies into assessment has come about within Australian higher education as a consequence of widely held aspirations to remain competitive in the global marketplace. An action research initiative at Southern Cross University reported in this paper suggests both extrinsic and intrinsic reasons why academics considering online assessment may or may not follow through with immediate implementation. More specifically, a crossdisciplinary action learning set in the case study presented has shown benefits in approaching educational design as a cyclical, collegial, creative and reflexive process for planning, implementing and evaluating online assessment.

Resource Directory For Assessing Learners Online, Meg O'Reilly

Dr Meg O'Reilly

To address the need for critical research, and to target access to the wide range of resources in the field of online assessment practices in higher education now published on the Internet itself, a research project has recently commenced at Southern Cross University. This project aims to improve the online assessment practices of academic staff through reflective practice and action research. An accompanying website is under development to provide a directory of resources including examples of the practices and theories pertaining to assessment online, as well as links to published literature. The poster presentation will provide access to this resource …

Using Cross-Disciplinary Action Learning Sets When Designing Online Assessment, Meg O'Reilly

Dr Meg O'Reilly

The drive to find appropriate ways to integrate online technologies into assessment has come about within Australian higher education as a consequence of widely held aspirations to remain competitive in the global marketplace. An action research initiative at Southern Cross University reported in this paper suggests both extrinsic and intrinsic reasons why academics considering online assessment may or may not follow through with immediate implementation. More specifically, a crossdisciplinary action learning set in the case study presented has shown benefits in approaching educational design as a cyclical, collegial, creative and reflexive process for planning, implementing and evaluating online assessment.

Planting The Seeds Of Change And Growing The Fruits Of Transdisciplinary Educational Design, Meg O'Reilly

Dr Meg O'Reilly

The professional practice of educational design normally involves collaborating with a subject matter expert on a one-to-one basis and is only occasionally undertaken in teams. This thesis argues that a team-based approach to educational design is powerful and particularly so when transdisciplinary collaborations are facilitated. Transdisciplinary educational design is the process of standing outside one’s discipline to collaborate with colleagues from the technical sphere, the library and other disciplines. The common ground shared by the transdisciplinary teams in this research was student assessment.

The core data collection for this research was completed between July 2002 and June 2005. Using an …

Proctored Versus Unproctored Online Exams: Studying The Impact Of Exam Environment On Student Performance, Kimberly Hollister, Mark L. Berenson

Department of Information Management and Business Analytics Faculty Scholarship and Creative Works

Increasing numbers of universities are offering courses in online and hybrid formats. One challenge in online assessment is the maintenance of academic integrity. We present a thorough statistical analysis to uncover differences in student performance when online exams are administered in a proctored environment (i.e., in class) versus an unproctored environment (i.e., offsite). Controlling for student grade point average (GPA), no significant differences in mean overall course performance or exam performance between the two groups were found, nor were there any differences in the mean vectors of individual exam scores. The study reveals that the group taking online exams in …