Open Access. Powered by Scholars. Published by Universities.®

Education Commons

Open Access. Powered by Scholars. Published by Universities.®

Educational Assessment, Evaluation, and Research

PDF

Selected Works

Keyword
Publication Year
Publication

Articles 91 - 120 of 1287

Full-Text Articles in Education

What Remuneration Levels Should Apply To Highly Accomplished And Lead Teacher Certification, Lawrence C. Ingvarson Jun 2018

What Remuneration Levels Should Apply To Highly Accomplished And Lead Teacher Certification, Lawrence C. Ingvarson

Dr Lawrence Ingvarson (Consultant)

This expert witness report was commissioned by the Queensland Teachers’ Union in April, 2018 as part of evidence to be presented in a submission to the Queensland Industrial Relations Commission. The purpose of this report was to review research that would assist the Commission in arriving at its decision regarding appropriate remuneration levels for certified Highly Accomplished and Lead Teachers.


Development Of Reporting Scales For Reading And Mathematics: A Report Describing The Process For Building The Uis Reporting Scales, Ross Turner, Ray Adams, Ursula Schwantner, Dan Cloney, Claire Scoular, Prue Anderson, Alexander Daraganov, Jen Jackson, Sandra Knowles, Gayl O'Connor, Pam Munro-Smith, Stavroula Zoumboulis, Pauline Rogers Jun 2018

Development Of Reporting Scales For Reading And Mathematics: A Report Describing The Process For Building The Uis Reporting Scales, Ross Turner, Ray Adams, Ursula Schwantner, Dan Cloney, Claire Scoular, Prue Anderson, Alexander Daraganov, Jen Jackson, Sandra Knowles, Gayl O'Connor, Pam Munro-Smith, Stavroula Zoumboulis, Pauline Rogers

Professor Ray Adams

As a technical partner of the UNESCO Institute for Statistics, ACER-GEM has created reporting scales for reading and maths, with the intention of enabling countries to examine and report the outcomes of their assessment activities using a common framework. This report gives the theoretical and contextual background to the scales, and describes the steps in the drafting process.


Development Of Reporting Scales For Reading And Mathematics: A Report Describing The Process For Building The Uis Reporting Scales, Ross Turner, Ray Adams, Ursula Schwantner, Dan Cloney, Claire Scoular, Prue Anderson, Alexander Daraganov, Jen Jackson, Sandra Knowles, Gayl O'Connor, Pam Munro-Smith, Stavroula Zoumboulis, Pauline Rogers Jun 2018

Development Of Reporting Scales For Reading And Mathematics: A Report Describing The Process For Building The Uis Reporting Scales, Ross Turner, Ray Adams, Ursula Schwantner, Dan Cloney, Claire Scoular, Prue Anderson, Alexander Daraganov, Jen Jackson, Sandra Knowles, Gayl O'Connor, Pam Munro-Smith, Stavroula Zoumboulis, Pauline Rogers

Dr Ursula Schwantner

As a technical partner of the UNESCO Institute for Statistics, ACER-GEM has created reporting scales for reading and maths, with the intention of enabling countries to examine and report the outcomes of their assessment activities using a common framework. This report gives the theoretical and contextual background to the scales, and describes the steps in the drafting process.


A Simple Low-Cost Institutional Learning-Outcomes Assessment Process, Andrea A. Curcio Jun 2018

A Simple Low-Cost Institutional Learning-Outcomes Assessment Process, Andrea A. Curcio

Andrea A. Curcio

Law school institutional learning outcomes require measuring nuanced skills that develop over time. Rather than look at achievement just in our own courses, institutional outcome-measures assessment requires collective faculty engagement and critical thinking about our students’ overall acquisition of the skills, knowledge, and qualities that ensure they graduate with the competencies necessary to begin life as professionals. Even for those who believe outcomes assessment is a positive move in legal education, in an era of limited budgets and already over-burdened faculty, the new mandated outcomes assessment process raises cost and workload concerns. This essay addresses those concerns. It describes a …


Challenges In Stem Learning In Australian Schools: Literature And Policy Review, Michael J. Timms, Kathryn Moyle, Paul R. Weldon, Pru Mitchell May 2018

Challenges In Stem Learning In Australian Schools: Literature And Policy Review, Michael J. Timms, Kathryn Moyle, Paul R. Weldon, Pru Mitchell

Professor Kathryn Moyle (consultant)

This literature and policy review outlines the complex context related to STEM learning in Australian schools and focuses on student outcomes, the teacher workforce and the curriculum. This paper also sheds light on possible policy directions by examining lessons from other countries. STEM education is a broad enterprise that starts in early childhood education, continues through the years of schooling and extends into tertiary education supported by contributions from extracurricular and enrichment activities, science centres and museums. However, the focus in this document is on primary and secondary schooling. Australian STEM education seems caught in a whirlpool of problems that …


Challenges In Stem Learning In Australian Schools, Michael J. Timms, Kathryn Moyle, Paul R. Weldon, Pru Mitchell May 2018

Challenges In Stem Learning In Australian Schools, Michael J. Timms, Kathryn Moyle, Paul R. Weldon, Pru Mitchell

Professor Kathryn Moyle (consultant)

Australian STEM education seems caught in a whirlpool of problems that are contributing to one another. Student engagement and performance in STEM are declining, but we do not have the supply of qualified teachers we need to improve learning. The STEM curriculum is unbalanced and fragmented, leading to less interest among students. It is not possible to break out of the downward cycle from within the current system and it requires policy changes that address the issues raised in this report. This means developing well-considered, systemic and joined-up policies that address the following challenges: Improving student outcomes, building the STEM …


Challenges In Stem Learning In Australian Schools, Michael J. Timms, Kathryn Moyle, Paul R. Weldon, Pru Mitchell May 2018

Challenges In Stem Learning In Australian Schools, Michael J. Timms, Kathryn Moyle, Paul R. Weldon, Pru Mitchell

Dr Paul Weldon

Australian STEM education seems caught in a whirlpool of problems that are contributing to one another. Student engagement and performance in STEM are declining, but we do not have the supply of qualified teachers we need to improve learning. The STEM curriculum is unbalanced and fragmented, leading to less interest among students. It is not possible to break out of the downward cycle from within the current system and it requires policy changes that address the issues raised in this report. This means developing well-considered, systemic and joined-up policies that address the following challenges: Improving student outcomes, building the STEM …


Challenges In Stem Learning In Australian Schools: Literature And Policy Review, Michael J. Timms, Kathryn Moyle, Paul R. Weldon, Pru Mitchell May 2018

Challenges In Stem Learning In Australian Schools: Literature And Policy Review, Michael J. Timms, Kathryn Moyle, Paul R. Weldon, Pru Mitchell

Dr Paul Weldon

This literature and policy review outlines the complex context related to STEM learning in Australian schools and focuses on student outcomes, the teacher workforce and the curriculum. This paper also sheds light on possible policy directions by examining lessons from other countries. STEM education is a broad enterprise that starts in early childhood education, continues through the years of schooling and extends into tertiary education supported by contributions from extracurricular and enrichment activities, science centres and museums. However, the focus in this document is on primary and secondary schooling. Australian STEM education seems caught in a whirlpool of problems that …


Challenges In Stem Learning In Australian Schools, Michael J. Timms, Kathryn Moyle, Paul R. Weldon, Pru Mitchell May 2018

Challenges In Stem Learning In Australian Schools, Michael J. Timms, Kathryn Moyle, Paul R. Weldon, Pru Mitchell

Pru Mitchell

Australian STEM education seems caught in a whirlpool of problems that are contributing to one another. Student engagement and performance in STEM are declining, but we do not have the supply of qualified teachers we need to improve learning. The STEM curriculum is unbalanced and fragmented, leading to less interest among students. It is not possible to break out of the downward cycle from within the current system and it requires policy changes that address the issues raised in this report. This means developing well-considered, systemic and joined-up policies that address the following challenges: Improving student outcomes, building the STEM …


Challenges In Stem Learning In Australian Schools: Literature And Policy Review, Michael J. Timms, Kathryn Moyle, Paul R. Weldon, Pru Mitchell May 2018

Challenges In Stem Learning In Australian Schools: Literature And Policy Review, Michael J. Timms, Kathryn Moyle, Paul R. Weldon, Pru Mitchell

Pru Mitchell

This literature and policy review outlines the complex context related to STEM learning in Australian schools and focuses on student outcomes, the teacher workforce and the curriculum. This paper also sheds light on possible policy directions by examining lessons from other countries. STEM education is a broad enterprise that starts in early childhood education, continues through the years of schooling and extends into tertiary education supported by contributions from extracurricular and enrichment activities, science centres and museums. However, the focus in this document is on primary and secondary schooling. Australian STEM education seems caught in a whirlpool of problems that …


Challenges In Stem Learning In Australian Schools: Literature And Policy Review, Michael J. Timms, Kathryn Moyle, Paul R. Weldon, Pru Mitchell May 2018

Challenges In Stem Learning In Australian Schools: Literature And Policy Review, Michael J. Timms, Kathryn Moyle, Paul R. Weldon, Pru Mitchell

Dr Michael J Timms

This literature and policy review outlines the complex context related to STEM learning in Australian schools and focuses on student outcomes, the teacher workforce and the curriculum. This paper also sheds light on possible policy directions by examining lessons from other countries. STEM education is a broad enterprise that starts in early childhood education, continues through the years of schooling and extends into tertiary education supported by contributions from extracurricular and enrichment activities, science centres and museums. However, the focus in this document is on primary and secondary schooling. Australian STEM education seems caught in a whirlpool of problems that …


Challenges In Stem Learning In Australian Schools, Michael J. Timms, Kathryn Moyle, Paul R. Weldon, Pru Mitchell May 2018

Challenges In Stem Learning In Australian Schools, Michael J. Timms, Kathryn Moyle, Paul R. Weldon, Pru Mitchell

Dr Michael J Timms

Australian STEM education seems caught in a whirlpool of problems that are contributing to one another. Student engagement and performance in STEM are declining, but we do not have the supply of qualified teachers we need to improve learning. The STEM curriculum is unbalanced and fragmented, leading to less interest among students. It is not possible to break out of the downward cycle from within the current system and it requires policy changes that address the issues raised in this report. This means developing well-considered, systemic and joined-up policies that address the following challenges: Improving student outcomes, building the STEM …


Development Of Reporting Scales For Reading And Mathematics: A Report Describing The Process For Building The Uis Reporting Scales, Ross Turner, Ray Adams, Ursula Schwantner, Dan Cloney, Claire Scoular, Prue Anderson, Alexander Daraganov, Jen Jackson, Sandra Knowles, Gayl O'Connor, Pam Munro-Smith, Stavroula Zoumboulis, Pauline Rogers May 2018

Development Of Reporting Scales For Reading And Mathematics: A Report Describing The Process For Building The Uis Reporting Scales, Ross Turner, Ray Adams, Ursula Schwantner, Dan Cloney, Claire Scoular, Prue Anderson, Alexander Daraganov, Jen Jackson, Sandra Knowles, Gayl O'Connor, Pam Munro-Smith, Stavroula Zoumboulis, Pauline Rogers

Dr Dan Cloney

As a technical partner of the UNESCO Institute for Statistics, ACER-GEM has created reporting scales for reading and maths, with the intention of enabling countries to examine and report the outcomes of their assessment activities using a common framework. This report gives the theoretical and contextual background to the scales, and describes the steps in the drafting process.


Young People’S Views Of Government, Peaceful Coexistence, And Diversity In Five Latin American Countries: Iea International Civic And Citizenship Education Study 2016 Latin American Report, Wolfram Schulz, John Ainley, Cristián Cox, Tim Friedman May 2018

Young People’S Views Of Government, Peaceful Coexistence, And Diversity In Five Latin American Countries: Iea International Civic And Citizenship Education Study 2016 Latin American Report, Wolfram Schulz, John Ainley, Cristián Cox, Tim Friedman

Dr Wolfram Schulz

ICCS 2016 was the second cycle of the IEA Civic and Citizenship Education Study (ICCS). ICCS studies the ways in which education systems from around the world prepare young people to undertake their roles as citizens in society. In Latin America, this area of learning is set within particular challenges and contexts. Compared to established Western democracies, most countries in this region returned to democratic rule only three or four decades ago or even more recently, and their political, social, and economic stability continues to be called into question. Surveys have consistently found that commitment to democracy among adults in …


Single-Sex Schooling And Girls’ Achievement In Australia, Katherine Dix May 2018

Single-Sex Schooling And Girls’ Achievement In Australia, Katherine Dix

Dr Katherine Dix

Data from research studies such as the Progress in International Reading Literacy Study (PIRLS), the Programme for International Student Assessment (PISA), Trends in Mathematics and Science Study (TIMSS), and NAPLAN have been utilised to compare girls’ and boys’ academic achievement in single-sex and co-educational schools. The data sets, which inform policy monitoring by identifying key performance measures and evaluating progress towards educational goals for Australian students by international standards, are examined to identify any gender biases in Australian and international trends in reading and mathematics for Years 3-4 to Year 9 students. The effects of socio-economic status, year level and …


A Qualitative Analysis Of Student Writing Rejected By An Automated Essay Scoring System, Nathanael Reinertsen, Toby Newton, Caithlin Power Apr 2018

A Qualitative Analysis Of Student Writing Rejected By An Automated Essay Scoring System, Nathanael Reinertsen, Toby Newton, Caithlin Power

Nathanael Reinertsen

The Australian Council for Educational Research’s online writing assessment, eWrite, uses Vantage Learning’s Intellimetric automated essay scoring (AES) system to score students’ writing. Approximately 5% of submissions are returned by the AES system unmarked and tagged with an error code, and are subsequently marked by a trained human rater. The raters provide numeric scores using an analytic rubric, and in some instances also provide written commentary about the scores.
 
This paper reports on a qualitative analysis of the commentaries of a sample of 86 scripts from 84 writers that were rejected by the AES and marked by trained human …


Initial Feasibility And Efficacy Of An Interprofessional Education Pilot Program, Katie Baker, Kerry Proctor-Williams, L. Brian Cross, Elizabeth Alley, Michael Crouch Apr 2018

Initial Feasibility And Efficacy Of An Interprofessional Education Pilot Program, Katie Baker, Kerry Proctor-Williams, L. Brian Cross, Elizabeth Alley, Michael Crouch

Kerry Proctor-Williams

No abstract provided.


Creating A Stem Identity: Investment With Return, Janet Callahan, Patricia Pyke, Susan Shadle, R. Eric Landrum Mar 2018

Creating A Stem Identity: Investment With Return, Janet Callahan, Patricia Pyke, Susan Shadle, R. Eric Landrum

R. Eric Landrum

Establishing a strong STEM (science, technology, engineering and mathematics) identity at Boise State University, a metropolitan campus with approximately 3,655 undergraduate STEM students and a total undergraduate enrollment of approximately 19,042 (16,136 FTE) has been an important step toward creating a climate conducive to facilitating fundamental change. Examples of such change include building collaborations among faculty within and across departments, establishing the identity of students as part of a community beyond their chosen major, improving the efficiency and effectiveness of university systems, and perhaps most importantly, developing a framework to think deliberately about ways to effect change. This paper is …


Digitalcommons@Lesley Quarterly Report & Impact Infographic - December 2017, Philip M. Siblo-Landsman Mar 2018

Digitalcommons@Lesley Quarterly Report & Impact Infographic - December 2017, Philip M. Siblo-Landsman

Philip M. Siblo-Landsman

Lesley University's institutional repository (IR) continues to grow since it's launch in May 2017. This report discusses the addition of new collections including the migration of an academic journal, and the addition of two conferences. It also discusses the outreach efforts of the digital team and comments on the download metrics and how they indicate the demographics of users accessing Lesley scholarly and creative works. An infographic is included to provide a visual report of these metrics and to highlight the impact of Lesley scholarship.


Lesley University Library Newsletter, Vol. 2(1), Hedi Benaicha, Rachel Fernandez, Micki Harrington, Philip M. Siblo-Landsman, Abby Mancini, Mikayla Collins, Sam Quiñon Mar 2018

Lesley University Library Newsletter, Vol. 2(1), Hedi Benaicha, Rachel Fernandez, Micki Harrington, Philip M. Siblo-Landsman, Abby Mancini, Mikayla Collins, Sam Quiñon

Philip M. Siblo-Landsman

The second volume of the Lesley University Library Newsletter debuts a new layout. Topics covered include an overview of the 2016-2017 academic year, new library resources, an article on the librarian as a generalist, new faculty workshops, the development of information literacy tools for online learning, and an overview of scholarly publishing tools.


Starting At The End: Measuring Learning Using Retrospective Pre-Post Evaluations, Debi Lang, Judith A. Savageau Mar 2018

Starting At The End: Measuring Learning Using Retrospective Pre-Post Evaluations, Debi Lang, Judith A. Savageau

Judith A. Savageau

Blog post to AEA365, a blog sponsored by the American Evaluation Association (AEA) dedicated to highlighting Hot Tips, Cool Tricks, Rad Resources, and Lessons Learned for evaluators. The American Evaluation Association is an international professional association of evaluators devoted to the application and exploration of program evaluation, personnel evaluation, technology, and many other forms of evaluation. Evaluation involves assessing the strengths and weaknesses of programs, policies, personnel, products, and organizations to improve their effectiveness.


National Assessment Program: Sample Assessment: Civics And Citizenship Report: Years 6 And 10: 2016, Julian Fraillon, Eveline Gebhardt, Judy Nixon, Louise Oakwell, Tim Friedman, Michelle Robins, Mark Mcandrew Mar 2018

National Assessment Program: Sample Assessment: Civics And Citizenship Report: Years 6 And 10: 2016, Julian Fraillon, Eveline Gebhardt, Judy Nixon, Louise Oakwell, Tim Friedman, Michelle Robins, Mark Mcandrew

Julian Fraillon

Under the National Assessment Program, the Civics and Citizenship sample assessment is administered to a representative sample of Year 6 and Year 10 students every three years. It is conducted under the auspices of the Education Council. The National Assessment Program – Civics and Citizenship assesses students’ skills, knowledge and understandings of Australia’s system of government, civic institutions and the values which underpin Australia’s democracy. It also provides an indication of student attitudes and their engagement in civic-related activities at school and in the community. This report presents the findings of the fifth National Assessment Program – Civics and Citizenship …


Using Technology To Bolster Student Engagement While Validating Course Curricula: A Case Study Of Two Graduate Health Management Programs, Elizaveta Walker, Sherril B. Gelmon Feb 2018

Using Technology To Bolster Student Engagement While Validating Course Curricula: A Case Study Of Two Graduate Health Management Programs, Elizaveta Walker, Sherril B. Gelmon

Elizaveta Walker

The successful administration of a competency-based curriculum is dependent on the quality of the assessment practices used to track competency development and demonstration. Practices that foster and sustain student engagement are critical to implementing robust competency-based assessment. This case study of the successful implementation of competency-based assessment in two related graduate health management programs identifies four such practices: (a) providing assessment opportunities at multiple intervals throughout the graduate program; (b) implementing assessment technologies to collect responses through contemporary channels (mobile-friendly assessments and computer-based evaluations); (c) utilizing student feedback to improve future assessment cycles; and (d) linking competency attainment with coursework …


Improving Quality Education And Children’S Learning Outcomes And Effective Practices In The Eastern And Southern Africa Region : Main Report, Tim Friedman, Ursula Schwantner, Jeaniene Spink, Naoko Tabata, Charlotte Waters Feb 2018

Improving Quality Education And Children’S Learning Outcomes And Effective Practices In The Eastern And Southern Africa Region : Main Report, Tim Friedman, Ursula Schwantner, Jeaniene Spink, Naoko Tabata, Charlotte Waters

Dr Ursula Schwantner

In order to understand the major impediments to student learning in the region, UNICEF Eastern and Southern Africa Regional Office commissioned this study to map and compare existing assessments of literacy and numeracy in primary education in the region, to examine how the data can be used to characterise children who are experiencing only limited learning outcomes to inform education policy, and to document practices that could help improve learning outcomes of disadvantaged children. The report concludes with a macro theory of change combining assessment, analysis and action. The research was jointly supported by ACER's Centre for Global Education Monitoring.


Improving Quality Education And Children’S Learning Outcomes And Effective Practices In The Eastern And Southern Africa Region : Appendices, Tim Friedman, Ursula Schwantner, Jeaniene Spink, Naoko Tabata, Charlotte Waters Feb 2018

Improving Quality Education And Children’S Learning Outcomes And Effective Practices In The Eastern And Southern Africa Region : Appendices, Tim Friedman, Ursula Schwantner, Jeaniene Spink, Naoko Tabata, Charlotte Waters

Dr Ursula Schwantner

These appendices comprises a collection of tables, figures, methodology and country case study notes to support the main report of this study: Improving Quality Education and Children’s Learning Outcomes and Effective Practices in the Eastern and Southern Africa Region : Main report.


Improving Quality Education And Children’S Learning Outcomes And Effective Practices In The Eastern And Southern Africa Region : Rwanda : Country Case Study, Ursula Schwantner Feb 2018

Improving Quality Education And Children’S Learning Outcomes And Effective Practices In The Eastern And Southern Africa Region : Rwanda : Country Case Study, Ursula Schwantner

Dr Ursula Schwantner

This case study of Rwanda provides an understanding of the specific practices implemented to measure and improve the literacy and numeracy learning outcomes of Rwandan primary school children in the long term. An important development regarding the quality standards and assurance programme of education in Rwanda is the 2011 introduction of Learning Achievement in Rwandan Schools (LARS). This case study outlines the main purposes and components of LARS, the main findings regarding effective strategies and factors from the LARS baseline report and the capacity building component of LARS.


School Psychologists’ Knowledge And Self-Efficacy In Working With Students With Tbi, Ann E. Glang, Melissa Mccart, Christabelle Moore, Susan C. Davies Feb 2018

School Psychologists’ Knowledge And Self-Efficacy In Working With Students With Tbi, Ann E. Glang, Melissa Mccart, Christabelle Moore, Susan C. Davies

Susan C. Davies

Approximately 145,000 U.S. children experience lasting effects of traumatic brain injury (TBI) that manifest in social, behavioural, physical, and cognitive challenges in the school setting. School psychologists have an essential role in identifying students who need support and in determining eligibility under the Individuals with Disabilities Education Act. The purpose of this study was to assess the knowledge and perception of abilities related to TBI in a sample of school psychologists currently working in public schools. We surveyed school psychologists and found persistently low levels of knowledge and of perceived preparedness to work with these students. School psychologists with more …


Australian Child Wellbeing Project Technical Report, Petra Lietz, Elizabeth O'Grady, Mollie Tobin, Martin Murphy, Greg Macaskill, Gerry Redmond, Katherine Dix, Sue Thomson Jan 2018

Australian Child Wellbeing Project Technical Report, Petra Lietz, Elizabeth O'Grady, Mollie Tobin, Martin Murphy, Greg Macaskill, Gerry Redmond, Katherine Dix, Sue Thomson

Dr Katherine Dix

The Australian Child Wellbeing Project (ACWP) was conducted from 2012 – 2015 using a mixed-methods, child-centred approach. Young people’s perspectives were used to inform a nationally representative survey of children’s wellbeing in the middle years. The aims of the ACWP survey were to benchmark child wellbeing in Australia and to provide useful information for services that promote young people’s healthy development. A final outcome of this project was to make the extensive ACWP database publically available in order to provide further opportunity to exploit the rich data and improve understanding. Accordingly, this technical report consolidates the research conducted by ACER …


The Question Of School Resources And Student Achievement: A History And Reconsideration, Larry Hedges, Terri D. Pigott, Joshua Polanin, Ann Marie Ryan, Charles Tocci, Ryan T. Williams Jan 2018

The Question Of School Resources And Student Achievement: A History And Reconsideration, Larry Hedges, Terri D. Pigott, Joshua Polanin, Ann Marie Ryan, Charles Tocci, Ryan T. Williams

Terri Pigott

One question posed continually over the past century of education research is to what extent school resources affect student outcomes. From the turn of the century to the present, a diverse set of actors, including politicians, physicians, and researchers from a number of disciplines, have studied whether and how money that is provided for schools translates into increased student achievement. The authors discuss the historical origins of the question of whether school resources relate to student achievement, and report the results of a meta- analysis of studies examining that relationship. They find that policymakers, researchers, and other stakeholders have addressed …


Why Can’T It Mark This One? A Qualitative Analysis Of Student Writing Rejected By An Automated Essay Scoring System, Nathanael Reinertsen Dec 2017

Why Can’T It Mark This One? A Qualitative Analysis Of Student Writing Rejected By An Automated Essay Scoring System, Nathanael Reinertsen

Nathanael Reinertsen

The difference in how humans read and how Automatic Essay Scoring (AES) systems process written language leads to a situation where a portion of student responses will be comprehensible to human markers, while being unable to be parsed by AES systems. This paper examines a number of pieces of student writing that were marked by trained human markers, but subsequently rejected by an AES system during the development of a scoring model for the eWrite online writing assessment that is offered by The Australian Council for Educational Research. The features of these ‘unscoreable’ responses are examined through a qualitative analysis. …