Education Commons^™

“In Lantite, No One Can Hear You Scream!” Student Voices Of High-Stakes Testing In Teacher Education., Alison L. Hilton, Rebecca Saunders, Caroline Mansfield

Australian Journal of Teacher Education

This article investigates pre-service teachers’ experiences of undertaking LANTITE, a high-stakes literacy and numeracy test for initial teacher education students. In this mixed methods study, 189 initial teacher education students from 28 Australian universities participated in an online questionnaire, with 27 students going on to take part in semi-structured telephone interviews. Indicative findings give voice to those most impacted by the implementation of LANTITE in 2017, revealing student concerns about the processing and return of results, and test anxiety. This study provides a unique insight into the experiences of completing this high-stakes test.

Above-Level Test Item Functioning Across Examinee Age Groups, Russell Warne, Kristine Doty, Anne Marie Malbica, Victor Angeles, Scott Innes, Jared Hall, Kelli Masterson-Nixon

Russell T Warne

Group Of National Experts On The Ahelo Feasibility Study : Engineering Assessment Framework : Ahelo Feasibility Study, Hamish Coates, Sarah Richardson, Jacob Pearce, Julian Fraillon

Julian Fraillon

This AHELO Engineering Assessment Framework describes and illustrates the domain of engineering competency that is used in the AHELO Feasibility Study. The framework gives an organisational structure for the domain in terms of engineering knowledge, processes and contexts; describes the types of assessment items that have been developed; and details how reporting will be carried out. - p.4

Pisa In Brief : Highlights From The Full Australian Report : Challenges For Australian Education : Results From Pisa 2009 : The Pisa 2009 Assessment Of Students' Reading, Mathematical And Scientific Literacy., Sue Thomson, Lisa De Bortoli, Marina Nicholas, Kylie Hillman, Sarah Buckley

Kylie Hillman

No abstract provided.

Pisa In Brief : Highlights From The Full Australian Report : Challenges For Australian Education : Results From Pisa 2009 : The Pisa 2009 Assessment Of Students' Reading, Mathematical And Scientific Literacy., Sue Thomson, Lisa De Bortoli, Marina Nicholas, Kylie Hillman, Sarah Buckley

Kylie Hillman

No abstract provided.

Pisa In Brief : Highlights From The Full Australian Report : Challenges For Australian Education : Results From Pisa 2009 : The Pisa 2009 Assessment Of Students' Reading, Mathematical And Scientific Literacy., Sue Thomson, Lisa De Bortoli, Marina Nicholas, Kylie Hillman, Sarah Buckley

Kylie Hillman

No abstract provided.

Mapping Student Achievement, Geoff Masters, Ray Adams, Jan Lokan

Prof Ray Adams

The analyses, publications and reports of quantitative data in education and the social sciences usually omit basic information on the construct measured. Probabilistic models for test data make it possible to delineate coherent and richly described measurement continua that facilitate interpretation of student achievement. The potential of conjoint measurement to bring about fundamental advances in educational testing practice lies in part in the opportunities it provides to build useful maps of learning domains and to use those maps in communicating student achievements. This chapter presents two applications of conjoint measurement aimed at constructing and describing achievement variables, developing insights into …

Group Of National Experts On The Ahelo Feasibility Study : Contextual Dimension Framework : Ahelo Feasibility Study : 8th Meeting Of The Ahelo Gne, Paris, 28-29 November 2011, Daniel Edwards

Dr Daniel Edwards

The document provides an overview of the framework and instruments used in the AHELO contextual dimension. Building on prior work, it describes development of a framework that charts an understanding of contexts of most relevance to contemporary higher education. It describes the properties of instruments that operationalise this framework in efficient, technically informed and environmentally relevant ways. The instruments are designed to yield data on systems, institutions, teachers and students. Importantly, this data will be combined with information on student learning outcomes.

Perceptions Of Kentucky Educators Concerning The Kentucky State Assessment System As An Accurate Reflection Of Student Learning, Benny C. Lile

Dissertations

While educational testing has been in place since the one room school house, it was not until the 1990s that accountability began to accompany assessment programs. With the passage of the No Child Left Behind Act (NCLB) in 2001, virtually every public school district in the United States of America that desired to continue to receive Title 1 funding found themselves tied to rigorous assessment and accountability systems. This focus on accountability has impacted every school, district, and state as they have sought to implement and deal with the consequences it has wrought. As the 50 states have sought to …

Group Of National Experts On The Ahelo Feasibility Study : Engineering Assessment Framework : Ahelo Feasibility Study, Hamish Coates, Sarah Richardson, Jacob Pearce, Julian Fraillon

Dr Jacob Pearce

This AHELO Engineering Assessment Framework describes and illustrates the domain of engineering competency that is used in the AHELO Feasibility Study. The framework gives an organisational structure for the domain in terms of engineering knowledge, processes and contexts; describes the types of assessment items that have been developed; and details how reporting will be carried out. - p.4

Open-Ended (Extended/Constructed) Response Questions As Predictors Of Success On Subsequent State Mathematics Examination : The Influence Of Mathematical Awareness And Conceptual Knowledge, Kathy Ann Gullie

Legacy Theses & Dissertations (2009 - 2024)

This study investigated the predictive ability of students' responses to open-ended, constructed/extended questions in third and fourth grade mathematics content sub-categories on subsequent fifth grade mathematics achievement proficiency levels. Open-ended, extended/constructed response questions reflected content as outlined by the National Council of Teachers of Mathematics (2007) in statistics and probability, number sense, numeration and operations, geometry, algebra, and measurement. Archival data from over 300 third, fourth and fifth grade students in one public school in New York State during the 2003- 2009 academic school years were utilized. Third grade predictor variables included statistics and probability, number sense, numeration and operations, …

Pisa In Brief : Highlights From The Full Australian Report : Challenges For Australian Education : Results From Pisa 2009 : The Pisa 2009 Assessment Of Students' Reading, Mathematical And Scientific Literacy., Sue Thomson, Lisa De Bortoli, Marina Nicholas, Kylie Hillman, Sarah Buckley

Lisa De Bortoli

No abstract provided.

Pisa Science 2006 : International Results, John Cresswell

Dr John Cresswell

Throughout the world education authorities want to know the capacities that their students develop during their formative years at school. They want to know to what extent students have learned fundamental scientific concepts and theories and how well they can solve real-life problems involving science and technology. In order to provide answers to these questions, PISA provides an international benchmark. Unlike many traditional assessments of student performance in science, PISA is not limited to measuring students' mastery of specific science content. Instead, it measures the capacity of students to identify scientific issues, explain phenomena scientifically and use scientific evidence. These …

Developing Tests And Questionnaires For A National Assessment Of Educational Achievement, Prue Anderson, George Morgan

Assessment and Reporting

This book addresses the design of two types of data collection instruments: student achievement tests and background questionnaires. Part 1 covers the development of an assessment framework and a test blueprint, item writing, pretesting, and final test layout. Part 2 delineates comparable stages and activities in the construction of background questionnaires, which are used to gather information from students, teachers, head teachers, or parents on variables that might help explain differences in student performance on the achievement test. Part 3 describes how to design a manual for test administration to help ensure that all students take the test under standardised …

Developing Tests And Questionnaires For A National Assessment Of Educational Achievement, Prue Anderson, George Morgan

Prue Anderson

The authors introduce readers to the activities involved in the development of achievement tests, including developing as assessment framework, writing multiple choice and constructed response type items, pretesting, producing test booklets, and handscoring items. A section on questionnaire construction features designing questionnaires, writing questions, coding responses, and linking questionnaire and test score data. The final section covers the development of a test administration manual, selecting test administrators, and contacting sampled schools. A companion CD contains examples of released items from national and international tests, sample questionnaires, and administrative manuals. [Back cover, ed]

Mathematics Placement Test: Helping Students Succeed, Norma Rueda, Carole Sokolowski

Mathematics Faculty Publications

A study was conducted at Merrimack College in Massachusetts to compare the grades of students who took the recommended course as determined by their mathematics placement exam score and those who did not follow this recommendation. The goal was to decide whether the mathematics placement exam used at Merrimack College was effective in placing students in the appropriate mathematics class. During five years, first-year students who took a mathematics course in the fall semester were categorized into four groups: those who took the recommended course, those who took an easier course than recommended, those who took a course more difficult …

Response To 'Cautions On Oecd's Recent Educational Survey (Pisa), Ray Adams

Prof Ray Adams

This paper refers to the work of S J Prais who questioned the outcomes of the Organisation for Economic Cooperation and Development's PISA survey of the reading, mathematics and science attainments of fifteen year-olds. Prais suggested that methodological flaws in Programme for International Student Assessment (PISA) had resulted in an apparent improvement in the attainment of British students, particularly when compared to their Swiss and German counterparts. This paper responds to Prais's criticisms, noting that when Prais's conjectures are tested with empirical data they are not supported. The author argues that many of Prais's criticisms are due to an incomplete …

Pisa 2000 Technical Report, Ray Adams (Ed), Margaret Wu (Ed)

Professor Ray Adams

The Programme for International Student Assessment (PISA) was launched by the OECD to provide internationally comparable evidence on student performance. This technical report is the product of a collaborative effort between the countries participating in PISA and the experts and the institutions working within the framework of the International PISA Consortium.

Measuring Student Knowledge And Skills : The Pisa 2000 Assessment Of Reading, Mathematical And Scientific Literacy, Andreas Schieicher, Claudia Tamassia, Geoff Masters, Ray Adams

Prof Ray Adams

Acer Conquest: Generalised Item Response Modelling Software, Margaret Wu, Ray Adams, M Wilson

Prof Ray Adams

ACER Conquest is a computer program for fitting item response and latent regression models. It provides a comprehensive and flexible range of item response models to analysts, allowing them to examine the properties of performance assessment, traditional assessments and rating scales. This manual examines ACER ConQuest in detail, includes a tutorial and coverage of technical matters.

Applications Of Item Response Theory In The Third International Mathematics And Science Study, E Gonzalez, Ray Adams, Marg Wu

Prof Ray Adams

The Third International Mathematics and Science Study (TIMSS) is a survey of mathematics and science achievement sponsored by the International Association for the Evaluation of Educational Achievement. With more than 45 participating countries, three target populations, more than thirty languages, 15,000 schools, more than half a million students, TIMSS is the largest and most ambitious international study of educational achievement ever undertaken. Students participating in the assessment were administered one of eight achievement tests that contain items in mathematics and science, using a variety of item formats. As TIMSS is an international study, many audiences will look at the results …

Rasch Models Of Multidimensionality Between Items And Within Items, W Wen-Chung, M Wilson, Ray Adams

Prof Ray Adams

This chapter focuses on Rasch measurement and extends it to multidimensional Rasch models. The author first clarifies multidimensionality at two levels: the item level and the test level. With this two way classification, three kinds of tests are formed: undimensional tests, multidimensional between-item tests, and multidimensional within-item tests. The author describes a multidimensional Rasch model, the multidimensional random coefficients multinomial logit (MRCML) model, for multidimensional tests. The model, when applied to multidimensional between-item tests, is more efficient than are unidimensional models in terms of model fit and reliability indices. The model can also be applied to investigate scale interaction of …

Bias In Weighted Likelihood Estimation When Using The Rasch Model, D Roberts, Ray Adams

Prof Ray Adams

There are three methods of maximum likelihood estimation that are commonly used with Rasch item response models: Joint maximum likelihood, which provides point estimates for both person and item parameters; conditional maximum likelihood, which produces estimates for the item parameters only, and marginal maximum likelihood, which produces estimates of the item parameters and parameters of the distribution from which it has been assumed that the persons have been sampled. A number of approaches have been suggested for obtaining ability estimates for subsequent use in reporting or analysis when either conditional or marginal methods have been used to obtain the item …

Mapping Student Achievement, Geoff Masters, Ray Adams, Jan Lokan

Prof Geoff Masters AO

The analyses, publications and reports of quantitative data in education and the social sciences usually omit basic information on the construct measured. Probabilistic models for test data make it possible to delineate coherent and richly described measurement continua that facilitate interpretation of student achievement. The potential of conjoint measurement to bring about fundamental advances in educational testing practice lies in part in the opportunities it provides to build useful maps of learning domains and to use those maps in communicating student achievements. This chapter presents two applications of conjoint measurement aimed at constructing and describing achievement variables, developing insights into …

Educational Measurement: Prospects For Research And Innovation, Geoff Masters

Prof Geoff Masters AO

No abstract provided.

Constructing An Item Bank Using Partial Credit Scoring, Geoff Masters

Prof Geoff Masters AO

A method for banking test items scored in several ordered response categories is described. Each item is seen as an ordered sequence of steps, and test forms are equated using the estimated difficulties of the steps in their shared items. Procedures for analyzing the internal consistency of individual links and for analyzing the coherence of an entire linking structure are described. The methodology is used to link six forms of a mathematics problem solving test.

The Australian Council For Educational Research 1930-80, William Fraser Connell

ACER historical documents

This book is a comprehensive history of the Australian Council for Educational Research throughout the 50 years of its existence. It is based on an examination of the archival material accumulated at the ACER, the Carnegie Corporation of New York, the Australian Archives, and the records of the Australian Education Council. It examines the interest and impact of the Carnegie Corporation on the early years of the ACER, reports on the development of educational research in Australia and the influence of the ACER on it. The ACER's interest in educational and psychological measurement is explained, and its range of other …

Ends And Means In Arithmetic, Australian Council For Educational Research (Acer)

Primary School Studies

First published in 1952, this pamphlet suggests there is need for a new approach to the subject of applied arithmetic. But social utility, if not the sole justification of arithmetic, is the main one. If it were applied as a touchstone to the litter of wearisome material that clutters up the present courses, much would be found false and useless. Perhaps if we could agree upon the ends that arithmetic should serve, we would have gone a long" way towards finding the means to attain them.