Education Commons^™

Iea International Civic And Citizenship Education Study 2022: Assessment Framework, Wolfram Schulz, Julian Fraillon, Bruno Losito, Gabriella Agrusti, John Ainley, Valeria Damiani, Tim Friedman

Civics and Citizenship Assessment

The International Civic and Citizenship Education Study (ICCS) investigates the preparation of young people to undertake their roles as citizens. It gathers and analyzes data from representative national samples on students’ conceptual knowledge and understanding of civics and citizenship, as well as their attitudes to, and engagement with, aspects of civics and citizenship. ICCS builds on a succession of IEA studies in this field dating back to 1971, and especially since 2009. The 2022 study has been developed to build on previous perspectives on, and monitor changes in, such enduring issues as: levels of civic knowledge and understanding; patterns of …

Iea International Civic And Citizenship Education Study 2022: Assessment Framework [Early Online Version], Wolfram Schulz, Julian Fraillon, John Ainley, Bruno Losito, Valeria Damiani, Tim Friedman

Civics and Citizenship Assessment

The International Civic and Citizenship Study (ICCS) 2022 continues IEA’s investigation into the ways in which young people understand and are prepared to be citizens in a world where contexts of democracy and civic participation continue to change. This assessment framework provides insight into the study’s conceptual background, cognitive, affective-behavioral and contextual content, and assessment design. It also describes content relevant for the measurement of the United Nations’ Sustainable Development Goals (SDGs) that is related to Global Citizenship Education (GCED) and Education for Sustainable Development (ESD). Countries that participated in ICCS 2009, ICCS 2016, and ICCS 2022 will be able …

Timss 2019 Australia. Volume Ii: School And Classroom Contexts For Learning, Sue Thomson, Nicole Wernert, Sarah Buckley, Sima Rodrigues, Elizabeth O'Grady, Marina Schmid

TIMSS 2019

This is the second of two reports that look at the results of TIMSS 2019 and Australia’s performance. Volume I focuses specifically on the achievement results, detailing Australia’s results within the international context, and presents results for the Australian jurisdictions, and for the different demographic groups within Australia, including male and female students. This report, Volume II, presents the results from the contextual questionnaires, and examines the contexts in which learning and achievement occur, including home, school, and classroom contexts, as well as student attitudes. Each chapter focuses on different indicators that cover the school community, the school learning environment, …

Timss 2019 Australian Year 4 And Year 8 Data [Sas & Spss], Sue Thomson, Nicole Wernert, Sima Rodrigues, Elizabeth O'Grady

TIMSS 2019

This is a data source for the report TIMSS 2019 Australia. Volume I: Student performance. This dataset is available for download as a zipped file https://research.acer.edu.au/context/timss_2019/article/1002/type/native/viewcontent.

Performance Comparison Between Ib And Non-Ib School Students On The International Schools’ Assessment, Ling Tan

Monitoring Learning

This report examines the performance of students enrolled in the IB Primary Years Programme (PYP) and the IB Middle Years Programme (MYP) on the ACER International Schools’ Assessment (ISA) compared with non-IB students from the same ISA cohorts. The ISA is an assessment created especially for students in international schools in Grades 3 to 10. The assessment asks both multiple-choice and open-ended questions in the areas of writing, reading, mathematics and science, and provides international normative information about student performance. The ISA scales for Reading, Mathematical Literacy and Scientific Literacy are based on those developed for the internationally endorsed frameworks …

Australia: Pisa Australia—Excellence And Equity?, Sue Thomson

OECD Programme for International Student Assessment (PISA) Australia

Australia’s education system reflects its history of federalism. State and territory governments are responsible for administering education within their jurisdiction and across the sector comprising government (public), Catholic systemic and other independent schooling systems. They collaborate on education policy with the federal government. Over the past two decades the federal government has taken a greater role in funding across the education sector, and as a result of this involvement and the priorities of federal governments of the day, Australia now has one of the highest rates of non-government schooling in the OECD. Funding equity across the sectors has become a …

Timss 2019 Australia. Volume I: Student Performance, Sue Thomson, Nicole Wernert, Sima Rodrigues, Elizabeth O'Grady

TIMSS 2019

The Trends in International Mathematics and Science Study (TIMSS) is an international comparative study of student achievement directed by the International Association for the Evaluation of Educational Achievement (IEA). TIMSS was first conducted in 1995 and the assessment conducted in 2019 formed the seventh cycle, providing 24 years of trends in mathematics and science achievement at Year 4 and Year 8. In Australia, TIMSS is managed by the Australian Council for Educational Research (ACER) and is jointly funded by the Australian Government and the state and territory governments. The goal of TIMSS is to provide comparative information about educational achievement …

Timss 2019 Australia Highlights, Sue Thomson, Nicole Wernert, Sima Rodrigues, Elizabeth O'Grady

TIMSS 2019

Trends in International Mathematics and Science Study (TIMSS) is an international sample study that assesses the mathematics and science achievement of Year 4 and Year 8 students every four years. Australia has participated in all cycles of TIMSS since it commenced in 1995 and over this 24-year period has collected rich data about trends in mathematics and science achievement. This document provides the highlights from Volume I of the main report TIMSS 2019 Australia. Volume I: Student performance. Volume I and these Highlights focus on the achievement results, detailing Australia’s results within the international context, as well as the …

Preparing For Life In A Digital World: The Iea International Computer And Information Literacy Study 2018 International Report, Julian Fraillon, John Ainley, Wolfram Schulz, Tim Friedman, Daniel Duckworth

ICT - Digital Literacy

The second cycle of ICILS in 2018 (ICILS 2018) continued to investigate students’ computer and information literacy (CIL) and also investigated students’ computational thinking (CT). This dimension involves conceptualising problems (through algorithmic or systems thinking) and operationalising solutions (creating, implementing, and evaluating computer-based responses to problems). The inclusion of CT as an option in ICILS 2018 reflects recent interest by educators, researchers, and policymakers in the value of CT in schooling. ICILS 2018 studied how these components of digital competence related to each other and to the school and out-of-school contexts that support learning with and about computer technology. This …

Development Of Reporting Scales For Reading And Mathematics: A Report Describing The Process For Building The Uis Reporting Scales, Ross Turner, Ray Adams, Ursula Schwantner, Dan Cloney, Claire Scoular, Prue Anderson, Alexander Daraganov, Jen Jackson, Sandra Knowles, Gayl O'Connor, Pam Munro-Smith, Stavroula Zoumboulis, Pauline Rogers

Gayl O'Connor

As a technical partner of the UNESCO Institute for Statistics, ACER-GEM has created reporting scales for reading and maths, with the intention of enabling countries to examine and report the outcomes of their assessment activities using a common framework. This report gives the theoretical and contextual background to the scales, and describes the steps in the drafting process.

Development Of Reporting Scales For Reading And Mathematics: A Report Describing The Process For Building The Uis Reporting Scales, Ross Turner, Ray Adams, Ursula Schwantner, Dan Cloney, Claire Scoular, Prue Anderson, Alexander Daraganov, Jen Jackson, Sandra Knowles, Gayl O'Connor, Pam Munro-Smith, Stavroula Zoumboulis, Pauline Rogers

Dr Claire Scoular

As a technical partner of the UNESCO Institute for Statistics, ACER-GEM has created reporting scales for reading and maths, with the intention of enabling countries to examine and report the outcomes of their assessment activities using a common framework. This report gives the theoretical and contextual background to the scales, and describes the steps in the drafting process.

Development Of Reporting Scales For Reading And Mathematics: A Report Describing The Process For Building The Uis Reporting Scales, Ross Turner, Ray Adams, Ursula Schwantner, Dan Cloney, Claire Scoular, Prue Anderson, Alexander Daraganov, Jen Jackson, Sandra Knowles, Gayl O'Connor, Pam Munro-Smith, Stavroula Zoumboulis, Pauline Rogers

Professor Ray Adams

As a technical partner of the UNESCO Institute for Statistics, ACER-GEM has created reporting scales for reading and maths, with the intention of enabling countries to examine and report the outcomes of their assessment activities using a common framework. This report gives the theoretical and contextual background to the scales, and describes the steps in the drafting process.

Development Of Reporting Scales For Reading And Mathematics: A Report Describing The Process For Building The Uis Reporting Scales, Ross Turner, Ray Adams, Ursula Schwantner, Dan Cloney, Claire Scoular, Prue Anderson, Alexander Daraganov, Jen Jackson, Sandra Knowles, Gayl O'Connor, Pam Munro-Smith, Stavroula Zoumboulis, Pauline Rogers

Dr Ursula Schwantner

As a technical partner of the UNESCO Institute for Statistics, ACER-GEM has created reporting scales for reading and maths, with the intention of enabling countries to examine and report the outcomes of their assessment activities using a common framework. This report gives the theoretical and contextual background to the scales, and describes the steps in the drafting process.

Development Of Reporting Scales For Reading And Mathematics: A Report Describing The Process For Building The Uis Reporting Scales, Ross Turner, Ray Adams, Ursula Schwantner, Dan Cloney, Claire Scoular, Prue Anderson, Alexander Daraganov, Jen Jackson, Sandra Knowles, Gayl O'Connor, Pam Munro-Smith, Stavroula Zoumboulis, Pauline Rogers

Dr Dan Cloney

As a technical partner of the UNESCO Institute for Statistics, ACER-GEM has created reporting scales for reading and maths, with the intention of enabling countries to examine and report the outcomes of their assessment activities using a common framework. This report gives the theoretical and contextual background to the scales, and describes the steps in the drafting process.

Learning Progressions As An Inclusive Solution To Global Education Monitoring, Ray J. Adams, Jen Jackson, Ross Turner

Monitoring Learning

The Sustainable Development Goals (SDGs) mark a welcome shift in global discussion of education, because now we are talking not only about getting children into school, but also about making sure that they are learning. At the same time, the SDGs introduce a new layer of complexity, because we need to define what quality education means in a way that is meaningful across international contexts.

This short paper describes how the development of global learning progressions provides an innovative solution, to balance the need for flexibility and consistency in global monitoring of learning.

Development Of Reporting Scales For Reading And Mathematics: A Report Describing The Process For Building The Uis Reporting Scales, Ross Turner, Ray Adams, Ursula Schwantner, Dan Cloney, Claire Scoular, Prue Anderson, Alexander Daraganov, Jen Jackson, Sandra Knowles, Gayl O'Connor, Pam Munro-Smith, Stavroula Zoumboulis, Pauline Rogers

Monitoring Learning

As a technical partner of the UNESCO Institute for Statistics, ACER-GEM has created reporting scales for reading and maths, with the intention of enabling countries to examine and report the outcomes of their assessment activities using a common framework. This report gives the theoretical and contextual background to the scales, and describes the steps in the drafting process.

Agat : Acer General Ability Tests : Teacher Manual, Andrew Stephanou, Mark Butler, Daniel Urbach, Prue Anderson

Prue Anderson

ACER General Ability Tests (AGAT) is a series of tests designed to assist teachers of students aged seven to sixteen years (approximately Year 2 to Year 10) in their assessment of students' general reasoning ability. There are nine AGAT test booklets that have been developed especially -but not exclusively - for use in Australian schools. Each of the tests assesses students' reasoning skills in three areas: Verbal; Numerical; Abstract (visual).

Torch : Tests Of Reading Comprehension, Leila Mossenson, Andrew Stephanou, Margaret Forster, Geoff Masters, Margaret Mcgregor, Prue Anderson, Peter Hill

Prue Anderson

This set of twelve reading tests is designed to assist teachers of students from Year 3 to Year 10 in their assessment of students' reading comprehension skills. Each of the twelve reading tests consists of a reading passage and a corresponding answer sheet.

Progressive Achievement Tests In Reading : Comprehension, Vocabulary And Spelling, Andrew Stephanou, Prue Anderson, Daniel Urbach

Prue Anderson

The ACER Progressive Achievement Tests in Reading Fourth Edition (PAT Reading Fourth Edition) is a major revision of this Australian test of achievement in reading. The PAT Reading Fourth Edition is a researched and normed test for measuring student achievement in reading comprehension, word knowledge and spelling. It is designed to help teachers assess the pre-reading, reading comprehension, vocabulary knowledge and spelling skills of students from the first year of school to Year 10; and it provides teachers with objective information for setting realistic learning goals and planning effective programs. The PAT Reading Fourth Edition contains eleven normed and graded …

Difficulty As A Concept Inventory Design Consideration: An Exploratory Study Of The Concept Assessment Tool For Statics (Cats), Dana L. Denick

Open Access Dissertations

The ability for engineering students to apply mathematic, scientific and engineering knowledge to real-life problems depends greatly on developing deep conceptual knowledge that structures and relates the meaning of underlying principles. Concept inventories have emerged as a class of tests typically developed for use in higher education science and engineering courses. Concept Inventories (CIs) are multiple-choice tests that are designed to assess students' conceptual understanding within a specific content domain. For example, the CI explored within this study, the Concept Assessment Tool for Statics (CATS) is intended to measure students' understanding of the concepts underlying the domain of engineering statics. …

Torch : Tests Of Reading Comprehension, Leila Mossenson, Andrew Stephanou, Margaret Forster, Geoff N. Masters, Margaret Mcgregor, Prue Anderson, Peter Hill

Prof Geoff Masters AO

This set of twelve reading tests is designed to assist teachers of students from Year 3 to Year 10 in their assessment of students' reading comprehension skills. Each of the twelve reading tests consists of a reading passage and a corresponding answer sheet.

Item Differential In Computer Based And Paper Based Versions Of A High Stakes Tertiary Entrance Test: Diagrams And The Problem Of Annotation, Brad Jackel

Dr Brad Jackel

This paper presents the results from a tertiary entrance test that was delivered to two groups of candidates, one as a paper based test and the other as a computer based test. Item level differential reveals a pattern that appears related to item type: questions based on diagrammatic stimulus show a pattern of increased difficulty when delivered on computer. Differential in performance was not present in other sections of the test and it would appear unlikely to be explained by demographic differences between the groups. It is suggested this differential is due to the inability of the candidates to freely …

Developing Large-Scale Assessments, Ray Philpot

Ray Philpot

A seminar on large-scale assessment given to a post-graduate class at Boston College, USA. In this seminar I discussed concepts in measurement theory, explained the principles for developing large-scale assessments and gave practical advice on how high quality tests can be constructed.

What Information From Pisa Is Useful For Teachers? How Can Pisa Help Our Students To Become More Proficient?, Juliette Mendelovits, Dara Searle, Tom Lumley

Juliette Mendelovits

A frequent objection to large-scale testing programs, both national and international, is that they are used as an instrument of control, rather than as a means of providing information to effect change. Moreover, concerns about large-scale testing often take the form of objection to the specific characteristics of the assessments as being prescriptive and proscriptive, leading to a narrowing of the curriculum and the spectre of 'teaching to the test' to the exclusion of more important educational content. Taking PISA reading literacy as its focus, this paper proposes, on the contrary, that a coherent assessment system is valuable in so …

Agat : Acer General Ability Tests : Teacher Manual, Andrew Stephanou, Mark Butler, Daniel Urbach, Prue Anderson

Mark Butler

ACER General Ability Tests (AGAT) is a series of tests designed to assist teachers of students aged seven to sixteen years (approximately Year 2 to Year 10) in their assessment of students' general reasoning ability. There are nine AGAT test booklets that have been developed especially -but not exclusively - for use in Australian schools. Each of the tests assesses students' reasoning skills in three areas: Verbal; Numerical; Abstract (visual).

Trialling Of Test Items; Is The Data A Reliable Predictor Of Final Test Performance?, Ross Hudson

Dr Ross Hudson

Trialling is seen as a necessary first step in producing a reliable valid assessment tool. However, how reliable is the trialling result in terms of predicting population test performance?

Impact Of Different Item Location In Common-Item Test Equating, Luc Le

Dr Luc Tu Le

This study used real data and simulation data to investigate the impacts of different item location in common-item test equating. The real data set included responses of about 150 000 students to a generic skills test from a university survey in Columbia in 2011, where each student was assigned randomly to one of four linked test forms. Each form consisted of two of three Critical Reasoning clusters and two of three Quantitative Reasoning clusters (20 items in each cluster). The results of an analysis using Item Response Theory clearly showed that items could become more difficult when located towards the …

Which Form Of Assessment Provides The Best Information About Student Performance In Chemistry Examinations?, Ross Hudson, David Treagust

Dr Ross Hudson

Background: This study developed from observations of apparent achievement differences between male and female chemistry performances in a state university entrance examination. Male students performed more strongly than female students, especially in higher scores. Apart from the gender of the students, two other important factors that might influence student performance were format of questions (short-answer or multiple-choice) and type of questions (recall or application). Purpose: The research question addressed in this study was: Is there a relationship between performance in state university entrance examinations in chemistry and school chemistry examinations and student gender, format of questions--multiple-choice or short-answer, and conceptual …

Adaptive Testing For Psychological Assessment: How Many Items Are Enough To Run An Adaptive Testing Algorithm?, Michaela Wagner-Menghin, Geoff Masters

Prof Geoff Masters AO

Although the principles of adaptive testing were established in the psychometric literature many years ago (e.g., Weiss, 1977), and practice of adaptive testing is established in educational assessment, it is not yet widespread in psychological assessment. One obstacle to adaptive psychological testing is a lack of clarity about the necessary number of items to run an adaptive algorithm. The study explores the relationship between item bank size, test length and measurement precision. Simulated adaptive test runs (allowing a maximum of 30 items per person) out of an item bank with 10 items per ability level (covering .5 logits, 150 items …

Profiles Of Learning: The Basic Skills Testing Program In New South Wales: 1989, Geoff Masters, Jan Lokan, Brian Doig, Siek Khoo, John Lindsey, Lynette Robinson, Susan Zammit

Prof Geoff Masters AO

The 1989 Basic Skills Testing Program in New South Wales provides the most comprehensive picture yet compiled of literacy and numeracy learning in Australian primary schools. In 1989, some 53,800 Year 6 students in NSW government schools were tested in five aspects of literacy and numeracy. Another 2,300 Year 3 students took part in a pilot study. This book discusses the writing of the tests, the analysis of results, and the reporting of results to parents, teachers and schools. The aim of the basic skills tests is to describe, in positive terms, the skills that students have mastered, to identify …