Open Access. Powered by Scholars. Published by Universities.®

Education Commons

Open Access. Powered by Scholars. Published by Universities.®

Articles 1 - 10 of 10

Full-Text Articles in Education

Scaling Procedures For Iccs Test Items, Wolfram Schulz, Julian Fraillon Aug 2012

Scaling Procedures For Iccs Test Items, Wolfram Schulz, Julian Fraillon

Julian Fraillon

This chapter describes the procedures used to analyse and scale the International Civic and Citizenship Education Study (ICCS) international and regional test items that were administered to measure students’ civic knowledge. The chapter covers the following topics: the scaling model used to analyze and scale the test items; test coverage and item dimensionality; assessment of item fit; assessment of scorer reliabilities for open-ended items; differential item functioning by gender; review of cross-national measurement equivalence; international item adjudication; international item calibration and test reliability; international ability estimates (plausible values and weighted likelihood estimates); estimation of changes in civic content knowledge between …


Overview Of The Iea International Civic And Citizenship Education Study, John Ainley, Wolfram Schulz Aug 2012

Overview Of The Iea International Civic And Citizenship Education Study, John Ainley, Wolfram Schulz

Dr John Ainley

The International Civic and Citizenship Education Study (ICCS) studied the ways in which young people are prepared to undertake their roles as citizens. ICCS was based on the premise that preparing students for citizenship roles involves developing relevant knowledge and understanding as well as helping them form positive attitudes toward being a citizen and participating in activities related to civic and citizenship education. It also examined differences among countries in relation to these outcomes of civic and citizenship education, and it explored how differences among countries relate to student characteristics, school and community contexts, and national characteristics. This technical report …


Translation And National Adaptations Of Iccs 2009 Instruments, Barbara Malak, Alana Yu, Wolfram Schulz, Tim Friedman Jul 2012

Translation And National Adaptations Of Iccs 2009 Instruments, Barbara Malak, Alana Yu, Wolfram Schulz, Tim Friedman

Dr Tim Friedman

In close collaboration with the participating countries, the international study center (ISC) developed an international English version of the ICCS assessment and questionnaires. These materials were subsequently translated and adapted by countries to their languages of instruction. Throughout this translation and adaptation process, the overarching aim was to create high-quality instruments that were internationally comparable yet also appropriate to each country’s national context and education system. The ICCS instruments were administered in 31 languages, the most common being English and Spanish. Even when the language of testing was English, adaptations were still required to suit the cultural setting and the …


Priorities For Civic And Citizenship Education In Europe, David Kerr, Linda Sturman, Tim Friedman Apr 2011

Priorities For Civic And Citizenship Education In Europe, David Kerr, Linda Sturman, Tim Friedman

Civics and Citizenship Assessment

The International Civic and Citizenship Education Study (ICCS) focused on the ways in which young people are prepared to undertake their roles as citizens. Preparing students for citizenship involves developing relevant knowledge and understanding as well as encouraging the formation of positive attitudes toward being a citizen. The conceptual background for, and the design of ICCS were described in the assessment framework (Schulz, Fraillon, Ainley, Losito, & Kerr, 2008) and the international results were reported in its international reports (Schulz, Ainley, Fraillon, Kerr & Losito, 2010a & 2010b). This paper provides an overview of the results from the regional assessment …


Design And Implementation Of The Iea Civic And Citizenship Education Study, Tim Friedman, Julian Fraillon, Barbara Malak Apr 2011

Design And Implementation Of The Iea Civic And Citizenship Education Study, Tim Friedman, Julian Fraillon, Barbara Malak

Civics and Citizenship Assessment

This paper provides an overview of the International Civic and Citizenship Education Study (ICCS) and summarizes different aspects of the study implementation. It outlines: the structure of the assessment framework; the design, development and implementation of instruments; the sampling design and outcomes; and quality control measures for the study.


Scaling Procedures For Iccs Questionnaire Items, Wolfram Schulz, Tim Friedman Dec 2010

Scaling Procedures For Iccs Questionnaire Items, Wolfram Schulz, Tim Friedman

Dr Wolfram Schulz

This chapter describes the procedures used to scale the International Civic and Citizenship Education Study (ICCS) questionnaire data (for students, teachers, and schools) and the indices based on them. In general, it is possible to distinguish two general types of indices derived from the ICCS questionnaires: 1. Simple indices constructed through arithmetical transformation or recoding, for example, ratios between teachers and students; and 2. Scale indices derived from scaling of items, a process typically achieved by using item response modeling of dichotomous or Likert-type items. The first part of this chapter lists the simple indices that were derived from the …


Scaling Procedures For Iccs Test Items, Wolfram Schulz, Julian Fraillon Dec 2010

Scaling Procedures For Iccs Test Items, Wolfram Schulz, Julian Fraillon

Dr Wolfram Schulz

This chapter describes the procedures used to analyse and scale the International Civic and Citizenship Education Study (ICCS) international and regional test items that were administered to measure students’ civic knowledge. The chapter covers the following topics: the scaling model used to analyze and scale the test items; test coverage and item dimensionality; assessment of item fit; assessment of scorer reliabilities for open-ended items; differential item functioning by gender; review of cross-national measurement equivalence; international item adjudication; international item calibration and test reliability; international ability estimates (plausible values and weighted likelihood estimates); estimation of changes in civic content knowledge between …


The Reporting Of Iccs Results, Wolfram Schulz Dec 2010

The Reporting Of Iccs Results, Wolfram Schulz

Dr Wolfram Schulz

This chapter describes the procedures that were used to report results in the International Civic and Citizenship Education Study (ICCS) publications. The chapter begins with a description of the replication methodology used to estimate sampling variance and then provides an outline of how the imputation variance of the civic knowledge scores was computed. The subsequent section describes how the significance tests for differences between country and subsample means or percentages were conducted. This chapter also includes descriptions of how the multiple regression analyses were conducted and how the hierarchical models explaining civic knowledge were estimated. The final section of the …


Iccs Questionnaire Development, Wolfram Schulz, Bruno Losito, David Kerr Dec 2010

Iccs Questionnaire Development, Wolfram Schulz, Bruno Losito, David Kerr

Dr Wolfram Schulz

This chapter describes the development of the International Civic and Citizenship Education Study (ICCS) international questionnaires for students, teachers, schools, and national research centers. The student questionnaire was designed to measure both learning outcomes and contextual information. The teacher questionnaire was designed to gather teacher perspectives on the general school and community environment, teaching methods, and civic and citizenship education. School principals were asked to report on the school context for learning, on school characteristics, including school climate, as well as aspects of civic and citizenship education at their schools. An online questionnaire for national research coordinators (NRCs)—the national contexts …


Iccs Test Development, Julian Fraillon Dec 2010

Iccs Test Development, Julian Fraillon

Julian Fraillon

The ICCS civic knowledge assessment was developed over an 18-month period from October 2006 to April 2008. Most of the ICCS test-item development was conducted by the international study center (ISC) at the Australian Council for Educational Research (ACER) in collaboration with the study’s national research coordinators (NRCs) and the Project Advisory Committee (PAC). This chapter provides a detailed description of the test-development process, review procedures, and the test design implemented for the ICCS field trial and main survey. Table 2.1 provides an overview of the test-development processes and timeline.