Open Access. Powered by Scholars. Published by Universities.®

Education Commons

Open Access. Powered by Scholars. Published by Universities.®

Articles 1 - 6 of 6

Full-Text Articles in Education

Scaling Procedures For Iccs Questionnaire Items, Wolfram Schulz, Tim Friedman Dec 2010

Scaling Procedures For Iccs Questionnaire Items, Wolfram Schulz, Tim Friedman

Dr Wolfram Schulz

This chapter describes the procedures used to scale the International Civic and Citizenship Education Study (ICCS) questionnaire data (for students, teachers, and schools) and the indices based on them. In general, it is possible to distinguish two general types of indices derived from the ICCS questionnaires: 1. Simple indices constructed through arithmetical transformation or recoding, for example, ratios between teachers and students; and 2. Scale indices derived from scaling of items, a process typically achieved by using item response modeling of dichotomous or Likert-type items. The first part of this chapter lists the simple indices that were derived from the …


Scaling Procedures For Iccs Test Items, Wolfram Schulz, Julian Fraillon Dec 2010

Scaling Procedures For Iccs Test Items, Wolfram Schulz, Julian Fraillon

Dr Wolfram Schulz

This chapter describes the procedures used to analyse and scale the International Civic and Citizenship Education Study (ICCS) international and regional test items that were administered to measure students’ civic knowledge. The chapter covers the following topics: the scaling model used to analyze and scale the test items; test coverage and item dimensionality; assessment of item fit; assessment of scorer reliabilities for open-ended items; differential item functioning by gender; review of cross-national measurement equivalence; international item adjudication; international item calibration and test reliability; international ability estimates (plausible values and weighted likelihood estimates); estimation of changes in civic content knowledge between …


The Reporting Of Iccs Results, Wolfram Schulz Dec 2010

The Reporting Of Iccs Results, Wolfram Schulz

Dr Wolfram Schulz

This chapter describes the procedures that were used to report results in the International Civic and Citizenship Education Study (ICCS) publications. The chapter begins with a description of the replication methodology used to estimate sampling variance and then provides an outline of how the imputation variance of the civic knowledge scores was computed. The subsequent section describes how the significance tests for differences between country and subsample means or percentages were conducted. This chapter also includes descriptions of how the multiple regression analyses were conducted and how the hierarchical models explaining civic knowledge were estimated. The final section of the …


Iccs Questionnaire Development, Wolfram Schulz, Bruno Losito, David Kerr Dec 2010

Iccs Questionnaire Development, Wolfram Schulz, Bruno Losito, David Kerr

Dr Wolfram Schulz

This chapter describes the development of the International Civic and Citizenship Education Study (ICCS) international questionnaires for students, teachers, schools, and national research centers. The student questionnaire was designed to measure both learning outcomes and contextual information. The teacher questionnaire was designed to gather teacher perspectives on the general school and community environment, teaching methods, and civic and citizenship education. School principals were asked to report on the school context for learning, on school characteristics, including school climate, as well as aspects of civic and citizenship education at their schools. An online questionnaire for national research coordinators (NRCs)—the national contexts …


The Analysis Of Measurement Equivalence In International Studies Using The Rasch Model, Wolfram Schulz, Julian Fraillon Dec 2010

The Analysis Of Measurement Equivalence In International Studies Using The Rasch Model, Wolfram Schulz, Julian Fraillon

Dr Wolfram Schulz

When comparing data derived from tests or questionnaires in cross-national studies, researchers commonly assume measurement invariance in their underlying scaling models. However, different cultural contexts, languages, and curricula can have powerful effects on how students respond in different countries. This article illustrates how the application of the Rasch item response theory (IRT) model (Rasch, 1960) can be used for assessing differences in measurement properties of tests and questionnaires with reference to examples from the field trial analyses for the International Association for the Evaluation of Educational Achievement (IEA) International Civic and Citizenship Education Study (ICCS). It also discusses the general …


The Development Of Regional Instruments, David Kerr, Wolfram Schulz, Julian Fraillon Dec 2010

The Development Of Regional Instruments, David Kerr, Wolfram Schulz, Julian Fraillon

Dr Wolfram Schulz

The International Civic and Citizenship Education Study (ICCS) included regional modules for Europe, Latin America, and Asia. Thirty-five of the 38 countries that participated in ICCS opted to be involved in these regional modules. Twenty-four countries participated in the European module, six in the Latin American module, and five countries in the Asian module. Regional instruments were developed for each module and were administered to students after they had completed the international assessment. These instruments were designed to address aspects of civic and citizenship education specific to each region. The results of these additional data collections are reported in a …