Open Access. Powered by Scholars. Published by Universities.®

Education Commons

Open Access. Powered by Scholars. Published by Universities.®

Educational Assessment, Evaluation, and Research

External Link

2011

Large-Scale Survey Methodology

Articles 1 - 3 of 3

Full-Text Articles in Education

Scaling Procedures For Iccs Questionnaire Items, Wolfram Schulz, Tim Friedman Dec 2010

Scaling Procedures For Iccs Questionnaire Items, Wolfram Schulz, Tim Friedman

Dr Wolfram Schulz

This chapter describes the procedures used to scale the International Civic and Citizenship Education Study (ICCS) questionnaire data (for students, teachers, and schools) and the indices based on them. In general, it is possible to distinguish two general types of indices derived from the ICCS questionnaires: 1. Simple indices constructed through arithmetical transformation or recoding, for example, ratios between teachers and students; and 2. Scale indices derived from scaling of items, a process typically achieved by using item response modeling of dichotomous or Likert-type items. The first part of this chapter lists the simple indices that were derived from the …


Scaling Procedures For Iccs Test Items, Wolfram Schulz, Julian Fraillon Dec 2010

Scaling Procedures For Iccs Test Items, Wolfram Schulz, Julian Fraillon

Dr Wolfram Schulz

This chapter describes the procedures used to analyse and scale the International Civic and Citizenship Education Study (ICCS) international and regional test items that were administered to measure students’ civic knowledge. The chapter covers the following topics: the scaling model used to analyze and scale the test items; test coverage and item dimensionality; assessment of item fit; assessment of scorer reliabilities for open-ended items; differential item functioning by gender; review of cross-national measurement equivalence; international item adjudication; international item calibration and test reliability; international ability estimates (plausible values and weighted likelihood estimates); estimation of changes in civic content knowledge between …


The Reporting Of Iccs Results, Wolfram Schulz Dec 2010

The Reporting Of Iccs Results, Wolfram Schulz

Dr Wolfram Schulz

This chapter describes the procedures that were used to report results in the International Civic and Citizenship Education Study (ICCS) publications. The chapter begins with a description of the replication methodology used to estimate sampling variance and then provides an outline of how the imputation variance of the civic knowledge scores was computed. The subsequent section describes how the significance tests for differences between country and subsample means or percentages were conducted. This chapter also includes descriptions of how the multiple regression analyses were conducted and how the hierarchical models explaining civic knowledge were estimated. The final section of the …