Open Access. Powered by Scholars. Published by Universities.®

Education Commons

Open Access. Powered by Scholars. Published by Universities.®

Selected Works

Educational Assessment, Evaluation, and Research

Dr Wolfram Schulz

Large-Scale Survey Methodology

Articles 1 - 12 of 12

Full-Text Articles in Education

National Assessment Program : Civics And Citizenship 2013 Year 6 And Year 10 : Technical Report, Kate O'Malley, Eveline Gebhardt, Renee Chow, Martin Murphy, Wolfram Schulz, Judy Nixon, Julian Fraillon Aug 2015

National Assessment Program : Civics And Citizenship 2013 Year 6 And Year 10 : Technical Report, Kate O'Malley, Eveline Gebhardt, Renee Chow, Martin Murphy, Wolfram Schulz, Judy Nixon, Julian Fraillon

Dr Wolfram Schulz

In 1999, the State, Territory and Commonwealth Ministers of Education, meeting as the tenth Ministerial Council on Education, Employment, Training and Youth Affairs (MCEETYA), agreed to the National Goals for Schooling in the Twenty-first Century. Subsequently, MCEETYA agreed to report on progress toward the achievement of the National Goals on a nationally-comparable basis, via the National Assessment Program (NAP). As part of NAP, a three-yearly cycle of sample assessments in primary science, civics and citizenship and ICT was established. The three previous cycles of NAP – CC were conducted in 2004, 2007 and 2010. As a result of a 2010 …


International Computer And Information Literacy Study: Icils 2013: Technical Report, Julian Fraillon, Wolfram Schulz, Tim Friedman, John Ainley, Eveline Gebhardt Aug 2015

International Computer And Information Literacy Study: Icils 2013: Technical Report, Julian Fraillon, Wolfram Schulz, Tim Friedman, John Ainley, Eveline Gebhardt

Dr Wolfram Schulz

The International Computer and Information Literacy Study (ICILS) studied the extent to which young people have developed computer and information literacy (CIL) to support their capacity to participate in the digital age. ICILS systematically investigated differences in CIL outcomes across the participating countries and looked at how these countries provide CIL-related education. The study also explored differences within and across countries with respect to the relationship between the outcomes of CIL education and student characteristics and school contexts. Chapter 1 of this report presents an overview of the International Computer and Information Literacy Study. Chapters 2 and 3 are concerned …


National Assessment Program : Ict Literacy 2008 : Year 6 And Year 10 : Technical Report, Chris Freeman, John Ainley, Julian Fraillon, Eveline Gebhardt, Kate O'Malley, Wolfram Schulz Oct 2014

National Assessment Program : Ict Literacy 2008 : Year 6 And Year 10 : Technical Report, Chris Freeman, John Ainley, Julian Fraillon, Eveline Gebhardt, Kate O'Malley, Wolfram Schulz

Dr Wolfram Schulz

This report describes the technical aspects of the National ICT Literacy Sample Assessment and summarises the main activities involved in the data collection, the data collection instruments and the analysis and reporting of the data. Chapter 2 summarises the development of the assessment domain and describes the process of item development and construction of the instruments. Chapter 3 reviews the sample design and describes the sampling process. Chapter 3 also describes the weighting procedures that were implemented to derive population estimates. Chapter 4 summarises the field administration and data management procedures, including quality control and the cleaning and coding of …


National Assessment Program : Civics And Citizenship : Year 6 And Year 10 : Technical Report : 2007, Nicole Wernert, Eveline Gebhardt, Wolfram Schulz Feb 2013

National Assessment Program : Civics And Citizenship : Year 6 And Year 10 : Technical Report : 2007, Nicole Wernert, Eveline Gebhardt, Wolfram Schulz

Dr Wolfram Schulz

This report describes the technical aspects of the National Civics and Citizenship Sample Assessment of 2007 that was conducted in Australian schools, and summarises the main activities involved in the data collection, the data collection instruments and the analysis and reporting of the data. Chapter 2 summarises the development of the assessment domain and describes the process of item development and construction of the instruments. Chapter 3 reviews the sample design and describes the sampling process. Chapter 3 also describes the weighting procedures that were implemented to derive population estimates. Chapter 4 summarises the field administration and data management procedures, …


National Assessment Program : Civics And Citizenship Year 6 And Year 10 : Technical Report 2004, Nicole Wernert, Eveline Gebhardt, Martin Murphy, Wolfram Schulz Feb 2013

National Assessment Program : Civics And Citizenship Year 6 And Year 10 : Technical Report 2004, Nicole Wernert, Eveline Gebhardt, Martin Murphy, Wolfram Schulz

Dr Wolfram Schulz

This report describes the technical aspects of the National Civics and Citizenship Sample Assessment and summarises the main activities involved in the data collection, the data collection instruments and the analysis and reporting of the data. Chapter 2 summarises the development of the assessment domain and describes the process of item development and construction of the instruments. Chapter 3 reviews the sample design and describes the sampling process. Chapter 3 also describes the process of weighting to derive population estimates. Chapter 4 summarises the field administration and data management procedures, including quality control and the cleaning and coding of the …


National Assessment Program : Civics And Citizenship Education 2010 : Year 6 And Year 10 : Technical Report, Eveline Gebhardt, Julian Fraillon, Nicole Wernert, Wolfram Schulz Aug 2012

National Assessment Program : Civics And Citizenship Education 2010 : Year 6 And Year 10 : Technical Report, Eveline Gebhardt, Julian Fraillon, Nicole Wernert, Wolfram Schulz

Dr Wolfram Schulz

The first cycle of the National Assessment Program – Civics and Citizenship (NAP – CC) was held in 2004 and provided the baseline against which future performance would be compared. The second cycle of the program was conducted in 2007 and was the first cycle where trends in performance were able to be examined. The most recent assessment was undertaken in 2010. This report describes the procedures and processes involved in the conduct of the third cycle of the NAP – CC. This report describes the technical aspects of NAP – CC 2010 and summarises the main activities involved in …


Iccs 2009 Technical Report, Wolfram Schulz, John Ainley, Julian Fraillon Nov 2011

Iccs 2009 Technical Report, Wolfram Schulz, John Ainley, Julian Fraillon

Dr Wolfram Schulz

The International Civic and Citizenship Education Study (ICCS) studied the ways in which young people are prepared to undertake their roles as citizens. ICCS was based on the premise that preparing students for citizenship roles involves developing relevant knowledge and understanding as well as helping them form positive attitudes toward being a citizen and participating in activities related to civic and citizenship education. It also examined differences among countries in relation to these outcomes of civic and citizenship education, and it explored how differences among countries relate to student characteristics, school and community contexts, and national characteristics. This report is …


Scaling Procedures For Iccs Questionnaire Items, Wolfram Schulz, Tim Friedman Dec 2010

Scaling Procedures For Iccs Questionnaire Items, Wolfram Schulz, Tim Friedman

Dr Wolfram Schulz

This chapter describes the procedures used to scale the International Civic and Citizenship Education Study (ICCS) questionnaire data (for students, teachers, and schools) and the indices based on them. In general, it is possible to distinguish two general types of indices derived from the ICCS questionnaires: 1. Simple indices constructed through arithmetical transformation or recoding, for example, ratios between teachers and students; and 2. Scale indices derived from scaling of items, a process typically achieved by using item response modeling of dichotomous or Likert-type items. The first part of this chapter lists the simple indices that were derived from the …


Scaling Procedures For Iccs Test Items, Wolfram Schulz, Julian Fraillon Dec 2010

Scaling Procedures For Iccs Test Items, Wolfram Schulz, Julian Fraillon

Dr Wolfram Schulz

This chapter describes the procedures used to analyse and scale the International Civic and Citizenship Education Study (ICCS) international and regional test items that were administered to measure students’ civic knowledge. The chapter covers the following topics: the scaling model used to analyze and scale the test items; test coverage and item dimensionality; assessment of item fit; assessment of scorer reliabilities for open-ended items; differential item functioning by gender; review of cross-national measurement equivalence; international item adjudication; international item calibration and test reliability; international ability estimates (plausible values and weighted likelihood estimates); estimation of changes in civic content knowledge between …


The Reporting Of Iccs Results, Wolfram Schulz Dec 2010

The Reporting Of Iccs Results, Wolfram Schulz

Dr Wolfram Schulz

This chapter describes the procedures that were used to report results in the International Civic and Citizenship Education Study (ICCS) publications. The chapter begins with a description of the replication methodology used to estimate sampling variance and then provides an outline of how the imputation variance of the civic knowledge scores was computed. The subsequent section describes how the significance tests for differences between country and subsample means or percentages were conducted. This chapter also includes descriptions of how the multiple regression analyses were conducted and how the hierarchical models explaining civic knowledge were estimated. The final section of the …


Questionnaire Construct Validation In The International Civic And Citizenship Education Study, Wolfram Schulz Nov 2009

Questionnaire Construct Validation In The International Civic And Citizenship Education Study, Wolfram Schulz

Dr Wolfram Schulz

International studies tend to use student, teacher or school questionnaires for the collection of contextual data on student or teacher characteristics, background, activities and the school's learning environment. Furthermore, student measures of values, attitudes and behavioural intentions are also frequently viewed as important learning outcomes, in particular in the context of studies of civic and citizenship education. Data obtained from these instruments become frequently important predictors of student performance or are treated as learning outcome variables of interest. Therefore, the scaling of questionnaire items to obtain measures of students', teachers' and principals' perceptions and attitudes should ideally be subject of …


Iea Civic Education Study: Technical Report, Wolfram Schulz, Heiko Sibberns Dec 2003

Iea Civic Education Study: Technical Report, Wolfram Schulz, Heiko Sibberns

Dr Wolfram Schulz

During 1999, researchers surveyed nearly 90,000 14-year-old students in 28 countries. Findings for this age group were released in 2001 and reported in Citizenship and Education in Twenty-eight Countries: Civic Knowledge and Engagement at Age Fourteen (Torney-Purta, Lehmann, Oswald, & Schulz). In the following year, over 50,000 upper secondary students (ranging in age from 16 to 19 years) from 16 countries received a similar test and the same survey of civic concepts and attitudes. Findings for the upper secondary students were released in 2002 and reported in Civic Knowledge and Engagement. An IEA Study of Upper Secondary Students in Sixteen …