Open Access. Powered by Scholars. Published by Universities.®

Education Commons

Open Access. Powered by Scholars. Published by Universities.®

Articles 1 - 28 of 28

Full-Text Articles in Education

National Assessment Program : Ict Literacy Years 6 & 10 Report 2014, Julian Fraillon, Wolfram Schulz, Eveline Gebhardt, John Ainley Nov 2015

National Assessment Program : Ict Literacy Years 6 & 10 Report 2014, Julian Fraillon, Wolfram Schulz, Eveline Gebhardt, John Ainley

Dr Wolfram Schulz

Literacy in information and communication technology (ICT) is critical to students as they progress through schooling and enter a world in which information technology will be ubiquitous. Work, health care, family finances, learning and social interaction will all depend on competence in ICT. To assess progress in this crucial part of student learning, ACARA conducts a National Assessment Program (NAP) aimed at measuring ICT literacy. Every three years since 2005, a sample of Year 6 and Year 10 students from across Australia have been tested to determine their ICT knowledge, understanding and skills and their ability to use ICT creatively, …


Assessing The Intended Participation Of Young Adolescents As Future Citizens, John Ainley, Wolfram Schulz, Julian Fraillon Oct 2015

Assessing The Intended Participation Of Young Adolescents As Future Citizens, John Ainley, Wolfram Schulz, Julian Fraillon

Dr Wolfram Schulz

In many Western countries there is concern about the level of participation of their citizens in civic life and the apparent lack of interest and involvement among young people in public and political life (Curtice & Seyd, 2003). The development of knowledge, understanding, skills, and dispositions that prepare young people to comprehend the world, hold productive employment, and be informed active citizens are among the characteristics that educational systems, schools, and teachers value and attempt to foster. However, countries vary in the status accorded to civic and citizenship education as part of school education and the relative importance of developing …


International Computer And Information Literacy Study: Icils 2013: Technical Report, Julian Fraillon, Wolfram Schulz, Tim Friedman, John Ainley, Eveline Gebhardt Aug 2015

International Computer And Information Literacy Study: Icils 2013: Technical Report, Julian Fraillon, Wolfram Schulz, Tim Friedman, John Ainley, Eveline Gebhardt

Dr Wolfram Schulz

The International Computer and Information Literacy Study (ICILS) studied the extent to which young people have developed computer and information literacy (CIL) to support their capacity to participate in the digital age. ICILS systematically investigated differences in CIL outcomes across the participating countries and looked at how these countries provide CIL-related education. The study also explored differences within and across countries with respect to the relationship between the outcomes of CIL education and student characteristics and school contexts. Chapter 1 of this report presents an overview of the International Computer and Information Literacy Study. Chapters 2 and 3 are concerned …


The Reporting Of Icils Results, Wolfram Schulz Jul 2015

The Reporting Of Icils Results, Wolfram Schulz

Dr Wolfram Schulz

This chapter describes the procedures that were used to report the population estimates in the ICILS 2013 publications. It starts with a description of the replication methodology used to estimate sampling variance, followed by an outline of how the imputation variance of students’ computer and information literacy (CIL) was computed. The subsequent section outlines the procedures for conducting significance tests of differences between country and subsample means or percentages.


Icils Questionnaire Development, Wolfram Schulz, John Ainley Dec 2014

Icils Questionnaire Development, Wolfram Schulz, John Ainley

Dr Wolfram Schulz

In this chapter, we describe the development of the international questionnaires for students, teachers, school principals, information and communication technology (ICT) coordinators, and national research centers. The student questionnaire was designed to gather information about students’ personal and home background as well as use of and familiarity with computers and computing. It included questions relating to students’ background characteristics, their experience and use of computers and ICT to complete a range of different tasks in school and out of school, and their attitudes toward the use of computers and ICT. The teacher questionnaire was designed to gather teachers’ perspectives on …


Scaling Procedures For Icils Test Items, Eveline Gebhardt, Wolfram Schulz Dec 2014

Scaling Procedures For Icils Test Items, Eveline Gebhardt, Wolfram Schulz

Dr Wolfram Schulz

This chapter describes the procedures used to analyze and scale the ICILS test items that were administered to measure students’ computer and information literacy (CIL).


Scaling Procedures For Icils Questionnaire Items, Wolfram Schulz, Tim Friedman Dec 2014

Scaling Procedures For Icils Questionnaire Items, Wolfram Schulz, Tim Friedman

Dr Wolfram Schulz

This chapter describes the procedures used to scale the ICILS questionnaire data (for students, teachers, school principals, and ICT coordinators) and the indices based on them. Two general types of indices could be distinguished, both of which derived from the ICILS questionnaires: 1. Simple indices constructed through arithmetical transformation or simple recoding, for example, ratios between ICT and students or an index of immigration background based on information about the country of birth of students and their parents; and 2. Scale indices derived from scaling of items, a process typically achieved by using item response modeling of dichotomous or Likert-type …


National Assessment Program : Ict Literacy 2008 : Year 6 And Year 10 : Technical Report, Chris Freeman, John Ainley, Julian Fraillon, Eveline Gebhardt, Kate O'Malley, Wolfram Schulz Oct 2014

National Assessment Program : Ict Literacy 2008 : Year 6 And Year 10 : Technical Report, Chris Freeman, John Ainley, Julian Fraillon, Eveline Gebhardt, Kate O'Malley, Wolfram Schulz

Dr Wolfram Schulz

This report describes the technical aspects of the National ICT Literacy Sample Assessment and summarises the main activities involved in the data collection, the data collection instruments and the analysis and reporting of the data. Chapter 2 summarises the development of the assessment domain and describes the process of item development and construction of the instruments. Chapter 3 reviews the sample design and describes the sampling process. Chapter 3 also describes the weighting procedures that were implemented to derive population estimates. Chapter 4 summarises the field administration and data management procedures, including quality control and the cleaning and coding of …


Measuring Young People’S Understanding Of Civics And Citizenship In A Cross-National Study., Wolfram Schulz, Julian Fraillon, John Ainley Apr 2013

Measuring Young People’S Understanding Of Civics And Citizenship In A Cross-National Study., Wolfram Schulz, Julian Fraillon, John Ainley

Dr Wolfram Schulz

The development of knowledge and understanding is widely reported as a key aim of civic and citizenship education and as an important aspect of being equipped for active citizenship. Measuring knowledge and understanding of this domain has grown as a focus of educational research both as an outcome in its own right and to underpin the systematic investigation of factors associated with the development of effective active citizenship. Given that civics and citizenship is often seen as a set of cross-curricular capabilities rather than an established discipline, it is crucial to articulate clearly what is being measured and to be …


National Assessment Program : Ict Literacy 2011 : Year 6 And Year 10 : Technical Report, Eveline Gebhardt, Julian Fraillon, Wolfram Schulz, Kate O'Malley, Chris Freeman, Martin Murphy, John Ainley Dec 2012

National Assessment Program : Ict Literacy 2011 : Year 6 And Year 10 : Technical Report, Eveline Gebhardt, Julian Fraillon, Wolfram Schulz, Kate O'Malley, Chris Freeman, Martin Murphy, John Ainley

Dr Wolfram Schulz

This report describes the technical aspects of the National Assessment Program – ICT Literacy (NAP – ICTL) 2011 sample assessment and summarises the main activities involved in the data collection, the data collection instruments and the analysis and reporting of the data. Chapter 2 summarises the development of the assessment domain and describes the process of item development and construction of the instruments. Chapter 3 reviews the sample design and describes the sampling process. It also describes the weighting procedures that were implemented to derive population estimates and calculation of participation rates. Chapter 4 summarises the field administration of the …


International Civic And Citizenship Education Study : Assessment Framework, Wolfram Schulz, Julian Fraillon, John Ainley, Bruno Losito, David Kerr Aug 2012

International Civic And Citizenship Education Study : Assessment Framework, Wolfram Schulz, Julian Fraillon, John Ainley, Bruno Losito, David Kerr

Dr Wolfram Schulz

The International Civic and Citizenship Study (ICCS) is the third lEA project investigating the role of schooling in preparing young people for their roles as citizens in society. The first study in this area began in 1971. The second Civic Education Study was undertaken in 1999. Almost 10 years on, global change has again prompted a new survey of civic and citizenship education. Amongst other considerations, the growing impact of the processes of globalization, external threats to civic societies and their freedoms, and the limited interest and involvement of young generations in public and political life. [p. 5, ed]


National Assessment Program : Ict Literacy Years 6 And 10 Report 2011, John Ainley, Julian Fraillon, Eveline Gebhardt, Wolfram Schulz Aug 2012

National Assessment Program : Ict Literacy Years 6 And 10 Report 2011, John Ainley, Julian Fraillon, Eveline Gebhardt, Wolfram Schulz

Dr Wolfram Schulz

Under the National Assessment Program, national samples of Year 6 and Year 10 students were assessed to determine their levels of confidence, creativity and skill development in the use of information and communication technologies. This report compares the results of Australian school students by state and territory and student sub-groups, and provides details of their achievement against an ICT literacy scale. It also enables the most recent achievements of students to be compared against those from the previous national assessments of ICT literacy, conducted first in 2005 and again in 2008. In addition, a survey of student access to and …


Students’ Participation In And Valuing Of Civic Engagement At School, Wolfram Schulz, Julian Fraillon Mar 2012

Students’ Participation In And Valuing Of Civic Engagement At School, Wolfram Schulz, Julian Fraillon

Dr Wolfram Schulz

The IEA International Civic and Citizenship Education Study studied the ways in which young people in lower secondary schools are prepared to undertake their roles as citizens in a wide range of countries including Europe, Latin America, and the Asian-Pacific region. ICCS was the third IEA study designed to measure contexts and outcomes of civic and citizenship education and was linked to the 1999 IEA Civic Education Study (CIVED). A central aspect of the study was the assessment of student knowledge about a wide range of civic-related issues. ICCS gathered data from more than 140,000 Grade 8 (or equivalent) students …


Educación Para La Ciudadanía Y Participación Cívica : Una Presentación Del Estudio Iccs 2009 Y De Sus Resultados, Wolfram Schulz Feb 2012

Educación Para La Ciudadanía Y Participación Cívica : Una Presentación Del Estudio Iccs 2009 Y De Sus Resultados, Wolfram Schulz

Dr Wolfram Schulz

No abstract provided.


Ten Hypotheses About Tolerance Among Latin American Adolescents, Daniel Caro, Wolfram Schulz Dec 2011

Ten Hypotheses About Tolerance Among Latin American Adolescents, Daniel Caro, Wolfram Schulz

Dr Wolfram Schulz

Discrimination on the grounds of sexual orientation, race, mental and/or physical disability, religious background, HIV/AIDS status, and ethnic origin affects the well-being of minorities and society in general. Recent research in North America underscores the importance of contact with diverse networks, intergroup discussions, a social dominance orientation, religious beliefs, and the school climate, among other factors, to explain tolerance for minorities. Theoretical and empirical work in Latin America is less extensive and has been limited by the lack of quantitative data. This article evaluates 10 different hypotheses about tolerance, using data from eighth-grade students in six Latin American countries that …


Scaling Procedures For Iccs Questionnaire Items, Wolfram Schulz, Tim Friedman Dec 2010

Scaling Procedures For Iccs Questionnaire Items, Wolfram Schulz, Tim Friedman

Dr Wolfram Schulz

This chapter describes the procedures used to scale the International Civic and Citizenship Education Study (ICCS) questionnaire data (for students, teachers, and schools) and the indices based on them. In general, it is possible to distinguish two general types of indices derived from the ICCS questionnaires: 1. Simple indices constructed through arithmetical transformation or recoding, for example, ratios between teachers and students; and 2. Scale indices derived from scaling of items, a process typically achieved by using item response modeling of dichotomous or Likert-type items. The first part of this chapter lists the simple indices that were derived from the …


Scaling Procedures For Iccs Test Items, Wolfram Schulz, Julian Fraillon Dec 2010

Scaling Procedures For Iccs Test Items, Wolfram Schulz, Julian Fraillon

Dr Wolfram Schulz

This chapter describes the procedures used to analyse and scale the International Civic and Citizenship Education Study (ICCS) international and regional test items that were administered to measure students’ civic knowledge. The chapter covers the following topics: the scaling model used to analyze and scale the test items; test coverage and item dimensionality; assessment of item fit; assessment of scorer reliabilities for open-ended items; differential item functioning by gender; review of cross-national measurement equivalence; international item adjudication; international item calibration and test reliability; international ability estimates (plausible values and weighted likelihood estimates); estimation of changes in civic content knowledge between …


The Reporting Of Iccs Results, Wolfram Schulz Dec 2010

The Reporting Of Iccs Results, Wolfram Schulz

Dr Wolfram Schulz

This chapter describes the procedures that were used to report results in the International Civic and Citizenship Education Study (ICCS) publications. The chapter begins with a description of the replication methodology used to estimate sampling variance and then provides an outline of how the imputation variance of the civic knowledge scores was computed. The subsequent section describes how the significance tests for differences between country and subsample means or percentages were conducted. This chapter also includes descriptions of how the multiple regression analyses were conducted and how the hierarchical models explaining civic knowledge were estimated. The final section of the …


Iccs Questionnaire Development, Wolfram Schulz, Bruno Losito, David Kerr Dec 2010

Iccs Questionnaire Development, Wolfram Schulz, Bruno Losito, David Kerr

Dr Wolfram Schulz

This chapter describes the development of the International Civic and Citizenship Education Study (ICCS) international questionnaires for students, teachers, schools, and national research centers. The student questionnaire was designed to measure both learning outcomes and contextual information. The teacher questionnaire was designed to gather teacher perspectives on the general school and community environment, teaching methods, and civic and citizenship education. School principals were asked to report on the school context for learning, on school characteristics, including school climate, as well as aspects of civic and citizenship education at their schools. An online questionnaire for national research coordinators (NRCs)—the national contexts …


The Analysis Of Measurement Equivalence In International Studies Using The Rasch Model, Wolfram Schulz, Julian Fraillon Dec 2010

The Analysis Of Measurement Equivalence In International Studies Using The Rasch Model, Wolfram Schulz, Julian Fraillon

Dr Wolfram Schulz

When comparing data derived from tests or questionnaires in cross-national studies, researchers commonly assume measurement invariance in their underlying scaling models. However, different cultural contexts, languages, and curricula can have powerful effects on how students respond in different countries. This article illustrates how the application of the Rasch item response theory (IRT) model (Rasch, 1960) can be used for assessing differences in measurement properties of tests and questionnaires with reference to examples from the field trial analyses for the International Association for the Evaluation of Educational Achievement (IEA) International Civic and Citizenship Education Study (ICCS). It also discusses the general …


The Development Of Regional Instruments, David Kerr, Wolfram Schulz, Julian Fraillon Dec 2010

The Development Of Regional Instruments, David Kerr, Wolfram Schulz, Julian Fraillon

Dr Wolfram Schulz

The International Civic and Citizenship Education Study (ICCS) included regional modules for Europe, Latin America, and Asia. Thirty-five of the 38 countries that participated in ICCS opted to be involved in these regional modules. Twenty-four countries participated in the European module, six in the Latin American module, and five countries in the Asian module. Regional instruments were developed for each module and were administered to students after they had completed the international assessment. These instruments were designed to address aspects of civic and citizenship education specific to each region. The results of these additional data collections are reported in a …


Questionnaire Construct Validation In The International Civic And Citizenship Education Study, Wolfram Schulz Sep 2009

Questionnaire Construct Validation In The International Civic And Citizenship Education Study, Wolfram Schulz

Dr Wolfram Schulz

International studies tend to use student, teacher, and/or school questionnaires to collect contextual data on student and teacher characteristics, background, and activities, and the school’s learning environment. Student measures of values, attitudes, and behavioral intentions are also often viewed as important learning outcomes, in particular within the context of studies of civic and citizenship education. The scaling of questionnaire items to obtain measures of students’, teachers’, and principals’ perceptions and attitudes should therefore ideally be subject to a thorough cross-country validation of the underlying constructs. However, whereas those conducting international studies spend considerable effort ensuring measurement equivalence for international test …


The Analysis Of Measurement Equivalence In International Studies Using The Rasch Model., Wolfram Schulz, Julian Fraillon Sep 2009

The Analysis Of Measurement Equivalence In International Studies Using The Rasch Model., Wolfram Schulz, Julian Fraillon

Dr Wolfram Schulz

This paper outlines how Rasch modelling can be used for testing assumption about measurement equivalence in international studies. Based on the Rasch model (Rasch, 1960) for dichotomous items and the Partial Credit model for polytomous items (Masters & Wright, 1982), so-called item-by-country interactions can be estimated that provide useful information about the level of measurement invariance in parameter estimates. It should be noted that item-by-country interactions are one form of differential item functioning (DIF) where groups vary in their probability of answering questions even after controlling for their levels of ability (see Hambleton, Swaminathan and Rogers, 1991). Item-by-country interactions can …


Measuring The Socio-Economic Background Of Students And Its Effect On Achievement In Pisa 2000 And Pisa 2003., Wolfram Schulz Apr 2006

Measuring The Socio-Economic Background Of Students And Its Effect On Achievement In Pisa 2000 And Pisa 2003., Wolfram Schulz

Dr Wolfram Schulz

One of the consistent findings of educational research studies is the effect of the students’ family socio-economic background on their learning achievement. Consequently, international comparative studies emphasise the role of socioeconomic background for determining learning outcomes. In particular, PISA results have been used to describe how different structures of the educational system can mediate the impact of socio-economic family background on performance with comprehensive systems generally providing more equity in educational opportunities. Given the cyclical nature of the PISA study, it is of interest to observe changes in the relationship between socio-economic background and student performance. However, in order to …


Political Efficacy And Expected Participation Among Lower And Upper Secondary Students. A Comparative Analysis With Data From The Iea Civic Education Study., Wolfram Schulz Sep 2005

Political Efficacy And Expected Participation Among Lower And Upper Secondary Students. A Comparative Analysis With Data From The Iea Civic Education Study., Wolfram Schulz

Dr Wolfram Schulz

The process of political socialisation of adolescents includes more than the acquisition of knowledge about society, citizenship and the political system. In a democracy, citizens are expected to participate actively in the political process. Active participation, however, requires citizens to believe in their own ability to influence the course of politics, in other words, to feel politically efficacious. Therefore, enhancing control beliefs and the willingness to act politically could be viewed as important areas of civic and citizenship education. This paper examines changes in levels and relationships regarding efficacy and expected participation using data from students at different stages of …


Mathematics Self-Efficacy And Student Expectations. Results From Pisa 2003., Wolfram Schulz Apr 2005

Mathematics Self-Efficacy And Student Expectations. Results From Pisa 2003., Wolfram Schulz

Dr Wolfram Schulz

Student performance is generally viewed as the main criterion variable when analysing equity in the outcomes of education. However, there is evidence that even with increasing equity in achievement, inequity in other important learning outcomes might still prevail. Self-beliefs like mathematics self-efficacy, i.e. students’ judgements of their own ability to solve tasks in mathematics, are often viewed as crucial learning outcomes, which affect the process of learning and are an important predictor of educational career choices. The second survey of the Programme for International Student Assessment (PISA 2003) provides data on self-related cognitions, motivations, learning behaviours and student performance in …


Iea Civic Education Study: Technical Report, Wolfram Schulz, Heiko Sibberns Dec 2003

Iea Civic Education Study: Technical Report, Wolfram Schulz, Heiko Sibberns

Dr Wolfram Schulz

During 1999, researchers surveyed nearly 90,000 14-year-old students in 28 countries. Findings for this age group were released in 2001 and reported in Citizenship and Education in Twenty-eight Countries: Civic Knowledge and Engagement at Age Fourteen (Torney-Purta, Lehmann, Oswald, & Schulz). In the following year, over 50,000 upper secondary students (ranging in age from 16 to 19 years) from 16 countries received a similar test and the same survey of civic concepts and attitudes. Findings for the upper secondary students were released in 2002 and reported in Civic Knowledge and Engagement. An IEA Study of Upper Secondary Students in Sixteen …


Citizenship And Education In Twenty-Eight Countries : Civic Knowledge And Engagement At Age Fourteen., Judith Torney-Purta, Rainer Lehmann, Hans Oswald, Wolfram Schulz Dec 2000

Citizenship And Education In Twenty-Eight Countries : Civic Knowledge And Engagement At Age Fourteen., Judith Torney-Purta, Rainer Lehmann, Hans Oswald, Wolfram Schulz

Dr Wolfram Schulz

This current publication, Citizenship and education in twenty-eight countries, presents the first results of Phase 2 of the study. It follows a style similar to that traditionally used by IEA, and it complements the more qualitative approach of the first volume by reporting quantitative information from the tests, surveys and questionnaires. Together, the two publications provide a complete and remarkable picture of civic education policies, practices and results across countries in the late 1990s. Having identified and discussed the outcomes of our respective countries in an international context, we know that the time has arrived to pay special attention to …