Education Commons^™

Digital Literacy: Myths And Realities, Julian Fraillon

Julian Fraillon

Digital literacy, under a wide variety of names, is routinely classified as a 21st-century skill and is frequently reported as an area of high priority in school education systems internationally. In comparison with students in other countries, Australian students have high levels of access to digital technologies both at and outside of school. With this access comes the expectations that students will be highly-proficient users of digital technologies and that schools will use digital technologies in transformative ways to support student learning. This session will examine how concepts of digital literacy have developed over time, what data from large-scale assessments …

National Assessment Program: Sample Assessment: Civics And Citizenship Report: Years 6 And 10: 2016, Julian Fraillon, Eveline Gebhardt, Judy Nixon, Louise Oakwell, Tim Friedman, Michelle Robins, Mark Mcandrew

Julian Fraillon

Under the National Assessment Program, the Civics and Citizenship sample assessment is administered to a representative sample of Year 6 and Year 10 students every three years. It is conducted under the auspices of the Education Council. The National Assessment Program – Civics and Citizenship assesses students’ skills, knowledge and understandings of Australia’s system of government, civic institutions and the values which underpin Australia’s democracy. It also provides an indication of student attitudes and their engagement in civic-related activities at school and in the community. This report presents the findings of the fifth National Assessment Program – Civics and Citizenship …

Measuring Student Well-Being In The Context Of Australian Schooling : Discussion Paper, Julian Fraillon

Julian Fraillon

This report was commissioned by the South Australian Department of Education and Children's Services as an agent of the Ministerial Council on Education, Employment, Training and Youth Affairs (MCEETYA). The report constitutes Phase 1 of a planned two phase process. Specifically this report defines a measurement construct for student well-being; outlines a methodology for measuring student well-being; and provides recommendations for ongoing work in the measuring, reporting and monitoring of student well-being (Phase 2).

Iea International Civic And Citizenship Education Study 2016 Assessment Framework, Wolfram Schulz, John Ainley, Julian Fraillon, Bruno Losito, Gabriella Agrusti

Julian Fraillon

The purpose of the International Civic and Citizenship Education Study (ICCS) is to investigate the ways in which young people are prepared to undertake their roles as citizens in a range of countries in the second decade of the 21th century. ICCS 2016 is a continuation of this study, which was initiated in 2009. The development of a framework for ICCS 2016 needed to take account of recent developments and ongoing challenges. The international project team identified areas related to civics and citizenship education, which had either gained more attention in recent years or were regarded as relevant, but which …

Southeast Asia Primary Learning Metrics (Sea-Plm) : Global Citizenship Domain Assessment Framework, Rachel Parker, Julian Fraillon

Julian Fraillon

This assessment framework forms part of the Southeast Asia Primary Learning Metrics (SEAPLM) assessment program and outlines an approach to assessing global citizenship. The purpose of this assessment framework is to articulate the basic structure of the global citizenship domain as part of SEA-PLM. It provides a description of the constructs to be measured. It also outlines the design and content of the measurement instruments and describes how measures generated by those instruments relate to the constructs. It combines theory and practice to describe “both the ‘what’ and the ‘how’” (Jago, 2009, p. 1) of the SEA-PLM assessment of global …

National Assessment Program : Ict Literacy Years 6 & 10 Report 2014, Julian Fraillon, Wolfram Schulz, Eveline Gebhardt, John Ainley

Julian Fraillon

Literacy in information and communication technology (ICT) is critical to students as they progress through schooling and enter a world in which information technology will be ubiquitous. Work, health care, family finances, learning and social interaction will all depend on competence in ICT. To assess progress in this crucial part of student learning, ACARA conducts a National Assessment Program (NAP) aimed at measuring ICT literacy. Every three years since 2005, a sample of Year 6 and Year 10 students from across Australia have been tested to determine their ICT knowledge, understanding and skills and their ability to use ICT creatively, …

Assessing The Intended Participation Of Young Adolescents As Future Citizens, John Ainley, Wolfram Schulz, Julian Fraillon

Julian Fraillon

In many Western countries there is concern about the level of participation of their citizens in civic life and the apparent lack of interest and involvement among young people in public and political life (Curtice & Seyd, 2003). The development of knowledge, understanding, skills, and dispositions that prepare young people to comprehend the world, hold productive employment, and be informed active citizens are among the characteristics that educational systems, schools, and teachers value and attempt to foster. However, countries vary in the status accorded to civic and citizenship education as part of school education and the relative importance of developing …

Engineering Assessment Development Report: Ahelo Feasibility Study, Jacob Pearce, Julian Fraillon, Hamish Coates, Sarah Richardson

Julian Fraillon

No abstract provided.

Group Of National Experts On The Ahelo Feasibility Study : Engineering Assessment Framework : Ahelo Feasibility Study, Hamish Coates, Sarah Richardson, Jacob Pearce, Julian Fraillon

Julian Fraillon

This AHELO Engineering Assessment Framework describes and illustrates the domain of engineering competency that is used in the AHELO Feasibility Study. The framework gives an organisational structure for the domain in terms of engineering knowledge, processes and contexts; describes the types of assessment items that have been developed; and details how reporting will be carried out. - p.4

National Assessment Program : Civics And Citizenship 2013 Year 6 And Year 10 : Technical Report, Kate O'Malley, Eveline Gebhardt, Renee Chow, Martin Murphy, Wolfram Schulz, Judy Nixon, Julian Fraillon

Julian Fraillon

In 1999, the State, Territory and Commonwealth Ministers of Education, meeting as the tenth Ministerial Council on Education, Employment, Training and Youth Affairs (MCEETYA), agreed to the National Goals for Schooling in the Twenty-first Century. Subsequently, MCEETYA agreed to report on progress toward the achievement of the National Goals on a nationally-comparable basis, via the National Assessment Program (NAP). As part of NAP, a three-yearly cycle of sample assessments in primary science, civics and citizenship and ICT was established. The three previous cycles of NAP – CC were conducted in 2004, 2007 and 2010. As a result of a 2010 …

National Assessment Program : Civics And Citizenship Years 6 And 10 Report 2013, Julian Fraillon, Wolfram Schulz, Judy Nixon, Eveline Gebhardt

Julian Fraillon

This report presents the findings of the 2013 National Assessment Program – Civics and Citizenship (NAP – CC) and is conducted under the auspices of the Standing Council on School Education and Early Childhood (SCSEEC) Education Council. Under the National Assessment Program, the Civics and Citizenship sample assessment is administered to a representative sample of Year 6 and Year 10 students on a triennial cycle. After three rounds of assessments – which were undertaken in 2004, 2007 and 2010 – this report looks at the 2013 assessment and examines emerging trends. The National Assessment Program – Civics and Citizenship measures …

Session P: Assessing General Capabilities, Julian Fraillon, Juliette Mendelovits

Julian Fraillon

There is growing interest in general capabilities and cross-curricular learning outcomes such as literacy in information and communication technologies, creative thinking and collaborative and individual problem-solving. As the expectation for such competencies to be taught in schools has increased, so has the need for teachers and schools to validly and reliably assess student learning in those areas, and to report on them in ways that teaching and learning. In this presentation examine the challenges of assessing on student learning and learning growth capabilities and cross-curricular learning present approaches used in research some of these challenges and reflect can be applied …

International Computer And Information Literacy Study: Icils 2013: Technical Report, Julian Fraillon, Wolfram Schulz, Tim Friedman, John Ainley, Eveline Gebhardt

Julian Fraillon

The International Computer and Information Literacy Study (ICILS) studied the extent to which young people have developed computer and information literacy (CIL) to support their capacity to participate in the digital age. ICILS systematically investigated differences in CIL outcomes across the participating countries and looked at how these countries provide CIL-related education. The study also explored differences within and across countries with respect to the relationship between the outcomes of CIL education and student characteristics and school contexts. Chapter 1 of this report presents an overview of the International Computer and Information Literacy Study. Chapters 2 and 3 are concerned …

The Rationale For And Use Of Assessment Frameworks: Improving Assessment And Reporting Quality In Medical Education, Jacob Pearce, Daniel Edwards, Julian Fraillon, Hamish Coates, Benedict Canny, David Wilkinson

Julian Fraillon

An assessment framework provides a structured conceptual map of the learning outcomes of a programme of study along with details of how achievement of the outcomes can be measured. The rationale for using frameworks to underpin the targeting of essential content components is especially relevant for the medical education community. Frameworks have the capacity to improve validity and reliability in assessment, allowing test developers to more easily create robust assessment instruments. The framework used by the Australian Medical Assessment Collaboration (AMAC) is an interesting and relevant case study for the international community as it draws and builds on established processes …

Study Flags Civics And Citizenship Knowledge, Julian Fraillon

Julian Fraillon

The percentage of Australian school students with the skills and knowledge required to be active and informed citizens has remained stable between 2010 and 2013, but there is room for improvement, as Julian Fraillon explains.

International Computer And Information Literacy Study: Assessment Framework, Julian Fraillon, Wolfram Schulz, John Ainley

Julian Fraillon

The purpose of the International Computer and Information Literacy Study 2013 (ICILS 2013) is to investigate, in a range of countries, the ways in which young people are developing computer and information literacy (CIL) to support their capacity to participate in the digital age. To achieve this aim, the study will assess student achievement through an authentic computer-based assessment of CIL administered to students in their eighth year of schooling. It will also collect and report on analyses of data about student use of computers and other digital devices as well as students’ attitudes toward the use of computers and …

International Computer And Information Literacy Study: Assessment Framework, Julian Fraillon, Wolfram Schulz, John Ainley

Julian Fraillon

The purpose of the International Computer and Information Literacy Study 2013 (ICILS 2013) is to investigate, in a range of countries, the ways in which young people are developing computer and information literacy (CIL) to support their capacity to participate in the digital age. To achieve this aim, the study will assess student achievement through an authentic computer-based assessment of CIL administered to students in their eighth year of schooling. It will also collect and report on analyses of data about student use of computers and other digital devices as well as students’ attitudes toward the use of computers and …

Computer-Based Assessment Systems, Julian Fraillon, Ralph Carstens

Julian Fraillon

ICILS was the first IEA study to collect student achievement and questionnaire data on computer rather than on paper. This chapter describes the key aspects of the computerbased test delivery system used in ICILS. It also details some of the challenges of using computer-based systems to collect student data in a crossnational large-scale assessment such as ICILS.

Icils Test Development, Julian Fraillon

Julian Fraillon

The ICILS assessment was developed over a 20-month period from April 2010 to December 2012. Most of this work was conducted by the international study center (ISC) at the Australian Council for Educational Research (ACER) in collaboration with national research coordinators (NRCs) and the project advisory committee (PAC). SoNET Systems conducted the software development for the test modules. This chapter provides a detailed description of the test development process and review procedures as well as the test design implemented for the ICILS field trial and main survey.

Australian Students Prepare For Digital Future, Julian Fraillon

Julian Fraillon

The world’s first computer-based international study into computer and information literacy shows that Australian students are developing the skills necessary for successful participation in the digital world. Julian Fraillon reports.

Preparing For Life In A Digital Age: The Iea International Computer And Information Literacy Study International Report, Julian Fraillon, John Ainley, Wolfram Schulz, Tim Friedman, Eveline Gebhardt

Julian Fraillon

The International Computer and Information Literacy Study (ICILS) studied the extent to which young people have developed computer and information literacy (CIL) to support their capacity to participate in the digital age. ICILS is a response to the increasing use of information and communication technology (ICT) in modern society and the need for citizens to develop relevant skills in order to participate effectively in the digital age. It also addresses the necessity for policymakers and education systems to have a better understanding of the contexts and outcomes of CIL-related education programs in their countries. ICILS is the first crossnational study …

Introduction To Lantite Assessment Frameworks And Content, Julian Fraillon

Julian Fraillon

No abstract provided.

National Assessment Program : Ict Literacy 2008 : Year 6 And Year 10 : Technical Report, Chris Freeman, John Ainley, Julian Fraillon, Eveline Gebhardt, Kate O'Malley, Wolfram Schulz

Julian Fraillon

This report describes the technical aspects of the National ICT Literacy Sample Assessment and summarises the main activities involved in the data collection, the data collection instruments and the analysis and reporting of the data. Chapter 2 summarises the development of the assessment domain and describes the process of item development and construction of the instruments. Chapter 3 reviews the sample design and describes the sampling process. Chapter 3 also describes the weighting procedures that were implemented to derive population estimates. Chapter 4 summarises the field administration and data management procedures, including quality control and the cleaning and coding of …

Measuring Young People’S Understanding Of Civics And Citizenship In A Cross-National Study., Wolfram Schulz, Julian Fraillon, John Ainley

Julian Fraillon

The development of knowledge and understanding is widely reported as a key aim of civic and citizenship education and as an important aspect of being equipped for active citizenship. Measuring knowledge and understanding of this domain has grown as a focus of educational research both as an outcome in its own right and to underpin the systematic investigation of factors associated with the development of effective active citizenship. Given that civics and citizenship is often seen as a set of cross-curricular capabilities rather than an established discipline, it is crucial to articulate clearly what is being measured and to be …

Assessing Higher Education Learning Outcomes In Civil Engineering: The Oecd Ahelo Feasibility Study, Roger Hadgraft, Jacob Pearce, Daniel Edwards, Julian Fraillon, Hamish Coates

Julian Fraillon

BACKGROUND

Higher education is increasingly a global business. At present, university ranking schemes are heavily reliant on research indicators, while students are likely looking for an excellent teaching and learning environment. Aware of this discrepancy, the OECD has funded the AHELO project.

PURPOSE

AHELO was designed to test the feasibility of an international assessment of higher education learning outcomes. The two test disciplines are civil engineering and economics, together with an assessment of generic skills. The civil engineering test will be reported in this paper.

More than a ranking, AHELO is a direct evaluation of student performance. It is intended …

National Assessment Program : Information Communication And Technology Literacy : Year 6 And Year 10 : Technical Report 2005, John Ainley, Julian Fraillon, Chris Freeman, Martin Murphy

Julian Fraillon

This report describes the technical aspects of the National ITC Literacy Sample Assessment and summarises the main activities involved in the data collection, the data collection instruments and the analysis and reporting of the data. Chapter 2 summarises the development of the assessment domain and describes the process of item development and construction of the instruments. Chapter 3 reviews the sample design and describes the sampling process. Chapter 3 also describes the process of weighting to derive population estimates. Chapter 4 summarises the field administration and data management procedures, including quality control and the cleaning and coding of the data. …

National Assessment Program : Ict Literacy 2011 : Year 6 And Year 10 : Technical Report, Eveline Gebhardt, Julian Fraillon, Wolfram Schulz, Kate O'Malley, Chris Freeman, Martin Murphy, John Ainley

Julian Fraillon

This report describes the technical aspects of the National Assessment Program – ICT Literacy (NAP – ICTL) 2011 sample assessment and summarises the main activities involved in the data collection, the data collection instruments and the analysis and reporting of the data. Chapter 2 summarises the development of the assessment domain and describes the process of item development and construction of the instruments. Chapter 3 reviews the sample design and describes the sampling process. It also describes the weighting procedures that were implemented to derive population estimates and calculation of participation rates. Chapter 4 summarises the field administration of the …

The 'Digital Natives' And Ict Literacy, Julian Fraillon

Julian Fraillon

Julian Fraillon reports on the latest national assessment of information and communication technology literacy.

Iccs 2009 Asian Report : Civic Knowledge, Attitudes, And Engagement Among Lower-Secondary Students In Five Asian Countries, John Ainley, Julian Fraillon, Wolfram Schulz

Julian Fraillon

This report describes results from the Asian regional module of the International Civic and Citizenship Education Study (ICCS). The five countries from the Asian region that participated in the international study—Chinese Taipei, Hong Kong SAR, Indonesia, the Republic of Korea, and Thailand—also participated in the Asian regional module. Each of these countries is located in either eastern or southeastern Asia. The report focuses on aspects of particular relevance for this geographic region, and should be viewed as part of the broader set of publications from ICCS. ICCS investigates the ways in which countries prepare their young people to undertake their …

National Assessment Program : Civics And Citizenship Education 2010 : Year 6 And Year 10 : Technical Report, Eveline Gebhardt, Julian Fraillon, Nicole Wernert, Wolfram Schulz

Julian Fraillon

The first cycle of the National Assessment Program – Civics and Citizenship (NAP – CC) was held in 2004 and provided the baseline against which future performance would be compared. The second cycle of the program was conducted in 2007 and was the first cycle where trends in performance were able to be examined. The most recent assessment was undertaken in 2010. This report describes the procedures and processes involved in the conduct of the third cycle of the NAP – CC. This report describes the technical aspects of NAP – CC 2010 and summarises the main activities involved in …