Educational Assessment, Evaluation, and Research Commons^™

Trial Of The Engagement Matrix Component 2: The Reliability And Validity Of The Engagement Matrix. Report, Petra Lietz, Mollie Tobin

Student learning processes

The second component of the trial of the Engagement Matrix (EM) seeks to examine empirically the reliability, validity and dimensionality of the EM by way of various analyses, particularly Rasch modelling. Responses to an online survey of more than 300 ICAN/FLO staff and teachers were analysed to ascertain whether the statements a) could be grouped together along the three assumed underlying dimensions (Relationships, Involvement in learning and Well-being) and if these dimensions were related to a common underlying trait, namely Engagement, b) measured these dimensions reliably, c) could differentiate between students with different levels of engagement and d) worked to …

Priorities For Civic And Citizenship Education In Europe, David Kerr, Linda Sturman, Tim Friedman

Civics and Citizenship Assessment

The International Civic and Citizenship Education Study (ICCS) focused on the ways in which young people are prepared to undertake their roles as citizens. Preparing students for citizenship involves developing relevant knowledge and understanding as well as encouraging the formation of positive attitudes toward being a citizen. The conceptual background for, and the design of ICCS were described in the assessment framework (Schulz, Fraillon, Ainley, Losito, & Kerr, 2008) and the international results were reported in its international reports (Schulz, Ainley, Fraillon, Kerr & Losito, 2010a & 2010b). This paper provides an overview of the results from the regional assessment …

Dispelling Myths: Indigenous Students’ Engagement With University, Christine Asmar, Susan Page, Ali Radloff

Australasian Survey of Student Engagement (AUSSE)

It has been known for years now that students who engage more frequently in educationally effective practices get better grades, are more satisfied, and are more likely to persist with their studies. It is also known that while engagement is positively linked to desired outcomes for all types of students, historically underserved students tend to benefit more than majority students. In the case of Indigenous Australians, positive responses in relation to engagement and satisfaction are not necessarily accompanied by the overall levels of persistence and completion one would expect. Moreover, New Zealand Maori students surveyed in the AUSSE reveal similar …

Monitoring Risk And Return: Critical Insights Into Graduate Coursework Engagement And Outcomes, Daniel Edwards

Australasian Survey of Student Engagement (AUSSE)

Coursework graduate courses have been a significant growth area over the last few decades and are of immense importance to Australian higher education. The knowledge and skills achieved through postgraduate study make a significant contribution to individuals and society. Nearly one quarter of all higher education students in Australia are enrolled in a coursework postgraduate degree. These students generate substantial income for institutions through the fees they pay. Nearly one third of all international students in Australian higher education are enrolled in postgraduate coursework degrees. Overall, international students make up around 50 per cent of all coursework masters enrolments, a …

Design And Implementation Of The Iea Civic And Citizenship Education Study, Tim Friedman, Julian Fraillon, Barbara Malak

Civics and Citizenship Assessment

This paper provides an overview of the International Civic and Citizenship Education Study (ICCS) and summarizes different aspects of the study implementation. It outlines: the structure of the assessment framework; the design, development and implementation of instruments; the sampling design and outcomes; and quality control measures for the study.

Final Report : The Deadly Awards Nomination And Voting System Review And Research Project, Australian Council For Educational Research (Acer), Michele Lonsdale

Indigenous Education Research

The Australian Council for Educational Research (ACER) was commissioned in late 2010 by Vibe Australia to investigate the current nomination and voting system for the Deadly Awards and identify ways in which the current system could be strengthened. The Deadlys are in their 17th year. Beginning as a music award, the categories have expanded over the years to include sport, the arts, community awards and nominations for the Hall of Fame. Given their longevity and the debate that ensued after last year’s awards, it is timely to review the current nomination and voting system. The Deadly Awards are intended to …

Latin American Perspectives On Civic And Citizenship Education, Wolfram Schulz, Eugenio Gonzalez

Civics and Citizenship Assessment

The International Civic and Citizenship Education Study (ICCS) focused on the ways in which young people are prepared to undertake their roles as citizens. Preparing students for citizenship involves developing relevant knowledge and understanding as well as encouraging the formation of positive attitudes toward being a citizen. The conceptual background for, and the design of ICCS were described in the assessment framework (Schulz, Fraillon, Ainley, Losito, & Kerr, 2008) and the international results were reported in its international reports (Schulz, Ainley, Fraillon, Kerr & Losito, 2010a & 2010b). This paper gives an overview of the results from the regional assessment …

Multi-Level Analysis Of Factors Explaining Differences In Civic Knowledge, Wolfram Schulz, Julian Fraillon, John Ainley, Eva Van De Gaer

Civics and Citizenship Assessment

The IEA International Civic and Citizenship Education Study studied the ways in which young people in lower secondary schools are prepared to undertake their roles as citizens in a wide range of countries including Europe, Latin America, and the Asian-Pacific region. ICCS was the third IEA study designed to measure contexts and outcomes of civic and citizenship education and was linked to the 1999 IEA Civic Education Study (CIVED) (Amadeo, Torney-Purta, Lehmann, Husfeldt & Nikolova, 2002; Schulz & Sibberns, 2004; Torney-Purta, Lehmann, Oswald & Schulz, 2001). A central aspect of the study was the assessment of student knowledge about a …

The Roles Of Schools And Communities In Civic And Citizenships Education, Elisa Caponera, Bruno Losito

Civics and Citizenship Assessment

The first part of the present paper is an overview of school and community roles in students’ civic and citizenship education across ICCS countries. Data from school and teacher questionnaires were used to describe how schools and communities contribute to the development of students’ civic knowledge. The second part investigates, through multi-level analysis, the relationship between a selection of variables at student and school levels and a selection of student attitudes. More specifically, the attitudes taken into account are: attitudes toward equal gender rights, toward equal rights for immigrants, and toward equal rights for ethnic/racial groups.

Expected Participation In Protest Activities Among Lower Secondary Students In 38 Countries, John Ainley, Wolfram Schulz

Civics and Citizenship Assessment

The IEA International Civic and Citizenship Education Study (ICCS) investigated the ways in which young people in lower secondary schools (specifically in their eighth year of school) are being prepared to undertake their roles as citizens in a wide range of countries in Europe, Latin America, and the Asian-Pacific region. ICCS is the third IEA1 study designed to study outcomes of civic and citizenship education (CCE) and is linked to the 1999 IEA Civic Education Study (CIVED) (Amadeo, Torney-Purta, Lehmann, Husfeldt & Nikolova, 2002; Schulz & Sibberns, 2004; Torney-Purta, Lehmann, Oswald & Schulz, 2001). Results from this study have been …

An Overview Of Psychometric Properties Of The Ausse Student Engagement Questionnaire (Seq), Hamish Coates

Australasian Survey of Student Engagement (AUSSE)

The quality of education is a product of what students do, and how teachers, support professionals and institutions support good educational practice. This means that measuring students’ participation in good educational practices and measuring how institutions support such participation goes to the heart of educational quality. An important link in this line of reasoning is that the instruments used for measurement provide valid, reliable and efficient measurement. This is essential, for otherwise insights into how students engage in education will be biased or diffuse and wrong decisions may be made that have serious implications for policy and practice. To that …

Improving Educational Outcomes In The Northern Territory : Preliminary Advice To The Northern Territory Department Of Education And Training, With A Particular Focus On The Ongoing Improvement Of Students’ Literacy And Numeracy Achievements, Geoff N. Masters

School and system improvement

The primary focus of this review is on strategies for improving literacy and numeracy outcomes in the Northern Territory. Clearly, the role of school education is much broader than the development of students literacy and numeracy skills, but these are foundational skills on which almost all other school learning is based. It is also clear from research that low levels of literacy and numeracy by the middle years of school are associated with lower school completion rates and a range of post-school outcomes, including higher levels of unemployment, lower lifetime earnings, and poorer health outcomes. Although the primary focus of …

Final Report: The Benefits Of School–Business Relationships, Michele Lonsdale, Alana Deery, Sharon Clerke, Michelle Anderson, Emma Curtin, Pat Knight, Meredith Bramich

Program monitoring and evaluation

In January 2011, the Australian Council for Educational Research was contracted by the Department of Education, Employment and Workplace Relations (DEEWR) to collate information gleaned from a range of sources and prepare a report that made clear the benefits associated with stronger relationships between schools and businesses. ACER was also asked to assess the existing evidence base in an Australian context and identify ways in which this could be strengthened. Given the complex demands faced by schools in the twenty-first century, and the limited nature of the resources available to meet these demands, schools and governments are increasingly looking to …

Working On A Dream: Educational Returns From Off-Campus Paid Work, Hamish Coates

Australasian Survey of Student Engagement (AUSSE)

The following analysis investigates Australian university students’ participation in off-campus paid work. During the 1990s, this phenomenon became an increasingly interesting and significant narrative in Australian higher education, with implications for institutions, industries, individuals and the economy as a whole. In 2011, as this briefing shows, undertaking off-campus paid work is an intrinsic and rewarding part of undergraduate life. In recent decades combining paid off-campus work and study has tended to be viewed as a troubling situation driven by economic hardship and a lack of government support that resulted in students being distracted from their studies. As with any complex …

International Update (No. 1) December 2010

International Update archive (2010-2012)

Table of contents for this issue: (a) Engaging international students; (b) Assessing higher education learning outcomes; (c) Indian Central Board of Secondary Education visits ACER; (d) Assessing student competencies in Brunei; (e) Assessing generic skills in Colombia; (f) English-language assessment in Hong Kong; (g) Evaluating reform in Mexican schools; (h) Initial findings from International Civics and Citizenship Education Study released; (i) Indonesian Islamic education; (j) National assessment in Mexico; (k) ACER advises PNG system on courses and curriculum; (l) ACER to assist in establishing Middle East centre; (m) Education for all in India; (n) Australian Council for Educational Research (ACER).

Medical Testing

International Developments

Universities are increasingly admitting new students based on more than just their academic results. In health-related fields especially, greater emphasis is being placed on the need for students to have a wider skill set, in particular logical reasoning and problem solving, the ability to communicate well and understand people, as well as the ability to work effectively in a team. Future doctors and other health professionals need to understand more than just medical theory – it is crucial they have the aptitude to work effectively with colleagues and patients in practice. ACER works with universities in the United Kingdom and …

International Schools' Assessment Program

International Developments

Designed and developed Schools’ Assessment Designed and developed by the Australian Council for Educational Research (ACER), the International Schools' Assessment Program (ISA) is currently administered in 260 international schools worldwide with over 49000 students participating, and allows these schools to benchmark themselves against other international schools in the core skill areas of mathematical literacy, reading and writing. The ISA is a culturally inclusive test that provides meaningful and valuable information for education providers and the parents of students.

Middle East

International Developments

The countries of the Middle East are forging ahead with educational development to ensure that their students are well prepared to meet the challenges of living and working in a global economy. with educational development to ensure that their students are well prepared to meet the challenges of living and working in a global economy. ACER's United Arab Emirates Office, located in Dubai, opened in October 2003 as the first educational research organisation in Knowledge Village. ACER UAE provides knowledge transfer, training and innovative educational services throughout the Middle East.

World Bank

International Developments

Established in 1944, the World Bank provides low‑interest loans, interest-free credits and grants to developing countries for investment in education, health, public administration, infrastructure, financial and private sector development, agriculture and environmental and natural resource management. One of the organisation’s strategic goals is to help countries integrate education into national economic strategies and develop holistic education systems responsive to varying socioeconomic needs. ACER’s World Bank-funded work extends from India to Ethiopia on projects involving national assessments, reviews and in-country consultancy.

Programme For International Student Assessment (Pisa)

International Developments

The Australian Council for Educational Research (ACER) leads an international consortium of research organisations, and educational institutions to deliver the International PISA project on behalf of the Organisation for Economic Cooperation and Development (OECD). Translated into 48 languages and then verified to ensure they can be understood by students from a wide range of language and cultural backgrounds, PISA questions are based on relevant, everyday situations. PISA tests the reading, mathematics and science literacy of 15-year-olds across the world. In 2009 around 400 000 students from 57 countries took part.

International Developments (No.1) 2010

International Developments

Table of contents for this issue: Programme for International Student Assessment (PISA); (b) World Bank; (c) Latin America; (d) Middle East; (e) International Schools Assessment Program; (f) Medical testing.

Schools In Their Communities, Robert Simons

Policy Briefs

The idea of school-community partnerships is intuitively attractive because of the benefits they can facilitate. These benefits include availability and access to complementary services to strengthen the focus on learning for students and teachers, and opportunities for continuing learning and skill development for parents and others in the community.1 However, there are also a number of practical challenges with the development of effective and sustainable school-community partnerships. This Policy Brief considers three models of partnerships in schools and communities that have been developed during the last fifteen years in Australia in response to a variety of national, regional, local and …

Analysis Of Year 12 Or Certificate Ii Attainment Of Indigenous Young People – Stage 1 : A Report Prepared For The Council Of Australian Governments Reform Council, John Ainley, Sarah Buckley, Adrian Beavis, Sheldon Rothman, Alice Tovey

Indigenous Education Research

The purpose of this paper is to assist the Council of Australian Governments (COAG) Reform Council to analyse performance information relating to the Year 12 or Certificate II attainment of Indigenous young people and to understand better variations in performance across jurisdictions. As part of these analyses variations over time within each jurisdiction have been reported. The analyses use existing data sources. No new data have been collected. There are four strands to this work:

1. a statistical overview of educational attainments and participation;
2. multivariate analyses of influences on attainment;
3. a review of literature intended to inform an understanding of trends …

School-Community Partnerships In Australian Schools, Michele Lonsdale

Program monitoring and evaluation

This report is based on an analysis of the data provided by Australian schools in their 2009 Schools First Impact Award applications. The data described the nature of the partnerships that schools had established with community and business groups, the reasons for these partnerships, the kinds of programs that were developed and implemented, and the effectiveness of the partnership/program.

These applications are a rich source of information about school–community partnerships in Australia. The report is organised around the following seven questions:

What types of schools established partnerships?

Who partnered with schools?

What were the main reasons for setting up these …

Regenerating The Academic Workforce: The Careers, Intentions And Motivations Of Higher Degree Research Students In Australia: Findings Of The National Research Student Survey (Nrss), Daniel Edwards, Emmaline Bexley, Sarah Richardson

Higher education research

The main findings of this report are based on the outcomes from the National Research Student Survey (NRSS) conducted in June 2010 across 38 of the 39 universities in Australia. In total 11,710 Higher Degree by Research students (those enrolled in PhD and masters by research degrees, also referred to simply as ‘research students’ in this report) responded to the NRSS, providing a 25.5 per cent response rate across the country. These response numbers represent the largest collection of survey responses from research students ever undertaken in Australia. The report primarily explores the career intentions and motivations of these students. …

Iccs 2009 Latin American Report : Civic Knowledge And Attitudes Among Lower-Secondary Students In Six Latin American Countries, Wolfram Schulz, John Ainley, Tim Friedman, Petra Lietz

Civics and Citizenship Assessment

The International Civic and Citizenship Education Study (ICCS) focused on the ways in which young people are prepared to undertake their roles as citizens. Preparing students for citizenship involves developing relevant knowledge and understanding as well as encouraging the formation of positive attitudes toward being a citizen. Descriptions of the conceptual background for and the design of ICCS appear in the publication detailing the ICCS assessment framework (Schulz, Fraillon, Ainley, Losito, & Kerr, 2008). Regional contexts are important for civic and citizenship education because they shape how people undertake their roles as citizens. ICCS included, in addition to the core …

National Assessment Program : Civics And Citizenship Years 6 And 10 Report 2010, Wolfram Schulz, Julian Fraillon, Eveline Gebhardt, Nicole Wernert

Civics and Citizenship Assessment

This report presents the findings of the National Assessment Program – Civics and Citizenship conducted under the auspices of the national council of education ministers, the Ministerial Council for Education, Early Childhood Development and Youth Affairs (MCEECDYA) in 2010. Under the National Assessment Program, assessment of civics and citizenship is conducted with a random sample of Year 6 and Year 10 students on a triennial cycle. This is a report of the third such assessment. The National Assessment Program – Civics and Citizenship measures not only students’ skills, knowledge and understandings of Australia’s system of government and civic life but …

Iccs 2009 Technical Report, Wolfram Schulz, John Ainley, Julian Fraillon

Civics and Citizenship Assessment

The International Civic and Citizenship Education Study (ICCS) studied the ways in which young people are prepared to undertake their roles as citizens. ICCS was based on the premise that preparing students for citizenship roles involves developing relevant knowledge and understanding as well as helping them form positive attitudes toward being a citizen and participating in activities related to civic and citizenship education. It also examined differences among countries in relation to these outcomes of civic and citizenship education, and it explored how differences among countries relate to student characteristics, school and community contexts, and national characteristics. This report is …

Mental Health And Wellbeing: Educational Perspectives, Rosalyn H. Shute Ed.

Shannon Research Press

Mental Health and Wellbeing: Educational Perspectives provides a significant overview of the matter of mental health and wellbeing with particular relevance to educational contexts. Comprising peer-reviewed chapter contributions from prominent Australian and international researchers and practitioners, this book presents an authoritative and diverse account of:

• links between wellbeing and learning

• interventions and initiatives in the field

• evidence based practice guidelines

• policy and practice examples

Pisa 2009 Plus Results : Performance Of 15-Year-Olds In Reading, Mathematics And Science For 10 Additional Participants, Maurice Walker

OECD Programme for International Student Assessment (PISA)

The OECD Programme for International Student Assessment (PISA) is an international comparative survey of 15-year-olds’ knowledge and skills in reading, mathematical and scientific literacy. PISA seeks to measure how well young adults have acquired the knowledge and skills that are required to function as successful members of society. As part of the PISA 2009 survey, students completed an assessment on reading literacy, mathematical literacy and scientific literacy, as well as an extensive background questionnaire. School principals also completed a survey describing the context of education at their school, including the level of resources in the school and qualifications of staff. …