Educational Assessment, Evaluation, and Research Commons^™

A Global Measure Of Digital And Ict Literacy Skills, John Ainley, Wolfram Schulz, Julian Fraillon

ICT - Digital Literacy

Digital and ICT literacy is considered an important competence for full participation in a knowledge economy and an information society. Consequently, interest at national and international level has emerged to explore the best ways of measuring the extent to which, and how equitably, competence in this area is being achieved. This paper reviews the definitions of digital and ICT literacy that have been adopted in cross-national studies, investigates the approaches to the assessment of digital and ICT literacy that have been employed in those studies and articulates the criteria that should guide the development of a global measure of digital …

An Analysis Of Education Reform In Sub-Saharan Africa, Katharine Eger

CMC Senior Theses

Sub-Saharan Africa continues to fall behind other developing regions regarding educational attainment, despite recent progress in enrollment. This thesis examines a variety of external conditional factors that could contribute to a country’s relative success, in terms of years spent in school using a prediction model that compares years enrolled in secondary education as a foundation to determine over- and under-performing countries in sub-Saharan Africa.

By exploring various educational policies, historical patterns, and projects executed in Rwanda, South Africa, Ghana, and Botswana, this thesis sheds light on four main challenges that can impact educational attainment: ethnic and racial tensions, an acute …

Media Literacy, Education & (Civic) Capability: A Transferable Methodology, Julian Mcdougall, Richard Berger, Pete Fraser, Marketa Zezulkova

Journal of Media Literacy Education

This article shares research into the relationship between a formal media educational encounter in the UK and the broad objectives for media and information literacy education circulating in mainland Europe and the US.

A pilot study, developed with a special interest group of the United Kingdom Literacy Association, applied a three part methodology for comparing the media literacy levels of young people who have studied media in school against peers who at the same educational level, who have not engaged with media education of any kind. The approach ‘hones in’ on Mihailidis’ (2014) framework for media literacy and civic engagement.

International Computer And Information Literacy Study: Icils 2013: Technical Report, Julian Fraillon, Wolfram Schulz, Tim Friedman, John Ainley, Eveline Gebhardt

ICT - Digital Literacy

The International Computer and Information Literacy Study (ICILS) studied the extent to which young people have developed computer and information literacy (CIL) to support their capacity to participate in the digital age. ICILS systematically investigated differences in CIL outcomes across the participating countries and looked at how these countries provide CIL-related education. The study also explored differences within and across countries with respect to the relationship between the outcomes of CIL education and student characteristics and school contexts. Chapter 1 of this report presents an overview of the International Computer and Information Literacy Study. Chapters 2 and 3 are concerned …

Collaboration Opportunities With The Society To Enhance Indonesian Citizenry By Furthering Higher Education With The Liberal Arts (Seiche), Judith Puncochar, Don Faust

Conference Presentations

The Society for the Enhancement of Indonesian Citizenry through Higher Education (SEICHE) is an Indonesian organization analogous to The Association for the Study of Higher Education (ASHE) in the United States. SEICHE and ASHE use similar organizational structures and promote scholarly research and debate about issues and possibilities in the advancement of higher education. SEICHE was launched on November 22, 2014, in Bandung, Indonesia, with representatives from seven universities and one non-profit organization. The SEICHE vision is to help achieve international recognition of Indonesia’s higher education system, accomplished principally through collaboration and engagement with research in curriculum, instruction, service, and …

Evaluation Of Ict In Education In Papua Province (Acdp-045): Final Report, Susanne Owen, John Hunt, Eda Simanjuntak, Eko Sediyono, Prapto Yuwono, Sri Yulianto, Wigati Yektinintys Modouw

ACER Indonesia

The Evaluation of Information and Communication Technologies (ICT) in Education in Papua Province study is a large-scale research project for the Republic of Indonesia’s Education Sector Analytical and Capacity Development Partnership (ACDP). The key objectives of the Study are: to measure the effectiveness of the TV-Edukasi (Education) (TV-E) and other ICT programs in the Province and to determine their impact on the learning outcomes of school children and adult learners; and to make recommendations to plan for further ICT in education initiatives.

Assessments To Support Quality Teaching And Learning, Charlotte Waters

International Developments

The focus of post-2015 development goals on educational quality for all is directing attention to assessments that support quality teaching and learning, as Charlotte Waters explains.

The Cure For Early Grades Assessment Difficulties? Take A Tablet, Maurice Walker

International Developments

Monitoring educational development in the early years of schooling is vital if practitioners, and policy makers, are to support students’ learning, but the assessment of student achievement in developing countries can be a logistical headache. Maurice Walker reports on an innovative approach to assessment using tablets that is addressing that.

International Developments (No.5) 2015

International Developments

This issue of International Developments focuses on the work of the Centre for Global Education Monitoring (GEM) at ACER. GEM is tracking progress in the provision and quality of schooling through the systematic and strategic collection of data on educational outcomes, and factors that influence these. Table of contents for this issue: (a) Data to inform policy; (b) The cure for early grades assessment difficulties? Take a tablet; (c) Measuring growth in a world of universal education; (d) Assessments to support quality teaching and learning.

Enhancing Cross-Border Higher Education Institution Mobility In The Apec Region, Sarah Richardson

Higher education research

This report presents findings of a study of the policy context around higher education institution (HEI) mobility in eight APEC economies – China, Indonesia, Malaysia, Mexico, Peru, the Philippines, Singapore and Viet Nam. The report provides insights into different policy contexts gathered from desktop research and from interviews with 68 participants. These all had direct involvement in HEI mobility in the eight economies in the study, including through senior positions in ministries of education, in bodies aligned to ministries, in accreditation and quality assurance agencies, and in foreign and local HEIs. The report identifies regulations, practices, policies, legislative contexts and …

Can They Teach Each Other? : The Restructuring Of Higher Education And The Rise Of Undergraduate Student “Teachers” In Ontario, Jennifer Massey, Sean Field

Journal of Critical Scholarship on Higher Education and Student Affairs

Changes to public funding regimes, coupled with transformations in how universities are managed and measured have altered the methods for educating undergraduate students. The growing reliance on teaching fellows, teaching assistants, and increasingly undergraduate peer educators (administering Supplemental Instruction [SI] programs) is promoted as a means toachieve a greater “return on investment” in the delivery of postsecondary education. Neoliberal discourses legitimating this downloading of teaching labour suggest it offers a “win-win” solution to the “problem” of educating growing numbers of undergraduate students. It proposes universities can deliver the same curricula, and achieve the same “outcomes” (primarily measured through grades and …

Supporting Teacher Development : Literature Review, Kate Reid, Elizabeth Kleinhenz

Initial Teacher education

This literature review identifies and evaluates evidence on the effectiveness of approaches to improving teacher quality in developing countries. It examines four categories of assistance for improving teacher quality: teacher development policies, pre-service education and training, in-service professional development, and school-based support. As far as possible, the review highlights practices that demonstrate effectiveness.

Special-Education Law In Mexico And The United States, Charles J. Russo, Ricardo Lozano

Educational Leadership Faculty Publications

The challenges of meeting the requirements of students with special needs under the Individuals with Disabilities Education Act and other laws are a particularly timely topic, as large numbers of native Spanish-speaking students move into the United States.

Against that backdrop, this article reviews the laws for special education in Mexico and the United States. The focus on the laws in Mexico stems from the fact that many students cross the border daily to attend public schools in the United States, and because Mexico has many laws in place dealing with special education. We offer school district leaders a comparative …

A Review Of International Large-Scale Assessments In Education: Assessing Component Skills And Collecting Contextual Data, John Cresswell, Ursula Schwantner, Charlotte Waters

OECD Programme for International Student Assessment (PISA)

The OECD has initiated PISA for Development (PISA-D) in response to the rising need of developing countries to collect data about their education systems and the capacity of their student bodies. This report aims to compare and contrast approaches regarding the instruments that are used to collect data on (a) component skills and cognitive instruments, (b) contextual frameworks, and (c) the implementation of the different international assessments, as well as approaches to include children who are not at school, and the ways in which data are used. It then seeks to identify assessment practices in these three areas that will …

Research Into The Financing Of Technical And Vocational Education And Training (Tvet) In The Pacific : Fiji : Country Report, Leo Maglen, Mark Weston Wall, Manaini Rokovunisei

Vocational, adult and professional education research

This study provides a detailed analysis of the financing of technical and vocational education and training (TVET) in Fiji. The study team commenced its field investigations in August 2013 and completed them in October 2013. The Fijian Country Study Report into the Financing of TVET forms part of a region-wide program Research into the Financing of TVET in the Pacific, initiated under Australia’s international development assistance program in 2011. The aims of the program, as identified by its Research Brief, are to produce, in conjunction with host country governments and TVET stakeholders, a comprehensive empirical analysis of the existing …

Research Into The Financing Of Technical And Vocational Education And Training (Tvet) In The Pacific : Kiribati : Country Report, Prabir Majumdar, Teweiariki Teaero

Vocational, adult and professional education research

This report provides a detailed analysis of the financing of technical and vocational education and training (TVET) in Kiribati. The Kiribati report forms part of the study Research into the Financing of TVET in the Pacific that was launched through Australia’s aid program in April 2012. Kiribati is one of seven countries taking part in the research. The study aims to produce, in conjunction with host country governments and TVET stakeholders, a comprehensive empirical analysis of the existing systems for financing TVET in each of the participating countries, identify key financing issues within the region, and the policy implications they …

Research Into The Financing Of Technical And Vocational Education And Training (Tvet) In The Pacific : Papua New Guinea : Country Report, Robert Horne, Ken Ngangan, Simaima Tavil-Melachon, Justin Brown

Vocational, adult and professional education research

This report provides a detailed analysis of the financing of Technical and Vocational Education and Training (TVET) in Papua New Guinea (PNG). The report is part of the study Research into the Financing of TVET in the Pacific initiated through Australia’s aid program in 2012. As well as PNG, the overall study involves six other Pacific countries; Fiji; Kiribati; Samoa; Solomon Islands; Tonga; and Vanuatu. The overall study team developed a general framework and set of data collection instruments to guide the work. Individual country teams adapted the general framework and instruments to meet national circumstances. PNG is by far …

Research Into The Financing Of Technical And Vocational Education And Training (Tvet) In The Pacific : Solomon Islands : Country Report, Andrea Bateman, Elizabeth Cassity, Judy Fangalasuu

Vocational, adult and professional education research

This report provides a detailed analysis of the financing of Technical and Vocational Education and Training (TVET) in Solomon Islands. The report forms part of the study Research into the Financing of TVET in the Pacific initiated through Australia’s aid program in 2012. The study aims to produce, in conjunction with host country governments and TVET stakeholders, a comprehensive empirical analysis of the systems for financing TVET in seven Pacific countries (Fiji, Kiribati, Papua New Guinea, Samoa, Solomon Islands, Tonga and Vanuatu), identify key financing issues, and identify directions through which future financing for TVET could be made more efficient …

Research Into The Financing Of Technical And Vocational Education And Training (Tvet) In The Pacific : Vanuatu : Country Report, Acer

Vocational, adult and professional education research

This report provides a detailed analysis of the financing of Technical and Vocational Education and Training (TVET) in Vanuatu. It forms part of the study Research into the Financing of TVET in the Pacific initiated through Australia’s aid program in consultation with governments in the Pacific region. Vanuatu was one of seven countries taking part in the research. (The other participating countries are Fiji, Kiribati, Papua New Guinea, Samoa, Solomon Islands and Tonga.) The study is intended to provide a detailed empirical analysis of TVET financing in each country, identify key TVET financing issues, and discuss directions through which future …

Research Into The Financing Of Technical And Vocational Education And Training (Tvet) In The Pacific : Tonga : Country Report, Andrea Bateman, Justin Brown, Meleoni Uera

Vocational, adult and professional education research

This report provides a detailed analysis of the financing of Technical and Vocational Education and Training (TVET) in Tonga. The report forms part of the study Research into the Financing of TVET in the Pacific initiated through Australia’s aid program in 2012. The study aims to produce, in conjunction with host country governments and TVET stakeholders, a comprehensive empirical analysis of the existing systems for financing TVET in seven Pacific countries (Fiji, Kiribati, Papua New Guinea, Samoa, Solomon Islands, Tonga and Vanuatu), identify key financing issues within the region, and identify directions through which future financing for TVET could be …

The Southern And Eastern Africa Consortium For Monitoring Educational Quality (Superseded Version), Australian Council For Educational Research

Assessment GEMS

The Southern and Eastern Africa Consortium for Monitoring Educational Quality (SACMEQ) carries out large-scale cross-national research studies in member countries in the Southern and Eastern Africa region. It aims to assess the conditions of schooling and performance levels of learners and teachers in the areas of literacy and numeracy. SACMEQ has completed three cross-national educational research projects so far at five- to six-year intervals (SACMEQ I, 1995-1999, SACMEQ II, 1998-2004 and SACMEQ III, 2005-2010). It is currently implementing the fourth project.

Research Into The Financing Of Technical And Vocational Education And Training (Tvet) In The Pacific : Samoa : Country Report, Leo Maglen, Justin Brown, Sala Perive T. Lene

Vocational, adult and professional education research

The Samoa Country Study Report into the Financing of TVET forms part of a regionwide program Research into the Financing of TVET in the Pacific initiated by the Australian Agency for International Development (AusAID) in 2011. The study team for Samoa commenced its field investigations in July 2012 and completed them in September 2012. 2. The aims of the program, as identified by its Research Brief, are to produce, in conjunction with host country governments and TVET stakeholders, a comprehensive empirical analysis of the existing systems for financing TVET in seven Pacific countries (Fiji, Kiribati, Papua New Guinea, Samoa, …

Successful Alternative Education: Still Reproducing Inequalities? The Case Of The Community School Program In Egypt, Lucy El-Sherif, Sarfaroz Niyozov

Institute for Educational Development, Karachi

Community schools are an alternative form of education that center on partnerships between the community and/or the state, aid organizations, and non-governmental organizations. The Community School Program (CSP) in Egypt sparked a social movement in education in that country, with disparate actors all coalescing around the CSP as an alternative, empowering model of education. This study examined the relationship between the CSP and the dynamics that formed, shaped and co-opted it through in-depth interviews and observations. Our analysis examined the program’s processes and legacies on its former students. The study found that critical factors in the program’s success were its …

Site Visitation: School Leaders' Perceptions Of A Diagnostic Tool For School Improvement, Mary Shannon C. Chiasson

LSU New Orleans Theses and Dissertations

This case study explored the use of site-visitation as a diagnostic tool for school improvement. Nine charter schools in New Orleans were selected for the study. Based on qualitative research and systems theory, a within- and cross-case analysis of nine semi-structured interviews with school leaders were conducted. The school leaders’ experiences with the state-run site-visitation model and their use of the findings for school improvement was explored. The findings led to the development of a hybrid accountability model that encompasses the components school leaders believe will lead to school improvement. This study aims to assist educators, policy makers, and researchers …

Interview With Andreas Schleicher, Padraig O'Malley, Andreas Schleicher

New England Journal of Public Policy

This interview took place on March 17, 2014, in Washington, DC, with Andreas Schleicher, Director of Education and Skills, and Special Advisor on Education Policy to the Secretary-General at the Organisation for Economic Co-operation and Development (OECD). Schleicher is responsible for the Directorate of Education and Skills’ research, analysis, and publication of the Program for International Student Assessment (PISA), the OECD Survey of Adult Skills (PIAAC), the OECD Teaching and Learning International Survey (TALIS), and the development and analysis of benchmarks on the performance of education systems. The OECD reports on PISA, PIAAC, and TALIS were released between December 3, …

School Reform In Canada And Florida: A Study Of Contrast, Catherine S. Boehme

New England Journal of Public Policy

Alberta and Florida have instituted school reform initiatives over the past fifteen years in an effort to improve the quality of their schools. Alberta has focused on systemic improvement by engaging the community in educational needs assessment, raising the high standards of teacher preparation, and improving effective instructional practices through professional development. Florida’s efforts have concentrated on holding students, teachers, schools, and districts accountable for high-stakes testing results by increasing the number and rigor of required assessments and increasing the negative consequences for low achievement scores. The 2012 PISA scores reveal that Alberta’s students are maintaining their high rankings relative …

Massachusetts Schooling Matters: Good News, Contributing Factors, Challenges, Persistent Problems, Kathleen J. Skinner, Paul Toner

New England Journal of Public Policy

Massachusetts public schools have performed at the highest levels on national and international benchmarked reading, mathematics, and science assessments. The Commonwealth’s population demographics related to educational attainment, employment, and family income coupled with factors within the control of the state, districts, or schools, such as highly qualified and unionized teachers, average school-district size, defined time on learning, universal health care coverage for all children, state funding for pre-K–12 schooling, curriculum articulation through statewide standards, and high participation in college admissions exams, have contributed to academic success. Massachusetts schools, however, still face challenges in narrowing existing achievement gaps, reducing the emphasis …

Editor's Note, Padraig O'Malley

New England Journal of Public Policy

On December 3, 2013, when the Organisation for Economic Co-operation and Development (OECD) released its Programme for International Student Assessment (PISA) scores, the ranking of the United States as number 27 on the global scoreboard elicited little surprise among teachers, educational professionals, academics, and educational policymakers. The usual platitudes were trotted out—no mention that the United States’ standing was getting any worse, just which other countries were passing us by. We were stuck at a perennial average.

The results are in a sense a metaphor of the slow decline of the United State since the 1970s from a position of …

What Can Pisa Tell Us About U.S. Education Policy?, Linda Darling-Hammond

New England Journal of Public Policy

Despite years of attention to “reform” in the United States, overall achievement on international assessments such as PISA has not improved during the period from 2000 to 2012. Reforms focused on high-stakes testing attached to sanctions, expansions of charter schools, and a market-based approach to teaching have been unsuccessful in changing outcomes. Meanwhile, growing childhood poverty, along with increasing segregation, income inequality, and disparities in school spending, have expanded the opportunity gap. Lessons from other nations and successful states indicate that systematic government investments in high-need schools along with capacity-building that improves the knowledge and skills of educators and the …

International Education Comparisons: How American Education Reform Is The New Status Quo, Randi Weingarten

New England Journal of Public Policy

The United States participates in international studies comparing school systems across the world. Reformers have largely ignored the lessons from these studies about what works best to educate children, and a strategy of test-based accountability has become the new status quo. This article analyzes the failed policy ideas reformers keep pushing on our schools that have been shown across the globe to be unsuccessful in the areas of school choice and competition, teacher quality and evaluation, an engaging curriculum, and equity. Research examines what top performing countries do to help students succeed, as well as what works in districts across …