Digital Commons Network^™

Beyond Letters And Numbers: The Covid-19 Pandemic And Foundational Literacy And Numeracy In Indonesia, Jeaniene Spink, Dan Cloney, Amy Berry

International Education Research

In 2020, with the COVID-19 pandemic spreading across Indonesia and around the world, INOVASI (the Innovation for Indonesia’s School Children) and the Indonesian Ministry of Education, Culture, Research and Technology (MoECRT) initiated a study of foundational literacy and numeracy learning by Indonesian students and the impact of the pandemic on this learning. The Australian Council for Educational Research (ACER) provided technical support. The study developed descriptions of literacy and numeracy achievement levels, referencing both global proficiency frameworks and Indonesia’s curriculum and assessment standards. Student results were benchmarked against descriptors of skills for the Global Proficiency Framework (GPF) Minimum Proficiency Levels …

Lower-Third Standardized Letters Of Evaluation In Emergency Medicine: Does Gender Make A Difference In Match Outcome?, Erica B. Shaver, Haley D. Frauen, Rachel Z. Polinski, Stephen M. Davis, Kimberly D. Quedado, Joseph Hansroth, Kristin H. Davis, Michelle R. Angeline, Christopher S. Kiefer

Faculty & Staff Scholarship

Objective The purpose of this study was to determine whether gender influences the likelihood of receiving a lowerthird global assessment (GA) on the standardized letter of evaluation (SLOE) submitted as part of the emergency medicine (EM) application process as well as the impact of gender on ultimate match outcomes for applicants receiving a lower-third GA ranking. Our hypothesis was that female applicants with a lowerthird GA ranking have a higher risk of not matching.

Methods We conducted a retrospective cohort study evaluating U.S.-based allopathic applicants to a single EM residency program in the Mid-Atlantic region during the 2017-2018 and 2018-2019 …

The Swans/Ables Project: A Set Of Resources Developed Collaboratively With Teachers To Support The Teaching And Learning Of Students With Additional Learning Needs, Toshiko Kamei

2021-2030 ACER Research Conferences

The inclusion of students with additional learning needs in schooling is part of policy and practice in Australia. However, it has been well documented that teachers lack the resources and training to meaningfully include students with additional learning needs in the full range of learning in their classrooms. The SWANs (Students with Additional Needs) program of work aimed to fill this gap through developing assessments based on learning progressions to provide targeted information to support the teaching and learning of all students, including students with additional learning needs. The development and implementation of the SWANs/ABLES suite of resources illustrates how …

Rethinking Measurement For Accountable Assessment, Mark Wilson

2021-2030 ACER Research Conferences

The underlying model for most formal educational measurement (e.g. standardised tests) is based on a very simple model: the student takes a test (possibly alongside other students). The complications of there being an instructional plan, actual instruction, interpretation of the outcome, and formulation of next steps, are all bypassed in considering how to model the process of measurement. There are some standard exceptions, of course: a pre-test/post-test context will involve two measurements, and attention to gain score, or similar. However, if we wish to design measurement to hold to Lehrer’s (2021) definition of ‘accountable assessment’ – as ‘actionable information for …

Applying Empirical Learning Progressions For A Holistic Approach To Evidence-Based Education: Swans/Ables, Emily White

2021-2030 ACER Research Conferences

Learning progressions have become an increasing topic of interest for researchers, educational organisations and schools as they can describe the expected pathway of learning within a content area to allow for targeted teaching and learning at all levels of ability. However, there is substantial variation in how learning progressions are developed and to what extent teachers can use them to inform their practices. The ABLES/SWANS tools (Students with Additional Needs/Abilities Based Learning and Education Support) are an example of how an empirical learning progression can be applied to support teachers’ ability to not only target teaching to a student’s zone …

Learning Progressions As Models And Tools For Supporting Classroom Assessment, Alicia C. Alonzo

2021-2030 ACER Research Conferences

Like all models, learning progressions (LPs) provide simplified representations of complex phenomena. One key simplification is the characterisation of student thinking in terms of levels. This characterisation is both essential for large-scale applications, such as informing standards, but potentially problematic for smaller-scale applications. In this paper, I describe a program of research designed to explore the smaller-scale use of LPs as supports for teacher classroom assessment practices in light of this simplification. Based on this research, I conclude that LP levels may serve as a generative heuristic, particularly when teachers are engaged with evidence of the limitations of LP levels …

Developing An Assessment Of Oral Language And Literacy: Measuring Growth In The Early Years, Dan Cloney, Kellie Picker

2021-2030 ACER Research Conferences

Children develop rapidly in their early years. A crucial component of this development is a child’s ability to learn and use language. Even before they enter formal education, children have learned much about oral language and literacy through meaningful interactions with others, and from their life experiences. Children, however, do not develop at the same pace – some children arrive in early childhood education and care (ECEC) programs more advanced while others require additional support. Recent reviews of the assessment tools available to ECEC educators show a lack of good quality measurement and a reliance on checklist style inventories or …

Citizen-Led Assessments: A Model For Evidence-Based Advocacy And Action To Improve Learning, Suman Bhattacharjea, Sehar Saeed, Rajib Timalsina, Syeed Ahamed

Assessment and Reporting

Designed as household-based assessments, citizen-led assessments (CLAs) are implemented by local organizations who assess children in their homes, thus reaching the most marginalized children, families, and communities, often in remote areas. CLAs add an essential piece of information for truly monitoring progress and help realistically represent the learning levels of all children – at national, regional, and global levels. By using simple tools and easy-to-understand reports, CLAs engage parents and community members in discussions about learning and help foster understanding of the importance of ensuring quality education through civil action. In this publication, members from organizations conducting CLAs in India, …

Investigating The Impact Of Learning Through Play At School

International Developments

Learning Through Play at School is a pioneering research study that investigates how playful approaches to teaching and learning are applied in the classroom. The four-year study provides an opportunity to expand understanding of learning through play at school in Ukraine and the impact on teachers and students.

Measuring The Impact Of A Girls Education Program In Zambia

International Developments

The Zambian Girls 2030: Realizing My Potential program was initiated in 2016 through a partnership between the Ministry of General Education (MoGE) and UNICEF. The program aims to ensure better educational and employment outcomes for Zambian girls through various educational interventions at the secondary school level. The ACER evaluation will shed light on the results achieved against the targeted objectives and the potential for expansion of the program.

Nepal Shifts To The Testing Of Higher Order Skills

International Developments

An overhaul of the examination system in Nepal focuses on standardisation of exams and assessing higher order thinking skills at the end of basic education.

Reviewing Professional Development Programs On Inclusive Teaching And Learning

International Developments

The Global Education Monitoring (GEM) Centre is conducting a review of in-service professional development programs that help teachers in low- and middle-income countries in the Asia-Pacific region build their competencies in inclusive education of children with disabilities. A scoping review aims to identify in-service professional learning programs assisting already practising teachers with the inclusion of students with disabilities in low- and middle income countries in the Asia-Pacific region.

Improving Learning Outcomes Through Teacher Development

International Developments

The Australian Government’s Department of Foreign Affairs and Trade (DFAT) has commissioned ACER to conduct the Teacher Development Multi-Year Series, a long-term, multi-country study to determine the extent to which Australian investments improve teaching quality and student learning. Countries involved include Timor-Leste, the three-year study focuses on Apoio Lideransa liuhusi Mentoria no Aprendizajen (ALMA) as part of the Australia-Timor-Leste Partnership for Human Development) - previously known as the Professional Learning Program; Lao PDR; and the Vanuatu Education Sector Program (VESP).

A Needs-Based Early Childhood Care And Development Model

International Developments

ACER Indonesia is partnering with the William and Lily Foundation and Adaro Bangun Negeri Foundation on a two year project which promises to improve the learning and development outcomes of Indonesian children in early childhood and development centres. This project will focus on Early Childhood Education and Development (ECED) centres or Pendidikan Anak Usia Dini (PAUDs) in 12 villages. These villages have been selected because their teachers have not received mandatory training from the government and many children have delayed physical development, or stunting.

Acer And Unicef Partner In Assessment And Evaluation

International Developments

In 2020, ACER signed two significant Long-Term Agreements (LTA) with UNICEF. One involves design, implementation and reporting on large-scale national and regional learning assessments in the Asia-Pacific region and the other covers technical assistance in the evaluation of education programs and interventions in countries under UNICEF’s Eastern and Southern Africa Regional Office (ESARO) and Regional Office for South Asia (ROSA).

Uncovering Learning Inequities In Southeast Asia

International Developments

Results released from the Southeast Asia Primary Learning Metrics (SEAPLM) 2019 show alarming inequities in learning outcomes for children. While some students are excelling, others are falling far behind and are unlikely to catch up. Without foundational skills in reading, mathematics and writing, these students are likely to be disadvantaged well into their adult lives.

Monitoring Progress Towards The Sdgs, Ursula Schwantner, Juliette F. Mendelovits, Maurice Walker

International Developments

Measuring where students are at in their learning is critical for determining whether the world is on track to meet Sustainable Development Goal (SDG) 4. ACER’s contribution to SDG 4 is spearheaded through the work of the GEM Centre, a long-term partnership with the Australian Government's Department of Foreign Affairs and Trade (DFAT). At the core of the GEM Centre's contribution is the development of technically sound and internationally comparable learning metrics that enable education stakeholders to align assessment systems with global SDG monitoring and reporting.

International Developments (No.10) 2021

International Developments

This issue of International Developments summarises the research evidence gathered through the work of the Australian Council for Educational Research (ACER) and the impact of specific projects around the globe.

Performance Comparison Between Ib And Non-Ib School Students On The International Schools’ Assessment, Ling Tan

Monitoring Learning

This report examines the performance of students enrolled in the IB Primary Years Programme (PYP) and the IB Middle Years Programme (MYP) on the ACER International Schools’ Assessment (ISA) compared with non-IB students from the same ISA cohorts. The ISA is an assessment created especially for students in international schools in Grades 3 to 10. The assessment asks both multiple-choice and open-ended questions in the areas of writing, reading, mathematics and science, and provides international normative information about student performance. The ISA scales for Reading, Mathematical Literacy and Scientific Literacy are based on those developed for the internationally endorsed frameworks …

Ensuring Quality In Classroom Assessments, Shilpi Banerjee

Teacher India

How can teachers make classroom-based assessments more valid, reliable, and fair? Shilpi Banerjee shares some guiding principles to help teachers design quality classroom-based assessments and use their results effectively.

Assessment Of Oral Language And Early Literacy In Early Childhood Education And Care: Literature Review, Danielle Anzai, Sandra Knowles, Dan Cloney, Pam Munro-Smith, Pru Mitchell

Early Childhood Education

This literature review is one of a series of reviews to support Victorian early childhood professionals to assess children's learning and development in relation to the five Learning and Development Outcomes in the Victorian Early Years Learning and Development Framework (VEYLDF). This review focuses on the Outcome: Children are effective communicators, and specifically on children as effective oral communicators. Focusing on the development of oral language and early literacy in the early years, this literature review sets out to provide a resource that will equip early childhood professionals with the knowledge to identify and assess children's progress in oral language …

Improving Learning: Reconsidering Student Assessment Globally, Amit Kaushik

Assessment and Reporting

Learning assessment plays a critical role in helping to improve learning under different conditions and in varying situations, as an integral part not just of the teaching–learning process, but also of the larger policy environment. While the objective of each type of assessment may differ, its fundamental purpose remains that of helping to determine progress made by each learner in their individual learning path so as to be able to guide and support further development (Masters 2013). Most importantly, utilizing the data emerging from an assessment is critical to its success. The effort of undertaking an assessment is lost when …

Time For A Paradigm Shift In School Education?, Geoff N. Masters

Occasional Essays

The thesis of this essay is that the schooling paradigm is in need of review and that the answer may lie in a shift in how we think about teaching and learning. Under the prevailing paradigm, the role of teachers is to deliver the year-level curriculum to all students in a year level. This mismatch has unfortunate consequences for both teaching and learning. Currently, many students are not ready for their year-level curriculum because they lack prerequisite knowledge, skills and understandings. The basis for an alternative paradigm and a 'new normal' is presented. The essay addresses concerns raised about changes …

Building Student Persistence With The Use Of Real-Time Feedback On Design Problems, John A. Mirth

ASEE North Midwest Section Annual Conference 2020 Publications

Background: This paper examines the use of a real-time feedback document to assist students in navigating design problems. The design problems are multi-step challenges that culminate in design specifications for a small system. Each problem can be solved using a predictable sequence of calculations. Students customize their specific problem by inserting their own performance parameters to develop a solution that is unique for each student.
Purpose: Two challenges associated with design problems are those of providing effective feedback to students and of grading final submissions that are unique to each student. The research described proposes the use of a structured …

Piaac Numeracy Task Complexity Schema: Factors That Impact On Item Difficulty, Dave Tout, Iddo Gal, Mieke Van Groenestijn, Myrna Manly, Mary Jane Schmitt

Transition and Post-School Education and Training

This paper describes some lessons learned from international adult numeracy assessments that can help in understanding the challenges that people, including both adults and school students, have when solving numeracy tasks and their levels of performance on functional mathematical problems. The paper presents a theoretical schema of five factors that predict, separately and in interaction, the complexity or level of difficulty of mathematically-related assessment tasks, including tasks that incorporate texts and require literacy or reading skills, which are very common in adults' lives. The model was originally developed as part of the development of the Adult Literacy and LifeSkills survey …

Assessment Of Children As Connected With And Contributing To Their World In Early Childhood Education And Care: Literature Review, Kate Noble, Jen Jackson, Pru Mitchell

Early Childhood Education

This literature review unpacks the concept of connection and contribution from the Victorian Early Years Learning and Development Framework (VEYLDF), which includes developing a sense of belonging to groups and communities, and an understanding of the reciprocal rights and responsibilities necessary for active civic participation; responding to diversity with respect; becoming aware of fairness; and becoming socially responsible and showing respect for the environment.

Science In The Early Years. Paper 3: Monitoring Children's Learning, Christine Rosicka, Gayl O'Connor

Early Childhood Education

This third paper in the Science in the Early Years series continues to review current research into science learning and monitoring in the early years. The aim of this series is to provide early years educators with an insight into current research; highlight how research findings relate to children’s science learning; look at the current understandings about monitoring early years science learning; and provide examples of how early years educators can incorporate this research into their practices. This series defines ‘early years’ as the two years prior to school and the first three years of primary school, which in Australia …

The Early Grade Reading Assessment: Assessing Children’S Acquisition Of Basic Literacy Skills In Developing Countries, Australian Council For Educational Research

Assessment GEMS

The Early Grade Reading Assessment (EGRA), administered individually in about 15 minutes, measures the most basic foundation skills for literacy acquisition in the early grades. The assessment was developed by the Research Triangle Institute (RTI) through funding provided by the United States Agency for International Development (USAID) and the World Bank, in addition to resources provided by RTI. In the context of this emerging focus on measuring basic literacy skills, EGRA was developed to provide a battery of assessments of basic reading skills for developing countries to monitor the status of early reading in primary schools. The assessment tool was …

Assessing Learning Of Students With Disabilities, Amit Kaushik

Teacher India

ACER and the Network on Education Quality Monitoring in the Asia-Pacific (NEQMAP) reviewed existing inclusive education policies and practices in the Asia-Pacific region with a particular focus on learning assessment of children with disabilities.

Analysis Of 21st Century Skills Integration As Applied In The Philippines K To 12 Program. Final Report, Claire Scoular

Curriculum development and review

An analysis of 21st Century Skills integration in the Philippines was designed to support the Philippines identify a strategy for assessment, teaching, and learning of 21st century skills (21CS). This project identified and built on a number of recent studies and country initiatives that have highlighted the need for different approaches to the integration of 21CS. This project had three overarching aims: 1. To identify best practices on the use of classroom-level teaching strategies of 21CS to support learning 2. To build in-country capacity to understand, identify, and observe the skills at classroom level 3. To develop a Strategic Road …