Educational Assessment, Evaluation, and Research Commons^™

Contemporary Homeschooling Arrangements: An Analysis Of Three Waves Of Nationally Representative Data, Albert Cheng, Daniel Hamlin

Education Reform Faculty and Graduate Students Publications

Homeschooling has increased dramatically in recent decades. During this period of expansion, scholars have reported on growing diversity in the ways that homeschool families educate their children. However, research tends to treat homeschooled children as a uniform group without accounting for differing homeschool arrangements. In this study, we examine the prevalence of four types of homeschool arrangements reported in prior literature as follows: (1) home education supplemented by the use of a private tutor or a homeschool cooperative, (2) home education supplemented by the use of online learning, (3) home education supplemented by part-time enrollment in a brick-and-mortar school, and …

Reporting Student Progress: What Might It Look Like?, Hilary Hollingsworth, Jonathan Heard, Anthony Hockey, Tegan Knuckey

2021-2030 ACER Research Conferences

The Communicating Student Learning Progress review produced by ACER in 2019 set out recommendations for schools and systems to improve the way schools report on student learning, in particular learning progress. Two case study schools from Victoria – a Catholic primary school and government secondary school – discuss changes they’ve made to their student reporting processes, in response to the review’s recommendations. Further research is recommended into how schools are rethinking reporting to engage students and parents in monitoring learning growth.

The Swans/Ables Project: A Set Of Resources Developed Collaboratively With Teachers To Support The Teaching And Learning Of Students With Additional Learning Needs, Toshiko Kamei

2021-2030 ACER Research Conferences

The inclusion of students with additional learning needs in schooling is part of policy and practice in Australia. However, it has been well documented that teachers lack the resources and training to meaningfully include students with additional learning needs in the full range of learning in their classrooms. The SWANs (Students with Additional Needs) program of work aimed to fill this gap through developing assessments based on learning progressions to provide targeted information to support the teaching and learning of all students, including students with additional learning needs. The development and implementation of the SWANs/ABLES suite of resources illustrates how …

How Might We Identify And Measure Learning Progression In History?, Louise Zarmati

2021-2030 ACER Research Conferences

In this session, Dr Zarmati will share her research on efforts to map and describe progress in the learning area of History.

Learning progression is a continuum that measures advances in learning by tracking development from early learning to more sophisticated levels of mastery. Mathematics relies on an understanding of empirical knowledge and concepts in a hierarchical sequence; students need to understand (or master) one mathematical concept before they can proceed to the next. In comparison, progress of understanding in history is not necessarily hierarchical because it is based on mastery of concepts and skills rather than historical knowledge, which …

Supporting Science Teaching Practice With Learning Progressions, Erin Furtak

2021-2030 ACER Research Conferences

Learning progressions are often used as foundations for curriculum and assessment. At the same time, as representations of the development of student ideas and practices, they can also serve as maps to support teachers during instruction. This paper describes a program of research in which my colleagues and I have investigated how learning progressions can support high school science teachers in cycles of co-designing formative assessments.

Rethinking Measurement For Accountable Assessment, Mark Wilson

2021-2030 ACER Research Conferences

The underlying model for most formal educational measurement (e.g. standardised tests) is based on a very simple model: the student takes a test (possibly alongside other students). The complications of there being an instructional plan, actual instruction, interpretation of the outcome, and formulation of next steps, are all bypassed in considering how to model the process of measurement. There are some standard exceptions, of course: a pre-test/post-test context will involve two measurements, and attention to gain score, or similar. However, if we wish to design measurement to hold to Lehrer’s (2021) definition of ‘accountable assessment’ – as ‘actionable information for …

Scaling Education Pathways Initiative (Sepi) Analysis, Ginger M. Reynolds

Reports, Analyses, and other Publications

No abstract provided.

Campus Racial Climate, Boundary Work And The Fear And Sexualization Of Black Masculinities On A Predominantly White University, Quaylan Allen

Education Faculty Articles and Research

This article presents data from a study of Black men and masculinities at a predominantly White university. I argue that the campus racial climate on predominantly White universities are important sites of boundary work where fear and sexualization of Black masculinities are normalized in ways that shape Black men’s social relations on college campuses. In doing so, I will share narrative data of how Black male college students perceive the campus racial climate, with a focus on how they are feared and sexualized in predominantly White spaces. I also analyze the ways in which they managed race, gender, and sexuality …

Making Excellent Progress In Early Reading: How Can The Identification Of Essential Skills And Concepts Help?, Dara Ramalingam, Prue Anderson, Sandra Knowles, Danielle Anzai, Greta Rollo

2021-2030 ACER Research Conferences

The ability to read and understand text is fundamental to full participation in modern adult life (Olson, 1977; Elwert, 2001). It is essential to educational progress across domains, but increased literacy levels are also linked to positive outcomes in terms of employment and health. Given its critical role both in the facilitation of learning in all domains, and in many aspects of life beyond school, it is imperative that we give students the best possible chance to develop their reading skills. This paper uses early reading as a case study for examining how the identification and explication of essential skills …

Leading System Transformation: A Work In Progress, Greg Whitby, Maura Manning, Gavin Hays

2021-2030 ACER Research Conferences

Internationally, the COVID-19 pandemic has profoundly disrupted the education sector. While NSW has avoided the longer periods of remote learning that our colleagues in Victoria and other countries have experienced, we have nonetheless been provoked to reflect on the nature of schooling and the systemic support we provide to transform the learning of each student and enrich the professional lives of staff within our Catholic learning community. At Catholic Education Diocese of Parramatta (CEDP), a key pillar of our approach is to create conditions that enable everyone to be a leader. Following the initial lockdown period in 2020 when students …

Interpreting Learning Progress Using Assessment Scores: What Is There To Gain?, Nathan Zoanetti

2021-2030 ACER Research Conferences

Using assessment scores to quantify gains and growth trajectories for individuals and groups can provide a valuable lens on learning progress for all students. This paper summarises some commonly observed patterns of progress and illustrates these using data from ACER’s Progressive Achievement Test (PAT) assessments. While growth trajectory measurement requires scores for the same individuals over at least three but preferably more occasions, scores from only two occasions are naturally more readily available. The difference between two successive scores is usually referred to as gain. Some common approaches and pitfalls when interpreting individual student gain data are illustrated. It is …

Using Assessment Data To Improve Equity: How Teachers Use Insights From The Scottish National Standardised Assessments, Sarah Richardson, Sladana Krstic

2021-2030 ACER Research Conferences

Evidence-based decision-making is regarded as an important indicator of quality in schools around the world. Using data gathered from assessments, in conjunction with other insights, can help school leaders and teachers better meet the needs of learners. In schools that cater to disadvantaged learners, using data to design targeted interventions plays an important role in improving equity. In this paper we report on a study with five schools in Scotland. All schools had learner cohorts characterised by multiple layers of disadvantage. Informed by the theoretical underpinnings of sensemaking theory, we investigated how teachers and school leaders used data from the …

Accountable Assessment, Richard Lehrer

2021-2030 ACER Research Conferences

There is widespread agreement about the importance of accounting for the extent to which educational systems advance student learning. Yet, the forms and formats of accountable assessments often ill serve students and teachers; the summative judgements of student performance that are typically employed to indicate proficiencies on benchmarks of student learning commonly fail to capture student performance in ways that are specific and actionable for teachers. Timing is another key barrier to the utility of summative assessment. In the US, summative evaluations occur at the end of the school year and may serve future students, but do not help teachers …

The Intersection Of Cultural Context And Research Encounter: Focus On Interviewing In Qualitative Research, Rebecca Yvonne Bayeck

Instructional Technology and Learning Sciences Faculty Publications

This article discusses the influence of the cultural context on the interview process. With literature demonstrating the role of spatial context on interviews, the article contends that similar consideration should be given to cultural contexts of research studies. Focusing on the cultural context where the interview takes place and the interactions during the interview can help researchers understand and analyze interview material. Interview forms such as conversation/interview bombing emerged from the interaction of cultural context with the interview process. This points to the need for qualitative researchers to explore how the cultural context shapes their research encounter. Such focus will …

Identifying And Monitoring Progress In Collaboration Skills, Claire Scoular

2021-2030 ACER Research Conferences

The nature of skills such as collaboration is complex, particularly given that there are internal processes at play. Inferences need to be made to interpret explicit behaviours observed from intentionally designed assessment tasks. This paper centres on the approach to develop hypotheses of skill development into validated learning progressions using assessment data. Understanding a skill from a growth perspective is essential for the effective teaching and development of the skill. The application of Item Response Theory (IRT) allows the interpretation of assessment data as levels of proficiency that we can use to map or monitor progress in collaborative skills.

Evidencing Creativity And Curiosity In Ib Schools, Sarah Richardson, Sladana Krstic

2021-2030 ACER Research Conferences

There is growing recognition of the importance of learners gaining transversal or 21st-century attributes in order to thrive in the contemporary world. This poses a number of challenges for educators. First, to what extent are transversal attributes innate, or do they include a combination of traits and skills? Second, what can teachers do to help nurture these attributes in learners? Third, how can the existence or strengthening of attributes be recognised? In this paper, we draw on work that we are doing for the International Baccalaureate Organisation to define conceptual frameworks for creativity and curiosity. Our goal is to enable …

Applying Empirical Learning Progressions For A Holistic Approach To Evidence-Based Education: Swans/Ables, Emily White

2021-2030 ACER Research Conferences

Learning progressions have become an increasing topic of interest for researchers, educational organisations and schools as they can describe the expected pathway of learning within a content area to allow for targeted teaching and learning at all levels of ability. However, there is substantial variation in how learning progressions are developed and to what extent teachers can use them to inform their practices. The ABLES/SWANS tools (Students with Additional Needs/Abilities Based Learning and Education Support) are an example of how an empirical learning progression can be applied to support teachers’ ability to not only target teaching to a student’s zone …

Learning Progressions As Models And Tools For Supporting Classroom Assessment, Alicia C. Alonzo

2021-2030 ACER Research Conferences

Like all models, learning progressions (LPs) provide simplified representations of complex phenomena. One key simplification is the characterisation of student thinking in terms of levels. This characterisation is both essential for large-scale applications, such as informing standards, but potentially problematic for smaller-scale applications. In this paper, I describe a program of research designed to explore the smaller-scale use of LPs as supports for teacher classroom assessment practices in light of this simplification. Based on this research, I conclude that LP levels may serve as a generative heuristic, particularly when teachers are engaged with evidence of the limitations of LP levels …

The Impacts Of The Covid-19 Pandemic On First-Generation, Low-Income And Rural Students In Indonesia And Vietnam: A Cross-Cultural Comparative Study, Rian Djita, Bich Thi Ngoc Tran, Nguyet Thi Minh Nguyen, Budi Wibawanta

Education Reform Faculty and Graduate Students Publications

The COVID-19 pandemic has had a significant impact worldwide, affecting 600 million students in higher education institutions across 200 countries. However, comparative studies by country on this topic are limited. In this paper, we explore the question: how has the COVID-19 pandemic affected higher education students and which ones have been impacted the most? Indonesia and Vietnam are our focus. We leveraged a rich set of data collected online from college/university students from both countries involving over 2600 participants, and used regression analyses to measure the students' outcomes, including the dimensions of their wellbeing, financial hardships, access to technology, and …

Karmel Oration: Excellent Progress For All: A Function Of Year-Level Curriculum Or Evidenced-Based Learning Progressions?, Dianne Siemon

2021-2030 ACER Research Conferences

Excellent progress for all students is an ambitious but necessary goal if we are to improve the life choices of all students. At the moment, we are not serving all our students well despite the best efforts of teachers. We need to look further afield to the curriculum and assessment regimes that drive current practice. Grouping students by ability and offering a watered-down curriculum for some is not the answer. Evidenced-based learning progressions that point to what is important in ensuring all students build a deep, well-connected understanding of mathematics over time is what is needed to support reform at …

This Time Without ‘Feeling’: Children’S Intuitive Theories Of Art As A Logical Basis For Learning Progression In Visual Arts, Karen Maras

2021-2030 ACER Research Conferences

Learning in Visual Arts has traditionally been framed as an experiential process in which feeling and intuition complement the development of aesthetic knowledge. However, while art can be about feelings and processes that develop students’ expressive capacities, the complexity of art understanding and thinking extends beyond this narrow common-sense assumption. I argue that this assumption, which is represented in the Australian Curriculum: The Arts (ACARA, 2015), and even more firmly resonates in recent proposals for the revision of this curriculum (ACARA, 2021), obfuscates the conceptual and theoretical bases on which students make progress in art understanding. This paper examines the …

Developing An Assessment Of Oral Language And Literacy: Measuring Growth In The Early Years, Dan Cloney, Kellie Picker

2021-2030 ACER Research Conferences

Children develop rapidly in their early years. A crucial component of this development is a child’s ability to learn and use language. Even before they enter formal education, children have learned much about oral language and literacy through meaningful interactions with others, and from their life experiences. Children, however, do not develop at the same pace – some children arrive in early childhood education and care (ECEC) programs more advanced while others require additional support. Recent reviews of the assessment tools available to ECEC educators show a lack of good quality measurement and a reliance on checklist style inventories or …

How Education Gets In The Way Of Learning, Geoff N. Masters

2021-2030 ACER Research Conferences

The formal structures and processes of school education – including the organisation of the school curriculum, processes for assessing student learning, methods of reporting performance, and the uses to which student results are put – are often inconsistent with what is now known about the best ways to promote human learning. Rather than being designed to maximise every student’s learning, these structures and processes often reflect 20th century priorities, including the use of school education to sort and select students into different education and training destinations, and future careers. This sorting function of schooling is becoming increasingly irrelevant in knowledge …

Research Conference 2021: Excellent Progress For Every Student: Proceedings And Program, Australian Council For Educational Research

2021-2030 ACER Research Conferences

The focus of the 2021 Australian Council for Educational Research (ACER) Research Conference is on evidence-based strategies for ensuring that every student makes excellent ongoing progress in their learning. This is an important topic because many students in our schools do not make good, steady progress. Some slip behind and fall increasingly behind the longer they are in school. By the middle years of school, this contributes to significant levels of student disengagement. ACER has invited a number of leading educational researchers to join us to share the findings of their research relevant to this topic. An important conclusion of …

Understanding How Covid-19 Has Changed Teachers’ Chances Of Remaining In The Classroom, Gema Zamarro, Andrew Camp, Dillon Fuchsman, Josh B. Mcgee

Education Reform Faculty and Graduate Students Publications

The 2020-2021 academic year was a year like no other. After nationwide school closures during the spring of 2020, schools reopened in the fall of 2020 using combinations of in-person, hybrid, and remote learning models. Teachers had to adapt to unexpected conditions, teaching in unprecedented ways, using synchronous and asynchronous instruction, while also being challenged to establish connections with students, families, and colleagues. Health concerns added to the mix as some teachers went back to in-person education during the height of the pandemic. As a result, teachers' levels of stress and burnout have been high throughout these unusual pandemic times …

Re-Conceptualizing Food Consumption And Its Educational Values, Chi Hong Nguyen, Toan Quoc Tran, Hay Ngoc Huynh, Linh Thuy Pham, Chi Thien Huu Le

Essays in Education

Food consumption has been largely researched in many areas. Most extant studies have highlighted the influences of socio-economic and cultural factors on people’s eating habits. These studies inform policy strategies by proposing campaigns and methods to improve nutritional intake among people of diverse socio-economic and geographical backgrounds. At the same time, they implicitly point out that food consumption may carry educational values that are co-constructed through food eaters’ engagement with the world. This requires researchers to go beyond the current methodological approaches that epistemologically focus on the factors that influence nutritional intake and eating habits. While little is known about …

Strategy And Pedagogical Mechanisms Of Training Competitive Personnels In Higher Educational Institutions, Alisher Yusufjonovich Umarov Rector

Central Asian Journal of Education

This article deals with conceptual basics of special mechanisms in order to carry out the forming of the competitiveness of graduates at higher education institutions, effective mechanisms of the above mentioned process, their content, as well as the main components and levels of such mechanisms based on latest year reforms.

Gender, Age And Staff Preparedness To Adopt Internet Tools For Research Sharing During Covid-19 In African Varsities, Valentine Joseph Owan, Michael Ekpenyong Asuquo Phd., Samuel Okpon Ekaette Ph.D., Sana Aslam, Moses Eteng Obla, Daniel Clement Agurokpon, Mercy Valentine Owan

Library Philosophy and Practice (e-journal)

This study assessed the partial as well as the collaborative impact of age and gender on academic staff preparedness to adopt Internet tools for research sharing in African universities during Covid-19. Although evidence abounds in the literature on gender and age as they affect relatively, scholars’ utilisation of digital tools for research communication, such studies did not examine scholars’ preparedness to adopt from a broad perspective of Africa. This study was conducted based on the argument that the preparedness of scholars may affect their future interest to utilize digital tools for research sharing. A quantitative method, based on the descriptive …

Community Roles For Supporting Emerging Education Researchers, Christopher A. F. Hass, Emilie Hancock, Samantha Wilson, Shams El-Adawy, Eleanor C. Sayre

Mathematics Faculty Scholarship

DBER attracts many faculty from other STEM disciplines, and these faculty have little or no specific training in DBER. DBER requires a mastery of quantitative, qualitative, and/or mixed methodologies, and also a nuanced understanding of breadth of topic, research questions, and theoretical frameworks. This interdisciplinarity is particularly challenging for emerging DBER researchers who often switch into DBER with only discipline specific content and research training. As part of a large study about how STEM faculty become involved with DBER, we interviewed a number of emerging DBER faculty about their pathways into DBER. We conducted a thematic analysis of these interviews …

Implementing Process Pedagogy In The High School Classroom: How To Improve Student Writing While Helping Students Enjoy Writing, Laura Mahaney

English Theses

Traditionally and currently, teachers also focus on the product and not the process in their own classroom. They will assign a paper with a final due date, students turn in their papers without having anyone else look at it beforehand, and students will get a final grade on what is their first draft. This way of teaching writing does not show students how to improve their writing. With this type of assessment, the natural processes of a person’s mind while writing is ignored; students are expected to have everything in their paper in the first draft and without support. Process …