Educational Assessment, Evaluation, and Research Commons^™

Interpreting Learning Progress Using Assessment Scores: What Is There To Gain?, Nathan Zoanetti

2021-2030 ACER Research Conferences

Using assessment scores to quantify gains and growth trajectories for individuals and groups can provide a valuable lens on learning progress for all students. This paper summarises some commonly observed patterns of progress and illustrates these using data from ACER’s Progressive Achievement Test (PAT) assessments. While growth trajectory measurement requires scores for the same individuals over at least three but preferably more occasions, scores from only two occasions are naturally more readily available. The difference between two successive scores is usually referred to as gain. Some common approaches and pitfalls when interpreting individual student gain data are illustrated. It is …

Using Assessment Data To Improve Equity: How Teachers Use Insights From The Scottish National Standardised Assessments, Sarah Richardson, Sladana Krstic

2021-2030 ACER Research Conferences

Evidence-based decision-making is regarded as an important indicator of quality in schools around the world. Using data gathered from assessments, in conjunction with other insights, can help school leaders and teachers better meet the needs of learners. In schools that cater to disadvantaged learners, using data to design targeted interventions plays an important role in improving equity. In this paper we report on a study with five schools in Scotland. All schools had learner cohorts characterised by multiple layers of disadvantage. Informed by the theoretical underpinnings of sensemaking theory, we investigated how teachers and school leaders used data from the …

Accountable Assessment, Richard Lehrer

2021-2030 ACER Research Conferences

There is widespread agreement about the importance of accounting for the extent to which educational systems advance student learning. Yet, the forms and formats of accountable assessments often ill serve students and teachers; the summative judgements of student performance that are typically employed to indicate proficiencies on benchmarks of student learning commonly fail to capture student performance in ways that are specific and actionable for teachers. Timing is another key barrier to the utility of summative assessment. In the US, summative evaluations occur at the end of the school year and may serve future students, but do not help teachers …

The Intersection Of Cultural Context And Research Encounter: Focus On Interviewing In Qualitative Research, Rebecca Yvonne Bayeck

Instructional Technology and Learning Sciences Faculty Publications

This article discusses the influence of the cultural context on the interview process. With literature demonstrating the role of spatial context on interviews, the article contends that similar consideration should be given to cultural contexts of research studies. Focusing on the cultural context where the interview takes place and the interactions during the interview can help researchers understand and analyze interview material. Interview forms such as conversation/interview bombing emerged from the interaction of cultural context with the interview process. This points to the need for qualitative researchers to explore how the cultural context shapes their research encounter. Such focus will …

Identifying And Monitoring Progress In Collaboration Skills, Claire Scoular

2021-2030 ACER Research Conferences

The nature of skills such as collaboration is complex, particularly given that there are internal processes at play. Inferences need to be made to interpret explicit behaviours observed from intentionally designed assessment tasks. This paper centres on the approach to develop hypotheses of skill development into validated learning progressions using assessment data. Understanding a skill from a growth perspective is essential for the effective teaching and development of the skill. The application of Item Response Theory (IRT) allows the interpretation of assessment data as levels of proficiency that we can use to map or monitor progress in collaborative skills.

Evidencing Creativity And Curiosity In Ib Schools, Sarah Richardson, Sladana Krstic

2021-2030 ACER Research Conferences

There is growing recognition of the importance of learners gaining transversal or 21st-century attributes in order to thrive in the contemporary world. This poses a number of challenges for educators. First, to what extent are transversal attributes innate, or do they include a combination of traits and skills? Second, what can teachers do to help nurture these attributes in learners? Third, how can the existence or strengthening of attributes be recognised? In this paper, we draw on work that we are doing for the International Baccalaureate Organisation to define conceptual frameworks for creativity and curiosity. Our goal is to enable …

Applying Empirical Learning Progressions For A Holistic Approach To Evidence-Based Education: Swans/Ables, Emily White

2021-2030 ACER Research Conferences

Learning progressions have become an increasing topic of interest for researchers, educational organisations and schools as they can describe the expected pathway of learning within a content area to allow for targeted teaching and learning at all levels of ability. However, there is substantial variation in how learning progressions are developed and to what extent teachers can use them to inform their practices. The ABLES/SWANS tools (Students with Additional Needs/Abilities Based Learning and Education Support) are an example of how an empirical learning progression can be applied to support teachers’ ability to not only target teaching to a student’s zone …

Learning Progressions As Models And Tools For Supporting Classroom Assessment, Alicia C. Alonzo

2021-2030 ACER Research Conferences

Like all models, learning progressions (LPs) provide simplified representations of complex phenomena. One key simplification is the characterisation of student thinking in terms of levels. This characterisation is both essential for large-scale applications, such as informing standards, but potentially problematic for smaller-scale applications. In this paper, I describe a program of research designed to explore the smaller-scale use of LPs as supports for teacher classroom assessment practices in light of this simplification. Based on this research, I conclude that LP levels may serve as a generative heuristic, particularly when teachers are engaged with evidence of the limitations of LP levels …

The Impacts Of The Covid-19 Pandemic On First-Generation, Low-Income And Rural Students In Indonesia And Vietnam: A Cross-Cultural Comparative Study, Rian Djita, Bich Thi Ngoc Tran, Nguyet Thi Minh Nguyen, Budi Wibawanta

Education Reform Faculty and Graduate Students Publications

The COVID-19 pandemic has had a significant impact worldwide, affecting 600 million students in higher education institutions across 200 countries. However, comparative studies by country on this topic are limited. In this paper, we explore the question: how has the COVID-19 pandemic affected higher education students and which ones have been impacted the most? Indonesia and Vietnam are our focus. We leveraged a rich set of data collected online from college/university students from both countries involving over 2600 participants, and used regression analyses to measure the students' outcomes, including the dimensions of their wellbeing, financial hardships, access to technology, and …

Karmel Oration: Excellent Progress For All: A Function Of Year-Level Curriculum Or Evidenced-Based Learning Progressions?, Dianne Siemon

2021-2030 ACER Research Conferences

Excellent progress for all students is an ambitious but necessary goal if we are to improve the life choices of all students. At the moment, we are not serving all our students well despite the best efforts of teachers. We need to look further afield to the curriculum and assessment regimes that drive current practice. Grouping students by ability and offering a watered-down curriculum for some is not the answer. Evidenced-based learning progressions that point to what is important in ensuring all students build a deep, well-connected understanding of mathematics over time is what is needed to support reform at …

This Time Without ‘Feeling’: Children’S Intuitive Theories Of Art As A Logical Basis For Learning Progression In Visual Arts, Karen Maras

2021-2030 ACER Research Conferences

Learning in Visual Arts has traditionally been framed as an experiential process in which feeling and intuition complement the development of aesthetic knowledge. However, while art can be about feelings and processes that develop students’ expressive capacities, the complexity of art understanding and thinking extends beyond this narrow common-sense assumption. I argue that this assumption, which is represented in the Australian Curriculum: The Arts (ACARA, 2015), and even more firmly resonates in recent proposals for the revision of this curriculum (ACARA, 2021), obfuscates the conceptual and theoretical bases on which students make progress in art understanding. This paper examines the …

Developing An Assessment Of Oral Language And Literacy: Measuring Growth In The Early Years, Dan Cloney, Kellie Picker

2021-2030 ACER Research Conferences

Children develop rapidly in their early years. A crucial component of this development is a child’s ability to learn and use language. Even before they enter formal education, children have learned much about oral language and literacy through meaningful interactions with others, and from their life experiences. Children, however, do not develop at the same pace – some children arrive in early childhood education and care (ECEC) programs more advanced while others require additional support. Recent reviews of the assessment tools available to ECEC educators show a lack of good quality measurement and a reliance on checklist style inventories or …

How Education Gets In The Way Of Learning, Geoff N. Masters

2021-2030 ACER Research Conferences

The formal structures and processes of school education – including the organisation of the school curriculum, processes for assessing student learning, methods of reporting performance, and the uses to which student results are put – are often inconsistent with what is now known about the best ways to promote human learning. Rather than being designed to maximise every student’s learning, these structures and processes often reflect 20th century priorities, including the use of school education to sort and select students into different education and training destinations, and future careers. This sorting function of schooling is becoming increasingly irrelevant in knowledge …

Understanding How Covid-19 Has Changed Teachers’ Chances Of Remaining In The Classroom, Gema Zamarro, Andrew Camp, Dillon Fuchsman, Josh B. Mcgee

Education Reform Faculty and Graduate Students Publications

The 2020-2021 academic year was a year like no other. After nationwide school closures during the spring of 2020, schools reopened in the fall of 2020 using combinations of in-person, hybrid, and remote learning models. Teachers had to adapt to unexpected conditions, teaching in unprecedented ways, using synchronous and asynchronous instruction, while also being challenged to establish connections with students, families, and colleagues. Health concerns added to the mix as some teachers went back to in-person education during the height of the pandemic. As a result, teachers' levels of stress and burnout have been high throughout these unusual pandemic times …

Research Conference 2021: Excellent Progress For Every Student: Proceedings And Program, Australian Council For Educational Research

2021-2030 ACER Research Conferences

The focus of the 2021 Australian Council for Educational Research (ACER) Research Conference is on evidence-based strategies for ensuring that every student makes excellent ongoing progress in their learning. This is an important topic because many students in our schools do not make good, steady progress. Some slip behind and fall increasingly behind the longer they are in school. By the middle years of school, this contributes to significant levels of student disengagement. ACER has invited a number of leading educational researchers to join us to share the findings of their research relevant to this topic. An important conclusion of …

Re-Conceptualizing Food Consumption And Its Educational Values, Chi Hong Nguyen, Toan Quoc Tran, Hay Ngoc Huynh, Linh Thuy Pham, Chi Thien Huu Le

Essays in Education

Food consumption has been largely researched in many areas. Most extant studies have highlighted the influences of socio-economic and cultural factors on people’s eating habits. These studies inform policy strategies by proposing campaigns and methods to improve nutritional intake among people of diverse socio-economic and geographical backgrounds. At the same time, they implicitly point out that food consumption may carry educational values that are co-constructed through food eaters’ engagement with the world. This requires researchers to go beyond the current methodological approaches that epistemologically focus on the factors that influence nutritional intake and eating habits. While little is known about …

Strategy And Pedagogical Mechanisms Of Training Competitive Personnels In Higher Educational Institutions, Alisher Yusufjonovich Umarov Rector

Central Asian Journal of Education

This article deals with conceptual basics of special mechanisms in order to carry out the forming of the competitiveness of graduates at higher education institutions, effective mechanisms of the above mentioned process, their content, as well as the main components and levels of such mechanisms based on latest year reforms.

Gender, Age And Staff Preparedness To Adopt Internet Tools For Research Sharing During Covid-19 In African Varsities, Valentine Joseph Owan, Michael Ekpenyong Asuquo Phd., Samuel Okpon Ekaette Ph.D., Sana Aslam, Moses Eteng Obla, Daniel Clement Agurokpon, Mercy Valentine Owan

Library Philosophy and Practice (e-journal)

This study assessed the partial as well as the collaborative impact of age and gender on academic staff preparedness to adopt Internet tools for research sharing in African universities during Covid-19. Although evidence abounds in the literature on gender and age as they affect relatively, scholars’ utilisation of digital tools for research communication, such studies did not examine scholars’ preparedness to adopt from a broad perspective of Africa. This study was conducted based on the argument that the preparedness of scholars may affect their future interest to utilize digital tools for research sharing. A quantitative method, based on the descriptive …

Community Roles For Supporting Emerging Education Researchers, Christopher A. F. Hass, Emilie Hancock, Samantha Wilson, Shams El-Adawy, Eleanor C. Sayre

Mathematics Faculty Scholarship

DBER attracts many faculty from other STEM disciplines, and these faculty have little or no specific training in DBER. DBER requires a mastery of quantitative, qualitative, and/or mixed methodologies, and also a nuanced understanding of breadth of topic, research questions, and theoretical frameworks. This interdisciplinarity is particularly challenging for emerging DBER researchers who often switch into DBER with only discipline specific content and research training. As part of a large study about how STEM faculty become involved with DBER, we interviewed a number of emerging DBER faculty about their pathways into DBER. We conducted a thematic analysis of these interviews …

Implementing Process Pedagogy In The High School Classroom: How To Improve Student Writing While Helping Students Enjoy Writing, Laura Mahaney

English Theses

Traditionally and currently, teachers also focus on the product and not the process in their own classroom. They will assign a paper with a final due date, students turn in their papers without having anyone else look at it beforehand, and students will get a final grade on what is their first draft. This way of teaching writing does not show students how to improve their writing. With this type of assessment, the natural processes of a person’s mind while writing is ignored; students are expected to have everything in their paper in the first draft and without support. Process …

Empirical Drawings: Utilizing Comic Essays In The Social Studies Classroom To Teach Citizenship, Angelo Letizia

SANE journal: Sequential Art Narrative in Education

This article posits that the comic medium, wedded with traditional essay assignments, may be a powerful tool for social studies teachers, those who prepare social studies teachers at the collegiate level and other teachers and professors who desire to teach about citizenship in an era of "fake news" and alternative facts.

Book Review: Introduction To Education Studies, Alhareth Taha Sait

International Journal for Research in Education

Education is one of the main human sciences that has been expanding more recently and has been integrated with other human sciences. That expansion would raise the assumption about how is difficult for junior educational researchers to get started. In fact, there are many books about introductions in education that would be recommended but few would have the desired depth, comprehensiveness, and keeping abreast of what is new in this field. “Introduction to Education Studies” by Diana Burton and Steve Bartlett is one of these recommended books. What distinguishes this book is, firstly: the long experience of its authors in …

Reasons For Parents' Reluctance To Register Their Children In Public Education In Kindergarten In The State Of Kuwait, Laila Saud Alkhayat Dr., Hessa Alsuhail Dr.

International Journal for Research in Education

The purpose of this study was to explore the reasons for parents' reluctance to register their children in public education and their preference for private education in kindergarten in the State of Kuwait. The study used the analytical descriptive methodology, and 311 questionnaires were randomly distributed to parents of children in private schools. This study found some recurring reasons for refraining from general education as follows: (a) The curriculum in public education does not include teaching foreign languages, (b) The frequent absence of children in public schools because of the lack of awareness of parents about the importance of the …

What Sources Of Data Did Teachers Use To Inform Remote Teaching Under Covid-19?, Anne-Marie Chase, Kathryn Richardson, Nathanael Reinertsen

Digital learning research

The Covid-19 pandemic disrupted education systems worldwide, forcing teachers to find new ways to teach students when physical attendance at school was not possible. Our study investigated how teachers gathered and used data to understand and cater for the diverse educational needs of students in remote learning. We surveyed teachers to understand the challenges faced by emergency remote teaching (ERT) and how they gathered and used existing data to meet their students’ needs. While some teachers had experienced online learning as students, few had taught remotely or online. This meant that teachers had limited experience on which to draw when …

Gender And Cross-Cultural Invariance Of Attitudes Toward Statistics Among Non-Stem Undergraduate Students, Mihili Edirisooriya

Dissertations

Because of the wide usage of statistics in almost every field, many universities have incorporated statistics into their undergraduate and graduate curricula. Students taking statistics have often reported negative experiences and an aversion to statistics. Non-STEM students have often reported negative attitudes toward statistics (Chew & Dillon, 2014; Keeley et al., 2008). Researchers have used qualitative and quantitative approaches to measure attitudes toward statistics. The Survey of Attitudes Toward Statistics-36 (SATS-36) scale has been the most widely accepted measure to investigate attitudes toward statistics. Any psychometrically sound measurement instrument requires invariance across groups in its usage. Otherwise, measurement biases could …

Online Prehealth Advising: Impact Analysis Spring 2017 To Fall 2020, Alasdair Ekpenyong, Mykel Beorchia

Publications

At Utah State University, various online, Canvas-based advising programs complement the traditional in-person advising program. The online prehealth advising service assists students who are considering health professions graduate school.

This report explored the association between online prehealth advising participation and student persistence to the next term at Utah State University.

Proceedings Of The Global Conference On Education And Research: Volume 4, Waynne B. James, Cihan Cobanoglu, Muhittin Cavusoglu

University of South Florida (USF) M3 Publishing

This is the fourth volume of the Global Conference on Education and Research Proceedings Series.

ISSN: 2572-6374

DOI

10.5038/2572-6374-v4

Interpreting School Neuropsychology Reports For Educators, Robert H. Martin

University of South Florida (USF) M3 Publishing

School neuropsychology is a field of study that is seeing rapid growth in institutions of higher learning, and subsequently in public and private schools. School neuropsychology assessments are substantially more extensive than traditional psychoeducational assessments reports. The reports are discussed at the student’s Individual Educational Plan (IEP) meeting and school educators need to be present at the meeting. Educators have often expressed that it is extremely difficult to understand the complicated reports. It is often viewed as too complex to grasp and too overwhelming. The purposes of this paper are to help educators understand and interpret the information that comes …

Admitting Smarter: Refining The Admission Process Through Professional Dispositions, Catherine Snyder

University of South Florida (USF) M3 Publishing

Since 2018, news agencies have shifted from reporting teacher layoffs to teacher shortages. This swift shift in the industry left many floundering to recruit enough teachers to fill classrooms. Even in the midst of the Covid-19 crisis, there is still a demand for teachers, now with added online teaching skills. This article addresses one program’s admissions improvement process: an analysis of the acceptance process, improvements and changes in the process with the goal of reducing attrition, and improving the quality of candidates admitted. Several improvements were made, specifically related to introducing dispositional tools and standardizing the acceptance process across the …

Implementing Technology Into Classroom Instructional Practices, Mark B. Christopher

College of Education

As the presence of technology increases within classrooms, teachers are evolving in their instruction; however, teacher utilization of technology within classroom instructional practice is not consistently applied for the educational benefit of students. The acquisition and implementation of classroom technology across rural and non-rural schools are not equitable due to a lack of financial resources and infrastructure (Sundeen & Sundeen, 2013). This mixed-method research study, with an emphasis on quantitative data, utilized a Likert-scale survey examining the thoughts, perceptions, and opinions of 667 K-12 teachers on technology access, support, and professional development along with a questionnaire of nine elementary and …