Educational Assessment, Evaluation, and Research Commons^™

Assessment Moderation: Is It Fit For Purpose?, Lenore Adie

2021-2030 ACER Research Conferences

This presentation outlines the different practices and purposes of assessment moderation and analyses the benefits and issues of these. Two projects are presented; each seeks to improve teacher judgement. Both attempt to redefine what we mean by moderation and how moderation can be conducted to reach diverse and dispersed groups. The first draws on a current Australian Research Council project that is exploring the development of scaled exemplars, the use of commentaries of judgement decisions, and the use of digital platforms to support teachers grading student work. The second draws on the work of the Graduate Teacher Performance Assessment (GTPA) …

The Transformational Change Of Adaptive Assessment, Jarrod Hingston, Toby Newton

2021-2030 ACER Research Conferences

Organisational change theory often discusses the differences between adaptive change and transformational change; adaptive change being the process of incremental shifts that are intended to drive improvement, while transformational change requires major alterations in processes. In 2019, ACER embarked on a mission to develop a new adaptive testing and reporting system, with the goal of delivering an assessment that would improve the precision of results for every student. While the intention was to introduce an adaptive change in the assessments, the project truly transformed the way that ACER delivers assessments and reports results, a result recognised by the project being …

An Innovative Method For Teachers To Formatively Assess Writing Online, Dr Sandy Heldsinger, Stephen Humphry

2021-2030 ACER Research Conferences

Assessment is an integral component of effective teaching and a teacher’s professional judgement influences all routine aspects of their work. In the last 20 years, there has been considerable work internationally to support teachers in using assessment to improve student learning. However, there is a pressing issue that impedes teacher professional judgement being exploited to its full potential. The issue relates to teacher assessments in the context of extended performances such as essays and arises from the complexity of obtaining reliable or consistent teacher assessments of students’ work. Literature published in the United States, England and Australia details evidence of …

Using Pat Data To Inform Teaching And Learning, Marc Kralj, Rachel Felgate, Shani Sniedze, Caithlin Power, Grant Barclay, Darren Leech

2021-2030 ACER Research Conferences

ACER works with thousands of Australian schools to set up Progressive Achievement Test (PAT) functionality, assign and administer tests, and to assist teachers to understand and interrogate the resulting test data and act upon findings. This session provides participants with an opportunity to hear about a school’s journey, and discuss this with the ACER team and our PAT school guest. ACER researchers have evaluated and documented assessment implementation and professional development opportunities, observing this school’s ability to track student and educator progress over time, which is a critical element in ACER’s Progressive Achievement approach. ACER’s educational consultants will demonstrate how …

Reimagining Classroom Assessment And Feedback To Meet Learner Needs, Fabienne Van Der Kleij

2021-2030 ACER Research Conferences

The power of classroom assessment and feedback to improve student learning outcomes has long been recognised. Yet, decades of research have yielded disappointing and often conflicting outcomes. This presentation challenges traditional conceptions of classroom assessment and feedback as teacher-driven practices. To meet learner needs better, it proposes a student-centred perspective in which students are active and have agency. By drawing on an extensive study of feedback reviews, this presentation illustrates how conceptualisations of feedback have changed over recent decades. This paper provides key insights into how classroom assessment and feedback practices can be changed in ways that are sustainable, afford …

Reimagining The Purpose Of Assessment, Geoff N. Masters

2021-2030 ACER Research Conferences

Assessment is commonly understood as the process of judging how well students have learnt what they have been taught. It comes at the end of a sequence that begins with a curriculum or course syllabus. Teachers are expected to deliver this body of specified content, students are expected to learn it, and assessment is the process of judging and grading students on how well they have learnt what teachers have taught. This is a common view of assessment among students, parents and many teachers. I will argue in this presentation that this traditional understanding of what it means to learn …

Research Conference 2022: Reimagining Assessment: Proceedings And Program, Kylie Burns (Ed.)

2021-2030 ACER Research Conferences

The focus of this year’s Research Conference is on the use of assessment to support improved teaching and learning. The conference is titled ‘reimagining assessment’ because we believe there is a need to transform the essential purposes of educational assessment to provide better information about the deep conceptual learning, skills, competencies, and personal attributes that teachers and schools now have as objectives for student learning and development. Reimagined assessments must now be focused on monitoring learning across this broader range of intended outcomes and provide quality information about the points individuals have reached in their long-term development.

Relationships Between And Student Perceptions Of Self-Efficacy, Growth Mindset, And Mathematics Identity Of Adolescents In A Rural South Georgia Charter School, Carrie Cooper Pierce

Theses and Dissertations

This mixed methods study investigated the relationships between the constructs of self-efficacy, growth mindset, and mathematics identity among middle school students at a South Georgia charter school. Constructivist grounded theory was used to investigate the strength of these constructs along with student perceptions of what factors make one a math person. The study was an explanatory sequential design consisting of an online survey followed by student interviews. Ninety-one students participated in the survey. Multiple linear regression was used to determine whether a correlation existed between the variables as well as among student subgroups. Self-efficacy was found to be a predictor …

Could The Inclusion Of Certain Building Information And Modelling Aspects Into The Leaving Certificate Engineering Syllabus, Aid The Transition Of Students Into Third Level Education, When Choosing A Course Within The Construction Industry, Joseph Boyle, Deborah M. Brennan

Capstone Reports

The paper investigates the effects of implementing several Building Information and Modelling (BIM) aspects into the Leaving Certificate Engineering Syllabus and examines the impact this has on students choosing third level Architectural Engineering and Construction (AEC) industry courses with the desire of improving the shortage in the sector. The method and content of the study was based on academic research on second level education in other European countries through the lens of a Literature Review. A sixteen-week pilot program was trialed with over one hundred students at Senior Cycle. The outcomes of the study were critically evaluated through stakeholder interviews …

Effect On Student Achievement For Middle School Math Students Using Blackboard, Canvas And Schoology In The State Of Virginia, Rosa Ann Woodley-Richard

Doctoral Dissertations and Projects

The purpose of this quantitative, causal-comparative research was to compare the differences in middle-school student achievement for grade 7 math students among three different learning management systems: Blackboard, Canvas, and Schoology. The instrument was the Virginia Grade 7 Math Standards of Learning test. The population included students in the 7th grade attending a public school in the state of Virginia. The participants were the individual school districts. The study examined the means between the pass rates of the three learning management systems to see if there was a significant difference. The independent variable included the three learning management systems: Blackboard, …

Important Factors Discriminating Between Problem-Solving Experts And Novices: A Data Mining Approach, Song Li Jin, Kwok Cheung Cheung, Pou Seong Sit

Chinese/English Journal of Educational Measurement and Evaluation | 教育测量与评估双语期刊

Digital problem-solving competence is widely recognized as one of the core skills of the 21st century. A number of important factors influence this competence; some are task-specific pertaining to the problem-solving processes while others are non-task-specific related to knowledge, skills, attitudes and beliefs of the problem solvers, as well as the student learning environment. This study sought to determine important factors that classify student problem-solver as “high-performing expert” versus “low-performing novice”, using computer-generated log files of an exemplary digital problem task assessed in Organization for Economic Co-operation and Development (OECD)’s Programme for International Student Assessment (PISA) 2012 Study. The participants …

Positionality: The Interplay Of Space, Context And Identity, Rebecca Y. Bayeck

Instructional Technology and Learning Sciences Faculty Publications

This article considers the way in which positionality shifts and is formed during a cross-cultural study to reveal the complexity of the insider-outsider status. As a researcher in a male-dominated game setting, I reflect on the research process and my interactions with participants to show the interplay of space, context, and identity in shaping a researcher’s status. I discuss the process of gaining access to the research site and participants, and data collection in relation to space, context, and identity. The interaction of my identities with space, and context informed my status at various moments. This interplay constructs a complex …

Collage As A Transdisciplinary Learning And Teaching Method In A Time Of International Crisis, James Green Dr

Arts and Design

This paper discusses the art and design method of collage and its efficacy as a trans-disciplinary learning and teaching technique that can be delivered remotely while living through a pandemic and the restrictions of a national lockdown. Collage is a method for making artworks by pasting together desperate elements, such as printed matter or digital images, to make a relatively unified image. Trans-disciplinary learning integrates perspectives from a range of different disciplines, going beyond a given students subject discipline, and should enable students to draw on these perspectives to gain a deeper understanding of their discipline. This was managed through …

Secondary Educators' Experiences Implementing Formative Assessment In Rural Southern Maryland: A Transcendental Phenomenological Qualitative Study, Bonnie J. Skinner

Doctoral Dissertations and Projects

The purpose of this phenomenological qualitative study is to describe secondary educators’ experiences in planning and implementing formative assessment in rural southern Maryland to gain an understanding of their definition and use of Assessment for Learning (AfL) in diverse classrooms. The theory guiding this study, the sociocultural learning theory, grew from the work of the psychologist Vygotsky. The sociocultural learning theory is the best worldview for this study as Vygotsky’s beliefs of parents, caregivers, peers, other mentors (teachers), and culture are responsible for the development of cognition and higher-order functions with learning occurring by interacting with other people. Four essential …

Use Of The Prepare Tool To Increase Completion Rates Of Advance Care Planning Documentation, Janella Thompson

Student Scholarly Projects

Practice Problem: One in three adults aged 55 and older admitted to the hospital lack advance care planning. Patients without advance care planning may not receive treatment that reflects their personal values, wishes, and preferences

PICOT: The PICOT question that guided this project was in adults 65 years or older (P), how does the implementation of a patient-centered web-based advance planning tool kit (I) compared to the usual practice of addressing advance care planning (C), affect the completion rate of advance care planning documentation (O) within 10 weeks (T).

Evidence: The current evidence has demonstrated that advanced care …

A Winning Approach: Teaching Science Communication Skills Through Small-Group Workshops, Serena B. Gumusoglu, Maria Noterman Soulinthavong, Jennifer Barr

Higher Learning Research Communications

Objectives: Research almost always culminates in the communication of findings. Despite the necessity of grant and manuscript writing throughout academic careers, scientific trainees often receive little guided practice in written communication. To fill this gap, we designed, implemented, and evaluated a voluntary writing initiative for biomedical students at a research-intensive (R1) university in the midwestern United States called Writing Initiative in Neuroscience (WIN).

Method: WIN consisted of didactic and workshop components. The didactic component included discussions with topic-specific experts on writing grants and manuscripts for the public and for non-academic scientific careers. The workshop component consisted of small group-based peer …

Laying The Foundation For Education 4.0: Access, Value And Accountability, Jennifer Karlin, L. Eric James, Lauren Singelmann, Dan Ewert

Integrated Engineering Department Publications

The complexity of the global problems engineers are working to solve has long been discussed in both engineering and engineering education circles. The Grand Challenges for Engineering are grand because of the complexity of the challenges. While the challenges stand over a decade later, the speed at which the terms in which they are described, the shift from Industry 3.0 to Industry 4.0, has been slow. As the world becomes more deeply connected, as the internet of things becomes more commonplace in all parts of our lives, as technologies like machine learning and cyber physical systems become accessible to even …

A Comparative Exploration Into First Time In College Student Academic Performance In Face-To-Face Versus Remote Learning Environments, Ashley Click

Theses & Dissertations

In spring 2020, the COVID-19 pandemic forced educational systems to transition into an emergency remote learning modality. This quantitative study compared retention and productive grade rates of two 16-week academic semesters and compared face-to-face (fall 2019) and remote (fall 2020) emergency remote instruction. The study sample was drawn from the core courses of History, English, and Speech at San Antonio College. Those courses were selected in part due to the high proportion of first time in college students who were considered a vulnerable population regarding performance and persistence. Additional variables (i.e., gender, veteran status, first-generation status, and socio-economic status) were …

Teachers’ And Students’ Views On The Use Of Songs In Teaching And Learning Ionic Bonds, Omollo D. O, Winston Edward Massam

Institute for Educational Development, East Africa

Taking into consideration learner engagement during a chemistry lesson is a very crucial step if conceptual understanding is one of the goals. In the current times, teachers are drastically losing a grasp of their learners during lessons, especially chemistry lessons. However, studies that borrowed from the kindergartens have proved that incorporation of songs during lessons may engage learners. This qualitative research, which took an action research design, explored the feasibility of applying songs in rich science content in enhancing interest, motivation and engagement in ionic bonding and similar chemistry concepts among Kenyan high school students. The aim of the study …

Metrics In Group Work, Emily Faulconer

Publications

Collaborative Learning, asynchronously online

• Critical Thinking
• Tech Literacy
• Communication
• Ethics
• Cultural Literacy
• Info Literacy

The Effects Of Immersive Virtual Environments On Motivation, Oral Communication, And Instructional Strategy In Efl Classrooms, John Martin Shipko

Graduate Theses and Dissertations

The creation of web-based real-time computer simulations has given language educators incredible new opportunities to create immersive experiences for English as a Foreign Language (EFL) learners. This thesis reviewed 12 empirical studies, 3 previous literature reviews, 3 non-empirical journal articles, and 23 additional background sources investigating the impact of Immersive Virtual Environments (IVE) on EFL learners’ motivation and oral communication in EFL learning. 12 empirical studies were analyzed closely while other sources were used to provide additional information and theoretical insights. The findings indicate that IVEs offer novel ways to connect EFL learners to native-speaking communities where they can acquire …

Teaching Learning Newsletter Vol 2 Issue 2, Sastra Deemed To Be University

TLC Newsletter

No abstract provided.

Student Achievement And Teacher Perceptions Of School Climate In Title 1 And Non-Title 1 Schools, Jennifer E. Pangle

Electronic Theses and Dissertations

The purpose of this quantitative study was to determine if there is a significant relationship between student achievement and teacher perceptions of school climate. An additional purpose of this study was to determine if there is a significant difference in teacher perceptions between Title 1 and non-Title 1 schools. The final purpose of this study was to determine if there is a significant difference in teacher perceptions of school climate among the schools according to overall student achievement. A series of Spearman’s Correlation analyses were used to analyze data to determine if there was a significant relationship between TVAAS composite …

Exploring The Lived Experiences Of Public High School Teachers And Instructional Coaches Participating In Virtual Instructional Coaching During The Covid-19 Pandemic, Alyson J. Manion

All Theses And Dissertations

The purpose of this qualitative phenomenological study was to explore the lived experiences of public high school teachers (grades 9-12) and instructional coaches who have participated in virtual instructional coaching during the COVID-19 pandemic. Three research questions guided this study: (1) How do public high school teachers and instructional coaches describe their experience with virtual instructional coaching during the COVID-19 pandemic?, (2) How do public high school teachers and instructional coaches describe the changes in instructional coaching experienced during the COVID-19 pandemic?, and (3) How do public high school teachers and instructional coaches describe their relationships with their instructional coaching …

Case Study: Exploring Inservice Teachers’ Perceptions And Experiences Of The Effectiveness Of Gifted Preparation And Training Programs In Saudi Arabia, Khlood Khaled Alshareef

Graduate Theses and Dissertations

In Saudi Arabia, the teaching of gifted and talented students is relatively new, and research that describes the quality and effectiveness of teachers' gifted preparation programs and the training sessions they receive remain rather limited and inconsistent. Purpose: This dissertation focuses on understanding the perceptions and experiences of in-service teachers regarding gifted-focused preparation and training programs in the country. Research Design: Data were collected through observation and semi-structured interviews with teachers of gifted and talented students in the country. Findings: Analysis of the data revealed six themes related to teachers’ perceptions and experiences of preparation and training programs in Saudi …

Piloting A Qualitative Interview For Malaysia Primary School Active Learning Needs Analysis Regarding Learner Control Experiences, Leow Min Hui, Siti Hajar Binti Halili, Rafiza Binti Abdul Razak

The Qualitative Report

This paper describes a holistic process of a pilot test to determine the trustworthiness of semi-structured interview questions to be used in the qualitative investigation of Malaysia primary school active learning needs analysis, by focusing on the learner control peculiarity in the context. The researchers carried out the pilot test based on a sequential cycle of determining, assessment, adjustment, revisiting, and reflection. The researchers generated semi-structured interview questions mainly based on Hutchinson and Waters’s (1987) framework for analysis of learning needs. The researchers tested the semi-structured interview questions on two teacher and two pupil participants mirroring the intended subjects in …

Diversity, Equity, And Inclusion: Three Essays In The Educational Context, James D. Paul

Graduate Theses and Dissertations

Many universities and K-12 public school systems express a significant, formal commitment to the ideals of diversity, equity, and inclusion (DEI). Relative to the emphasis on DEI in America’s educational institutions, however, there has been little research describing DEI trends and evaluating the efficacy of DEI bureaucracies. This three-chapter dissertation examines DEI trends that have been the subject of much discussion—but rarely studied empirically.

For example, chapter one analyzes how universities promote DEI when hiring new faculty. I audit a subset of academic job postings and present the first evidence on how many require DEI statements, as well as the …

Educators Synchronously Using Multiple Platforms And Devices For Teaching And Learning During Covid-19 Lockdown, Nyarai Tunjera, Agnes Chigona

Journal of Educational Technology Development and Exchange (JETDE)

The 21st century coupled with the COVID-19 worldwide pandemic is indeed imposing new demands on teaching and learning. Higher education institutions affected extensively educational institutions are mandated with the responsibility of inclusiveness and preparing students for realities of the current and unknown future. There has been heightened attention to educational technologies to mitigate the COVID-19 instigated disruptions. To ensure inclusiveness during future pandemics, there is a need to pay attention to the forms of digital technologies that students have access to (e.g., mobile phones, laptops, as well as applications they are using) in their areas. The article reports the use …

An Analysis Of Retention Through The Perceptions Of Teachers In A Middle Georgia School District, Mark Antley

Theses and Dissertations

The purpose of this study was to assess the initiatives and incentives preferred by certified teachers employed by a Middle Georgia school district with the goal of formulating a plan to retain teachers. This quantitative study looked at factors such as race, gender, age, and grade level of teachers and the statistical significance to initiatives and incentives and the effect on teacher retention. The data from the study was obtained using a survey administered to teachers in the district with various levels of experience.

Culturally Responsive Pedagogy: A Case Study In Georgia, Glenda Johnson - Mapp

Theses and Dissertations

This study explored the phenomenon of culturally responsive pedagogy to address the problem of limited data to inform best practices in facilitating high teacher self-efficacy with culturally responsive teaching practices. Using a qualitative exploratory case study design with an initial quantitative component, the perceptions of content-area middle school general education teachers regarding culturally responsive pedagogy in their classroom teaching practices were assessed and considered in respect to their reported perceptions of self-efficacy with culturally responsive teaching. The study’s quantitative component used the Teacher Self-Efficacy on Culturally Responsive Pedagogy Scale to assess the perceived self-efficacy with culturally responsive teaching of 150 …