Educational Assessment, Evaluation, and Research Commons^™

Acer 2019-2020 Annual Report, Australian Council For Educational Research (Acer)

ACER Annual Reports

No abstract provided.

Recommendations On Using Artificial Intelligence In Archival Appraisal And Selection, Rebecca Y. Bayeck, Giovanni Colavizza, Jenny Bunn, Mark Bell, Souvick Ghosh

Instructional Technology and Learning Sciences Faculty Publications

This article reports on discussions from a three-day webinar about artificial intelligence (AI) in archival appraisal and selection. Increasingly, workshops and research are conducted to discuss AI and archives. This article is an example of this growing interest in the potential of AI for the field of archives. Yet, within the field, discussions about how AI can be applied in archival appraisal and selection is still limited. To advance a conversation on the issue, and particularly on ways to use AI in archival appraisal and selection, we organized a three-day webinar in 2022 with a diverse group of researchers and …

A Program Evaluation Of A Social-Emotional Alternative Learning Program, Patricia Horton-Albritton

Doctor of Education Dissertations

The names of the participants and the school district used in this program evaluation are pseudonyms to protect the participant’s identity. This program evaluation was from the perceptions of the parent/guardian and faculty of the Garnett County School District (GCSD) K-8 Alternative Learning Program. The study focused on the middle school program. The school district received the AWARE (Advancing Wellness and Resilience Education) grant from the North Carolina Department of Health and Human Services, Substance Abuse and Mental Health Services Administration (SAMHSA). GCSD used part of the grant funds to strategically implement programs to support students who attend the alternative …

A Weighted Individual Performance-Based Assessment For Middle School Orchestral Strings: Establishing Validity And Reliability, Kevin Ward

Doctor of Education Dissertations

The study established the validity and reliability of a weighted individual performance-based assessment tool within the utility scope of middle school orchestral strings. The following research questions guided this study:

1. What specific string-playing behaviors and corresponding criteria validate a weighted individual performance-based assessment tool for middle school orchestral strings?

2. What are the psychometric properties of the weighted individual performance-based assessment tool in authentic situations?

For Research Question 1, the expert panel and I were able to 100% mutually agree on 10 string-playing behaviors: tempo, rhythm, tone, pitch, intonation, technique, bowing, dynamics, phrasing, and posture that created the DISAT. …

Who Takes Dual Enrollment Classes? A Research Brief, David Naff

MERC Publications

This research brief from the Metropolitan Educational Research Consortium (MERC) explores three questions: 1) What are Dual Enrollment classes? 2) Who takes Dual Enrollment classes? and 3) What strategies promote greater access to Dual Enrollment? An accompanying podcast episode is linked in the research brief.

Demonstrating ‘Impact’: Insights From The Work Of Preservice Teachers Completing A Graduate Teacher Performance Assessment, Peter D. Brett, Michelle Parks

Australian Journal of Teacher Education

Initial Teacher Education (ITE) reform in Australia has mandated that graduating teachers demonstrate their practice and ‘impact’ through the completion of a Teaching Performance Assessment (TPA) prior to graduation. The requirement to analyse ‘impact’ in teaching, requires a nuanced understanding of what ‘impact’ is and how it manifests in varied contemporary classrooms. This paper reports on how a sample of high-performing pre-service teachers from one Australian ITE institution, within a framework devised by Australia’s largest TPA consortium, appraised the impact of their teaching in the context of the disciplinary area of Humanities and Social Sciences (HASS). How ‘impact’ was articulated …

Using Systems Perspectives To Develop Underlying Principles For Educational Reform, John Daniel Kenny, Connie Cirkony

Australian Journal of Teacher Education

One of the enduring problems in the education system is the gap between theory and practice, where the research to improve teaching and learning is not fully realised in the classroom. This has impacted the effectiveness of education reform. We take a systems thinking approach to better understand the complexity of an education system, which involves multiple stakeholders, each with different levels of power, purposes, and perspectives about what is important. Drawing on an extensive body of research we propose a set of six foundational and five enabling principles that support systemic educational reform. These 11 principles are put forward …

Australian Teachers’ Perception Of Their Preparedness To Teach Traumatised Students: A Systematic Literature Review., Glenys M. Oberg, India Bryce

Australian Journal of Teacher Education

There are many studies documenting the negative impacts of trauma in childhood. However, despite schools and teachers being a known protective factor which have the potential to modify the negative impacts of complex trauma, limited research examining the perspectives of primary teachers working with traumatised children and their perceptions of preparedness to teach students living with complex trauma has been conducted. Thus a systematic literature review was conducted to collate and synthesise available empirical research on this topic. The review followed PRISMA guidelines and searches were conducted across academic databases for peer reviewed studies published between 2011 and 2022. Only …

Medium Altitude Long Endurance Rpa Training: Evaluating Blended Learning, Zachary Waller, Robert Stupnisky

International Journal of Aviation, Aeronautics, and Aerospace

The Heads Down Display (HDD) Menu Trainer – a stand-alone software trainer – was developed to familiarize students in Remotely Piloted Aircraft training with the layout and manipulation of the HDD menus for either the MQ-1 or MQ-9. Preliminary work by Waller et al. (2016) established the efficacy of the HDD Menu Trainer in improving student performance from pretest to posttest scores across several modalities (i.e. traditional, blended, and distance). Recognizing that students holding pilot certification scored higher in some aspects of the HDD Menu Trainer, this study sampled students across a curriculum to assess whether performance with the HDD …

Enhancing Quality And Equity? Performance Assessment Validation In Examination Physical Education In Western Australia, Dawn Penney, Eibhlish O'Hara, Rob Lund

Research outputs 2022 to 2026

The positioning and format of performance assessment in examination physical education varies between courses across Australia and internationally. This paper centres on developments in performance assessment in the Physical Education Studies (PES) course in Western Australia (WA). In 2021 The School Curriculum and Standards Authority (SCSA) undertook an assessment validation trial of school-based assessment of students participating in modified format competitive game play in the 10 PES sports. This contrasted to existing centralised examination arrangements. The paper reports on findings from observation of the trial in nine of the 10 sport contexts, and semi-structured interviews with teachers, validators and SCSA …

ผลการให้ข้อมูลย้อนกลับจากการประยุกต์ใช้โปรแกรมโค้ดที่มีต่อพัฒนาการการคิดแก้ปัญหาของนักเรียนประถมศึกษา, ภัทราวดี ชุ่มนวล

Chulalongkorn University Theses and Dissertations (Chula ETD)

งานวิจัยนี้มีวัตถุประสงค์ 1) เพื่อสร้างและตรวจสอบคุณภาพข้อมูลย้อนกลับที่นำมาใช้ร่วมกับโปรแกรมโค้ดในการประเมินพัฒนาการการคิดแก้ปัญหาของนักเรียนชั้นประถมศึกษา และ2) เพื่อวิเคราะห์พัฒนาการการคิดแก้ปัญหาของนักเรียนระดับชั้นประถมศึกษาจากการประยุกต์ใช้โปรแกรมโค้ดร่วมกับการให้ข้อมูลย้อนกลับ การวิจัยใช้ระเบียบวิธีวิจัยขั้นต้น แบบ pretest posttest time series design เครื่องมือที่ใช้ในการวิจัย คือ แบบวัดทักษะการคิดแก้ปัญหา การวิเคราะห์ข้อมูล ประกอบด้วย การวิเคราะห์ข้อมูลโดยสถิติบรรยาย ได้แก่ ค่าเฉลี่ย ส่วนเบี่ยงเบนมาตรฐาน ร้อยละของพัฒนาการ และการวิเคราะห์ข้อมูลโดยสถิติสรุปอ้างอิง ได้แก่ สถิติทดสอบความแปรปรวนแบบวัดซ้ำ ผลการวิจัยพบว่า 1) ข้อมูลย้อนกลับและเกณฑ์การประเมินการประยุกต์ใช้โปรแกรมโค้ด ประกอบด้วย 4 ด้าน ได้แก่ (1) การเขียนโปรแกรมได้ตามที่โจทย์กำหนด (2) การแสดงลำดับขั้นตอนได้ตามเงื่อนไข (3) ความสมบูรณ์ของผลงาน และ (4) นำเสนอวิธีการแก้ปัญหา โดยมีค่าดัชนี IOC อยู่ระหว่าง .6-1.0 และ 2) นักเรียนมีพัฒนาการการคิดแก้ปัญหาสูงสุดในระยะที่ 4 อย่างมีนัยสำคัญทางสถิติที่ระดับ .05

An Exploratory Quantitative Study Of The Impact Of Stem-Focused Middle Schools On Student Persistence And Performance In Stem, Shandua Ellis

Doctor of Education Dissertations

Science, technology, engineering, and math (STEM) continue to be a major challenge for the United States (U.S.), as the U.S. continues to lag behind other countries in this area due to ongoing lack of individuals who are entering STEM fields and many who are entering STEM fields but lack the skills necessary to perform adequately in these roles. The problem related to this study involved the ongoing need to identify how well STEM education programs are addressing this need and increasing the number of students, especially underrepresented minorities, in following STEM career pathways and developing the knowledge and skills needed …

Stt Kadesi’S Disrupting The Teaching And Learning Process During Covid-19, Muner Daliman, Hana Suparti, Jonathan D. James, Eudia Anggelia Ika Agustin, Hengky Wijaya

Research outputs 2022 to 2026

In this paper we report on a pilot study of the teaching and learning at Sekolah Tinggi Teologi KADESI (STTK), a tertiary theological institution in Yogyakarta, during the Covid-19 pandemic in 2020. Our methods for collecting data were to survey the 40 students and conduct one-to-one interviews with the 10 lecturers at STTK. The analysis of data drew on two theoretical constructs: Donald Schön’s reflection-in-action and the notion of empowerment in an educational context. We found challenges and difficulties to do with the logistics of teaching and the barriers to communication between instructors and students. And on the positive side, …

International Professional Skills: Interdisciplinary Project Work, Thomas Mejtoft, Helen Cripps, Christopher Blöcker

Research outputs 2022 to 2026

Higher education should provide learning situations that prepare students for a future profession and make them world-ready. This paper reports insights from an international interdisciplinary collaborative project aiming to create learning experiences that are close to a professional situation. The collaboration setup simulates a setting of a digital agency with a development team in Sweden and a marketing team in Australia working together to solve a task. The collaborative project has been active since 2017, completing its fifth iteration in 2021. Postcourse survey results show that the students felt that a real situation was created with a high level of …

Pre-Service Teachers' Use Of Ict To Collaborate To Complete Assessment Tasks, Eileen V. Slater, Donna Barwood, Zina Cordery

Research outputs 2022 to 2026

This research explored the use of ICT products by n = 123 pre-service teachers to complete collaborative assessments. Students responded to a questionnaire relating to the use, benefits and limitations, and what would better enable the use of ICT for collaborative assessment purposes. The ICT products favoured by students did not support some key elements necessary for online collaboration, through either student use or product functionality. Poor Internet access was a commonly cited limitation with the effect of reducing access to available ICT skills training. Suggestions for changes to course structure and content and further research are made.

How Can We Address The Wicked Problem Of University Student Attrition? A Bed (Early Childhood) Case Study, Gillian Kirk

Research outputs 2022 to 2026

Student retention in education courses is a political imperative. This research examined the wicked problem of attrition in a Bachelor of Education (Early Childhood Studies) course, drawing on the experiences of three different groups of students studying early childhood. The participants from each study represented different student groups within the course, which included all female (n = 20), all male (n = 6) and all mid-year entry students (n = 10). A qualitative methodology was employed to capture students’ university experiences and their perceptions of events at university. The research generated a unique theoretical framework examining the intersection between student …

Realising Curriculum Possibilities In Wales: Teachers’ Initial Experiences Of Re-Imagining Secondary Physical Education, David Aldous, Victoria Evans, Rhys Lloyd, Fiona Heath-Diffey, Fiona Chambers

Research outputs 2022 to 2026

This paper provides insight into secondary Physical Education (PE) teachers’ experiences of beginning to re-imagine secondary physical education provision in light of the new Curriculum for Wales, 2022 (CfW). Data were generated through analysis of semi-structured interviews (n = 5) with secondary PE teachers who participated in three workshops which uses a design-thinking methodology. Informed by Ball and colleagues’ conceptualisation of policy work, findings draw attention towards how engagement in the workshops provided a foundation for the participants to begin interpretation and translation of the new CfW and consider re-imagining existing PE provision within the school context. Participants’ interpretations of …

Education In A Warming World: Trends, Opportunities And Pitfalls For Institutes Of Higher Education, Orla Kelly, Sam Illingworth, Fabrizio Butera, Vaille Dawson, Peta White, Mindy Blaise, Pim Martens, Geertje Schuitema, Maud Huynen, Susan Bailey, Sian Cowman

Research outputs 2022 to 2026

Higher education institutes (HEI) face considerable challenges in navigating how to respond to the escalating and intertwined socio-ecological sustainability crises. Many dedicated individuals working in the sector are already driving meaningful action through rigorous research, teaching, knowledge sharing, and public engagement, while there is a growing consensus that sector-wide change is needed to ensure that aspirational declarations and positive individual actions translate into sustainable and transformative change. This article seeks to contribute to such efforts by illustrating a number of trends, examples, and reflections on how third-level educational institutes can act sustainably. We highlight the potential of five strategies HEI …

Educators’ Perspectives About Teaching And Supporting Students With Learning Difficulties In Reading, Tanya Serry, Pam Snow, Lorraine Hammond, Emina Mclean, Jane Mccormack

Research outputs 2022 to 2026

We explored the perspectives of school-based educators located in Victoria, Australia, regarding their support of students who have reading difficulties. An anonymous survey was completed by 523 participants, including educators, educational leaders and Student Support Services staff. Results revealed multiple areas of concern related to their capacity to work on reading intervention with these students. Although participants reported that students with reading difficulties were present in most classes, confidence to work effectively with these students was mixed. They described feeling poorly prepared by preservice programs and indicated that insufficient time and mentorship prevented them from serving these students optimally. As …

The Knowledge Produced Through Student Drawings, Vesife Hatisaru

Research outputs 2022 to 2026

Drawings have been extensively used as a research method to gather data from research participants including school students regarding their perceptions of mathematics and its teaching and learning. What is valued in drawing-based research in mathematics education, and what kind of knowledge is produced through student drawings, however, is not known. This study examines drawing-based research studies to understand these questions by applying a novel framework – the legitimation code theory (LCT). The study focuses on two cases: one of which looked at middle school students’ images of mathematicians (draw a mathematician) and the other examined the same age group …

Curriculum Reform In Wales: Physical Education Teacher Educators' Negotiation Of Policy Positions, David Aldous, Victoria Evans, Dawn Penney

Research outputs 2022 to 2026

This paper reports on research that explored the experiences of secondary Physical Education Teacher Education (PETE) professionals' simultaneous negotiation and implementation of the new Curriculum for Wales (CfW) Health and Well-Being (HWB) Area of Learning and Experience (AoLE) and policies focused on the transformation of Initial Teacher Education (ITE) in Wales. The study was an exploratory case study of PETE professionals working within one university's ITE programme. Data were generated through documentary analysis of PETE and ITE programme materials and semi-structured interviews with staff involved in programme management and delivery. Data analysis employed Ball and colleagues' conceptualisation of policy actors …

The Role Of Early Childhood Pedagogical Leaders In Schools: Leading Change For Ongoing Improvement, Amie Fabry, Lennie Barblett, Marianne Knaus

Research outputs 2022 to 2026

Early childhood pedagogical practice in primary schools is often challenged by academic demands, debate about best practice and ongoing change through new policy initiatives. This paper reports an investigation of how early childhood pedagogical leaders assist early years teachers in schools to embrace change and embed early childhood pedagogy. Framed within a constructivist epistemology, this paper reports on findings from three case studies drawn from a larger mixed-methods study from Perth, Western Australia. Data collected through shadowing pedagogical leaders, undertaking contextual interviews and analysing school documents revealed that pedagogical change was promoted, encouraged and sustained through a number of strategies. …

‘The Participation Group Means That I'M Low Ability’: Students’ Perspectives On The Enactment Of ‘Mixed-Ability’ Grouping In Secondary School Physical Education, Shaun D. Wilkinson, Dawn Penney

Research outputs 2022 to 2026

Mixed-ability grouping is widespread in primary schools and in several subject areas in secondary schools in England. Notwithstanding, there is scant research on mixed-ability grouping in the education literature, particularly in terms of its impact on students’ experiences. The research reported in this paper employs enactment theory to provide original insights into the diverse practices and complex contextual factors that shape students’ perceptions and experiences of mixed-ability grouping in physical education (PE). Enactment theory acknowledges that school decisions about grouping policy are impacted by wider education policy and other contextual influences, and that the expression of grouping policies in specific …

Supporting Teacher Retention Through A Trauma-Informed Lens, Nicole C. Reddig

Honors Theses

This thesis explores the relationship between trauma-informed practices and teacher burnout and turnover. For the past decade, schools across the United States have seen high levels of burnout and turnover amongst their educators. At the same time, young children are experiencing high levels of exposure to traumatic events in childhood, affecting their behavior, social and emotional health, and ability to learn. While teachers play an important role in the support system for these students, they are also at risk for experiencing secondary trauma and burnout. To mitigate the effects of trauma, trauma-informed practices have been introduced in schools to respond …

การส่งเสริมความฉลาดในการรับมือกับปัญหาผ่านหนังสือและสื่อการเรียนรู้สำหรับนักเรียนชั้นประถมศึกษาปีที่ 1 : การวิเคราะห์วาทกรรมพหุรูปแบบ, รวิวรรณ นิ้มคธาวุธ

Chulalongkorn University Theses and Dissertations (Chula ETD)

หนังสือและสื่อการเรียนรู้ที่ส่งเสริมความฉลาดในการรับมือกับปัญหาของผู้เรียนระดับ ป. 1 ในประเทศไทยมักอยู่ในรูปแบบที่หลากหลาย ซึ่งเป็นข้อมูลพหุรูปแบบที่มีความซับซ้อน โดยมีวัตถุประสงค์เพื่อสำรวจรูปแบบและลักษณะของหนังสือและสื่อการเรียนรู้ วิเคราะห์ประเภทของสื่อพหุรูปแบบ วิเคราะห์วาทกรรมในสื่อพหุรูปแบบ และพัฒนาฐานข้อมูลหนังสือและสื่อการเรียนรู้ ตัวอย่างวิจัย คือ หนังสือและสื่อการเรียนรู้ที่ผ่านเกณฑ์และได้รับการสุ่ม ครูผู้สอนและผู้ปกครองชั้น ป. 1 ที่อาสาสมัครเข้าทดลองใช้ฐานข้อมูลฯ ซึ่งดำเนินการวิจัยเพื่อศึกษารูปแบบและลักษณะของสื่อ โดยสุ่มจากหนังสือที่ผ่านเกณฑ์จำนวน 221 เล่ม และสื่อการเรียนรู้ออนไลน์ที่ผ่านเกณฑ์จำนวน 110 เรื่อง จากนั้นนำมาวิเคราะห์ประเภทของสื่อพหุรูปแบบและวิเคราะห์วาทกรรมพหุรูปแบบในสื่อ โดยประยุกต์ใช้แนวคิดของ O’Halloran, Tan & Wignell (2019) ผลการวิจัย พบว่า 1. หนังสือและสื่อฯ อยู่ในรูปแบบที่หลากหลายผสมผสานกัน อันเป็นข้อมูลพหุรูปแบบ ที่มีการสอดแทรกความรู้และทักษะที่ผู้เขียน/ผู้แต่งต้องการส่งเสริมให้เกิดขึ้นกับผู้เรียนชั้น ป. 1 และมีเรื่องราวที่ใกล้เคียงกับประสบการณ์ของผู้อ่าน 2. ประเภทของสื่อพหุรูปแบบปรากฏในหนังสือและสื่อฯ สามารถจำแนกได้ 6 ประเภท คือ ข้อความ สัญลักษณ์ ภาพนิ่ง ภาพเคลื่อนไหว เสียงและการเคลื่อนไหว 3. จากการวิเคราะห์วาทกรรมพหุรูปแบบสะท้อนการผลิตหนังสือและสื่อฯ ที่สอดแทรกการส่งเสริมความฉลาดใน การรับมือกับปัญหาทั้งมิติของการควบคุม สาเหตุและความรับผิดชอบ การกระจายตัวของปัญหาและความอดทนต่อความยืดเยื้อของปัญหา โดยพบการส่งเสริมความฉลาดในการรับมือกับปัญหาในมิติของการควบคุมสูงที่สุด 4. ฐานข้อมูลหนังสือและสื่อการเรียนรู้ที่ส่งเสริมและพัฒนาความฉลาดในการรับมือกับปัญหาของผู้เรียนชั้น ป. 1 ที่พัฒนาขึ้นจากโปรแกรม AppSheet ได้รับความพึงพอใจในมาตรฐานด้านการใช้ประโยชน์ ความเหมาะสม ความถูกต้อง และความเป็นไปได้ในเชิงบวกทั้งหมดทั้งระดับเห็นด้วยอย่างยิ่งและเห็นด้วย

The Perceived Influence Of Value-Added Metrics On Urban Middle School Teachers’ Job Satisfaction And Motivation, Angela Jones

Walden Dissertations and Doctoral Studies

Value-added metrics or models (VAMs) are an important component of the teacher evaluation process that evaluators use to determine the value teachers add to their students’ academic achievement. VAMs are used to arrive at a score that is derived from the number of the teachers’ students who pass and/or fail a standardized assessment. While prior research has focused on VAMs with respect to impact on student success and performance, little is known about how teachers experience the implementation of these metrics and how those experiences may influence teachers’ job satisfaction and motivation. The purpose of this interpretive qualitative study was …

The African American And The California Basic Skills Requirement For Teaching, Willie C. Thomas Ii

University of the Pacific Theses and Dissertations

This study examines why the passing rates of African Americans on the CBEST are the lowest in California at 60%. Madkins (2011) identified licensure testing as a significant reason why African Americans cannot enter the teaching progression. According to Darling-Hammond et al. (2016), California has an ongoing credentialed teacher shortage. An even more significant need is for teachers of color. According to the California Department of Education (2021), 60% of the state’s educator workforce is White, while the state student body, multicultural and multilingual, is only slightly more than 22% White. While licensure testing for teachers is required in all …

Interaction With Augmented Reality Sandbox Does Not Produce Greater Gains In Topographic Map Skills For Undergraduate Students, Celeste Kenworthy

Honors Program: Senior Projects (Public)

The augmented reality (AR) sandbox allows students to interact with topographic maps in a 3D space. Being able to understand topographic maps is important to geologists and they are taught in many introductory geology courses. Recent research has focused on whether the AR sandbox can improve students’ topographic map skills. Previous studies have found that students who interact with the AR sandbox do not score significantly better on topographic map assessments (TMAs) than their peers. One proposed reason for this is the limited time students have to interact with the AR sandbox. This study sought to address this by creating …

Teaching License In Pakistan: A White Paper 2022, Sajid Ali, Afaq Ahmed

Institute for Educational Development, Karachi

No abstract provided.

An Exploratory Case Study Into Understanding Teaching Practice And Towards Enhancing Transformative Learning And Graduate Employability At Tu Dublin, Ellen Kampinga

Masters

This research focuses on understanding and enhancing the educational practice towards using pedagogies like transformative learning to enhance graduate employability at a new technological university, TU Dublin, during the coronavirus (COVID-19) pandemic. It was found that teaching practice depends significantly on the lecturer, the discipline area, the graduate skills that are sought after in each module and discipline, and the context of the delivery. The PAGE (Pedagogy Assisting Graduate Employability) framework developed from this research, aims to visualise the connection between the teaching process, pedagogy, and graduate employability. Application of the framework will offer insight into how each unique lecturer …