Educational Assessment, Evaluation, and Research Commons^™

An Eye-Tracking Study Of Gaze Guidance And Visual Integration Effects On Attention, Learning, And Instructor Social Presence, Sonny Rosenthal, John Komar, Vanessa Simin Ho

Research Collection College of Integrative Studies

This study used the gaze-cueing effect and split-attention principle to study the impact of gaze guidance and lecture recording format on attention, knowledge retention and instructor social presence. The authors analysed data from 250 participants in a mixed factorial experiment with eye-tracking, self-reported instructor social presence and a delayed knowledge measure as dependent variables. Results showed that when the instructor looked at the slide content, participants spent more time looking at it (η2p = 0.044), but instructor social presence decreased (η2p = .040). The strongest decrease occurred when the content and instructor’s image were separated in a picture-in-picture video (η2p …

The Students’ Conceptions Of Assessment (Scoa) Instrument: A Validation Study In Medical Education Context, Diantha Soemantri, Nadia Greviana, Najila Ramadhina

Health Professions Education

Purpose: To validate the Students’ Conceptions of Assessment (SCoA) instrument for the medical education context as a tool to examine Indonesian medical students’ conceptions of assessment in general before its implementation.

Method: A cross-sectional study was conducted to validate the translated SCoA instrument. The original 45-item instrument was translated to Indonesian with some modifications. The study was conducted on a total of 308 preclinical and clinical participants in two public medical schools: Universitas Indonesia and Universitas Udayana.

Results: The samples were found to be suitable for exploratory factor analysis, as indicated by a high Kaiser–Meyer–Olkin value (0.949) and a significant …

Investigating The Impact Of Creativity In Specialized Learning Environments, Samantha Jo Stewart

Graduate Student Theses, Dissertations, & Professional Papers

Stewart, Samantha, M.A., Summer 2025 Teaching and Learning

Abstract

Chairperson: Dr. Jeb Puryear

This study investigates the impact of creative instructional strategies on student engagement and learning in a K–5 Structured Learning Program (SLP) serving students with behavioral challenges, trauma histories, autism, and twice-exceptionality (2e). A mixed-methods approach was used to compare two instructional periods: September to December, during which traditional teaching methods were used, and January to June, when flexible, creativity-based practices were introduced. Instructional shifts included increased student choice, multimodal tasks, and scaffolded opportunities for divergent thinking. Data sources included daily staff reflections, classroom observations, and student work …

Exploring The Perceptions Of School Leaders And Teachers Towards The Role And Value Of School Librarians, Amanda Galliton

Electronic Theses and Dissertations

This study explored the perceptions of school leaders and teachers toward the role and value of school librarians in a North Central Texas Education Service Center area. The study investigated how superintendents, principals, and teachers view the contributions of certified school librarians to student achievement and school culture, particularly in light of budget cuts and the elimination of librarian positions. Using a mixed-methods approach, this research gathered information from superintendents, principals, and teachers, using quantitative and qualitative data and then quantitizing that data. The results reveal a significant variance in perceptions among superintendents, principals, and teachers, as well as a …

การพัฒนาต้นแบบโปรแกรมการฝึกความสามารถในการฟื้นพลังเพื่อส่งเสริมสุขภาพจิตของนักเรียนมัธยมศึกษาตอนปลาย, ศิริวิช เกษรากุล

Chulalongkorn University Theses and Dissertations (Chula ETD)

การวิจัยครั้งนี้มีวัตถุประสงค์เพื่อ 1. พัฒนาโปรแกรมการฝึกความสามารถในการฟื้นพลังสำหรับนักเรียนระดับมัธยมศึกษาตอนปลาย และ 2. ศึกษาผลของโปรแกรมที่มีต่อสุขภาพจิตของนักเรียน โดยเปรียบเทียบคะแนนสุขภาพจิตก่อนและหลังการทดลองระหว่างกลุ่มทดลองและกลุ่มควบคุม การดำเนินงานแบ่งเป็น 3 ระยะตามลำดับ ระยะที่ 1 เป็นการมุ่งทำความเข้าใจนักเรียนอย่างรอบด้านผ่านการสัมภาษณ์ครูแนะแนว จำนวน 10 คน และนักเรียนระดับมัธยมศึกษาตอนปลาย จำนวน 10 คน ซึ่งได้มาโดยการสุ่มแบบเจาะจง (Purposive sampling) ดำเนินการโดยใช้แบบสัมภาษณ์แบบมีโครงสร้าง เพื่อสำรวจประสบการณ์ด้านสุขภาพจิต การจัดการอารมณ์ ความสัมพันธ์ทางสังคม และอุปสรรคที่นักเรียนพบเจอ ผลการวิจัยพบว่า ปัญหาที่ครูแนะแนวและนักเรียนพบเจอประกอบด้วย 1. นักเรียนมีความเครียดสูงและขาดทักษะจัดการอารมณ์อย่างเหมาะสม 2. กิจกรรมส่งเสริมสุขภาพจิตที่มีอยู่ยังไม่ต่อเนื่องและไม่เป็นระบบ 3. ครูและนักเรียนต้องการโปรแกรมที่มีบรรยากาศที่ปลอดภัย 4. โรงเรียนมีข้อจำกัดด้านเวลา บุคลากร งบประมาณ และความแตกต่างของนักเรียน จึงจำเป็นต้องใช้โปรแกรมที่ยืดหยุ่นและนำไปใช้ได้จริง และ 5. ครูและนักเรียนต้องการให้โปรแกรมบูรณาการอยู่ในระบบดูแลช่วยเหลือนักเรียนเพื่อส่งเสริมสุขภาพจิตในระยะยาว ระยะที่ 2 เป็นการพัฒนาต้นแบบโปรแกรมการฝึกความสามารถในการฟื้นพลัง โดยสังเคราะห์กรอบแนวคิดจากผลการศึกษาระยะที่ 1 และการทบทวนวรรณกรรมอย่างเป็นระบบ พบว่า องค์ประกอบของความสามารถในการฟื้นพลัง ประกอบด้วย 6 องค์ประกอบ ได้แก่ 1. การตระหนักรู้และเห็นคุณค่าในตนเอง 2. ความยืดหยุ่นทางอารมณ์ 3. ความยืดหยุ่นทางความคิดและทัศนคติเชิงบวก 4. ความเชื่อมั่นในตนเองและการกำกับชีวิต 5. ทักษะระหว่างบุคคลและสังคม และ 6. แหล่งสนับสนุนภายนอก ต้นแบบโปรแกรมการฝึกความสามารถในการฟื้นพลัง ประกอบด้วย 8 ครั้ง ครั้งละ 50 นาที ใช้เวลาดำเนินกิจกรรมสัปดาห์ละ 2 ครั้ง รวม 4 สัปดาห์ ระยะที่ 3 เป็นการทดสอบผลของโปรแกรมการฝึกความสามารถในการฟื้นพลังนักเรียนระดับมัธยมศึกษาตอนปลาย 43 คน แบ่งเป็นกลุ่มทดลอง 20 คน และกลุ่มควบคุม 23 คน ซึ่งได้มาโดยการสุ่มแบบเจาะจง (Purposive sampling) ผลการวิเคราะห์ข้อมูลพบว่า หลังการทดลอง นักเรียนกลุ่มทดลอง …

A Testing Load: A Review Of Cognitive Load In Computer And Paper-Based Learning And Assessment, James Pengelley, Peter R. Whipp, Anabela Malpique

Research outputs 2022 to 2026

The rising use of technology in classrooms has also brought with it a concomitant wave of computer-based assessments. The argument for computer-based testing is often framed in terms of efficiency and data management: computer-based tests facilitate more efficient processing of test data and the rate at which feedback can be leveraged for student learning rather than being framed in terms of the direct effects that students experience from engaging with novel learning tools. Whilst potentially beneficial, for some students the outcomes of computer-based tests may be counter-productive. This review considers the cognitive, and often implicit, consequences of testing mode upon …

Transforming Transitions Ii: Building Children's Engagement In Learning At School, Lennie Barblett, Fiona Boylan, Amelia Ruscoe

Research outputs 2022 to 2026

Building on the success of the Transforming Transitions project conducted with ten Western Australian Independent Schools (Barblett et al., 2023), this study extended the inquiry into school engagement and the transition process. The project was reimagined to deepen collaboration with schools, focusing on two key areas: first, fostering meaningful engagement with young learners and their families during the transition to school by drawing on their funds of knowledge; and second, centering the perspectives of children as active participants in their transition, acknowledging their experiences and the role of family-school engagement in shaping their sense of belonging.

A Hopeful Or Hopeless Future? Perspectives On The Challenges And Opportunities In Catholic Education, Christine Robinson, Linda Cranley

Research outputs 2022 to 2026

The research presented in this paper offers a significant contribution to existing discourse that explores the challenges and opportunities within Catholic education. In an increasingly secularised world, Catholic education continues its mission to form and inform young people in the faith. The Church acknowledges that the Catholic school enacts the mission of the Church in society and does so despite a detraditionalised cultural context. The Global Researchers Advancing Catholic Education, known as G.R.A.C.E, was formed to act as a global network of Catholic educators to respond to the ‘signs of the times’ in an innovative and integrated way. This paper …

What Is Informal Sport? Negotiating Contemporary Sporting Forms, Justen O’Connor, Ruth Jeanes, Jonathan Magee, Ramón Spaaij, Dawn Penney, Satoshi Miyashita

Research outputs 2022 to 2026

As traditional sport participation stagnates or declines, flexible informal sporting forms are increasingly a focus for those with a vested interest in maximising participation in sport and physical activity. This study critiques existing definitions of informal sport as overly binary, largely unhelpful, and conceptually diffuse. We propose a more nuanced understanding of informal sport that explores participant proximity to the negotiation of practices that come to shape the sporting experience and therefore levels of (in)formality. Drawing on qualitative data from three Australian case studies, we examine how participants negotiate key features of their sporting experience, such as affiliation, environment, scheduling, …

Work Smarter Not Harder: Mapping Interprofessional Education Collaboration Core Competencies Across Curricula, Hanlie Pitout, Paula Barnard-Ashton, Fasloen Adams, Sanetta H.J. Du Toit

Research outputs 2022 to 2026

Integrating Interprofessional Education and Collaborative Practice (IPECP) into health professions curricula is recognized as a challenging task due to factors such as timing, curriculum overload, and resource availability. This study aimed to identify opportunities within courses across all health professions that would help students achieve the Interprofessional Education Collaborative (IPEC) Core Competencies. These competencies include (1) Values and Ethics, (2) Roles and Responsibilities, (3) Interprofessional Communication, and (4) Teams and Teamwork. A quantitative, cross-sectional document review was conducted, analyzing curriculum maps and documents from 11 healthcare professions at a South African university. This process involved 22 participants, comprising two representatives …

Outdoor Adventure Education For Adolescent Social And Emotional Wellbeing: A Systematic Review And Meta-Analysis, Michael J.A. Down, D. Picknoll, T. Edwards, F. Farringdon, G. Hoyne, B. Piggott, M. C. Murphy

Research outputs 2022 to 2026

This study examines the effects of OAE on adolescent social and emotional wellbeing and their contributors. Intervention studies (single or multi-arm) assessing the effects of OAE on wellbeing were included. Meta-analysis was conducted on outcomes of interest, and the Cochrane Risk of Bias (RoB) Tool assessed RoB in multi-arm studies. Four studies assessed within-group change (n = 368), and six assessed between-group change (n = 1,143). Findings indicate significant between-group improvements in resilience, self-esteem and social belonging when OAE was compared to no intervention, but no self-efficacy and overall wellbeing changes were observed. Studies were at high risk of bias, …

Responding To Children’S Voices: The New Frontier In Education Policy Reform, Amelia Ruscoe

Research outputs 2022 to 2026

More than thirty years on from the United Nations Convention of the Child honouring a child’s right to be heard (Article 12) has unlocked a new frontier in ethical research. In education, children have demonstrated competence to contribute with insight to recent policy development in Australia. This paper provides further evidence of the critical role children stand to play in education reform. A post-structural perspective is adopted and underpinned with Foucauldian theory of discursive power in the context of school-based affordances. Visual and dialogic qualitative methods are used to compare the impact of powerful discourses upon children’s affordances in the …

Measuring Career Aspirations In Science, Technology, Engineering, Mathematics And Education, Michael Fitzgerald, Saeed Salimpour, David Mckinnon, Rachel Freed, Dan Reichart

Research outputs 2022 to 2026

There has been a sustained interest in student perceptions about STEM fields and their choice of careers over the past few decades. Research has shown that there is a decline in students pursuing STEM careers, and this has raised global concern. Despite these issues, no unistructural, broad, parsimonious and unambiguous quantitative instrument exists to probe student career aspirations. This paper highlights the background, extension and validation of an instrument, derived from a previous science-focussed high-quality instrument that allows student career aspirations to be quantitatively characterised. Participants were 1221 undergraduate students, 1003 of whom were judged to have provided good data, …

Digital Stories Of Resilience: A Case Study Of Urban Community College English Learners, Patricia George Hunter

Journal of English Learner Education

This study utilizes a qualitative case study approach to learn how project-based, digital storytelling (DST) voices the resilience of post-secondary English language learners (ELLs) attending a minority-serving, open-access, community college in New York City. Along with many studies that have examined the usefulness of DST in oral production, this research investigates whether project-based digital storytelling enhances students’ understanding of academic content related to resilience and conventional composition. Narrative inquiry (NI) research technique is the basis of the digital story project in an English as a Second Language (ESL) course. In this case, the study relies on observations and artifacts to …

Game-Based Learning With Augmented Reality, Kantida Nanon

Dissertations

Augmented Reality (AR) technology provides an effective and controllable learning environment, especially for complicated, potentially dangerous, or critical content. Effective implementation of interaction and platforms for educational tools can maximize learner engagement and optimize the learning experience. This dissertation explores the potential of AR technology to enhance learning experiences across multiple platforms and subject areas, particularly within chemistry and mathematics. The dissertation is grounded in the field of Human-Computer Interaction (HCI) and explores the potential of AR to increase learner engagement, improve learning outcomes, and transform traditional pedagogical practices.

The dissertation is divided into two parts. The first part examines …

Differential Item Functioning Of The Region-Based National Examinationequipment, Adi Setiawan, Gulzhaina Kuralbaevna Kassymova, Vianney Mbazumutima, Anggit Reviana Dewi Agustyani

REID (Research and Evaluation in Education)

This research aims to detect Differential Item Functioning (DIF) in the 2014/2015 National Examination Questions in mathematics of junior high schools and equivalent- level schools in the Yogyakarta region as a reference group and the South Kalimantan region as a focus group using the Likelihood Ratio Test (LRT) method, Area Measure Raju, and Lord. A sensitivity analysis was conducted to determine the most sensitive method. The data consisted of 5,465 National Examination papers of the students from the two regions who worked on type A questions. A sample of 1,000 exam papers for each region was established using the simple …

Exploring The Perceptions Of Literacy In Assessment For Learning Among High School English Teachers, Sukarno Sukarno, Nur Hidayanto Pancoro Setyo Putro, Ihtiara Fitrianingsih, Yasir Ayed Alsamiri, Fadhl Mohammed Awadh Gharamah, Ingrid A. Gavilan Tatin

REID (Research and Evaluation in Education)

In the field of English language education, the crucial role of assessment for learning (AfL) requires teachers to possess robust assessment literacy. This study explores AfL literacy among high school English teachers in Yogyakarta, Indonesia by utilizing Alonzo's validated AfL survey that establishes a comprehensive six-factor model, delineating teachers as assessors, pedagogists, student partners, motivators, learners, and stakeholder partners. Exploiting confirmatory factor analysis and examining demographic variations, this quantitative research invited 202 English teachers in the Special Region of Yogyakarta, Indonesia selected purposively based on the geographical service area. Data were collected through an online questionnaire adopting Alonzo's 42-questions AfL …

Understanding Barriers To Optimal Supervision And Delivery Of The Nationalcertificate (Vocational) Curriculum Through Tvet College Lecturers’Reflective Evaluations, Angelona Rewhydah Williams, Karel Prins, Bongani Innocent Nkambule, Sindile Amina Ngubane

REID (Research and Evaluation in Education)

Propounded by reflective theory, this qualitative case study drew on TVET lecturers' reflective evaluations of factors that they considered to have a bearing on optimal supervision and delivery of the National Certificate (Vocational) curriculum. Data were collected from participants across three campuses of a TVET college in the Eastern Cape Province, South Africa. Twelve lecturers of different seniority were purposively sampled and interviewed in two focus group sessions. The first focus session involved six participants: four post-level 2 and two post-level 3 personnel recognized by the South African Council for Educators (SACE) as "office-based lecturers" and classified within the middle …

Number Sense Profile Of Prospective Elementary School Teachers In Blendedmathematics Learning, Welly Novitasari, Herwin Herwin, Supartinah Supartinah, Putri Wulandari, Budiharti Budiharti

REID (Research and Evaluation in Education)

Number sense is a skill that contributes significantly to learning mathematics. However, number sense is often positioned as a fundamental skill whose development is more focused on children. The contribution of number sense in mathematics is even more apparent at higher levels of education. Ironically, number sense seems ignored and has become a rarely studied topic in higher education. Thus, the student’s number sense ability profile seems buried with various problems. This study aims to reveal the profile of prospective elementary school teachers’ number sense abilities and the factors causing their failure in solving math problems during the implementation of …

A Psychometric Evaluation Of An Item Bank For An English Readingcomprehension Tool Using Rasch Analysis, Louis Wai Keung Yim, Che Yee Lye, Poh Wee Koh

REID (Research and Evaluation in Education)

This study reports the psychometric evaluation of an item bank for an Assessment for Learning (AfL) tool to assess primary school students’ reading comprehension skills. A pool of 46 primary 1 to 6 reading passages and their accompanying 522 multiple choice and short answer items were developed based on the Progress in International Reading Literacy Study (PIRLS) assessment framework. They were field-tested at 27 schools in Singapore involving 9834 students aged between 7 and 13. Four main com- prehension processes outlined in PIRLS were assessed: focusing on and retrieving ex- plicitly stated information, making straightforward inferences, interpreting and inte- grating …