Educational Assessment, Evaluation, and Research Commons^™

Understanding And Doing Research In Education & The Social Sciences, Phillip A. Olt, Yaprak Dalat Ward, Kevin Splichal, Reade L. Dowda, Elliot Isom

All Open Educational Resources

The purpose of this book is to provide an open-access, free textbook for initial learning about research for students in the social sciences and related professional fields (such as education, social work, business, or nursing).

This OER was updated in 2026 to include accessibility updates.

Effectiveness Of Multimodal Communicative Practices In Higher Artistic Education: An Analysis Of Contemporary Approaches, Mariia Tkach, Alla Kozyr, Mykhailo Mymryk, Nadiia Holubytska, Iryna Khomych

Journal of Educational Technology Development and Exchange (JETDE)

The relevance of the study is driven by the fact that in today’s world, higher education is increasingly oriented towards interactivity and the utilization of various resources. The aim of this article is to explore various aspects of multimodality and formulate key communicative practices in higher artistic education. Addressing the stated problem is based on theoretical methodology, including methods such as surveys, analytical approaches including historical and hermeneutic analysis, comparative methods, and systematization. Research findings demonstrate that multimodality effectively enriches the learning process, fosters critical thinking, and deepens understanding of subjects. Digital technologies contribute to enhancing students’ technological literacy, preparing …

Evaluation Of Ste(A)M Education: An Analysis Of Research And Practices From 2014 To 2023, Billy T.M. Wong, Kam Cheong Li, Mengjin Liu

Journal of Educational Technology Development and Exchange (JETDE)

STEM (Science, Technology, Engineering, and Mathematics) and STEAM (by including Arts) education (hereafter STE(A)M education) has been widely studied and practiced. Evaluation plays an important role in assessing and improving the effectiveness of relevant initiatives. Although there has been extensive research on evaluating STE(A)M education, little attention has been paid to examining the patterns of said evaluations. To address the research gap, this paper analyses relevant work on the evaluation of STE(A)M education practices with respect to their countries/regions, levels of education, discipline domains, pedagogical approaches, objectives of evaluation, evaluation areas, as well as data collection and analysis methods. It …

Assessing Middle School Teachers' Digital Innovation Skills In Bisha Province: A Comprehensive Study, Ahmad Mohammad Aldaleel

Journal of Educational Technology Development and Exchange (JETDE)

This study aims to assess the digital innovation skills of 400 middle school teachers in the Bisha Province and evaluate their significance in the educational process. The survey reveals that instructors exhibit a high level of technological expertise and proficiency, namely in utilising search engines and databases to locate information. Nevertheless, their proficiency in using artificial intelligence applications in school is deficient. In terms of digital security, instructors are competent at generating strong passwords, but they lack understanding of cybercrimes and prevention solutions. Teachers have exceptional communication and cooperation abilities, emphasising ongoing learning and active involvement in professional development programs. …

Analyzing The Effectiveness Of The Readi System In Helping Non-Native English-Speaking Preschoolers In Sarawak Learn The Alphabet: A Pilot Study., Yen Vee Tan, Julia Ai Cheng Lee, Rehman Ullah Khan, Chwen Jen Chen, Kartini Abdul Ghani, Sarah Flora Samson Juan, Brian Chung Shiong Loh

Journal of Educational Technology Development and Exchange (JETDE)

In Sarawak, Malaysia, many children come from multicultural backgrounds and are predominantly non-native English speakers making preschool education essential for developing early literacy skills in English. However, high teacher-child ratios can impede effective learning. The READi system—a module-based, multisensory, web-based early literacy intervention—was introduced as a supplementary classroom tool to address this challenge. This pilot study specifically evaluated the effectiveness of the "Alphabet Adventure" module within the READi system on enhancing alphabet knowledge, with a focus on letter recognition and letter name knowledge. The research design employed a pretest-posttest control group approach grounded in the positivist paradigm. [YT1] Participants were …

A Study Of Image Editing Ai Awareness In Children: Can Ai That Lets Still Images Speak Capture The Interest Of Young Children?, Hidemichi Okamoto, Hironori Tachizaki

Journal of Educational Technology Development and Exchange (JETDE)

This study explores the application of image and video editing Artificial Intelligence (AI) in early childhood education, with a particular focus on “image-speaking AI”. We investigated whether using AI could effectively capture children’s attention. The results showed that, under certain settings, the longest attention span was achieved when a character spoke by means of AI(*p<0.05). Rather than adding sound to a still image, using AI to move the mouth of the still image captured the children’s attention. However, the parents from the survey indicated that the realism of the mouth movements seemed unnatural and could distract the viewers from understanding the contents.

Gamification In Education: Its Impact On Engagement, Motivation, And Learning Outcomes, Hansika Ukgoda

Journal of Educational Technology Development and Exchange (JETDE)

Gamification, integrating game design elements into educational contexts, has emerged as a promising strategy to enhance student engagement, motivation, and learning outcomes. This systematic review synthesizes findings from 41 peer-reviewed studies published between 2012 and 2023, offering a comprehensive overview of the current state of gamification in education. Following PRISMA guidelines, the review evaluates the effectiveness of gamification elements such as points, badges, and leaderboards. Key Findings indicate that while gamification can foster positive learning attitudes and competition, its effectiveness depends on the context. The impact of game elements on engagement and motivation varies based on the learning environment and …

The Demand For Educational Functions Of Study Tour Products: From Students’ Perspectives, Yaqi Yu, Azizan Marzuki

Journal of Educational Technology Development and Exchange (JETDE)

Few academic studies have comprehensively examined the actual demands of students regarding the educational function of study tours. This paper develops a demand index system based on three dimensions: cognitive, affective, and behavioral demands. A questionnaire survey was administered to 397 students. Initially, student demands were categorized using the Kano model. Subsequently, the “dependence” and “expectancy” characteristics were analyzed through the dissatisfaction index (DI) and satisfaction index (SI). The impact of fulfilling each demand on dissatisfaction and satisfaction levels was then determined. The results indicated that among the three dimensions, there were 7 must-be demands, 6 one-dimensional demands, 8 attractive …

Development Of E-Module Based On Game-Based Learning To Enhance Students' Conceptual Understanding And Interest In Vibration And Wave Concept, Suci Indah Wulandari, Arif Widiyatmoko, Tiara Dwi Wulandari

Journal of Educational Technology Development and Exchange (JETDE)

This study aims to determine the effect of using a Game-Based Learning e-module on improving students' conceptual understanding and learning interest. The research employed the Research and Development (R&D) method using the ADDIE development model (Analysis, Design, Development, Implementation, Evaluation). The developed e-module was tested on eighth-grade students. Conceptual understanding was measured based on seven indicators: interpreting, exemplifying, classifying, summarizing, inferring, comparing, and explaining. Learning interest was analyzed through four indicators: interest and enjoyment in the material, motivation to learn, focus and attention during the learning process, and the level of participation, enthusiasm, and involvement of students. Data were collected …

Rasch Model Utilization Towards Developing An Instrument For Measuring Creative Drive, David W. Stenulson

Theses and Dissertations--Educational Policy Studies and Evaluation

Creativity is commonly assessed across undergraduate programs as a graduation requirement. However, a considerable amount of literature suggests that creativity is a complex, multidimensional construct, and more efficient ways of assessing it should be explored with multiple measures representing different creative aspects. This exploratory pilot study sought to take steps in developing a supplemental instrument designed to measure creative drive, a theoretical construct with predictive potential for future creative output. In order to gain a greater understanding of the nature of creative drive and gauge accuracy of initial thinking in terms of item writing, the Creative Drive Assessment (CDA), a …

Investigating The Fits And Functionality Of The Community College Survey Of Student Engagement Using Rasch Modeling, Olukemi O. Kolawole

Theses and Dissertations--Educational Policy Studies and Evaluation

Student engagement is a central variable in higher education research as it influences academic achievement, retention, and the development of problem-solving skills. The Community College Survey of Student Engagement (CCSSE) is a vital tool for assessing student engagement in community colleges. Previous validation studies were mainly conducted in the mid-to-late 2000s and have used Classical Test Theory frameworks despite the known limitations of this approach. The present study seeks to evaluate the psychometric properties of the CCSSE survey using a Rasch Analysis framework. The two CCSSE datasets were obtained from the Center for Community College Student Engagement at The University …

Investigating The Psychometric Properties Of A Set Of Local Stem Literacy Instruments In Rasch Model, Lijun Shen

Theses and Dissertations--Educational Policy Studies and Evaluation

This study investigates the psychometric features of the See Blue STEM literacy inventories (SBSTEMs, including the elementary version SB-E and the middle school version SB-M) to determine their validity in measuring STEM literacy. Using data from elementary and middle school students participating in the See Blue STEM camp in 2019 and 2021-22, this research employed the Rasch Partial Credit Model (PCM) to analyze item-level performance and identify DIF items across various demographic subgroups (race, gender, free-lunch status, and potential first-generation status) and camp delivery modes (online versus in-person). Results indicated that both the elementary (SB-E) and middle school (SB-M) versions …

University Studies First-Year Inquiry Student Success Pilot Year 1 Report 2024 - 2025, Sarah Dougher, Lindsey Wilkinson, Rowanna L. Carpenter

University Studies Assessment Research

During the 24-25 academic year, fourteen University Studies First-year Inquiry courses participated in a pilot supported by the Office of Student Success that embeds student support resources into course work, activities, and curricula. This is an effort to connect students more directly to support services they may need to be successful at PSU, to increase their sense of belonging, and ultimately increase their completion of FRINQ. The Pilot is being evaluated based on academic outcomes, PSU resource use, and measures of efficacy and belonging. For Information about our evaluation methods and data sources, please see the full report and the …

Assessing Stress, Anxiety, And Burnout In Undergraduate Veterinary Technology Students, Dean Ann Daughaday-Provine

Murray State Theses and Dissertations

Academic stress, anxiety, and burnout can negatively impact the mental health and well-being of students pursuing degrees in veterinary medicine. This quantitative study was designed to investigate the effects of academic stress, anxiety, and burnout on undergraduate students enrolled in Veterinary Technology programs. This study gained critical insight from current students transitioning through a rigorous curriculum of standards designed by the American Veterinary Medical Association (AVMA). The AVMA Committee on Veterinary Technician Education and Activities (CVTEA) has established standards, outlined in policies and procedures, to ensure the quality of assessments and enhancements in veterinary education within accredited Veterinary Technology programs.

The Role Of Faith-Based Adult Education In Black And Marginalized Communities, Brian Jones

Murray State Theses and Dissertations

Abstract

The purpose of this study is to examine how faith-based and strengths-based adult education programs impact the cognitive well-being, life purpose, and socioeconomic outcomes of Black, and marginalized adult learners. The research seeks to understand the lived experiences of participants, motivations, and barriers to inform more inclusive and effective adult education practices. Additionally, the study aims to understand what impact these organizations are having on the self-efficacy, socioeconomic outcomes of Black and marginalized students, while looking to align areas for improvement. While the study uses quantitative methods to answer research question, the focus of questions bring insight that would …

Explorations Of Social-Emotional Learning In The Arts, Lydia Boyer

Williams Honors College, Honors Research Projects

The purpose of this Honors Research Project was to explore social-emotional learning as a practice, to find effective applications for schools, to highlight the connections between the arts and social-emotional learning, and to provide useful methods for the actual implementation. There is a focus on the five main competencies of social-emotional learning which are self- awareness, social-awareness, self-management, relationship-building, and responsible decision- making skills which are translated into various class practices and art projects. Social-emotional learning is a mindset rather than merely a practice and has been practiced latently in education. Art education and social-emotional learning share congruencies in standards, …

The Impact Of Stem Self-Efficacy And Sense Of Belonging On Academic Performance For Students Of Color In Introductory Stem Courses, Danyelle Nichole Stokes

UNF Graduate Theses and Dissertations

The study explores the interplay between STEM identity development, race and gender in relation to academic performance in STEM at the beginning of post-secondary education. Statistical analyses of this study included descriptive statistics, independent sample t-tests and a multiple linear regression. The quantitative results indicated no statistically significant differences in self-efficacy and sense of belonging scores between White students and students of color. However, participants’ open-ended responses warranted a holistic examination to look for qualitative differences in the STEM identities of students of color and White students. The findings supported existing literature on disparities in support, inclusion and access to …

Personalized Physics Learning Through Ai: Insights From Problem Generation, Chatbot Dialogues, And Intelligent Tutoring Systems, Atharva Dange

Physics Dissertations - Archive

Artificial intelligence (AI) is poised to transform science education, yet questions remain on how best to integrate these technologies into teaching and learning. This dissertation investigates the use of AI-driven tools in university physics courses through three complementary studies. In the first study, a generative language model (ChatGPT) was used to create novel physics homework problems aligned with course objectives. Analysis showed that, after expert vetting, AI-generated questions can foster higher-order problem-solving and reduce student reliance on solution memorization, though careful instructor oversight is required to ensure accuracy. The second study embedded an AI chatbot as a learning aid in …

Does Money Matter? An Analysis Between Per-Student Funding And Its Link To Student Achievement In Florida, Chloe Zwetschkenbaum

Honors Undergraduate Theses

This study examined the relationship between per-student funding and student achievement within four counties in the state of Florida (Clay County, Duval County, Flagler County, and St. Johns County) and whether higher per-student funding resulted in higher student achievement. Florida recently changed from the usage of the Common Core Standards to the Florida Benchmarks for Excellent Student Thinking (B.E.S.T.) and from the Florida State Assessment (FSA) to the Florida Assessment of Student Thinking (F.A.S.T.) test in 2022 (Sabina, Hartikka, and Viola, 2023). This research focused funding on the results of the F.A.S.T. test and the per-student funding of each district …

Mapping Learning In Higher Education: The Embedding Content Across Academic Programmes Toolkit, John Pierce, Mary Beades, Andrew Shields

Publications

The growing diversification of teaching roles in higher education and the siloed nature of semesterised programmes can inhibit quality teaching and learning. This paper introduces the Embedding Content Across Academic Programmes Toolkit (ECAAPT), a practical model for mapping and tracking embedded content across modules, semesters, and years within higher education programmes that can ease the administrative burden of curricular mapping and change on academics teaching in the sector. Originally developed with a focus on tracking student academic literacies, this model has also been adapted and shown value in mapping and tracking other content, such as graduate attributes, feedback, assessment strategies, …

Motivating Students Through Problem-Based And Project-Based Learning, Dennis J. Moore

College of Graduate Studies: Theses & Dissertations

ABSTRACT

As educators, motivating students can be a difficult task.Sixteen eighth-grade students discuss their perceptions of what makes educational programs motivating. In teacher-centered classrooms, teachers lecture while their students take notes, quizzes, and tests and practice memorization skills in preparation for high-stakes testing. Is this a fair assessment of a student's knowledge, and does this type of instruction fulfill students’ needs for a successful future? Research for this case study focused on students' perceptions of an agricultural program that utilizes problem-based and project-based learning with a sustainability focus.

In problem-based learning (PBL) classes, students are given real-world problems and asked …

Research Methodology Education In Europe: A Multi-Country, Cross-Disciplinary Survey Of Current Practices And Perspectives, Silke Kniffert, Ivan Buljan, Flavio Azevedo, Peter Babinčák, Lucija Batinović, Thomas Rhys Evans, Sara Garofalo, Christopher Graham, Lucianne Groenink, Malika Ihle, Milosav Klugar, Lucia Kočišová, Michal Kohút, Nikolaos Kostomitsopoulos, Seán Lacey, Anita Lunić, Ana Marušić, Thomas Nordström, Charlotte R. Pennington, Daniel Pizzolato, Ulf Toelch, Marta Topor, Miro Vuković, Michiel R. De Boer

Publications

Background

Research methodology education aims to equip students with the foundational knowledge of robust scientific practices, emphasizing deep understanding of scientific inquiry, integrity, and critical thinking in research practice. A literature review reveals that the observed diversity in research methods course design and instruction stems from a lack of consensus about the essential foundations required to critically engage with, design, and execute research in education. This is further compounded by a limited pedagogical innovation. However, no study has yet investigated how research methodology is taught and perceived across European universities. The objective of this study is to examine practices and …

Relaciones De Las Competencias Docentes Con El Bienestar En Docentes De Ciencias Empresariales Bajo La Modalidad A Distancia En Una Universidad Privada En Colombia, Camilo Ernesto Aguirre Martínez

Theses and Dissertations

El propósito de esta investigación consistió en determinar las relaciones de las competencias docentes con el bienestar en docentes de Ciencias Empresariales bajo la modalidad a distancia en una Universidad privada de Colombia. El estudio buscó identificar las relaciones entre las competencias docentes y el bienestar psicológico, el bienestar subjetivo y el bienestar social, cuáles de esas relaciones predominan, así como la identificación de cuáles elementos de estos tipos de bienestar contribuyen con el desarrollo de las competencias docentes.

El enfoque de la investigación fue el empírico analítico o cuantitativo, el diseño fue no experimental y su alcance fue de …

Implementation Of Competency-Based Education In East Central Illinois, Cheyenne Warman-Neal

Masters Theses

The purpose of this study was to investigate the perceptions of the effectiveness of competency-based education in a rural school district located in East Central Illinois. The researcher examined the first phase of implementation of Competency-Based Education (CBE) in both middle and high schools of this school district through surveys of students and teachers, along with students’ Measure Academic Proficiency or Performance (MAP) Test scores in ELA and Math. MAP score data was obtained from 669 students for ELA Growth and 699 students for Math Growth. Survey data was obtained from 70 high school students and six teachers. Student survey …

2025 Conference Program, Georgia Southern University

SoTL Commons Conference

2025 Conference Program

Afit Generative Ai Teaching Guidebook, Afit Faculty Learning Community, Mark G. Bateman, Brett J. Borghetti, Allen W. Dukes, Nicholas C. Francis, Mike Frick, Bobbie Oh, Kevin Patterson, Hiren J. Patel, Mark G. Reith, Erick S. Tyndall, Teresa M. Walton, Torrey J. Wagner, Timothy S. Wolfe, Jonathan Zemmer

AFIT Documents

AFIT is proud to highlight the Generative AI Teaching Guidebook, a resource designed to provide military educators with practical insights, strategies, and use cases for integrating Generative AI (Gen AI) into their teaching practices. Developed through a collaborative effort involving AFIT faculty across various departments within the Graduate School of Engineering and Management and the School of Systems and Logistics, this digital resource serves as a starting point for educators exploring how to leverage Gen AI in their classrooms. It offers accessible examples and best practices, ensuring utility for instructors of all technical backgrounds. The guidebook provides a comprehensive overview …

Afit Generative Ai Teaching Guidebook Synopsis, Afit Faculty Learning Community, Mark G. Bateman, Brett J. Borghetti, Allen W. Dukes, Nicholas C. Francis, Mike Frick, Bobbie Oh, Kevin Patterson, Hiren J. Patel, Mark G. Reith, Erick S. Tyndall, Teresa M. Walton, Torrey J. Wagner, Timothy S. Wolfe, Jonathan Zemmer

AFIT Documents

The main objective of this work was to bring together various perspectives on how to envision incorporating Gen AI capabilities into the learning environment and identify some best practices for their implementation. Any instructor who is interested in these capabilities but does not necessarily have a technical background can find pragmatic use of the examples provided. While the examples have a wide range of applicability, they are meant to serve as a starting point for educators to explore what would be beneficial to their educational environment, from traditional classroom settings to online continuing education courses.

Benefits And Challenges With The Modular Model Of Teacher Certification In Australia: Listening To Teachers’ Voices, Bernard Brown, Rohan Nethsinghe

Australian Journal of Teacher Education

This paper examines teachers’ views about the Highly Accomplished and Lead Teacher (HALT) Certification 2.0 Modular Model (CMM 2.0). The research reveals teachers’ voices and agency in relation to HALT certification. Participants in this study included HALT certified teachers, current HALT participants, and prospective participants. The semi-structured interviews conducted provide insights into the benefits and challenges associated with the CMM 2.0. Thematic coding and systematic analysis were applied to the data to arrive at the key findings. The research revealed that teachers believed that the modular approach was advantageous as it was flexible and provided professional recognition and development. Issues …

Am I As Effective At Identifying Emotions As Artificial Intelligence? A Comparative Study Of Emotional Recognition, Traci R. Grove, Alexandra T. Lucas, Maryann Martin, Cathleen M. Deckers, Lulu Sherif Mahmood, Nicole Danaher-Garcia, Mark W. Scerbo, Suzan Kardong-Edgren, Janice C. Palaganas

Psychology Faculty Publications

Background

Learning conversations, or dialogues aimed at deepening understanding and reflection, are deeply influenced by emotions. Effective communication is influenced by emotional intelligence - the ability to recognize, understand, and manage both one’s own and others’ emotions. While advances in artificial intelligence (AI) offer new tools for emotion recognition, these technologies still struggle with accurately interpreting subtle and culturally diverse emotional expressions, sparking debate about their reliability and effectiveness. This article provides a comparative analysis of human versus AI recognition of emotions during an end-of-course reflective learning conversation.

Methods

Emotions during a structured post-conference debriefing were analyzed and coded by …

2025 Merc Annual Report, David B. Naff, Jesse Senechal, Paula L. Ogston-Nobile

MERC Publications

This is the annual report of the Metropolitan Educational Research Consortium (MERC) at Virginia Commonwealth University for the 2024-2025 academic year. It includes vignettes depicting MERC activities in the past year that align with each of its five principles: research, relevance, rigor, multiple perspectives, and impact. It concludes with a discussion of MERC's commitment moving forward.