Educational Technology Commons^™

Individual Differences In Generative Ai Effectiveness: An Empirical Puzzle For Hrd Research, Nolan C. Lovett

Educational Leadership & Workforce Development Faculty Publications

Professionals with similar backgrounds, given identical generative AI tools, achieve sharply different outcomes. This perspectives piece examines what explains that variance, reviewing evidence on cognitive capacity, domain expertise, metacognition, epistemic calibration, personality, and culture, and argues that existing user typologies describe these differences without predicting their consequences. It then extends the puzzle in a direction the static account misses: the same individual differences that shape AI effectiveness are themselves reshaped by sustained AI use, as cognitive offloading, deskilling, and upskilling inhibition operate differently across the expertise distribution. Recent evidence, including deskilling among experienced clinicians and suppressed learning among students using …

Student Perceptions Of The Community Of Inquiry In Online Human Anatomy And Physiology Discussion Boards Using 2-D And 3-D Anatomical Models, Timothy J. Mcguire

EVMS School of Health Professions Theses & Dissertations

Online human anatomy and physiology (HA&P) courses require students to learn complex anatomical content outside of a physical laboratory environment, a challenge that may be supported by enhancing students’ perceptions of collaborative learning (CL) through the community of inquiry (CoI) framework. This convergent parallel mixed-methods study examined participants’ perceptions of the CoI framework during two discussion board (DB) activities in an online, asynchronous, noncredit HA&P I study course at a midwestern community college.

Participants were recruited via convenience sampling and randomly assigned to one of two instructional sequence groups (2-D→3-D or 3-D→2-D) to complete two DB activities requiring annotation of …

Effects Of Cross-Language Instructional Design On Foreign Language Learners' Cognitive Load: Approaching The Redundancy Principle Of Multimedia Learning, Leonor Mendiola Adams

STEMPS Theses & Dissertations

Because conceptualizations of cognitive resources play a critical role in determining the effectiveness of instructional design (Greeno, 2011; Greeno et al., 1996; Mayer, 2011, 2019), this study explores the effects of cross-language instructional design on learners’ perceived intrinsic, extraneous, and germane cognitive load content corresponding to content complexity, instructional presentation demands, and depth of understanding and schema construction, respectively.

Grounded in the redundancy principle of the Cognitive Theory of Multimedia Learning, this research further investigates whether the principle operates differently when learners’ native language is strategically incorporated into foreign language learning contexts. According to the cognitive theory of multimedia learning, …

The Living Lab: Instructional Design Interventions To Improve Communication And Equity In Federal Housing Programs, Joana I. Camp

Knowledge and Creativity Expo

The Living Lab is an independent applied research project informed by my 25 years of lived experience as a Section 8 voucher holder, examining how instructional design strategies can improve administrative workflows, communication, and equitable access within the Housing Choice Voucher Program. Drawing on sustained participation, the research identifies two primary systemic barriers: the federally mandated 15-day inspection period and incomplete Request for Tenancy Approval (RFTA) packets. To address these issues, the project developed the RFTA Roadmap—a zero-cost, clarity-driven communication tool that embeds sequential instructions directly within procedural workflows, mitigating the Split-Attention Effect and cognitive “Bandwidth Tax” associated with standard …

Learning Design To Advance Human-Ai Collaboration In K-12 Education, Wing Sha Chan, Jinhee Kim, Seongryeong Yu, Rita Kay Detrick

STEMPS Faculty Publications

This chapter explores key components for designing effective Human-AI Collaboration (HAC) in K–12 education, addressing the current lack of theoretical and conceptual frameworks for structuring and implementing HAC in teaching and learning. It examines four essential areas: curriculum design, student and teacher–AI interaction, learning environments, and the evolution of HAC over time. The chapter introduces the concept of HAC in K–12 contexts, highlighting how humans and AI can leverage each other's strengths through co-evolutionary processes that foster mutual learning and collaboration. It reviews current HAC practices in schools and discusses their contributions to both teaching and learning. Finally, it presents …

Impacts Of Segmenting Principle On Learner Performance And Attitude In A 3d Environment: A Mixed-Method Multiple Case Study, Kristin Herman, Mohan Yang, Jim Shifflet, Noah Glaser

STEMPS Faculty Publications

This study presents a conceptual replication of Moreno’s (Appl Cogn Psychol 21:765–781. 10.1002/acp.1348, 2007) study on the benefits of adhering to the segmentation principle when utilizing multimedia learning objects. Furthermore, this study expands upon the original by taking place in a low-immersive virtual reality environment, allowing for further understanding on the extent to which multimedia principles are still relevant. Both a synchronous and an asynchronous case are presented. Results indicate benefits for both cases in far transfer of learning. Furthermore, synchronous learners indicated a significant reduction in cognitive load and increased overall attitudes towards learning due to segmented instruction.

Using Ai-Generated Multimedia To Teach Leisure Choice Making, Charles Thull

STEMPS Faculty Publications

This learning representation introduces an AI-developed, multimedia assessment for identifying leisure preferences among middle school students with developmental disabilities. Grounded in instructional design, ecological systems, and multimedia learning theories, the activity integrates ChatGPT, InVideo AI, Sora, DALL·E, and Gemini to create guided-choice visuals, short videos, and a structured, teacher-facilitated paired-choice activity using visual prompts across home, school, and community interest contexts. The technology-developed design fosters engagement, accessibility, and self-expression as students participate in a structured, teacher-facilitated paired-choice activity. Outcomes include enhanced student voice in leisure planning, increased self-awareness, and the identification of potential leisure interests. Assessments include student responses to …

Leveraging Virtual Reality And Haptics To Teach Surgical Skills: A Usability Study On Retropubic Midurethral Slings, Lauren Siff, Ginger S. Watson, Jerome Dixon, Moshe Feldman, Franklin Bost, Philippe J. Giabbanelli

VMASC Publications

Traditional methods to learn soft-tissue surgical procedures rely on cadaver labs or patient-based learning, which are costly and geographically limited, and raise ethical questions. Virtual reality (VR) with haptic feedback offers a scalable alternative, but most current platforms emphasize bone-based rather than soft-tissue procedures learned by feel. We developed a VR+haptic simulation for preoperative training of retropubic midurethral sling (MUS) surgery. This study examines the usability of this platform with thirteen expert urogynecologic surgeons and subsequently makes improvements (e.g., in haptics) to evaluate the platform with twelve trainees based on the NASA Task Load Index for workload and a UTAUT-informed …

Game-Based Learning For Asynchronous Ai Literacy Course: Approach To Improve Students' Cognitive, Behavioural, Affective, And Ethical Learning Of Ai, Jinhee Kim, Guang Yang, Wing Sha Chan, Xi Lin, Yukyeong Song

STEMPS Faculty Publications

Educators in higher education face persistent challenges in scaling AI literacy across disciplines and helping novice learners understand abstract AI concepts. Although research on game-based learning (GBL) reports mixed outcomes, few studies have examined its large-scale use in mandatory, asynchronous AI literacy courses for diverse undergraduate populations. Addressing this gap, this study investigates a scalable GBL-based AI literacy course delivered to 4898 first-year undergraduates across disciplines. Using a mixed-methods design with 311 valid pre- and post-survey responses and 20 interviews, the study evaluates students' cognitive, behavioural, affective, and ethical learning of AI. Quantitative results show significant improvements in overall AI …

Students-Generative Ai Interaction Patterns And Its Impact On Academic Writing, Jinhee Kim, Sang-Soog Lee, Rita Detrick, Jialin Wang, Na Li

STEMPS Faculty Publications

Considering both the transformative opportunities and challenges presented by generative AI (GenAI) in academic writing, effectively integrating GenAI into the academic setting becomes a significant need requiring prioritization. Yet, there is limited understanding regarding the nature of interactions between different types of students, what behavioral patterns students exhibit during a student-GenAI interaction (SAI) on a given task, and how these different SAI patterns relate to the actual writing task performance. This study, therefore, aimed to identify SAI patterns of academic writing tasks depending on students’ level of AI literacy and examine the differences in academic writing performance between the identified …

Students' Perception Of Generative Ai-Assisted Collaborative Argumentation, Jinhee Kim, Seongryeong Yu, Rita Detrick, Liangjie Fan, Na Li

STEMPS Faculty Publications

The rapid scaling of generative artificial intelligence (GenAI) technology presents opportunities for personalised learning experiences and facilitates collaborative learning, including collaborative argumentation (CA). However, empirical research examining students' perceptions of GenAI-assisted CA within classroom contexts remains limited. This study explored university students' experiences with GenAI-assisted CA through in-depth interviews with 36 students following a CA activity using a ChatGPT4-embedded argumentation platform developed by the research team. Findings indicate that students viewed GenAI as serving multiple roles, including tool, facilitator, teaching assistant and machine buddy. Students perceived that GenAI-assisted CA could empower task performance and create a collaborative learning environment. Meanwhile, …

Designing Faculty Standards For Technology Integration In Higher Education Institutions: A Design-Based Research Study, Helen Crompton, Diane Burke, Christine Nickel

STEMPS Faculty Publications

This design-based research study responds to the call from scholars, organizations, and institutions to address the gap in scholarly knowledge regarding the lack of technology standards for faculty in higher education. These standards cover the three areas of faculty workload: teaching, research, and service. Conducted over two iterative macro cycles, this unique study engaged 114 participants, including faculty from a range of disciplines and institutional types, accreditation organizations and coordinators, and education and technology organizations. The outcome is a framework comprising six faculty standards; Instructor, Coordinator, Leader, Researcher, Learner, and Contributor. Each outcome is accompanied by practical indicators that support …

Foreword, Pedagogical Innovations In Computer Science Education, Helen Crompton

STEMPS Faculty Publications

[Introduction] Computer science education sits at a defining moment. Across schools and universities worldwide, computing is no longer a niche discipline reserved for a select few. It is a foundational literacy that shapes how learners understand the world, participate in society, and imagine their futures. At the same time, the rapid pace of technological change, particularly in artificial intelligence, data systems, and intelligent tools, has placed unprecedented pressure on educators to rethink not only what we teach, but why and how we teach it. This book arrives precisely when such reflection is most needed.

Human Centered Learning Management System Design Inspired By Social Networking Platforms, Giseung Lee

World Languages and Cultures Faculty Publications

The rapid integration of generative artificial intelligence (GenAI) into higher education is reshaping interaction within digital learning environments. As AI-enabled tools such as conversational agents and automated feedback systems become embedded in Learning Management Systems (LMSs), questions arise regarding how these systems can support social presence, dialogue, and human-centered pedagogy without reproducing the attention-driven logics of commercial social media. This paper presents a conceptual, design-oriented framework for human-centered LMS design inspired by selected interactional affordances of Social Network Sites (SNSs). Drawing on social presence theory, post-process pedagogy, and hyperpedagogy, the framework articulates four interrelated design dimensions—Familiar Interaction, Dialogic Feedback, Community …

Designing Ai Systems To Support A Productive-Failure-Based Learning: Insights From Adult Learners On Ai Applications And Ai System Design Principles, Jinhee Kim, Xi Lin, Seongryeong Yu, Rita Detrick

STEMPS Faculty Publications

Emerging capabilities of generative artificial intelligence (GenAI) offer significant potential to support productive failure (PF)-based learning, which engages adult learners (ALs) in exploring problems before instruction and learning from their initial attempts. However, the effective use of AI to support multifaceted areas of PF-based learning, including problem generation, exploration, consolidation, and knowledge assembly, is limited. Furthermore, AI design principles to support PF-based learning remain under-researched. This study, therefore, aims to investigate ALs’ perceptions of AI applications in enhancing PF-based learning and to explore the essential design principles of AI systems for PF-based learning. To achieve these aims, the study conducted …

The Devil Is In The Det[Ai]Ls: Ai Agents, Ghost Students, And The Crisis Of Verified Presence In An Agentic Ai World, Aras Bozkurt, Helen Crompton, Caroline Fell Kurban

STEMPS Faculty Publications

The transition from reactive Generative Artificial Intelligence (GenAI) to agentic AI systems marks a categorical shift in digital education, moving beyond simple content generation to goal-oriented, autonomous execution. This paper explores the emergence of the “ghost student”: a digital surrogate created by the coupling of Large Language Models (the “mind”) and agentic AI browsers (the “body”). These entities are capable of navigating Learning Management Systems (LMS), engaging with content, and completing assessments with human-like mimicry, often rendering the actual learner’s presence optional. We argue that this phenomenon creates a verification gap that traditional proctoring and detection tools are structurally unable …

Instructional Designers' Reflections On Generative Ai Use For Scenario-Based And Performance-Centered Learning: A Collective Autoethnography, Nour El Houda Maache, Dan V. Dao, Jiyoon Jung, Jayanth Nadheri, Nari Kim, Chikezie Ozuzu, Xinyue Ren

STEMPS Faculty Publications

This study examines how instructional designer-instructors (IDIs) use and evaluate generative artificial intelligence (GenAI) when designing scenario-based and performance-centered authentic learning in higher education. Using a collective autoethnography (CAE) approach, the study draws on semi-structured interviews and reflective narratives from five IDIs with varied professional experience. Findings indicate that GenAI enhanced design capacity by accelerating scenario development, translating complex content, and supporting scenario-based and performance-based task construction. At the same time, participants reported limitations related to contextual misalignment, output unreliability, and the cognitive demands of prompt refinement. Across cases, effective integration depended on sustained human oversight, disciplinary judgment, and ethical …

Adult Learners' Perspectives Of Ai Applications In Supporting Andragogy, Jinhee Kim, Xi Lin, Seongryeong Yu, Rita Detrick

STEMPS Faculty Publications

Emerging roles and capabilities of artificial intelligence (AI) technologies have the potential to support andragogical education and enhance learning experience for adult learners (ALs). However, the effective use of AI to support multifaceted components of andragogy including involvement, experience, problem-centered, relevance remains under explored. Furthermore, research on AI design principles to support ALs and andragogy is limited. This study, therefore, aims to investigate ALs perceptions of AI applications in enhancing andragogy and to explore the essential design principles of AI systems for andragogy. To this end, the study conducted semi-structured interviews with 20 ALs facilitated by 11 scenarios of AI …

Chatgpt In Secondary English Language Learning: Educators' And Students' Literacy, Perceptions, And Experiences, Victoria Brenes, Sierra Outerbridge, Xinyue Ren

STEMPS Faculty Publications

The increasing use of generative artificial intelligence (GenAI) has shown the potential of transforming teaching and learning practices in various educational settings, such as in English language learning (ELL). As English language learners (ELLs) often experience many challenges and barriers in schools in the United States, it is urgent to leverage the educational affordances of GenAI in fostering the effectiveness of ELL. Given the limited research investigating GenAI adoption, especially ChatGPT literacy within K-12 ELL, this convergent mixed methods research aims to investigate students' and teachers’ perceptions of using ChatGPT and their ChatGPT literacy in secondary ELL contexts. We will …

Redefining Educational Technology: A Critical Collaborative Inquiry, Aras Bozkurt, Helen Crompton, Robert Farrow, Agnes Kukulska-Hulme, Jon Dron, Richard West, Agnieszka (Aga) Palalas, Matth Bower, Junhong Xiao, Ahmed Tlili, Danah Henriksen, Angelica Pazurek, Henk Huijser, Thomas K. F. Chiu, Petar Jandrić, Katy Jordan, John Curry, Royce Kimmons, Mutlu Cukurova, Thomas Reeves, Gwo-Jen Hwang, Peter Shea, Jason Lodge, Martin Weller, Davy Ng, Tutaleni Iita Asino

STEMPS Faculty Publications

Educational technologists have not settled on a fixed definition of the field and likely never will. However, attempting to define the field helps to understand the epistemological meanings that shape what the field sees, values, and considers worth pursuing. Through a critical historical review spanning over a century, alongside theoretical engagement with the concepts of entanglement and distributed agency, this paper identifies three key insufficiencies in current educational technology frameworks. These are the persistence of an instrumental-facilitative paradigm that treats technology as a resource deployed by human agents; the theoretical dissolution of the pedagogy-technology dichotomy that existing definitions have not …

Hyflex Course Design: Outcomes, Challenges, And Supports For Students And Instructors, Tracey Barr, Tian Luo

STEMPS Faculty Publications

Since it was first developed in 2006, the hybrid flexible, or HyFlex, course model has been growing in prevalence in higher education. HyFlex courses are defined as those allowing students to decide whether to experience course material in person, online synchronously, or asynchronously on a weekly or daily basis without warning to, or permission from, the course’s instructor. Empirical research regarding this instructional approach is still relatively limited despite increased attention during and following the COVID-19 pandemic. Increasing interest in providing alternatives to fully in-person instruction has made it necessary to closely examine the existing body of research to determine …

A Methodological Framework For Modernizing Engineering Course Content With Large Language Models, Katherine Smith, Dalya Ismael, Otilia Popescu, Murat Kuzlu, Adel El-Shahat, Vukica M. Jovanovic

Engineering Technology Faculty Publications

The rapid evolution of technology presents challenges for engineering educators. While the core engineering methods often remain relevant over time, course materials rapidly become outdated in presentation and pedagogical approach. This paper presents a methodological framework for using large-language models (LLMs) to modernize engineering course content with a case study in an advanced technical analysis course.

The methodology follows a phased approach that is designed to be repeatable and verify the accuracy and completeness of course content. During the first phase, an LLM is used to map outdated text-heavy content to a modern format using a LaTeX template. The second …

Iuse: A Gamified Virtual Learning Platform For Connected Vehicle Applications To Enhance Undergraduate Transportation Education, Tianyu Shen, Di Yang, Kai Sun, Hong Yang, Kun Xie, Mansoureh Jeihani

Civil & Environmental Engineering Faculty Publications

Emerging transportation technologies are rapidly reshaping transportation systems and industry practice. However, most transportation undergraduate curricula still emphasize foundational topics such as geometric design, travel demand forecasting, pavements, and soil properties, typically delivered through lecture-centric instruction. While these subjects remain essential to the discipline, they do not fully reflect the pace of technological change or provide sufficient opportunities for experiential learning with modern tools and data. This gap limits students’ exposure to CV concepts and their ability to translate theory into practice.

Focusing on a key emerging technology, connected vehicles (CVs), this paper bridges the above gap by introducing a …

Examining Inclusive Computing Education For Blind Students In India, Akshay Kolgar Nayak, Yash Prakash, Md Javedul Ferdous, Sampath Jayarathna, Hae-Na Lee, Vikas Ashok

Computer Science Faculty Publications

The growing demand for computer professionals, driven by the expanding Information Technology industry, has led to numerous inclusive computing education efforts. These efforts have even included blind or visually-impaired (BVI) students, who are being increasingly encouraged to pursue education and a career in computing, despite the visually-oriented nature of the discipline. Extant literature has predominantly focused on identifying and addressing the accessibility barriers faced by BVI students to promote more inclusive learning environments. While few studies have also investigated the accessibility of computing education from the perspectives of BVI learners and instructors, these have been primarily situated in the Global …

Guidelines For Automatic Grading Of Student Essays Using Large Language Models, Diwakar Yalpi, Sruta Keerti Kasula, Ravi Mukkamala

Computer Science Faculty Publications

Automated essay evaluation using large language models (LLMs) has emerged as a promising approach to support scalable and consistent educational assessment. However, the effectiveness of LLM-based grading varies significantly across evaluation dimensions and is highly influenced by prompt design and model selection. In this study, we evaluate five state-of-the-art LLMs across five rubric-based categories: Relevance to Question, Reasoning and Critical Thinking, Evidence and Examples, Organization, and Clarity and Writing Quality. We systematically investigate the impact of three prompting strategies, including rubric-only prompting, exemplar-based prompting (with and without rubric guidance)(Original and Refined prompt designs) incorporating structured instructions. Additionally, a prompt ablation …

Contextual Scaffolding And Self-Efficacy: Supporting Computer Skill Development Among Blind Learners In India, Akshay Kolgar Nayak, Yash Prakash, Sampath Jayarathna, Hae-Na Lee, Vikas Ashok

Computer Science Faculty Publications

Inclusive computer literacy education efforts, broadening the participation of blind or visually impaired (BVI) individuals, have gained traction in recent years. Existing literature investigating these efforts primarily draws evidence from affluent Global North contexts, where accessibility resources and legal frameworks are relatively more mature. Little is known about the in-situ teaching and learning challenges faced by trainers and BVI students, respectively, in resource-constrained, multicultural Global South countries like India. To address this knowledge gap, we conducted a four-month contextual inquiry at two computer training centers catering to 94 BVI students in India. We notably observed a rigid, experience-driven training environment …

Marginalized Pre-Service Teachers’ Digital Competence: An Exploration Of Epistemic Beliefs And Lived Experiences, Jerolyn Rose Brown

STEMPS Theses & Dissertations

Amid growing calls for equity in teacher education, this dissertation investigates how digital competence and epistemological beliefs interact within the lived experiences of marginalized pre-service teachers (mPSTs), also referenced as teacher candidates, whose racial and ethnic identities often position them at the periphery of dominant educational narratives. Anchored in critical narrative inquiry (Pino Gavidia & Adu, 2022) and framed by the DigCompEdu digital competence model (Redecker & Punie, 2017), the study employs a multimethod approach, integrating quantitative data from the SELFIEforTEACHERS self-assessment tool (Economou, 2023) with qualitative insights drawn from in-depth narrative interviews. The participant cohort consists of 50 marginalized …

Toward Personalizing Quantum Computing Education: An Evolutionary Llm-Powered Approach, Iizalaarab Elhaimeur

Computer Science Theses & Dissertations

Quantum computing education faces significant challenges due to its complexity and the limitations of current tools. This thesis introduces a novel Intelligent Teaching Assistant for quantum computing education and details its evolutionary design process. The system combines a knowledge-graph-augmented architecture with two specialized LLM agents: a Teaching Agent for dynamic interaction and a Lesson Planning Agent for lesson generation. The system is designed to adapt to individual student needs, with interactions meticulously tracked and stored in a knowledge graph. This graph represents student actions, learning resources, and their relationships, aiming to enable reasoning about effective learning pathways. We describe the …

Expectations In Instructional Design: A Comparison Of Hampton Roads Industry Requirements And Old Dominion University’S Curriculum, Haley Aguilar

STEMPS Master's Level Projects and Papers

This master’s thesis aims to analyze the alignment between Old Dominion University’s Instructional Design and Technology program curriculum and employer expectations for instructional designers in the Hampton Roads region. The study examined job listings from 50 positions and curriculum content from 22 courses across six skill categories: technical skills, design and development competencies, communication and facilitation skills, analysis and assessment skills, project management capabilities, and specialized skills. The findings contribute to understanding the challenges of preparing instructional design graduates for workforce entry.

Practicing In The Laboratories Of Democracy: An Interpretive Phenomenological Analysis Of How Political Science Faculty Use Simulations With Community College Students, James Stewart Shifflett

STEMPS Theses & Dissertations

Political science faculty members have often used simulations to promote civic engagement and build political efficacy in students. However, the use of political simulations with community college students has not been studied as extensively as it has with their four-year counterparts. Through the interpretive phenomenological analysis (IPA) methodology, this study examined the experiences of nine political science faculty members who use simulations with community college students to understand how instructional designers might better support their civic engagement and design efforts. Faculty members who participated in the study use simulations as constructive social interactions; as comprehensive learning experiences integrating preparation, facilitation …