Educational Technology Commons^™

Learning Design To Advance Human-Ai Collaboration In K-12 Education, Wing Sha Chan, Jinhee Kim, Seongryeong Yu, Rita Kay Detrick

STEMPS Faculty Publications

This chapter explores key components for designing effective Human-AI Collaboration (HAC) in K–12 education, addressing the current lack of theoretical and conceptual frameworks for structuring and implementing HAC in teaching and learning. It examines four essential areas: curriculum design, student and teacher–AI interaction, learning environments, and the evolution of HAC over time. The chapter introduces the concept of HAC in K–12 contexts, highlighting how humans and AI can leverage each other's strengths through co-evolutionary processes that foster mutual learning and collaboration. It reviews current HAC practices in schools and discusses their contributions to both teaching and learning. Finally, it presents …

Impacts Of Segmenting Principle On Learner Performance And Attitude In A 3d Environment: A Mixed-Method Multiple Case Study, Kristin Herman, Mohan Yang, Jim Shifflet, Noah Glaser

STEMPS Faculty Publications

This study presents a conceptual replication of Moreno’s (Appl Cogn Psychol 21:765–781. 10.1002/acp.1348, 2007) study on the benefits of adhering to the segmentation principle when utilizing multimedia learning objects. Furthermore, this study expands upon the original by taking place in a low-immersive virtual reality environment, allowing for further understanding on the extent to which multimedia principles are still relevant. Both a synchronous and an asynchronous case are presented. Results indicate benefits for both cases in far transfer of learning. Furthermore, synchronous learners indicated a significant reduction in cognitive load and increased overall attitudes towards learning due to segmented instruction.

Using Ai-Generated Multimedia To Teach Leisure Choice Making, Charles Thull

STEMPS Faculty Publications

This learning representation introduces an AI-developed, multimedia assessment for identifying leisure preferences among middle school students with developmental disabilities. Grounded in instructional design, ecological systems, and multimedia learning theories, the activity integrates ChatGPT, InVideo AI, Sora, DALL·E, and Gemini to create guided-choice visuals, short videos, and a structured, teacher-facilitated paired-choice activity using visual prompts across home, school, and community interest contexts. The technology-developed design fosters engagement, accessibility, and self-expression as students participate in a structured, teacher-facilitated paired-choice activity. Outcomes include enhanced student voice in leisure planning, increased self-awareness, and the identification of potential leisure interests. Assessments include student responses to …

Game-Based Learning For Asynchronous Ai Literacy Course: Approach To Improve Students' Cognitive, Behavioural, Affective, And Ethical Learning Of Ai, Jinhee Kim, Guang Yang, Wing Sha Chan, Xi Lin, Yukyeong Song

STEMPS Faculty Publications

Educators in higher education face persistent challenges in scaling AI literacy across disciplines and helping novice learners understand abstract AI concepts. Although research on game-based learning (GBL) reports mixed outcomes, few studies have examined its large-scale use in mandatory, asynchronous AI literacy courses for diverse undergraduate populations. Addressing this gap, this study investigates a scalable GBL-based AI literacy course delivered to 4898 first-year undergraduates across disciplines. Using a mixed-methods design with 311 valid pre- and post-survey responses and 20 interviews, the study evaluates students' cognitive, behavioural, affective, and ethical learning of AI. Quantitative results show significant improvements in overall AI …

Students-Generative Ai Interaction Patterns And Its Impact On Academic Writing, Jinhee Kim, Sang-Soog Lee, Rita Detrick, Jialin Wang, Na Li

STEMPS Faculty Publications

Considering both the transformative opportunities and challenges presented by generative AI (GenAI) in academic writing, effectively integrating GenAI into the academic setting becomes a significant need requiring prioritization. Yet, there is limited understanding regarding the nature of interactions between different types of students, what behavioral patterns students exhibit during a student-GenAI interaction (SAI) on a given task, and how these different SAI patterns relate to the actual writing task performance. This study, therefore, aimed to identify SAI patterns of academic writing tasks depending on students’ level of AI literacy and examine the differences in academic writing performance between the identified …

Students' Perception Of Generative Ai-Assisted Collaborative Argumentation, Jinhee Kim, Seongryeong Yu, Rita Detrick, Liangjie Fan, Na Li

STEMPS Faculty Publications

The rapid scaling of generative artificial intelligence (GenAI) technology presents opportunities for personalised learning experiences and facilitates collaborative learning, including collaborative argumentation (CA). However, empirical research examining students' perceptions of GenAI-assisted CA within classroom contexts remains limited. This study explored university students' experiences with GenAI-assisted CA through in-depth interviews with 36 students following a CA activity using a ChatGPT4-embedded argumentation platform developed by the research team. Findings indicate that students viewed GenAI as serving multiple roles, including tool, facilitator, teaching assistant and machine buddy. Students perceived that GenAI-assisted CA could empower task performance and create a collaborative learning environment. Meanwhile, …

Designing Faculty Standards For Technology Integration In Higher Education Institutions: A Design-Based Research Study, Helen Crompton, Diane Burke, Christine Nickel

STEMPS Faculty Publications

This design-based research study responds to the call from scholars, organizations, and institutions to address the gap in scholarly knowledge regarding the lack of technology standards for faculty in higher education. These standards cover the three areas of faculty workload: teaching, research, and service. Conducted over two iterative macro cycles, this unique study engaged 114 participants, including faculty from a range of disciplines and institutional types, accreditation organizations and coordinators, and education and technology organizations. The outcome is a framework comprising six faculty standards; Instructor, Coordinator, Leader, Researcher, Learner, and Contributor. Each outcome is accompanied by practical indicators that support …

Foreword, Pedagogical Innovations In Computer Science Education, Helen Crompton

STEMPS Faculty Publications

[Introduction] Computer science education sits at a defining moment. Across schools and universities worldwide, computing is no longer a niche discipline reserved for a select few. It is a foundational literacy that shapes how learners understand the world, participate in society, and imagine their futures. At the same time, the rapid pace of technological change, particularly in artificial intelligence, data systems, and intelligent tools, has placed unprecedented pressure on educators to rethink not only what we teach, but why and how we teach it. This book arrives precisely when such reflection is most needed.

Designing Ai Systems To Support A Productive-Failure-Based Learning: Insights From Adult Learners On Ai Applications And Ai System Design Principles, Jinhee Kim, Xi Lin, Seongryeong Yu, Rita Detrick

STEMPS Faculty Publications

Emerging capabilities of generative artificial intelligence (GenAI) offer significant potential to support productive failure (PF)-based learning, which engages adult learners (ALs) in exploring problems before instruction and learning from their initial attempts. However, the effective use of AI to support multifaceted areas of PF-based learning, including problem generation, exploration, consolidation, and knowledge assembly, is limited. Furthermore, AI design principles to support PF-based learning remain under-researched. This study, therefore, aims to investigate ALs’ perceptions of AI applications in enhancing PF-based learning and to explore the essential design principles of AI systems for PF-based learning. To achieve these aims, the study conducted …

The Devil Is In The Det[Ai]Ls: Ai Agents, Ghost Students, And The Crisis Of Verified Presence In An Agentic Ai World, Aras Bozkurt, Helen Crompton, Caroline Fell Kurban

STEMPS Faculty Publications

The transition from reactive Generative Artificial Intelligence (GenAI) to agentic AI systems marks a categorical shift in digital education, moving beyond simple content generation to goal-oriented, autonomous execution. This paper explores the emergence of the “ghost student”: a digital surrogate created by the coupling of Large Language Models (the “mind”) and agentic AI browsers (the “body”). These entities are capable of navigating Learning Management Systems (LMS), engaging with content, and completing assessments with human-like mimicry, often rendering the actual learner’s presence optional. We argue that this phenomenon creates a verification gap that traditional proctoring and detection tools are structurally unable …

Instructional Designers' Reflections On Generative Ai Use For Scenario-Based And Performance-Centered Learning: A Collective Autoethnography, Nour El Houda Maache, Dan V. Dao, Jiyoon Jung, Jayanth Nadheri, Nari Kim, Chikezie Ozuzu, Xinyue Ren

STEMPS Faculty Publications

This study examines how instructional designer-instructors (IDIs) use and evaluate generative artificial intelligence (GenAI) when designing scenario-based and performance-centered authentic learning in higher education. Using a collective autoethnography (CAE) approach, the study draws on semi-structured interviews and reflective narratives from five IDIs with varied professional experience. Findings indicate that GenAI enhanced design capacity by accelerating scenario development, translating complex content, and supporting scenario-based and performance-based task construction. At the same time, participants reported limitations related to contextual misalignment, output unreliability, and the cognitive demands of prompt refinement. Across cases, effective integration depended on sustained human oversight, disciplinary judgment, and ethical …

Adult Learners' Perspectives Of Ai Applications In Supporting Andragogy, Jinhee Kim, Xi Lin, Seongryeong Yu, Rita Detrick

STEMPS Faculty Publications

Emerging roles and capabilities of artificial intelligence (AI) technologies have the potential to support andragogical education and enhance learning experience for adult learners (ALs). However, the effective use of AI to support multifaceted components of andragogy including involvement, experience, problem-centered, relevance remains under explored. Furthermore, research on AI design principles to support ALs and andragogy is limited. This study, therefore, aims to investigate ALs perceptions of AI applications in enhancing andragogy and to explore the essential design principles of AI systems for andragogy. To this end, the study conducted semi-structured interviews with 20 ALs facilitated by 11 scenarios of AI …

Chatgpt In Secondary English Language Learning: Educators' And Students' Literacy, Perceptions, And Experiences, Victoria Brenes, Sierra Outerbridge, Xinyue Ren

STEMPS Faculty Publications

The increasing use of generative artificial intelligence (GenAI) has shown the potential of transforming teaching and learning practices in various educational settings, such as in English language learning (ELL). As English language learners (ELLs) often experience many challenges and barriers in schools in the United States, it is urgent to leverage the educational affordances of GenAI in fostering the effectiveness of ELL. Given the limited research investigating GenAI adoption, especially ChatGPT literacy within K-12 ELL, this convergent mixed methods research aims to investigate students' and teachers’ perceptions of using ChatGPT and their ChatGPT literacy in secondary ELL contexts. We will …

Redefining Educational Technology: A Critical Collaborative Inquiry, Aras Bozkurt, Helen Crompton, Robert Farrow, Agnes Kukulska-Hulme, Jon Dron, Richard West, Agnieszka (Aga) Palalas, Matth Bower, Junhong Xiao, Ahmed Tlili, Danah Henriksen, Angelica Pazurek, Henk Huijser, Thomas K. F. Chiu, Petar Jandrić, Katy Jordan, John Curry, Royce Kimmons, Mutlu Cukurova, Thomas Reeves, Gwo-Jen Hwang, Peter Shea, Jason Lodge, Martin Weller, Davy Ng, Tutaleni Iita Asino

STEMPS Faculty Publications

Educational technologists have not settled on a fixed definition of the field and likely never will. However, attempting to define the field helps to understand the epistemological meanings that shape what the field sees, values, and considers worth pursuing. Through a critical historical review spanning over a century, alongside theoretical engagement with the concepts of entanglement and distributed agency, this paper identifies three key insufficiencies in current educational technology frameworks. These are the persistence of an instrumental-facilitative paradigm that treats technology as a resource deployed by human agents; the theoretical dissolution of the pedagogy-technology dichotomy that existing definitions have not …

Hyflex Course Design: Outcomes, Challenges, And Supports For Students And Instructors, Tracey Barr, Tian Luo

STEMPS Faculty Publications

Since it was first developed in 2006, the hybrid flexible, or HyFlex, course model has been growing in prevalence in higher education. HyFlex courses are defined as those allowing students to decide whether to experience course material in person, online synchronously, or asynchronously on a weekly or daily basis without warning to, or permission from, the course’s instructor. Empirical research regarding this instructional approach is still relatively limited despite increased attention during and following the COVID-19 pandemic. Increasing interest in providing alternatives to fully in-person instruction has made it necessary to closely examine the existing body of research to determine …

Artificial Intelligence In Achieving Sustainable Development: Expectations Of Undergraduate Students, Jinhee Kim

STEMPS Faculty Publications

While there has been ample discussion regarding Artificial Intelligence (AI)’s contributions and challenges on the development agenda at the policy level, little is known about how students translate the potential and barriers of AI in achieving Sustainable Development Goals (SDGs). Drawing upon various qualitative data, including class observation, focus group interviews, and learning activity outcomes generated by 240 students across 7 different majors, this case study explores the expected roles of AI as well as barriers to AI adoption for sustainable development perceived by undergraduate students. The study revealed that students anticipated AI to play diverse roles, including data analyst, …

Lived Experiences Of Marginalized Pre-Service Teachers' Technology Ownership And Acquisition Of Digital Skills, Jerolyn Brown, Tian Luo

STEMPS Faculty Publications

Aim/Purpose

Despite increasing access to technology, persistent disparities in digital competence and self-efficacy remain among marginalized pre-service teachers, often exacerbated by systemic inequities and the digital divide. This research explores the gap in knowledge of the lived experiences of marginalized pre-service teachers’ (PST) prior access to technology and their current perceptions about educational technology integration.

Background

Grounded in Sociocultural Theory and the Theory of Planned Behavior, this study seeks to answer how marginalized pre-service teachers perceive prior and current technology ownership and related skill acquisition, what beliefs and intentions they have for future classroom technology integration, and what systemic disparities …

Examining Non-Traditional Online Learners' Ownership Of Learning In The Context Of Chatgpt-Facilitated Design, Mohan Yang, Tian Luo, Kristin Herman, Belle Li, Shanan Chappell Moots, Noah Glaser, Shiyan Jiang

STEMPS Faculty Publications

Generative artificial intelligence (GenAI) offers potential solutions to educational challenges by personalizing learning experiences for diverse learners. However, it also introduces complexities around issues of ownership of learning. As an indicator of empowered learning, ownership is a multifaceted but underexplored concept. In this study, the authors adopted a mixed-methods multiple-case study design to explore non-traditional online students’ perceived ownership of learning when using ChatGPT for instructional design. The authors adopted the psychology ownership construct consisting of self-efficacy, accountability, belongingness, and self-identity as the theoretical framework. Findings revealed students’ prior AI experiences and educational levels played a significant role in their …

The Use Of Extended Reality (Xr) In Higher Education: A Systematic Review, Diane Burke, Helen Crompton, Christine Nickel

STEMPS Faculty Publications

The use of XR, which encompasses Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR) has evolved rapidly in higher education (HE), driven by advancements in technology and the increasing recognition of its potential to enhance learning experiences. This systematic review provides unique findings with an up-to-date examination of the use of XR in HE from 2020–2024. Using PRISMA principles and protocol, 295 articles were identified for full examination. Using a priori, and grounded coding, the data from the 295 articles were extracted, analyzed, and coded to determine the trends in HE research regarding the use of XR. A …

Exploring The Impact Of Generative Ai Chatgpt On Critical Thinking In Higher Education: Passive Ai-Directed Use Or Human-Ai Supported Collaboration?, Nesma Ragab Nasr, Chih-Hsiung Tu, Jennifer Werner, Tonia Bauer, Cherng-Jyh Yen, Laura Sujo-Montes

STEMPS Faculty Publications

Generative AI is weaving into the fabric of many human aspects through its transformative power to mimic human-generated content. It is not a mere technology; it functions as a generative virtual assistant, raising concerns about its impact on cognition and critical thinking. This mixed-methods study investigates how GenAI ChatGPT affects critical thinking across cognitive presence (CP) phases. Forty students from a four-year university in the southwestern United States completed a survey; six provided their ChatGPT scripts, and two engaged in semi-structured interviews. Students’ self-reported survey responses suggested that GenAI ChatGPT improved triggering events (M = 3.60), exploration (M = 3.70), …

Examining Teaching Competencies And Challenges While Integrating Artificial Intelligence In Higher Education, Xinyue Ren, Min Lun Wu

STEMPS Faculty Publications

The rapid development of artificial intelligence (AI) technologies has demonstrated their affordances and limitations in revolutionizing pedagogical strategies in higher education. Given the lack of guidelines, policies, and resources to assist instructors in efficiently and ethically integrating AI into teaching and learning practices, this systematic review aimed to investigate AI integration competencies and challenges in higher education from the intelligent Technological Pedagogical Content Knowledge (TPACK) perspective. We first applied the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) to identify 23 studies published between 2019 and 2023 that met the inclusion and exclusion criteria. After conducting open coding and …

Advancing Pedagogical And Instructional Design Through Artificial Intelligence (Ai) In Education And Training Contexts, Mohan Yang, Jewoong Moon, Tian Luo, Jinhee Kim

STEMPS Faculty Publications

[Introduction] "The only way to discover the limits of the possible is to go beyond them into the impossible." - Arthur C. Clarke

It is our pleasure and honor as guest editors for this special issue of the Journal of Applied Instructional Design (JAID) to present "Advancing Pedagogical and Instructional Design through Artificial Intelligence (AI) in Education and Training Contexts." This issue arrives at a truly timely moment, as the rapid and continuous development of generative artificial intelligence (GenAI) is fundamentally reshaping the traditional paradigms of teaching, learning, and training.

Analysing Nontraditional Students' Chatgpt Interaction, Engagement, Self-Efficacy And Performance: A Mixed-Methods Approach, Mohan Yang, Shiyan Jiang, Belle Li, Kristin Herman, Tian Luo, Shanan Chappell Moots, Nolan Lovett

STEMPS Faculty Publications

Generative artificial intelligence brings opportunities and unique challenges to nontraditional higher education students, stemming, in part, from the experience of the digital divide. Providing access and practice is critical to bridge this divide and equip students with needed digital competencies. This mixed-methods study investigated how nontraditional higher education students interact with ChatGPT in multiple courses and examined relationships between ChatGPT interactions, engagement, self-efficacy and performance. Data were collected from 73 undergraduate and graduate students through chat logs, course reflections and artefacts, surveys and interviews. ChatGPT interactions were analysed using four metrics: prompt number, depth of knowledge (DoK), prompt relevance and …

Leveraging Custom Gpts For Formative Assessment And Feedback, Nari Kim, Jason Vickers, Shaimaa Alyehaibi, Chikezie Ozuzu, Xinyue Ren, Suhasini Kotcherlakota

STEMPS Faculty Publications

As artificial intelligence (AI) advances, the use of custom generative pre-trained transformers (Custom GPTs) in formative assessments opens new opportunities for improving student learning and engagement. Custom GPTs increase cognitive and emotional engagement by providing timely, context-sensitive, and tailored responses based on unique learner profiles. This paper aims to investigate how custom GPT-driven formative feedback can enhance individualized learning experiences and improve student performance. This paper will discuss the promise of this AI tool, the challenges associated with its application, and recommendations for educators and academics looking to use these technologies for formative assessments.

College Students' Identity Differences In Offline And Online Learning Environment And Their Effects On Achievement Motivation, Sang-Soog Lee, Jinhee Kim, Seung Won Yu, Na Li

STEMPS Faculty Publications

The unprecedented evolution of educational technologies has transformed the learning landscape, creating distinct experiences in offline and online learning environments (OLE). However, little attention has been given to exploring students’ identities in the online learning context and how they can influence academic trajectories, limiting the development of a holistic understanding of the nature, effects, and areas of improvement in students’ identity formation in OLE. This study aims to investigate how students’ identity subcomponents differ among offline and OLE students via propensity score matching (PSM) in China, which allows us to find a doppelganger to estimate the counterfactual situation for making …

Socially Shared Regulation Of Learning And Artificial Intelligence: Opportunities To Support Socially Shared Regulation, Jinhee Kim, Rita Detrick, Seongryeong Yu, Yukyeong Song, Linda Bol, Na Li

STEMPS Faculty Publications

Supporting learners in achieving high-level socially shared regulation of learning (SSRL) in the online collaborative learning (OCL) context presents challenges that the utilization of artificial intelligence (AI) technologies may help solve. However, the effective uses of AI to support multifaceted areas (cognition, metacognition, and motivation) and phases (forethought, performance, and reflection) of SSRL remain elusive. Furthermore, research on developing an educational AI and what pedagogical attributes and elements are required for AI to support students' SSRL effectively is limited. This study, therefore, aims to investigate students' perceptions of AI applications in enhancing SSRL and to explore the essential pedagogical elements …

The Integration Of Artificial Intelligence And Ontologies: Transformations In Knowledge Representation And Application, Grazia Serratore, Julaine Clunis

STEMPS Faculty Publications

Artificial Intelligence (AI) is reshaping the landscape of knowledge representation. There is an increasingly strong bidirectional relationship, between AI techniques and ontologies. AI techniques revolutionized traditional, manual ontology development and contribute to automated ontology construction, while ontologies enhance the performance of AI systems and their semantic accuracy. Through a comprehensive review of current literature, this paper aims to examine: i) how Machine Learning (ML) techniques contribute to the automated construction, refinement, and validation of ontologies; ii) the most widely used and effective ML approaches for ontology construction; iii) how domain-specific requirements influence the selection and adaptation of AI techniques for …

Un Enfoque Sistémico De La Integración De Tecnología - A Systems Approach To Technology Integration El Marco Seti, Helen Crompton

STEMPS Faculty Publications

[El marco de Integración Socioecológica de la Tecnología (SETI, por sus siglas en inglés) ofrece una perspectiva sistémica de la integración eficaz de la tecnología en educación. A diferencia de otros modelos anteriores que se centran en la práctica docente —como TPACK y SAMR—, el marco SETI sitúa al educador en un conjunto complejo de sistemas socioecológicos, incluido el microsistema de los entornos escolares, el exosistema de las estructuras de apoyo a nivel de distrito y el macrosistema de las políticas nacionales y las normas culturales. Este artículo parte de conceptualizaciones previas de SETI y desarrolla el marco para mostrar …

Designing Ai-Powered Learning: Adult Learners' Expectations For Curriculum And Human-Ai Interaction, Jinhee Kim, Seongryeong Yu, Rita Detrick, Xi Lin, Na Li

STEMPS Faculty Publications

Despite the potential benefits offered by GenAI technologies to provide innovative solutions to address distinct challenges faced by working adult learners (ALs) in higher education and beyond, there is limited understanding of how best to structure AI-powered learning for this population while ensuring their distinct needs and perspectives are considered. Hence, this study aimed to determine what curriculum and student-AI interaction would be required by situating ALs’ views. Through analyzing 48 e-portfolios and in-depth interviews with 20 ALs from diverse educational and professional backgrounds, the study found that ALs perceived content mastery and developing a lifelong habit of learning as …

Editorial: Ai's Impact On Higher Education: Transforming Research, Teaching, And Learning, Alyse Jordan, Ashley L. Dockens, Natalia Anastasia Pierson, Xinyue Ren

STEMPS Faculty Publications

[Introduction] This Research Topic provides a comprehensive examination of how artificial intelligence (AI) is transforming higher education. The collected studies reveal several interconnected themes that illuminate both the opportunities and challenges of AI integration in academic settings. This editorial summarizes these themes and articulates their significance for the future of higher education.