Educational Technology Commons^™

The Promise And Pitfalls Of Genai In Education, Helen Crompton

STEMPS Faculty Publications

Since ChatGPT was made available to the public, artificial intelligence (AI) has had accelerated growth in the field of education at an unprecedented rate. This study examined the misuses and limitations of ChatGPT and similar generative AI as well as the affordances of these tools for teaching and learning. Using PRISMA protocol, this thematic systematic review examined extant literature from November 2022 to June 2024. The findings reveal five misuses and limitations trends in the literature of cheating, inaccuracies, plagiarism, bias, and data privacy. Affordances highlighted six areas of content creation, personalization, engagement, student coaching and assistance, assessment, and task …

The Seti Framework And Technology Integration In The Digital Age, Helen Crompton, Diane Burke, Christine Nickel, Agnes Chigona

STEMPS Faculty Publications

Effective integration of technology is critical for online, blended, hybrid, and face-to-face learning. The purpose of this paper is to introduce the SETI (Socio-Ecological Technology Integration) framework and explain what it adds to the scholarly research regarding effective technology integration. The SETI framework goes beyond previous frameworks and applies a holistic systems approach to understanding effective technology integration. This takes into account all aspects of technology integration including new findings uncovered during the Covid-19 lockdown. TPACK and SAMR were analyzed identifying their benefits and limitations and then the SETI framework was explained providing insight into the value of a whole …

Types Of Teacher-Ai Collaboration In K-12 Classroom Instruction: Chinese Teachers' Perspective, Jinhee Kim

STEMPS Faculty Publications

The advancing power and capabilities of artificial intelligence (AI) have expanded the roles of AI in education and have created the possibility for teachers to collaborate with AI in classroom instruction. However, the potential types of teacher-AI collaboration (TAC) in classroom instruction and the benefits and challenges of implementing TAC are still elusive. This study, therefore, aimed to explore different types of TAC and the potential benefits and obstacles of TAC through Focus Group Interviews with 30 Chinese teachers. The study found that teachers anticipated six types of TAC, which are thematized as One Teach, One Observe; One Teach, One …

Differences In Student-Ai Interaction Process On A Drawing Task: Focusing On Students' Attitude Towards Ai And The Level Of Drawing Skills, Jinhee Kim, Yoonhee Ham, Sang-Soog Lee

STEMPS Faculty Publications

Recent advances and applications of artificial intelligence (AI) have increased the opportunities for students to interact with AI in their learning tasks. Although various fields of scholarly research have investigated human-AI collaboration, the underlying processes of how students collaborate with AI in a student-AI teaming scenario have been scarcely investigated. To develop effective AI applications in education, it is necessary to understand differences in the student-AI interaction (SAI) process depending on students' characteristics. The present study attempts to fill this gap by exploring the differences in the SAI process amongst students with varying drawing proficiencies and attitudes towards AI in …

Exploring Students' Perspectives On Generative Ai-Assisted Academic Writing, Jinhee Kim, Seongryeong Yu, Rita Detrick, Na Li

STEMPS Faculty Publications

The rapid development of generative artificial intelligence (GenAI), including large language models (LLM), has merged to support students in their academic writing process. Keeping pace with the technical and educational landscape requires careful consideration of the opportunities and challenges that GenAI-assisted systems create within education. This serves as a useful and necessary starting point for fully leveraging its potential for learning and teaching. Hence, it is crucial to gather insights from diverse perspectives and use cases from actual users, particularly the unique voices and needs of student-users. Therefore, this study explored and examined students' perceptions and experiences about GenAI-assisted academic …

The Manifesto For Teaching And Learning In A Time Of Generative Ai: A Critical Collective Stance To Better Navigate The Future, Aras Bozkurt, Junhong Xiao, Robert Farrow, John Y. H. Bai, Chrissi Nerantzi, Stephanie Moore, Jon Dron, Christian M. Stracke, Lenandlar Singh, Helen Crompton, Apostolos Koutropoulos, Evgenii Terentev, Angelica Pazurek, Mark Nichols, Alexander M. Sidorkin, Eamon Costello, Steven Watson, Dónal Mulligan, Sarah Honeychurch, Charles B. Hodges, Mike Sharples, Andrew Swindell, Isak Frumin, Ahmed Tlili, Patricia J. Slagter Van Tryon, Melissa Bond, Maha Bali, Jing Leng, Kai Zhang, Mutlu Cukurnova, Thomas K. F. Chiu, Kyungmee Lee, Stefan Hrastinski, Manuel B. Garcia, Ramesh Chander Sharma, Bryan Alexander, Olaf Zawacki-Richter, Henk Huijser, Petar Jandrić, Chanjin Zheng, Peter Shea, Josep M. Duart, Chryssa Themeli, Anton Vorochkov, Sunagül Sani-Bozkurt, Robert L. Moore, Tutaleni Iita Asino

STEMPS Faculty Publications

This manifesto critically examines the unfolding integration of Generative AI (GenAI), chatbots, and algorithms into higher education, using a collective and thoughtful approach to navigate the future of teaching and learning. GenAI, while celebrated for its potential to personalize learning, enhance efficiency, and expand educational accessibility, is far from a neutral tool. Algorithms now shape human interaction, communication, and content creation, raising profound questions about human agency and biases and values embedded in their designs. As GenAI continues to evolve, we face critical challenges in maintaining human oversight, safeguarding equity, and facilitating meaningful, authentic learning experiences. This manifesto emphasizes that …

The Educational Affordances And Challenges Of Chatgpt: State Of The Field, Helen Crompton, Diane Burke

STEMPS Faculty Publications

ChatGPT was released to the public in November 30, 2022. This study examines how ChatGPT can be used by educators and students to promote learning and what are the challenges and limitations. This study is unique in providing one of the first systematic reviews using peer review studies to provide an early examination of the field. Using PRISMA principles, 44 articles were selected for review. Grounded coding was then used to reveal trends in the data. The findings show that educators can use ChatGPT for teaching support, task automation, and professional development. These were further delineated further by axial sub …

Ai And English Language Teaching: Affordances And Challenges, Helen Crompton, Adam Edmett, Neenaz Ichaporia, Diane Burke

STEMPS Faculty Publications

English is one of the most used languages for jobs, markets, tourism, discourse and international connectivity. However, English learners face many challenges in gaining English language skills. Extant studies show that AI has affordances to support in English language teaching and learning ELT/L. This study answers the call to examine specific challenges and affordances for using AI in ELT/L. A systematic review method was used with PRISMA principles to identify 42 studies. Findings reveal the geographical locations of studies, learner ages and years of study. Grounded coding was then used to identify affordances of the use of AI in ELT/L …

The Nexus Of Iste Standards And Academic Progress: A Mapping Analysis Of Empirical Studies, Helen Crompton, Diane Burke

STEMPS Faculty Publications

Technology has become commonplace in K-12 classrooms with students actively using digital technology to support learning. The purpose of this study was to investigate whether there is empirical support that implementing the ISTE Standards for Students can result in learning gains. A scoping review methodology was used to map extant literature to evidence of learning gains. To ensure transparency in the selection of the articles and the evidence gathering procedure, an a priori method was used. This study is unique in that it provides the first examination of a set of student standards for technology use to learning gains within …

Join The Sons Of Liberty! Exploring 1773 Bloxels Boston, Elisa Shaffer

STEMPS Faculty Publications

Learners will create a colonial character to explore 1773 Boston and gain insight into the underpinnings of the events that led up to and occurred during the Boston Tea Party on December 16, 1773. Using Bloxels, learners will travel the streets of Boston, interacting with different characters and learning about their concerns and events. They will also interact with British soldiers and tax collectors. Additionally, they will be given an opportunity to join the Sons of Liberty and participate in the Boston Tea Party.

Exploring Instructional Designers' Utilization And Perspectives On Generative Ai Tools: A Mixed Methods Study, Tian Luo, Pauline S. Muljana, Xinyue Ren, Dara Young

STEMPS Faculty Publications

The emergence of generative artificial intelligence (GenAI) has caused significant disruptions on a global scale in various workplace settings, including the field of instructional design (ID). Given the paucity of research investigating the impact of GenAI on ID work, we conducted a mixed methods study to understand instructional designers (IDs)’ perceptions and experiences of utilizing GenAI across a spectrum of ID tasks. A total of 70 IDs completed an online survey, and 13 of them participated in the semi-structured interviews. The survey results indicated IDs’ familiarity with and perceived usability of GenAI tools in performing various ID responsibilities in their …

Simulation-Based Adaptive Interface For Personalized Learning Of Ai Fundamentals In Secondary School, Sara Guerreiro-Santalla, Dalila Duraes, Helen Crompton, Paulo Novais, Francisco Bellas

STEMPS Faculty Publications

This paper presents the first results on the validation of a new Adaptive E-learning System, focused on providing personalized learning to secondary school students in the field of education about AI by means of an adaptive interface based on a 3D robotic simulator. The prototype tool presented here has been tested at schools in USA, Spain, and Portugal, obtaining very valuable insights regarding the high engagement level of students in programming tasks when dealing with the simulated interface. In addition, it has been shown the system reliability in terms of adjusting the students’ learning paths according to their skills and …

Roboboits: A Simulation-Based Tutoring System To Support Ai Education Through Robotics, Sara Guerreiro-Santalla, Helen Crompton, Francisco Bellas

STEMPS Faculty Publications

This paper presents a novel tutoring system to educate pre-university students about AI, a key issue to develop AI in Education for Sustainable Society. With the aim of following a learning-by-doing approach to AI, we decided to focus on robotics as the main application domain for the students’ activities. Specifically, the tutoring system is based on the Robobo educational robot, and its simulation environment. A prototype version of the tutoring system, called RoboboITS, has been released and tested in two in-person sessions with 17 students in a secondary school at Virginia (USA), leading to and promising outcomes for future development.

How It Course Improves Digital Competencies: An Experimental Study In Science Education, Mustafa Tevfik Hebebci, Helen Crompton

STEMPS Faculty Publications

The rising significance of technology in society has caused a surge in the requirement of individuals possessing digital competencies. In the current era, digital skills are progressively vital for both personal and occupational growth. Governments have acknowledged the value of digital competencies and have incorporated them as part of fundamental proficiencies in numerous countries. Pre-service teachers have a paramount role in molding forthcoming generations, highlighting their necessity to possess robust digital competencies. This research centers on how an "Information Technologies in Science Education" course influences the digital competency progression in pre-service teachers. The study deployed a pre-test post-test experimental design …

The Theory Of Learning In Micro: Context & Explanation, Irene A. Bal, Mohammad Shams Ud Duha, Okan Arslan, Jessica Collier, Paula Marcelle, Annetta Dolowitz, Jamie Brernhardt, Meg Swanson, Monalisa Dash, Bohdana Allman (Ed.), Heather Leary (Ed.), Royce Kimmons (Ed.)

STEMPS Faculty Publications

The Theory of Learning in Micro is a proposed theory on how people micro-learn. This theory is based on the hypothesis that learning is a continual process better supported with smaller, more focused learning resources and activities. Based on two main beliefs, knowledge and design, The Theory of Learning in Micro was crafted as a foundation for how people learn in micro, providing a set of beliefs and assumptions for the microlearning design and development community.

Comparing The "Value Of Information Services" For Providers And Vulnerable Patrons: A Mixed-Methods Study With Academic Libraries And Students With Disabilities, Devendra Potnis, Kevin J. Mallary

STEMPS Faculty Publications

Introduction. This multi-year, mixed-methods study compares (a) the reasons administrators and librarians of academic libraries invest in assistive technology for delivering information services to students with disabilities, with (b) the benefits that influence these students’ intention to use AT.

Method. In the first phase, 50 library administrators and 22 librarians from 186 public universities across the US shared their top-three reasons for investing in assistive technology through a qualitative survey. In the second phase, 322 students with disabilities from the same institutions completed a quantitative survey, in which respondents shared individual-level benefits that influence their intention to use assistive technology. …

Examining The Impact Of Online Math Games On Student Performance And Attitudes, Tian Luo, Catherine Hickman, Pauline Muljana

STEMPS Faculty Publications

Low mathematics scores in the U.S. have been pressing the educators to find engaging strategies and effective tools to promote math performance. While emerging technologies, such as digital math games, show promises in improving mathematical education, existing studies have garnered mixed findings and thereby necessitating further investigation. This study aims to examine the impact of skill-based online math games on students’ math performance and attitudes, as well as students’ perceptions of the games. Thirty-eight students ranging from fifth to eighth grade participated in the study. The results showed a mixed picture of the impact of the online games on math …

Conducting A Formative Evaluation On A Course-Level Learning Analytics Implementation Through The Lens Of Self-Regulated Learning And Higher-Order Thinking, Pauline S. Muljana, Tian Luo, Greg Placencia

STEMPS Faculty Publications

Self-regulated learning (SRL) and higher-order thinking skills (HOTS) are associated with academic achievement, but fostering these skills is not easy. Scholars have suggested an alternative way to scaffold these important skills through learning analytics (LA). This paper presents a formative evaluation of a course-level LA implementation through the lens of self-regulated learning (SRL) and higher-order thinking skills (HOTS). We explored the changes in students’ SRL, HOTS, and perceptions at the end of the course term. Results indicate an increase in some elements of SRL and HOTS, and positive student perceptions. Discussion on implications and opportunities for informing future teaching strategies …

Organizational Analysis In Preparation For Lms Change: A Narrative Case Study, F. Eamonn Powers, Robert L. Moore

STEMPS Faculty Publications

Collaboration and teamwork are concepts routinely attributed to organizational success and successful change management. Yet often the details of these collaborative experiences are limited to participants in the team involved. In this case study we highlight how a learning experience architect, as part of an organizational working group, could leverage human performance technology (HPT) principles to lead the analysis efforts surrounding an LMS platform change at a professional training organization. Human performance technology is the study and practice of improving productivity in organizations. This includes designing and developing effective interventions, processes, and methodologies that are ethical, results-oriented, comprehensive, and systemic …

Past Precedent Reconciling Established Multimedia Principles In 3d Virtual Learning Environments, Kristin Herman, Jim S. Shifflett, Courtney W. Schoolmaster, Charles Thull, Noah Glaser

STEMPS Faculty Publications

This design case documents the inception, development, and installation of a virtual exhibit on ethical use of learning analytics (LA) for the Museum of Instructional Design (MID), hosted in Mozilla Hubs. Tension emerged as the design team attempted to negotiate established principles of multimedia design theory (see Mayer, 2014; Mayer & Fiorella, 2021; Richardson, 2014) within an emerging learning environment. A rapid prototyping model, combined with elements of critical museology and dialectics, allowed for ongoing formative evaluation of design fidelity. Exhibit artifacts consisted of scenarios illustrating the ethical ambiguities of LA; a data justice timeline pairing recent peer-reviewed articles on …

A Predictive Study Of Students Social Presence And Their Interconnectivities In The Social Network Interaction Of Online Discussion Board, Cherng-Jyh Yen, Chih-Hsiung Tu, Moussa Tankari, Emrah Emre Ozkeskin, Hoda Harati, Alexandra Miller

STEMPS Faculty Publications

Effective online interaction is beyond interacting with whomever. The quality of social interconnectivity matters. Social presence plays a vital role in building an effective online learning community. This study empirically examined: how online social presence will predict various aspects of students’ social interconnectivities (i.e., in-degree, out-degree, betweenness centrality, closeness centrality, eigenvector centrality, reciprocated vertex pair ratio, & PageRank) in the social network of discussion board within an online course? The predictive utility of social presence for all social network interconnectivity was supported, but reciprocated vertex pair ratio, so-called two-way interconnectivity was not. Social presence serves as a strong predictor for …

Review Of: Estrellado, R. A., Freer, E. A., Motsipak, J., Rosenberg, J. M., & Velásquez, I. C. (2021). Data Science In Education Using R. London, England: Routledge, Esther Michela, Robert L. Moore

STEMPS Faculty Publications

Data use in education is continually expanding in scope (Romero and Ventura 2020), and though programming resources are plentiful, those that truly scaffold the learning process are scarce. Data Science in Education Using R by Estrellado, Freer, Motsipak, Rosenberg, and Velásquez is a combination primer and workbook. This format allows the volume to serve as both an introductory R resource aimed to help readers overcome the daunting initial roadblocks to proficiency and familiarize them with educational data uses. We reviewed this book from the perspective of a beginning R user with little other programming background for whom this book is …

Safety Training For Career And Content Switchers, Philip A. Reed, M. Kathleen Ferguson

STEMPS Faculty Publications

No abstract provided.

Lights, Camera, Activity! A Systematic Review Of Research On Learner-Generated Videos, Bridgette Shade Epps, Tian Luo, Pauline S. Muljana

STEMPS Faculty Publications

Aim/Purpose

The current literature discusses the use and benefits of learner-generated videos (LGVs). However, it rarely addresses any correlation between the types of subjects that are best suited for using these videos or what techniques should accompany the use of LGVs.

Background

This systematic review synthesizes current literature to identify patterns and implications that develop from the use of LGVs so that their future use can be both consistent and effective. This paper also reviews the studies to establish the most consistent educational benefits that emerge from this activity.

Methodology

Employing the Preferred-Reporting of Items for Systematic Reviews and Meta-Analyses …

Informing Makerspace Outcomes Through A Linguistic Analysis Of Written And Video-Recorded Project Assessments, Kevin M. Oliver, Jennifer K. Houchins, Robert L. Moore, Chuang Wang

STEMPS Faculty Publications

A growing body of research focuses on what outcomes to assess in makerspaces, and appropriate formats for capturing those outcomes (e.g. reflections, surveys, and port-folios). Linguistic analysis as a data mining technique holds promise for revealing different dimensions of learning exhibited by students in makerspaces. In this study, student reflections on makerspace projects were gathered in 2 formats over 2 years: private written assessments captured in the 3D GameLab gamification platform, and semi-public video-recorded assessments posted in the more social FlipGrid platform. Transcripts of student assessments were analyzed using Linguistic Inquiry Word Count (LIWC) to generate 4 summary variables thought …

When Failure Is An Option: A Scoping Review Of Failure States In Game-Based Learning, F. Eamonn Powers, Robert L. Moore

STEMPS Faculty Publications

As interest in the use of games and gaming elements within learning environments grows, educators and designers may find it easier to account for winning than for losing and failure. This scoping review examines the role of failure and loss within game-based instructional interventions. Because of the varied methods and relatively small number of articles directly addressing the intersection between failure and loss within game-based instructional interventions, a scoping review was undertaken. This review included 14 peer-reviewed articles which explored a range of instructional contexts implementing failure state game mechanics. We identify several key takeaways that indicate how failure state …

Exploring Student Perceptions Of Flipgrid In Online Courses, Patrick R. Lowenthal, Robert L. Moore

STEMPS Faculty Publications

Asynchronous video-based discussions have affordances that can address some of the constraints of asynchronous text-based discussions. However, little research has been conducted on the use of asynchronous video-based discussions in online courses. As a result, the purpose of this exploratory study was to investigate students’ perceptions of using Flipgrid for asynchronous video-based discussions in fully online courses. We used a cross-sectional survey design to survey 79 students who used Flipgrid in a fully online course. Students overall reported that they liked using Flipgrid, it was easy to use, and that it helped improve social presence. In this paper, we will …

Standards For Technological And Engineering Literacy: Addressing Trends And Issues Facing Technology And Engineering Education, Johnny J. Moye, Philip A. Reed

STEMPS Faculty Publications

The article offers information on addressing trends and issues facing technology and engineering education. It mentions future challenges, students need to "have a broad conceptual understanding of technology and its place in society, enabling them to be active participants in the technological world and careful creators and users of technology.

Systematic Review Of Adaptive Learning Research Designs, Context, Strategies, And Technologies From 2009 To 2018, Florence Martin, Yan Chen, Robert L. Moore, Carl D. Westine

STEMPS Faculty Publications

This systematic review of research on adaptive learning used a strategic search process to synthesize research on adaptive learning based on publication trends, instructional context, research methodology components, research focus, adaptive strategies, and technologies. A total of 61 articles on adaptive learning were analyzed to describe the current state of research and identify gaps in the literature. Descriptive characteristics were recorded, including publication patterns, instructional context, and research methodology components. The count of adaptive learning articles published fluctuated across the decade and peaked in 2015. During this time, the largest concentration of adaptive learning articles appeared in Computers and Education. …

Education Technology Tools, Robert L. Moore

STEMPS Faculty Publications

Educational technology has the benefit of creating active learning environments in both online and face-to-face classrooms. With the globalization of education, numerous educational tools and resources have been developed to create authentic learning experiences in the classroom. These tools can vary from web-based collaboration tools, such as Google Docs and VoiceThread, to a video tool such as FlipGrid. Such technology can be used in both live (synchronous) or online (asynchronous) classroom settings. With so many options, understanding how to select tools and how they can be integrated into instruction is important and thus is the focus of this entry.