Education Commons^™

Identifying Support Structures Associated With Informal Formative Evaluation In Instructional Design, Suzanne Smith, Tian Luo

STEMPS Faculty Publications

Instructional designers perform informal formative evaluation in design practice. An evaluation may be used to locate errors in alignment of instructional objectives or to increase the quality or effectiveness of a design. An instructional design review is similar to peer reviews in higher education which are often structured, and tools are provided to contribute to the review. A study was performed to identify the support structures and tools that contribute to building a community of feedback within the practice of instructional design reviews. Six instructional designers and design managers were interviewed to gather the processes they use in design reviews …

Universal Design For Learning Implementation In Higher Education: Survey Of Faculty And Instructional Designers, Breanne A. Kirsch, Tian Luo

STEMPS Faculty Publications

Universal design for learning (UDL) is an inclusive design framework. Faculty and instructional designers were surveyed to investigate UDL implementation in higher education. This survey was based on one used by Westine et al. (2019). Results about how faculty and instructional designers learn about UDL, how instructional designers train and support faculty in UDL, and why and how participants choose to employ UDL are shared. The results from this study have provided new findings in relation to faculty and instructional designer UDL implementation efforts in higher education that have implications for training and supporting faculty with UDL application efforts.

Building Belonging Into The System, Kristin Herman, Michelle Gill

STEMPS Faculty Publications

This design case documents how a K-12 district took steps to systemically support virtual student wellness and belonging. Plans for course design to support social-emotional-academic learning (SEAL) competencies, increase perception of belonging, and create safe, predictable learning environments characteristic of a trauma-informed approach to teaching and learning are shared. The assumption virtual learners are not looking to experience belonging and cannot be successful unless they already have strong SEAL skills is challenged. Rather, the positioning of SEAL competencies as learning objectives rather than necessary prerequisites to access online learning proved to contribute to more equitable learning opportunities.

Authentic Learning Design Failures: The Need For Learner And Contextual Analysis And Participatory Design, Mohan Yang, Jon Harbor

STEMPS Faculty Publications

This design case examines what program leaders learned from failures in the design of a program of authentic learning about teaching diverse audiences through educational outreach. The program was initiated and then redesigned to develop the teaching and communication skills of graduate students from a wide range of backgrounds by engaging them in authentic experiences with middle school teachers and students. Analysis of post-program data revealed seven design failures related to the lack of upfront analysis to inform the program design. Each design failure was detailed through a fishbone diagram method to identify the corre- sponding contributing factors. The failures …

Pursuing Professional Learning By Using Social Media: How Do Instructional Designers Apply Self-Regulated Learning?, Pauline Salim Muljana, Tian Luo

STEMPS Faculty Publications

The instructional design and technology field are dynamic, requiring instructional designers to stay abreast through timely professional learning. Social media offers characteristics to collapse the time, geographical, and financial limitations of informal professional learning, but challenges exist. Continuous professional learning requires proactive actions, wherein self-regulated learning (SRL) plays an important role. How-ever, not all professionals know the effective strategies to promote SRL skills. This study examines instructional designers' (N = 17) experiences of professional learning on social media through an SRL lens. Data collected through semi-structured inter-views were analyzed using thematic analysis. Findings include SRL strategies con-ducted by instructional designers …

Instructional Design Learners Make Sense Of Theory: A Collaborative Autoethnography, Holly Fiock, Sally Meech, Mohan Yang, Yishi Long, Tadd Farmer, Nathan Hilliard, Adrie A. Koehler, Zui Cheng

STEMPS Faculty Publications

Understanding theory is essential to instructional design (ID) research and practice; however, novice designers struggle to make sense of instructional design theory due to its abstract and complex nature, the inconsistent use of theoretical terms and concepts within literature, and the dissociation of theory from practice. While these challenges are generally understood, little is known about the sensemaking process of learners as they encounter these challenges in pursuit of deeper theoretical understanding. Using a collaborative autoethnographic approach, six ID learners investigated their sensemaking experience within an advanced ID theory course. Autoethnography, a form of qualitative research, focuses on self-reflection “to …

Past Precedent Reconciling Established Multimedia Principles In 3d Virtual Learning Environments, Kristin Herman, Jim S. Shifflett, Courtney W. Schoolmaster, Charles Thull, Noah Glaser

STEMPS Faculty Publications

This design case documents the inception, development, and installation of a virtual exhibit on ethical use of learning analytics (LA) for the Museum of Instructional Design (MID), hosted in Mozilla Hubs. Tension emerged as the design team attempted to negotiate established principles of multimedia design theory (see Mayer, 2014; Mayer & Fiorella, 2021; Richardson, 2014) within an emerging learning environment. A rapid prototyping model, combined with elements of critical museology and dialectics, allowed for ongoing formative evaluation of design fidelity. Exhibit artifacts consisted of scenarios illustrating the ethical ambiguities of LA; a data justice timeline pairing recent peer-reviewed articles on …

Free Asynchronous Professional Development By, From, And For Instructional Designers: How Informal Learning Opportunities Shape Our Professional Learning And Design Practices, Pauline S. Muljana, Kristen Austion, Kayla Jutzi, Lora B. Pezzell, Malgorzata (Gosia) Pytel

STEMPS Faculty Publications

Instructional designers (IDs) need to maintain an understanding of the current trends and issues within the field. Pursuing professional learning informally supports IDs’ effort to keep up with current trends and issues because it is not restricted by curriculum and time. Professional development (PD) offered by Professional Development for Instructional Designers (PD4IDs) learning group can address issues related to geographical and funding limitations. This application paper presents the coordination of PD based on the conceptual framework (e.g., Community of Practice and Social Network Knowledge Construction) and reflections of several PD4IDs members with various roles. The reflections indicate the benefits of …

Lights, Camera, Activity! A Systematic Review Of Research On Learner-Generated Videos, Bridgette Shade Epps, Tian Luo, Pauline S. Muljana

STEMPS Faculty Publications

Aim/Purpose

The current literature discusses the use and benefits of learner-generated videos (LGVs). However, it rarely addresses any correlation between the types of subjects that are best suited for using these videos or what techniques should accompany the use of LGVs.

Background

This systematic review synthesizes current literature to identify patterns and implications that develop from the use of LGVs so that their future use can be both consistent and effective. This paper also reviews the studies to establish the most consistent educational benefits that emerge from this activity.

Methodology

Employing the Preferred-Reporting of Items for Systematic Reviews and Meta-Analyses …

When Failure Is An Option: A Scoping Review Of Failure States In Game-Based Learning, F. Eamonn Powers, Robert L. Moore

STEMPS Faculty Publications

As interest in the use of games and gaming elements within learning environments grows, educators and designers may find it easier to account for winning than for losing and failure. This scoping review examines the role of failure and loss within game-based instructional interventions. Because of the varied methods and relatively small number of articles directly addressing the intersection between failure and loss within game-based instructional interventions, a scoping review was undertaken. This review included 14 peer-reviewed articles which explored a range of instructional contexts implementing failure state game mechanics. We identify several key takeaways that indicate how failure state …

Design Matters: Development And Validation Of The Online Course Design Elements (Ocde) Instrument, Florence Martin, Doris U. Bolliger, Claudia Flowers

STEMPS Faculty Publications

Course design is critical to online student engagement and retention. This study focused on the development and validation of an online course design elements (OCDE) instrument with 38 Likert-type scale items in five subscales: (a) overview, (b) content presentation, (c) interaction and communication, (d) assessment and evaluation, and (e) learner support. The validation process included implementation with 222 online instructors and instructional designers in higher education. Three models were evaluated which included a one-factor model, five-factor model, and higher-order model. The five-factor and higher-order models aligned with the development of the OCDE. The frequency of use of OCDE items was …

Exploring Faculty Perceptions Of Professional Development Support For Transitioning To Emergency Remote Teaching, Ana Redstone, Tian Luo

STEMPS Faculty Publications

Professional development (PD) for instructors at higher education institutions offering online courses is important for assuring the quality of online programs. However, PD opportunities for faculty members have often been piecemeal and inadequate. In light of the COVID-19 pandemic that forced instructors around the world to teach online, PD has become even more critical to the success of the instructors, students, and institutions themselves. This paper describes research conducted at a large university in the United States that used a survey developed to operationalize Baran and Correia’s (2014) holistic Professional Development Framework for Online Teaching (PDFOT). The survey identified strengths …

Exploring Student Perceptions Of Flipgrid In Online Courses, Patrick R. Lowenthal, Robert L. Moore

STEMPS Faculty Publications

Asynchronous video-based discussions have affordances that can address some of the constraints of asynchronous text-based discussions. However, little research has been conducted on the use of asynchronous video-based discussions in online courses. As a result, the purpose of this exploratory study was to investigate students’ perceptions of using Flipgrid for asynchronous video-based discussions in fully online courses. We used a cross-sectional survey design to survey 79 students who used Flipgrid in a fully online course. Students overall reported that they liked using Flipgrid, it was easy to use, and that it helped improve social presence. In this paper, we will …

Chopped Id: Students Engaged In Gamification To Enhance Advanced Instructional Design Techniques, John Baaki, Tian Luo

STEMPS Faculty Publications

The Food Network's television show Chopped pits chefs against each other, in a three-round battle, to create their best appetizer, entrée, and dessert. Facing master chef judges, the chef participants present their dishes with one chef chopped (eliminated) after each round. The last chef standing is crowned the Chopped Champion. A faculty member in an instructional design and technology program, created Chopped ID, an innovative adaptation and gamification of the Food Network's Chopped for application in a distance learning environment. Participating as competitors and judges, graduate students, firsthand, experienced gamification as an advanced instructional design technique. In the end, Chopped …

Editor’S Welcome, Abbie Brown, Jill Stefaniak

STEMPS Faculty Publications

Welcome to this special edition of the Journal of Computing in Higher Education. (First paragraph) The articles in this issue focus on the instructional design process and the preparation of instructional designers. Instructional design is traditionally closely aligned with instructional technology; so much so that many refer to the discipline as instructional design/technology. We are honored to serve as guest editors for this special issue of JCHE and hope the articles that comprise this issue help articulate critically important aspects of the instructional design process as well as issues associated with the education of instructional designers.

Examining Collaborative Knowledge Construction In Microblogging-Based Learning Environments, Tian Luo, Lacey Clifton

STEMPS Faculty Publications

Aim/Purpose: The purpose of the study is to provide foundational research to exemplify how knowledge construction takes place in microblogging-based learning environments, to understand learner interaction representing the knowledge construction process, and to analyze learner perception, thereby suggesting a model of delivery for microblogging.

Background: Up-and-coming digital native learners crave the real-time, multimedia, global-interconnectedness of microblogging, yet there has been limited research that specifically proposes a working model of Twitter's classroom integration for designers and practitioners without bundling it in with other social media tools.

Methodology: This semester-long study utilized a case-study research design via a multi-dimensional approach in a …

Enabling Microblogging-Based Peer Feedback In Face-To-Face Classrooms, Tian Luo

STEMPS Faculty Publications

The purpose of this paper is to understand student interaction and learning in microblogging-based peer feedback sessions. The researcher examined through a case study how students interacted and provided peer feedback for each other when Twitter was enabled as a backchannel; students were also asked to report how they perceived their experience. The findings suggested that students participated actively in the microblogging-based peer feedback sessions. Although Twitter supported cognitive and corrective feedback, affective feedback was dominant. Student interaction on Twitter tended to be brief and involve low-level cognitive thinking in unguided, naturalistic learning contexts. Overall, students had a positive attitude …

Supporting Documentation Of Informal Learning And Making From A Distance With Voicethread, Kevin Oliver, Robert L. Moore

STEMPS Faculty Publications

This best practices session and paper describes the incorporation of Voicethread as a tool for supporting design documentation of makerspace projects among graduate distance education students in a course on informal learning. All students successfully utilized the tool to present photographic and video evidence of design processes with oral annotations, and received clarifications and feedback from peers. Students reported positive affordances of the tool in terms of marking up slides to communicate particular design decisions, sharing video as "proof" of successfully completing a particular make project and as exemplars of makers’ problem solving and thinking, documenting a linear process with …

Use Of Mobile Phones For Interaction In Distance Education, Tayyaba Batool, Ginger Watson, Saul Carliner (Ed.), Catherine Fulford (Ed.), Nathaniel Ostashewski (Ed.)

STEMPS Faculty Publications

Distance education is a widely adopted technology in many developed parts of the world where educational agencies are constantly considering new technologies that can serve as a medium for instructional delivery and interaction. Mobile phones are one of the most recent technologies to gain much consideration and use. This brief paper outlines the current state of distance education, delivery mediums, and instructional approaches that foster interaction to promote effective learning. Particular emphasis is given to the potential for mobile devices to be used as effective instructional tools in distance education in Pakistan and other underdeveloped countries. The proposed study will …

Instructional Guidance In Microblogging-Supported Learning: Insights From A Multiple Case Study, Tian Luo

STEMPS Faculty Publications

Microblogging tools such as Twitter show potential to enrich classroom experience and benefit student learning. Research shows that instructional guidance is particularly necessary in computer-assisted learning environments, but no research has been done to study the effects of instructional guidance in microblogging-based learning. Using a multiple-case study design, the researcher examined student learning in terms of the amount of participation, ability to focus on task, and depth of thinking in guided, semi-guided, and unguided modes. The findings suggest that in guided environments, students achieved higher levels of learning, especially with respect to focusing on task and depth of thinking. Variations …

Tweeting And Blogging: Moving Towards Education 2.0, Tian Luo, Teresa Franklin

STEMPS Faculty Publications

This paper reports on an exploratory study that employed Twitter and blogs as instructional Web 2.0 tools to support student learning in an undergraduate-level class. Case study methodology entailing a usage survey, an exit survey, and 12 in-depth semi-structured interviews was sought to examine patterns and characteristics of students' usage of social media and to elicit their perceptions on how the incorporation of Twitter and blogs facilitated their learning. Findings demonstrate that as advanced users of social media, the students highly embraced the incorporation of Twitter and blogs in the class. Not only were the students motivated to utilize social …

Documenting Current Instructional Design Practices: Towards A Typology Of Instructional Designer Activities, Roles, And Collaboration, William Sugar, Robert L. Moore

STEMPS Faculty Publications

The overall goal of this study was to conduct a yearlong inquiry into an instructional designer’s activities and interactions with his clients. Exclusive focus of this study was on an instructional designer who worked at a large public university in the southeastern region of the United States. Documented in an instructional design activities log, this study analyzed 115 distinct activities. Using an emergent theme analysis approach, specific instructional design activities and roles emerged. In addition, the instructional designer’s collaboration with his clients was analyzed. Results of this study augment the knowledge base of existing studies of instructional design practices.

Analyzing Commercial Video Game Instruction Through The Lens Of Instructional Design, Susan E. Copp, Rebecca L. Fischer, Tian Luo, David R. Moore, Seann Dikkers

STEMPS Faculty Publications

This paper will examine how Gagne’s Nine Events of Instruction (1992) may appear, perhaps inadvertently, within commercial games that guide the user from novice to expert player. By employing a qualitative artifact analysis methodology, we examine a popular action adventure video game to determine if game designers encourage players to build game expertise by employing similar events to Gagne’s instructional design model. We demonstrate that our artifact of analysis does consistently employ Gagne’s events, though often in a manner unique to a digitally mediated space. We conclude that an experiential game setting has the potential to be a platform for …

Working Together: The Public Records Webinar Series, Robert L. Moore

STEMPS Faculty Publications

Key Takeways:

* Faculty and instructional designers working together can create more effective online courses that leverage technology efficiently to reach the target audience.

* The instructional support team was part of the initial conversations planning the webinar series at the UNC School of Government, which led to the formulation of a webinar theme that reflected the content as opposed to imposing a design theme afterwards.

* Advanced planning and coordination among faculty and staff, and the thematic marketing plan provided at the outset, enabled the production of a uniform package of information in a high-quality format.

Examining Student Participation In Three Learning Activities Supported By Social Annotation Tools, Tian Luo, Fei Gao, Kathryn S. Hoff

STEMPS Faculty Publications

Social annotation (SA) allows learners to highlight and comment on Web pages and share annotations with each other online. Despite its potential in promoting collaborative learning, examining how to integrate it into educational settings has not been fully studied. The purpose of the study is to examine student participation in three different SA-based online activities: (1) peer review, (2) annotated discussion, and (3) collaborative reading. Students participated in all three SA-based activities and took a survey at the end reporting the effectiveness of these activities. The analysis of students' annotations and their survey responses suggested that although participants perceived the …

Design, Development And Evaluation Of An Interactive Virtual Haptics-Augmented Training System For Undergraduate Engineering, Robert L. Williams Ii, Ernur Karadogan, David R. Moore, Tian Luo

STEMPS Faculty Publications

No abstract provided.

Examining Student Participation In Three Learning Activities Supported By Social Annotation Tools, Tian Luo, Fei Gao, Kathryn S. Hoff

STEMPS Faculty Publications

Social annotation (SA) allows learners to highlight and comment on Web pages and share annotations with each other online. Despite its potential in promoting collaborative learning, examining how to integrate it into educational settings has not been fully studied. The purpose of the study is to examine student participation in three different SA-based online activities: (1) peer review, (2) annotated discussion, and (3) collaborative reading. Students participated in all three SA-based activities and took a survey at the end reporting the effectiveness of these activities. The analysis of students’ annotations and their survey responses suggested that although participants perceived the …

Web 2.0 For Language Learning: Benefits And Challenges For Educators, Tian Luo

STEMPS Faculty Publications

This literature review study explores 44 empirical research studies that report on the integration of Web 2.0 tools into language learning and evaluate the actual impact of using those Web 2.0 tools in language learning. In particular, this review aims to identify the specific Web 2.0 tools integrated in the educational settings, theoretical underpinnings that are commonly used to frame the research, methodologies and data analysis techniques that scholars employ to analyze their research data, the benefits and challenges scholars spotted in their research findings, the pedagogical implications in using Web 2.0 for language learning and future research directions that …

Effective Knowledge Development In Game-Based Learning Environments: Considering Research In Cognitive Processes And Simulation Design, Amy B. Adcock, Ginger S. Watson, Gary R. Morrison, Lee A. Belfore

STEMPS Faculty Publications

Serious games are, at their core, exploratory learning environments designed around the pedagogy and constraints associated with specific knowledge domains. This focus on instructional content is what separates games designed for entertainment from games designed to educate. As instructional designers and educators, the authors want serious game play to provide learners with a deep understanding of the domain, allowing them to use their knowledge in practice to think through multifaceted problems quickly and efficiently. Attention to the design of serious game affordances is essential to facilitating the development of domain knowledge during game play. As such, the authors contend that …