Educational Assessment, Evaluation, and Research Commons^™

Identifying Support Structures Associated With Informal Formative Evaluation In Instructional Design, Suzanne Smith, Tian Luo

STEMPS Faculty Publications

Instructional designers perform informal formative evaluation in design practice. An evaluation may be used to locate errors in alignment of instructional objectives or to increase the quality or effectiveness of a design. An instructional design review is similar to peer reviews in higher education which are often structured, and tools are provided to contribute to the review. A study was performed to identify the support structures and tools that contribute to building a community of feedback within the practice of instructional design reviews. Six instructional designers and design managers were interviewed to gather the processes they use in design reviews …

Authentic Learning Design Failures: The Need For Learner And Contextual Analysis And Participatory Design, Mohan Yang, Jon Harbor

STEMPS Faculty Publications

This design case examines what program leaders learned from failures in the design of a program of authentic learning about teaching diverse audiences through educational outreach. The program was initiated and then redesigned to develop the teaching and communication skills of graduate students from a wide range of backgrounds by engaging them in authentic experiences with middle school teachers and students. Analysis of post-program data revealed seven design failures related to the lack of upfront analysis to inform the program design. Each design failure was detailed through a fishbone diagram method to identify the corre- sponding contributing factors. The failures …

An Instrumental Case Study Of Confirmative Evaluation In The Continuous Improvement Of Online Remote Leaders’ Work, Chad Lawrence Mclane

STEMPS Theses & Dissertations

Confirmative evaluation is often noted as an important element of models of Human Performance Technology and Performance Improvement, but there exists confusion around what is and what is not confirmative evaluation. A significant issue limiting the use of confirmative evaluation is the Performance Improvement field’s inability to clearly classify confirmative evaluation in terms of its purpose and scope. Additionally, the performance improvement field lacks sufficient examples of confirmative evaluation in the literature necessary to adequately define confirmative evaluation and demonstrate its use. Without sufficient examples of confirmative evaluation, practitioners of performance improvement are left without a clear path of how …

Editor’S Welcome, Abbie Brown, Jill Stefaniak

STEMPS Faculty Publications

Welcome to this special edition of the Journal of Computing in Higher Education. (First paragraph) The articles in this issue focus on the instructional design process and the preparation of instructional designers. Instructional design is traditionally closely aligned with instructional technology; so much so that many refer to the discipline as instructional design/technology. We are honored to serve as guest editors for this special issue of JCHE and hope the articles that comprise this issue help articulate critically important aspects of the instructional design process as well as issues associated with the education of instructional designers.

Examining Collaborative Knowledge Construction In Microblogging-Based Learning Environments, Tian Luo, Lacey Clifton

STEMPS Faculty Publications

Aim/Purpose: The purpose of the study is to provide foundational research to exemplify how knowledge construction takes place in microblogging-based learning environments, to understand learner interaction representing the knowledge construction process, and to analyze learner perception, thereby suggesting a model of delivery for microblogging.

Background: Up-and-coming digital native learners crave the real-time, multimedia, global-interconnectedness of microblogging, yet there has been limited research that specifically proposes a working model of Twitter's classroom integration for designers and practitioners without bundling it in with other social media tools.

Methodology: This semester-long study utilized a case-study research design via a multi-dimensional approach in a …

The Influence Of Multimedia Production Knowledge On The Design Decisions Of The Instructional Designer, Stephen Brent Hoard

STEMPS Theses & Dissertations

This study explored the interaction of multimedia production competencies of expert and novice instructional designers on the design decisions made during the instructional design process / workflow. This multiple measures study used qualitative survey instruments to access and measure the production competencies of participants, then a design aloud protocol to capture and measure the instructional design decision-making process for those same participants. A follow-on interview after the initial design aloud session was conducted in order to triangulate and confirm any trends or findings uncovered during the earlier design aloud session. Ultimately, the objective of this study was to provide some …

Elaboration And Question Strategy Effect On Learning Outcomes And Cognitive Load, Julie Ann Bridges

STEMPS Theses & Dissertations

The purpose of this study was to investigate the effects of instructor-created elaborations, learner-created elaborations and adjunct questions on learning outcomes in an asynchronous learning environment, using pre-recorded video. The study also investigated the effects of instructor-created elaborations, learner-created elaborations, or adjunct questions on perceived cognitive load. The effect of learning strategy on quality of elaboration was also investigated. Results showed no significant difference in learning outcomes or cognitive load or quality of elaboration, but a post-hoc analysis revealed a significant difference in intrinsic cognitive load for students who used generative strategies while having no gain in learning outcomes.

Examining Student Participation In Three Learning Activities Supported By Social Annotation Tools, Tian Luo, Fei Gao, Kathryn S. Hoff

STEMPS Faculty Publications

Social annotation (SA) allows learners to highlight and comment on Web pages and share annotations with each other online. Despite its potential in promoting collaborative learning, examining how to integrate it into educational settings has not been fully studied. The purpose of the study is to examine student participation in three different SA-based online activities: (1) peer review, (2) annotated discussion, and (3) collaborative reading. Students participated in all three SA-based activities and took a survey at the end reporting the effectiveness of these activities. The analysis of students' annotations and their survey responses suggested that although participants perceived the …

Prompting Self-Monitoring Of Learning In Self-Paced Computer Based Training: The Effect On Self-Regulation And Learning, Christopher J. Coburn

STEMPS Theses & Dissertations

The purpose of this dissertation was to investigate the effects of prompting students to monitor their use of learning strategies and comprehension while completing self-paced, work-related training in a computer-based learning environment. Study participants included 94 enlisted military volunteers, randomly assigned to one of three groups in the spring of 2012. Changes in strategy use and comprehension were evaluated within and between groups receiving either immediate, delayed or no prompts using multiple methods of measurement, both during and after training. Prompts asked participants to rate their level of agreement to statements regarding their strategy use and comprehension of lesson content. …