Education Commons^™

Identifying Support Structures Associated With Informal Formative Evaluation In Instructional Design, Suzanne Smith, Tian Luo

STEMPS Faculty Publications

Instructional designers perform informal formative evaluation in design practice. An evaluation may be used to locate errors in alignment of instructional objectives or to increase the quality or effectiveness of a design. An instructional design review is similar to peer reviews in higher education which are often structured, and tools are provided to contribute to the review. A study was performed to identify the support structures and tools that contribute to building a community of feedback within the practice of instructional design reviews. Six instructional designers and design managers were interviewed to gather the processes they use in design reviews …

Authentic Learning Design Failures: The Need For Learner And Contextual Analysis And Participatory Design, Mohan Yang, Jon Harbor

STEMPS Faculty Publications

This design case examines what program leaders learned from failures in the design of a program of authentic learning about teaching diverse audiences through educational outreach. The program was initiated and then redesigned to develop the teaching and communication skills of graduate students from a wide range of backgrounds by engaging them in authentic experiences with middle school teachers and students. Analysis of post-program data revealed seven design failures related to the lack of upfront analysis to inform the program design. Each design failure was detailed through a fishbone diagram method to identify the corre- sponding contributing factors. The failures …

Conducting A Formative Evaluation On A Course-Level Learning Analytics Implementation Through The Lens Of Self-Regulated Learning And Higher-Order Thinking, Pauline S. Muljana, Tian Luo, Greg Placencia

STEMPS Faculty Publications

Self-regulated learning (SRL) and higher-order thinking skills (HOTS) are associated with academic achievement, but fostering these skills is not easy. Scholars have suggested an alternative way to scaffold these important skills through learning analytics (LA). This paper presents a formative evaluation of a course-level LA implementation through the lens of self-regulated learning (SRL) and higher-order thinking skills (HOTS). We explored the changes in students’ SRL, HOTS, and perceptions at the end of the course term. Results indicate an increase in some elements of SRL and HOTS, and positive student perceptions. Discussion on implications and opportunities for informing future teaching strategies …

Review Of: Estrellado, R. A., Freer, E. A., Motsipak, J., Rosenberg, J. M., & Velásquez, I. C. (2021). Data Science In Education Using R. London, England: Routledge, Esther Michela, Robert L. Moore

STEMPS Faculty Publications

Data use in education is continually expanding in scope (Romero and Ventura 2020), and though programming resources are plentiful, those that truly scaffold the learning process are scarce. Data Science in Education Using R by Estrellado, Freer, Motsipak, Rosenberg, and Velásquez is a combination primer and workbook. This format allows the volume to serve as both an introductory R resource aimed to help readers overcome the daunting initial roadblocks to proficiency and familiarize them with educational data uses. We reviewed this book from the perspective of a beginning R user with little other programming background for whom this book is …

Assessing An Academic Readiness Model In A Community College Occupational Program, Scott A. Hauert, Robert L. Moore, Quinton Nottingham

STEMPS Faculty Publications

This study assessed a localized academic readiness model that measures academic skills relevant to an occupational program and the institutional context. Enrollment in the program’s mandatory gateway course is contingent upon establishing academic readiness either: (1) possess an associate-level or higher degree; (2) achieve placement test scores that permit enrollment in college-level English composition/critical reading; or (3) complete developmental education prerequisites to permit enrollment in college-level English composition/critical reading. Using the gateway course performance for 112 students, the study explored whether any of the model’s criterions are significantly related to success in the gateway course and whether there is any …

Informing Makerspace Outcomes Through A Linguistic Analysis Of Written And Video-Recorded Project Assessments, Kevin M. Oliver, Jennifer K. Houchins, Robert L. Moore, Chuang Wang

STEMPS Faculty Publications

A growing body of research focuses on what outcomes to assess in makerspaces, and appropriate formats for capturing those outcomes (e.g. reflections, surveys, and port-folios). Linguistic analysis as a data mining technique holds promise for revealing different dimensions of learning exhibited by students in makerspaces. In this study, student reflections on makerspace projects were gathered in 2 formats over 2 years: private written assessments captured in the 3D GameLab gamification platform, and semi-public video-recorded assessments posted in the more social FlipGrid platform. Transcripts of student assessments were analyzed using Linguistic Inquiry Word Count (LIWC) to generate 4 summary variables thought …

The Power Of Open: Benefits, Barriers, And Strategies For Integration Of Open Educational Resources, Tian Luo, Kirsten Hostetler, Candice Freeman, Jill Stefaniak

STEMPS Faculty Publications

Open Educational Resources (OER) are becoming a significant, mission-driven trend within educational literature. To help address rising costs, instructors and designers are looking to OER to effectively replace traditional instructional content, which requires more than just identify and replace. Drawing from 51 OER studies conducted in countries across the five continents, this systematic literature review explored the empirical themes evident in the current research on a global scale. This review found (1) discoverability, sustainability, and remixing are significant barriers that stand in the way of OER disrupting traditional textbook models; (2) there is no significant difference in learning outcomes when …

Improving Classroom Management And Teacher Retention: A Needs Assessment, Jill Stefaniak, Jilian L. Reynolds, Tian Luo

STEMPS Faculty Publications

This case explores how a needs assessment was conducted at a middle school experiencing high rates of teacher turnover. Pamela Frost, an experienced instructional designer, was assigned to assess the situation and identify opportunities to improve professional development opportunities for the teachers. As a part of a needs assessment, Pamela gathered data to address needs pertaining to classroom management challenges, teacher attrition rates, and establishing relations with the local community. This case explores how Pamela gathered data and triangulated her findings to determine what interventions were needed.

School Librarians Making Global Connections: Conjecture Mapping And Researcher Practitioner Partnerships, Barbara Schultz-Jones, Marcia Mardis, Sue Kimmel

STEMPS Faculty Publications

Dr. Barbara Schultz-Jones (University of North Texas), Dr Marcia Mardis (Florida State University) and Dr Sue Kimmel (Old Dominion University, Virginia) share their research on a way to support evidence building of causal relationships between the school library and a teacher librarian’s contribution to student outcomes.

Combining Different Motivation And Cognitive Supports In Undergraduate Biology In Different Contexts: Lessons Learned, Avi Kaplan, Jennifer G. Cromley, Tony Perez, Ting Dai, Kyle R. Mara, Michael Balsai

STEMPS Faculty Publications

Researchers acknowledge that students’ learning and achievement requires both effective cognition and the motivation to apply it. In addition, both cognition and motivation are multidimensional, each involving different processes that may be less or more salient in different contexts. However, most basic research and intervention studies focus on either cognition OR motivation, and commonly only target a single process. We designed an intervention to investigate the role of different combinations of cognitive and motivational supports in first-year undergraduate introductory biology courses. We sought an online delivery approach with minimal burden on the instructor that can accompany any such course. Building …

The Preparation And Certification Of School Librarians: Using Causal Educational Research About Teacher Characteristics To Probe Facets Of Effectiveness, Sue C. Kimmel, Marcia A. Mardis, Shana Pribesh, Laura A. Pasquini, Barbara Schultz-Jones, Faye R. Jones, Lois D. Wine, Lenese M. Colson

STEMPS Faculty Publications

How do we define a high-quality school librarian? Decades of educational researchers have attempted to link teacher characteristics—such as how teachers are prepared, which credentials they carry, and years of experience—to student outcomes. These researchers have contended that individual educator attributes may have a direct effect on what and how much their students learn. School librarians are also teachers who have direct student contact, and although numerous studies have indicated that school librarian preparation, licensure, and other background characteristics are promising areas for further direct exploration, researchers have yet to examine if, how, and why school librarians’ certification or preparation …

Factors Contributing To Student Retention In Online Learning And Recommended Strategies For Improvement: A Systematic Literature Review, Pauline S. Muljana, Tian Luo

STEMPS Faculty Publications

Aim/Purpose

This systematic literature review investigates the underlying factors that influence the gap between the popularity of online learning and its completion rate. The review scope within this paper includes an observation of possible causal aspects within the non-ideal completion rates in online learning environments and an identification of recommended strategies to increase retention rates.

Background

While online learning is increasingly popular, and the number of online students is steadily growing, student retention rates are significantly lower than those in the traditional environment. Despite the multitude of studies, many institutions are still searching for solutions for this matter.

Methodology

A …

Setting The Pace: Examining Cognitive Processing In Mooc Discussion Forums With Automatic Text Analysis, Robert L. Moore, Kevin M. Oliver, Chuang Wang

STEMPS Faculty Publications

Learning analytics focuses on extracting meaning from large amounts of data. One of the largest datasets in education comes from Massive Open Online Courses (MOOCs) that typically feature enrollments in the tens of thousands. Analyzing MOOC discussion forums presents logistical issues, resulting chiefly from the size of the dataset, which can create challenges for understanding and adequately describing student behaviors. Utilizing automatic text analysis, this study built a hierarchical linear model that examines the influence of the pacing condition of a massive open online course (MOOC), whether it is self-paced or instructor-paced, on the demonstration of cognitive processing in a …

Implementing The U.S. School Library Standards: Data And Dialogue From The Field, Elizabeth Ann Burns

STEMPS Faculty Publications

In this exploratory study, a survey was conducted to learn about school librarian perceptions on the implementation and practice using the US National School Library Standards (NSLS) for Learners, School Librarians, and School Libraries published by the American Association of School Librarians (AASL), a division of the American Library Association (ALA). Participants in the state of Virginia in the United States, reported on their experiences after attending training on the new NSLS and they began their personal plan of implementation. This report documents preliminary findings indicating participants found implementation training largely introductory. After one year many remain at the awareness …

Evidence, Standards, And School Librarianship: Prevailing Policies, Promising Methods, And Progress On A Research Agenda, Barbara Schultz-Jones, Sue C. Kimmel, Marcia A. Mardis, Faye R. Jones, Shana Pribesh, Laura Pasquini

STEMPS Faculty Publications

Guided by the question, "What are the implications of national educational evidence standards for school librarianship research?," prevailing U.S. evidence-driven educational policies are examined to identify implications for school librarianship research; promising methods to contribute to building this evidence base are explored; and finally, progress on a long-term research agenda designed to enable school librarianship researchers to contribute evidence to educational policy is reviewed. As promising methods are explored, an actionable agenda is proposed that school library researchers can undertake to participate in a causal research environment.

A Comparative Analysis Of Holographic, 3d-Printed, And Computer-Generated Models: Implications For Engineering Technology Students' Spatial Visualization Ability, Petros J. Katsioloudis, Mildred V. Jones

STEMPS Faculty Publications

A number of studies indicate that the use of holographic displays can influence spatial visualization ability; however, research provides inconsistent results. Considering this, a quasi-experimental study was conducted to identify the existence of statistically significant effects on sectional view drawing ability due to the impacts of holographic displays. In particular, the study compared the use of three different types of displays: 3D printed model, computer generated model, and holographic model to determine whether a significant difference exists towards sectional view drawing ability, among engineering technology students. According to the results of this study, it is suggested that the impact of …

Editor’S Welcome, Abbie Brown, Jill Stefaniak

STEMPS Faculty Publications

Welcome to this special edition of the Journal of Computing in Higher Education. (First paragraph) The articles in this issue focus on the instructional design process and the preparation of instructional designers. Instructional design is traditionally closely aligned with instructional technology; so much so that many refer to the discipline as instructional design/technology. We are honored to serve as guest editors for this special issue of JCHE and hope the articles that comprise this issue help articulate critically important aspects of the instructional design process as well as issues associated with the education of instructional designers.

Delving Into The Specificity Of Instructional Guidance In Social Media-Supported Learning Environments, Tian Luo

STEMPS Faculty Publications

Aim/Purpose: This study investigates the variations in student participation patterns across different types of instructional activities, learning modes, and with different instructional guidance approaches. In the current study, different variables, modes of learning (guided versus unguided), and types of guidance (social versus cognitive) were manipulated in a series of microblogging-supported collaborative learning tasks to examine to what extent and in which aspects instructional guidance affects the effectiveness and student perception of microblogging-supported learning.

Background: Despite the overwhelming agreement on the importance of instructional guidance in microblogging-supported learning environments, very few studies have been done to examine the specificity of guidance, …

The Researchers' Perspective: For And By The Community: Processes And Practices From The Development Of National School Library Standards, Elizabeth A. Burns, Marcia A. Mardis

STEMPS Faculty Publications

In this study, we describe the innovative and rigorous phased process used to compose the American Association of School Librarians (AASL) National School Library Standards (AASL, 2018). We begin by recounting previous standards iterations and compared their development processes to the most recent process used during the development of the AASL Standards. After we detail the development timeline and process phases, we conclude with implications for best practices in standards development for school librarians, professional leaders, and practitioners.

Aligning Information Literacy Assessment With Metacognitive Strategies, Kirsten Hostetler, Tian Luo, Jill E. Stefaniak

STEMPS Faculty Publications

Despite the popularity of metacognitive research, and the inclusion of similar concepts in professional guidelines, librarians have not incorporated metacognitive tools into their assessment strategies. This systematic literature review found (1) metacognitive assessments can act as a learning aide in encouraging higher-order thinking; (2) metacognitive assessments can be effective measurements under proper conditions with experienced learners; and (3) librarians have limited options when selecting assessment tools even as the demand for demonstrating the library’s value to stakeholders is increasing. The paper concludes with gaps in the literature and areas for future directions.

Building Of Causality: A Future For School Librarianship Research And Practice, Marcia A. Mardis, Sue C. Kimmel, Laura A. Pasquini

STEMPS Faculty Publications

The article discusses the future trends in school librarianship and its impact on professional practice. Topics discussed include the research study conducted by Colorado Study and funded by the American Association of School Librarians, along with how to respond to the changes technology has brought in engaging learners.

School Librarian As Inquisitor Of Practice: Reimagine, Reflect, And React With The New Standards, Elizabeth Burns

STEMPS Faculty Publications

The article focuses on the National School Library Standards offering entry points for school librarians wanting to execute reflection in their regular practice. Topics discussed include modeling self-reflection for learners, impact practice for student improvement and monitoring the professional growth.

Effectiveness Of Drafting Models For Engineering Technology Students And Impacts On Spatial Visualization Ability: An Analysis And Consideration Of Critical Variables, Petros J. Katsioloudis, Jill E. Stefaniak

STEMPS Faculty Publications

Results from a number of studies indicate that the use of drafting models can positively influence the spatial visualization ability for engineering technology students. However, additional variables such as light, temperature, motion and color can play an important role but research provides inconsistent results. Considering this, a set of 5 quasi-experimental studies, was conducted to identify additional critical variables. According to the results, a dynamic, 3Dprinted drafting model, presented with a blue background under lighting conditions between 500–750 lux had the highest impact on spatial visualization ability of engineering technology students.

A Platform For Voice And Identity: School Library Standards In Support Of Ya Urban Literature's Transformative Impacts On Youth, Sabrina Carnesi

STEMPS Faculty Publications

In this qualitative study of collaboration between an eighth grade English teacher and school librarian, 14 urban youth from a suburban city in the mid-Atlantic region of the United States were interviewed on the impact they experienced from a yearlong study with young adult literature reflective of their lived experiences. Steeped in the language of social justice and inclusive of the American Association of School Librarians’ Standards for the 21st Century Learner (2009) and International Federation of LibraryAssociations’ School Library Guidelines (2015), an analysis of findings bring attention to the impact highly effective partnerships have on implementing literature discussion circles …

Examining Collaborative Knowledge Construction In Microblogging-Based Learning Environments, Tian Luo, Lacey Clifton

STEMPS Faculty Publications

Aim/Purpose: The purpose of the study is to provide foundational research to exemplify how knowledge construction takes place in microblogging-based learning environments, to understand learner interaction representing the knowledge construction process, and to analyze learner perception, thereby suggesting a model of delivery for microblogging.

Background: Up-and-coming digital native learners crave the real-time, multimedia, global-interconnectedness of microblogging, yet there has been limited research that specifically proposes a working model of Twitter's classroom integration for designers and practitioners without bundling it in with other social media tools.

Methodology: This semester-long study utilized a case-study research design via a multi-dimensional approach in a …

Developing Distance Education Content Using The Tappa Process, Robert L. Moore

STEMPS Faculty Publications

The proliferation of distance education has occurred alongside the emerging technologies of the Web 2.0 and Web 3.0 environments, changing the way instructors approach, design, and deliver their instructional materials. In the past, instructional design (ID) practitioners relied on instruction system design (ISD) models that focused primarily on macroinstruction. It is now important for these practitioners to use microinstruction strategies to keep pace with the technology evolution. This case study describes the TAPPA (Target, Accomplishment, Past, Prototype, Artifact) Process which was created using the Generic Model for Design Research (GMDR) proposed by McKenney and Reeves (2012) and uses selected ID …

Articulating An Impact On Student Learning, Elizabeth Burns

STEMPS Faculty Publications

(First Paragraph) The Every Student Succeeds Act (ESSA), passed in December 2015, positions school librarians as Essential Personnel and provides potential dedicated funding to effective school libraries–IF we make them understand why school librarians matter. ESSA falls short, however, of identifying what characterizes an effective school library program. This significant language allows school librarians to voice how their programs make an impact in their schools. As local decision makers (Local Education Agencies or LEAs in the actual law) and educational communities develop tools and evaluations to determine a school library’s effectiveness, there will be a greater need for each of …

Spatial Visualization Ability And Impact Of Drafting Models: A Quasi Experimental Study, Petros J. Katsioloudis, Vukica Jovanovic

STEMPS Faculty Publications

A quasi experimental study was done to determine significant positive effects among three different types of visual models and to identify whether any individual type or combination contributed towards a positive increase of spatial visualization ability for students in engineering technology courses. In particular, the study compared the use of different visual models - a 3D printed solid object, a 3D computer generated drawing and a 2D drawing.

Does The Sequence Of Instruction Matter During Simulation?, Jill E. Stefaniak, Carman L. Turkelson

STEMPS Faculty Publications

Introduction: Instructional strategies must be balanced when subjecting students to full-immersion simulation so as not to discourage learning and increase cognitive overload. The purpose of this study was to determine if participating in a simulation exercise before lecture yielded better performance outcomes among novice learners.

Methods: Twenty-nine participants were divided into 2 groups as follows: group 1 participated in simulation exercises followed by a didactic lecture and group 2 participated in the same learning activities presented in the opposite order. Participants were administered a multiple-choice cognitive assessment upon completion of a workshop.

Results: Learners who participated in the simulated exercises …

The Disconnect Between College And Reality, Janice Bell Underwood, Elizabeth Burns

STEMPS Faculty Publications

With formative assessments, teachers can more accurately determine student interests and aptitudes and drive achievement.