Instructional Media Design Commons^™

Cognitive Reappraisal: The Bridge Between Cognitive Load And Emotion, Rebecca Brockbank, David F. Feldon

Instructional Technology and Learning Sciences Faculty Publications

Within this integrative review, cognitive load theory (CLT) is asserted as a powerful framework for conceptualizing human cognitive processes within learning. The relationship between cognition and emotion is then examined and further integrated within the scope of CLT. Emotion regulation strategies are discussed and adaptive strategies are proposed as being of particular relevance to broadening the theoretical and practical impacts of CLT. Central to the argument of this review is the use of cognitive reappraisal as a potential mitigator of cognitive load. Cognitive reappraisal involves reframing or reassessing understandings or beliefs that underlie an emotional response, which may mitigate cognitive …

Accuracy And Effectiveness Of An Orchestration Tool On Instructors' Interventions And Groups' Collaboration, Luettamae Lawrence, Emma Mercier, Taylor Tucker Parks, Nigel Bosch, Luc Paquette

Instructional Technology and Learning Sciences Faculty Publications

This paper presents the development of a novel orchestration tool that predicts collaborative problem-solving (CPS) behaviors of undergraduate engineering groups and investigates the use of that tool by instructors. We explore the impact of receiving real-time, machine-learning, model-based prompts on 1) instructors' orchestration strategies, which are strategies instructors use to manage and facilitate collaborative activities, and 2) groups' participation, including how groups are engaged in CPS activities. The orchestration tool is a dashboard that notifies instructors of–and advises them on–monitoring and intervening with groups who may need collaborative support and guidance. We describe the accuracy of the models in predicting …

Computational Models As Tools For Supporting Responsive Teaching, Hillary Swanson, Luettamae Lawrence, Jared Arnell, Bonni Jones, Bruce Sherin, Uri Wilensky

Instructional Technology and Learning Sciences Faculty Publications

It is widely agreed that science instruction should help students build new knowledge on the foundation of their prior knowledge. Responsive teaching refers to a family of teaching strategies that pursue and build on student ideas. We introduce a particular approach to responsive teaching and examine how it can be supported by the use of computational models. We analyze an 8^th grade science teacher's facilitation of a class discussion near the end of a lesson on sound. We present a moment-by-moment characterization of her responsive teaching moves, highlighting the ways she used a computational model to help students articulate …

Incorporating Design Based Implementation Research With A Randomized Controlled Trial To Develop And Evaluate The Efficacy Of Playful Rational Number Learning, Kreshnik N. Begolli, Vanessa N. Bermudez, Luettamae Lawrence, Lourdes M. Acevedo-Farag, Sabrina V. Valdez, Evelyn Santana, Daniela Alvarez-Vargas, June Ahn, Drew Bailey, Katherine Rhodes, Lindsey E. Richland, Andres S. Bustamante

Instructional Technology and Learning Sciences Faculty Publications

We combine design-based implementation research with a pre-registered RCT to address a long-standing challenge in psychological science: How to use psychological principles to address real-world problems while designing and implementing interventions in the field. We posit this as a design methodology for optimizing the translation between psychological science and real-world applications. We tested the efficacy of an extensively co-designed version of a game-based rational number intervention, Fraction Ball, versus "business-as-usual" math instruction and physical education in a sample of 4th/5th grade Latine students (N=360). Insights from nine co-design sessions with 20 teachers informed revisions and additions to a …

Theory-Based Science Communication At Comic Cons, Lisa Lundgren, Emily Slater, Man Zhang, Kadie Kunz, Gabriel-Philip Santos

Instructional Technology and Learning Sciences Faculty Publications

The majority of research concerning science communication happens in spaces where people already have a vested interest in or knowledge of science, such as museums and science cafes. Thus, there is a gap in understanding what theory-based science communication looks like in non-science-centered spaces. This qualitative research study, which featured cosplaying science communicators at comic conventions, offers insights into what science communication practices occur within everyday spaces. We conducted observations of and semi-structured interviews with 15 cosplaying scientists, examining how they utilized effective framing and narrative structuring when communicating science at comic cons in cosplay. Across 700 coded utterances, cosplaying …

Who Gets To Decolonize: A Reflection On The Importance Of Positionality In The Decolonization Of Digital Learning Spaces And Learning Design, Rebecca Y. Bayeck, Tutaleni Iita Asino

Instructional Technology and Learning Sciences Faculty Publications

Decolonization as a term and concept gained prominence in the 20th century as new nations emerged from the cessation of the global colonial project which primarily saw European countries occupying different parts of the world. In modern times, interests in decolonization have taken different forms, particularly in learning design and digital learning spaces. In the digital space, researchers mainly suggest introducing indigenous perspectives and cultural lenses in the design of digital learning environments and the design of emerging technologies that embed indigenous perspectives (Nede, 2023). This reflexive essay discusses the importance of positionality in digital learning spaces and learning/instructional design. …

Understanding Non-Designers' Practices And Processes In A Human-Centered Design Course, Luettamae Lawrence, Saadeddine Shehab, Mike Tissenbaum

Instructional Technology and Learning Sciences Faculty Publications

Human-centered design (HCD) has been identified in the literature as a useful problem-solving approach for learners. However, learning and applying HCD poses several challenges for students who are unfamiliar with this form of learning. In this paper, we analyse how a novice design team worked on a HCD class project to examine how non-designers learn about and integrate HCD practices into their project. We introduce the HCD taxonomy to define the processes and practices that students engage in. The team’s design work is triangulated across multiple data sources and revealed three challenges for engaging non-designers in HCD: 1) the need …

How Teachers Conceptualise Shared Control With An Ai Co-Orchestration Tool: A Multiyear Teacher-Centred Design Process, Luettamae Lawrence, Vanessa Echeverria, Kexin Yang, Vincent Aleven, Nikol Rummel

Instructional Technology and Learning Sciences Faculty Publications

Artificial intelligence (AI) can enhance teachers' capabilities by sharing control over different parts of learning activities. This is especially true for complex learning activities, such as dynamic learning transitions where students move between individual and collaborative learning in un-planned ways, as the need arises. Yet, few initiatives have emerged considering how shared responsibility between teachers and AI can support learning and how teachers' voices might be included to inform design decisions. The goal of our article is twofold. First, we describe a secondary analysis of our co-design process comprising six design methods to understand how teachers conceptualise sharing control with …

Understanding Computational Thinking In The Gameplay Of The African Songo Board Game, Rebecca Y. Bayeck

Instructional Technology and Learning Sciences Faculty Publications

Computational thinking is a necessary skill for the 21st century. While previously examined in computer-rich settings, researchers are increasingly studying computational thinking in unplugged environments such as board games. Focusing on the African board game Songo, this study shows that computational thinking practices are embedded in Songo board gameplay and interact with the cultural context. The study also reveals a computing practice peculiar to Songo gameplay, songoputation. This paper suggests that researchers can benefit from exploring computational thinking and computing practices beyond board games in western contexts.

How Co-Designing Computational Modeling Activities Helped Teachers Implement Responsive Teaching Strategies, Hillary Swanson, Luettamae Lawrence, Jared Arnell, Allisia Dawkins, Bonni Jones, Bruce Sherin, Uri Wilensky

Instructional Technology and Learning Sciences Faculty Publications

In recent years, science education has shifted focus, from content to practice. This is reflected in the NGSS, which advocate learning science concepts through engagement in science and engineering practices. Theory building is a central activity of science and computational modeling is a key practice through which contemporary scientists construct theory. In this paper, we discuss an 8th grade science teacher's implementation of a computational modeling lesson. The teacher had co-designed the computational modeling microworld and lesson with the research team over the preceding summers. We investigate the teacher's activity during a whole-class discussion near the end of the lesson, …

Supporting And Sustaining Equitable Steam Activities In High School Classrooms: Understanding Computer Science Teachers’ Needs And Practices When Implementing An E-Textiles Curriculum To Forge Connections Across Communities, Deborah A. Fields, Yasmin B. Kafai

Instructional Technology and Learning Sciences Faculty Publications

While the last two decades have seen an increased interest in STEAM (science, technology, engineering, arts, and mathematics) in K-12 schools, few efforts have focused on the teachers and teaching practices necessary to support these interventions. Even fewer have considered the important work that teachers carry out not just inside classrooms but beyond the classroom walls to sustain such STEAM implementation efforts, from interacting with administrators to recruiting students and persuading parents about the importance of arts and computer science. In order to understand teachers’ needs and practices regarding STEAM implementation, in this paper, we focus on eight experienced computer …

Is Microethnography An Ethnographic Case Study? And/Or A Mini-Ethnographic Case Study? An Analysis Of The Literature, Rebecca Y. Bayeck

Instructional Technology and Learning Sciences Faculty Publications

Selecting the research approach that addresses the research question is often challenging for novice researchers. However, getting a better understanding of the research approaches available in the field, is likely to help novice researchers identify and choose the research approach that fits their situation. In this paper, we discuss microethnography, ethnographic case study, and mini-ethnography case study in order to show that these approaches may have similarities but are different. The author hopes that this discussion will help researchers get a better understanding of these approaches and dissipate the confusion that may exist.

The Predictive Validity Of The Gre Across Graduate Outcomes: A Meta-Analysis Of Trends Over Time, David F. Feldon, Kaylee Litson, Brinleigh Cahoon, Zhang Feng, Andrew Walker, Colby Tofel-Grehl

Instructional Technology and Learning Sciences Faculty Publications

This meta-analysis assesses the predictive validity of the Graduate Record Examination (GRE) across outcome variables, including grade point average, for graduate students. In addition to aggregate effects, this paper also assessed changes in observed effects over time as related to increasing diversity in the graduate student population and as a function of gender and racial/ethnic composition of study samples. Framed using a lens of critical whiteness, this analysis examined n = 1,744 individual effects across k = 208 studies. Overall, 61.6% of reported effects were nonsignificant (i.e. no predictive value of GRE scores on student outcomes). Further, the magnitude of …

Designing Hybrid Human-Ai Orchestration Tools For Individual And Collaborative Activities: A Technology Probe Study, Vanessa Echeverria, Kexin Yang, Luettamae Lawrence, Nikol Rummel, Vincent Aleven

Instructional Technology and Learning Sciences Faculty Publications

Combining individual and collaborative learning is common, but dynamic combinations (which happen as-the-need arises, rather than in pre-planned ways, and may happen on an individual basis) are rare. This work reports findings from a technology probe study exploring alternative designs for classroom co-orchestration support for dynamically transitioning between individual and collaborative learning. The study involved 1) a technology-probe classroom study in an authentic, AI-supported classroom to understand teachers' and students' needs for co-orchestration support over dynamic transitions; and 2) workshops and interviews with students and teachers to get informed feedback about their lived experiences. 118 students and three teachers from …

"The Village That Learns": A Learning Journey Across Intraventions And Domains Over Two Decades In A Rural Thai Community, Deborah A. Fields, Luis Morales-Navarro, Paulo Blikstein

Instructional Technology and Learning Sciences Faculty Publications

What does it mean to become a village that learns? In this paper we document the transformative learning journey of a small Thai village over 24 years, becoming a community that identified, tackled, and iterated on problems, altering their everyday practices and lives. In that process the village shifted from a subsistence agricultural community staggeringly in debt to one known for its sustainable environmental, agricultural, and financial initiatives. To understand the village’s learning journey, we consider the village itself as the primary unit of analysis, applying an iterative case study approach, with chronological sequencing, thematic, and biographical narrative analysis …

Positionality: The Interplay Of Space, Context And Identity, Rebecca Y. Bayeck

Instructional Technology and Learning Sciences Faculty Publications

This article considers the way in which positionality shifts and is formed during a cross-cultural study to reveal the complexity of the insider-outsider status. As a researcher in a male-dominated game setting, I reflect on the research process and my interactions with participants to show the interplay of space, context, and identity in shaping a researcher’s status. I discuss the process of gaining access to the research site and participants, and data collection in relation to space, context, and identity. The interaction of my identities with space, and context informed my status at various moments. This interplay constructs a complex …

The Intersection Of Cultural Context And Research Encounter: Focus On Interviewing In Qualitative Research, Rebecca Yvonne Bayeck

Instructional Technology and Learning Sciences Faculty Publications

This article discusses the influence of the cultural context on the interview process. With literature demonstrating the role of spatial context on interviews, the article contends that similar consideration should be given to cultural contexts of research studies. Focusing on the cultural context where the interview takes place and the interactions during the interview can help researchers understand and analyze interview material. Interview forms such as conversation/interview bombing emerged from the interaction of cultural context with the interview process. This points to the need for qualitative researchers to explore how the cultural context shapes their research encounter. Such focus will …

Understanding The Transient Nature Of Stem Doctoral Students’ Research Self-Efficacy Across Time: Considering The Role Of Gender, Race, And First-Generation College Status, Kaylee Litson, Jennifer M. Blaney, David F. Feldon

Instructional Technology and Learning Sciences Faculty Publications

Developing research self-efficacy is an important part of doctoral student preparation. Despite the documented importance of research self-efficacy, little is known about the progression of doctoral students’ research self-efficacy over time in general and for students from minoritized groups. This study examined both within- and between-person stability of research self-efficacy from semester to semester over 4 years, focusing on doctoral students in biological sciences (N = 336). Using random intercept autoregressive analyses, we evaluated differences in stability across gender, racially minoritized student status, and first-generation student status. Results showed similar mean levels of self-efficacy across demographic groups and across …

Communicating About Computational Thinking: Understanding Affordances Of Portfolios For Assessing High School Students’ Computational Thinking And Participation Practices, Deborah A. Fields, Debora Lui, Yasmin Kafai, Gayithri Jayathirtha, Justice Walker, Mia Shaw

Instructional Technology and Learning Sciences Faculty Publications

Background and Context: While assessment of computational thinking concepts, practices, and perspectives is at the forefront of K-12 CS education, supporting student communication about computation has received relatively little attention.

Objective: To examine the usability of process-based portfolios for capturing students’ communication about their computational practices regarding the process of making electronic textile projects.

Method: We examined the portfolios of 248 high school students in 15 introductory CS classrooms from largely underserved communities, using a formal rubric (top-down) to code computational communication and an open-coding scheme (bottom-up) to identify computational practices described.

Findings: Students demonstrated stronger …

Debugging By Design: A Constructionist Approach To High School Students’ Crafting And Coding Of Electronic Textiles As Failure Artifacts, Deborah A. Fields, Yasmin B. Kafai, Luis Morales-Navarro, Justice T. Walker

Instructional Technology and Learning Sciences Faculty Publications

Much attention in constructionism has focused on designing tools and activities that support learners in designing fully finished and functional applications and artifacts to be shared with others. But helping students learn to debug their applications often takes on a surprisingly more instructionist stance by giving them checklists, teaching them strategies or providing them with test programs. The idea of designing bugs for learning—or debugging by design—makes learners agents of their own learning and, more importantly, of making and solving mistakes. In this paper, we report on our implementation of “Debugging by Design” activities in a high school classroom over …

Leveraging Local Resources And Contexts For Inclusive Computer Science Classrooms: Reflections From Experienced High School Teachers Implementing Electronic Textiles, Mia S. Shaw, Deborah A. Fields, Yasmin B. Kafai

Instructional Technology and Learning Sciences Faculty Publications

Background and context

Promoting open-ended projects presents new opportunities and challenges for inclusive teaching in CS classrooms. While efforts have been made to develop inclusive curricula, little research has focused on ways teachers apply curricula in their classrooms to promote inclusion.

Objective

To understand the challenges faced in facilitating an open-ended unit and the pedagogical strategies enacted to address those challenges, we analyze the self-reported teaching practices that experienced teachers developed in their implementation of a constructionist electronic textiles unit in Exploring Computer Science.

Method

We inductively analyzed and coded 17 experienced teachers’ weekly surveys and post-interviews.

Findings

Teachers …

Finding A Fit: Biological Science Doctoral Students’ Selection Of A Principal Investigator And Research Laboratory, Michelle A. Maher, Annie M. Wofford, Josipa Roksa, David F. Feldon

Instructional Technology and Learning Sciences Faculty Publications

In the laboratory-based disciplines, selection of a principal investigator (PI) and research laboratory (lab) indelibly shapes doctoral students’ experiences and educational outcomes. Framed by the theoretical concept of person–environment fit from within a socialization model, we use an inductive, qualitative approach to explore how a sample of 42 early-stage doctoral students enrolled in biological sciences programs made decisions about fitting with a PI and within a lab. Results illuminated a complex array of factors that students considered in selecting a PI, including PI relationship, mentoring style, and professional stability. Further, with regard to students’ lab selection, peers and research projects …

“How Well Does Your Structural Equation Model Fit Your Data?”: Is Marcoulides And Yuan’S Equivalence Test The Answer?, James Peugh, David F. Feldon

Instructional Technology and Learning Sciences Faculty Publications

Structural equation modeling is an ideal data analytical tool for testing complex relationships among many analytical variables. It can simultaneously test multiple mediating and moderating relationships, estimate latent variables on the basis of related measures, and address practical issues such as nonnormality and missing data. To test the extent to which a hypothesized model provides an appropriate characterization of the collective relationships among its variables, researchers must assess the “fit” between the model and the sample’s data. However, interpreting estimates of model fit is a problematic process. The traditional inferential test of model fit, the chi-square test, is biased due …

Steam Maker Education: Conceal/Reveal Of Personal, Artistic And Computational Dimensions In High School Student Projects, Lindsay Lindberg, Deborah A. Fields, Yasmin B. Kafai

Instructional Technology and Learning Sciences Faculty Publications

Much of maker education’s expansion has focused on STEM (science, technology, engineering, mathematics) learning, leaving out equally promising opportunities for integrating arts learning. In this paper we share findings from a project in which high school students created electronic-textiles-based art representing features of a community important to them as a part of an elective high school computer science class. We addressed the following research questions: (1) What kinds of personal and community meanings did students convey through their maker projects? (2) How did students engage with artistic dimensions in their projects? (3) How did coding interactive features support students’ artwork? …

The Validity And Instructional Value Of A Rubric For Evaluating Online Course Quality: An Empirical Study, Ji Eun Lee, Mimi Recker, Min Yuan

Instructional Technology and Learning Sciences Faculty Publications

This study investigated the validity and instructional value of a rubric developed to evaluate the quality of online courses offered at a midsized public university. This rubric was adapted from an online course quality rubric widely used in higher education, the Quality Matters rubric. We first examined the reliability and preliminary construct validity of the rubric using quality ratings for 202 online courses and eliminated twelve problematic items. We then examined the instructional value of the rubric by investigating causal relationships between 1) course quality scores, 2) online interactions between students, instructors, and content, and 3) student course performance (course …

Consensual Assessment In The New Domain Of E-Textiles: Comparing Insights From Expert, Quasi-Expert, And Novice Judges, Anthony Phonethibsavads, Maggie Dahn, Kylie Peppler, Deborah A. Fields, Yasmin B. Kafai

Instructional Technology and Learning Sciences Faculty Publications

Establishing what constitutes creativity in a domain is something for which we often look to experts—individuals versed in a domain’s history and able to identify timeworn ideas from fresh ones. Such valuations of creative merit are tied to a familiarity with past and present trends and, therefore, opinions of newcomers are often ignored. However, what about domains that build upon new, unexplored practices? This study examines the creativity ratings of judges with varying expertise in the emergent domain of electronic textiles (or e-textiles). E-textiles are fabrics that have programmable electronics such as sensors and actuators embedded in them toward a …

Identifying Faculty And Peer Interaction Patterns Of First-Year Biology Doctoral Students: A Latent Class Analysis, Soojeong Jeong, Jennifer M. Blaney, David F. Feldon

Instructional Technology and Learning Sciences Faculty Publications

Faculty and peer interactions play a key role in shaping graduate student socialization. Yet, within the literature on graduate student socialization, researchers have primarily focused on understanding the nature and impact of faculty alone, and much less is known about how peer interactions also contribute to graduate student outcomes. Using a national sample of first-year biology doctoral students, this study reveals distinct categories that classify patterns of faculty and peer interaction. Further, we document inequities such that certain groups (e.g., underrepresented minority students) report constrained types of interactions with faculty and peers. Finally, we connect faculty and peer interaction patterns …

Communicating Computational Concepts And Practices Within High School Students’ Portfolios Of Making Electronic Textiles, Debora Lui, Justice T. Walker, Sheri Hanna, Yasmin B. Kafai, Deborah A. Fields, Gayithri Jayathirtha

Instructional Technology and Learning Sciences Faculty Publications

Portfolios have recently gained traction within computer science education as a way to assess students’ computational thinking and practices. Whereas traditional assessments such as exams tend to capture learning within artificial settings at a single point in time, portfolios provide more authentic opportunities to document a trajectory of students’ learning and practices in everyday contexts. Furthermore, because communication itself has been defined as an important computational thinking practice, portfolios give students a place to practice this skill in the classroom. In this study, we report on the implementation of a digital portfolio with a class of 21 high school students …

The Picture Of Smartphones At School Is Not A Dire One And The Picture Of Student Competence Is A Bright One, Victor R. Lee

Instructional Technology and Learning Sciences Faculty Publications

In the United States, where I am based, one would get the impression that smartphones are a dangerous drug. Adults worry about smartphone addiction, the correlation of depression with smartphone usage, and an excess amount of screen time (e.g., Elhai, Levine, Dvorak, & Hall, 2016; Duke & Montag, 2017; Škařupová, Ólafsson, & Blinka, 2017). News headlines appear about technology moguls who will not allow their own children to have their own mobile device despite they themselves being the leaders in smartphone products and services. This then evokes guilt and causes anxiety for all the other American adults who are not …

Whose Responsibility Is It? A Statewide Survey Of School Librarians On Responsibilities And Resources For Teaching Digital Citizenship, Abigail L. Phillips, Victor R. Lee

Instructional Technology and Learning Sciences Faculty Publications

In 2015 the Utah State Legislature passed H.B. 213, “Safe Technology Utilization and Digital Citizenship in Public Schools,” mandating that K–12 schools provide digital citizenship instruction. This study presents an exploratory endeavor to understand how school librarians in a state that adopted digital citizenship legislation engage with digital citizenship instruction and their perceptions of a school librarian’s role in providing this instruction. We conducted a statewide survey of Utah school librarians, including questions focusing on digital citizenship resources used, current instruction within the school, and inquiries about improvements to current instruction. School librarians expressed a desire to be more involved …