Instructional Media Design Commons^™

How Teachers Conceptualise Shared Control With An Ai Co-Orchestration Tool: A Multiyear Teacher-Centred Design Process, Luettamae Lawrence, Vanessa Echeverria, Kexin Yang, Vincent Aleven, Nikol Rummel

Instructional Technology and Learning Sciences Faculty Publications

Artificial intelligence (AI) can enhance teachers' capabilities by sharing control over different parts of learning activities. This is especially true for complex learning activities, such as dynamic learning transitions where students move between individual and collaborative learning in un-planned ways, as the need arises. Yet, few initiatives have emerged considering how shared responsibility between teachers and AI can support learning and how teachers' voices might be included to inform design decisions. The goal of our article is twofold. First, we describe a secondary analysis of our co-design process comprising six design methods to understand how teachers conceptualise sharing control with …

How Co-Designing Computational Modeling Activities Helped Teachers Implement Responsive Teaching Strategies, Hillary Swanson, Luettamae Lawrence, Jared Arnell, Allisia Dawkins, Bonni Jones, Bruce Sherin, Uri Wilensky

Instructional Technology and Learning Sciences Faculty Publications

In recent years, science education has shifted focus, from content to practice. This is reflected in the NGSS, which advocate learning science concepts through engagement in science and engineering practices. Theory building is a central activity of science and computational modeling is a key practice through which contemporary scientists construct theory. In this paper, we discuss an 8th grade science teacher's implementation of a computational modeling lesson. The teacher had co-designed the computational modeling microworld and lesson with the research team over the preceding summers. We investigate the teacher's activity during a whole-class discussion near the end of the lesson, …

Understanding Computational Thinking In The Gameplay Of The African Songo Board Game, Rebecca Y. Bayeck

Instructional Technology and Learning Sciences Faculty Publications

Computational thinking is a necessary skill for the 21st century. While previously examined in computer-rich settings, researchers are increasingly studying computational thinking in unplugged environments such as board games. Focusing on the African board game Songo, this study shows that computational thinking practices are embedded in Songo board gameplay and interact with the cultural context. The study also reveals a computing practice peculiar to Songo gameplay, songoputation. This paper suggests that researchers can benefit from exploring computational thinking and computing practices beyond board games in western contexts.

Supporting And Sustaining Equitable Steam Activities In High School Classrooms: Understanding Computer Science Teachers’ Needs And Practices When Implementing An E-Textiles Curriculum To Forge Connections Across Communities, Deborah A. Fields, Yasmin B. Kafai

Instructional Technology and Learning Sciences Faculty Publications

While the last two decades have seen an increased interest in STEAM (science, technology, engineering, arts, and mathematics) in K-12 schools, few efforts have focused on the teachers and teaching practices necessary to support these interventions. Even fewer have considered the important work that teachers carry out not just inside classrooms but beyond the classroom walls to sustain such STEAM implementation efforts, from interacting with administrators to recruiting students and persuading parents about the importance of arts and computer science. In order to understand teachers’ needs and practices regarding STEAM implementation, in this paper, we focus on eight experienced computer …

Is Microethnography An Ethnographic Case Study? And/Or A Mini-Ethnographic Case Study? An Analysis Of The Literature, Rebecca Y. Bayeck

Instructional Technology and Learning Sciences Faculty Publications

Selecting the research approach that addresses the research question is often challenging for novice researchers. However, getting a better understanding of the research approaches available in the field, is likely to help novice researchers identify and choose the research approach that fits their situation. In this paper, we discuss microethnography, ethnographic case study, and mini-ethnography case study in order to show that these approaches may have similarities but are different. The author hopes that this discussion will help researchers get a better understanding of these approaches and dissipate the confusion that may exist.

The Predictive Validity Of The Gre Across Graduate Outcomes: A Meta-Analysis Of Trends Over Time, David F. Feldon, Kaylee Litson, Brinleigh Cahoon, Zhang Feng, Andrew Walker, Colby Tofel-Grehl

Instructional Technology and Learning Sciences Faculty Publications

This meta-analysis assesses the predictive validity of the Graduate Record Examination (GRE) across outcome variables, including grade point average, for graduate students. In addition to aggregate effects, this paper also assessed changes in observed effects over time as related to increasing diversity in the graduate student population and as a function of gender and racial/ethnic composition of study samples. Framed using a lens of critical whiteness, this analysis examined n = 1,744 individual effects across k = 208 studies. Overall, 61.6% of reported effects were nonsignificant (i.e. no predictive value of GRE scores on student outcomes). Further, the magnitude of …

Designing Hybrid Human-Ai Orchestration Tools For Individual And Collaborative Activities: A Technology Probe Study, Vanessa Echeverria, Kexin Yang, Luettamae Lawrence, Nikol Rummel, Vincent Aleven

Instructional Technology and Learning Sciences Faculty Publications

Combining individual and collaborative learning is common, but dynamic combinations (which happen as-the-need arises, rather than in pre-planned ways, and may happen on an individual basis) are rare. This work reports findings from a technology probe study exploring alternative designs for classroom co-orchestration support for dynamically transitioning between individual and collaborative learning. The study involved 1) a technology-probe classroom study in an authentic, AI-supported classroom to understand teachers' and students' needs for co-orchestration support over dynamic transitions; and 2) workshops and interviews with students and teachers to get informed feedback about their lived experiences. 118 students and three teachers from …

Positionality: The Interplay Of Space, Context And Identity, Rebecca Y. Bayeck

Instructional Technology and Learning Sciences Faculty Publications

This article considers the way in which positionality shifts and is formed during a cross-cultural study to reveal the complexity of the insider-outsider status. As a researcher in a male-dominated game setting, I reflect on the research process and my interactions with participants to show the interplay of space, context, and identity in shaping a researcher’s status. I discuss the process of gaining access to the research site and participants, and data collection in relation to space, context, and identity. The interaction of my identities with space, and context informed my status at various moments. This interplay constructs a complex …

The Intersection Of Cultural Context And Research Encounter: Focus On Interviewing In Qualitative Research, Rebecca Yvonne Bayeck

Instructional Technology and Learning Sciences Faculty Publications

This article discusses the influence of the cultural context on the interview process. With literature demonstrating the role of spatial context on interviews, the article contends that similar consideration should be given to cultural contexts of research studies. Focusing on the cultural context where the interview takes place and the interactions during the interview can help researchers understand and analyze interview material. Interview forms such as conversation/interview bombing emerged from the interaction of cultural context with the interview process. This points to the need for qualitative researchers to explore how the cultural context shapes their research encounter. Such focus will …

Understanding The Transient Nature Of Stem Doctoral Students’ Research Self-Efficacy Across Time: Considering The Role Of Gender, Race, And First-Generation College Status, Kaylee Litson, Jennifer M. Blaney, David F. Feldon

Instructional Technology and Learning Sciences Faculty Publications

Developing research self-efficacy is an important part of doctoral student preparation. Despite the documented importance of research self-efficacy, little is known about the progression of doctoral students’ research self-efficacy over time in general and for students from minoritized groups. This study examined both within- and between-person stability of research self-efficacy from semester to semester over 4 years, focusing on doctoral students in biological sciences (N = 336). Using random intercept autoregressive analyses, we evaluated differences in stability across gender, racially minoritized student status, and first-generation student status. Results showed similar mean levels of self-efficacy across demographic groups and across …

Communicating About Computational Thinking: Understanding Affordances Of Portfolios For Assessing High School Students’ Computational Thinking And Participation Practices, Deborah A. Fields, Debora Lui, Yasmin Kafai, Gayithri Jayathirtha, Justice Walker, Mia Shaw

Instructional Technology and Learning Sciences Faculty Publications

Background and Context: While assessment of computational thinking concepts, practices, and perspectives is at the forefront of K-12 CS education, supporting student communication about computation has received relatively little attention.

Objective: To examine the usability of process-based portfolios for capturing students’ communication about their computational practices regarding the process of making electronic textile projects.

Method: We examined the portfolios of 248 high school students in 15 introductory CS classrooms from largely underserved communities, using a formal rubric (top-down) to code computational communication and an open-coding scheme (bottom-up) to identify computational practices described.

Findings: Students demonstrated stronger …

Debugging By Design: A Constructionist Approach To High School Students’ Crafting And Coding Of Electronic Textiles As Failure Artifacts, Deborah A. Fields, Yasmin B. Kafai, Luis Morales-Navarro, Justice T. Walker

Instructional Technology and Learning Sciences Faculty Publications

Much attention in constructionism has focused on designing tools and activities that support learners in designing fully finished and functional applications and artifacts to be shared with others. But helping students learn to debug their applications often takes on a surprisingly more instructionist stance by giving them checklists, teaching them strategies or providing them with test programs. The idea of designing bugs for learning—or debugging by design—makes learners agents of their own learning and, more importantly, of making and solving mistakes. In this paper, we report on our implementation of “Debugging by Design” activities in a high school classroom over …

Leveraging Local Resources And Contexts For Inclusive Computer Science Classrooms: Reflections From Experienced High School Teachers Implementing Electronic Textiles, Mia S. Shaw, Deborah A. Fields, Yasmin B. Kafai

Instructional Technology and Learning Sciences Faculty Publications

Background and context

Promoting open-ended projects presents new opportunities and challenges for inclusive teaching in CS classrooms. While efforts have been made to develop inclusive curricula, little research has focused on ways teachers apply curricula in their classrooms to promote inclusion.

Objective

To understand the challenges faced in facilitating an open-ended unit and the pedagogical strategies enacted to address those challenges, we analyze the self-reported teaching practices that experienced teachers developed in their implementation of a constructionist electronic textiles unit in Exploring Computer Science.

Method

We inductively analyzed and coded 17 experienced teachers’ weekly surveys and post-interviews.

Findings

Teachers …

Finding A Fit: Biological Science Doctoral Students’ Selection Of A Principal Investigator And Research Laboratory, Michelle A. Maher, Annie M. Wofford, Josipa Roksa, David F. Feldon

Instructional Technology and Learning Sciences Faculty Publications

In the laboratory-based disciplines, selection of a principal investigator (PI) and research laboratory (lab) indelibly shapes doctoral students’ experiences and educational outcomes. Framed by the theoretical concept of person–environment fit from within a socialization model, we use an inductive, qualitative approach to explore how a sample of 42 early-stage doctoral students enrolled in biological sciences programs made decisions about fitting with a PI and within a lab. Results illuminated a complex array of factors that students considered in selecting a PI, including PI relationship, mentoring style, and professional stability. Further, with regard to students’ lab selection, peers and research projects …

“How Well Does Your Structural Equation Model Fit Your Data?”: Is Marcoulides And Yuan’S Equivalence Test The Answer?, James Peugh, David F. Feldon

Instructional Technology and Learning Sciences Faculty Publications

Structural equation modeling is an ideal data analytical tool for testing complex relationships among many analytical variables. It can simultaneously test multiple mediating and moderating relationships, estimate latent variables on the basis of related measures, and address practical issues such as nonnormality and missing data. To test the extent to which a hypothesized model provides an appropriate characterization of the collective relationships among its variables, researchers must assess the “fit” between the model and the sample’s data. However, interpreting estimates of model fit is a problematic process. The traditional inferential test of model fit, the chi-square test, is biased due …

Steam Maker Education: Conceal/Reveal Of Personal, Artistic And Computational Dimensions In High School Student Projects, Lindsay Lindberg, Deborah A. Fields, Yasmin B. Kafai

Instructional Technology and Learning Sciences Faculty Publications

Much of maker education’s expansion has focused on STEM (science, technology, engineering, mathematics) learning, leaving out equally promising opportunities for integrating arts learning. In this paper we share findings from a project in which high school students created electronic-textiles-based art representing features of a community important to them as a part of an elective high school computer science class. We addressed the following research questions: (1) What kinds of personal and community meanings did students convey through their maker projects? (2) How did students engage with artistic dimensions in their projects? (3) How did coding interactive features support students’ artwork? …

The Validity And Instructional Value Of A Rubric For Evaluating Online Course Quality: An Empirical Study, Ji Eun Lee, Mimi Recker, Min Yuan

Instructional Technology and Learning Sciences Faculty Publications

This study investigated the validity and instructional value of a rubric developed to evaluate the quality of online courses offered at a midsized public university. This rubric was adapted from an online course quality rubric widely used in higher education, the Quality Matters rubric. We first examined the reliability and preliminary construct validity of the rubric using quality ratings for 202 online courses and eliminated twelve problematic items. We then examined the instructional value of the rubric by investigating causal relationships between 1) course quality scores, 2) online interactions between students, instructors, and content, and 3) student course performance (course …

Consensual Assessment In The New Domain Of E-Textiles: Comparing Insights From Expert, Quasi-Expert, And Novice Judges, Anthony Phonethibsavads, Maggie Dahn, Kylie Peppler, Deborah A. Fields, Yasmin B. Kafai

Instructional Technology and Learning Sciences Faculty Publications

Establishing what constitutes creativity in a domain is something for which we often look to experts—individuals versed in a domain’s history and able to identify timeworn ideas from fresh ones. Such valuations of creative merit are tied to a familiarity with past and present trends and, therefore, opinions of newcomers are often ignored. However, what about domains that build upon new, unexplored practices? This study examines the creativity ratings of judges with varying expertise in the emergent domain of electronic textiles (or e-textiles). E-textiles are fabrics that have programmable electronics such as sensors and actuators embedded in them toward a …

Identifying Faculty And Peer Interaction Patterns Of First-Year Biology Doctoral Students: A Latent Class Analysis, Soojeong Jeong, Jennifer M. Blaney, David F. Feldon

Instructional Technology and Learning Sciences Faculty Publications

Faculty and peer interactions play a key role in shaping graduate student socialization. Yet, within the literature on graduate student socialization, researchers have primarily focused on understanding the nature and impact of faculty alone, and much less is known about how peer interactions also contribute to graduate student outcomes. Using a national sample of first-year biology doctoral students, this study reveals distinct categories that classify patterns of faculty and peer interaction. Further, we document inequities such that certain groups (e.g., underrepresented minority students) report constrained types of interactions with faculty and peers. Finally, we connect faculty and peer interaction patterns …

Communicating Computational Concepts And Practices Within High School Students’ Portfolios Of Making Electronic Textiles, Debora Lui, Justice T. Walker, Sheri Hanna, Yasmin B. Kafai, Deborah A. Fields, Gayithri Jayathirtha

Instructional Technology and Learning Sciences Faculty Publications

Portfolios have recently gained traction within computer science education as a way to assess students’ computational thinking and practices. Whereas traditional assessments such as exams tend to capture learning within artificial settings at a single point in time, portfolios provide more authentic opportunities to document a trajectory of students’ learning and practices in everyday contexts. Furthermore, because communication itself has been defined as an important computational thinking practice, portfolios give students a place to practice this skill in the classroom. In this study, we report on the implementation of a digital portfolio with a class of 21 high school students …

The Picture Of Smartphones At School Is Not A Dire One And The Picture Of Student Competence Is A Bright One, Victor R. Lee

Instructional Technology and Learning Sciences Faculty Publications

In the United States, where I am based, one would get the impression that smartphones are a dangerous drug. Adults worry about smartphone addiction, the correlation of depression with smartphone usage, and an excess amount of screen time (e.g., Elhai, Levine, Dvorak, & Hall, 2016; Duke & Montag, 2017; Škařupová, Ólafsson, & Blinka, 2017). News headlines appear about technology moguls who will not allow their own children to have their own mobile device despite they themselves being the leaders in smartphone products and services. This then evokes guilt and causes anxiety for all the other American adults who are not …

Whose Responsibility Is It? A Statewide Survey Of School Librarians On Responsibilities And Resources For Teaching Digital Citizenship, Abigail L. Phillips, Victor R. Lee

Instructional Technology and Learning Sciences Faculty Publications

In 2015 the Utah State Legislature passed H.B. 213, “Safe Technology Utilization and Digital Citizenship in Public Schools,” mandating that K–12 schools provide digital citizenship instruction. This study presents an exploratory endeavor to understand how school librarians in a state that adopted digital citizenship legislation engage with digital citizenship instruction and their perceptions of a school librarian’s role in providing this instruction. We conducted a statewide survey of Utah school librarians, including questions focusing on digital citizenship resources used, current instruction within the school, and inquiries about improvements to current instruction. School librarians expressed a desire to be more involved …

Connecting With Computer Science: Electronic Textile Portfolios As Ideational Identity Resources For High School Students, Mia S. Shaw, Deborah A. Fields, Yasmin B. Kafai

Instructional Technology and Learning Sciences Faculty Publications

The development of student identities—their interests in computer science, perceptions of the discipline, and sense of belonging in the field—is critical for broadening participation of underrepresented groups in computing. This paper reports on the design of portfolios in which two classes of high school students reflected on the process of making electronic textile projects. We examine how students expressed self-authorship in relation to computer science and how the use of reflective portfolios shaped students’ perceptions of computer science. In the discussion we consider how reflective portfolios can serve as ideational resources for computer science identity construction.

Equitable Engagement In Stem: Using E-Textiles To Challenge The Positioning Of Non-Dominant Girls In School Science, Kristin A. Searle, Colby Tofel-Grehl, Janet Breitenstein

Instructional Technology and Learning Sciences Faculty Publications

This paper examines how working with sewable, programmable electronics embedded in textiles (e-textiles) impacted the self-perceptions and actions of two middle school girls from non-dominant communities as they navigated their place within science class. Using analytic induction (Erickson, 1986), we explore the phenomena around their experiences and the influence of their teachers’ perceptions. Findings indicate that the personalizable nature of e-textiles created a meaningful opportunity for students to engage in science class in a new way.

The Ethics Of Play And Participation In A Tween Virtual World: Cheating Practices And Perspectives In The Whyville Community, Yasmin B. Kafai, Deborah A. Fields, Estee Ellis

Instructional Technology and Learning Sciences Faculty Publications

Much attention has been paid to young people’s increased participation in digital publics and its potential impact on their development and learning. However, few studies have examined the ethics in online play and their interactions as a critical aspect in the development of youth digital culture. In this paper we turn to the issue of cheating, a widely accepted practice in many online communities, including Whyville.net, a virtual world with over 5.5 million registered players ages 8-16. Our analyses focused on culturally-relevant examples such as player-written articles on cheating and player-produced YouTube cheating videos associated with Whyville from 2000 to …

The Lifecycle Of Sustainable Analytics: From Data Collection To Change Management, Mitchell Colver

Instructional Technology and Learning Sciences Faculty Publications

In this age of an ever-increasing list of analytics vendors and endlessly forwarded news articles that trumpet the promises of big data in higher education, it can be easy to become distracted by data science and miss out on another opportuni­ty—supporting increased professionalism amongst university staff, faculty, and administrators. Indeed, like many technologies before it, analytics provides us with an opportunity to catalyze institutional effectiveness, but only when we resist the tenden­cy to believe that technology can replace the need for human ingenuity and judgment. This report will argue that such threats to pro­fessional flourishing can be insulated against if …

Note-Taking And Science Inquiry In An Open-Ended Learning Environment, Yang Jiang, Jody Clarke-Midura, Bryan Keller, Ryan S. Baker, Luc Paquette, Jaclyn Ocumpaugh

Instructional Technology and Learning Sciences Faculty Publications

Note-taking is important for academic success and has been thoroughly studied in traditional classroom contexts. Recent advancements of technology have led to more students taking notes on computers, and in different situations than are common in traditional instructional contexts. However, research on computer-based note-taking is still an emerging area, and findings from these studies are mixed. In this exploratory study, we conducted multilevel analysis to comprehensively investigate the relationship between note-taking measures and subsequent student success at science inquiry among middle school students, using two scenarios of an open-ended learning environment named Virtual Performance Assessments. Analysis revealed an advantage for …

How Mother And Father Support Affect Youths’ Interest In Computer Science, Jody Clarke-Midura, Frederick J. Poole, Katarina Pantic, Chongning Sun, Vicki Allan

Instructional Technology and Learning Sciences Faculty Publications

Parental support is a predictor of children’s career interest and aspirations. However, mother and father support affects youth career choices differently. To understand how perceived mothers’ and fathers’ support affect career interest in computer science (CS), we developed two path models using both mother and father support gains to predict youths’ interest in CS. We hypothesized that perceived father’s and mother’s support would relate to youths’ interest in CS via youths’ perception of CS utility value as a mediator. We found that both mother and father support leads to interest in CS. However, father support was found to affect CS …

Designing For Online Computer-Based Clinical Simulations: Evaluation Of Instructional Approaches, Ilana Dubovi

Instructional Technology and Learning Sciences Faculty Publications

Background: Online computer-based simulations are becoming more widespread in nursing education. Therefore, an understanding of when and how to implement the variety of instructional strategies related to these simulations is fundamental.

Objectives: This study compares the effectiveness of online computer-based simulations designed using two alternative instructional approaches—Productive Failure and Simple-to-Complex sequencing—on learning of clinical reasoning skills.

Participants: Participants in this study were undergraduate nursing students (n = 103, mean age = 23.4 ± 2.1) enrolled at a university in Israel.

Methods: Participants completed two online simulations designed using Productive Failure approach (emergency medicine, mental health) and two online simulations using …

Does Audience Matter? Comparing Teachers' And Non-Teachers' Application And Perception Of Quality Rubrics For Evaluating Open Educational Resources, Min Yuan, Mimi Recker

Instructional Technology and Learning Sciences Faculty Publications

While many rubrics have been developed to guide people in evaluating the quality of Open Educational Resources (OER), few studies have empirically investigated how different people apply and perceive such rubrics. This study examines how participants (22 teachers and 22 non-teachers) applied three quality rubrics (comprised of a total of 17 quality indicators) to evaluate 20 OER, and how they perceived the utility of these rubrics. Results showed that both teachers and non-teachers found some indicators more difficult to apply, and displayed different response styles on different indicators. In addition, teachers gave higher overall ratings to OER, but non-teachers' ratings …