Education Commons^™

The Ethics Of Play And Participation In A Tween Virtual World: Cheating Practices And Perspectives In The Whyville Community, Yasmin B. Kafai, Deborah A. Fields, Estee Ellis

Instructional Technology and Learning Sciences Faculty Publications

Much attention has been paid to young people’s increased participation in digital publics and its potential impact on their development and learning. However, few studies have examined the ethics in online play and their interactions as a critical aspect in the development of youth digital culture. In this paper we turn to the issue of cheating, a widely accepted practice in many online communities, including Whyville.net, a virtual world with over 5.5 million registered players ages 8-16. Our analyses focused on culturally-relevant examples such as player-written articles on cheating and player-produced YouTube cheating videos associated with Whyville from 2000 to …

How Design Features In Digital Math Games Support Learning And Mathematics Connections, Patricia S. Moyer-Packenham, Christina W. Lommatsch, Kristy Litster, Jill Ashby, Emma P. Bullock, Allison L. Roxburgh, Jessica F. Shumway, Emily Speed, Benjamin Covington, Christine Hartmann, Jody Clarke-Midura, Joel Skaria, Arla Westenskow, Beth L. Macdonald, Jurgen Symanzik, Kerry Jordan

Teacher Education and Leadership Faculty Publications

Current research shows that digital games can significantly enhance children’s learning. The purpose of this study was to examine how design features in 12 digital math games influenced children’s learning. The participants in this study were 193 children in Grades 2 through 6 (ages 8-12). During clinical interviews, children in the study completed pre-tests, interacted with digital math games, responded to questions about the digital math games, and completed post-tests. We recorded the interactions using two video perspectives that recorded children’s gameplay and responses to interviewers. We employed mixed methods to analyze the data and identify salient patterns in children’s …

The Lifecycle Of Sustainable Analytics: From Data Collection To Change Management, Mitchell Colver

Instructional Technology and Learning Sciences Faculty Publications

In this age of an ever-increasing list of analytics vendors and endlessly forwarded news articles that trumpet the promises of big data in higher education, it can be easy to become distracted by data science and miss out on another opportuni­ty—supporting increased professionalism amongst university staff, faculty, and administrators. Indeed, like many technologies before it, analytics provides us with an opportunity to catalyze institutional effectiveness, but only when we resist the tenden­cy to believe that technology can replace the need for human ingenuity and judgment. This report will argue that such threats to pro­fessional flourishing can be insulated against if …

Note-Taking And Science Inquiry In An Open-Ended Learning Environment, Yang Jiang, Jody Clarke-Midura, Bryan Keller, Ryan S. Baker, Luc Paquette, Jaclyn Ocumpaugh

Instructional Technology and Learning Sciences Faculty Publications

Note-taking is important for academic success and has been thoroughly studied in traditional classroom contexts. Recent advancements of technology have led to more students taking notes on computers, and in different situations than are common in traditional instructional contexts. However, research on computer-based note-taking is still an emerging area, and findings from these studies are mixed. In this exploratory study, we conducted multilevel analysis to comprehensively investigate the relationship between note-taking measures and subsequent student success at science inquiry among middle school students, using two scenarios of an open-ended learning environment named Virtual Performance Assessments. Analysis revealed an advantage for …

How Mother And Father Support Affect Youths’ Interest In Computer Science, Jody Clarke-Midura, Frederick J. Poole, Katarina Pantic, Chongning Sun, Vicki Allan

Instructional Technology and Learning Sciences Faculty Publications

Parental support is a predictor of children’s career interest and aspirations. However, mother and father support affects youth career choices differently. To understand how perceived mothers’ and fathers’ support affect career interest in computer science (CS), we developed two path models using both mother and father support gains to predict youths’ interest in CS. We hypothesized that perceived father’s and mother’s support would relate to youths’ interest in CS via youths’ perception of CS utility value as a mediator. We found that both mother and father support leads to interest in CS. However, father support was found to affect CS …

Designing For Online Computer-Based Clinical Simulations: Evaluation Of Instructional Approaches, Ilana Dubovi

Instructional Technology and Learning Sciences Faculty Publications

Background: Online computer-based simulations are becoming more widespread in nursing education. Therefore, an understanding of when and how to implement the variety of instructional strategies related to these simulations is fundamental.

Objectives: This study compares the effectiveness of online computer-based simulations designed using two alternative instructional approaches—Productive Failure and Simple-to-Complex sequencing—on learning of clinical reasoning skills.

Participants: Participants in this study were undergraduate nursing students (n = 103, mean age = 23.4 ± 2.1) enrolled at a university in Israel.

Methods: Participants completed two online simulations designed using Productive Failure approach (emergency medicine, mental health) and two online simulations using …

Does Audience Matter? Comparing Teachers' And Non-Teachers' Application And Perception Of Quality Rubrics For Evaluating Open Educational Resources, Min Yuan, Mimi Recker

Instructional Technology and Learning Sciences Faculty Publications

While many rubrics have been developed to guide people in evaluating the quality of Open Educational Resources (OER), few studies have empirically investigated how different people apply and perceive such rubrics. This study examines how participants (22 teachers and 22 non-teachers) applied three quality rubrics (comprised of a total of 17 quality indicators) to evaluate 20 OER, and how they perceived the utility of these rubrics. Results showed that both teachers and non-teachers found some indicators more difficult to apply, and displayed different response styles on different indicators. In addition, teachers gave higher overall ratings to OER, but non-teachers' ratings …

Putting Making Into High School Computer Science Classrooms: Promoting Equity In Teaching And Learning With Electronic Textiles In Exploring Computer Science, Deborah A. Fields, Yasmin B. Kafai, Tomoko Nakajima, Joanna Goode, Jane Margolis

Instructional Technology and Learning Sciences Faculty Publications

Recent discussions of making have focused on developing out-of-school makerspaces and activities to provide more equitable and enriching learning opportunities for youth. Yet school classrooms present a unique opportunity to help broaden access, diversify representation, and deepen participation in making. In turning to classrooms, we want to understand the crucial practices that teachers employ in broadening and deepening access to making. In this paper, we investigate two high school teachers’ approaches in implementing a novel eight-week, electronic textiles unit within the Exploring Computer Science curriculum, where students designed wearable electronic textile projects with microcontrollers, sensors, and LEDs. We share teachers’ …

Iterative Design Of A Simulation-Based Module For Teaching Evolution By Natural Selection, Jody Clarke-Midura, Denise S. Pope, Susan Maruca, Joel K. Abraham, Eli Meir

Instructional Technology and Learning Sciences Faculty Publications

Background: This research builds on a previous study that looked at the effectiveness of a simulation-based module for teaching students about the process of evolution by natural selection. While the previous study showed that the module was successful in teaching how natural selection works, the research uncovered some weaknesses in the design. In this paper, we used design-based research to investigate how design changes to the module affected not only students’ understanding of the concepts but also their usage of misconceptions in the assessments. We present results from two studies. In study 1, we looked at gains in understanding …

Self-Efficacy Change Associated With A Cognitive Load-Based Intervention In An Undergraduate Biology Course, David F. Feldon, Joana Franco, Jie Chao, James Peugh, Cathy Maahs-Fladung

Instructional Technology and Learning Sciences Faculty Publications

Cognitive load theory (CLT) holds that discovery learning and other instructional strategies imposing high levels of extraneous load on novice learners hinder learning. Such learning conditions are also associated with significant drops in persistence, a key measure of motivation. However, research within the CLT framework typically engages motivation as a necessary precursor to learning, rather than as an outcome of instruction. In this study, we examine changes in motivational beliefs as outcomes of learners' cognitive processes through a CLT lens as they engage with instruction. Using a double-blind quasi-experimental design, we manipulate the level of cognitive load imposed on participants …

Semester In The Parks: Engaging Students With Common Intellectual Experiences, Jacqualine B. Grant, John S. Maclean

Journal on Empowering Teaching Excellence

High-impact educational practices (HIP) such as Common Intellectual Experiences (CIE) enhance student engagement and positively affect student learning. At Southern Utah University we created a new HIP-focused program to enrich our students and faculty: Semester in the Parks (SIP). Students lived outside of Bryce Canyon National Park in the gateway community of Bryce Canyon City while they worked for Ruby’s Inn Resort and learned about the national parks. Faculty commuted to this off campus venue and redesigned their courses to incorporate national parks thinking and experiential learning opportunities. The CIE of a national parks-focused semester enhanced student engagement and developed …

Approaches To Evaluating Blended Courses, Mateja R. Savoie-Roskos, Stacy Bevan, Rebecca Charlton, Marlene Israelsen Graf

Journal on Empowering Teaching Excellence

Blended learning, sometimes referred to as hybrid or flexible learning, is becoming increasingly common in higher education. Unfortunately, many instructors receive limited training on how to effectively evaluate blended courses, and as a result, commonly rely solely on end-of-semester evaluations. Due to the more complex nature of how blended courses are designed and implemented, instructors should consider utilizing a variety of course evaluation methods. This article includes researched-based approaches for evaluating blended courses based on feedback from students, peers, and instructional designers. This combination of formalized feedback is offered as one strategy to ensure instructors achieve course learning objectives and …

Data Use By Middle And Secondary Students In The Digital Age: A Status Report And Future Prospects, Victor R. Lee, Michelle H. Wilkerson

Instructional Technology and Learning Sciences Faculty Publications

What it means to work with data has changed significantly since the preparation and publication of America’s Lab Report(Singer, Hilton, & Schweingruber, 2006)in ways that are impacting students, educators, and the very practice of science. This change is expressing itself most obviously in the abundance of data that can be collected and accessed by students and teachers. There are also notable changes in the types of data (e.g., GPS data, network data, qualitative/verbal data) that are now readily available, and the purposes for which data are collected and analyzed. These shifts have both generated enthusiasm and raised a number …

Conjecture Mapping The Library: Iterative Refinements Toward Supporting Maker Learning Activities In Small Community Spaces, Victor R. Lee, Mimi Recker, Abigail L. Phillips

Instructional Technology and Learning Sciences Faculty Publications

A recent and important innovation in design-based research (DBR) is the use of conjecture maps, where researchers explicitly articulate the conjectured mediational relations between their designed goals and the learning designs and contexts. In this paper, we present a design case as an iterative sequence of evolving conjecture maps. As each conjecture map was tested, we revised it to highlight and refine our articulation of the tools and processes that embodied our design approach. Out design case involves small-town and rural community and school libraries in the United States as partners and DBR sites, with the goal of supporting librarians …

Personal Analytics Explorations To Support Youth Learning, Victor R. Lee

Instructional Technology and Learning Sciences Faculty Publications

While personalized learning environments often include systems that automatically adapt to inferred learner needs, other forms of personalized learning exist. One form involves the use of personal analytics in which the learner obtains and analyzes data about himself/herself. More known in informatics communities, there is potential for use of personal analytics for design of instruction. This chapter provides two cases of personal analytics learning explorations to demonstrate their range and potential. One case is of a high school student examining how sleep influences her mood. The other case is of a sixth-grade class of students examining how deviations from typical …

A Bayesian Network Meta-Analysis To Synthesize The Influence Of Contexts Of Scaffolding Use On Cognitive Outcomes In Stem Education, Brian Robert Belland, Andrew Walker, Nam Ju Kim

Instructional Technology and Learning Sciences Faculty Publications

Computer-based scaffolding provides temporary support that enables students to participate in and become more proficient at complex skills like problem solving, argumentation, and evaluation. While meta-analyses have addressed between-subject differences on cognitive outcomes resulting from scaffolding, none has addressed within-subject gains. This leaves much quantitative scaffolding literature not covered by existing meta-analyses. To address this gap, this study used Bayesian network meta-analysis to synthesize within-subjects (pre–post) differences resulting from scaffolding in 56 studies. We generated the posterior distribution using 20,000 Markov Chain Monte Carlo samples. Scaffolding has a consistently strong effect across student populations, STEM (science, technology, engineering, and mathematics) …

Testing The Effectiveness Of Two Natural Selection Simulations In The Context Of A Large‑Enrollment Undergraduate Laboratory Class, Denise S. Pope, Caleb M. Rounds, Jody Clarke-Midura

Instructional Technology and Learning Sciences Faculty Publications

Background: Simulations can be an active and engaging way for students to learn about natural selection, and many have been developed, including both physical and virtual simulations. In this study we assessed the student experience of, and learning from, two natural selection simulations, one physical and one virtual, in a large enrollment introductory biology lab course. We assigned students to treatments (the physical or virtual simulation activity) by section and assessed their understanding of natural selection using a multiple-choice pre-/post-test and short-answer responses on a post-lab assignment. We assessed student experience of the activities through structured observations and an affective …

A Comparison Of Discovered Regularities In Blood Glucose Readings Across Two Data Collection Approaches Used With A Type 1 Diabetic Youth, Victor R. Lee, Travis Thurston, Chris Thurston

Instructional Technology and Learning Sciences Faculty Publications

Background: Type 1 diabetes requires frequent testing and monitoring of blood glucose levels in order to determine appropriate type and dosage of insulin administration. This can lead to thousands of individual measurements over the course of a lifetime of a single individual, of which very few are retained as part of a permanent record. The third author, aged 9, and his family have maintained several years of written records since his diagnosis with Type 1 diabetes at age 20 months, and have also recently begun to obtain automated records from a continuous glucose monitor.

Objectives: This paper compares regularities identified …

Stitching Codeable Circuits: High School Students' Learning About Circuitry And Coding With Electronic Textiles, Breanne Krystine Litts, Yasmin B. Kafai, Debora A. Lui, Justice T. Walker, Sari A. Widman

Instructional Technology and Learning Sciences Faculty Publications

Learning about circuitry by connecting a battery, light bulb, and wires is a common activity in many science classrooms. In this paper, we expand students’ learning about circuitry with electronic textiles, which use conductive thread instead of wires and sewable LEDs instead of lightbulbs, by integrating programming sensor inputs and light outputs and examining how the two domains interact.We implemented an electronic textiles unit with 23 high school students ages 16–17 years who learned how to craft and code circuits with the LilyPad Arduino, an electronic textile construction kit. Our analyses not only confirm significant increases in students’ understanding of …

Interview And Focus Groups Analysis Of Decreased Composite Benchmark Scores On Dynamic Indicators Of Basic Early Literacy Skills Dibels From Kindergarten To First Grade Students, Loreen Flanary

All Graduate Plan B and other Reports, Spring 1920 to Spring 2023

School districts in the state of Utah are required to use Dynamic Indicators of Basic Literacy Skills (DIBELS) as an assessment of reading ability for students in kindergarten through fifth grade. The Logan City School District (LCSD) kindergarten end of year (EOY) Composite DIBELS data have been strong over the past 5 years with over 90% of students scoring at benchmark. In comparison, in each of those 5 years, first grade beginning of year (BOY) data drops considerably. LCSD is concerned with this trend because it is larger than the state trend of 13-14%, the trend is increasing, and this …

Learning Analytics: Shifting From Theory To Practice., Courtney Stewart

Journal on Empowering Teaching Excellence

As online and blended learning continues to increase in higher education, so does the amount of data that is housed within Learning Management Systems that can be analyzed and processed within the framework of Learning Analytics. Learning Analytics is a new and developing field. As with many new fields of study, a gap between theory and practice is evident. Some attribute this gap to the lack of situating learning analytics within learning theory. In order for Learning Analytics to find interest and usability among educators, a shift is needed from the technical use to practical application. In this theoretical paper …

Time-To-Credit Gender Inequities Of First-Year Phd Students In The Biological Sciences, David F. Feldon, James Peugh, Michelle A. Maher, Josipa Roksa, Colby Tofel-Grehl

Instructional Technology and Learning Sciences Faculty Publications

Equitable gender representation is an important aspect of scientific workforce development to secure a sufficient number of individuals and a diversity of perspectives. Biology is the most gender equitable of all scientific fields by the marker of degree attainment, with 52.5% of PhDs awarded to women. However, equitable rates of degree completion do not translate into equitable attainment of faculty or postdoctoral positions, suggesting continued existence of gender inequalities. In a national cohort of 336 first-year PhD students in the biological sciences (i.e., microbiology, cellular biology, molecular biology, develop-mental biology, and genetics) from 53 research institutions, female participants logged significantly …

An Assessment Instrument Of Technological Literacies In Makerspaces And Fablabs, Paulo Blikstein, Zaza Kabayadondo, Andrew Martin, Deborah A. Fields

Instructional Technology and Learning Sciences Faculty Publications

Background

As the maker movement is increasingly adopted into K‐12 schools, students are developing new competences in exploration and fabrication technologies. This study assesses learning with these technologies in K‐12 makerspaces and FabLabs.

Purpose

Our study describes the iterative process of developing an assessment instrument for this new technological literacy, the Exploration and Fabrication Technologies Instrument, and presents findings from implementations at five schools in three countries. Our index is generalizable and psychometrically sound, and permits comparison between student confidence and performance.

Design/Method

Our evaluation of distinct technology skills separates general computing, information and communication technology (ICT), and exploration and …

From Wearing To Wondering: Treating Wearable Activity Trackers As Objects Of Inquiry, Joel R. Drake, Ryan Cain, Victor R. Lee

Instructional Technology and Learning Sciences Faculty Publications

Wearable technologies represent a rapidly expanding category of consumer information and communications technologies. From smartwatches to activity tracking devices, wearables are finding their way into many aspects of our lives, changing the way we think about ourselves and the world around us. The rapid adoption of these tools in everyday life hints at the possibilities these devices may hold in school and other educational settings. Drawing on examples taken from a five-year study using wearable fitness tracking devices in elementary and middle school classrooms, this paper presents two examples of how wearable devices can be appropriated for use in school …

Engaging Everyday Science Knowledge To Help Make Sense Of Data, Susan B. Kelly, Luettamae Lawrence, Emma Mercier

Instructional Technology and Learning Sciences Faculty Publications

Making sense of data to inform decisions is an important skill emphasized in current curriculum documents (NRC, 2012). Making sense of data through personal experiences and prior knowledge is one way that students can begin to understand multiple and unfamiliar data sources. This paper examines how middle school students used different data sources when engaged in a collaborative problem solving activity using a multi-touch table during classroom science instruction. In this study, we found that students made personal connections when talking about data. Students engaged in data talk across all conversation quality levels, but the ways students interacted and talked …

Appropriating Quantified Self Technologies To Support Elementary Statistical Teaching And Learning, Victor R. Lee, Joel R. Drake, Jeffrey L. Thayne

Instructional Technology and Learning Sciences Faculty Publications

Wearable activity tracking devices associated with the Quantified Self movement have potential benefit for educational settings because they produce authentic and granular data about activities and experiences already familiar to youth. This article explores how that potential could be realized through explicit acknowledgment of and response to tacit design assumptions about how such technologies will be used in practice and strategic design for use in a classroom. We argue that particular practical adaptations that we have identified serve to ensure that the classroom and educational use cases are appropriately considered. As an example of how those adaptations are realized in …

An Embodied Agent Helps Anxious Students In Mathematics Learning, Yanghee Kim, Jeffrey L. Thayne, Quan Wei

Instructional Technology and Learning Sciences Faculty Publications

Mathematics anxiety is known to be detrimental to mathematics learning. This study explored if an embodied agent could be used to help alleviate student anxiety in classrooms. To examine this potential, agent-guided algebra lessons were developed, in which an animated agent was equipped with prescriptive instructional guidance and anxiety treating messages. The lessons were deployed in regular mathematics classrooms, one lesson per day over a week, with 138 boys and girls in the 9th grade in the United States. After taking the weeklong agent-based lessons, students decreased in their mathematics anxiety (p = .042) and increased in mathematics learning …

A Mixed-Method Study Of Mobile Devices And Student Self-Directed Learning And Achievement During A Middle School Stem Activity, Scott Bartholomew

All Graduate Theses and Dissertations, Spring 1920 to Summer 2023

With the increasingly ubiquitous nature of mobile devices among K-12 students, many argue for and against the inclusion of these devices in K-12 classrooms. Arguments in favor cite instant access to information and collaboration with others as positive affordances made possible through mobile devices. Self-directed learning, a process where individuals take charge of their learning and decide what they will learn, how they learn it, and how they assess their learning, has been identified as an increasingly important trait for K-12 students. The relationship between mobile device access in K-12 education settings and student self-directed learning has not been explored. …

Coding By Choice: A Transitional Analysis Of Social Participation Patterns And Programming Contributions In The Online Scratch Community, Deborah A. Fields, Yasmin B. Kafai, Michael T. Giang

Instructional Technology and Learning Sciences Faculty Publications

While massive online communities have drawn the attention of researchers and educators on their potential to support active collaborative work, knowledge sharing, and user-generated content, few studies examine participation in these communities at scale. The little research that does exist attends almost solely to adults rather than communities to support youths’ learning and identity development. In this chapter, we tackle two challenges related to understanding social practices that support learning in massive social networking forums where users engage in design. We examined a youth programmer community, called Scratch.mit.edu, that garners the voluntary participation of millions of young people worldwide. We …

A Knowledge Analytic Comparison Of Cued Primitives When Students Are Explaining Predicted And Enacted Motions, Victor R. Lee

Instructional Technology and Learning Sciences Faculty Publications

The Knowledge in Pieces theoretical perspective posits p-prims as an important knowledge element in intuitive reasoning. Because p-prims are a class of knowledge elements developed and abstracted from everyday physical experiences, it seems plausible that immediate physical experiences, both in terms of sensations and actual observations of motion, would cue knowledge in different ways than when those experiences are just discussed as hypotheticals. This paper presents two cases to show that immediate embodied experiences with everyday objects does change which p-prims are cued and how they are deployed by students to explain situations involving motion. These cases come from a …