Educational Assessment, Evaluation, and Research Commons^™

Effects Of Frequency Of Early Intervention On Spoken Language And Literacy Levels Of Children Who Are Deaf Or Hard Of Hearing In Preschool And Elementary School, Ann E. Geers, Jean S. Moog, Amanda M. Rudge

Journal of Early Hearing Detection and Intervention

Language delays associated with hearing loss during infancy may have a negative impact on academic development throughout childhood. Early intervention provided by the Moog Center for Deaf Education prior to 36 months of age was quantified, and associations with later outcomes were examined for 50 students who are DHH representing Moog Center alumni. The objective was to determine whether the amount of early intervention (referred to hereafter as dose of early intervention received at the Moog Center during the time children were 0-36 months of age) contributed uniquely to outcomes in preschool (4–6 years) and in elementary school (8–14 years). …

21st Century Teenagers And Young Adults Who Are Deaf Or Hard Of Hearing: Outcomes And Possibilities, Jean S. Moog, Amanda M. Rudge 3730756

Journal of Early Hearing Detection and Intervention

The purpose of this study was to document demographics, characteristics, and long-term outcomes of teenagers and young adults who are deaf or hard of hearing (DHH) and who all attended the Moog Center for Deaf Education for preschool and/or a portion of elementary school. Data were obtained via an online survey that was designed to assess educational, personal, and professional outcomes of individuals who were currently in high school and beyond. Survey questions were about the lives of these individuals after leaving the Moog Center. Participants included 108 individuals who were DHH, ranging from 15 to 32 years of age. …

Communicating Computational Concepts And Practices Within High School Students’ Portfolios Of Making Electronic Textiles, Debora Lui, Justice T. Walker, Sheri Hanna, Yasmin B. Kafai, Deborah A. Fields, Gayithri Jayathirtha

Instructional Technology and Learning Sciences Faculty Publications

Portfolios have recently gained traction within computer science education as a way to assess students’ computational thinking and practices. Whereas traditional assessments such as exams tend to capture learning within artificial settings at a single point in time, portfolios provide more authentic opportunities to document a trajectory of students’ learning and practices in everyday contexts. Furthermore, because communication itself has been defined as an important computational thinking practice, portfolios give students a place to practice this skill in the classroom. In this study, we report on the implementation of a digital portfolio with a class of 21 high school students …

The Picture Of Smartphones At School Is Not A Dire One And The Picture Of Student Competence Is A Bright One, Victor R. Lee

Instructional Technology and Learning Sciences Faculty Publications

In the United States, where I am based, one would get the impression that smartphones are a dangerous drug. Adults worry about smartphone addiction, the correlation of depression with smartphone usage, and an excess amount of screen time (e.g., Elhai, Levine, Dvorak, & Hall, 2016; Duke & Montag, 2017; Škařupová, Ólafsson, & Blinka, 2017). News headlines appear about technology moguls who will not allow their own children to have their own mobile device despite they themselves being the leaders in smartphone products and services. This then evokes guilt and causes anxiety for all the other American adults who are not …

Whose Responsibility Is It? A Statewide Survey Of School Librarians On Responsibilities And Resources For Teaching Digital Citizenship, Abigail L. Phillips, Victor R. Lee

Instructional Technology and Learning Sciences Faculty Publications

In 2015 the Utah State Legislature passed H.B. 213, “Safe Technology Utilization and Digital Citizenship in Public Schools,” mandating that K–12 schools provide digital citizenship instruction. This study presents an exploratory endeavor to understand how school librarians in a state that adopted digital citizenship legislation engage with digital citizenship instruction and their perceptions of a school librarian’s role in providing this instruction. We conducted a statewide survey of Utah school librarians, including questions focusing on digital citizenship resources used, current instruction within the school, and inquiries about improvements to current instruction. School librarians expressed a desire to be more involved …

Connecting With Computer Science: Electronic Textile Portfolios As Ideational Identity Resources For High School Students, Mia S. Shaw, Deborah A. Fields, Yasmin B. Kafai

Instructional Technology and Learning Sciences Faculty Publications

The development of student identities—their interests in computer science, perceptions of the discipline, and sense of belonging in the field—is critical for broadening participation of underrepresented groups in computing. This paper reports on the design of portfolios in which two classes of high school students reflected on the process of making electronic textile projects. We examine how students expressed self-authorship in relation to computer science and how the use of reflective portfolios shaped students’ perceptions of computer science. In the discussion we consider how reflective portfolios can serve as ideational resources for computer science identity construction.

Equitable Engagement In Stem: Using E-Textiles To Challenge The Positioning Of Non-Dominant Girls In School Science, Kristin A. Searle, Colby Tofel-Grehl, Janet Breitenstein

Instructional Technology and Learning Sciences Faculty Publications

This paper examines how working with sewable, programmable electronics embedded in textiles (e-textiles) impacted the self-perceptions and actions of two middle school girls from non-dominant communities as they navigated their place within science class. Using analytic induction (Erickson, 1986), we explore the phenomena around their experiences and the influence of their teachers’ perceptions. Findings indicate that the personalizable nature of e-textiles created a meaningful opportunity for students to engage in science class in a new way.

The Ethics Of Play And Participation In A Tween Virtual World: Cheating Practices And Perspectives In The Whyville Community, Yasmin B. Kafai, Deborah A. Fields, Estee Ellis

Instructional Technology and Learning Sciences Faculty Publications

Much attention has been paid to young people’s increased participation in digital publics and its potential impact on their development and learning. However, few studies have examined the ethics in online play and their interactions as a critical aspect in the development of youth digital culture. In this paper we turn to the issue of cheating, a widely accepted practice in many online communities, including Whyville.net, a virtual world with over 5.5 million registered players ages 8-16. Our analyses focused on culturally-relevant examples such as player-written articles on cheating and player-produced YouTube cheating videos associated with Whyville from 2000 to …

The Lifecycle Of Sustainable Analytics: From Data Collection To Change Management, Mitchell Colver

Instructional Technology and Learning Sciences Faculty Publications

In this age of an ever-increasing list of analytics vendors and endlessly forwarded news articles that trumpet the promises of big data in higher education, it can be easy to become distracted by data science and miss out on another opportuni­ty—supporting increased professionalism amongst university staff, faculty, and administrators. Indeed, like many technologies before it, analytics provides us with an opportunity to catalyze institutional effectiveness, but only when we resist the tenden­cy to believe that technology can replace the need for human ingenuity and judgment. This report will argue that such threats to pro­fessional flourishing can be insulated against if …

How Mother And Father Support Affect Youths’ Interest In Computer Science, Jody Clarke-Midura, Frederick J. Poole, Katarina Pantic, Chongning Sun, Vicki Allan

Instructional Technology and Learning Sciences Faculty Publications

Parental support is a predictor of children’s career interest and aspirations. However, mother and father support affects youth career choices differently. To understand how perceived mothers’ and fathers’ support affect career interest in computer science (CS), we developed two path models using both mother and father support gains to predict youths’ interest in CS. We hypothesized that perceived father’s and mother’s support would relate to youths’ interest in CS via youths’ perception of CS utility value as a mediator. We found that both mother and father support leads to interest in CS. However, father support was found to affect CS …

Designing For Online Computer-Based Clinical Simulations: Evaluation Of Instructional Approaches, Ilana Dubovi

Instructional Technology and Learning Sciences Faculty Publications

Background: Online computer-based simulations are becoming more widespread in nursing education. Therefore, an understanding of when and how to implement the variety of instructional strategies related to these simulations is fundamental.

Objectives: This study compares the effectiveness of online computer-based simulations designed using two alternative instructional approaches—Productive Failure and Simple-to-Complex sequencing—on learning of clinical reasoning skills.

Participants: Participants in this study were undergraduate nursing students (n = 103, mean age = 23.4 ± 2.1) enrolled at a university in Israel.

Methods: Participants completed two online simulations designed using Productive Failure approach (emergency medicine, mental health) and two online simulations using …

Does Audience Matter? Comparing Teachers' And Non-Teachers' Application And Perception Of Quality Rubrics For Evaluating Open Educational Resources, Min Yuan, Mimi Recker

Instructional Technology and Learning Sciences Faculty Publications

While many rubrics have been developed to guide people in evaluating the quality of Open Educational Resources (OER), few studies have empirically investigated how different people apply and perceive such rubrics. This study examines how participants (22 teachers and 22 non-teachers) applied three quality rubrics (comprised of a total of 17 quality indicators) to evaluate 20 OER, and how they perceived the utility of these rubrics. Results showed that both teachers and non-teachers found some indicators more difficult to apply, and displayed different response styles on different indicators. In addition, teachers gave higher overall ratings to OER, but non-teachers' ratings …

Putting Making Into High School Computer Science Classrooms: Promoting Equity In Teaching And Learning With Electronic Textiles In Exploring Computer Science, Deborah A. Fields, Yasmin B. Kafai, Tomoko Nakajima, Joanna Goode, Jane Margolis

Instructional Technology and Learning Sciences Faculty Publications

Recent discussions of making have focused on developing out-of-school makerspaces and activities to provide more equitable and enriching learning opportunities for youth. Yet school classrooms present a unique opportunity to help broaden access, diversify representation, and deepen participation in making. In turning to classrooms, we want to understand the crucial practices that teachers employ in broadening and deepening access to making. In this paper, we investigate two high school teachers’ approaches in implementing a novel eight-week, electronic textiles unit within the Exploring Computer Science curriculum, where students designed wearable electronic textile projects with microcontrollers, sensors, and LEDs. We share teachers’ …

Self-Efficacy Change Associated With A Cognitive Load-Based Intervention In An Undergraduate Biology Course, David F. Feldon, Joana Franco, Jie Chao, James Peugh, Cathy Maahs-Fladung

Instructional Technology and Learning Sciences Faculty Publications

Cognitive load theory (CLT) holds that discovery learning and other instructional strategies imposing high levels of extraneous load on novice learners hinder learning. Such learning conditions are also associated with significant drops in persistence, a key measure of motivation. However, research within the CLT framework typically engages motivation as a necessary precursor to learning, rather than as an outcome of instruction. In this study, we examine changes in motivational beliefs as outcomes of learners' cognitive processes through a CLT lens as they engage with instruction. Using a double-blind quasi-experimental design, we manipulate the level of cognitive load imposed on participants …

Approaches To Evaluating Blended Courses, Mateja R. Savoie-Roskos, Stacy Bevan, Rebecca Charlton, Marlene Israelsen Graf

Journal on Empowering Teaching Excellence

Blended learning, sometimes referred to as hybrid or flexible learning, is becoming increasingly common in higher education. Unfortunately, many instructors receive limited training on how to effectively evaluate blended courses, and as a result, commonly rely solely on end-of-semester evaluations. Due to the more complex nature of how blended courses are designed and implemented, instructors should consider utilizing a variety of course evaluation methods. This article includes researched-based approaches for evaluating blended courses based on feedback from students, peers, and instructional designers. This combination of formalized feedback is offered as one strategy to ensure instructors achieve course learning objectives and …

Conjecture Mapping The Library: Iterative Refinements Toward Supporting Maker Learning Activities In Small Community Spaces, Victor R. Lee, Mimi Recker, Abigail L. Phillips

Instructional Technology and Learning Sciences Faculty Publications

A recent and important innovation in design-based research (DBR) is the use of conjecture maps, where researchers explicitly articulate the conjectured mediational relations between their designed goals and the learning designs and contexts. In this paper, we present a design case as an iterative sequence of evolving conjecture maps. As each conjecture map was tested, we revised it to highlight and refine our articulation of the tools and processes that embodied our design approach. Out design case involves small-town and rural community and school libraries in the United States as partners and DBR sites, with the goal of supporting librarians …

Personal Analytics Explorations To Support Youth Learning, Victor R. Lee

Instructional Technology and Learning Sciences Faculty Publications

While personalized learning environments often include systems that automatically adapt to inferred learner needs, other forms of personalized learning exist. One form involves the use of personal analytics in which the learner obtains and analyzes data about himself/herself. More known in informatics communities, there is potential for use of personal analytics for design of instruction. This chapter provides two cases of personal analytics learning explorations to demonstrate their range and potential. One case is of a high school student examining how sleep influences her mood. The other case is of a sixth-grade class of students examining how deviations from typical …

Data Use By Middle And Secondary Students In The Digital Age: A Status Report And Future Prospects, Victor R. Lee, Michelle H. Wilkerson

Instructional Technology and Learning Sciences Faculty Publications

What it means to work with data has changed significantly since the preparation and publication of America’s Lab Report(Singer, Hilton, & Schweingruber, 2006)in ways that are impacting students, educators, and the very practice of science. This change is expressing itself most obviously in the abundance of data that can be collected and accessed by students and teachers. There are also notable changes in the types of data (e.g., GPS data, network data, qualitative/verbal data) that are now readily available, and the purposes for which data are collected and analyzed. These shifts have both generated enthusiasm and raised a number …

A Bayesian Network Meta-Analysis To Synthesize The Influence Of Contexts Of Scaffolding Use On Cognitive Outcomes In Stem Education, Brian Robert Belland, Andrew Walker, Nam Ju Kim

Instructional Technology and Learning Sciences Faculty Publications

Computer-based scaffolding provides temporary support that enables students to participate in and become more proficient at complex skills like problem solving, argumentation, and evaluation. While meta-analyses have addressed between-subject differences on cognitive outcomes resulting from scaffolding, none has addressed within-subject gains. This leaves much quantitative scaffolding literature not covered by existing meta-analyses. To address this gap, this study used Bayesian network meta-analysis to synthesize within-subjects (pre–post) differences resulting from scaffolding in 56 studies. We generated the posterior distribution using 20,000 Markov Chain Monte Carlo samples. Scaffolding has a consistently strong effect across student populations, STEM (science, technology, engineering, and mathematics) …

Stitching Codeable Circuits: High School Students' Learning About Circuitry And Coding With Electronic Textiles, Breanne Krystine Litts, Yasmin B. Kafai, Debora A. Lui, Justice T. Walker, Sari A. Widman

Instructional Technology and Learning Sciences Faculty Publications

Learning about circuitry by connecting a battery, light bulb, and wires is a common activity in many science classrooms. In this paper, we expand students’ learning about circuitry with electronic textiles, which use conductive thread instead of wires and sewable LEDs instead of lightbulbs, by integrating programming sensor inputs and light outputs and examining how the two domains interact.We implemented an electronic textiles unit with 23 high school students ages 16–17 years who learned how to craft and code circuits with the LilyPad Arduino, an electronic textile construction kit. Our analyses not only confirm significant increases in students’ understanding of …

Interview And Focus Groups Analysis Of Decreased Composite Benchmark Scores On Dynamic Indicators Of Basic Early Literacy Skills Dibels From Kindergarten To First Grade Students, Loreen Flanary

All Graduate Plan B and other Reports, Spring 1920 to Spring 2023

School districts in the state of Utah are required to use Dynamic Indicators of Basic Literacy Skills (DIBELS) as an assessment of reading ability for students in kindergarten through fifth grade. The Logan City School District (LCSD) kindergarten end of year (EOY) Composite DIBELS data have been strong over the past 5 years with over 90% of students scoring at benchmark. In comparison, in each of those 5 years, first grade beginning of year (BOY) data drops considerably. LCSD is concerned with this trend because it is larger than the state trend of 13-14%, the trend is increasing, and this …

Learning Analytics: Shifting From Theory To Practice., Courtney Stewart

Journal on Empowering Teaching Excellence

As online and blended learning continues to increase in higher education, so does the amount of data that is housed within Learning Management Systems that can be analyzed and processed within the framework of Learning Analytics. Learning Analytics is a new and developing field. As with many new fields of study, a gap between theory and practice is evident. Some attribute this gap to the lack of situating learning analytics within learning theory. In order for Learning Analytics to find interest and usability among educators, a shift is needed from the technical use to practical application. In this theoretical paper …

Time-To-Credit Gender Inequities Of First-Year Phd Students In The Biological Sciences, David F. Feldon, James Peugh, Michelle A. Maher, Josipa Roksa, Colby Tofel-Grehl

Instructional Technology and Learning Sciences Faculty Publications

Equitable gender representation is an important aspect of scientific workforce development to secure a sufficient number of individuals and a diversity of perspectives. Biology is the most gender equitable of all scientific fields by the marker of degree attainment, with 52.5% of PhDs awarded to women. However, equitable rates of degree completion do not translate into equitable attainment of faculty or postdoctoral positions, suggesting continued existence of gender inequalities. In a national cohort of 336 first-year PhD students in the biological sciences (i.e., microbiology, cellular biology, molecular biology, develop-mental biology, and genetics) from 53 research institutions, female participants logged significantly …

An Assessment Instrument Of Technological Literacies In Makerspaces And Fablabs, Paulo Blikstein, Zaza Kabayadondo, Andrew Martin, Deborah A. Fields

Instructional Technology and Learning Sciences Faculty Publications

Background

As the maker movement is increasingly adopted into K‐12 schools, students are developing new competences in exploration and fabrication technologies. This study assesses learning with these technologies in K‐12 makerspaces and FabLabs.

Purpose

Our study describes the iterative process of developing an assessment instrument for this new technological literacy, the Exploration and Fabrication Technologies Instrument, and presents findings from implementations at five schools in three countries. Our index is generalizable and psychometrically sound, and permits comparison between student confidence and performance.

Design/Method

Our evaluation of distinct technology skills separates general computing, information and communication technology (ICT), and exploration and …

Engaging Everyday Science Knowledge To Help Make Sense Of Data, Susan B. Kelly, Luettamae Lawrence, Emma Mercier

Instructional Technology and Learning Sciences Faculty Publications

Making sense of data to inform decisions is an important skill emphasized in current curriculum documents (NRC, 2012). Making sense of data through personal experiences and prior knowledge is one way that students can begin to understand multiple and unfamiliar data sources. This paper examines how middle school students used different data sources when engaged in a collaborative problem solving activity using a multi-touch table during classroom science instruction. In this study, we found that students made personal connections when talking about data. Students engaged in data talk across all conversation quality levels, but the ways students interacted and talked …

From Wearing To Wondering: Treating Wearable Activity Trackers As Objects Of Inquiry, Joel R. Drake, Ryan Cain, Victor R. Lee

Instructional Technology and Learning Sciences Faculty Publications

Wearable technologies represent a rapidly expanding category of consumer information and communications technologies. From smartwatches to activity tracking devices, wearables are finding their way into many aspects of our lives, changing the way we think about ourselves and the world around us. The rapid adoption of these tools in everyday life hints at the possibilities these devices may hold in school and other educational settings. Drawing on examples taken from a five-year study using wearable fitness tracking devices in elementary and middle school classrooms, this paper presents two examples of how wearable devices can be appropriated for use in school …

Appropriating Quantified Self Technologies To Support Elementary Statistical Teaching And Learning, Victor R. Lee, Joel R. Drake, Jeffrey L. Thayne

Instructional Technology and Learning Sciences Faculty Publications

Wearable activity tracking devices associated with the Quantified Self movement have potential benefit for educational settings because they produce authentic and granular data about activities and experiences already familiar to youth. This article explores how that potential could be realized through explicit acknowledgment of and response to tacit design assumptions about how such technologies will be used in practice and strategic design for use in a classroom. We argue that particular practical adaptations that we have identified serve to ensure that the classroom and educational use cases are appropriately considered. As an example of how those adaptations are realized in …

An Embodied Agent Helps Anxious Students In Mathematics Learning, Yanghee Kim, Jeffrey L. Thayne, Quan Wei

Instructional Technology and Learning Sciences Faculty Publications

Mathematics anxiety is known to be detrimental to mathematics learning. This study explored if an embodied agent could be used to help alleviate student anxiety in classrooms. To examine this potential, agent-guided algebra lessons were developed, in which an animated agent was equipped with prescriptive instructional guidance and anxiety treating messages. The lessons were deployed in regular mathematics classrooms, one lesson per day over a week, with 138 boys and girls in the 9th grade in the United States. After taking the weeklong agent-based lessons, students decreased in their mathematics anxiety (p = .042) and increased in mathematics learning …

A Mixed-Method Study Of Mobile Devices And Student Self-Directed Learning And Achievement During A Middle School Stem Activity, Scott Bartholomew

All Graduate Theses and Dissertations, Spring 1920 to Summer 2023

With the increasingly ubiquitous nature of mobile devices among K-12 students, many argue for and against the inclusion of these devices in K-12 classrooms. Arguments in favor cite instant access to information and collaboration with others as positive affordances made possible through mobile devices. Self-directed learning, a process where individuals take charge of their learning and decide what they will learn, how they learn it, and how they assess their learning, has been identified as an increasingly important trait for K-12 students. The relationship between mobile device access in K-12 education settings and student self-directed learning has not been explored. …

Coding By Choice: A Transitional Analysis Of Social Participation Patterns And Programming Contributions In The Online Scratch Community, Deborah A. Fields, Yasmin B. Kafai, Michael T. Giang

Instructional Technology and Learning Sciences Faculty Publications

While massive online communities have drawn the attention of researchers and educators on their potential to support active collaborative work, knowledge sharing, and user-generated content, few studies examine participation in these communities at scale. The little research that does exist attends almost solely to adults rather than communities to support youths’ learning and identity development. In this chapter, we tackle two challenges related to understanding social practices that support learning in massive social networking forums where users engage in design. We examined a youth programmer community, called Scratch.mit.edu, that garners the voluntary participation of millions of young people worldwide. We …