Software Engineering Commons^™

Developing Narrative-Based Stem Learning Tool For K-6 Visually Impaired Students, Daniel Tsivkovski, Dylan Ravel, Jeffrey Kraskouskas, Brandon Foley, Maryam Etezad, Franceli Cibrian, Rajeev Joshi, Ariel Han

Student Scholar Symposium Abstracts and Posters

This research develops a free, accessible web application that enables K-6 students who are blind or visually impaired (BVI) to learn STEM concepts using refreshable braille displays. Currently, most online learning tools are not designed for BVI students, creating a significant educational barrier.

The application interfaces with commercial braille displays and uses narrative-based learning to make STEM content approachable and engaging. By presenting material as personalized interactive stories generated with the help of Artificial Intellligence (AI), students can connect with concepts while developing braille reading skills. The curriculum design prioritizes accessibility through the Accessible Rich Internet Applications (ARIA) standards and …

Developing Accessible Narrative-Based Stem Learning Software For K-6 Braille Display Users, Dylan Ravel, Daniel Tsivkovski, Brandon Foley, Maryam Etezad, Franceli Cibrian, Ariel Han, Rajeev Joshi

Student Scholar Symposium Abstracts and Posters

This research develops a free, accessible web application that enables K-6 students who are blind or visually impaired (BVI) to learn STEM concepts using refreshable braille displays. Currently, most online learning tools are not designed for BVI students, creating a significant educational barrier.

The application interfaces with commercial braille displays and uses narrative-based learning to make STEM content approachable and engaging. By presenting material as interactive stories, students can connect with concepts while developing braille reading skills. The curriculum design prioritizes accessibility through the Accessible Rich Internet Applications (ARIA) standards and screen reader support.

The goal is to provide BVI …

Development Of Interactive Games On An Affordable Braille Display, Daniel Tsivkovski, Dylan Ravel, Maryam Etezad

Student Scholar Symposium Abstracts and Posters

Developing an affordable and STEM learning-focused Braille display addresses a significant disparity in the market for Braille displays, where most fail to provide a cost-effective, accessible, and education-oriented solution. This research aims to bridge this gap through innovative hardware and software development, offering a comprehensive learning experience to elementary school children (K-6) who are blind/visually impaired. The hardware features a piezo-electric tactile display that displays up to six Braille characters at once or a shape in an 8x8 pin array configuration. The educational software includes a user-friendly website packed with engaging STEM activities specifically designed for blind/visually impaired children. The …

Reducing Stigma Around Neurodiversity Through The Use Of Celebratory Technology Ice Breakers In First-Year Undergraduate Classrooms, Briana Craig

Electrical Engineering and Computer Science (MS) Theses

Celebratory technology for Neurodiversity is a new paradigm in the field of human computer interaction; it focuses on reducing stigma surrounding neurodivergent labels and behaviors. Celebratory technology aims to highlight the strengths of neurodiversity rather than fixing socially undesired traits, shifting the responsibility for change from neurodivergent individuals to society's attitudes. Stigma reduction can be accomplished through providing high quality interactions, where anyone can meet and learn about positive traits in others as well as learn of interests' others have in common, thus reframing neurodivergence as inclusion in human diversity rather than a condition to be stigmatized or objectified. This …

Dancetag: Using Sensors To Improve Feedback Given To Dance Students, Yanelly Mego, Franceli L. Cibrian

Student Scholar Symposium Abstracts and Posters

The structure of dance classrooms has remained largely unchanged for years, with minimal integration of technology to enhance teaching. This has motivated our research project, which aims to capture dance movements using wearable sensors and translate the information into meaningful visualizations to help dancers improve their skills. As the first step in addressing the research question—can data from commercial wearables differentiate between the movements of dancers and non-dancers?—we developed DANCETAG (Data Analytics and Notation with Captured Event Tagging), a platform designed for data collection and movement annotation. We utilized Sony’s Mocopi sensors, a motion capture system with six sensors attached …

Software Implementations And Analyses Of The Emotional Impact Of Various Binaural Beat Classifications Layered Into Music., Neil Azimi

Student Scholar Symposium Abstracts and Posters

This study explores the psychoacoustic effects of binaural beats, which are produced when sinusoidal waves of slightly differing frequencies are played into each ear, leading to brainwave entrainment. Binaural beats are categorized by frequency bands (e.g., Beta: 14–30 Hz for energy, Theta: 4–8 Hz for relaxation), each associated with different psychological effects. This research contributes to the field by empirically analyzing whether binaural beats alter the emotional impact of music. Past studies have investigated the potential benefits of binaural beats in relaxation and energy stimulation. However, their effects, when combined with music, especially regarding a song's perceived emotional quality or …

How Do Preservice Teachers Learn To Teach Integrated Computational Thinking?: Evidence From Planning, Enactment, And Reflection, Rachael Dektor, Samuel Severance, Kip Téllez

Journal of Computer Science Integration

This study examines pre-service teachers’ (PSTs) beliefs and understandings about computational thinking (CT) integration and lesson implementation over time. Utilizing a design-based research approach, 3 PSTs led the co-design of integrated CT lessons with support from researchers and enacted these CT integrated lessons with K-5 students. All PSTs participated in a whole-group CT workshop and engaged in one-on-one lesson design sessions with a researcher. We utilized a grounded theory approach to qualitatively analyze pre-surveys, semi-structured interviews, and video data of three PSTs enacting their lessons. We found that PSTs’ initial beliefs about CT instruction – including the importance of it …

Dancetag: Using Sensors To Improve Feedback Given To Dance Students, Yanelly Mego

Student Scholar Symposium Abstracts and Posters

The structure of dance classrooms has remained unchanged for several years. Very little, if any, technology has been incorporated to improve the quality of teaching. This has motivated our research project, whose goal is to capture dance movements with wearable sensors, to develop DANCETAG (Data Analytics and Notation with Captured Event Tagging). This is a platform that allows the gathering of data captured by Sony’s Mocopi sensors and annotating them with the dancer's movements. The Mocopi sensors make up a motion capture system. It is comprised of six small, round sensors that can be attached to velcro straps and clips. …

Broadening Participation Of Teachers In Computing: Examining Postsecondary Educational Experiences And Prospective Educators’ Cs Teaching Interests, Robert Schwarzhaupt, Alexsandra Galanis, Joanna Goode, Kate Blanchard, Jill Bowdon, Joseph P. Wilson

Journal of Computer Science Integration

Teacher shortages in K–12 computer science (CS) education negatively impact students’ access to CS courses, exposure to CS concepts, and interest in CS-related careers. To address CS teacher shortages, this study seeks to understand factors related to expressing a preference to teach CS among prospective teachers. The study team analyzed data from 27,700 prospective teacher applications accepted into the 2016–2020 Teach For America (TFA) corps (cohorts). The TFA corps is an alternative teacher development program that recruits and prepares participants to obtain their teaching certification while they work for at least two years in underserved communities on a temporary teaching …

Piecing Together Performance: Collaborative, Participatory Research-Through-Design For Better Diversity In Games, Daniel L. Gardner, Louanne Boyd, Reginald T. Gardner

Engineering Faculty Articles and Research

Digital games are a multi-billion-dollar industry whose production and consumption extend globally. Representation in games is an increasingly important topic. As those who create and consume the medium grow ever more diverse, it is essential that player or user-experience research, usability, and any consideration of how people interface with their technology is exercised through inclusive and intersectional lenses. Previous research has identified how character configuration interfaces preface white-male defaults [39, 40, 67]. This study relies on 1-on-1 play-interviews where diverse participants attempt to create “themselves” in a series of games and on group design activities to explore how participants may …

A Critical Computing Curriculum Design Case: Exploring Tribal Sovereignty For Middle School Students, Kristin A. Searle, Aubrey Rogowski, Colby Tofel-Grehl, Mengying Jiang

Journal of Computer Science Integration

We report on our efforts to design an integrated computing curriculum for middle school students in Montana that is in line with the Kapor Center’s focus on culturally sustaining-revitalizing pedagogies. Montana provides a unique context for doing this work because a state constitutional mandate requires all K-12 students to learn about tribal histories and cultures through Indian Education For All (IEFA). IEFA centers around seven essential understandings about Indigenous peoples in Montana that are integrated across content areas. In addition, implementation of Montana’s CS standards began in the 2021–2022 school year. In the curricular design, we sought to bring together …

Employing An Abolitionist, Critical Race Pedagogy In Cs: Centering The Voices, Experiences And Technological Innovations Of Black Youth, Tiera Tanksley

Journal of Computer Science Integration

This paper proposes a pedagogical extension of culturally responsive praxis called abolitionist, critical race pedagogy in CS. To showcase the power and potentiality of this pedagogy, this paper examines the experiences of 2 cohorts of Black high school students (n = 30) who participated in a critical race technology course that was taught during the dual pandemic of COVID-19 and anti-Black racism. The goal of this summer course was to employ an abolitionist, critical race pedagogy in CS to foster Black students’ ability to critically examine the ubiquity of anti-Black racism within the socio-technical architectures (e.g. code, data, algorithms and …

Culturally Responsive-Sustaining Computational Thinking: Enactment In Elementary Classrooms, Victoria Macann, Aman Yadav

Journal of Computer Science Integration

Technology has increasingly permeated many aspects of everyday life and this evolution raises the need for individuals to understand how the digital world works and what opportunities and risks it brings (Nouri, Zhang, Mannila & Norén, 2019). For this to be an experience for everyone, we need to rethink how we integrate computational thinking (CT) and provide teachers with tools to center their students’ identities, experiences, and cultures in the classroom. In this paper, we present two case studies of primary (elementary) teachers from a full primary (student ages 5–13) semi-rural school in the North Island of New Zealand that …

Teacher Candidates’ Conceptions And Practices Of Computational Thinking For Equity, Heather F. Clark, Symone A. Gyles, Imelda Nava-Landeros

Journal of Computer Science Integration

This study documents novice science and math teachers’ developing pedagogical approaches to integrating computational thinking (CT) and data into their courses to support educational equity and social justice. The 10 novice teacher candidates (TCs) studied were part of an urban teacher residency program that empowered them with an asset-based pedagogy we describe as “CT for Equity.” Drawing on coursework and interviews as data, we asked three questions: What are teachers’ conceptions of CT? What are their CT instructional practices? And how did their students respond to those practices? To explore conceptions of CT, we used Kafai et al.’s (2020) articulation …

Asset-Based Approaches To Multilingual Students’ Computer Science Identity Development, Sharin Rawhiya Jacob, Mark Warschauer

Journal of Computer Science Integration

While computer science identity development has been examined in several studies, there is much to learn about the development of multilingual students’ computer science (CS) identities. To develop strong CS identities, multilingual students must engage in culturally and linguistically sustaining curriculum, pedagogy, and interaction that draws from their rich and varied resources. This theoretical paper is grounded in a justice-centered, asset-based framework that views the traditions and practices in students’ cultures and communities as strong contributors to knowledge construction in STEM. We draw on multiple studies exploring multilingual student CS identity development to better understand how their personal, familial, community-based, …

Wind River Elementary Computer Science Collaborative: Connecting Computer Science And Indigenous Identities And Knowledges On The Wind River Reservation, Joseph P. Wilson, Kathryn M. Rich, Jared O'Leary, Veronica Miller

Journal of Computer Science Integration

Three Northern Arapaho and Eastern Shoshone–serving districts formed a researcher–practitioner partnership with the Wyoming Department of Education, the American Institutes for Research®, and BootUp Professional Development to advance the computer science (CS) education of their elementary students in ways that strengthen their Indigenous identities and knowledges. In this paper, we share experiences from 2019 to 2022 with our curriculum development, professional development (PD), and classroom implementation. The researcher–practitioner partnership developed student and teacher materials to support elementary CS lessons aligned to Wyoming’s CS standards and “Indian Education for All” social studies standards. Indigenous community members served as experts to codesign …

Near Peer Pedagogies For Culturally Sustaining Computer Science And Mathematics, Cliff Freeman, Eli Tucker-Raymond, Juan Gutierrez

Journal of Computer Science Integration

In this study, College STEM Literacy Workers act as co-teachers in 9th and 10th grade classrooms alongside mathematics teachers as they both learn to integrate a 30-hour integrated computer science/mathematics curriculum. As part of the curriculum for educator learning, we adapted the Algebra Project’s “Model of Excellence” for culturally relevant-sustaining pedagogies. We used the framework to explore how teachers understand College STEM Literacy Workers’ contributions in the model as well as College STEM Literacy Workers’ own experiences in the classroom. We found that while teachers and College STEM Literacy Workers did not individually instantiate the model of excellence, they were …

Visualizing Transaction-Level Modeling Simulations Of Deep Neural Networks, Nataniel Farzan, Emad Arasteh

Engineering Technical Reports

The growing complexity of data-intensive software demands constant innovation in computer hardware design. Performance is a critical factor in rapidly evolving applications such as artificial intelligence (AI). Transaction-level modeling (TLM) is a valuable technique used to represent hardware and software behavior in a simulated environment. However, extracting actionable insights from TLM simulations is not a trivial task. We present Netmemvisual, an interactive, cross-platform visualization tool for exposing memory bottlenecks in TLM simulations. We demonstrate how Netmemvisual helps system designers rapidly analyze complex TLM simulations to find memory contention. We describe the project’s current features, experimental results with two state-of-the-art deep …

Multi-Scale Attention Networks For Pavement Defect Detection, Junde Chen, Yuxin Wen, Yaser Ahangari Nanehkaran, Defu Zhang, Adan Zeb

Engineering Faculty Articles and Research

Pavement defects such as cracks, net cracks, and pit slots can cause potential traffic safety problems. The timely detection and identification play a key role in reducing the harm of various pavement defects. Particularly, the recent development in deep learning-based CNNs has shown competitive performance in image detection and classification. To detect pavement defects automatically and improve effects, a multi-scale mobile attention-based network, which we termed MANet, is proposed to perform the detection of pavement defects. The architecture of the encoder-decoder is used in MANet, where the encoder adopts the MobileNet as the backbone network to extract pavement defect features. …

Designing An Equity-Centered Framework And Crosswalk For Integrated Elementary Computer Science Curriculum And Instruction, Carla Strickland, Andrea Ramírez-Salgado, Lauren Weisberg, Latoya Chandler, Jeanne Di Domenico, Elizabeth M. Lehman, Maya Israel

Journal of Computer Science Integration

As computer science (CS) education becomes more prevalent in K-12 instruction, it is critical for educators, researchers, and curriculum developers to identify culturally responsive and pedagogically inclusive approaches that can increase participation, access, and feelings of belonging for students from historically marginalized communities. In response, we developed an equity-centered curricular framework and illustrative crosswalk that synchronizes three distinct pedagogical approaches: culturally responsive pedagogy (CRP), Universal Design for Learning (UDL), and project-based learning (PBL). We describe the framework’s theoretical underpinnings and explain how this framework informed the development of an integrated elementary science+CS curricular unit and provide examples of its implementation. …

Large-Scale Identification And Analysis Of Factors Impacting Simple Bug Resolution Times In Open Source Software Repositories, Elia Eiroa-Lledo, Rao Hamza Ali, Gabriela Pinto, Jillian Anderson, Erik Linstead

Engineering Faculty Articles and Research

One of the most prominent issues the ever-growing open-source software community faces is the abundance of buggy code. Well-established version control systems and repository hosting services such as GitHub and Maven provide a checks-and-balances structure to minimize the amount of buggy code introduced. Although these platforms are effective in mitigating the problem, it still remains. To further the efforts toward a more effective and quicker response to bugs, we must understand the factors that affect the time it takes to fix one. We apply a custom traversal algorithm to commits made for open source repositories to determine when “simple stupid …

Comparing Boys’ And Girls’ Attitudes Toward Computer Science, Danielle Scott, Amiee Zou, Sharin Rawhiya Jacob, Debra Richardson, Mark Warschauer

Journal of Computer Science Integration

Women are severely underrepresented in computer science (CS) degrees and careers. While student interest is a key predictor of success, little is known about how elementary students from underserved groups, such as girls, develop their interest in CS. To address this issue, we examined the differences in attitudes between upper elementary girls and boys towards CS after participating in a yearlong, inquiry-based CS curriculum designed for diverse learners. Pre-and-post surveys on students’ attitudes towards CS (n = 108) were delivered before and after student participation in the curriculum. Results from the survey showed only two demonstrated significant differences between boys …

Examining Early Elementary Computer Science Identity Repertoires Within A Curriculum: Implications For Epistemologically Pluralistic Identities, Eleanor Richard, Shakhnoza Kayumova

Journal of Computer Science Integration

As computer science (CS) enters an increasing number of elementary classrooms, researchers must investigate the representations of what kinds of people are presented as doing computer science within CS curricula. In this paper, we explore a widely used, freely accessible, web-based, early elementary CS curriculum to examine the kinds of identity repertoires (behaviors, actions, skills, and socioemotional norms) that are promoted as representative of being/becoming a CS person. More specifically, we draw on identity studies and employ critical discourse analysis to examine how the kinds of norms and repertoires of CS practice made available in the curricular materials might construct …

Integrating Computing Into Preservice Teacher Preparation Programs Across The Core: Language, Mathematics, And Science, Lauren E. Margulieux, Patrick Enderle, Pier Junor Clarke, Natalie King, Caroline Sullivan, Michelle Zoss, Joyce Many

Journal of Computer Science Integration

This paper describes the beginning of a design-based research project for integrating computing activities in preservice teacher programs throughout a middle and secondary education department. Computing integration activities use computing tools, like programming, to support learning in non-computing disciplines. The paper begins with the motivation for integrating computing that encouraged widespread buy-in, design goals, and design parameters. The primary motivating factor for this work was preparing teachers to use technology to support learning in their classrooms. Involving computing education faculty in the preparation enabled the activities to include computer science and spread computational literacy. The paper also describes the process …

Perturbation Modeling For Molecular Design Of Protein Tyrosine Kinase Inhibitors Using Unsupervised Machine Learning, Keerthi Krishnan

Computational and Data Sciences (MS) Theses

The field of computational drug discovery and development has grown, with the aid of new computational tools for novel molecule discovery. In specific, generative deep learning models have excelled as tools to aid in navigating the large space of known molecules and in the creation of new molecules. These models are fed various representations of molecules as inputs and learn to perform a variety of things, such as the optimization of these molecules towards a targeted property. Ultimately, these generative learning models allow us to build bridges between chemical and continuous spaces to understand the compromise between invoking small incremental …

Preparing School Leaders To Advance Equity In Computer Science Education, Julie Flapan, Jean J. Ryoo, Roxana Hadad, Joel Knudson

Journal of Computer Science Integration

Background and Context: Most large-scale statewide initiatives of the Computer Science for All (CS for All) movement have focused on the classroom level. Critical questions remain about building school and district leadership capacity to support teachers while implementing equitable computer science education that is scalable and sustainable.

Objective: This statewide research-practice partnership, involving university researchers and school leaders from 14 local education agencies (LEA) from district and county offices, addresses the following research question: What do administrators identify as most helpful for understanding issues related to equitable computer science implementation when engaging with a guide and workshop we …

Teachers’ Engagement And Self-Efficacy In A Pk–12 Computer Science Teacher Virtual Community Of Practice, Robert Schwarzhaupt, Feng Liu, Joseph Wilson, Fanny Lee, Melissa Rasberry

Journal of Computer Science Integration

Prekindergarten to 12th-grade teachers of computer science (CS) face many challenges, including isolation, limited CS professional development resources, and low levels of CS teaching self-efficacy that could be mitigated through communities of practice (CoPs). This study used survey data from 420 PK–12 CS teacher members of a virtual CoP, CS for All Teachers, to examine the needs of these teachers and how CS teaching self-efficacy, community engagement, and sharing behaviors vary by teachers’ instructional experiences and school levels taught. Results show that CS teachers primarily join the CoP to gain high-quality pedagogical, assessment, and instructional resources. The study also found …

On-Device Deep Learning Inference For System-On-Chip (Soc) Architectures, Tom Springer, Elia Eiroa-Lledo, Elizabeth Stevens, Erik Linstead

Engineering Faculty Articles and Research

As machine learning becomes ubiquitous, the need to deploy models on real-time, embedded systems will become increasingly critical. This is especially true for deep learning solutions, whose large models pose interesting challenges for target architectures at the “edge” that are resource-constrained. The realization of machine learning, and deep learning, is being driven by the availability of specialized hardware, such as system-on-chip solutions, which provide some alleviation of constraints. Equally important, however, are the operating systems that run on this hardware, and specifically the ability to leverage commercial real-time operating systems which, unlike general purpose operating systems such as Linux, can …

Applications Of Machine Learning To Facilitate Software Engineering And Scientific Computing, Natalie Best

Computational and Data Sciences (PhD) Dissertations

The use of machine learning has risen in recent years, though many areas remain unexplored due to lack of data or lack of computational tools. This dissertation explores machine learning approaches in case studies involving image classification and natural language processing. In addition, a software library in the form of two-way bridge connecting deep learning models in Keras with ones available in the Fortran programming language is also presented.

In Chapter 2, we explore the applicability of transfer learning utilizing models pre-trained on non-software engineering data applied to the problem of classifying software unified modeling language diagrams where data is …

Exploring The Efficacy Of Transfer Learning In Mining Image‑Based Software Artifacts, Natalie Best, Jordan Ott, Erik J. Linstead

Engineering Faculty Articles and Research

Background

Transfer learning allows us to train deep architectures requiring a large number of learned parameters, even if the amount of available data is limited, by leveraging existing models previously trained for another task. In previous attempts to classify image-based software artifacts in the absence of big data, it was noted that standard off-the-shelf deep architectures such as VGG could not be utilized due to their large parameter space and therefore had to be replaced by customized architectures with fewer layers. This proves to be challenging to empirical software engineers who would like to make use of existing architectures without …