Other Computer Engineering Commons^™

Harmonicthreads: A Formative Evaluation Of A Fabric-Based Digital Musical Instrument Toward Inclusive Music-Making, Ellie Nguyen, Franceli L. Cibrian

Engineering Faculty Articles and Research

Background:

Inclusive music-making requires instruments that support varied bodies, abilities, musical backgrounds, and forms of participation. Digital musical instruments provide diverse approaches to sound creation, and fabric-based interfaces offer an alternative interaction modality that may support participation for some users and contexts. Their tactile and deformable properties enable forms of interaction that differ from conventional rigid or screen-based controllers and may offer inclusive possibilities in particular settings.

Objective:

This paper presents HarmonicThreads as a formative interaction-design case of a fabric-based digital musical instrument. The prototype explores how tactile cues, fabric deformation, projected visual feedback, and assisted accompaniment can support low-barrier …

Evaluating Team Formation Strategies With Algorithms, Ethan E. Lopez, Andy Vo

Student Scholar Symposium Abstracts and Posters

Effective teamwork is essential for collaborative learning, yet forming compatible student groups remains a persistent challenge. This study explores how algorithmic team-building methods influence students’ social and academic compatibility overtime. To support this investigation, we designed a visual survey system called “The Disco Ball." Evaluating work ethics, lifestyles, behaviors, and communication styles, students were initially assigned to project teams using one of three conditions: (1) random assignment (control), (2) a “most matches” condition maximizing similarity between students, and (3) a “diverse communication styles” condition designed to balance differing interaction preferences. After an initial collaboration period, students were given the opportunity …

Parentcoach: Designing An Mhealth Parenting App To Enhance Parental Involvement In Adhd Support, Franceli L. Cibrian, Nancy Herrera, Jesus A. Beltran, Lucas M. Silva, Mikaela Pulse, Kayla Anderson, Cassie Zeiler, Luc Rieffel, Daniel I. Lee, Sabrina E. B. Schuck, Kimberley D. Lakes

Engineering Faculty Articles and Research

Introduction: Parents play a vital role in supporting self-regulation and managing behaviors in children with Attention-Deficit/Hyperactivity Disorder (ADHD). However, many face barriers to accessing consistent, evidence-based support. Mobile health (mHealth) technologies offer a promising way to deliver flexible, low-burden guidance for parents on best practices and strategies to support their children's self-regulation. However, designing them is non-trivial.

Objective: This paper introduces ParentCoach, a mobile application designed to support parents of children with ADHD through brief daily lessons, reflection prompts, and skill-building activities.

Methods: ParentCoach was developed in two phases: (1) secondary analysis of qualitative data from over 30 families …

Design Considerations For Conversational Agents To Assess The Social-Emotional Well-Being Of Young Children In Low-Income South African Communities, Lucretia A. Williams, Elizabeth A. Ankrah, Catherine E. Draper, Caylee J. Cook, Franceli L. Cibrian, Jesus A. Beltran, Kimberley D. Lakes, Gillian R. Hayes

Engineering Faculty Articles and Research

A variety of digital technologies have been used to support early childhood development (ECD) programs in low-income South African communities. Even though technology has provided opportunities to increase access to health interventions, the lack of trust and socio-economic constraints under which these tools would need to work pose complex challenges. We examine home visitors’ work processes, experiences, and preferences of a conversational agent to support their work of administering social-emotional well-being assessments to young children ages 0-5. Analysis of the results of focus groups with 51 home visitors indicates the need for designing conversational agents that support ECD in the …

Harmonicthreads – An Interface That Supports Accessibility In Musical Interaction, Ellie Nguyen, Miyuki Weldon, Franceli L. Cibrian

Engineering Faculty Articles and Research

Traditional musical instruments often can create boundaries due to their cost, training, mobility, and cognitive requirements, making musical expression inaccessible. To address this challenge, we developed HarmonicThreads, a novel pervasive computing interface consisting of a responsive, flexible fabric. HarmonicThreads provides a tactile and auditory experience, allowing users to easily create and control sounds. Using embedded sensors and real-time processing, HarmonicThreads interprets the user's natural movements and interactions to create adaptable musical outputs. This enables context-aware musical interaction, demonstrating the potential of pervasive interfaces in reducing barriers and making musical expression more accessible.

Feasibility And Acceptability Of The Mazi Umntanakho Digital Tool In South African Settings: A Qualitative Evaluation, Catherine E. Draper, Caylee J. Cook, Elizabeth A. Ankrah, Jesus A. Beltran, Franceli L. Cibrian, Kimberley D. Lakes, Hanna Mofid, Lucretia Williams, Gillian R. Hayes

Engineering Faculty Articles and Research

To address the need for interventions targeting social emotional development and mental health of young children in South Africa, the Mazi Umntanakho (‘know your child’) digital tool was co-designed, and piloted with caregivers and 3–5-year-old children involved in home visiting programmes promoting early childhood development. The aim of this study was to qualitatively evaluate the feasibility and acceptability of this tool in four urban and four rural low-income communities, from the perspective of home visitors and caregivers. Focus groups were conducted with home visitors (n = 117) and caregivers (n = 72). Issues relating to the feasibility of …

Digital Assessments For Children And Adolescents With Adhd: A Scoping Review, Franceli L. Cibrian, Elissa M. Monteiro, Kimberley D. Lakes

Engineering Faculty Articles and Research

Introduction: In spite of rapid advances in evidence-based treatments for attention deficit hyperactivity disorder (ADHD), community access to rigorous gold-standard diagnostic assessments has lagged far behind due to barriers such as the costs and limited availability of comprehensive diagnostic evaluations. Digital assessment of attention and behavior has the potential to lead to scalable approaches that could be used to screen large numbers of children and/or increase access to high-quality, scalable diagnostic evaluations, especially if designed using user-centered participatory and ability-based frameworks. Current research on assessment has begun to take a user-centered approach by actively involving participants to ensure the development …

M3t-Lm: A Multi-Modal Multi-Task Learning Model For Jointly Predicting Patient Length Of Stay And Mortality, Junde Chen, Qing Li, Feng Liu, Yuxin Wen

Engineering Faculty Articles and Research

Ensuring accurate predictions of inpatient length of stay (LoS) and mortality rates is essential for enhancing hospital service efficiency, particularly in light of the constraints posed by limited healthcare resources. Integrative analysis of heterogeneous clinic record data from different sources can hold great promise for improving the prognosis and diagnosis level of LoS and mortality. Currently, most existing studies solely focus on single data modality or tend to single-task learning, i.e., training LoS and mortality tasks separately. This limits the utilization of available multi-modal data and prevents the sharing of feature representations that could capture correlations between different tasks, ultimately …

Toward Intuitive 3d Interactions In Virtual Reality: A Deep Learning- Based Dual-Hand Gesture Recognition Approach, Trudi Di Qi, Franceli L. Cibrian, Meghna Raswan, Tyler Kay, Hector M. Camarillo-Abad, Yuxin Wen

Engineering Faculty Articles and Research

Dual-hand gesture recognition is crucial for intuitive 3D interactions in virtual reality (VR), allowing the user to interact with virtual objects naturally through gestures using both handheld controllers. While deep learning and sensor-based technology have proven effective in recognizing single-hand gestures for 3D interactions, research on dual-hand gesture recognition for VR interactions is still underexplored. In this work, we introduce CWT-CNN-TCN, a novel deep learning model that combines a 2D Convolution Neural Network (CNN) with Continuous Wavelet Transformation (CWT) and a Temporal Convolution Network (TCN). This model can simultaneously extract features from the time-frequency domain and capture long-term dependencies using …

The Sensory Accommodation Framework For Technology: Bridging Sensory Processing To Social Cognition, Louanne Boyd

Engineering Faculty Books and Book Chapters

This book provides a thorough introduction to the many facets of designing technologies for autism, with a particular focus on optimizing visual attention frameworks. This book is designed to provide a detailed overview of several aspects of technology for autism. Each Chapter illustrates different parts of the Sensory Accommodation Framework and provides examples of relevant available technologies. The books first discusses a variety of skills that make up human development as well as a history of autism as a diagnosis and the birth of the neurodiversity movement. It goes on to detail individual types of therapy and how they interact …

Towards A Virtual Reality Visualization Of Hand-Object Interactions To Support Remote Physical Therapy, Trudi Di Qi, Louanne Boyd, Scott Fitzpatrick, Meghna Raswan, Franceli L. Cibrian

Engineering Faculty Articles and Research

Improving object manipulation skills through hand-object interaction exercises is crucial for rehabilitation. Despite limited healthcare resources, physical therapists propose remote exercise routines followed up by remote monitoring. However, remote motor skills assessment remains challenging due to the lack of effective motion visualizations. Therefore, exploring innovative ways of visualization is crucial, and virtual reality (VR) has shown the potential to address this limitation. However, it is unclear how VR visualization can represent understandable hand-object interactions. To address this gap, in this paper, we present VRMoVi, a VR visualization system that incorporates multiple levels of 3D visualization layers to depict movements. In …

Adaptive Octree Meshes For Simulation Of Extracellular Electrophysiology, Christopher Bc Girard, Dong Song

Engineering Faculty Articles and Research

Objective. The interaction between neural tissues and artificial electrodes is crucial for understanding and advancing neuroscientific research and therapeutic applications. However, accurately modeling this space around the neurons rapidly increases the computational complexity of neural simulations. Approach. This study demonstrates a dynamically adaptive simulation method that greatly accelerates computation by adjusting spatial resolution of the simulation as needed. Use of an octree structure for the mesh, in combination with the admittance method for discretizing conductivity, provides both accurate approximation and ease of modification on-the-fly. Main results. In tests of both local field potential estimation and multi-electrode stimulation, dynamically adapted meshes …

Visualizing Transaction-Level Modeling Simulations Of Deep Neural Networks, Nataniel Farzan, Emad Arasteh

Engineering Technical Reports

The growing complexity of data-intensive software demands constant innovation in computer hardware design. Performance is a critical factor in rapidly evolving applications such as artificial intelligence (AI). Transaction-level modeling (TLM) is a valuable technique used to represent hardware and software behavior in a simulated environment. However, extracting actionable insights from TLM simulations is not a trivial task. We present Netmemvisual, an interactive, cross-platform visualization tool for exposing memory bottlenecks in TLM simulations. We demonstrate how Netmemvisual helps system designers rapidly analyze complex TLM simulations to find memory contention. We describe the project’s current features, experimental results with two state-of-the-art deep …

Region-Specified Inverse Design Of Absorption And Scattering In Nanoparticles By Using Machine Learning, Alex Vallone, Nooshin M. Estakhri, Nasim Mohammadi Estrakhri

Engineering Faculty Articles and Research

Machine learning provides a promising platform for both forward modeling and the inverse design of photonic structures. Relying on a data-driven approach, machine learning is especially appealing for situations when it is not feasible to derive an analytical solution for a complex problem. There has been a great amount of recent interest in constructing machine learning models suitable for different electromagnetic problems. In this work, we adapt a region-specified design approach for the inverse design of multilayered nanoparticles. Given the high computational cost of dataset generation for electromagnetic problems, we specifically investigate the case of a small training dataset, enhanced …

Para Cima Y Pa’ Abajo: Building Bridges Between Hci Research In Latin America And In The Global North, Pedro Reynolds-Cuéllar, Marisol Wong-Villacres, Karla A. Badillo-Urquiola, Mayra Donaji Barrera-Machuca, Franceli L. Cibrian, Marianela Ciolfi Felice, Carolina Fuentes, Laura Sanely Gaytán-Lugo, Vivian Genaro Motti, Monica Perusquía-Hernández, Oscar A. Lemus

Engineering Faculty Articles and Research

The Human-computer Interaction (HCI) community has the opportunity to foster the integration of research practices across the Global South and North to begin overcoming colonial relationships. In this paper, we focus on the case of Latin America (LATAM), where initiatives to increase the representation of HCI practitioners lack a consolidated understanding of the practices they employ, the factors that influence them, and the challenges that practitioners face. To address this knowledge gap, we employ a mixed-methods approach, comprising a survey (66 respondents) and in-depth interviews (19 interviewees). Our analyses characterize a set of research perspectives on how HCI is practiced …

Low-Power Redundant-Transition-Free Tspc Dual-Edge-Triggering Flip-Flop Using Single-Transistor-Clocked Buffer, Zisong Wang, Peiyi Zhao, Tom Springer, Congyi Zhu, Jaccob Mau, Andrew Wells, Yinshui Xia, Lingli Wang

Engineering Faculty Articles and Research

In the modern graphics processing unit (GPU)/artificial intelligence (AI) era, flip-flop (FF) has become one of the most power-hungry blocks in processors. To address this issue, a novel single-phase-clock dual-edge-triggering (DET) FF using a single-transistor-clocked (STC) buffer (STCB) is proposed. The STCB uses a single-clocked transistor in the data sampling path, which completely removes clock redundant transitions (RTs) and internal RTs that exist in other DET designs. Verified by post-layout simulations in 22 nm fully depleted silicon on insulator (FD-SOI) CMOS, when operating at 10% switching activity, the proposed STC-DET outperforms prior state-of-the-art low-power DET in power consumption by 14% …

Completeness Of Nominal Props, Samuel Balco, Alexander Kurz

Engineering Faculty Articles and Research

We introduce nominal string diagrams as string diagrams internal in the category of nominal sets. This leads us to define nominal PROPs and nominal monoidal theories. We show that the categories of ordinary PROPs and nominal PROPs are equivalent. This equivalence is then extended to symmetric monoidal theories and nominal monoidal theories, which allows us to transfer completeness results between ordinary and nominal calculi for string diagrams.

Towards Qos-Based Embedded Machine Learning, Tom Springer, Erik Linstead, Peiyi Zhao, Chelsea Parlett-Pelleriti

Engineering Faculty Articles and Research

Due to various breakthroughs and advancements in machine learning and computer architectures, machine learning models are beginning to proliferate through embedded platforms. Some of these machine learning models cover a range of applications including computer vision, speech recognition, healthcare efficiency, industrial IoT, robotics and many more. However, there is a critical limitation in implementing ML algorithms efficiently on embedded platforms: the computational and memory expense of many machine learning models can make them unsuitable in resource-constrained environments. Therefore, to efficiently implement these memory-intensive and computationally expensive algorithms in an embedded computing environment, innovative resource management techniques are required at the …

Automated Identification Of Astronauts On Board The International Space Station: A Case Study In Space Archaeology, Rao Hamza Ali, Amir Kanan Kashefi, Alice C. Gorman, Justin St. P. Walsh, Erik J. Linstead

Art Faculty Articles and Research

We develop and apply a deep learning-based computer vision pipeline to automatically identify crew members in archival photographic imagery taken on-board the International Space Station. Our approach is able to quickly tag thousands of images from public and private photo repositories without human supervision with high degrees of accuracy, including photographs where crew faces are partially obscured. Using the results of our pipeline, we carry out a large-scale network analysis of the crew, using the imagery data to provide novel insights into the social interactions among crew during their missions.

Classifying Toe Walking Gait Patterns Among Children Diagnosed With Idiopathic Toe Walking Using Wearable Sensors And Machine Learning Algorithms, Rahul Soangra, Yuxin Wen, Hualin Yang, Marybeth Grant-Beuttler

Physical Therapy Faculty Articles and Research

Idiopathic toe walking (ITW) is a gait abnormality in which children’s toes touch at initial contact and demonstrate limited or no heel contact throughout the gait cycle. Toe walking results in poor balance, increased risk of falling, and developmental delays among children. Identifying toe walking steps during walking can facilitate targeted intervention among children diagnosed with ITW. With recent advances in wearable sensing, communication technologies, and machine learning, new avenues of managing toe walking behavior among children are feasible. In this study, we investigate the capabilities of Machine Learning (ML) algorithms in identifying initial foot contact (heel strike versus toe …

Project Metamorphosis: Designing A Dynamic Framework For Converting Musical Compositions Into Paintings, Rao Hamza Ali, Grace Fong, Erik Linstead

Engineering Faculty Articles and Research

The authors present an automated, rule-based system for converting piano compositions into paintings. Using a color-note association scale presented by Edward Maryon in 1919, which correlates 12-tone scale with 12 hues of the color circle, the authors present a simple approach for extracting colors associated with each note played in a piano composition. The authors also describe the color extraction and art generation process in detail, as well as the process for creating “moving art,” which imitates the progression of a musical piece in real time. They share and discuss artworks generated for four well-known piano compositions.

Cognality Vr: Exploring A Mobile Vr App With Multiple Stakeholders To Reduce Meltdowns In Autistic Children, Louanne E. Boyd, Espen Garner, Ian Kim, Gianna Valencia

Engineering Faculty Articles and Research

Many autistic children can have difficulty communicating, understanding others, and interacting with new and unfamiliar environments. At times they may suffer from a meltdown. The major contributing factor to meltdowns is sensory overwhelm. Technological solutions have shown promise in improving the quality of life for autistic children-however little exists to manage meltdowns. In this work with stakeholders, we design and deploy a low cost, mobile VR application to provide relief during sensory discomfort. Through the analysis of surveys from 88 stakeholders from a variety of groups (i.e., autistic adults, children with autism, parents of autistic individuals, and medical practitioners), we …

Machine Learning Based Medical Image Deepfake Detection: A Comparative Study, Siddharth Solaiyappan, Yuxin Wen

Engineering Faculty Articles and Research

Deep generative networks in recent years have reinforced the need for caution while consuming various modalities of digital information. One avenue of deepfake creation is aligned with injection and removal of tumors from medical scans. Failure to detect medical deepfakes can lead to large setbacks on hospital resources or even loss of life. This paper attempts to address the detection of such attacks with a structured case study. Specifically, we evaluate eight different machine learning algorithms, which include three conventional machine learning methods (Support Vector Machine, Random Forest, Decision Tree) and five deep learning models (DenseNet121, DenseNet201, ResNet50, ResNet101, VGG19) …

Manipulating Image Luminance To Improve Eye Gaze And Verbal Behavior In Autistic Children, Louanne Boyd, Vincent Berardi, Deanna Hughes, Franceli L. Cibrian, Jazette Johnson, Viseth Sean, Eliza Delpizzo-Cheng, Brandon Mackin, Ayra Tusneem, Riya Mody, Sara Jones, Karen Lotich

Engineering Faculty Articles and Research

Autism has been characterized by a tendency to attend to the local visual details over surveying an image to understand the gist–a phenomenon called local interference. This sensory processing trait has been found to negatively impact social communication. Although much work has been conducted to understand these traits, little to no work has been conducted to intervene to provide support for local interference. Additionally, recent understanding of autism now introduces the core role of sensory processing and its impact on social communication. However, no interventions to the end of our knowledge have been explored to leverage this relationship. This work …

A Deep Learning-Based Approach To Extraction Of Filler Morphology In Sem Images With The Application Of Automated Quality Inspection, Md. Fashiar Rahman, Tzu-Liang Bill Tseng, Jianguo Wu, Yuxin Wen, Yirong Lin

Engineering Faculty Articles and Research

Automatic extraction of filler morphology (size, orientation, and spatial distribution) in Scanning Electron Microscopic (SEM) images is essential in many applications such as automatic quality inspection in composite manufacturing. Extraction of filler morphology greatly depends on accurate segmentation of fillers (fibers and particles), which is a challenging task due to the overlap of fibers and particles and their obscure presence in SEM images. Convolution Neural Networks (CNNs) have been shown to be very effective at object recognition in digital images. This paper proposes an automatic filler detection system in SEM images, utilizing a Mask Region-based CNN architecture. The proposed system …

Three Wave Mixing In Epsilon-Near-Zero Plasmonic Waveguides For Signal Regeneration, Nicholas Mirchandani, Mark C. Harrison

Engineering Faculty Articles and Research

Vast improvements in communications technology are possible if the conversion of digital information from optical to electric and back can be removed. Plasmonic devices offer one solution due to optical computing’s potential for increased bandwidth, which would enable increased throughput and enhanced security. Plasmonic devices have small footprints and interface with electronics easily, but these potential improvements are offset by the large device footprints of conventional signal regeneration schemes, since surface plasmon polaritons (SPPs) are incredibly lossy. As such, there is a need for novel regeneration schemes. The continuous, uniform, and unambiguous digital information encoding method is phase-shift-keying (PSK), so …

A Neural Network Based Proportional Hazard Model For Iot Signal Fusion And Failure Prediction, Yuxin Wen, Xingxin Guo, Junbo Son, Jianguo Wu

Engineering Faculty Articles and Research

Accurate prediction of remaining useful life (RUL) plays a critical role in optimizing condition-based maintenance decisions. In this paper, a novel joint prognostic modeling framework that simultaneously combines both time-to-event data and multi-sensor degradation signals is proposed. With the increasing use of IoT devices, unprecedented amounts of diverse signals associated with the underlying health condition of in-situ units have become easily accessible. To take full advantage of the modern IoT-enabled engineering systems, we propose a specialized framework for RUL prediction at the level of individual units. Specifically, a Bayesian linear regression model is developed for the multi-sensor degradation signals and …

Let's Read: Designing A Smart Display Application To Support Codas When Learning Spoken Language, Katie Rodeghiero, Yingying Yuki Chen, Annika M. Hettmann, Franceli L. Cibrian

Engineering Faculty Articles and Research

Hearing children of Deaf adults (CODAs) face many challenges including having difficulty learning spoken languages, experiencing social judgment, and encountering greater responsibilities at home. In this paper, we present a proposal for a smart display application called Let's Read that aims to support CODAs when learning spoken language. We conducted a qualitative analysis using online community content in English to develop the first version of the prototype. Then, we conducted a heuristic evaluation to improve the proposed prototype. As future work, we plan to use this prototype to conduct participatory design sessions with Deaf adults and CODAs to evaluate the …

Digital Markers Of Autism, Ivonne Monarca, Franceli L. Cibrian, Monica Tentori

Engineering Faculty Articles and Research

Autism Spectrum Disorder (ASD) is a neurological condition that affects how a people communicate and interact with others. The use of screening tools during childhood is very important to detect those children who need to be referred for a diagnosis of ASD. However, most screening tools are based on parents' responses so the result can be subjective. In addition, most screening tools focus on social and communicative skills leaving aside sensory features, which have shown to have the potential to be ASD markers. Tactile processing has been little explored due to lack of tools to asses it, however with the …

Feel And Touch: A Haptic Mobile Game To Assess Tactile Processing, Ivonne Monarca, Monica Tentori, Franceli L. Cibrian

Engineering Faculty Articles and Research

Haptic interfaces have great potential for assessing the tactile processing of children with Autism Spectrum Disorder (ASD), an area that has been under-explored due to the lack of tools to assess it. Until now, haptic interfaces for children have mostly been used as a teaching or therapeutic tool, so there are still open questions about how they could be used to assess tactile processing of children with ASD. This article presents the design process that led to the development of Feel and Touch, a mobile game augmented with vibrotactile stimuli to assess tactile processing. Our feasibility evaluation, with 5 children …