Other Electrical and Computer Engineering Commons^™

Harmonicthreads: A Formative Evaluation Of A Fabric-Based Digital Musical Instrument Toward Inclusive Music-Making, Ellie Nguyen, Franceli L. Cibrian

Engineering Faculty Articles and Research

Background:

Inclusive music-making requires instruments that support varied bodies, abilities, musical backgrounds, and forms of participation. Digital musical instruments provide diverse approaches to sound creation, and fabric-based interfaces offer an alternative interaction modality that may support participation for some users and contexts. Their tactile and deformable properties enable forms of interaction that differ from conventional rigid or screen-based controllers and may offer inclusive possibilities in particular settings.

Objective:

This paper presents HarmonicThreads as a formative interaction-design case of a fabric-based digital musical instrument. The prototype explores how tactile cues, fabric deformation, projected visual feedback, and assisted accompaniment can support low-barrier …

Hardware-In-The-Loop Evaluation Of Sensor-Source Selection For Prosthetic Locomotion Intent Recognition, Victoria Asencio-Clemens

Master's Theses

Active lower-limb prostheses use intent-recognition systems to identify a user’s locomotion mode and select an appropriate control strategy, but sensor configurations that perform well offline may be unsuitable for resource-constrained embedded hardware. Existing sensor-selection methods generally prioritize classification accuracy without directly accounting for processing latency, memory usage, or other hardware-dependent requirements. To address this limitation, this thesis develops a hardware-in-the-loop source-selection framework for embedded classification of level walking, ramp ascent, ramp descent, stair ascent, and stair descent using multimodal biomechanical data from transtibial amputee participants. Subject-specific linear support vector machine classifiers were evaluated using trial-held-out validation, and candidate configurations from …

Autonomous Vision-Based Litter Collection Rover, Dante Michael Benedetti, Benjamin Scott Tavares, Nathan Heil

Electrical Engineering

This report documents the design, implementation, and testing of an autonomous litter-collection rover developed as a Senior Project Design Lab (EE 460/463/464) at California Polytechnic State University. The rover integrates autonomy, computer vision, embedded real-time control, mecanum-wheel omnidirectional mobility, and a two-degree-of-freedom robotic arm to detect, approach, and collect small ground-level litter such as bottles, wrappers, and paper fragments.

The system uses a two-layer compute architecture: an NVIDIA Jetson Orin Nano running ROS 2 for perception, SLAM, and path planning, paired with an STM32L4A6ZG microcontroller for real-time motor control and odometry. The robot is built on a multi-level aluminum frame …

Solving Linearly Constrained Quadratic Programs Using Field Programmable Analog Arrays, Tyler Wynn, Alonzo Arroyo

Electrical Engineering

This paper presents a field-programmable analog array (FPAA) implementation for solving linearly constrained quadratic programs (LCQPs) directly in the analog domain. The solver is based on a continuous-time primal-dual control architecture with integral action, anti-windup compensation, and a piecewise-linear nonlinearity for enforcing affine inequality constraints. A switched-capacitor implementation using three AN231E04 FPAAs is developed, and coefficient scaling methods are introduced to keep internal and output signals within the voltage limits of the hardware. A global scaling factor is used to reduce internal signal excursions, while solution-space scaling is shown to modify the implemented optimization coefficients and alter the local closed-loop …

Polysaber: A Custom Reactive Lightsaber Soundboard, Pedro B. Medeiros

Computer Engineering

The PolySaber project was developed as a custom reactive lightsaber control system built as a fully custom PCB design. The purpose of the project was to create a lower-cost and more customizable alternative to commercially available lightsaber soundboards while simultaneously providing hands-on experience in PCB design, embedded systems development, and hardware integration. Commercial lightsaber soundboards are expensive, proprietary, and difficult for hobbyists to customize. The PolySaber project addresses this by creating a modifiable hardware platform built around the ESP32 microcontroller. The system supports programmable firmware, RGB NeoPixel blade control, motion sensing, reactive swing and clash effects, onboard audio amplification, and …

Design And Parametric Study Of A Mems-Based Reservoir Computer For Reinforcement Learning, Andrew P. Carr

Master's Theses

Single-node reservoir computing (RC) is a hardware-efficient approach to machine learning, leveraging the dynamics of physical systems. In this work, two reinforcement learning algorithms, Q-learning and Proximal Policy Optimization (PPO), are applied to a simulated micro-electro-mechanical system (MEMS)-based reservoir computer to solve both discrete and continuous control tasks. MEMS-based reservoirs are low-power, compact, and their natural frequencies (kHz to MHz) pair well with real-time control loops. To explore the relationship between reservoir dynamics and learning performance, a parametric study is conducted on two reservoir hyperparameters, reservoir size and neuron separation, using CartPole-v1 and MountainCar-v0. The RC successfully learns multiple tasks …

Deep Learning Approaches For Ctenophore Identification And Tracking, Anagha Bharadwaj

Theses

Ctenophores are translucent marine organisms with nearly invisible tentacles and pose significant challenges due to their transparent morphology and ambiguous structural features. This research addresses the classification and tracking of these organisms and evaluates the performance of current computer vision models under sparse-data environments.

A dataset from the NJIT Life History Lab consisting of microscopic laboratory videos and photographs of different growth stages is used to train and assess a number of convolutional neural network designs, including VGG16, ResNet, BioCLIP2, YOLO, and DeepLabCut. Additionally, a web-based interface is developed to evaluate expert-labeled ground truth with the model's performance.

The findings …

Temporal Logic Planning In Semantic Maps Of Unknown Environments Using Tl-Rrt, Dongrui Yang

McKelvey School of Engineering Graduate Student Theses & Dissertations

Autonomous mobile robots are increasingly expected to perform complex missions in unstructured environments. Traditional path planning approaches handle simple point-to-point navigation, but struggle with complex tasks that involve temporal and logical orderings of objectives. Linear Temporal Logic (LTL) provides a method for complex missions (e.g., sequential visits to multiple targets or surveillance tasks) in a strict way. This thesis presents an integrated planning framework that enables a robot to satisfy LTL-based task specifications in an unknown environment by combining a Temporal Logic RRT* (TL-RRT*) planner with semantic mapping. The robot builds a semantic map of its environment online using simultaneous …

A Low-Cost Motion Classification System For A Stuffed Animal Using An Imu And Machine Learning, Rachel N. Guynes

Honors Theses

One of the many fields that has seen the integration of robots is therapy. Zoomorphic robots (ZR) are designed to look and behave like animals to assist in Animal Assisted Therapy (AAT) practices. Studies show that ZRs can provide benefits similar to working with an actual animal; however, their high cost limits their accessibility. This thesis documents the process of building a real-time, low-cost motion classification system that can be attached to a stuffed animal to make it more interactive. Using a Random Forest (RF) classifier, the system identifies movements with approximately 81.67% accuracy.

Proxyconnec: A Lora-Based Proactive Safety Communication System For Off-Grid Environments, Shruti Bhandari, Roza Shaimurat

ATU Scholars Symposium

Remote environments lacking cellular or satellite coverage present significant safety challenges. ProxyConnec was developed as a point-to-point communication system using ESP32 microcontrollers and REYAX RYLR998 LoRa modules to provide off-grid monitoring.

The system implements a proactive heartbeat model in which a beacon device transmits a signal every 1,000 milliseconds. A base station monitors this connection using a 5,000 millisecond watchdog timer. If communication is interrupted, the system immediately triggers audible and visual alerts. Unlike conventional tracking devices that depend on manual SOS activation, this design treats unexpected signal loss as a potential safety event.

The manufacturer rates the selected LoRa …

Behavioral-Centric Team Evaluation Via Consistent Rewards, Clement Kudakwashe Nyanhongo

Dartmouth College Ph.D Dissertations

Across human domains ranging from sports to business and organizational settings, complex tasks are often solved by teams rather than individuals, leveraging benefits such as interaction, mutual support, complementary skills, cohesion, and task allocation. Evaluating team effectiveness, however, is inherently challenging due to the subjectivity of many existing techniques and the limitations of outcome-driven metrics that primarily focus on performance scores while overlooking the team processes that generated the scores. To address these challenges, this dissertation proposes a behavioral-centric, end-to-end framework for team evaluation grounded in reward functions that model sequential team behavior. Reward functions offer compact and interpretable representations …

Flexible Fault-Tolerant Multi-Die Fpga-Based Architectures For Varying Space Environments, Yosof Ali Seif El Din Ali Maklad

Theses and Dissertations

It is well-known fact that spacecraft’s electronic components operate in an extreme harsh and varying space environments, beside changing orbit or passing through Van Allan Belts during orbital course results of radiation levels change. This thesis focuses on SRAM-based FPGA systems on-board of such spacecrafts, that are commonly utilized in space applications’ critical applications due to their capabilities and flexibility to reconfigure, since these systems are vulnerable to frequent negative impacts of ionizing radiation, thus inducing soft and hard errors leading to disastrous failures that could jeopardize the entire spacecraft. The soft errors’ effects are frequent yet can be mitigated, …

Advancing Task-Oriented Dialog Systems: Scalability, Generalization, And Evaluation, Adib Mosharrof

Theses and Dissertations--Computer Science

Task-oriented dialog (TOD) systems enable conversational interfaces for complex tasks like flight booking and restaurant reservations. However, deploying TOD systems at scale faces three critical barriers: scalability, generalization, and evaluation. Scalability is primarily restricted by the human-annotation bottleneck, as current systems depend on vast quantities of manually labeled data for every new domain, making deployment prohibitively expensive. Generalization remains a persistent challenge, as systems optimized for known domains often suffer significant performance degradation when encountering new, unseen ones. Existing evaluation metrics measure response quality and fluency, but fail to measure functional task success. As TOD systems are deployed across diverse …

Parentcoach: Designing An Mhealth Parenting App To Enhance Parental Involvement In Adhd Support, Franceli L. Cibrian, Nancy Herrera, Jesus A. Beltran, Lucas M. Silva, Mikaela Pulse, Kayla Anderson, Cassie Zeiler, Luc Rieffel, Daniel I. Lee, Sabrina E. B. Schuck, Kimberley D. Lakes

Engineering Faculty Articles and Research

Introduction: Parents play a vital role in supporting self-regulation and managing behaviors in children with Attention-Deficit/Hyperactivity Disorder (ADHD). However, many face barriers to accessing consistent, evidence-based support. Mobile health (mHealth) technologies offer a promising way to deliver flexible, low-burden guidance for parents on best practices and strategies to support their children's self-regulation. However, designing them is non-trivial.

Objective: This paper introduces ParentCoach, a mobile application designed to support parents of children with ADHD through brief daily lessons, reflection prompts, and skill-building activities.

Methods: ParentCoach was developed in two phases: (1) secondary analysis of qualitative data from over 30 families …

Design Considerations For Conversational Agents To Assess The Social-Emotional Well-Being Of Young Children In Low-Income South African Communities, Lucretia A. Williams, Elizabeth A. Ankrah, Catherine E. Draper, Caylee J. Cook, Franceli L. Cibrian, Jesus A. Beltran, Kimberley D. Lakes, Gillian R. Hayes

Engineering Faculty Articles and Research

A variety of digital technologies have been used to support early childhood development (ECD) programs in low-income South African communities. Even though technology has provided opportunities to increase access to health interventions, the lack of trust and socio-economic constraints under which these tools would need to work pose complex challenges. We examine home visitors’ work processes, experiences, and preferences of a conversational agent to support their work of administering social-emotional well-being assessments to young children ages 0-5. Analysis of the results of focus groups with 51 home visitors indicates the need for designing conversational agents that support ECD in the …

Ai-Powered Accessibility Tracker For Inclusive Public Spaces, Yenny Ma, Kevin Beltran

College of Engineering Summer Undergraduate Research Program

This research project will develop and evaluate a smartphone-based, AI-powered system to crowdsource and analyze accessibility features and barriers in public spaces. Using computer vision and geospatial mapping, the system will identify and categorize issues such as uneven sidewalks, missing or inadequate curb ramps, damaged tactile paving, obstructive overhangs, and the absence of visual or auditory wayfinding cues. The overarching goal is to generate a dynamic, real-time accessibility map that empowers individuals with diverse mobility, sensory, and cognitive needs to navigate public spaces more safely and confidently. The project will integrate technologies and methods from applied machine learning, mobile computer …

Multi-Modal Depth Estimation Using Camera And Mmwave Sensors, Alston D. Devero-Belfon

Student Theses

For accurately estimating the depth of environments with varying lighting conditions, reliable methods are limited. By utilizing wireless sensor technology in conjunction with cameras, a wide range of environments can be visualized, and objects within these environments can be tracked and monitored. Such methods offer cost-effective alternatives and provide a more secure, data-at-rest option for individuals with low vision, while also enhancing machine perception. In this work, we develop such a prototype that utilizes wireless sensors and cameras, which act in sync, enabling us to estimate the depth of objects within varying lighting environments to a level that is recognizable …

Accelerating Gnn Inference On Multi-Core Systems, Binglin Ji

McKelvey School of Engineering Graduate Student Theses & Dissertations

Graph Neural Networks (GNNs) are becoming increasingly popular, with their applications expanding across diverse domains. As the scale of graph data continues to grow, including larger numbers of nodes, edges, and higher embedding dimensions, standardized libraries such as DGL and PyG have been developed to facilitate GNN computation. However, with the rapid increase in the number of processor cores and the evolution of multi-core architectures, these libraries often show poor scalability and fail to execute GNN inference efficiently on the latest multi-core systems, particularly those with upwards of a hundred cores. To address this limitation, we present FGI, a Fast …

Autonomous Mapping Rover, Garrett Jones, Timothy Kyle Chu, Eugenio Caruso Pasos

Electrical Engineering

This report details the design, implementation, and evaluation of "Rovero," an autonomous mapping rover developed as a senior project. Rovero integrates state-of-the-art technologies, including ROS2 for communication, SLAM algorithms for mapping, and sensor fusion for accurate navigation. The project aimed to achieve robust autonomous operation in indoor environments, leveraging a combination of LiDAR, IMU, and encoder data for real-time decision-making. Key challenges addressed include path planning, obstacle avoidance, and integration of multiple sensor inputs. Results demonstrate successful mapping capabilities and efficient navigation performance.

Design Considerations Of A Gpu, Nicholas M. Devilliers

Electrical Engineering and Computer Science Undergraduate Honors Theses

With the current era of AI technology, the era of single instruction multiple data has become an increasingly viable solution to accelerate training. The problem is that while software to use GPUs and other hardware accelerators, designing GPUs and ASIC devices has become increasingly more expensive and there aren’t great examples of generic GPUs that anyone can use and modify. In this thesis, there are four design considerations that will be discussed and how they affect the result of a generic GPU. The four considerations that were talked about in the thesis are, word width, arithmetic type, number of stages, …

Harmonicthreads – An Interface That Supports Accessibility In Musical Interaction, Ellie Nguyen, Miyuki Weldon, Franceli L. Cibrian

Engineering Faculty Articles and Research

Traditional musical instruments often can create boundaries due to their cost, training, mobility, and cognitive requirements, making musical expression inaccessible. To address this challenge, we developed HarmonicThreads, a novel pervasive computing interface consisting of a responsive, flexible fabric. HarmonicThreads provides a tactile and auditory experience, allowing users to easily create and control sounds. Using embedded sensors and real-time processing, HarmonicThreads interprets the user's natural movements and interactions to create adaptable musical outputs. This enables context-aware musical interaction, demonstrating the potential of pervasive interfaces in reducing barriers and making musical expression more accessible.

Feasibility And Acceptability Of The Mazi Umntanakho Digital Tool In South African Settings: A Qualitative Evaluation, Catherine E. Draper, Caylee J. Cook, Elizabeth A. Ankrah, Jesus A. Beltran, Franceli L. Cibrian, Kimberley D. Lakes, Hanna Mofid, Lucretia Williams, Gillian R. Hayes

Engineering Faculty Articles and Research

To address the need for interventions targeting social emotional development and mental health of young children in South Africa, the Mazi Umntanakho (‘know your child’) digital tool was co-designed, and piloted with caregivers and 3–5-year-old children involved in home visiting programmes promoting early childhood development. The aim of this study was to qualitatively evaluate the feasibility and acceptability of this tool in four urban and four rural low-income communities, from the perspective of home visitors and caregivers. Focus groups were conducted with home visitors (n = 117) and caregivers (n = 72). Issues relating to the feasibility of …

Computing With Photonic Phase Change Memory, David B. Pippen

Theses and Dissertations--Electrical and Computer Engineering

A recent breakthrough in silicon photonics includes the discovery and use of phase changing materials (PCMs). These materials can be programmed to store nonvolatile values, and when a stored value in a PCM cell is read, it changes the amplitude of the read signal, imprinting the value held into the PCM cell on the amplitude of the read signal. This thesis proposes a new approach to using PCM cells not only for photonic memory but also as a substrate to perform multiplications in the photonic domain. The proposed multiplier uses PCM cells to encode amplitude-analog weight values and differing lengths …

Solar Energy Prediction Using Advanced Hybrid Machine Learning Models, Jelawi A. Alqhtani

UNF Graduate Theses and Dissertations

Accurate short-term forecasting of solar power generation is critical for the reliable and cost-effective operation of renewable-based microgrids, where sudden weather-induced variability can compromise grid stability, battery scheduling, and energy trading decisions. Traditional physical and statistical models struggle to capture the complex non-linear relationships and localized weather effects, while individual deep learning architectures often exhibit systematic biases such as chronic under-prediction of peak generation. This thesis proposes a novel Cross-Feedback Ensemble framework that combines the complementary strengths of Long Short-Term Memory (LSTM), Gated Recurrent Unit (GRU), and one-dimensional Convolutional Neural Network (1D-CNN) models through an iterative cross-feedback mechanism and a …

Exploring Smart Thermostat, Don P. Dang

2024 Fall Honors Capstone Projects - Archive

This study examines the security, privacy, and compatibility challenges associated with smart thermostats in smart home systems. Smart thermostats, as part of the growing Internet of Things (IoT) ecosystem, face vulnerabilities such as unauthorized access, data breaches, and inconsistent security protocols. Using a mixed-methods approach, this research evaluates encryption techniques, communication protocols (Zigbee, Z-Wave, Wi Fi), and user behaviors that impact system security and efficiency. Key findings indicate that 35% of users are concerned about hacking risks, while 25% express data privacy concerns. Many users lack awareness of security measures, such as firmware updates and password management, which increases vulnerabilities. …

Three-Dimensional Environmentally Sustainable Neuromorphic Computing System Based On Natural Organic Memristor, Mohammed Rafeeq Khan

Graduate Theses and Dissertations (2019 - present)

A three-dimensional neuromorphic (3D) computing architecture based on environmentally sustainable natural organic honey memristors is proposed in this thesis. A set of comprehensive and experimental results indicate that the proposed systems exhibit remarkable inference accuracy, consistently surpassing the 90% threshold, even with different challenges such as device variations and nonlinearity. This study also considers four different conductance drift situations, the effects of analog-to-digital converter (ADC) quantization, and multiple algorithms, such as VGG8 and DenseNet-40. The deliverable of this thesis will test the stability of the proposed systems and explore their potential applications and scalability in real-world situations.

Virtual Control: A Comparison Of Methods For Hand-Tracking Implementation, Nathan Roberts

Honors Program: Senior Projects (Public)

This thesis examines the design philosophy of modern virtual reality applications that utilize hand-tracking as a primary form of user input. The analysis presented hopes to provide ideas for future implementations of this technology so that more immersive experiences are developed. This analysis starts with the discussion of a modern example of successful hand-tracking implementation, then comparing that implementation to a recent senior design project. This comparison is primarily based on each experience’s ability to create interactivity and immediacy. Interactivity is the degree to which the user can quickly and reliably make changes to their virtual environment, while immediacy is …

M3t-Lm: A Multi-Modal Multi-Task Learning Model For Jointly Predicting Patient Length Of Stay And Mortality, Junde Chen, Qing Li, Feng Liu, Yuxin Wen

Engineering Faculty Articles and Research

Ensuring accurate predictions of inpatient length of stay (LoS) and mortality rates is essential for enhancing hospital service efficiency, particularly in light of the constraints posed by limited healthcare resources. Integrative analysis of heterogeneous clinic record data from different sources can hold great promise for improving the prognosis and diagnosis level of LoS and mortality. Currently, most existing studies solely focus on single data modality or tend to single-task learning, i.e., training LoS and mortality tasks separately. This limits the utilization of available multi-modal data and prevents the sharing of feature representations that could capture correlations between different tasks, ultimately …

Convex Approach To Data-Driven Optimal Control With Safety Constraints Using Linear Transfer Operator, Joseph Raphel Moyalan

All Dissertations

This thesis is concerned with the data-driven solution to the optimal control problem with safety constraints for a class of control-affine nonlinear systems. Designing optimal control satisfying safety constraints is a problem of interest in various applications, including robotics, power systems, transportation networks, and manufacturing. This problem is known to be non-convex. One of this thesis's main contributions is providing a convex formulation to this non-convex problem. The second main contribution is providing a data-driven framework for solving the control problem with safety constraints. The linear operator theoretic framework involving Perron-Frobenius and Koopman operators provides the convex formulation and associated …

Autonomous Apple Harvester Robot, Jack Ryan Cline, Tyus Green, Devon Woolston

Electrical Engineering

As agricultural demands rise and manual labor costs increase, there has become a dire need to automate apple harvesting. However, the precision and speed necessary for cost-efficient apple harvesting pose a significant challenge for robotic automation. To maintain cost-effective production, a harvester must be able to operate fast enough and long enough to compete with human labor. It must also be able to navigate and traverse apple orchards autonomously and pick apples without damaging the fruit or tree. This project presents an apple harvesting robot that uses a Mask R-CNN vision system with an RGB-D camera to detect the location …