Signal Processing Commons^™

Extending Geometric Acoustic Ray Tracing To Multi-Room Environments: A Case Study On Gunshot Sound Transmission Between Adjacent Rooms, Tyler Ton

Theses and Dissertations

Accurate localization of gunshots in multi-room building environments remains a challenging problem in acoustic forensics and public safety applications. Existing approaches model sound propagation within a single room, neglecting the transmission of acoustic energy through walls and other building materials. This thesis presents a study on modeling multi-room gunshot acoustic transmission, combining geometric ray tracing with structural acoustic transmission-loss modeling to generate impulse responses for two horizontally adjacent rooms separated by a shared wall, providing a foundation for future inter-room gunshot localization work. The proposed system uses GSound-SIR, a geometric acoustics engine, to simulate sound propagation in both of the …

Investigating The Spatial Scales Of Ionospheric Irregularities Using Wavelet Analysis, Nash Mcleod

Discovery Day - Daytona Beach

Investigating the Spatial Scales of Ionospheric Irregularities Using Wavelet Analysis:   Ionospheric radio wave scintillation arises from plasma density irregularities in Earth’s ionosphere. Consequently, rapid fluctuations occur in the phase and amplitude of Global Navigation Satellite System (GNSS) signals and can impact communication and navigation systems. These irregularities span from a wide range of spatial and temporal scales and evolve dynamically under the influence of magnetosphere-ionosphere (MI) processes. We investigate phase and amplitude scintillation events using Continuous Wavelet Transform (CWT) to study the spatial evolution of ionospheric irregularities. These irregularities are thought to be formed via different plasma mechanisms such as …

Learning Global Context For Sparse Activity Recognition In Lengthy Recordings With Limited Dataset Size, Zeyu Tang

All Dissertations

This dissertation describes methods to analyze lengthy recordings of data in order to detect sparsely occurring activities. The narrative below describes the progression of research that led to the development of these methods and their generalization into a unified framework. My research started with designing models for dietary monitoring, including detecting meals from day-long recordings and detecting intake gestures from meal-length recordings. Both tasks share some common characteristics: (a) the target event takes only a small portion of data recordings, and (b) there is global context within full-length data recordings that can help a model make better decisions. After finishing …

Universal Sound Separation: Distance-Aware Mixture Simulation, Co-Occurrence Conditioning, And Chain-Of-Inference, Wonjun Park

Computer Science and Engineering Theses - Archive

Universal Sound Separation (USS) -- the task of disentangling arbitrary sound sources from a single-channel acoustic mixture -- remains an open challenge due to the ill-posed nature of the problem and the distributional gap between synthetic training data and real-world recordings. This thesis addresses three distinct bottlenecks in the USS pipeline: training data realism, inference strategy, and conditioning richness. We first present two knowledge-guided approaches to sound source separation. The first is a distance-aware mixing strategy that leverages Large Language Models (LLMs) to assign plausible loudness relationships between audio sources during training data synthesis. By querying an LLM about the …

A Predictive Model For Multi- Week Respiratory Risk From Red Tide On Florida’S Gulf Coast., Elmer S. Ochaeta

Computer Science and Engineering Faculty Publications

Florida’s Gulf Coast red tide (Karenia brevis) can put toxins into the air, making people cough, irritating the throat, and worsening asthma or other breathing problems especially when winds blow from the ocean toward the beach. Right now, most public updates don’t really help with the question people actually ask when planning a weekend or vacation: “Will going to or close to the beach be risky in the next few weeks?”.

In this project, I build a weekly early warning system that estimates respiratory risk for specific beaches and predicts that risk 2 to 4 weeks ahead. The study covers …

Iso-Detr: A Novel Detection Transformer For Industrial Small Object Detection, Faisal Saeed, Anand Paul

School of Public Health Faculty Publications

Effectively detecting and assessing real-time structural and ecological parameters in contemporary manufacturing environments poses significant challenges, particularly in identifying minute objects within product images. The swift evolution of the industrial sector underscores the necessity for intelligent manufacturing environments to uphold stringent product quality standards. However, accelerating production processes at high speeds heightens the risk of defective product outcomes. This research addresses the challenges inherent in small object detection within industrial contexts, proposing an innovative detection transformer model tailored to modern manufacturing environments. The proposed model integrates a feature-enhanced multi-head self-attention block (FEMSA), merging cross-channel communication network and multiple multi-head self-attention …

Adaptive Deep Learning In Physical Layer Applications, Ali Owfi

All Dissertations

Traditionally, signal processing models in communication systems have been designed based on solid foundations in statistics and information theory, often assuming linearity and optimizing for simplified models. However, real-world communication systems exhibit numerous imperfections and non-linearities that traditional linear models struggle to capture accurately. Deep Learning (DL)-based approaches, unconstrained by rigid mathematical models, have shown promise in optimizing system performance by accommodating specific hardware configurations and dynamic channel conditions as an alternative to the traditional methods. Despite all the recent research efforts on DL-based methods for physical layer applications, DL models have still not been widely applied to physical layer …

Csc36000 - Modern Distributed Computing Assignment, Saptarashmi Bandyopadhyay

Open Educational Resources

This assignment covers standard performance metrics for Distributed Systems and the basics of Multiprocessing for CSC36000 - Modern Distributed Computing at the City College of New York CUNY. It is an interactive coding assignment intended to be executed in a Python notebook.

Multi-Modal Depth Estimation Using Camera And Mmwave Sensors, Alston D. Devero-Belfon

Student Theses

For accurately estimating the depth of environments with varying lighting conditions, reliable methods are limited. By utilizing wireless sensor technology in conjunction with cameras, a wide range of environments can be visualized, and objects within these environments can be tracked and monitored. Such methods offer cost-effective alternatives and provide a more secure, data-at-rest option for individuals with low vision, while also enhancing machine perception. In this work, we develop such a prototype that utilizes wireless sensors and cameras, which act in sync, enabling us to estimate the depth of objects within varying lighting environments to a level that is recognizable …

Advancing Real-World Implementation Of The Well Optimized Linear Finder (Wolf) High-Speed Atmospheric Turbulence Compensation Method, Timothy Evan Coon

Theses and Dissertations

This dissertation advances the real-world implementation of the Well Optimized Linear Finder (WOLF) method for high-speed Atmospheric Turbulence Compensation (ATC). Atmospheric turbulence introduces phase aberrations into optical wavefronts and degrades image quality in terrestrial imaging systems. Traditional phase diversity methods are computationally intensive and poorly suited to real-time operation. The WOLF method addresses these limitations through a novel, point-wise formulation of the optical transfer function (OTF) as a structured autocorrelation of the generalized pupil function (GPF). This formulation enables the estimation of phase aberrations at individual spatial coordinates with distributed computational complexity.

The research begins by developing a MATLAB-based simulation …

Artificial Intelligence Applications For Grid-Connected Solar Inverters, Utkirjon Ubaydullaev, Sarvinoz Mirzaeva, Hasan Mustafoev

Chemical Technology, Control and Management

The increasing global demand for renewable energy has highlighted the importance of grid-connected solar inverters in ensuring efficient and stable power conversion. However, challenges such as fluctuations in solar energy generation, grid disturbances, and power quality issues necessitate advanced control strategies. The integration of artificial intelligence (AI) into solar inverters presents a transformative solution, enhancing performance, adaptability, and reliability in real-world applications.

This review explores the role of AI techniques, including machine learning (ML), deep learning (DL), fuzzy logic, and reinforcement learning (RL), in optimizing key inverter functionalities such as maximum power point tracking (MPPT), fault detection, power quality enhancement, …

Smart Irrigation System Using Iot And Lstm For Optimal Water Management, Farley Y. Ruiz

Electrical Engineering Theses - Archive

This thesis presents the design and implementation of a smart irrigation system that combines Internet of Things hardware with a Long Short-Term Memory (LSTM) neural network for predictive soil moisture management. The goal is an affordable and reliable solution that uses real-time sensor data and environmental data to schedule irrigation before the substrate moisture drops below its target range. The system integrates soil moisture, temperature, humidity, and sensors on an Arduino Nano that communicates wirelessly with a Raspberry Pi. The Raspberry Pi runs a Python/Flask backend that collects and processes data, executes the LSTM model, and serves a secure web …

Revealing Spatiotemporal Neural Activation Patterns In Electrocorticography Recordings Of Human Speech Production By Mutual Information, Julio Kovacs, Dean Krusienski, Minu Maninder, Willy Wriggers

Mechanical & Aerospace Engineering Faculty Publications

Background

Spatiotemporal mapping of neural activity during continuous speech production has been traditionally approached using correlation coefficient (CC) analysis between cortical signals and speech recordings. A prior study employed this approach using electrocorticography (ECoG) data from participants who underwent invasive intracranial monitoring for epilepsy. However, CC cannot detect nonlinear relationships and is dominated by the correspondence between periods of silence and of non-silence.

New Method

We introduce the mutual information (MI) measure, which can capture both linear and nonlinear dependencies. We validated CC and MI on the sub-second spatiotemporal brain activity recorded during continuous speech tasks. To refine the results, …

Identifying Subject Bias In Wifi-Based Human Activity Recognition Evaluation Methods, Amany Elkelany, Robert J. Ross, Susan Mckeever

Conference papers

WiFi-based Human Activity Recognition (HAR) has emerged as a promising approach for monitoring and analysing human activities in a non-intrusive manner, leveraging WiFi signals for activity classification. Despite advancements, existing WiFi-based HAR research lacks consideration of subject (human) bias. This results in learning models performing well on individuals used in the training samples but failing to generalise to new/unseen subjects, in contrast to known good practices in machine learning. In this paper, we address this oversight directly by systematically examining the evaluation methodology for the WiFi-based HAR context. Specifically, we investigate the impact of Leave-One-Subject-Out Cross-Validation (LOSOCV) in a hybrid …

Strategies To Alleviate Flickering: Bayesian And Smoothing Methods For Deep Learning Classification In Video, Noah Miller, Glen Ryan Drumm, Lance Champagne, Bruce A. Cox, Trevor Bihl

Faculty Publications

Excerpt: Increasing reliance on autonomous systems requires confidence in the accuracies produced from computer vision classification algorithms. Computer vision (CV) for video classification provides phenomenal abilities, but it often suffers from “flickering” of results. Flickering occurs when the CV algorithm switches between declared classes over successive frames. Such behavior causes a loss of trust and confidence in their operations.

Star-Based Reachability Analysis Of Binary Neural Networks On Continuous Input, Mykhailo Ivashchenko

School of Computing: Dissertations, Theses, and Student Research

Deep Neural Networks (DNNs) have become a popular instrument for solving various real-world problems. DNNs’ sophisticated structure allows them to learn complex representations and features. However, architecture specifics and floating-point number usage result in increased computational operations complexity. For this reason, a more lightweight type of neural networks is widely used when it comes to edge devices, such as microcomputers or microcontrollers – Binary Neural Networks (BNNs). Like other DNNs, BNNs are vulnerable to adversarial attacks; even a small perturbation to the input set may lead to an errant output. Unfortunately, only a few approaches have been proposed for verifying …

Database And Machine Learning Model For Classifying Autism Spectrum Disorder From Smartphone Based Electroretinography, Rory Harris

Honors Scholar Theses

Autism Spectrum Disorder (ASD) is a neurodevelopmental disorder that negatively affects a patient’s cognitive and communication aptitude and, therefore, can severely impact that patient’s quality of life. Because of this, early diagnosis is paramount. In recent studies, electroretinography (ERG), which is a measure of the retina’s electrical response to a brief flash of light into the eye, has shown promise in detecting ASD. Access to these scans can provide early diagnosis, improving well-being. Current ERG devices are very expensive due to their on board processing capabilities. This paper aims to create an ERG device using a smartphone as the main …

Enhancing Rotating Machinery Fault Diagnosis: A Dual-Head Attention Mechanism In Deep Learning Neural Networks, Qing Snyder

Dissertations

Rotating machinery is crucial to production efficiency and safety in manufacturing industries for an extended time. Ensuring machinery reliability necessitates effective diagnostic systems, particularly for rotating bearings, the key components of such equipment. Fault diagnosis in rotating machinery is essential to prevent failures and minimize downtime, thereby playing an important role in industrial operations. The application of advanced neural network techniques in industry has risen recently. Among these, attention-based neural networks, especially the Transformer models, are originally noteworthy for their sequential data handling capability. This research delves into attention-based algorithms for rotating machinery fault diagnosis, signifying a substantial advancement in …

Random Forests For Detecting Weak Signals And Extracting Physical Information: A Case Study Of Magnetic Navigation, Mohammadamin Moradi, Zheng-Meng Zhai, Aaron Nielsen, Ying-Cheng Lai, Aaron P. Nielsen

Faculty Publications

It has been recently demonstrated that two machine-learning architectures, reservoir computing and time-delayed feed-forward neural networks, can be exploited for detecting the Earth’s anomaly magnetic field immersed in overwhelming complex signals for magnetic navigation in a GPS-denied environment. The accuracy of the detected anomaly field corresponds to a positioning accuracy in the range of 10–40 m. To increase the accuracy and reduce the uncertainty of weak signal detection as well as to directly obtain the position information, we exploit the machine-learning model of random forests that combines the output of multiple decision trees to give optimal values of the physical …

Small Unmanned Aircraft System Detection And Tracking With Audio, Computer Vision, And Deep Learning Techniques, Anthony C. Brunson

Theses and Dissertations

sUAS present significant risks to local and federal agencies when under the control of negligent, reckless, or criminal operators. In the face of an escalating presence of sUAS in shared airspace with traditional aircraft, and their deployment in protected airspace as potential weapons, safeguarding personnel, facilities, and assets becomes paramount. This research seeks to address this emerging threat by investigating the efficacy of integrating low-cost distributed sensors and Machine learning (ML) models to enhance battlespace awareness and complement existing sensing platforms for real-time sUAS detection, classification, and localization. The thesis introduces the conceptualization and development of a Drone Detection Command …

Dung Dkar Cloak: Exploring Soft Interfaces For Sonic Interactions, Judit Eszter Kárpáti, Esteban De La Torre

Textile Society of America: Symposium Proceedings

The importance of crossmodal interaction within the contemporary cultural, technological and scientific panorama has evidently gained significant attention due to its remarkable advantages in creating a meaningful, interwoven, and integrated experience. The use and recontextualization of textiles in such exploratory quest into the human senses has proven to be critical. Computational science, algorithmic logic and digital devices have always been rooted and closely interwoven with textile crafts and practices. Recent technological advancements have further combined technology and textile, generating interactive textile surfaces, constructing endless possibilities for multisensorial experiences. In this presentation we will examine how we can weave a sensitive …

Gnss Software Defined Radio: History, Current Developments, And Standardization Efforts, Thomas Pany, Dennis Akos, Javier Arribas, M. Zahidul H. Bhuiyan, Pau Closas, Fabio Dovis, Ignacio Fernandez-Hernandez, Carles Fernandez-Prades, Sanjeev Gunawardena, Todd Humphreys, Zaher M. Kassas, Jose A. Lopez Salcedo, Mario Nicola, Mario L. Psiaki, Alexander Rugamer, Yong-Jin Song, Jong-Hoon Won

Faculty Publications

Taking the work conducted by the global navigation satellite system (GNSS) software-defined radio (SDR) working group during the last decade as a seed, this contribution summarizes, for the first time, the history of GNSS SDR development. This report highlights selected SDR implementations and achievements that are available to the public or that influenced the general development of SDR. Aspects related to the standardization process of intermediate-frequency sample data and metadata are discussed, and an update of the Institute of Navigation SDR Standard is proposed. This work focuses on GNSS SDR implementations in general-purpose processors and leaves aside developments conducted on …

Artificial Intelligence Enabled Machinery Fault Detection And Diagnosis Using Vibro-Acoustic Signals, Srinivasa Rao Ippili

Theses and Dissertations--Mechanical and Aerospace Engineering

In various industries, the early detection of faults in rotating machinery is crucial to prevent system failures and ensure customer satisfaction. Typically, vibration measurement and diagnosis are employed for fault detection, but this process faces challenges in automation due to the complexity of installing and maintaining accelerometers, particularly in end-of-line quality control or pre-installed machinery health assessments. Acoustic signals, as a form of mechanical wave, offer an alternative for monitoring machinery while in operation. Unlike accelerometers, acoustic transducers are non-contact and easy to set up, enabling real-time data collection without interrupting equipment operation. However, utilizing acoustic signals in manufacturing poses …

Sparse Representation Learning For Temporal Networks, Maxwell Mcneil

Electronic Theses & Dissertations (2024 - present)

Temporal networks arise in many domains including activity of social network users, sensor network readings over time, and time course gene expression within the interaction network of a model organism. Data of this type contains a wealth of prior information such as the connectivity among nodes (e.g., a friendship graph), and prior knowledge of expected temporal patterns (e.g., periodicity). Modeling these temporal and network patterns jointly is essential for state-of-the-art performance in temporal network data analysis and mining. Sparse dictionary encoding is one modeling approach for such underlying patterns. However, most classical approaches consider only one dimension of the data …

An Analysis Of Precision: Occlusion And Perspective Geometry’S Role In 6d Pose Estimation, Jeffrey Choate, Derek Worth, Scott Nykl, Clark N. Taylor, Brett J. Borghetti, Christine M. Schubert Kabban

Faculty Publications

Achieving precise 6 degrees of freedom (6D) pose estimation of rigid objects from color images is a critical challenge with wide-ranging applications in robotics and close-contact aircraft operations. This study investigates key techniques in the application of YOLOv5 object detection convolutional neural network (CNN) for 6D pose localization of aircraft using only color imagery. Traditional object detection labeling methods suffer from inaccuracies due to perspective geometry and being limited to visible key points. This research demonstrates that with precise labeling, a CNN can predict object features with near-pixel accuracy, effectively learning the distinct appearance of the object due to perspective …

Resilient, Sustainable, And Secure Systems Support For Ultra-Low-Power Computational Things, Nicole Tobias

All Dissertations

Wireless battery-free and energy-harvesting devices are expanding the reach and vision of the Internet of Things, where trillions of embedded computational things interconnect ubiquitously around us and inform many different aspects of our everyday lives. Designing these systems without batteries and interconnecting wires lowers maintenance, environmental, and economic costs while also extending device lifetime and deployment opportunities. Over the last decade, research on these ultra-low-power embedded sensors and systems has dramatically increased — enabling new and exciting prospects in many different scientific fields, from smart building and health monitoring applications to animal and activity tracking.

These systems are not without …

Electronic Note-String Detector, Gavin Garcia-Rossi, Tommy Smail

Electrical Engineering

As the virtual space has become a dominant part of everyone’s day-to-day lives, many normal face-to-face interactions and services have not yet been facilitated by adapting technology. One of these prevailing areas is music lessons. Over Zoom meetings, or other virtual platforms, it is tremendously challenging to teach students. These challenges include recognizing student mistakes audibly and visually, and being able to give confident feedback on the incorrect notes played by learning musicians. Without having to delve into improving the complex systems that would be required to improve audio, video, and connection quality of these connections, we have another solution …

Accelerating Machine Learning Inference For Satellite Component Feature Extraction Using Fpgas., Andrew Ekblad

Theses and Dissertations

Running computer vision algorithms requires complex devices with lots of computing power, these types of devices are not well suited for space deployment. The harsh radiation environment and limited power budgets have hindered the ability of running advanced computer vision algorithms in space. This problem makes running an on-orbit servicing detection algorithm very difficult. This work proposes using a low powered FPGA to accelerate the computer vision algorithms that enable satellite component feature extraction. This work uses AMD/Xilinx’s Zynq SoC and DPU IP to run model inference. Experiments in this work centered around improving model post processing by creating implementations …

Spoken Language Processing And Modeling For Aviation Communications, Aaron Van De Brook

Doctoral Dissertations and Master's Theses

With recent advances in machine learning and deep learning technologies and the creation of larger aviation-specific corpora, applying natural language processing technologies, especially those based on transformer neural networks, to aviation communications is becoming increasingly feasible. Previous work has focused on machine learning applications to natural language processing, such as N-grams and word lattices. This thesis experiments with a process for pretraining transformer-based language models on aviation English corpora and compare the effectiveness and performance of language models transfer learned from pretrained checkpoints and those trained from their base weight initializations (trained from scratch). The results suggest that transformer language …

On Explainability Of Neural Networks, Cem Benar

Dissertations

It is widely reported that deep neural networks outperform most competitors for a range of applications. The state-of-the-art neural networks have built-in inductive bias of architectural choices, regularizations, optimizer types, and initialization methods. Using inductive bias is intuitive to enhance the model approximation. Deep neural networks are mostly dense and heavily overparameterized. They tend to be biased towards low-rank solutions to reduce complexity and improve generalization performance, known as implicit regularization. The implicit regularization as observed in specific architectures and various real-world data sets suggests to overparameterize neural networks judiciously and learn compressed representations (lower rank approximation) with improved performance. …