Signal Processing Commons^™

Learning Global Context For Sparse Activity Recognition In Lengthy Recordings With Limited Dataset Size, Zeyu Tang

All Dissertations

This dissertation describes methods to analyze lengthy recordings of data in order to detect sparsely occurring activities. The narrative below describes the progression of research that led to the development of these methods and their generalization into a unified framework. My research started with designing models for dietary monitoring, including detecting meals from day-long recordings and detecting intake gestures from meal-length recordings. Both tasks share some common characteristics: (a) the target event takes only a small portion of data recordings, and (b) there is global context within full-length data recordings that can help a model make better decisions. After finishing …

Universal Sound Separation: Distance-Aware Mixture Simulation, Co-Occurrence Conditioning, And Chain-Of-Inference, Wonjun Park

Computer Science and Engineering Theses - Archive

Universal Sound Separation (USS) -- the task of disentangling arbitrary sound sources from a single-channel acoustic mixture -- remains an open challenge due to the ill-posed nature of the problem and the distributional gap between synthetic training data and real-world recordings. This thesis addresses three distinct bottlenecks in the USS pipeline: training data realism, inference strategy, and conditioning richness. We first present two knowledge-guided approaches to sound source separation. The first is a distance-aware mixing strategy that leverages Large Language Models (LLMs) to assign plausible loudness relationships between audio sources during training data synthesis. By querying an LLM about the …

A Predictive Model For Multi- Week Respiratory Risk From Red Tide On Florida’S Gulf Coast., Elmer S. Ochaeta

Computer Science and Engineering Faculty Publications

Florida’s Gulf Coast red tide (Karenia brevis) can put toxins into the air, making people cough, irritating the throat, and worsening asthma or other breathing problems especially when winds blow from the ocean toward the beach. Right now, most public updates don’t really help with the question people actually ask when planning a weekend or vacation: “Will going to or close to the beach be risky in the next few weeks?”.

In this project, I build a weekly early warning system that estimates respiratory risk for specific beaches and predicts that risk 2 to 4 weeks ahead. The study covers …

Iso-Detr: A Novel Detection Transformer For Industrial Small Object Detection, Faisal Saeed, Anand Paul

School of Public Health Faculty Publications

Effectively detecting and assessing real-time structural and ecological parameters in contemporary manufacturing environments poses significant challenges, particularly in identifying minute objects within product images. The swift evolution of the industrial sector underscores the necessity for intelligent manufacturing environments to uphold stringent product quality standards. However, accelerating production processes at high speeds heightens the risk of defective product outcomes. This research addresses the challenges inherent in small object detection within industrial contexts, proposing an innovative detection transformer model tailored to modern manufacturing environments. The proposed model integrates a feature-enhanced multi-head self-attention block (FEMSA), merging cross-channel communication network and multiple multi-head self-attention …

Adaptive Deep Learning In Physical Layer Applications, Ali Owfi

All Dissertations

Traditionally, signal processing models in communication systems have been designed based on solid foundations in statistics and information theory, often assuming linearity and optimizing for simplified models. However, real-world communication systems exhibit numerous imperfections and non-linearities that traditional linear models struggle to capture accurately. Deep Learning (DL)-based approaches, unconstrained by rigid mathematical models, have shown promise in optimizing system performance by accommodating specific hardware configurations and dynamic channel conditions as an alternative to the traditional methods. Despite all the recent research efforts on DL-based methods for physical layer applications, DL models have still not been widely applied to physical layer …

Csc36000 - Modern Distributed Computing Assignment, Saptarashmi Bandyopadhyay

Open Educational Resources

This assignment covers standard performance metrics for Distributed Systems and the basics of Multiprocessing for CSC36000 - Modern Distributed Computing at the City College of New York CUNY. It is an interactive coding assignment intended to be executed in a Python notebook.

Multi-Modal Depth Estimation Using Camera And Mmwave Sensors, Alston D. Devero-Belfon

Student Theses

For accurately estimating the depth of environments with varying lighting conditions, reliable methods are limited. By utilizing wireless sensor technology in conjunction with cameras, a wide range of environments can be visualized, and objects within these environments can be tracked and monitored. Such methods offer cost-effective alternatives and provide a more secure, data-at-rest option for individuals with low vision, while also enhancing machine perception. In this work, we develop such a prototype that utilizes wireless sensors and cameras, which act in sync, enabling us to estimate the depth of objects within varying lighting environments to a level that is recognizable …

Artificial Intelligence Applications For Grid-Connected Solar Inverters, Utkirjon Ubaydullaev, Sarvinoz Mirzaeva, Hasan Mustafoev

Chemical Technology, Control and Management

The increasing global demand for renewable energy has highlighted the importance of grid-connected solar inverters in ensuring efficient and stable power conversion. However, challenges such as fluctuations in solar energy generation, grid disturbances, and power quality issues necessitate advanced control strategies. The integration of artificial intelligence (AI) into solar inverters presents a transformative solution, enhancing performance, adaptability, and reliability in real-world applications.

This review explores the role of AI techniques, including machine learning (ML), deep learning (DL), fuzzy logic, and reinforcement learning (RL), in optimizing key inverter functionalities such as maximum power point tracking (MPPT), fault detection, power quality enhancement, …

Smart Irrigation System Using Iot And Lstm For Optimal Water Management, Farley Y. Ruiz

Electrical Engineering Theses - Archive

This thesis presents the design and implementation of a smart irrigation system that combines Internet of Things hardware with a Long Short-Term Memory (LSTM) neural network for predictive soil moisture management. The goal is an affordable and reliable solution that uses real-time sensor data and environmental data to schedule irrigation before the substrate moisture drops below its target range. The system integrates soil moisture, temperature, humidity, and sensors on an Arduino Nano that communicates wirelessly with a Raspberry Pi. The Raspberry Pi runs a Python/Flask backend that collects and processes data, executes the LSTM model, and serves a secure web …

Database And Machine Learning Model For Classifying Autism Spectrum Disorder From Smartphone Based Electroretinography, Rory Harris

Honors Scholar Theses

Autism Spectrum Disorder (ASD) is a neurodevelopmental disorder that negatively affects a patient’s cognitive and communication aptitude and, therefore, can severely impact that patient’s quality of life. Because of this, early diagnosis is paramount. In recent studies, electroretinography (ERG), which is a measure of the retina’s electrical response to a brief flash of light into the eye, has shown promise in detecting ASD. Access to these scans can provide early diagnosis, improving well-being. Current ERG devices are very expensive due to their on board processing capabilities. This paper aims to create an ERG device using a smartphone as the main …

Enhancing Rotating Machinery Fault Diagnosis: A Dual-Head Attention Mechanism In Deep Learning Neural Networks, Qing Snyder

Dissertations

Rotating machinery is crucial to production efficiency and safety in manufacturing industries for an extended time. Ensuring machinery reliability necessitates effective diagnostic systems, particularly for rotating bearings, the key components of such equipment. Fault diagnosis in rotating machinery is essential to prevent failures and minimize downtime, thereby playing an important role in industrial operations. The application of advanced neural network techniques in industry has risen recently. Among these, attention-based neural networks, especially the Transformer models, are originally noteworthy for their sequential data handling capability. This research delves into attention-based algorithms for rotating machinery fault diagnosis, signifying a substantial advancement in …

Random Forests For Detecting Weak Signals And Extracting Physical Information: A Case Study Of Magnetic Navigation, Mohammadamin Moradi, Zheng-Meng Zhai, Aaron Nielsen, Ying-Cheng Lai, Aaron P. Nielsen

Faculty Publications

It has been recently demonstrated that two machine-learning architectures, reservoir computing and time-delayed feed-forward neural networks, can be exploited for detecting the Earth’s anomaly magnetic field immersed in overwhelming complex signals for magnetic navigation in a GPS-denied environment. The accuracy of the detected anomaly field corresponds to a positioning accuracy in the range of 10–40 m. To increase the accuracy and reduce the uncertainty of weak signal detection as well as to directly obtain the position information, we exploit the machine-learning model of random forests that combines the output of multiple decision trees to give optimal values of the physical …

Artificial Intelligence Enabled Machinery Fault Detection And Diagnosis Using Vibro-Acoustic Signals, Srinivasa Rao Ippili

Theses and Dissertations--Mechanical and Aerospace Engineering

In various industries, the early detection of faults in rotating machinery is crucial to prevent system failures and ensure customer satisfaction. Typically, vibration measurement and diagnosis are employed for fault detection, but this process faces challenges in automation due to the complexity of installing and maintaining accelerometers, particularly in end-of-line quality control or pre-installed machinery health assessments. Acoustic signals, as a form of mechanical wave, offer an alternative for monitoring machinery while in operation. Unlike accelerometers, acoustic transducers are non-contact and easy to set up, enabling real-time data collection without interrupting equipment operation. However, utilizing acoustic signals in manufacturing poses …

Sparse Representation Learning For Temporal Networks, Maxwell Mcneil

Electronic Theses & Dissertations (2024 - present)

Temporal networks arise in many domains including activity of social network users, sensor network readings over time, and time course gene expression within the interaction network of a model organism. Data of this type contains a wealth of prior information such as the connectivity among nodes (e.g., a friendship graph), and prior knowledge of expected temporal patterns (e.g., periodicity). Modeling these temporal and network patterns jointly is essential for state-of-the-art performance in temporal network data analysis and mining. Sparse dictionary encoding is one modeling approach for such underlying patterns. However, most classical approaches consider only one dimension of the data …

Accelerating Machine Learning Inference For Satellite Component Feature Extraction Using Fpgas., Andrew Ekblad

Theses and Dissertations

Running computer vision algorithms requires complex devices with lots of computing power, these types of devices are not well suited for space deployment. The harsh radiation environment and limited power budgets have hindered the ability of running advanced computer vision algorithms in space. This problem makes running an on-orbit servicing detection algorithm very difficult. This work proposes using a low powered FPGA to accelerate the computer vision algorithms that enable satellite component feature extraction. This work uses AMD/Xilinx’s Zynq SoC and DPU IP to run model inference. Experiments in this work centered around improving model post processing by creating implementations …

Spoken Language Processing And Modeling For Aviation Communications, Aaron Van De Brook

Doctoral Dissertations and Master's Theses

With recent advances in machine learning and deep learning technologies and the creation of larger aviation-specific corpora, applying natural language processing technologies, especially those based on transformer neural networks, to aviation communications is becoming increasingly feasible. Previous work has focused on machine learning applications to natural language processing, such as N-grams and word lattices. This thesis experiments with a process for pretraining transformer-based language models on aviation English corpora and compare the effectiveness and performance of language models transfer learned from pretrained checkpoints and those trained from their base weight initializations (trained from scratch). The results suggest that transformer language …

On Explainability Of Neural Networks, Cem Benar

Dissertations

It is widely reported that deep neural networks outperform most competitors for a range of applications. The state-of-the-art neural networks have built-in inductive bias of architectural choices, regularizations, optimizer types, and initialization methods. Using inductive bias is intuitive to enhance the model approximation. Deep neural networks are mostly dense and heavily overparameterized. They tend to be biased towards low-rank solutions to reduce complexity and improve generalization performance, known as implicit regularization. The implicit regularization as observed in specific architectures and various real-world data sets suggests to overparameterize neural networks judiciously and learn compressed representations (lower rank approximation) with improved performance. …

Characterization And Estimation Of Musculoskeletal Pain Using Machine Learning, Boluwatife Faremi

Master's Theses

Traditional scales utilized for recording pain are known to be highly subjective and biased due to inaccuracies in recollecting actual pain intensities. As a result, machine learning (ML) models that are trained using these scores as ground truth are reported to have low performance for objective pain classification because of the huge disparity between what was felt in moments of pain and the scores recorded afterward.

In the present study, two devices were designed for gathering real-time, continuous in-session subjective pain scores and the recording of the autonomic nervous system (ANS) altered endodermal (EDA) activity. 24 participants were recruited to …

Investigating The Use Of Recurrent Neural Networks In Modeling Guitar Distortion Effects, Caleb Koch, Scott Hawley, Andrew Fyfe

[Archive] Belmont University Research Symposium (BURS)

Guitar players have been modifying their guitar tone with audio effects ever since the mid-20th century. Traditionally, these effects have been achieved by passing a guitar signal through a series of electronic circuits which modify the signal to produce the desired audio effect. With advances in computer technology, audio “plugins” have been created to produce audio effects digitally through programming algorithms. More recently, machine learning researchers have been exploring the use of neural networks to replicate and produce audio effects initially created by analog and digital effects units. Recurrent Neural Networks have proven to be exceptional at modeling audio effects …

Chatgpt As Metamorphosis Designer For The Future Of Artificial Intelligence (Ai): A Conceptual Investigation, Amarjit Kumar Singh (Library Assistant), Dr. Pankaj Mathur (Deputy Librarian)

Library Philosophy and Practice (e-journal)

Abstract

Purpose: The purpose of this research paper is to explore ChatGPT’s potential as an innovative designer tool for the future development of artificial intelligence. Specifically, this conceptual investigation aims to analyze ChatGPT’s capabilities as a tool for designing and developing near about human intelligent systems for futuristic used and developed in the field of Artificial Intelligence (AI). Also with the helps of this paper, researchers are analyzed the strengths and weaknesses of ChatGPT as a tool, and identify possible areas for improvement in its development and implementation. This investigation focused on the various features and functions of ChatGPT that …

Generalizable And Adaptable Data-Driven Methods For Overcoming Barriers To Practical Industrial Condition Monitoring, Matthew B. Russell

Theses and Dissertations--Electrical and Computer Engineering

The future of smart manufacturing relies on predictive maintenance systems that intelligently minimize expensive downtime through timely assessment of machine condition. Deep Learning (DL) has achieved excellent performance in industrial condition monitoring experiments, but the constraints of the manufacturing environment prevent many algorithms from being practically deployed on the factory floor. Ubiquitous sensing from online machines generates high velocity data streams that require new techniques for efficient transmission and storage. Despite these ever-increasing data lakes, many applications still lack the data needed for training DL fault diagnosis and wear tracking models since most data is unlabeled and only from nominal …

Defending Ai-Based Automatic Modulation Recognition Models Against Adversarial Attacks, Haolin Tang, Ferhat Ozgur Catak, Murat Kuzlu, Evren Catak, Yanxiao Zhao

Engineering Technology Faculty Publications

Automatic Modulation Recognition (AMR) is one of the critical steps in the signal processing chain of wireless networks, which can significantly improve communication performance. AMR detects the modulation scheme of the received signal without any prior information. Recently, many Artificial Intelligence (AI) based AMR methods have been proposed, inspired by the considerable progress of AI methods in various fields. On the one hand, AI-based AMR methods can outperform traditional methods in terms of accuracy and efficiency. On the other hand, they are susceptible to new types of cyberattacks, such as model poisoning or adversarial attacks. This paper explores the vulnerabilities …

Deep-Learning-Based Classification Of Digitally Modulated Signals Using Capsule Networks And Cyclic Cumulants, John A. Snoap, Dimitrie C. Popescu, James A. Latshaw, Chad M. Spooner

Electrical & Computer Engineering Faculty Publications

This paper presents a novel deep-learning (DL)-based approach for classifying digitally modulated signals, which involves the use of capsule networks (CAPs) together with the cyclic cumulant (CC) features of the signals. These were blindly estimated using cyclostationary signal processing (CSP) and were then input into the CAP for training and classification. The classification performance and the generalization abilities of the proposed approach were tested using two distinct datasets that contained the same types of digitally modulated signals, but had distinct generation parameters. The results showed that the classification of digitally modulated signals using CAPs and CCs proposed in the paper …

Development Of A Smartphone Application As An Asset To Pavement Management Engineers, Smartp3m, Damien Stephens

Electrical Engineering Theses

An application specific multi-platform smartphone application can utilize on-board accelerometer, gyroscope, and GPS sensors, along with software derived signals from the same sensors, to sample vibrational and geolocation datasets to capture pavement distresses such as potholes when mounted in a standardized configuration in a vehicle. Several observations were made with regard to the signals obtained from the accelerometer, gyroscope, and GPS sensors, and it was determined that the raw sensor outputs are capable of sampling statistically significant datasets which can be used to distinguish pavement distress from normal driving conditions. Furthermore, an approximate sensor noise margin is established, and a …

Emotion Detection Using An Ensemble Model Trained With Physiological Signals And Inferred Arousal-Valence States, Matthew Nathanael Gray

Electrical & Computer Engineering Theses & Dissertations

Affective computing is an exciting and transformative field that is gaining in popularity among psychologists, statisticians, and computer scientists. The ability of a machine to infer human emotion and mood, i.e. affective states, has the potential to greatly improve human-machine interaction in our increasingly digital world. In this work, an ensemble model methodology for detecting human emotions across multiple subjects is outlined. The Continuously Annotated Signals of Emotion (CASE) dataset, which is a dataset of physiological signals labeled with discrete emotions from video stimuli as well as subject-reported continuous emotions, arousal and valence, from the circumplex model, is used for …

Computational Models To Detect Radiation In Urban Environments: An Application Of Signal Processing Techniques And Neural Networks To Radiation Data Analysis, Jose Nicolas Gachancipa

Beyond: Undergraduate Research Journal

Radioactive sources, such as uranium-235, are nuclides that emit ionizing radiation, and which can be used to build nuclear weapons. In public areas, the presence of a radioactive nuclide can present a risk to the population, and therefore, it is imperative that threats are identified by radiological search and response teams in a timely and effective manner. In urban environments, such as densely populated cities, radioactive sources may be more difficult to detect, since background radiation produced by surrounding objects and structures (e.g., buildings, cars) can hinder the effective detection of unnatural radioactive material. This article presents a computational model …

Machine Learning Classification Of Digitally Modulated Signals, James A. Latshaw

Electrical & Computer Engineering Theses & Dissertations

Automatic classification of digitally modulated signals is a challenging problem that has traditionally been approached using signal processing tools such as log-likelihood algorithms for signal classification or cyclostationary signal analysis. These approaches are computationally intensive and cumbersome in general, and in recent years alternative approaches that use machine learning have been presented in the literature for automatic classification of digitally modulated signals. This thesis studies deep learning approaches for classifying digitally modulated signals that use deep artificial neural networks in conjunction with the canonical representation of digitally modulated signals in terms of in-phase and quadrature components. Specifically, capsule networks are …

Intra-Hour Solar Forecasting Using Cloud Dynamics Features Extracted From Ground-Based Infrared Sky Images, Guillermo Terrén-Serrano

Electrical and Computer Engineering ETDs

Due to the increasing use of photovoltaic systems, power grids are vulnerable to the projection of shadows from moving clouds. An intra-hour solar forecast provides power grids with the capability of automatically controlling the dispatch of energy, reducing the additional cost for a guaranteed, reliable supply of energy (i.e., energy storage). This dissertation introduces a novel sky imager consisting of a long-wave radiometric infrared camera and a visible light camera with a fisheye lens. The imager is mounted on a solar tracker to maintain the Sun in the center of the images throughout the day, reducing the scattering effect produced …

On-Ice Detection, Classification, Localization And Tracking Of Anthropogenic Acoustic Sources With Machine Learning, Steven J. Whitaker

Dissertations, Master's Theses and Master's Reports

Arctic acoustics have been of concern in recent years for the US navy. First-year ice is now the prevalent factor in ice coverage in the Arctic, which changes the previously understood acoustic properties. Due to the ice melting each year, anthropogenic sources in the Arctic region are more common: military exercises, shipping, and tourism. For the navy, it is of interest to detect, classify, localize, and track these sources to have situational awareness of these surroundings. Because the sources are on-water or on-ice, acoustic radiation propagates at a longer distance and so acoustics are the method by which the sources …

Generation Of High Performing Morph Datasets, Kelsey Lynn O'Haire

Graduate Theses, Dissertations, and Problem Reports (ETD)

Facial recognition systems play a vital role in our everyday lives. We rely on this technology from menial tasks to issues as vital as national security. While strides have been made over the past ten years to improve facial recognition systems, morphed face images are a viable threat to the reliability of these systems. Morphed images are generated by combining the face images of two subjects. The resulting morphed face shares the likeness of the contributing subjects, confusing both humans and face verification algorithms. This vulnerability has grave consequences for facial recognition systems used on international borders or for law …