Signal Processing Commons^™

Robotizing Complex Welding Processes Through Imitation Learning And Generative Models From Human Demonstration, Yue Cao

Theses and Dissertations--Electrical and Computer Engineering

Arc welding processes demand real-time adaptive control that current robotic systems cannot achieve autonomously. This dissertation develops a systematic framework to robotize complex welding by learning from human demonstration, integrating generative modeling, physics-informed reconstruction, and model-based imitation learning. First, human--robot collaboration systems are established for both Gas Tungsten Arc Welding (GTAW) and Double-Electrode Gas Metal Arc Welding, combining robotic teleoperation with virtual reality interfaces to capture high-quality operator demonstrations. Second, a physics-informed neural network framework reconstructs complete molten pool flow fields from high-speed imaging, enriching process understanding beyond direct sensor observation. Third, generative models, including a hybrid latent variational autoencoder …

Scalable Hypergraph Structure Learning With Diverse Smoothness Priors, Benjamin T. Brown

Theses and Dissertations--Electrical and Computer Engineering

In graph signal processing, learning weighted connections between nodes from signals is a fundamental task when the underlying relationships are unknown. With the extension of graphs to hypergraphs, where edges can connect more than two nodes, graph learning methods have similarly been generalized to hypergraphs. However, the absence of a unified framework for calculating total variation has led to divergent definitions of smoothness and, consequently, differing approaches to hyperedge recovery. This challenge is confronted in this work through generalization of several previously proposed hypergraph total variations, allowing ease of substitution into a vector-based optimization. To this end, a novel hypergraph …

Artificial Intelligence Enabled Machinery Fault Detection And Diagnosis Using Vibro-Acoustic Signals, Srinivasa Rao Ippili

Theses and Dissertations--Mechanical and Aerospace Engineering

In various industries, the early detection of faults in rotating machinery is crucial to prevent system failures and ensure customer satisfaction. Typically, vibration measurement and diagnosis are employed for fault detection, but this process faces challenges in automation due to the complexity of installing and maintaining accelerometers, particularly in end-of-line quality control or pre-installed machinery health assessments. Acoustic signals, as a form of mechanical wave, offer an alternative for monitoring machinery while in operation. Unlike accelerometers, acoustic transducers are non-contact and easy to set up, enabling real-time data collection without interrupting equipment operation. However, utilizing acoustic signals in manufacturing poses …

Investigation Of Delta-Focused Ictal Electrical Source Imaging In Refractory Focal Epilepsy, Jared A. Rybarczyk

Theses and Dissertations--Electrical and Computer Engineering

Refractory focal epilepsy is characterized by the presence of seizures that cannot be controlled via anti-seizure medications. For patients suffering from this form of epilepsy, accurate identification of the seizure onset zone is a crucial step for many modalities of treatment. Electrical source imaging (ESI) allows for estimation of the seizure onset zone from electroencephalography. EEG feature extraction is an important step that can impact the final accuracy of source estimates. This work provides a review of 23 ictal ESI studies and proposes a delta-focused ictal ESI methodology. Our proposed delta-focused ictal ESI is implemented across 33 refractory focal epilepsy …

A Novel Processor Architecture Implementing The Stacked Error Diffusion Algorithm And Its Zynq-Based Realization, Qishi Hu

Theses and Dissertations--Electrical and Computer Engineering

Digital halftoning reproduces continuous-tone images using patterns of black and white dots, while multitoning extends this concept by incorporating inks with intermediate intensities. These techniques are extensively utilized in the printing industry to accommodate the limited range of inks available in printers. Stacked error diffusion is a high-quality multitoning algorithm that adheres to the blue-noise dithering standard. This thesis research studies the potential parallelism inherent in the algorithm and introduces the design of a novel processor architecture optimized for efficient execution. The architecture is realized on an FPGA development board featuring a Zynq SoC. Additionally, the hardware prototype can also …

Information-Theoretic Learning Framework Based On Covariance Operators On Reproducing Kernel Hilbert Spaces, Jhoan Keider Hoyos Osorio

Theses and Dissertations--Electrical and Computer Engineering

Information theory provides tools to quantify uncertainty, dependence, and similarity between probability distributions, which are crucial for addressing various machine-learning problems. However, estimating these quantities is challenging because data distributions are usually unknown, and only observations are available for analysis. In this dissertation, we advance the field of information-theoretic learning by developing a comprehensive framework using kernel methods for analyzing probability distributions using reproducing kernel Hilbert spaces (RKHS). By leveraging covariance operators in this representation space, we propose approaches to estimate a set of fundamental information-theoretic quantities, that, because of their resemblance with conventional quantities in information theory, we call …

Generalizable And Adaptable Data-Driven Methods For Overcoming Barriers To Practical Industrial Condition Monitoring, Matthew B. Russell

Theses and Dissertations--Electrical and Computer Engineering

The future of smart manufacturing relies on predictive maintenance systems that intelligently minimize expensive downtime through timely assessment of machine condition. Deep Learning (DL) has achieved excellent performance in industrial condition monitoring experiments, but the constraints of the manufacturing environment prevent many algorithms from being practically deployed on the factory floor. Ubiquitous sensing from online machines generates high velocity data streams that require new techniques for efficient transmission and storage. Despite these ever-increasing data lakes, many applications still lack the data needed for training DL fault diagnosis and wear tracking models since most data is unlabeled and only from nominal …

Modeling The Early Visual System, Nicholas Lanning

Theses and Dissertations--Electrical and Computer Engineering

There are two encoding schema present in simple cells in the early visual system of vertebrates: the retinal simple cells activate highly when the receptive field contains a center surround stimulus, while the primary visual cortex’s (V1) simple cells activate highly when the receptive field contains visual edges. Work has been done in the past to enforce constraints on visual machine learning such that the retinal or V1 encoding is learned, but this work is often done to emulate retinal and V1 encoding in a vacuum. Recent work using convolutional neural networks focuses on anatomical constraints along with a supervised …

Synthesizing Dysarthric Speech Using Multi-Speaker Tts For Dsyarthric Speech Recognition, Mohammad Soleymanpour

Theses and Dissertations--Electrical and Computer Engineering

Dysarthria is a motor speech disorder often characterized by reduced speech intelligibility through slow, uncoordinated control of speech production muscles. Automatic Speech recognition (ASR) systems may help dysarthric talkers communicate more effectively. However, robust dysarthria-specific ASR requires a significant amount of training speech is required, which is not readily available for dysarthric talkers.

In this dissertation, we investigate dysarthric speech augmentation and synthesis methods. To better understand differences in prosodic and acoustic characteristics of dysarthric spontaneous speech at varying severity levels, a comparative study between typical and dysarthric speech was conducted. These characteristics are important components for dysarthric speech modeling, …

Novel Tools For Analysis Of Disordered Sleep And Motor Behavior In Preclinical Models Of Disease, Dillon M. Huffman

Theses and Dissertations--Biomedical Engineering

Subtle changes in sleep architecture can accompany and be symptomatic of various diseases or disorders. Understanding the complex interactions between sleep and health requires the ability to characterize sleep, probe its underlying mechanisms through perturbation, and quantify dependent physiological outcomes. Rodent models have come to be accepted as a valuable tool for preclinical investigations. However, experimental tools to accomplish such research typically rely on laborious methods that limit throughput and flexibility. Thus, research tools that minimize workload could be of great value to the research community and expedite investigation of the underlying mechanisms of sleep and further the development of …

Localization Of Stationary Source Of Floor Vibration Using The Steered Response Power Method, Mohammad Royvaran

Theses and Dissertations--Civil Engineering

If the generated vibration in a building exceeds the acceptable limit design for a floor system, it is necessary to identify the source of vibration, a process known as localization. The objective of this study is the localization of stationary vibration sources, and the approach used is the steered response power (SRP) method. This method has already been shown to work well for wireless and acoustical applications to locate transmitter and sound sources, respectively. To the writer’s knowledge, this study is the first application of the SRP method to locate vibration sources using floor vibration measurements. However, because waves behave …

Novel Machine Learning And Wearable Sensor Based Solutions For Smart Healthcare Monitoring, Rajdeep Kumar Nath

Theses and Dissertations--Electrical and Computer Engineering

The advent of IoT has enabled the design of connected and integrated smart health monitoring systems. These health monitoring systems can be utilized for monitoring the mental and physical wellbeing of a person. Stress, anxiety, and hypertension are the major elements responsible for the plethora of physical and mental illnesses. In this context, the older population demands special attention because of the several age-related complications that exacerbate the effects of stress, anxiety, and hypertension. Monitoring stress, anxiety, and blood pressure regularly can prevent long-term damage by initiating necessary intervention or clinical treatment beforehand. This will improve the quality of life …

Vibro-Acoustic Codling Moth Larvae Infestation Detection In Apples, Chadwick A. Parrish

Theses and Dissertations--Electrical and Computer Engineering

Within recent years, the demand for organic produce has greatly increased due to many factors, including increasing knowledge about such things as dietary fiber and balanced gastrointestinal bacterial ecosystems. This increase in demand, coupled with the financial penalties for sending invasive species and pests across borders, presents a need for a scalable and accurate system to non-destructively detect infestation. The proposed work addresses this problem by testing the performance of a non-destructive vibro-acoustic method for detecting lava activity in apples. This involved 3 steps; design a mechanical data collection prototype for testing apples, a evaluate a set of features, and …

Machine Learning Approach For Vigilance State Classification In Mice, Anik Muhury

Theses and Dissertations--Electrical and Computer Engineering

Sleep has a significant impact on cognitive abilities such as memory, reaction time, productivity, and creative thinking; however, there are many aspects of this important activity that are not clearly understood. Over the last century, researchers have developed technology and animal models to assist in the study of sleep. Manual sleep scoring is time consuming, reduces productivity, and is impacted by human scorer subjectivity. On the other hand, automatic sleep stage categorization can enhance consistency and reliability, aiding professionals in identifying sleep related health problems.

In recent times various studies reported significant achievements for automatic vigilance detection and overcome the …

Weakly Supervised Learning For Multi-Image Synthesis, Muhammad Usman Rafique

Theses and Dissertations--Electrical and Computer Engineering

Machine learning-based approaches have been achieving state-of-the-art results on many computer vision tasks. While deep learning and convolutional networks have been incredibly popular, these approaches come at the expense of huge amounts of labeled data required for training. Manually annotating large amounts of data, often millions of images in a single dataset, is costly and time consuming. To deal with the problem of data annotation, the research community has been exploring approaches that require less amount of labelled data.

The central problem that we consider in this research is image synthesis without any manual labeling. Image synthesis is a classic …

Accelerometer-Based Vigilance State Classification In Dairy Cows, Evan King

Theses and Dissertations--Electrical and Computer Engineering

Globally, dairy farming is a $700 billion industry, with more than 9 million dairy cows in the United States alone. Depriving cows of required activities such as sleep has been shown to negatively impact reproductive efficiency, decrease the volume of milk produced, and increase the risk of culling. Overcrowded herds can decrease individual animal health, demanding the need for automatic behavior detection that would provide insight into their state of health.

Using electroencephalography (EEG), electrooculography (EOG), and electromyography (EMG) to characterize the phases of sleep is a technique which has been used for decades. While these techniques are considered the …

Mispronunciation Detection And Diagnosis In Mandarin Accented English Speech, Subash Khanal

Theses and Dissertations--Electrical and Computer Engineering

This work presents the development, implementation, and evaluation of a Mispronunciation Detection and Diagnosis (MDD) system, with application to pronunciation evaluation of Mandarin-accented English speech. A comprehensive detection and diagnosis of errors in the Electromagnetic Articulography corpus of Mandarin-Accented English (EMA-MAE) was performed by using the expert phonetic transcripts and an Automatic Speech Recognition (ASR) system. Articulatory features derived from the parallel kinematic data available in the EMA-MAE corpus were used to identify the most significant articulatory error patterns seen in L2 speakers during common mispronunciations. Using both acoustic and articulatory information, an ASR based Mispronunciation Detection and Diagnosis (MDD) …

Articulatory-Wavenet: Deep Autoregressive Model For Acoustic-To-Articulatory Inversion, Narjes Alsadat Agha Seyed Mirza Bozorg

Theses and Dissertations--Electrical and Computer Engineering

Acoustic-to-Articulatory Inversion, the estimation of articulatory kinematics from speech, is an important problem which has received significant attention in recent years. Estimated articulatory movements from such models can be used for many applications, including speech synthesis, automatic speech recognition, and facial kinematics for talking-head animation devices. Knowledge about the position of the articulators can also be extremely useful in speech therapy systems and Computer-Aided Language Learning (CALL) and Computer-Aided Pronunciation Training (CAPT) systems for second language learners. Acoustic-to-Articulatory Inversion is a challenging problem due to the complexity of articulation patterns and significant inter-speaker differences. This is even more challenging when …

An Accurate And Efficient Time Delay Estimation Method Of Ultra-High Frequency Signals For Partial Discharge Localization In Substations, Pengfei Li, Kejie Dai, Tong Zhang, Yantao Jin, Yushun Liu, Yuan Liao

Electrical and Computer Engineering Faculty Publications

Partial discharge (PD) localization in substations based on the ultra-high frequency (UHF) method can be used to efficiently assess insulation conditions. Localization accuracy is affected by the accuracy of the time delay (TD) estimation, which is critical for PD localization in substations. A review of existing TD estimation methods indicates that there is a need to develop methods that are both accurate and computationally efficient. In this paper, a novel TD estimation method is proposed to improve both accuracy and efficiency. The TD is calculated using an improved cross-correlation algorithm based on full-wavefronts of array UHF signals, which are extracted …

A Redundant Monitoring System For Human Welder Operation Using Imu And Vision Sensors, Rui Yu

Theses and Dissertations--Electrical and Computer Engineering

In manual control, the welding gun’s moving speed can significantly influence the welding results and critical welding operations usually require welders to concentrate consistently in order to react rapidly and accurately. However, human welders always have some habitual action which can have some subtle influence the welding process. It takes countless hours to train an experienced human welder. Using vision and IMU sensor will be able to set up a system and allow the worker got more accurate visual feedback like an experienced worker.

The problem is that monitor and measuring of the control process not always easy under a …

Self-Image Multimedia Technologies For Feedforward Observational Learning, Nkiruka M. A. Uzuegbunam

Theses and Dissertations--Electrical and Computer Engineering

This dissertation investigates the development and use of self-images in augmented reality systems for learning and learning-based activities. This work focuses on self- modeling, a particular form of learning, actively employed in various settings for therapy or teaching. In particular, this work aims to develop novel multimedia systems to support the display and rendering of augmented self-images. It aims to use interactivity (via games) as a means of obtaining imagery for use in creating augmented self-images. Two multimedia systems are developed, discussed and analyzed. The proposed systems are validated in terms of their technical innovation and their clinical efficacy in …

Speaker And Gender Identification Using Bioacoustic Data Sets, Neenu Jose

Theses and Dissertations--Electrical and Computer Engineering

Acoustic analysis of animal vocalizations has been widely used to identify the presence of individual species, classify vocalizations, identify individuals, and determine gender. In this work automatic identification of speaker and gender of mice from ultrasonic vocalizations and speaker identification of meerkats from their Close calls is investigated. Feature extraction was implemented using Greenwood Function Cepstral Coefficients (GFCC), designed exclusively for extracting features from animal vocalizations. Mice ultrasonic vocalizations were analyzed using Gaussian Mixture Models (GMM) which yielded an accuracy of 78.3% for speaker identification and 93.2% for gender identification. Meerkat speaker identification with Close calls was implemented using Gaussian …

Time-Frequency Masking Performance For Improved Intelligibility With Microphone Arrays, Joshua P. Morgan

Theses and Dissertations--Electrical and Computer Engineering

Time-Frequency (TF) masking is an audio processing technique useful for isolating an audio source from interfering sources. TF masking has been applied and studied in monaural and binaural applications, but has only recently been applied to distributed microphone arrays. This work focuses on evaluating the TF masking technique's ability to isolate human speech and improve speech intelligibility in an immersive "cocktail party" environment. In particular, an upper-bound on TF masking performance is established and compared to the traditional delay-sum and general sidelobe canceler (GSC) beamformers. Additionally, the novel technique of combining the GSC with TF masking is investigated and its …

Experimental Investigation Of Reading Passive Uhf Tags In A Multi-Tag Environment, Yi Zhou

Theses and Dissertations--Mechanical and Aerospace Engineering

Recently, the Internet of things (IoT) has emerged as a promising solution for several industrial applications. One of the key components in IoT is passive radio frequency identification (RFID) tags which do not require a power source for operations. Specifically, ultra-high frequency (UHF) tags are studied in this paper. However, due to factors such as tag-to-tag interference and inaccurate localization, RFID tags that are closely spaced together are difficult to detect and program accurately with unique identifiers. This thesis investigates several factors that affect the ability to encode a specific tag with unique information in the presence of other tags, …

Constant False Alarm Rate Performance Of Sound Source Detection With Time Delay Of Arrival Algorithm, Xipeng Wang

Theses and Dissertations--Electrical and Computer Engineering

Time Delay of Arrival (TDOA) based algorithms and Steered Response Power (SRP) based algorithms are two most commonly used methods for sound source detection and localization. SRP is more robust under high reverberation and multi-target conditions, while TDOA is less computationally intensive. This thesis introduces a modified TDOA algorithm, TDOA delay table search (TDOA-DTS), that has more stable performance than the original TDOA, and requires only 4% of the SRP computation load for a 3-dimensional space of a typical room. A 2-step adaptive thresholding procedure based on a Weibull noise peak distributions for the cross-correlations and a binomial distribution for …

Information-Theoretic Secure Outsourced Computation In Distributed Systems, Zhaohong Wang

Theses and Dissertations--Electrical and Computer Engineering

Secure multi-party computation (secure MPC) has been established as the de facto paradigm for protecting privacy in distributed computation. One of the earliest secure MPC primitives is the Shamir's secret sharing (SSS) scheme. SSS has many advantages over other popular secure MPC primitives like garbled circuits (GC) -- it provides information-theoretic security guarantee, requires no complex long-integer operations, and often leads to more efficient protocols. Nonetheless, SSS receives less attention in the signal processing community because SSS requires a larger number of honest participants, making it prone to collusion attacks. In this dissertation, I propose an agent-based computing framework using …

Analysis Of Vocal Fold Kinematics Using High Speed Video, Harikrishnan Unnikrishnan

Theses and Dissertations--Electrical and Computer Engineering

Vocal folds are the twin in-folding of the mucous membrane stretched horizontally across the larynx. They vibrate modulating the constant air flow initiated from the lungs. The pulsating pressure wave blowing through the glottis is thus the source for voiced speech production. Study of vocal fold dynamics during voicing are critical for the treatment of voice pathologies. Since the vocal folds move at 100 - 350 cycles per second, their visual inspection is currently done by strobosocopy which merges information from multiple cycles to present an apparent motion. High Speed Digital Laryngeal Imaging(HSDLI) with a temporal resolution of up to …

Robust Background Subtraction For Moving Cameras And Their Applications In Ego-Vision Systems, Hasan Sajid

Theses and Dissertations--Electrical and Computer Engineering

Background subtraction is the algorithmic process that segments out the region of interest often known as foreground from the background. Extensive literature and numerous algorithms exist in this domain, but most research have focused on videos captured by static cameras. The proliferation of portable platforms equipped with cameras has resulted in a large amount of video data being generated from moving cameras. This motivates the need for foundational algorithms for foreground/background segmentation in videos from moving cameras. In this dissertation, I propose three new types of background subtraction algorithms for moving cameras based on appearance, motion, and a combination of …

Wearable Privacy Protection With Visual Bubble, Shaoqian Wang

Theses and Dissertations--Electrical and Computer Engineering

Wearable cameras are increasingly used in many different applications such as entertainment, security, law enforcement and healthcare. In this thesis, we focus on the application of the police worn body camera and behavioral recording using a wearable camera for one-on-one therapy with a child in a classroom or clinic. To protect the privacy of other individuals in the same environment, we introduce a new visual privacy protection technique called visual bubble. Visual bubble is a virtual zone centered around the camera for observation whereas the rest of the environment and people are obfuscated. In contrast to most existing visual privacy …

Experimental-Computational Analysis Of Vigilance Dynamics For Applications In Sleep And Epilepsy, Farid Yaghouby

Theses and Dissertations--Biomedical Engineering

Epilepsy is a neurological disorder characterized by recurrent seizures. Sleep problems can cooccur with epilepsy, and adversely affect seizure diagnosis and treatment. In fact, the relationship between sleep and seizures in individuals with epilepsy is a complex one. Seizures disturb sleep and sleep deprivation aggravates seizures. Antiepileptic drugs may also impair sleep quality at the cost of controlling seizures. In general, particular vigilance states may inhibit or facilitate seizure generation, and changes in vigilance state can affect the predictability of seizures. A clear understanding of sleep-seizure interactions will therefore benefit epilepsy care providers and improve quality of life in patients. …