Digital Commons Network^™

Physics-Augmented Modeling And Optimization Of Complex Systems: Healthcare Applications, Jianxin Xie

Doctoral Dissertations

The rapid advances in sensing technology have created a data-rich environment that tremendously

benefits predictive modeling and decision-making for complex systems. Harnessing

the full potential of this complexly-structured sensing data requires the development of

novel and reliable analytical models and tools for system informatics. Such advancements in

sensing present unprecedented opportunities to investigate system dynamics and optimize

decision-making processes for smart health. Nevertheless, sensing data is typically

characterized by high dimensionality and intricate structures. To fully unlock the potential of

this data, we significantly rely on innovative analytical methods and tools that can effectively

process information.

The objective of this …

Optimizing Collective Communication For Scalable Scientific Computing And Deep Learning, Jiali Li

Doctoral Dissertations

In the realm of distributed computing, collective operations involve coordinated communication and synchronization among multiple processing units, enabling efficient data exchange and collaboration. Scientific applications, such as simulations, computational fluid dynamics, and scalable deep learning, require complex computations that can be parallelized across multiple nodes in a distributed system. These applications often involve data-dependent communication patterns, where collective operations are critical for achieving high performance in data exchange. Optimizing collective operations for scientific applications and deep learning involves improving the algorithms, communication patterns, and data distribution strategies to minimize communication overhead and maximize computational efficiency.

Within the context of this …

Deep Learning Based Power System Stability Assessment For Reduced Wecc System, Yinfeng Zhao

Doctoral Dissertations

Power system stability is the ability of power system, for a giving initial operating condition, to reach a new operation condition with most of the system variables bounded in normal range after subjecting to a short or long disturbance. Traditional power system stability mainly uses time-domain simulation which is very time consuming and only appropriate for offline assessment.

Nowadays, with increasing penetration of inverter based renewable, large-scale distributed energy storage integration and operation uncertainty brought by weather and electricity market, system dynamic and operating condition is more dramatic, and traditional power system stability assessment based on scheduling may not be …

Insights Into The Application Of Deep Reinforcement Learning In Healthcare And Materials Science, Benjamin R. Smith

Doctoral Dissertations

Reinforcement learning (RL) is a type of machine learning designed to optimize sequential decision-making. While controlled environments have served as a foundation for RL research, due to the growth in data volumes and deep learning methods, it is now increasingly being applied to real-world problems. In our work, we explore and attempt to overcome challenges that occur when applying RL to solve problems in healthcare and materials science.

First, we explore how issues in bias and data completeness affect healthcare applications of RL. To understand how bias has already been considered in this area, we survey the literature for existing …

Improving Customer Experience Throughout The Customer Journey In The Big Data Era, Mohammad Saljoughian

Doctoral Dissertations

My PhD dissertation focuses on how firms should adapt their strategies to improve customer engagement throughout customer journey. My first paper examines firm-customer conversations on social media. Many firms struggle with how to craft their messages in conversations with customers on social media, and the lack of guidance for interacting with customers is among the top social media challenges reported by firms. The problem is compounded by the fact that these conversations take place in different, simultaneous threads, each of which potentially requiring a different approach. This paper studies how firms can adapt their responses in individual social media conversations …

Tomato Flower Detection And Three-Dimensional Mapping For Precision Pollination, Kaitlyn Mckensie Nelms

Masters Theses

It is estimated that nearly 75% of major crops have some level of reliance on pollination. Humans are reliant on fruit and vegetable crops for many vital nutrients. With the intensification of agricultural production in response to human demand, native pollinator species are not able to provide sufficient pollination services, and managed bee colonies are in decline due to colony collapse disorder, among other issues. Previous work addresses a few of these issues by designing pollination systems for greenhouse operations or other controlled production systems but fails to address the larger need for development in other agricultural settings with less …

Benchmarking Of Embedded Object Detection In Optical And Radar Scenes, Vijaysrinivas Rajagopal

Masters Theses

A portable, real-time vital sign estimation protoype is developed using neural network- based localization, multi-object tracking, and embedded processing optimizations. The system estimates heart and respiration rates of multiple subjects using directional of arrival techniques on RADAR data. This system is useful in many civilian and military applications including search and rescue.

The primary contribution from this work is the implementation and benchmarking of neural networks for real time detection and localization on various systems including the testing of eight neural networks on a discrete GPU and Jetson Xavier devices. Mean average precision (mAP) and inference speed benchmarks were performed. …

On Interpreting Eddy Covariance In Small Area Agricultural Situations With Contrasting Site Management., Joel Oetting

Doctoral Dissertations

This dissertation examined the carbon sequestration potential of a low C:N soil amendment and its incorporation into the soil over a rolling agricultural field. A segmented planar fit was developed to assess and correct the systematic errors the topography introduces on the carbon dioxide fluxes. The carbon dioxide fluxes were then be partitioned into gross primary productivity and soil respiration to understand the influence of the contrasting management practices, using flux variance partitioning. Concomitant with the partitioning, high resolution temporal and spatial scale remote sensing images were interpolated and standardized to conduct hypothesis testing for treatment effects.

Learning With Limited Labeled Data For Image And Video Understanding, Razieh Kaviani Baghbaderani

Doctoral Dissertations

Deep learning-based algorithms have remarkably improved the performance in many computer vision tasks. However, deep networks often demand a large-scale and carefully annotated dataset and sufficient sample coverage of every training category. However, it is not practical in many real-world applications where only a few examples may be available, or the data annotation is costly and require expert knowledge. To mitigate this issue, learning with limited data has gained considerable attention and is investigated thorough different learning methods, including few-shot learning, weakly/semi supervised learning, open-set learning, etc.

In this work, the classification problem is investigated under an open-world assumption to …

Auto-Curation Of Large Evolving Image Datasets, Sara Mousavicheshmehkaboodi

Doctoral Dissertations

Large image collections are becoming common in many fields and offer tantalizing opportunities to transform how research, work, and education are conducted if the information and associated insights could be extracted from them. However, major obstacles to this vision exist. First, image datasets with associated metadata contain errors and need to be cleaned and organized to be easily explored and utilized. Second, such collections typically lack the necessary context or may have missing attributes that need to be recovered. Third, such datasets are domain-specific and require human expert involvement to make the right interpretation of the image content. Fourth, the …

Qualitative And Quantitative Improvements For Positron Emission Tomography Using Different Motion Correction Methodologies, Tasmia Rahman Tumpa

Doctoral Dissertations

Positron Emission Tomography (PET) data suffers from low image quality and quantitative accuracy due to different kinds of motion of patients during imaging. Hardware-based motion correction is currently the standard; however, is limited by several constraints, the most important of which is retroactive data correction. Data-driven techniques to perform motion correction in this regard are active areas of research. The motivation behind this work lies in developing a complete data-driven approach to address both motion detection and correction. The work first presents an algorithm based on the positron emission particle tracking (PEPT) technique and makes use of time-of-flight (TOF) information …

Automated Intelligent Cueing Device To Improve Ambient Gait Behaviors For Patients With Parkinson's Disease, Nader Naghavi

Doctoral Dissertations

Freezing of gait (FoG) is a common motor dysfunction in individuals with Parkinson’s disease (PD). FoG impairs walking and is associated with increased fall risk. Although pharmacological treatments have shown promise during ON-medication periods, FoG remains difficult to treat during medication OFF state and in advanced stages of the disease. External cueing therapy in the forms of visual, auditory, and vibrotactile, has been effective in treating gait deviations. Intelligent (or on-demand) cueing devices are novel systems that analyze gait patterns in real-time and activate cues only at moments when specific gait alterations are detected. In this study we developed methods …

Deep Learning Techniques For Power System Operation: Modeling And Implementation, Yan Du

Doctoral Dissertations

The fast development of the deep learning (DL) techniques in the most recent years has drawn attention from both academia and industry. And there have been increasing applications of the DL techniques in many complex real-world situations, including computer vision, medical diagnosis, and natural language processing. The great power and flexibility of DL can be attributed to its hierarchical learning structure that automatically extract features from mass amounts of data. In addition, DL applies an end-to-end solving mechanism, and directly generates the output from the input, where the traditional machine learning methods usually break down the problem and combine the …

Identifying Smokestacks In Remotely Sensed Imagery Via Deep Learning Algorithms, Kenneth Moss

Masters Theses

Locating smokestacks in remote sensing imagery is a crucial first step to calculating smokestack heights, which allows for the accurate modeling of dioxin pollution spread and the study of resulting health impacts. In the interest of automating this process, this thesis examines deep learning networks and how changes in input datasets and network architecture affect image detection accuracy. This initial image detection serves as the first step in automated object recognition and height calculation. While this is applicable to general land use classification, this study specifically addresses detecting smokestack images. Different dataset scenarios are generated from the massive Functional Map …

Improving Convolutional Neural Network Robustness To Adversarial Images Through Image Filtering, Natalie E. Bogda

Masters Theses

The field of computer vision and deep learning is known for its ability to recognize images with extremely high accuracy. Convolutional neural networks exist that can correctly classify 96\% of 1.2 million images of complex scenes. However, with just a few carefully positioned imperceptible changes to the pixels of an input image, an otherwise accurate network will misclassify this almost identical image with high confidence. These perturbed images are known as \textit{adversarial examples} and expose that convolutional neural networks do not necessarily "see" the world in the way that humans do. This work focuses on increasing the robustness of classifiers …

Application Of Big Data In Transportation Safety Analysis Using Statistical And Deep Learning Methods, Ramin Arvin

Doctoral Dissertations

The emergence of new sensors and data sources provides large scale high-resolution big data from instantaneous vehicular movements, driver decision and states, surrounding environment, roadway characteristics, weather condition, etc. Such a big data can be served to expand our understanding regarding the current state of the transportation and help us to proactively evaluate and monitor the system performance. The key idea behind this dissertation is to identify the moments and locations where drivers are exhibiting different behavior comparing to the normal behavior. The concept of driving volatility is utilized which quantifies deviation from normal driving in terms of variations in …

Hierarchical Neural Architectures For Classifying Cancer Pathology Reports, Shang Gao

Doctoral Dissertations

Electronic health records (EHRs) are the primary method for documenting and storing patient outcomes in modern healthcare; data mining and machine learning approaches utilize the information stored in EHRs to assist in clinical decision support and other critical healthcare applications. Important information in EHRs is often stored in the form of unstructured clinical text. Unfortunately, the state-of-the-art methods used to automatically extract useful information from unstructured clinical text lags significantly behind the state-of-the-art methods used in the general natural language processing (NLP) community for other tasks such as machine translation, question answering, and sentiment analysis. In this work, we attempt …

Deep Reinforcement Learning For Real-Time Residential Hvac Control, Evan Mckee

Masters Theses

The model-free Deep Reinforcement Learning (DRL) environment developed for this work attempts to minimize energy cost during residential heating, ventilation, and air conditioning (HVAC) operation. The HVAC load associated with heating and cooling is an ideal candidate for price optimization through automation for two reasons: Its power footprint in a typical home is sizeable, and the required level of participation from an inhabitant is passive. HVAC is difficult to accurately model and unique for every home, so online machine learning is used to allow for real-time readjustment in performance. Energy cost for the cooling unit shown in this work is …

On The Robustness Of Object Detection Based Deep Learning Models, Matthew Seals

Masters Theses

Object detection is one of the most popular areas in the field of computer vision and deep learning. Several advances have been reported in the literature showing promising object detection results. However, most of these results use databases of images that have been collected under almost ideal conditions and tested with input images mostly not representative of real life imagery. When tested with challenging data, most of these object detection models break down.The objective of this work is to quantify the performance of the most recent object detection models in the presence of realistic degradation in the form of differing …

Cross Domain Image Transformation And Generation By Deep Learning, Yang Song

Doctoral Dissertations

Compared with single domain learning, cross-domain learning is more challenging due to the large domain variation. In addition, cross-domain image synthesis is more difficult than other cross learning problems, including, for example, correlation analysis, indexing, and retrieval, because it needs to learn complex function which contains image details for photo-realism. This work investigates cross-domain image synthesis in two common and challenging tasks, i.e., image-to-image and non-image-to-image transfer/synthesis.The image-to-image transfer is investigated in Chapter 2, where we develop a method for transformation between face images and sketch images while preserving the identity. Different from existing works that conduct domain transfer in …

A Cnn-Lstm For Predicting Mortality In The Icu, Mohammad Hashir Khan

Masters Theses

An accurate predicted mortality is crucial to healthcare as it provides an empirical risk estimate for prognostic decision making, patient stratification and hospital benchmarking. Current prediction methods in practice are severity of disease scoring systems that usually involve a fixed set of admission attributes and summarized physiological data. These systems are prone to bias and require substantial manual effort which necessitates an updated approach which can account for most shortcomings. Clinical observation notes allow for recording highly subjective data on the patient that can possibly facilitate higher discrimination. Moreover, deep learning models can automatically extract and select features without human …

Artificial Intelligence In Materials Science: Applications Of Machine Learning To Extraction Of Physically Meaningful Information From Atomic Resolution Microscopy Imaging, Artem Borisovich Maksov

Doctoral Dissertations

Materials science is the cornerstone for technological development of the modern world that has been largely shaped by the advances in fabrication of semiconductor materials and devices. However, the Moore’s Law is expected to stop by 2025 due to reaching the limits of traditional transistor scaling. However, the classical approach has shown to be unable to keep up with the needs of materials manufacturing, requiring more than 20 years to move a material from discovery to market. To adapt materials fabrication to the needs of the 21st century, it is necessary to develop methods for much faster processing of experimental …

Optimization Of Spatial Convolution In Convnets On Intel Knl, Sangamesh Nagashattappa Ragate

Masters Theses

Most of the experts admit that the true behavior of the neural network is hard to predict. It is quite impossible to deterministically prove the working of the neural network as the architecture gets bigger, yet, it is observed that it is possible to apply a well engineered network to solve one of the most abstract problems like image recognition with substantial accuracy. It requires enormous amount of training of a considerably big and complex neural network to understand its behavior and iteratively improve its accuracy in solving a certain problem. Deep Neural Networks, which are fairly popular nowadays deal …

Conditional Computation In Deep And Recurrent Neural Networks, Andrew Scott Davis

Doctoral Dissertations

Recently, deep learning models such as convolutional and recurrent neural networks have displaced state-of-the-art techniques in a variety of application domains. While the computationally heavy process of training is usually conducted on powerful graphics processing units (GPUs) distributed in large computing clusters, the resulting models can still be somewhat heavy, making deployment in resource- constrained environments potentially problematic. In this work, we build upon the idea of conditional computation, where the model is given the capability to learn how to avoid computing parts of the graph. This allows for models where the number of parameters (and in a sense, the …

Scalable Hardware Efficient Deep Spatio-Temporal Inference Networks, Steven Robert Young

Doctoral Dissertations

Deep machine learning (DML) is a promising field of research that has enjoyed much success in recent years. Two of the predominant deep learning architectures studied in the literature are Convolutional Neural Networks (CNNs) and Deep Belief Networks (DBNs). Both have been successfully applied to many standard benchmarks with a primary focus on machine vision and speech processing domains.

Many real-world applications involve time-varying signals and, consequently, necessitate models that efficiently represent both temporal and spatial attributes. However, neither DBNs nor CNNs are designed to naturally capture temporal dependencies in observed data, often resulting in the inadequate transformation of spatio-temporal …

Online Multi-Stage Deep Architectures For Feature Extraction And Object Recognition, Derek Christopher Rose

Doctoral Dissertations

Multi-stage visual architectures have recently found success in achieving high classification accuracies over image datasets with large variations in pose, lighting, and scale. Inspired by techniques currently at the forefront of deep learning, such architectures are typically composed of one or more layers of preprocessing, feature encoding, and pooling to extract features from raw images. Training these components traditionally relies on large sets of patches that are extracted from a potentially large image dataset. In this context, high-dimensional feature space representations are often helpful for obtaining the best classification performances and providing a higher degree of invariance to object transformations. …