Engineering Commons^™

Application Of Long Short-Term Memory (Lstm) Neural Network Based On Deeplearning For Electricity Energy Consumption Forecasting, Mehmet Bi̇lgi̇li̇, Ni̇yazi̇ Arslan, Ali̇i̇hsan Şekerteki̇n, Abdulkadi̇r Yaşar

Turkish Journal of Electrical Engineering and Computer Sciences

Electricity is the most substantial energy form that significantly affects the development of modern life, work efficiency, quality of life, production, and competitiveness of the society in the ever-growing global world. In this respect, forecasting accurate electricity energy consumption (EEC) is fairly essential for any country?s energy consumption planning and management regarding its growth. In this study, four time-series methods; long short-term memory (LSTM) neural network, adaptive neuro-fuzzy inference system (ANFIS) with subtractive clustering (SC), ANFIS with fuzzy cmeans (FCM), and ANFIS with grid partition (GP) were implemented for the short-term one-day ahead EEC prediction. Root mean square error (RMSE), …

Customer Gaze Estimation In Retail Using Deep Learning, Shashimal Senarath, Primesh Pathirana, Dulani Meedeniya, Sampath Jayarathna

Computer Science Faculty Publications

At present, intelligent computing applications are widely used in different domains, including retail stores. The analysis of customer behaviour has become crucial for the benefit of both customers and retailers. In this regard, the concept of remote gaze estimation using deep learning has shown promising results in analyzing customer behaviour in retail due to its scalability, robustness, low cost, and uninterrupted nature. This study presents a three-stage, three-attention-based deep convolutional neural network for remote gaze estimation in retail using image data. In the first stage, we design a mechanism to estimate the 3D gaze of the subject using image data …

Electro-Chemo-Mechanics Of The Interfaces In 2d-3d Heterostructure Electrodes, Vidushi Sharma

Dissertations

Unique heterostructure electrodes comprising two-dimensional (2D) materials and bulk three dimensional (3D) high-performance active electrodes are recently synthesized and experimentally tested for their electrochemical performance in metal-ion batteries. Such electrodes exhibit long cycle life while they also retain high-capacity inherent to the active electrode. The role of 2D material is to provide a supportive mesh that allows buffer space for volume expansions upon ion intercalation in the active material and establishes a continuous electronic contact. Therefore, the binding strength between both materials is crucial for the success of such electrodes. Furthermore, battery cycles may bring about phase transformations in the …

Photoacoustic Imaging Of Colorectal Cancer And Ovarian Cancer, Xiandong Leng

McKelvey School of Engineering Graduate Student Theses & Dissertations

Photoacoustic (PA) imaging is an emerging hybrid imaging technology that uses a short-pulsed laser to excite tissue. The resulting photoacoustic waves are used to image the optical absorption distribution of the tissue, which is directly related to micro-vessel networks and thus to tumor angiogenesis, a key process in tumor growth and metastasis. In this thesis, the acoustic-resolution photoacoustic microscopy (AR-PAM) was first investigated on its role in human colorectal tissue imaging, and the optical-resolution photoacoustic microscopy (OR-PAM) was investigated on its role in human ovarian tissue imaging.Colorectal cancer is the second leading cause of cancer death in the United States. …

Deep Learning For Automatic Microscopy Image Analysis, Shenghua He

McKelvey School of Engineering Graduate Student Theses & Dissertations

Microscopy imaging techniques allow for the creation of detailed images of cells (or nuclei) and have been widely employed for cell studies in biological research and disease diagnosis in clinic practices.Microscopy image analysis (MIA), with tasks of cell detection, cell classification, and cell counting, etc., can assist with the quantitative analysis of cells and provide useful information for a cellular-level understanding of biological activities and pathology. Manual MIA is tedious, time-consuming, prone to subject errors, and are not feasible for the high-throughput cell analysis process. Thus, automatic MIA methods can facilitate all kinds of biological studies and clinical tasks. Conventional …

Using A Systemic Skills Model To Build An Effective 21st Century Workforce: Factors That Impact The Ability To Navigate Complex Systems, Morteza Nagahi

Theses and Dissertations

The growth of technology and the proliferation of information made modern complex systems more fragile and vulnerable. As a result, competitive advantage is no longer achieved exclusively through strategic planning but by developing an influential cadre of technical people who can efficiently manage and navigate modern complex systems. The dissertation aims to provide educators, practitioners, and organizations with a model that helps to measure individuals’ systems thinking skills, complex problem solving, personality traits, and the impacting demographic factors such as managerial and work experience, current occupation type, organizational ownership structure, and education level. The intent is to study how these …

A Data-Driven Approach For The Investigation Of Microstructural Effects On The Effective Piezoelectric Responses Of Additively Manufactured Triply Periodic Bi-Continuous Piezocomposite, Wenhua Yang

Theses and Dissertations

A two-scale model consisting of ceramic grain scale and composite scale are developed to systematically evaluate the effects of microstructures (e.g., residual pores, grain size, texture) and geometry on the piezoelectric responses of the polarized triply periodic bi-continuous (TPC) piezocomposites. These TPC piezocomposites were fabricated by a recently developed additive manufacturing (AM) process named suspension-enclosing projection-stereolithography (SEPS) under different process conditions. In the model, the Fourier spectral iterative perturbation method (FSIPM) and the finite element method will be adopted for the calculation at the grain and composite scale, respectively. On the grain scale, a DL approach based on stacked generative …

Uncertainty-Aware Deep Learning For Prediction Of Remaining Useful Life Of Mechanical Systems, Samuel J. Cornelius

Theses and Dissertations

Remaining useful life (RUL) prediction is a problem that researchers in the prognostics and health management (PHM) community have been studying for decades. Both physics-based and data-driven methods have been investigated, and in recent years, deep learning has gained significant attention. When sufficiently large and diverse datasets are available, deep neural networks can achieve state-of-the-art performance in RUL prediction for a variety of systems. However, for end users to trust the results of these models, especially as they are integrated into safety-critical systems, RUL prediction uncertainty must be captured. This work explores an approach for estimating both epistemic and heteroscedastic …

Uptpu: Improving Energy Efficiency Of A Tensor Processing Unit Through Underutilization Based Power-Gating, Pramesh Pandey, Noel Daniel Gundi, Koushik Chakraborty, Sanghamitra Roy

Electrical and Computer Engineering Faculty Publications

The AI boom is bringing a plethora of domain-specific architectures for Neural Network computations. Google's Tensor Processing Unit (TPU), a Deep Neural Network (DNN) accelerator, has replaced the CPUs/GPUs in its data centers, claiming more than 15 × rate of inference. However, the unprecedented growth in DNN workloads with the widespread use of AI services projects an increasing energy consumption of TPU based data centers. In this work, we parametrize the extreme hardware underutilization in TPU systolic array and propose UPTPU: an intelligent, dataflow adaptive power-gating paradigm to provide a staggering 3.5 ×-6.5× energy efficiency to TPU for different input …

Contrastive Learning For Unsupervised Auditory Texture Models, Christina Trexler

Computer Science and Computer Engineering Undergraduate Honors Theses

Sounds with a high level of stationarity, also known as sound textures, have perceptually relevant features which can be captured by stimulus-computable models. This makes texture-like sounds, such as those made by rain, wind, and fire, an appealing test case for understanding the underlying mechanisms of auditory recognition. Previous auditory texture models typically measured statistics from auditory filter bank representations, and the statistics they used were somewhat ad-hoc, hand-engineered through a process of trial and error. Here, we investigate whether a better auditory texture representation can be obtained via contrastive learning, taking advantage of the stationarity of auditory textures to …

Deep Learning Based Speech Enhancement And Its Application To Speech Recognition, Ju Lin

All Dissertations

Speech enhancement is the task that aims to improve the quality and the intelligibility of a speech signal that is degraded by ambient noise and room reverberation. Speech enhancement algorithms are used extensively in many audio- and communication systems, including mobile handsets, speech recognition, speaker verification systems and hearing aids. Recently, deep learning has achieved great success in many applications, such as computer vision, nature language processing and speech recognition. Speech enhancement methods have been introduced that use deep-learning techniques, as these techniques are capable of learning complex hierarchical functions using large-scale training data. This dissertation investigates the deep learning …

Deep Learning-Guided Prediction Of Material’S Microstructures And Applications To Advanced Manufacturing, Jianan Tang

All Dissertations

Material microstructure prediction based on processing conditions is very useful in advanced manufacturing. Trial-and-error experiments are very time-consuming to exhaust numerous combinations of processing parameters and characterize the resulting microstructures. To accelerate process development and optimization, researchers have explored microstructure prediction methods, including physical-based modeling and feature-based machine learning. Nevertheless, they both have limitations. Physical-based modeling consumes too much computational power. And in feature-based machine learning, low-dimensional microstructural features are manually extracted to represent high-dimensional microstructures, which leads to information loss.

In this dissertation, a deep learning-guided microstructure prediction framework is established. It uses a conditional generative adversarial network (CGAN) …

Joint Linear And Nonlinear Computation With Data Encryption For Efficient Privacy-Preserving Deep Learning, Qiao Zhang

Electrical & Computer Engineering Theses & Dissertations

Deep Learning (DL) has shown unrivalled performance in many applications such as image classification, speech recognition, anomalous detection, and business analytics. While end users and enterprises own enormous data, DL talents and computing power are mostly gathered in technology giants having cloud servers. Thus, data owners, i.e., the clients, are motivated to outsource their data, along with computationally-intensive tasks, to the server in order to leverage the server’s abundant computation resources and DL talents for developing cost-effective DL solutions. However, trust is required between the server and the client to finish the computation tasks (e.g., conducting inference for the newly-input …

Audio Representations For Deep Learning In Sound Synthesis: A Review, Anastasia Natsiou, Sean O'Leary

Articles

The rise of deep learning algorithms has led many researchers to withdraw from using classic signal processing methods for sound generation. Deep learning models have achieved expressive voice synthesis, realistic sound textures, and musical notes from virtual instruments. However, the most suitable deep learning architecture is still under investigation. The choice of architecture is tightly coupled to the audio representations. A sound’s original waveform can be too dense and rich for deep learning models to deal with efficiently - and complexity increases training time and computational cost. Also, it does not represent sound in the manner in which it is …

Deepfakes Generated By Generative Adversarial Networks, Olympia A. Paul

Honors College Theses

Deep learning is a type of Artificial Intelligence (AI) that mimics the workings of the human brain in processing data such as speech recognition, visual object recognition, object detection, language translation, and making decisions. A Generative adversarial network (GAN) is a special type of deep learning, designed by Goodfellow et al. (2014), which is what we call convolution neural networks (CNN). How a GAN works is that when given a training set, they can generate new data with the same information as the training set, and this is often what we refer to as deep fakes. CNN takes an input …

Deep Learning Predicts Ebv Status In Gastric Cancer Based On Spatial Patterns Of Lymphocyte Infiltration, Baoyi Zhang, Kevin Yao, Min Xu, Jia Wu, Chao Cheng

Computer Vision Faculty Publications

EBV infection occurs in around 10% of gastric cancer cases and represents a distinct subtype, characterized by a unique mutation profile, hypermethylation, and overexpression of PD-L1. Moreover, EBV positive gastric cancer tends to have higher immune infiltration and a better prognosis. EBV infection status in gastric cancer is most commonly determined using PCR and in situ hybridization, but such a method requires good nucleic acid preservation. Detection of EBV status with histopathology images may complement PCR and in situ hybridization as a first step of EBV infection assessment. Here, we developed a deep learning-based algorithm to directly predict EBV infection …

Research And Applications Of Artificial Neural Network In Pavement Engineering: A State-Of-The-Art Review, Xu Yang, Jinchao Guan, Ling Ding, Zhanping You, Vincent C.S. Lee, Mohd Rosli Mohd Hasan, Xiaoyun Cheng

Michigan Tech Publications, Part 1

Given the great advancements in soft computing and data science, artificial neural network (ANN) has been explored and applied to handle complicated problems in the field of pavement engineering. This study conducted a state-of-the-art review for surveying the recent progress of ANN application at different stages of pavement engineering, including pavement design, construction, inspection and monitoring, and maintenance. This study focused on the papers published over the last three decades, especially the studies conducted since 2013. Through literature retrieval, a total of 683 papers in this field were identified, among which 143 papers were selected for an in-depth review. The …

Research On The Network Of 3d Smoke Flow Super-Resolution Data Generation, Jinlian Du, Shufei Li, Xueyun Jin

Journal of System Simulation

Abstract: Aiming at the problem of low data generation efficiency due to the high complexity of solving the N-S equation of smoke flow field, a deep learning model which can generate high-resolution smoke flow data based on low-resolution smoke flow data solved by N-S equation is explored and designed. Based on the Generative Adversarial Network, the smoke data reconstruction network based on the sub voxel convolution layer is constructed. Considering the fluidity of smoke, time loss based on advection step is introduced into the loss function to realize high-precision smoke simulation. By extending the image super-resolution quality evaluation index, the …

Unsupervised Learning For Anomaly Detection In Remote Sensing Imagery, Husam A. Alfergani

Theses and Dissertations

Landfill fire is a potential hazard of waste mismanagement, and could occur both on and below the surface of active and closed sites. Timely identification of temperature anomalies is critical in monitoring and detecting landfill fires, to issue warnings that can help extinguish fires at early stages. The overarching objective of this research is to demonstrate the applicability and advantages of remote sensing data, coupled with machine learning techniques, to identify landfill thermal states that can lead to fire, in the absence of onsite observations. This dissertation proposed unsupervised learning techniques, notably variational auto-encoders (VAEs), to identify temperature anomalies from …

Automatic Identification And Monitoring Of Plant Diseases Using Unmanned Aerial Vehicles: A Review, Krishna Neupane, Fulya Baysal-Gurel

Agricultural and Environmental Sciences Faculty Research

Disease diagnosis is one of the major tasks for increasing food production in agriculture. Although precision agriculture (PA) takes less time and provides a more precise application of agricultural activities, the detection of disease using an Unmanned Aerial System (UAS) is a challenging task. Several Unmanned Aerial Vehicles (UAVs) and sensors have been used for this purpose. The UAVs’ platforms and their peripherals have their own limitations in accurately diagnosing plant diseases. Several types of image processing software are available for vignetting and orthorectification. The training and validation of datasets are important characteristics of data analysis. Currently, different algorithms and …

Computer-Aided Diagnosis Of Low Grade Endometrial Stromal Sarcoma (Lgess), Xinxin Yang, Mark Stamp

Faculty Research, Scholarly, and Creative Activity

Low grade endometrial stromal sarcoma (LGESS) accounts for about 0.2% of all uterine cancer cases. Approximately 75% of LGESS patients are initially misdiagnosed with leiomyoma, which is a type of benign tumor, also known as fibroids. In this research, uterine tissue biopsy images of potential LGESS patients are preprocessed using segmentation and stain normalization algorithms. We then apply a variety of classic machine learning and advanced deep learning models to classify tissue images as either benign or cancerous. For the classic techniques considered, the highest classification accuracy we attain is about 0.85, while our best deep learning model achieves an …

Deep Learning For Weather Clustering And Forecasting, Nathaniel R. Beveridge

Theses and Dissertations

Clustering weather data is a valuable endeavor in multiple respects. The results can be used in various ways within a larger weather prediction framework or could simply serve as an analytical tool for characterizing climatic differences of a particular region of interest. This research proposes a methodology for clustering geographic locations based on the similarity in shape of their temperature time series over a long time horizon of approximately 11 months. To this end an emerging and powerful class of clustering techniques that leverages deep learning, called deep representation clustering (DRC), are utilized. Moreover, a time series specific DRC algorithm …

Efficient, Low-Cost Bridge Cracking Detection And Quantification Using Deep-Learning And Uav Images, Chao Sun, Xiangyu Meng, Joshua O. Ogbebor, Shaopan Guo

Data

Many bridges in the State of Louisiana and the United States are working under serious degradation conditions where cracks on bridges threaten structural integrity and public security. To ensure structural integrity and public security, it is required that bridges in the US be inspected and rated every two years. Currently, this biannual assessment is largely implemented using manual visual inspection methods, which is slow and costly. In addition, it is challenging for workers to detect cracks in regions that are hard to reach, e.g., the top part of the bridge tower, cables, mid-span of the bridge girders, and decks. This …

Efficient, Low-Cost Bridge Cracking Detection And Quantification Using Deep-Learning And Uav Images, Chao Sun, Xiangyu Meng, Joshua O. Ogbebor, Shaopan Guo

Publications

Many bridges in the State of Louisiana and the United States are working under serious degradation conditions where cracks on bridges threaten structural integrity and public security. To ensure structural integrity and public security, it is required that bridges in the US be inspected and rated every two years. Currently, this biannual assessment is largely implemented using manual visual inspection methods, which is slow and costly. In addition, it is challenging for workers to detect cracks in regions that are hard to reach, e.g., the top part of the bridge tower, cables, mid-span of the bridge girders, and decks. This …

Gradient Free Sign Activation Zero One Loss Neural Networks For Adversarially Robust Classification, Yunzhe Xue

Dissertations

The zero-one loss function is less sensitive to outliers than convex surrogate losses such as hinge and cross-entropy. However, as a non-convex function, it has a large number of local minima, andits undifferentiable attribute makes it impossible to use backpropagation, a method widely used in training current state-of-the-art neural networks. When zero-one loss is applied to deep neural networks, the entire training process becomes challenging. On the other hand, a massive non-unique solution probably also brings different decision boundaries when optimizing zero-one loss, making it possible to fight against transferable adversarial examples, which is a common weakness in deep learning …

Towards Adversarial Robustness With 01 Lossmodels, And Novel Convolutional Neural Netsystems For Ultrasound Images, Meiyan Xie

Dissertations

This dissertation investigates adversarial robustness with 01 loss models and a novel convolutional neural net systems for vascular ultrasound images.

In the first part, the dissertation presents stochastic coordinate descent for 01 loss and its sensitivity to adversarial attacks. The study here suggests that 01 loss may be more resilient to adversarial attacks than the hinge loss and further work is required.

In the second part, this dissertation proposes sign activation network with a novel gradient-free stochastic coordinate descent algorithm and its ensembling model. The study here finds that the ensembling model gives a high minimum distortion (as measured by …

Linking Social Media, Medical Literature, And Clinical Notes Using Deep Learning., Mohsen Asghari

Electronic Theses and Dissertations

Researchers analyze data, information, and knowledge through many sources, formats, and methods. The dominant data format includes text and images. In the healthcare industry, professionals generate a large quantity of unstructured data. The complexity of this data and the lack of computational power causes delays in analysis. However, with emerging deep learning algorithms and access to computational powers such as graphics processing unit (GPU) and tensor processing units (TPUs), processing text and images is becoming more accessible. Deep learning algorithms achieve remarkable results in natural language processing (NLP) and computer vision. In this study, we focus on NLP in the …

Step-Wise Deep Learning Models For Solving Routing Problems, Liang Xin, Wen Song, Zhiguang Cao, Jie Zhang

Research Collection School Of Computing and Information Systems

Routing problems are very important in intelligent transportation systems. Recently, a number of deep learning-based methods are proposed to automatically learn construction heuristics for solving routing problems. However, these methods do not completely follow Bellman's Principle of Optimality since the visited nodes during construction are still included in the following subtasks, resulting in suboptimal policies. In this article, we propose a novel step-wise scheme which explicitly removes the visited nodes in each node selection step. We apply this scheme to two representative deep models for routing problems, pointer network and transformer attention model (TAM), and significantly improve the performance of …

Signal Processing And Data Analysis For Real-Time Intermodal Freight Classification Through A Multimodal Sensor System., Enrique J. Sanchez Headley

Graduate Theses and Dissertations

Identifying freight patterns in transit is a common need among commercial and municipal entities. For example, the allocation of resources among Departments of Transportation is often predicated on an understanding of freight patterns along major highways. There exist multiple sensor systems to detect and count vehicles at areas of interest. Many of these sensors are limited in their ability to detect more specific features of vehicles in traffic or are unable to perform well in adverse weather conditions. Despite this limitation, to date there is little comparative analysis among Laser Imaging and Detection and Ranging (LIDAR) sensors for freight detection …

Gaze Estimation And Tracking For Assisted Living Environments, Paris Her

Master's Theses (2009 -)

Assisted living environments must be able to efficiently and unobtrusively gather information on a person's well-being. Human gaze direction provides some of the strongest indicators of how a person behaves and interacts with their environment. To that end, this thesis proposes a gaze tracking method that uses a neural network regressor to estimate gaze direction from facial keypoints and integrates them over time using various temporal methods, specifically through moving averages and a Kalman filter. Our gaze regression model uses confidence gated units to handle cases of keypoint occlusion and is able to estimate its own prediction uncertainty. This approach …