Engineering Commons^™

Learning Deep Time-Index Models For Time Series Forecasting, Jiale Gerald Woo, Chenghao Liu, Doyen Sahoo, Akshat Kumar, Steven Hoi

Research Collection School Of Computing and Information Systems

Deep learning has been actively applied to time series forecasting, leading to a deluge of new methods, belonging to the class of historicalvalue models. Yet, despite the attractive properties of time-index models, such as being able to model the continuous nature of underlying time series dynamics, little attention has been given to them. Indeed, while naive deep timeindex models are far more expressive than the manually predefined function representations of classical time-index models, they are inadequate for forecasting, being unable to generalize to unseen time steps due to the lack of inductive bias. In this paper, we propose DeepTime, a …

Distributed Deep Learning Optimization Of Heat Equation Inverse Problem Solvers, Zhuowei Wang, Le Yang, Haoran Lin, Genping Zhao, Zixuan Liu, Xiaoyu Song

Electrical and Computer Engineering Faculty Publications and Presentations

The inversion problem of partial differential equation plays a crucial role in cyber-physical systems applications. This paper presents a novel deep learning optimization approach to constructing a solver of heat equation inversion. To improve the computational efficiency in large-scale industrial applications, data and model parallelisms are incorporated on a platform of multiple GPUs. The advanced Ring-AllReduce architecture is harnessed to achieve an acceleration ratio of 3.46. Then a new multi-GPUs distributed optimization method GradReduce is proposed based on Ring-AllReduce architecture. This method optimizes the original data communication mechanism based on mechanical time and frequency by introducing the gradient transmission scheme …

Automatic Classification And Segmentation Of Patterned Martian Ground Using Deep Learning Techniques, Ruthy Brito

Electronic Thesis and Dissertation Repository

Science autonomy onboard spacecraft can optimize image return by prioritizing downlink of meaningful data. Martian polygonally cracked ground is actively studied by planetary geologists and may be indicative of subsurface water. Filtering images containing these polygonal features can be used as a case study for science autonomy and to reduce the overhead associated with parsing through Martian surface images. This thesis demonstrates the use of deep learning techniques in the classification of Martian polygonally patterned ground from HiRISE images. Three tasks are considered, a binary classification to identify images containing polygons, multiclass classification distinguishing different polygon types and semantic segmentation …

Mine Water Inrush Prediction Method Based On Vmd-Dbn Model, Liu Hui, Liu Guiqin, Ning Dianyan, Fan Juan, Chen Weiming

Coal Geology & Exploration

In the process of coal mining, the loss of people and property caused by mine water inrush is extremely serious. To prevent the occurrence of water inrush accidents and grasp the law of change of water inrush, the water inrush prediction and forecasting, especially the accurate estimation of mine water inrush, is very important, which is also an important task in the prevention and control of mine water damage. To increase the prediction accuracy of mine water inrush, an efficient time series prediction model combining Variational Mode Decomposition (VMD) and Deep Belief Network (DBN) was proposed for the series of …

Terrain Characterization Via Machine Vs. Deep Learning Using Remote Sensing, Jordan Ewing, Thomas Oommen, Jobin Thomas, Anush Kasaragod, Richard Dobson, Colin Brooks, Paramsothy Jayakumar, Michael Cole, Tulga Ersal

Michigan Tech Publications

Terrain traversability is critical for developing Go/No-Go maps for ground vehicles, which significantly impact a mission’s success. To predict the mobility of terrain, one must understand the soil characteristics. In-situ measurements performed in the field are the current method of collecting this information, which is time-consuming, costly, and can be lethal for military operations. This paper investigates an alternative approach using thermal, multispectral, and hyperspectral remote sensing from an unmanned aerial vehicle (UAV) platform. Remotely sensed data combined with machine learning (linear, ridge, lasso, partial least squares (PLS), support vector machines (SVM), and k nearest neighbors (KNN)) and deep learning …

Patient Movement Monitoring Based On Imu And Deep Learning, Mohsen Sharifi Renani

Electronic Theses and Dissertations

Osteoarthritis (OA) is the leading cause of disability among the aging population in the United States and is frequently treated by replacing deteriorated joints with metal and plastic components. Developing better quantitative measures of movement quality to track patients longitudinally in their own homes would enable personalized treatment plans and hasten the advancement of promising new interventions. Wearable sensors and machine learning used to quantify patient movement could revolutionize the diagnosis and treatment of movement disorders. The purpose of this dissertation was to overcome technical challenges associated with the use of wearable sensors, specifically Inertial Measurement Units (IMUs), as a …

Classification Of Arabic Social Media Texts Based On A Deep Learning Multi-Tasks Model, Ali A. Jalil, Ahmed H. Aliwy

Al-Bahir Journal for Engineering and Pure Sciences

The proliferation of social networking sites and their user base has led to an exponential increase in the amount of data generated on a daily basis. Textual content is one type of data that is commonly found on these platforms, and it has been shown to have a significant impact on decision-making processes at the individual, group, and national levels. One of the most important and largest part of this data are the texts that express human intentions, feelings and condition. Understanding these texts is one of the biggest challenges that facing data analysis. It is the backbone for understanding …

Long-Term Human Video Activity Quantification In Collaborative Learning Environments, Venkatesh Jatla

Electrical and Computer Engineering ETDs

Research on video activity detection has mainly focused on identifying well-defined human activities in short video segments, often requiring large-parameter systems and extensive training datasets. This dissertation introduces a low-parameter, modular system with rapid inference capabilities, capable of being trained on limited datasets without transfer learning from large-parameter systems. The system accurately detects specific activities and associates them with students in real-life classroom videos. Additionally, an interactive web-based application is developed to visualize human activity maps over long classroom videos.

Long-term video activity detection in classrooms presents challenges, such as multiple simultaneous activities, rapid transitions, long-term occlusions, duration exceeding 15 …

Detection Of Crypto-Ransomware Attack Using Deep Learning, Muna Jemal

Master of Science in Computer Science Theses

The number one threat to the digital world is the exponential increase in ransomware attacks. Ransomware is malware that prevents victims from accessing their resources by locking or encrypting the data until a ransom is paid. With individuals and businesses growing dependencies on technology and the Internet, researchers in the cyber security field are looking for different measures to prevent malicious attackers from having a successful campaign. A new ransomware variant is being introduced daily, thus behavior-based analysis of detecting ransomware attacks is more effective than the traditional static analysis. This paper proposes a multi-variant classification to detect ransomware I/O …

Deep Learning Of Semantic Image Labels On Hdr Imagery In A Maritime Environment, Charles Montagnoli

Doctoral Dissertations and Master's Theses

Situational awareness in the maritime environment can be extremely challenging. The maritime environment is highly dynamic and largely undefined, requiring the perception of many potential hazards in the shared maritime environment. One particular challenge is the effect of direct-sunlight exposure and specular reflection causing degradation of camera reliability. It is for this reason then, in this work, the use of High-Dynamic Range imagery for deep learning of semantic image labels is studied in a littoral environment. This study theorizes that the use HDR imagery may be extremely beneficial for the purpose of situational awareness in maritime environments due to the …

Modeling And Control Strategies For A Two-Wheel Balancing Mobile Robot, John Alan Moritz

Graduate Theses and Dissertations

The problem of balancing and autonomously navigating a two-wheel mobile robot is an increasingly active area of research, due to its potential applications in last-mile delivery, pedestrian transportation, warehouse automation, parts supply, agriculture, surveillance, and monitoring. This thesis investigates the design and control of a two-wheel balancing mobile robot using three different control strategies: Proportional Integral Derivative (PID) controllers, Sliding Mode Control, and Deep Q-Learning methodology. The mobile robot is modeled using a dynamic and kinematic model, and its motion is simulated in a custom MATLAB/Simulink environment. The first part of the thesis focuses on developing a dynamic and kinematic …

An Efficient Deep Learning Architecture For Turkish Lira Recognition And Counterfeit Detection, Burak İyi̇kesi̇ci̇, Ergun Erçelebi̇

Turkish Journal of Electrical Engineering and Computer Sciences

Banknote counterfeiting is a common practice worldwide. Due to the recent developments in technology, banknote imitation has become easier than before. There are different kinds of algorithms developed for the detection of counterfeit banknotes for different countries in the literature. The earlier algorithms utilized classical image processing techniques where the implementations of machine learning and deep learning algorithms appeared with the developments in the artificial intelligence field as well as the computer hardware. In this study, a novel convolutional neural networks-based deep learning algorithm has been developed that detects counterfeit Turkish Lira banknotes and their denominations using the banknote images …

Tomato Flower Detection And Three-Dimensional Mapping For Precision Pollination, Kaitlyn Mckensie Nelms

Masters Theses

It is estimated that nearly 75% of major crops have some level of reliance on pollination. Humans are reliant on fruit and vegetable crops for many vital nutrients. With the intensification of agricultural production in response to human demand, native pollinator species are not able to provide sufficient pollination services, and managed bee colonies are in decline due to colony collapse disorder, among other issues. Previous work addresses a few of these issues by designing pollination systems for greenhouse operations or other controlled production systems but fails to address the larger need for development in other agricultural settings with less …

A Long-Term Funds Predictor Based On Deep Learning, Shuiyi Kuang

Electronic Theses, Projects, and Dissertations

Numerous neural network models have been created to predict the rise or fall of stocks since deep learning has gained popularity, and many of them have performed quite well. However, since the share market is hugely influenced by various policy changes or unexpected news, it is challenging for investors to use such short-term predictions as a guide. In this paper, we try to find a suitable long-term predictor for the funds market by testing different kinds of neural network models, including the Long Short-Term Memory(LSTM) model with different layers, the Gated Recurrent Units(GRU) model with different layers, and the combination …

Task Offloading And Resource Allocation Based On Dl-Ga In Mobile Edge Computing, Hang Gu, Minjuan Zhang, Wenzao Li, Yuwen Pan

Turkish Journal of Electrical Engineering and Computer Sciences

With the rapid development of 5G and the Internet of Things (IoT), the traditional cloud computing architecture struggle to support the booming computation-intensive and latency-sensitive applications. Mobile edge computing (MEC) has emerged as a solution which enables abundant IoT tasks to be offloaded to edge services. However, task offloading and resource allocation remain challenges in MEC framework. In this paper, we add the total number of offloaded tasks to the optimization objective and apply algorithm called Deep Learning Trained by Genetic Algorithm (DL-GA) to maximize the value function, which is defined as a weighted sum of energy consumption, latency, and …

Enhanced Iot-Based Electrocardiogram Monitoring System With Deep Learning, Jian Ni

UNLV Theses, Dissertations, Professional Papers, and Capstones

Due to the rapid development of computing and sensing technologies, Internet of Things (IoT)-based cardiac monitoring plays a crucial role in providing patients with cost-efficient solutions for long-term, continuous, and pervasive electrocardiogram (ECG) monitoring outside a hospital setting. In a typical IoT-based ECG monitoring system, ECG signals are picked up by sensors located on the edge, and then uploaded to the remote cloud servers. ECG interpretation is performed for the collected ECGs in the cloud servers and the analysis results can be made instantly available to the patients as well as their healthcare providers.In this dissertation, we first examine the …

Wearable Sensor Gait Analysis For Fall Detection Using Deep Learning Methods, Haben Girmay Yhdego

Electrical & Computer Engineering Theses & Dissertations

World Health Organization (WHO) data show that around 684,000 people die from falls yearly, making it the second-highest mortality rate after traffic accidents [1]. Early detection of falls, followed by pneumatic protection, is one of the most effective means of ensuring the safety of the elderly. In light of the recent widespread adoption of wearable sensors, it has become increasingly critical that fall detection models are developed that can effectively process large and sequential sensor signal data. Several researchers have recently developed fall detection algorithms based on wearable sensor data. However, real-time fall detection remains challenging because of the wide …

Utilizing Deep Learning Methods In The Identification And Synthesis Of Gene Regulations, Jiandong Wang

Theses and Dissertations

Gene expression is the fundamental differentiation and development process of life. Although all cells in an organism have essentially the same DNA, cell types and activities vary due to changes in gene expression. Gene expression can be influenced by many gene regulations. RNA editing contributes to the variety of RNA and proteins by allowing single nucleotide substitution. Reverse transcription can alter the expression status of genes by inducing genetic diversity and polymorphism via novel insertions, deletions, and recombination events. Gene regulation is critical to normal development because it enables cells to respond rapidly to environmental changes. However, identifying gene regulations …

Transfer Learning, Model Interpretation, And Dataset Bias Analysis For Automated Violence Detection From Video, Erik Clemens

Master's Theses (2009 -)

Many communities have installed surveillance cameras in an effort to deter and respond to violence.Due to the difficulty of constantly monitoring such camera feeds, these systems are rarely used to provide real-time information. To enable rapid alerts and information for first responders, this thesis develops a proof-of-concept system capable of automatically detecting violence from video footage. This system is developed by fine-tuning a convolutional neural network that has previously demonstrated success on general action recognition tasks. This thesis explores two new techniques to improve the accuracy of the fine-tuned model. The first is a data augmentation technique that generates aspect …

Computer Vision Aided Hotspot Creation In Virtual Environments, Lama A. Affara, Bilal E. Nakhal

Architecture and Planning Journal (APJ)

Hotspot creation is one of the most important modules within virtual environments which helps show the navigators of these environments some information about semantic elements within it and facilitate the navigation between the virtual spaces. In this paper, a system for automatic hotspot proposals and creation in virtual environments is proposed. The system uses computer vision modules to automatically propose hotspot locations in addition to identifying and creating these hotspots with candidate labels. Two main modules used in the system are object detection and scene segmentation. The scene segmentation helps give candidate hotspot areas and provides an overall understanding of …

Using Deep Learning To Generate Front And Backyards In Landscape Architecture, Mehmet O. Senem, Mustafa Koç, Hayriye E. Tunçay, İmdat As

Architecture and Planning Journal (APJ)

The use of artificial intelligence (AI) engines in the design disciplines is a nascent field of research, which became very popular over the last decade. In particular, deep learning (DL) and related generative adversarial networks (GANs) proved to be very promising. While there are many research projects exploring AI in architecture and urban planning, e.g., in order to generate optimal floor layouts, massing models, evaluate image quality, etc., there are not many research projects in the area of landscape architecture - in particular the design of two-dimensional garden layouts. In this paper, we present our work using GANs to generate …

Autonomous 3d Urban And Complex Terrain Geometry Generation And Micro-Climate Modelling Using Cfd And Deep Learning, Tewodros F. Alemayehu

Electronic Thesis and Dissertation Repository

Sustainable building design requires a clear understanding and realistic modelling of the complex interaction between climate and built environment to create safe and comfortable outdoor and indoor spaces. This necessitates unprecedented urban climate modelling at high temporal and spatial resolution. The interaction between complex urban geometries and the microclimate is characterized by complex transport mechanisms. The challenge to generate geometric and physics boundary conditions in an automated manner is hindering the progress of computational methods in urban design. Thus, the challenge of modelling realistic and pragmatic numerical urban micro-climate for wind engineering, environmental, and building energy simulation applications should address …

Tempnet – Temporal Super-Resolution Of Radar Rainfall Products With Residual Cnns, Muhammed Ali Sit, Bongchul Seo, Ibrahim Demir

Civil, Architectural and Environmental Engineering Faculty Research & Creative Works

The temporal and spatial resolution of rainfall data is crucial for environmental modeling studies in which its variability in space and time is considered as a primary factor. Rainfall products from different remote sensing instruments (e.g., radar, satellite) have different space-time resolutions because of the differences in their sensing capabilities and post-processing methods. In this study, we developed a deep-learning approach that augments rainfall data with increased time resolutions to complement relatively lower-resolution products. We propose a neural network architecture based on Convolutional Neural Networks (CNNs), namely TempNet, to improve the temporal resolution of radar-based rainfall products and compare the …

Inducing Sparsity Within High-Dimensional Remote Sensing Modalities For Lightning Prediction, Grace E. Metzgar

Theses and Dissertations

The uncertainty of lightning constantly threatens many weather-sensitive fields where the slightest presence of lightning can endanger valuable personnel and assets. The consequences of delaying operations have incited the research of methods that can accurately predict the location of future lightning strikes from the current weather conditions. High-dimensional remote sensing modalities contain information capable of detecting significant patterns and intensities within storms that could indicate the presence of lightning. This thesis induces sparsity into convolutional neural networks (CNNs) and remote sensing modalities through a combination of regularization and tensor decomposition techniques to call attention to sparse features that are most …

3d Point Cloud Classification With Acgan-3d And Vacwgan-Gp, Onur Ergün, Yusuf Sahi̇lli̇oğlu

Turkish Journal of Electrical Engineering and Computer Sciences

Machine learning and deep learning techniques are widely used to make sense of 3D point cloud data which became ubiquitous and important due to the recent advances in 3D scanning technologies and other sensors. In this work, we propose two networks to predict the class of the input 3D point cloud: 3D Auxiliary Classifier Generative Adversarial Network (ACGAN-3D) and Versatile Auxiliary Conditional Wasserstein Generative Adversarial Network with Gradient Penalty (VACWGAN-GP). Unlike other classifiers, we are able to enlarge the limited data set with the data produced by generative models. We consequently aim to increase the success of the model by …

Deep Learning For Detection Of Upper And Lower Body Movements, Kyle B. Lacroix

Electronic Thesis and Dissertation Repository

When humans repeat the same motion, the tendons, muscles, and nerves can be damaged, causing repetitive stress injuries (RSI). Symptoms usually begin slowly and become more intense and constant over time. If the motions that lead to RSI are recognized early, these injuries can be prevented. A preventative approach could be implemented in factories to warn workers about possible injuries. By detecting the movements that can cause RSI, the worker can be alerted to stop carrying out those movements. For this purpose, machine learning models can detect human motion with the human activity recognition (HAR) model. HAR models typically require …

Noise2clean: Cross-Device Side-Channel Traces Denoising With Unsupervised Deep Learning, Honggang Yu, Mei Wang, Xiyu Song, Haoqi Shan, Hongbing Qiu, Junyi Wang, Kaichen Yang

Michigan Tech Publications

Deep learning (DL)-based side-channel analysis (SCA) has posed a severe challenge to the security and privacy of embedded devices. During its execution, an attacker exploits physical SCA leakages collected from profiling devices to create a DL model for recovering secret information from victim devices. Despite this success, recent works have demonstrated that certain countermeasures, such as random delay interrupts or clock jitters, would make these attacks more complex and less practical in real-world scenarios. To address this challenge, we present a novel denoising scheme that exploits the U-Net model to pre-process SCA traces for “noises” (i.e., countermeasures) removal. Specifically, we …

A Bidirectional Deep Lstm Machine Learning Method For Flight Delay Modelling And Analysis, Desmond B. Bisandu, Irene Moulitsas

National Training Aircraft Symposium (NTAS)

Flight delays can be prevented by providing a reference point from an accurate prediction model because predicting flight delays is a problem with a specific space. Only a few algorithms consider predicted classes' mutual correlation during flight delay classification or prediction modelling tasks. None of these existing methods works for all scenarios. Therefore, the need to investigate the performance of more models in solving the problem of flight delay is vast and rapidly increasing. This paper presents the development and evaluation of LSTM and BiLSTM models by comparing them for a flight delay prediction. The LSTM does the feature extraction …

Pt-Net: A Multi-Model Machine Learning Approach For Smarter Next-Generation Wearable Tremor Suppression Devices For Parkinson's Disease Tremor, Anas Ibrahim

Electronic Thesis and Dissertation Repository

According to the World Health Organization (WHO), Parkinson's Disease (PD) is the second most common neurodegenerative condition that can cause tremors and other motor and non motor related symptoms. Medication and deep brain stimulation (DBS) are often used to treat tremor; however, medication is not always effective and has adverse effects, and DBS is invasive and carries a significant risk of complications. Wearable tremor suppression devices (WTSDs) have been proposed as a possible alternative, but their effectiveness is limited by the tremor models they use, which introduce a phase delay that decreases the performance of the devices. Additionally, the availability …

Modulation Recognition Method Of Mixed Signal Based On Intelligent Analysis Of Cyclic Spectrum Section, Yu Du, Xinquan Yang, Jianhua Zhang, Suchun Yuan, Huachao Xiao, Jingjing Yuan

Journal of System Simulation

Abstract: Aiming at the problems of low intelligence and poor adaptability for the existing mixed signal recognition methods, an intelligent recognition method based on cyclic spectral cross section and deep learning is proposed. For common mixed communication signals, the characteristics of zero frequency cross section of cyclic spectrum are theoretically deduced and analyzed. Two new pre-processing methods, nonlinear segmental mapping and directional pseudo-clustering are proposed, which can effectively improve the adaptability and consistency of cross section features. The pre-processed feature graph is combined with the residual network (ResNet), and the deep learning network is used to mine and analyze the …