Numerical Analysis and Scientific Computing Commons^™

A Wind Turbine Fault Diagnosis Method Based On Siamese Deep Neural Network, Jiarui Liu, Guotian Yang, Xiaowei Wang

Journal of System Simulation

Abstract: In order to effectively extract the fault features of time series data in supervisory control and data acquisition (SCADA), considering the advantages of one-dimensional convolutional neural network (1-D CNN) for extracting local time series features and the advantages of long-term memory (LSTM) which can extract long-term dependent features, a method for fault diagnosis of wind turbines based on 1-D CNN-LSTM is proposed. To solve the problem of the scarcity of fault samples of wind turbines based on the siamese network architecture, a wind fault diagnosis method based on siamese 1-D CNN-LSTM is proposed. The proposed siamese 1-D CNN-LSTM …

Continual Learning With Neural Networks, Pham Hong Quang

Dissertations and Theses Collection (Open Access)

Recent years have witnessed tremendous successes of artificial neural networks in many applications, ranging from visual perception to language understanding. However, such achievements have been mostly demonstrated on a large amount of labeled data that is static throughout learning. In contrast, real-world environments are always evolving, where new patterns emerge and the older ones become inactive before reappearing in the future. In this respect, continual learning aims to achieve a higher level of intelligence by learning online on a data stream of several tasks. As it turns out, neural networks are not equipped to learn continually: they lack the ability …

Fatigue Detection Method Based On Facial Features And Head Posture, Rongxiu Lu, Bihao Zhang, Zhenlong Mo

Journal of System Simulation

Abstract: Aiming at the of the single fatigue characteristics, low robustness and inability to customize fatigue thresholds for different drivers of fatigue detection methods, a method based on facial features and head posture is proposed. In face detection and face key point positioning HOG feature operator and regression tree algorithm are used. In head posture estimation, head posture Euler angle is estimated by combining the face key points with the coordinate system transformation. In fatigue feature extraction, a deep residual neural network model is established to extract the eye fatigue features, which the eye, mouth aspect ratio and head posture …

Electrical Resistance Tomography And Flow Pattern Identification Method Based On Deep Residual Neural Network, Weiguo Tong, Shichao Zeng, Lifeng Zhang, Zhe Hou, Jiayue Guo

Journal of System Simulation

Abstract: Aiming at the low accuracy of inverse problem imaging and flow pattern recognition in electrical resistance tomography (ERT), a two-phase flow electrical resistance tomography and flow pattern recognition method based on the deep residual neural network is proposed. The finite element method is used to model the ERT forward problem to construct the "boundary voltage-conductivity distribution-flow pattern category" dataset of various gas-liquid two-phase flow distributions. The residual neural network for ERT image reconstruction and flow pattern identification of gas-liquid two-phase flow is built and trained. The two outputs of the residual neural network are processed respectively to obtain …

Deep Learning-Based Text Recognition Of Agricultural Regulatory Document, Hua Leong Fwa, Farn Haur Chan

Research Collection School Of Computing and Information Systems

In this study, an OCR system based on deep learning techniques was deployed to digitize scanned agricultural regulatory documents comprising of certificates and labels. Recognition of the certificates and labels is challenging as they are scanned images of the hard copy form and the layout and size of the text as well as the languages vary between the various countries (due to diverse regulatory requirements). We evaluated and compared between various state-of-the-art deep learningbased text detection and recognition model as well as a packaged OCR library – Tesseract. We then adopted a two-stage approach comprising of text detection using Character …

Aerial Target Threat Assessment Method Based On Deep Learning, Huimin Chai, Yong Zhang, Xinyue Li, Yanan Song

Journal of System Simulation

Abstract: Due to many factors of aerial target threat assessment and the lack of self-learning ability of current assessment methods, a deep neural network model for aerial target threat assessment is established using deep learning theory. In order to improve the fitting effect of the model training, a symmetric pre-training method is given. The hidden layers of the model are pre-trained layer by layer, and finally the whole model is trained. Sample data and air to air simulation scene experiments are carried out respectively. The experiments results show that the accuracy of the model using the symmetric pre-training method is …

Radar Remote Sensing Data Augmentation Method Based On Generative Adversarial Network, Xu Kang, Xiaofeng Zhang

Journal of System Simulation

Abstract: In the research field of radar remote sensing, both the completeness and diversity of radar data samples cannot meet the requirement of effective training of deep learning models, and the models are prone to over-fitting, which significantly limits the wide application of deep learning techniques in this field. Targeting on the needs of intelligent application in radar remote sensing, a microwave imaging radar suited data augmentation method is proposed to solve the issue of insufficient radar data samples by leveraging the general framework of generative adversarial network. Aiming at the features of radar samples being not obvious, the label …

Brief Review On Applying Reinforcement Learning To Job Shop Scheduling Problems, Xiaohan Wang, Zhang Lin, Ren Lei, Kunyu Xie, Kunyu Wang, Ye Fei, Chen Zhen

Journal of System Simulation

Abstract: Reinforcement Learning (RL) achieves lower time response and better model generalization in Job Shop Scheduling Problem (JSSP). To explain the current overall research status of JSSP based on RL, summarize the current scheduling framework based on RL, and lay the foundation for follow-up research, the backgrounds of JSSP and RL are introduced. Two simulation techniques commonly used in JSSP are analyzed and two commonly used frameworks for RL to solve JSSP are given. In addition, some existing challenges are pointed out, and related research progress is introduced from three aspects: direct scheduling, feature representation-based scheduling, and parameter search-based scheduling.

Study On Prediction Of Crystal Properties Based On Deep Learning, Buwei Wang, Wang Min, Fan Qian, Ya'nan Wang, Hanwen Zhang, Yunliang Yue

Journal of System Simulation

Abstract: Predicting crystal properties using traditional machine learning methods requires complex feature engineering. In order to bypass time-consuming feature engineering, element network (ElemNet), representation learning from stoichiometry (Roost), compositionally-restricted attention-based network (CrabNet) and crystal graph convolution neural network (CGCNN) based on deep learning technology are used to simulate the formation energy, total energy per atom, band gap, and Fermi energy of crystal. The residual learning is introduced into CGCNN, and a crystal graph convolution residual neural network (CGCRN) is proposed. In the CGCRN, the number of hidden layers and the number of nodes in the hidden layers are increased, …

Variety Recognition Based On Deep Learning And Double-Sided Characteristics Of Maize Kernel, Feng Xiao, Zhang Hui, Zhou Rui, Qiao Lu, Wei Dong, Dandan Li, Yuyao Zhang, Guoqing Zheng

Journal of System Simulation

Abstract: In order to construct a maize kernel variety recognition model with high recognition accuracy and suitable for mobile phone application, a mobile phone is used to obtain maize kernel double-sided (embryonic and non-embryonic) images. Based on the lightweight convolutional neural network MobileNetV2 and transfer learning, a maize kernel image variety recognition model is constructed. In view of the existing research methods are mainly for single-sided recognition of maize kernel variety, the performance of single-sided and double-sided characteristics modeling and recognition is compared. The results show that the double-sided recognition accuracy of maize kernel double-sided characteristics modeling is 99.83%, which …

Interest Points Analysis For Internet Forum Based On Long-Short Windows Similarity, Xinghai Ju, Jicang Lu, Xiangyang Luo, Gang Zhou, Shiyu Wang, Shunhang Li, Yang Yang

Research Collection School Of Computing and Information Systems

For Internet forum Points of Interest (PoI), existing analysis methods are usually lack of usability analysis under different conditions and ignore the long-term variation, which lead to blindness in method selection. To address this problem, this paper proposed a PoI variation prediction framework based on similarity analysis between long and short windows. Based on the framework, this paper presented 5 PoI analysis algorithms which can be categorized into 2 types, i.e., the traditional sequence analysis methods such as autoregressive integrated moving average model (ARIMA), support vector regressor (SVR), and the deep learning methods such as convolutional neural network (CNN), long-short …

A Non-Deterministic Deep Learning Based Surrogate For Ice Sheet Modeling, Hannah Jordan

Graduate Student Theses, Dissertations, & Professional Papers

Surrogate modeling is a new and expanding field in the world of deep learning, providing a computationally inexpensive way to approximate results from computationally demanding high-fidelity simulations. Ice sheet modeling is one of these computationally expensive models, the model used in this study currently requires between 10 and 20 minutes to complete one simulation. While this process is adequate for certain applications, the ability to use sampling approaches to perform statistical inference becomes infeasible. This issue can be overcome by using a surrogate model to approximate the ice sheet model, bringing the time to produce output down to a tenth …

Research On The Network Of 3d Smoke Flow Super-Resolution Data Generation, Jinlian Du, Shufei Li, Xueyun Jin

Journal of System Simulation

Abstract: Aiming at the problem of low data generation efficiency due to the high complexity of solving the N-S equation of smoke flow field, a deep learning model which can generate high-resolution smoke flow data based on low-resolution smoke flow data solved by N-S equation is explored and designed. Based on the Generative Adversarial Network, the smoke data reconstruction network based on the sub voxel convolution layer is constructed. Considering the fluidity of smoke, time loss based on advection step is introduced into the loss function to realize high-precision smoke simulation. By extending the image super-resolution quality evaluation index, the …

Deep Learning For Image Super-Resolution: A Survey, Zhihao Wang, Jian Chen, Steven C. H. Hoi

Research Collection School Of Computing and Information Systems

Image Super-Resolution (SR) is an important class of image processing techniqueso enhance the resolution of images and videos in computer vision. Recent years have witnessed remarkable progress of image super-resolution using deep learning techniques. This article aims to provide a comprehensive survey on recent advances of image super-resolution using deep learning approaches. In general, we can roughly group the existing studies of SR techniques into three major categories: supervised SR, unsupervised SR, and domain-specific SR. In addition, we also cover some other important issues, such as publicly available benchmark datasets and performance evaluation metrics. Finally, we conclude this survey by …

Step-Wise Deep Learning Models For Solving Routing Problems, Liang Xin, Wen Song, Zhiguang Cao, Jie Zhang

Research Collection School Of Computing and Information Systems

Routing problems are very important in intelligent transportation systems. Recently, a number of deep learning-based methods are proposed to automatically learn construction heuristics for solving routing problems. However, these methods do not completely follow Bellman's Principle of Optimality since the visited nodes during construction are still included in the following subtasks, resulting in suboptimal policies. In this article, we propose a novel step-wise scheme which explicitly removes the visited nodes in each node selection step. We apply this scheme to two representative deep models for routing problems, pointer network and transformer attention model (TAM), and significantly improve the performance of …

Research On Intrusion Detection Based On Stacked Autoencoder And Long-Short Memory, Lin Shuo, An Lei, Zhijun Gao, Shan Dan, Wenli Shang

Journal of System Simulation

Abstract: As network attacks increasingly hidden, intelligent and complex. Simple machine learning cannot deal with attacks timely. A deep learning method based on the combination of SDAE and LSTM is proposed. Firstly, the distribution rules of network data are extracted intelligently layer by layer by SDAE, and the diverse anomaly features of high-dimensional data ate extracted by using coefficient penalty and reconstruction error of each coding layer. Then, LSTM’ s memory function and the powerful learning ability of sequence data are used to classify learning depth. Finally, the experiments are carried out with the UNSW-NB15 data set, which is analyzed …

Creating Synthetic Satellite Cloud Data Based On Gan Method, Wencong Cheng, Xiaokang Shi, Zhigang Wang

Journal of System Simulation

Abstract: To create the synthetic satellite cloud data in the domain of Meteorology, a method based on Generative Adversarial Networks (GAN) is proposed. Depending on ability of the nonlinear mapping and the information extraction of raster data with the deep learning network, a deep generative adversarial network model is proposed to extract the corresponding information between the numerical weather prediction(NWP) products and the satellite cloud data, and then the appropriate elements of the NWP product are chosen as the input to synthesize the corresponding satellite cloud data. The experiments are conducted on the re-analysis products of the European Centre …

Grand-Vision: An Intelligent System For Optimized Deployment Scheduling Of Law Enforcement Agents, Jonathan Chase, Tran Phong, Kang Long, Tony Le, Hoong Chuin Lau

Research Collection School Of Computing and Information Systems

Law enforcement agencies in dense urban environments, faced with a wide range of incidents to handle and limited manpower, are turning to data-driven AI to inform their policing strategy. In this paper we present a patrol scheduling system called GRAND-VISION: Ground Response Allocation and Deployment - Visualization, Simulation, and Optimization. The system employs deep learning to generate incident sets that are used to train a patrol schedule that can accommodate varying manpower, break times, manual pre-allocations, and a variety of spatio-temporal demand features. The complexity of the scenario results in a system with real world applicability, which we demonstrate through …

Using Deep Learning For Children Brain Image Analysis, Rafael Toche Pizano

Computer Science and Computer Engineering Undergraduate Honors Theses

Analyzing the correlation between brain volumetric/morphometry features and cognition/behavior in children is important in the field of pediatrics as identifying such relationships can help identify children who may be at risk for illnesses. Understanding these relationships can not only help identify children who may be at risk of illnesses, but it can also help evaluate strategies that promote brain development in children. Currently, one way to do this is to use traditional statistical methods such as a correlation analysis, but such an approach does not make it easy to generalize and predict how brain volumetric/morphometry will impact cognition/behavior. One of …

Robot: Robustness-Oriented Testing For Deep Learning Systems, Jingyi Wang, Jialuo Chen, Youcheng Sun, Xingjun Ma, Dongxia Wang, Jun Sun, Peng Cheng

Research Collection School Of Computing and Information Systems

Recently, there has been a significant growth of interest in applying software engineering techniques for the quality assurance of deep learning (DL) systems. One popular direction is deep learning testing, where adversarial examples (a.k.a. bugs) of DL systems are found either by fuzzing or guided search with the help of certain testing metrics. However, recent studies have revealed that the commonly used neuron coverage metrics by existing DL testing approaches are not correlated to model robustness. It is also not an effective measurement on the confidence of the model robustness after testing. In this work, we address this gap by …

Network Traffic Anomaly Detection Method For Imbalanced Data, Shuqin Dong, Bin Zhang

Journal of System Simulation

Abstract: Aiming at the poor detection performances caused by the low feature extraction accuracy of rare traffic attacks from scarce samples, a network traffic anomaly detection method for imbalanced data is proposed. A traffic anomaly detection model is designed, in which the traffic features in different feature spaces are learned by alternating activation functions, architectures, corrupted rates and dropout rates of stacked denoising autoencoder (SDA), and the low accuracy in extracting features of rare traffic attacks in a single space is solved. A batch normalization algorithm is designed, and the Adam algorithm is adopted to train parameters of …

Privacy-Preserving Federated Deep Learning With Irregular Users, Guowen Xu, Hongwei Li, Yun Zhang, Shengmin Xu, Jianting Ning, Robert H. Deng

Research Collection School Of Computing and Information Systems

Federated deep learning has been widely used in various fields. To protect data privacy, many privacy-preserving approaches have also been designed and implemented in various scenarios. However, existing works rarely consider a fundamental issue that the data shared by certain users (called irregular users) may be of low quality. Obviously, in a federated training process, data shared by many irregular users may impair the training accuracy, or worse, lead to the uselessness of the final model. In this paper, we propose PPFDL, a Privacy-Preserving Federated Deep Learning framework with irregular users. In specific, we design a novel solution to reduce …

A Survey On Visual Slam Based On Deep Learning, Ruijun Liu, Xiangshang Wang, Zhang Chen, Bohua Zhang

Journal of System Simulation

Abstract: Following the development of computer vision and robotics, visual Simultaneous Localization and Mapping becomes a research focus in the field of unmanned systems. The powerful advantages of deep learning in the image processing offer a huge opportunity to the wide combination of the two fields. The outstanding research achievements of deep learning combined with visual odometry, loop closure detection and semantic Simultaneous Localization and Mapping are summarized. A comparison between the traditional algorithm and method based on deep learning is carried out. The development direction of visual Simultaneous Localization and Mapping based on deep learning is …

Human Depth Maps Restoration Based On Guided Gan, Jingfang Yin, Dengming Zhu, Shi Min, Zhaoqi Wang

Journal of System Simulation

Abstract: The depth maps captured by a small depth camera on mobile devices suffer from the problem of severe holes. The Guided Generative Adversarial Network (Guided GAN) based on deep learning is proposed to restore human depth maps with above problems. The high-precision human segmentation features and depth class features are extracted from the monocular RGB image by the guider based on the stacked hourglass network. The holes in the human depth maps are filled by the special generator under the guidance of the extracted human features. In order to get the more realistic results, the discriminator is introduced …

Holiday Highway Traffic Flow Prediction Method Based On Deep Learning, Xiaofeng Ji, Yicheng Ge

Journal of System Simulation

Abstract: Accurately predicting highway traffic holiday flow can provide important data for the emergency management of highway. The LSTM-SVR prediction model is established by using the theoretical framework of deep learning. The BP neural network is used to process the sample data, and the data features captured by LSTM are input into the SVR regression layer to realize the traffic flow prediction. Before and after the “Eleventh” Golden Week, the LSTM-SVR model was verified by using the traffic monitoring data of the intermodulation station in Lijiang City and the prediction results were compared with the others. It is found that …

Travel Time Prediction Of Urban Road Based On Deep Learning, Weiwei Zhang, Ruimin Li, Zhongjiao Xie

Journal of System Simulation

Abstract: Travel time prediction of urban road is a significant support for urban intelligent transportation system. Four types of LSTM neural network architecture were selected to predict the urban road travel time. The number of nodes in the LSTM hidden layer was fixed to determine the optimal input length of the model. The input length of the model was fixed and the predictive performance of the four LSTM models under different hidden layer nodes and considering spatial correlation were tested respectively. The performance of spatial LSTM model was compared with four traditional models, for example, BP neural network. The results …

A Cnn Based Cognitive Method To Battlefields Encompassing Situation With Insufficient Samples, Zhu Feng, Xiaofeng Hu, Xiaoyuan He, Yisi Kong, Yang Lu

Journal of System Simulation

Abstract: To research the issue of how to grasp the commander's cognitive experience successfully and effectively facing to battlefields sight map, Convolution Neural Network (CNN) as a kind of the typical algorithm in deep learning can provide the key ways. However, CNN needs the enough samples for running. These samples are hardly to achieve for the time being. Aimed at these problems, some exploring researches were carried out. The issues of battlefields encompassing situation cognition met generally in the warfare and lacking enough samples were discussed. On the basis of analyzing the image characteristics of battlefields encompassing situation and the …

Research Of Air Mission Recognition Method Based On Deep Learning, Qingkai Yao, Shaojun Liu, Xiaoyuan He, Ou Wei

Journal of System Simulation

Abstract: In the large-scale simulation of war game, the air mission is the focus of the commander's attention. The rapid, accurate and automatic recognition of air missions is the prerequisite and basis for intelligent decision making. The rapid development of deep learning technology provided a practical and feasible solution for the extraction of complex battlefield posture features, and provided technical support for studying air mission recognition. The research progress of the traditional mission recognition research method and the mission recognition method based on the deep learning was summarized. The three methods of deep learning of Convolution Neural Network (CNN), Long-short …

Development Of Fully Balanced Ssfp And Computer Vision Applications For Mri-Assisted Radiosurgery (Mars), Jeremiah Sanders

Dissertations and Theses (Open Access)

Prostate cancer is the second most common cancer in men and the second-leading cause of cancer death in men. Brachytherapy is a highly effective treatment option for prostate cancer, and is the most cost-effective initial treatment among all other therapeutic options for low to intermediate risk patients of prostate cancer. In low-dose-rate (LDR) brachytherapy, verifying the location of the radioactive seeds within the prostate and in relation to critical normal structures after seed implantation is essential to ensuring positive treatment outcomes.

One current gap in knowledge is how to simultaneously image the prostate, surrounding anatomy, and radioactive seeds within the …

Research On Image Description Method Based On Neural Network, Kong Rui, Xie Wei, Lei Tai

Journal of System Simulation

Abstract: The automatic recognition and automatically describing image content is an important research direction to the artificial intelligence to connect the computer vision and the natural language processing. A method of describing the image content is proposed to generate the natural language by using the deep neural network model. The model consists of a convolutional neural network (CNN) and a recurrent neural network (RNN). The CNN is used to extract features of the input image to generate a fixed-length feature vector, which initializes the RNN to generate the sentences. Experimental results on the MSCOCO image description dataset show the syntactic …