Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 9 of 9
Full-Text Articles in Engineering
Noisy Importance Sampling Actor-Critic: An Off-Policy Actor-Critic With Experience Replay, Miriam A M Capretz, Norman Tasfi
Noisy Importance Sampling Actor-Critic: An Off-Policy Actor-Critic With Experience Replay, Miriam A M Capretz, Norman Tasfi
Electrical and Computer Engineering Publications
This paper presents Noisy Importance Sampling Actor-Critic (NISAC), a set of empirically validated modifications to the advantage actor-critic algorithm (A2C), allowing off-policy reinforcement learning and increased performance. NISAC uses additive action space noise, aggressive truncation of importance sample weights, and large batch sizes. We see that additive noise drastically changes how off-sample experience is weighted for policy updates. The modified algorithm achieves an increase in convergence speed and sample efficiency compared to both the on-policy actor-critic A2C and the importance weighted off-policy actor-critic algorithm. In comparison to state-of-the-art (SOTA) methods, such as actor-critic with experience replay (ACER), NISAC nears the …
A Self Controlled Rdp Approach For Feature Extraction In Online Handwriting Recognition Using Deep Learning, Sukhdeep Singh, Vinod Kumar Chauhan, Elisa H. Barney Smith
A Self Controlled Rdp Approach For Feature Extraction In Online Handwriting Recognition Using Deep Learning, Sukhdeep Singh, Vinod Kumar Chauhan, Elisa H. Barney Smith
Electrical and Computer Engineering Faculty Publications and Presentations
The identification of accurate features is the initial task for benchmarked handwriting recognition. For handwriting recognition, the objective of feature computation is to find those characteristics of a handwritten stroke that depict the class of a stroke and make it separable from the rest of the stroke classes. The present study proposes a feature extraction technique for online handwritten strokes based on a self controlled Ramer-Douglas-Peucker (RDP) algorithm. This novel approach prepares a smaller length feature vector for different shaped online handwritten strokes without preprocessing and without any control parameter to RDP. Thus, it also overcomes the shortcomings of the …
Knowledge Infused Learning (K-Il): Towards Deep Incorporation Of Knowledge In Deep Learning, Ugur Kursuncu, Manas Gaur, Amit Sheth
Knowledge Infused Learning (K-Il): Towards Deep Incorporation Of Knowledge In Deep Learning, Ugur Kursuncu, Manas Gaur, Amit Sheth
Publications
Learning the underlying patterns in data goes beyondinstance-based generalization to external knowledge repre-sented in structured graphs or networks. Deep learning thatprimarily constitutes neural computing stream in AI hasshown significant advances in probabilistically learning la-tent patterns using a multi-layered network of computationalnodes (i.e., neurons/hidden units). Structured knowledge thatunderlies symbolic computing approaches and often supportsreasoning, has also seen significant growth in recent years,in the form of broad-based (e.g., DBPedia, Yago) and do-main, industry or application specific knowledge graphs. Acommon substrate with careful integration of the two willraise opportunities to develop neuro-symbolic learning ap-proaches for AI, where conceptual and probabilistic repre-sentations are combined. …
Learning In The Machine: To Share Or Not To Share?, Jordan Ott, Erik Linstead, Nicholas Lahaye, Pierre Baldi
Learning In The Machine: To Share Or Not To Share?, Jordan Ott, Erik Linstead, Nicholas Lahaye, Pierre Baldi
Engineering Faculty Articles and Research
Weight-sharing is one of the pillars behind Convolutional Neural Networks and their successes. However, in physical neural systems such as the brain, weight-sharing is implausible. This discrepancy raises the fundamental question of whether weight-sharing is necessary. If so, to which degree of precision? If not, what are the alternatives? The goal of this study is to investigate these questions, primarily through simulations where the weight-sharing assumption is relaxed. Taking inspiration from neural circuitry, we explore the use of Free Convolutional Networks and neurons with variable connection patterns. Using Free Convolutional Networks, we show that while weight-sharing is a pragmatic optimization …
Coverage Guided Differential Adversarial Testing Of Deep Learning Systems, Jianmin Guo, Houbing Song, Yue Zhao, Yu Jiang
Coverage Guided Differential Adversarial Testing Of Deep Learning Systems, Jianmin Guo, Houbing Song, Yue Zhao, Yu Jiang
Publications
Deep learning is increasingly applied to safety-critical application domains such as autonomous cars and medical devices. It is of significant importance to ensure their reliability and robustness. In this paper, we propose DLFuzz, the coverage guided differential adversarial testing framework to guide deep learing systems exposing incorrect behaviors. DLFuzz keeps minutely mutating the input to maximize the neuron coverage and the prediction difference between the original input and the mutated input, without manual labeling effort or cross-referencing oracles from other systems with the same functionality. We also design multiple novel strategies for neuron selection to improve the neuron coverage. The …
Deep Learning Towards Intelligent Vehicle Fault Diagnosis, Mohammed Al-Zeyadi, Javier Andreu-Perez, Hani Hagras, Chris Royce, Darren Smith, Piotr Rzonsowski, Ali Malik
Deep Learning Towards Intelligent Vehicle Fault Diagnosis, Mohammed Al-Zeyadi, Javier Andreu-Perez, Hani Hagras, Chris Royce, Darren Smith, Piotr Rzonsowski, Ali Malik
Conference papers
Recently, the rapid development of automotive industries has given rise to large multidimensional datasets both in the production sites and after-sale services. Fault diagnostic systems are one of the services that the automotive industries provide. As a consequence of the rapid development of cars features, traditional rule-based diagnostic systems became very limited. Therefore, more sophisticated AI approaches need to be investigated towards more efficient solutions. In this paper, we focus on utilising deep learning so as to build a diagnostic system that is able to estimate the required services in an efficient and effective way. We propose a new model, …
Wind Power Forecasting Methods Based On Deep Learning: A Survey, Xing Deng, Haijian Shao, Chunlong Hu, Dengbiao Jiang, Yingtao Jiang
Wind Power Forecasting Methods Based On Deep Learning: A Survey, Xing Deng, Haijian Shao, Chunlong Hu, Dengbiao Jiang, Yingtao Jiang
Electrical & Computer Engineering Faculty Research
Accurate wind power forecasting in wind farm can effectively reduce the enormous impact on grid operation safety when high permeability intermittent power supply is connected to the power grid. Aiming to provide reference strategies for relevant researchers as well as practical applications, this paper attempts to provide the literature investigation and methods analysis of deep learning, enforcement learning and transfer learning in wind speed and wind power forecasting modeling. Usually, wind speed and wind power forecasting around a wind farm requires the calculation of the next moment of the definite state, which is usually achieved based on the state of …
Enhanced Pml Based On The Long Short Term Memory Network For The Fdtd Method, He Ming Yao, Lijun Jiang
Enhanced Pml Based On The Long Short Term Memory Network For The Fdtd Method, He Ming Yao, Lijun Jiang
Electrical and Computer Engineering Faculty Research & Creative Works
This paper proposes a new absorbing boundary condition (ABC) computation approach based on the deep learning technique. Benefited from the sequence dependence feature, the Long Short-Term Memory (LSTM) network is employed to replace the conventional perfectly matched layer (PML) ABC for the Finite-Difference Time-Domain (FDTD) solving process. The newly proposed LSTM based PML model is trained by the electromagnetic field data on the interface of the conventional PML. Different from the conventional PML, the newly proposed model only needs one cell layer as the boundary. Hence, the newly proposed method conveniently reduces both the algorithm's complexity and the area of …
Quantifying Seagrass Distribution In Coastal Water With Deep Learning Models, Daniel Perez, Kazi Islam, Victoria Hill, Richard Zimmerman, Blake Schaeffer, Yuzhong Shen, Jiang Li
Quantifying Seagrass Distribution In Coastal Water With Deep Learning Models, Daniel Perez, Kazi Islam, Victoria Hill, Richard Zimmerman, Blake Schaeffer, Yuzhong Shen, Jiang Li
OES Faculty Publications
Coastal ecosystems are critically affected by seagrass, both economically and ecologically. However, reliable seagrass distribution information is lacking in nearly all parts of the world because of the excessive costs associated with its assessment. In this paper, we develop two deep learning models for automatic seagrass distribution quantification based on 8-band satellite imagery. Specifically, we implemented a deep capsule network (DCN) and a deep convolutional neural network (CNN) to assess seagrass distribution through regression. The DCN model first determines whether seagrass is presented in the image through classification. Second, if seagrass is presented in the image, it quantifies the seagrass …