Engineering Commons^™

Metal Additive Manufacturing Parts Inspection Using Convolutional Neural Network, Wenyuan Cui, Yunlu Zhang, Xinchang Zhang, Lan Li, Frank W. Liou

Mechanical and Aerospace Engineering Faculty Research & Creative Works

Metal additive manufacturing (AM) is gaining increasing attention from academia and industry due to its unique advantages compared to the traditional manufacturing process. Parts quality inspection is playing a crucial role in theAMindustry, which can be adopted for product improvement. However, the traditional inspection process has relied on manual recognition, which could suffer from low efficiency and potential bias. This study presented a convolutional neural network (CNN) approach toward robust AM quality inspection, such as good quality, crack, gas porosity, and lack of fusion. To obtain the appropriate model, experiments were performed on a series of architectures. Moreover, data augmentation …

Lm-Based Word Embeddings Improve Biomedical Named Entity Recognition: A Detailed Analysis, Liliya Akhtyamova, John Cardiff

Conference Papers

Recent studies have shown that contextualized word embeddings outperform other types of embeddings on a variety of tasks. However, there is little research done to evaluate their effectiveness in the biomedical domain under multi-task settings. We derive the contextualized word embeddings from the Flair framework and apply them to the task of biomedical NER on 5 benchmark datasets, yielding major improvements over the baseline and achieving competitive results over the current best systems. We analyze the sources of these improvements, reporting model performances over different combinations of word embeddings, and fine-tuning and casing modes.

Perceived Neighborhood: Preferences Versus Actualities, Saeed Moradi, Ali Nejat, Da Hu, Souparno Ghosh

Department of Statistics: Faculty Publications

Housing recovery plays a key role in the overall restoration of a community. A multitude of factors affect housing recovery, many of which are associated with interactions of residents with their perceived neighborhoods. Targeting perceived neighborhoods rather than administratively defined measures of land helps with devising recovery plans that could better address social preferences of the residents. However, such measures are commonly subject to collection of information via expensive and time-consuming surveys. The current research aims to contribute to the domain by exploring the relationship between perception of households of their neighborhood anchors (perceived anchors) and the anchors that exist …

Smart Distributed Generation System Event Classification Using Recurrent Neural Network-Based Long Short-Term Memory, Shuva Das

College of Graduate Studies: Theses & Dissertations

High penetration of distributed generation (DG) sources into a decentralized power system causes several disturbances, making the monitoring and operation control of the system complicated. Moreover, because of being passive, modern DG systems are unable to detect and inform about these disturbances related to power quality in an intelligent approach. This paper proposed an intelligent and novel technique, capable of making real-time decisions on the occurrence of different DG events such as islanding, capacitor switching, unsymmetrical faults, load switching, and loss of parallel feeder and distinguishing these events from the normal mode of operation. This event classification technique was designed …

Applying Artificial Intelligence To Medical Data, Shaikh Shiam Rahman

College of Graduate Studies: Theses & Dissertations

Machine learning, data mining, and deep learning has become the methodology of choice for analyzing medical data and images. In this study, we implemented three different machine learning techniques to medical data and image analysis. Our first study was to implement different log base entropy for a decision tree algorithm. Our results suggested that using a higher log base for the dataset with mostly categorical attributes with three or more categories for each attribute can obtain a higher accuracy. For the second study, we analyzed mental health data tuning the parameters of the decision tree (splitting method, depth and entropy). …

Application Of Advanced Algorithms And Statistical Techniques For Weed-Plant Discrimination, Saman Akbar Zadeh

Theses: Doctorates and Masters

Precision agriculture requires automated systems for weed detection as weeds compete with the crop for water, nutrients, and light. The purpose of this study is to investigate the use of machine learning methods to classify weeds/crops in agriculture. Statistical methods, support vector machines, convolutional neural networks (CNNs) are introduced, investigated and optimized as classifiers to provide high accuracy at high vehicular speed for weed detection.

Initially, Support Vector Machine (SVM) algorithms are developed for weed-crop discrimination and their accuracies are compared with a conventional data-aggregation method based on the evaluation of discrete Normalised Difference Vegetation Indices (NDVIs) at two different …

Enhanced Pml Based On The Long Short Term Memory Network For The Fdtd Method, He Ming Yao, Lijun Jiang

Electrical and Computer Engineering Faculty Research & Creative Works

This paper proposes a new absorbing boundary condition (ABC) computation approach based on the deep learning technique. Benefited from the sequence dependence feature, the Long Short-Term Memory (LSTM) network is employed to replace the conventional perfectly matched layer (PML) ABC for the Finite-Difference Time-Domain (FDTD) solving process. The newly proposed LSTM based PML model is trained by the electromagnetic field data on the interface of the conventional PML. Different from the conventional PML, the newly proposed model only needs one cell layer as the boundary. Hence, the newly proposed method conveniently reduces both the algorithm's complexity and the area of …

Quantifying Seagrass Distribution In Coastal Water With Deep Learning Models, Daniel Perez, Kazi Islam, Victoria Hill, Richard Zimmerman, Blake Schaeffer, Yuzhong Shen, Jiang Li

OES Faculty Publications

Coastal ecosystems are critically affected by seagrass, both economically and ecologically. However, reliable seagrass distribution information is lacking in nearly all parts of the world because of the excessive costs associated with its assessment. In this paper, we develop two deep learning models for automatic seagrass distribution quantification based on 8-band satellite imagery. Specifically, we implemented a deep capsule network (DCN) and a deep convolutional neural network (CNN) to assess seagrass distribution through regression. The DCN model first determines whether seagrass is presented in the image through classification. Second, if seagrass is presented in the image, it quantifies the seagrass …

Geographic Variation And Ethnicity In Diabetic Retinopathy Detection Via Deeplearning, Ali Serener, Sertan Serte

Turkish Journal of Electrical Engineering and Computer Sciences

The prevalence of diabetes is on the rise steadily around the globe. Diabetic retinopathy (DR) is a result of damage to the blood vessels in the retina due to diabetes and its fast treatment is crucial for preventing possible blindness. The diagnosis of DR is done mostly using a comprehensive eye exam, where the eye is dilated for better inspection. Analysis by an ophthalmologist is prone to human error and thus automatic and highly accurate detection of DR is preferred for an earlier and better diagnosis. It is important, however, that automatic detection be accurate for all data collected from …

Chronic Obstructive Pulmonary Disease Severity Analysis Using Deep Learning Onmulti-Channel Lung Sounds, Gökhan Altan, Yakup Kutlu, Ahmet Gökçen

Turkish Journal of Electrical Engineering and Computer Sciences

Chronic obstructive pulmonary disease (COPD) is one of the deadliest diseases which cannot be treated but can be kept under control in certain stages. COPD has five severities, including at-risk, mild, moderate, severe, and very severe stages. Diagnosis of COPD at early stages needs additional clinical tests for even experienced specialists. The study aims at detecting the severity of the COPD to start treatment for preventing the progression of the disease to the next levels. We analyzed 12-channel lung sounds with different COPD severities from RespiratoryDatabase@TR. The lung sounds were recorded from the clinical auscultation points from 41 patients on …

Deep Learning Towards Intelligent Vehicle Fault Diagnosis, Mohammed Al-Zeyadi, Javier Andreu-Perez, Hani Hagras, Chris Royce, Darren Smith, Piotr Rzonsowski, Ali Malik

Conference papers

Recently, the rapid development of automotive industries has given rise to large multidimensional datasets both in the production sites and after-sale services. Fault diagnostic systems are one of the services that the automotive industries provide. As a consequence of the rapid development of cars features, traditional rule-based diagnostic systems became very limited. Therefore, more sophisticated AI approaches need to be investigated towards more efficient solutions. In this paper, we focus on utilising deep learning so as to build a diagnostic system that is able to estimate the required services in an efficient and effective way. We propose a new model, …

Coverage Guided Differential Adversarial Testing Of Deep Learning Systems, Jianmin Guo, Houbing Song, Yue Zhao, Yu Jiang

Publications

Deep learning is increasingly applied to safety-critical application domains such as autonomous cars and medical devices. It is of significant importance to ensure their reliability and robustness. In this paper, we propose DLFuzz, the coverage guided differential adversarial testing framework to guide deep learing systems exposing incorrect behaviors. DLFuzz keeps minutely mutating the input to maximize the neuron coverage and the prediction difference between the original input and the mutated input, without manual labeling effort or cross-referencing oracles from other systems with the same functionality. We also design multiple novel strategies for neuron selection to improve the neuron coverage. The …

Transformer Neural Networks For Automated Story Generation, Kemal Araz

Dissertations

Towards the last two-decade Artificial Intelligence (AI) proved its use on tasks such as image recognition, natural language processing, automated driving. As discussed in the Moore’s law the computational power increased rapidly over the few decades (Moore, 1965) and made it possible to use the techniques which were computationally expensive. These techniques include Deep Learning (DL) changed the field of AI and outperformed other models in a lot of fields some of which mentioned above. However, in natural language generation especially for creative tasks that needs the artificial intelligent models to have not only a precise understanding of the given …

Improving Transfer Learning For Use In Multi-Spectral Data, Yuvraj Sharma

Dissertations

Recently Nasa as well as the European Space Agency have made observational satellites images public. The main reason behind opening it to public is to foster research among university students and corporations alike. Sentinel is a program by the European Space Agency which has plans to release a series of seven satellites in lower earth orbit for observing land and sea patterns. Recently huge datasets have been made public by the Sentinel program. Many advancements have been made in the field of computer vision in the last decade. Krizhevsky, Sutskever & Hinton, 2012, revolutionized the field of image analysis by …

Deep Learning For Digitized Histology Image Analysis, Sudhir Sornapudi

Doctoral Dissertations

“Cervical cancer is the fourth most frequent cancer that affects women worldwide. Assessment of cervical intraepithelial neoplasia (CIN) through histopathology remains as the standard for absolute determination of cancer. The examination of tissue samples under a microscope requires considerable time and effort from expert pathologists. There is a need to design an automated tool to assist pathologists for digitized histology slide analysis. Pre-cervical cancer is generally determined by examining the CIN which is the growth of atypical cells from the basement membrane (bottom) to the top of the epithelium. It has four grades, including: Normal, CIN1, CIN2, and CIN3. In …

Brian Valdez - Dynamics And Control Of A 3-Dof Manipulator With Deep Learning Feedback, Brian Orlando Valdez

Open Access Theses & Dissertations

With the ever-increasing demands in the space domain and accessibility to low-cost small satellite platforms for educational and scientific projects, efforts are being made in various technology capacities including robotics and artificial intelligence in microgravity. The MIRO Center for Space Exploration and Technology Research (cSETR) prepares the development of their second nanosatellite to launch to space and it is with that opportunity that a 3-DOF robotic arm is in development to be one of the payloads in the nanosatellite. Analyses, hardware implementation, and testing demonstrate a potential positive outcome from including the payload in the nanosatellite and a deep learning …

Wind Power Forecasting Methods Based On Deep Learning: A Survey, Xing Deng, Haijian Shao, Chunlong Hu, Dengbiao Jiang, Yingtao Jiang

Electrical & Computer Engineering Faculty Research

Accurate wind power forecasting in wind farm can effectively reduce the enormous impact on grid operation safety when high permeability intermittent power supply is connected to the power grid. Aiming to provide reference strategies for relevant researchers as well as practical applications, this paper attempts to provide the literature investigation and methods analysis of deep learning, enforcement learning and transfer learning in wind speed and wind power forecasting modeling. Usually, wind speed and wind power forecasting around a wind farm requires the calculation of the next moment of the definite state, which is usually achieved based on the state of …

Video And Image Super-Resolution Via Deep Learning With Attention Mechanism, Xuan Xu

Graduate Theses, Dissertations, and Problem Reports (ETD)

Image demosaicing, image super-resolution and video super-resolution are three important tasks in color imaging pipeline. Demosaicing deals with the recovery of missing color information and generation of full-resolution color images from so-called Color filter Array (CFA) such as Bayer pattern. Image super-resolution aims at increasing the spatial resolution and enhance important structures (e.g., edges and textures) in super-resolved images. Both spatial and temporal dependency are important to the task of video super-resolution, which has received increasingly more attention in recent years. Traditional solutions to these three low-level vision tasks lack generalization capability especially for real-world data. Recently, deep learning methods …

Deepmag+ : Sniffing Mobile Apps In Magnetic Field Through Deep Learning, Rui Ning, Cong Wang, Chunsheng Xin, Jiang Li, Hongyi Wu

Electrical & Computer Engineering Faculty Publications

This paper reports a new side-channel attack to smartphones using the unrestricted magnetic sensor data. We demonstrate that attackers can effectively infer the Apps being used on a smartphone with an accuracy of over 80%, through training a deep Convolutional Neural Networks (CNN). Various signal processing strategies have been studied for feature extractions, including a tempogram based scheme. Moreover, by further exploiting the unrestricted motion sensor to cluster magnetometer data, the sniffing accuracy can increase to as high as 98%. To mitigate such attacks, we propose a noise injection scheme that can effectively reduce the App sniffing accuracy to only …

Vegetation Detection Using Deep Learning And Conventional Methods, Bulent Ayhan, Chiman Kwan, Bence Budavari, Liyun Kwan, Yan Lu, Daniel Perez, Jiang Li, Dimitrios Skarlatos, Marinos Vlachos

Electrical & Computer Engineering Faculty Publications

Land cover classification with the focus on chlorophyll-rich vegetation detection plays an important role in urban growth monitoring and planning, autonomous navigation, drone mapping, biodiversity conservation, etc. Conventional approaches usually apply the normalized difference vegetation index (NDVI) for vegetation detection. In this paper, we investigate the performance of deep learning and conventional methods for vegetation detection. Two deep learning methods, DeepLabV3+ and our customized convolutional neural network (CNN) were evaluated with respect to their detection performance when training and testing datasets originated from different geographical sites with different image resolutions. A novel object-based vegetation detection approach, which utilizes NDVI, computer …

On Geometric Design Rules And In-Process Build Quality Monitoring Of Thin-Wall Features Made Using Laser Powder Bed Fusion Additive Manufacturing Process, Aniruddha Gaikwad

Department of Mechanical and Materials Engineering: Dissertations, Theses, and Student Research

The goal of this thesis is to quantify the link between the design features (geometry), in-process signatures, and build quality of parts made using the laser powder bed fusion (LPBF) additive manufacturing (AM) process. This knowledge is the foundational basis for proposing design rules in AM, as well as for detecting the impending build failures using in-process sensor data.

As a step towards this goal, the objectives of this work are two-fold:

1) Quantify the effect of the geometry and orientation on the build quality of thin-wall features. To explain further, the geometry related factor is the ratio of the …

Applying Deep Learning Models To Structural Mri For Stage Prediction Of Alzheimer's Disease, Altuğ Yi̇ği̇t, Zerri̇n Işik

Turkish Journal of Electrical Engineering and Computer Sciences

Alzheimer's disease is a brain disease that causes impaired cognitive abilities in memory, concentration, planning, and speaking. Alzheimer's disease is defined as the most common cause of dementia and changes different parts of the brain. Neuroimaging, cerebrospinal fluid, and some protein abnormalities are commonly used as clinical diagnostic biomarkers. In this study, neuroimaging biomarkers were applied for the diagnosis of Alzheimer's disease and dementia as a noninvasive method. Structural magnetic resonance (MR) brain images were used as input of the predictive model. T1 weighted volumetric MR images were reduced to two-dimensional space by several preprocessing methods for three different projections. …

Time Series Forecasting On Multivariate Solar Radiation Data Using Deep Learning (Lstm), Murat Ci̇han Sorkun, Özlem Durmaz İncel, Christophe Paoli

Turkish Journal of Electrical Engineering and Computer Sciences

Energy management is an emerging problem nowadays and utilization of renewable energy sources is an efficient solution. Solar radiation is an important source for electricity generation. For effective utilization, it is important to know precisely the amount from different sources and at different horizons: minutes, hours, and days. Depending on the horizon, two main classes of methods can be used to forecast the solar radiation: statistical time series forecasting methods for short to midterm horizons and numerical weather prediction methods for medium- to long-term horizons. Although statistical time series forecasting methods are utilized in the literature, there are a limited …

Convolutional Auto Encoders For Sentence Representation Generation, Ali̇ Mert Ceylan, Vecdi̇ Aytaç

Turkish Journal of Electrical Engineering and Computer Sciences

In this study, we have proposed an alternative approach for sentence modeling problem. The difficulty of the choice of answer, the semantically related questions and the lack of syntactic closeness of the answers give rise to the difficulty of selecting the answer. The deep learning field has recently achieved a pivotal success in semantic analysis, machine translation, and text summaries. The essence of this work, inspired by the human orthographic processing mechanism and using multiple convolution filters with pre-rendered 2-Dimension (2D) representations of sentences, input or output size is to learn the basic features of the language without concerns. For …

Gated Recurrent Unit Based Demand Response For Preventing Voltage Collapse In A Distribution System, Venkateswarlu Gundu, Sishaj Pulikottil Simon, Kinattingal Sundareswaran, Srinivasa Rao Nayak Panugothu

Turkish Journal of Electrical Engineering and Computer Sciences

This paper presents the application of deep learning algorithms towards demand response management. Demand limit violation and voltage stability are the major problems associated with a secondary distribution system. These problems are solved using demand response models by day ahead scheduling loads at every 15 min interval through linear integer programming and based on short term forecasting of load (kW). A new architecture for short term load forecasting is presented namely gated recurrent unit in which statistical analysis is carried out to get the optimal architecture of the neural network model. Reliability indices such as loss of load probability (LOLP) …

Research And Implementation Of Driving Concern Area Detection Based On Deep Learning, Jihua Ye, Shuxia Shi, Hanxi Li, Shimin Wang, Siyu Yang

Journal of System Simulation

Abstract: As a key technology of intelligent driving, driving concern area detection method has an important impact on the performance of intelligent driving or intelligent early warning system. In view of the shortcomings of the existing methods, this paper proposes an effective method for driving concern area detection based on the deep learning. We obtain the camera internal and external parameters by using camera self-calibration method based on camera model, use the Canny edge detection and Bisecting K-means clustering to realize the vanishing point estimation, and establish the road detection model based on the obtained estimates. We obtain the depth …

Amodal Instance Segmentation And Multi-Object Tracking With Deep Pixel Embedding, Yanfeng Liu

Department of Electrical and Computer Engineering: Dissertations, Theses, and Student Research

This thesis extends upon the representational output of semantic instance segmentation by explicitly including both visible and occluded parts. A fully convolutional network is trained to produce consistent pixel-level embedding across two layers such that, when clustered, the results convey the full spatial extent and depth ordering of each instance. Results demonstrate that the network can accurately estimate complete masks in the presence of occlusion and outperform leading top-down bounding-box approaches.

The model is further extended to produce consistent pixel-level embeddings across two consecutive image frames from a video to simultaneously perform amodal instance segmentation and multi-object tracking. No post-processing …

Self-Driving Toy Car Using Deep Learning, Fahim Ahmed, Suleyman Turac, Mubtasem Ali

Publications and Research

Our research focuses on building a student affordable platform for scale model self-driving cars. The goal of this project is to explore current developments of Open Source hardware and software to build a low-cost platform consisting of the car chassis/framework, sensors, and software for the autopilot. Our research will allow other students with low budget to enter into the world of Deep Learning, self-driving cars, and autonomous cars racing competitions.

Multiple Face Detection And Recognition System Design Applying Deep Learning In Web Browsers Using Javascript, Cristhian Gabriel Espinosa Sandoval

Computer Science and Computer Engineering Undergraduate Honors Theses

Deep learning has advanced progressively in the last years and now demonstrates state-of-the-art performance in various fields. In the era of big data, transformation of data into valuable knowledge has become one of the most important challenges in computing. Therefore, we will review multiple algorithms for face recognition that have been researched for a long time and are maturely developed, and analyze deep learning, presenting examples of current research.

To provide a useful and comprehensive perspective, in this paper we categorize research by deep learning architecture, including neural networks, convolutional neural networks, depthwise Separable Convolutions, densely connected convolutional networks, and …

Multivariate Time Series Pattern Recognition Using Machine Learning And Deep Learning Methods, Sai Abhishek Devar

Industrial, Manufacturing, and Systems Theses - Archive

In this research work, we have implemented machine learning & deep-learning algorithms on real-time multivariate time series datasets in the manufacturing & health care fields. The research work is organized in two case-studies. The case study-1 is about rare event classification in multivariate time series in a pulp and paper manufacturing industry, data was collected of multiple sensors at each stage of production line, the data contains a rare event of paper break that commonly occurs in the industry. For preprocessing we have implemented sliding window approach for calculating first order difference method to capture the variation in the data …