Engineering Commons^™

Survey On Deep Neural Networks In Speech And Vision Systems, M. Alam, Manar D. Samad, Lasitha Vidyaratne, ‪Alexander Glandon, Khan M. Iftekharuddin

Computer Science Faculty Research

This survey presents a review of state-of-the-art deep neural network architectures, algorithms, and systems in speech and vision applications. Recent advances in deep artificial neural network algorithms and architectures have spurred rapid innovation and development of intelligent speech and vision systems. With availability of vast amounts of sensor data and cloud computing for processing and training of deep neural networks, and with increased sophistication in mobile and embedded technology, the next-generation intelligent systems are poised to revolutionize personal and commercial computing. This survey begins by providing background and evolution of some of the most successful deep learning models for intelligent …

Automatic Target Recognition With Convolutional Neural Networks., Nada Baili

Electronic Theses and Dissertations

Automatic Target Recognition (ATR) characterizes the ability for an algorithm or device to identify targets or other objects based on data obtained from sensors, being commonly thermal. ATR is an important technology for both civilian and military computer vision applications. However, the current level of performance that is available is largely deficient compared to the requirements. This is mainly due to the difficulty of acquiring targets in realistic environments, and also to limitations of the distribution of classified data to the academic community for research purposes. This thesis proposes to solve the ATR task using Convolutional Neural Networks (CNN). We …

Pose Estimation Using Convolutional Neural Network With Synthesis Depth Data, Wang Song, Fuchang Liu, Huang Ji, Weiwei Xu, Hongwei Dong

Journal of System Simulation

Abstract: 3D scenes can be reconstructed more easily and rapidly with depth camera. However, it is difficult to retrieve items in 3D scenes from a single view depth image, especially for the pose estimation. In this paper, we present a method of pose estimation using convolutional neural network with synthesis depth data, which predicts the items' pose in 3D scenes by regression. This is achieved by (i) synthesizing large amount of depth images with different pose for linear regression using 3D model, (ii) designing a class-dependent linear regression framework, which estimates the object's pose from different classes separately, …

Learning In The Machine: To Share Or Not To Share?, Jordan Ott, Erik Linstead, Nicholas Lahaye, Pierre Baldi

Engineering Faculty Articles and Research

Weight-sharing is one of the pillars behind Convolutional Neural Networks and their successes. However, in physical neural systems such as the brain, weight-sharing is implausible. This discrepancy raises the fundamental question of whether weight-sharing is necessary. If so, to which degree of precision? If not, what are the alternatives? The goal of this study is to investigate these questions, primarily through simulations where the weight-sharing assumption is relaxed. Taking inspiration from neural circuitry, we explore the use of Free Convolutional Networks and neurons with variable connection patterns. Using Free Convolutional Networks, we show that while weight-sharing is a pragmatic optimization …

Semantic Segmentation Of Aerial Imagery Using U-Nets, Terence J. Yi

Theses and Dissertations

In situations where global positioning systems are unavailable, alternative methods of localization must be implemented. A potential step to achieving this is semantic segmentation, or the ability for a model to output class labels by pixel. This research aims to utilize datasets of varying spatial resolutions and locations to train a fully convolutional neural network architecture called the U-Net to perform segmentations of aerial images. Variations of the U-Net architecture are implemented and compared to other existing models in order to determine the best in detecting buildings and roads. A final dataset will also be created combining two datasets to …

3d Convolutional Neural Networks For The Diagnosis Of 6 Unique Pathologies On Head Ct, Travis Clarke, Paras Lakhani, Md

Phase 1

Introduction: Head CT scans are a standard first-line tool used by physicians in the diagnosis of neurological pathologies. Recently, the development of deep learning models such as convolutional neural networks (CNNs) has allowed the rapid identification of bleeds and other pathologies on CT scans. This study aims to show that by training 3D CNNs with a larger, curated dataset, a more comprehensive list of potential diagnoses can be included in the detailed model.

Methods: A retrospective study was performed using a dataset of 66,000 head CT studies from the Thomas Jefferson University health system. Studies were acquired using a natural …

Vegetation Detection Using Deep Learning And Conventional Methods, Bulent Ayhan, Chiman Kwan, Bence Budavari, Liyun Kwan, Yan Lu, Daniel Perez, Jiang Li, Dimitrios Skarlatos, Marinos Vlachos

Electrical & Computer Engineering Faculty Publications

Land cover classification with the focus on chlorophyll-rich vegetation detection plays an important role in urban growth monitoring and planning, autonomous navigation, drone mapping, biodiversity conservation, etc. Conventional approaches usually apply the normalized difference vegetation index (NDVI) for vegetation detection. In this paper, we investigate the performance of deep learning and conventional methods for vegetation detection. Two deep learning methods, DeepLabV3+ and our customized convolutional neural network (CNN) were evaluated with respect to their detection performance when training and testing datasets originated from different geographical sites with different image resolutions. A novel object-based vegetation detection approach, which utilizes NDVI, computer …

Improving The Efficiency Of Dnn Hardware Accelerator By Replacing Digitalfeature Extractor With An Imprecise Neuromorphic Hardware, Majid Mohammadi Rad, Omid Sojodishijani

Turkish Journal of Electrical Engineering and Computer Sciences

Mixed-signal in-memory computation can drastically improve the efficiency of the hardware implementing machine learning (ML) algorithms by (i) removing the need to fetch neural network parameters from internal or external memory and (ii) performing a large number of multiply-accumulate operations in parallel. However, this boost in efficiency comes with some disadvantages. Among them, the inability to precisely program nonvolatile memory devices (NVM) with neural network parameters and sensitivity to noise prevent the mixed-signal hardware to perform a precise and deterministic computation. Unfortunately, these hardware-specific errors can get magnified while propagating along with the layers of the deep neural network. In …

Detection Of Hand Osteoarthritis From Hand Radiographs Using Convolutionalneural Networks With Transfer Learning, Kemal Üreten, Hasan Erbay, Hadi̇ Hakan Maraş

Turkish Journal of Electrical Engineering and Computer Sciences

Osteoarthritis is the most common type of arthritis. Hand osteoarthritis leads to specific structural changes in the joints, such as asymmetric joint space narrowing and osteophytes (bone spurs). Conventional radiography has traditionally been the primary method of visualizing these structural changes and diagnosing osteoarthritis. We aimed to develop a computerized method that is capable of determining the structural changes seen in radiography of the hand and to assist practitioners in interpreting radiographic changes and diagnosing the disease. In this retrospective study, transfer-learning-based convolutional neural networks were trained on a randomly selected dataset containing 332 radiography images of hands from an …

Efficient Turkish Tweet Classification System For Crisis Response, Saed Alqaraleh, Merve Işik

Turkish Journal of Electrical Engineering and Computer Sciences

This paper presents a convolutional neural networks Turkish tweet classification system for crisis response. This system has the ability to classify the present information before or during any crisis. In addition, a preprocessing model was also implemented and integrated as a part of the developed system. This paper presents the first ever Turkish tweet dataset for crisis response, which can be widely used and improve similar studies. This dataset has been carefully preprocessed, annotated, and well organized. It is suitable to be used by all the well-known natural language processing tools. Extensive experimental work, using our produced Turkish tweet dataset …

A Sample Weight And Adaboost Cnn-Based Coarse To Fine Classification Of Fruit And Vegetables At A Supermarket Self-Checkout, Khurram Hameed, Douglas Chai, Alexander Rassau

Research outputs 2014 to 2021

© 2020 by the authors. Licensee MDPI, Basel, Switzerland. The physical features of fruit and vegetables make the task of vision-based classification of fruit and vegetables challenging. The classification of fruit and vegetables at a supermarket self-checkout poses even more challenges due to variable lighting conditions and human factors arising from customer interactions with the system along with the challenges associated with the colour, texture, shape, and size of a fruit or vegetable. Considering this complex application, we have proposed a progressive coarse to fine classification technique to classify fruit and vegetables at supermarket checkouts. The image and weight of …

Filter Design For Small Target Detection On Infrared Imagery Using Normalized-Cross-Correlation Layer, Hüseyi̇n Seçki̇n Demi̇r, Erdem Akagündüz

Turkish Journal of Electrical Engineering and Computer Sciences

n this paper, we introduce a machine learning approach to the problem of infrared small target detection filter design. For this purpose, similar to a convolutional layer of a neural network, the normalized-cross-correlational (NCC) layer, which we utilize for designing a target detection/recognition filter bank, is proposed. By employing the NCC layer in a neural network structure, we introduce a framework, in which supervised training is used to calculate the optimal filter shape and the optimum number of filters required for a specific target detection/recognition task on infrared images. We also propose the mean-absolute-deviation NCC (MAD-NCC) layer, an efficient implementation …

Context-Aware System For Glycemic Control In Diabetic Patients Using Neural Networks, Owais Bhat, Dawood A. Khan

Turkish Journal of Electrical Engineering and Computer Sciences

Diabetic patients are quite hesitant in engaging in normal physiological activities due to difficulties associated with diabetes management. Over the last few decades, there have been advancements in the computational power of embedded systems and glucose sensing technologies. These advancements have attracted the attention of researchers around the globe developing automatic insulin delivery systems. In this paper, a method of closed-loop control of diabetes based on neural networks is proposed. These neural networks are used for making predictions based on the clinical data of a patient. A neural network feedback controller is also designed to provide a glycemic response by …

Applying Deep Learning Models To Structural Mri For Stage Prediction Of Alzheimer's Disease, Altuğ Yi̇ği̇t, Zerri̇n Işik

Turkish Journal of Electrical Engineering and Computer Sciences

Alzheimer's disease is a brain disease that causes impaired cognitive abilities in memory, concentration, planning, and speaking. Alzheimer's disease is defined as the most common cause of dementia and changes different parts of the brain. Neuroimaging, cerebrospinal fluid, and some protein abnormalities are commonly used as clinical diagnostic biomarkers. In this study, neuroimaging biomarkers were applied for the diagnosis of Alzheimer's disease and dementia as a noninvasive method. Structural magnetic resonance (MR) brain images were used as input of the predictive model. T1 weighted volumetric MR images were reduced to two-dimensional space by several preprocessing methods for three different projections. …

Deep Learning For Digitized Histology Image Analysis, Sudhir Sornapudi

Doctoral Dissertations

“Cervical cancer is the fourth most frequent cancer that affects women worldwide. Assessment of cervical intraepithelial neoplasia (CIN) through histopathology remains as the standard for absolute determination of cancer. The examination of tissue samples under a microscope requires considerable time and effort from expert pathologists. There is a need to design an automated tool to assist pathologists for digitized histology slide analysis. Pre-cervical cancer is generally determined by examining the CIN which is the growth of atypical cells from the basement membrane (bottom) to the top of the epithelium. It has four grades, including: Normal, CIN1, CIN2, and CIN3. In …