Computer Engineering Commons^™

Lm-Based Word Embeddings Improve Biomedical Named Entity Recognition: A Detailed Analysis, Liliya Akhtyamova, John Cardiff

Conference Papers

Recent studies have shown that contextualized word embeddings outperform other types of embeddings on a variety of tasks. However, there is little research done to evaluate their effectiveness in the biomedical domain under multi-task settings. We derive the contextualized word embeddings from the Flair framework and apply them to the task of biomedical NER on 5 benchmark datasets, yielding major improvements over the baseline and achieving competitive results over the current best systems. We analyze the sources of these improvements, reporting model performances over different combinations of word embeddings, and fine-tuning and casing modes.

Applying Artificial Intelligence To Medical Data, Shaikh Shiam Rahman

College of Graduate Studies: Theses & Dissertations

Machine learning, data mining, and deep learning has become the methodology of choice for analyzing medical data and images. In this study, we implemented three different machine learning techniques to medical data and image analysis. Our first study was to implement different log base entropy for a decision tree algorithm. Our results suggested that using a higher log base for the dataset with mostly categorical attributes with three or more categories for each attribute can obtain a higher accuracy. For the second study, we analyzed mental health data tuning the parameters of the decision tree (splitting method, depth and entropy). …

Application Of Advanced Algorithms And Statistical Techniques For Weed-Plant Discrimination, Saman Akbar Zadeh

Theses: Doctorates and Masters

Precision agriculture requires automated systems for weed detection as weeds compete with the crop for water, nutrients, and light. The purpose of this study is to investigate the use of machine learning methods to classify weeds/crops in agriculture. Statistical methods, support vector machines, convolutional neural networks (CNNs) are introduced, investigated and optimized as classifiers to provide high accuracy at high vehicular speed for weed detection.

Initially, Support Vector Machine (SVM) algorithms are developed for weed-crop discrimination and their accuracies are compared with a conventional data-aggregation method based on the evaluation of discrete Normalised Difference Vegetation Indices (NDVIs) at two different …

Geographic Variation And Ethnicity In Diabetic Retinopathy Detection Via Deeplearning, Ali Serener, Sertan Serte

Turkish Journal of Electrical Engineering and Computer Sciences

The prevalence of diabetes is on the rise steadily around the globe. Diabetic retinopathy (DR) is a result of damage to the blood vessels in the retina due to diabetes and its fast treatment is crucial for preventing possible blindness. The diagnosis of DR is done mostly using a comprehensive eye exam, where the eye is dilated for better inspection. Analysis by an ophthalmologist is prone to human error and thus automatic and highly accurate detection of DR is preferred for an earlier and better diagnosis. It is important, however, that automatic detection be accurate for all data collected from …

Chronic Obstructive Pulmonary Disease Severity Analysis Using Deep Learning Onmulti-Channel Lung Sounds, Gökhan Altan, Yakup Kutlu, Ahmet Gökçen

Turkish Journal of Electrical Engineering and Computer Sciences

Chronic obstructive pulmonary disease (COPD) is one of the deadliest diseases which cannot be treated but can be kept under control in certain stages. COPD has five severities, including at-risk, mild, moderate, severe, and very severe stages. Diagnosis of COPD at early stages needs additional clinical tests for even experienced specialists. The study aims at detecting the severity of the COPD to start treatment for preventing the progression of the disease to the next levels. We analyzed 12-channel lung sounds with different COPD severities from RespiratoryDatabase@TR. The lung sounds were recorded from the clinical auscultation points from 41 patients on …

Coverage Guided Differential Adversarial Testing Of Deep Learning Systems, Jianmin Guo, Houbing Song, Yue Zhao, Yu Jiang

Publications

Deep learning is increasingly applied to safety-critical application domains such as autonomous cars and medical devices. It is of significant importance to ensure their reliability and robustness. In this paper, we propose DLFuzz, the coverage guided differential adversarial testing framework to guide deep learing systems exposing incorrect behaviors. DLFuzz keeps minutely mutating the input to maximize the neuron coverage and the prediction difference between the original input and the mutated input, without manual labeling effort or cross-referencing oracles from other systems with the same functionality. We also design multiple novel strategies for neuron selection to improve the neuron coverage. The …

Transformer Neural Networks For Automated Story Generation, Kemal Araz

Dissertations

Towards the last two-decade Artificial Intelligence (AI) proved its use on tasks such as image recognition, natural language processing, automated driving. As discussed in the Moore’s law the computational power increased rapidly over the few decades (Moore, 1965) and made it possible to use the techniques which were computationally expensive. These techniques include Deep Learning (DL) changed the field of AI and outperformed other models in a lot of fields some of which mentioned above. However, in natural language generation especially for creative tasks that needs the artificial intelligent models to have not only a precise understanding of the given …

Improving Transfer Learning For Use In Multi-Spectral Data, Yuvraj Sharma

Dissertations

Recently Nasa as well as the European Space Agency have made observational satellites images public. The main reason behind opening it to public is to foster research among university students and corporations alike. Sentinel is a program by the European Space Agency which has plans to release a series of seven satellites in lower earth orbit for observing land and sea patterns. Recently huge datasets have been made public by the Sentinel program. Many advancements have been made in the field of computer vision in the last decade. Krizhevsky, Sutskever & Hinton, 2012, revolutionized the field of image analysis by …

Deep Learning For Digitized Histology Image Analysis, Sudhir Sornapudi

Doctoral Dissertations

“Cervical cancer is the fourth most frequent cancer that affects women worldwide. Assessment of cervical intraepithelial neoplasia (CIN) through histopathology remains as the standard for absolute determination of cancer. The examination of tissue samples under a microscope requires considerable time and effort from expert pathologists. There is a need to design an automated tool to assist pathologists for digitized histology slide analysis. Pre-cervical cancer is generally determined by examining the CIN which is the growth of atypical cells from the basement membrane (bottom) to the top of the epithelium. It has four grades, including: Normal, CIN1, CIN2, and CIN3. In …

Deepmag+ : Sniffing Mobile Apps In Magnetic Field Through Deep Learning, Rui Ning, Cong Wang, Chunsheng Xin, Jiang Li, Hongyi Wu

Electrical & Computer Engineering Faculty Publications

This paper reports a new side-channel attack to smartphones using the unrestricted magnetic sensor data. We demonstrate that attackers can effectively infer the Apps being used on a smartphone with an accuracy of over 80%, through training a deep Convolutional Neural Networks (CNN). Various signal processing strategies have been studied for feature extractions, including a tempogram based scheme. Moreover, by further exploiting the unrestricted motion sensor to cluster magnetometer data, the sniffing accuracy can increase to as high as 98%. To mitigate such attacks, we propose a noise injection scheme that can effectively reduce the App sniffing accuracy to only …

Vegetation Detection Using Deep Learning And Conventional Methods, Bulent Ayhan, Chiman Kwan, Bence Budavari, Liyun Kwan, Yan Lu, Daniel Perez, Jiang Li, Dimitrios Skarlatos, Marinos Vlachos

Electrical & Computer Engineering Faculty Publications

Land cover classification with the focus on chlorophyll-rich vegetation detection plays an important role in urban growth monitoring and planning, autonomous navigation, drone mapping, biodiversity conservation, etc. Conventional approaches usually apply the normalized difference vegetation index (NDVI) for vegetation detection. In this paper, we investigate the performance of deep learning and conventional methods for vegetation detection. Two deep learning methods, DeepLabV3+ and our customized convolutional neural network (CNN) were evaluated with respect to their detection performance when training and testing datasets originated from different geographical sites with different image resolutions. A novel object-based vegetation detection approach, which utilizes NDVI, computer …

Applying Deep Learning Models To Structural Mri For Stage Prediction Of Alzheimer's Disease, Altuğ Yi̇ği̇t, Zerri̇n Işik

Turkish Journal of Electrical Engineering and Computer Sciences

Alzheimer's disease is a brain disease that causes impaired cognitive abilities in memory, concentration, planning, and speaking. Alzheimer's disease is defined as the most common cause of dementia and changes different parts of the brain. Neuroimaging, cerebrospinal fluid, and some protein abnormalities are commonly used as clinical diagnostic biomarkers. In this study, neuroimaging biomarkers were applied for the diagnosis of Alzheimer's disease and dementia as a noninvasive method. Structural magnetic resonance (MR) brain images were used as input of the predictive model. T1 weighted volumetric MR images were reduced to two-dimensional space by several preprocessing methods for three different projections. …

Time Series Forecasting On Multivariate Solar Radiation Data Using Deep Learning (Lstm), Murat Ci̇han Sorkun, Özlem Durmaz İncel, Christophe Paoli

Turkish Journal of Electrical Engineering and Computer Sciences

Energy management is an emerging problem nowadays and utilization of renewable energy sources is an efficient solution. Solar radiation is an important source for electricity generation. For effective utilization, it is important to know precisely the amount from different sources and at different horizons: minutes, hours, and days. Depending on the horizon, two main classes of methods can be used to forecast the solar radiation: statistical time series forecasting methods for short to midterm horizons and numerical weather prediction methods for medium- to long-term horizons. Although statistical time series forecasting methods are utilized in the literature, there are a limited …

Convolutional Auto Encoders For Sentence Representation Generation, Ali̇ Mert Ceylan, Vecdi̇ Aytaç

Turkish Journal of Electrical Engineering and Computer Sciences

In this study, we have proposed an alternative approach for sentence modeling problem. The difficulty of the choice of answer, the semantically related questions and the lack of syntactic closeness of the answers give rise to the difficulty of selecting the answer. The deep learning field has recently achieved a pivotal success in semantic analysis, machine translation, and text summaries. The essence of this work, inspired by the human orthographic processing mechanism and using multiple convolution filters with pre-rendered 2-Dimension (2D) representations of sentences, input or output size is to learn the basic features of the language without concerns. For …

Gated Recurrent Unit Based Demand Response For Preventing Voltage Collapse In A Distribution System, Venkateswarlu Gundu, Sishaj Pulikottil Simon, Kinattingal Sundareswaran, Srinivasa Rao Nayak Panugothu

Turkish Journal of Electrical Engineering and Computer Sciences

This paper presents the application of deep learning algorithms towards demand response management. Demand limit violation and voltage stability are the major problems associated with a secondary distribution system. These problems are solved using demand response models by day ahead scheduling loads at every 15 min interval through linear integer programming and based on short term forecasting of load (kW). A new architecture for short term load forecasting is presented namely gated recurrent unit in which statistical analysis is carried out to get the optimal architecture of the neural network model. Reliability indices such as loss of load probability (LOLP) …

Research And Implementation Of Driving Concern Area Detection Based On Deep Learning, Jihua Ye, Shuxia Shi, Hanxi Li, Shimin Wang, Siyu Yang

Journal of System Simulation

Abstract: As a key technology of intelligent driving, driving concern area detection method has an important impact on the performance of intelligent driving or intelligent early warning system. In view of the shortcomings of the existing methods, this paper proposes an effective method for driving concern area detection based on the deep learning. We obtain the camera internal and external parameters by using camera self-calibration method based on camera model, use the Canny edge detection and Bisecting K-means clustering to realize the vanishing point estimation, and establish the road detection model based on the obtained estimates. We obtain the depth …

Amodal Instance Segmentation And Multi-Object Tracking With Deep Pixel Embedding, Yanfeng Liu

Department of Electrical and Computer Engineering: Dissertations, Theses, and Student Research

This thesis extends upon the representational output of semantic instance segmentation by explicitly including both visible and occluded parts. A fully convolutional network is trained to produce consistent pixel-level embedding across two layers such that, when clustered, the results convey the full spatial extent and depth ordering of each instance. Results demonstrate that the network can accurately estimate complete masks in the presence of occlusion and outperform leading top-down bounding-box approaches.

The model is further extended to produce consistent pixel-level embeddings across two consecutive image frames from a video to simultaneously perform amodal instance segmentation and multi-object tracking. No post-processing …

Self-Driving Toy Car Using Deep Learning, Fahim Ahmed, Suleyman Turac, Mubtasem Ali

Publications and Research

Our research focuses on building a student affordable platform for scale model self-driving cars. The goal of this project is to explore current developments of Open Source hardware and software to build a low-cost platform consisting of the car chassis/framework, sensors, and software for the autopilot. Our research will allow other students with low budget to enter into the world of Deep Learning, self-driving cars, and autonomous cars racing competitions.

Multiple Face Detection And Recognition System Design Applying Deep Learning In Web Browsers Using Javascript, Cristhian Gabriel Espinosa Sandoval

Computer Science and Computer Engineering Undergraduate Honors Theses

Deep learning has advanced progressively in the last years and now demonstrates state-of-the-art performance in various fields. In the era of big data, transformation of data into valuable knowledge has become one of the most important challenges in computing. Therefore, we will review multiple algorithms for face recognition that have been researched for a long time and are maturely developed, and analyze deep learning, presenting examples of current research.

To provide a useful and comprehensive perspective, in this paper we categorize research by deep learning architecture, including neural networks, convolutional neural networks, depthwise Separable Convolutions, densely connected convolutional networks, and …

Seer: An Explainable Deep Learning Midi-Based Hybrid Song Recommender System, Khalil Damak, Olfa Nasraoui

Faculty and Staff Scholarship

State of the art music recommender systems mainly rely on either matrix factorization-based collaborative filtering approaches or deep learning architectures. Deep learning models usually use metadata for content-based filtering or predict the next user interaction by learning from temporal sequences of user actions. Despite advances in deep learning for song recommendation, none has taken advantage of the sequential nature of songs by learning sequence models that are based on content. Aside from the importance of prediction accuracy, other significant aspects are important, such as explainability and solving the cold start problem. In this work, we propose a hybrid deep learning …

Improved Study Of Side-Channel Attacks Using Recurrent Neural Networks, Muhammad Abu Naser Rony Chowdhury

Boise State University Theses and Dissertations

Differential power analysis attacks are special kinds of side-channel attacks where power traces are considered as the side-channel information to launch the attack. These attacks are threatening and significant security issues for modern cryptographic devices such as smart cards, and Point of Sale (POS) machine; because after careful analysis of the power traces, the attacker can break any secured encryption algorithm and can steal sensitive information.

In our work, we study differential power analysis attack using two popular neural networks: Recurrent Neural Network (RNN) and Convolutional Neural Network (CNN). Our work seeks to answer three research questions(RQs):

RQ1: Is it …

Identifying Regional Trends In Avatar Customization, Peter Mawhorter, Sercan Sengun, Haewoon Kwak, D. Fox Harrell

Research Collection School Of Computing and Information Systems

Since virtual identities such as social media profiles and avatars have become a common venue for self-expression, it has become important to consider the ways in which existing systems embed the values of their designers. In order to design virtual identity systems that reflect the needs and preferences of diverse users, understanding how the virtual identity construction differs between groups is important. This paper presents a new methodology that leverages deep learning and differential clustering for comparative analysis of profile images, with a case study of almost 100 000 avatars from a large online community using a popular avatar creation …

Why Deep Learning Is More Efficient Than Support Vector Machines, And How It Is Related To Sparsity Techniques In Signal Processing, Laxman Bokati, Olga Kosheleva, Vladik Kreinovich

Departmental Technical Reports (CS)

Several decades ago, traditional neural networks were the most efficient machine learning technique. Then it turned out that, in general, a different technique called support vector machines is more efficient. Reasonably recently, a new technique called deep learning has been shown to be the most efficient one. These are empirical observations, but how we explain them -- thus making the corresponding conclusions more reliable? In this paper, we provide a possible theoretical explanation for the above-described empirical comparisons. This explanation enables us to explain yet another empirical fact -- that sparsity techniques turned out to be very efficient in signal …

Deep Learning (Partly) Demystified, Vladik Kreinovich, Olga Kosheleva

Departmental Technical Reports (CS)

Successes of deep learning are partly due to appropriate selection of activation function, pooling functions, etc. Most of these choices have been made based on empirical comparison and heuristic ideas. In this paper, we show that many of these choices -- and the surprising success of deep learning in the first place -- can be explained by reasonably simple and natural mathematics.

Limited Data Rolling Bearing Fault Diagnosis With Few-Shot Learning, Ansi Zhang, Shaobo Li, Yuxin Cui, Wanli Yang, Rongzhi Dong, Jianjun Hu

Faculty Publications

This paper focuses on bearing fault diagnosis with limited training data. A major challenge in fault diagnosis is the infeasibility of obtaining sufficient training samples for every fault type under all working conditions. Recently deep learning based fault diagnosis methods have achieved promising results. However, most of these methods require large amount of training data. In this study, we propose a deep neural network based few-shot learning approach for rolling bearing fault diagnosis with limited data. Our model is based on the siamese neural network, which learns by exploiting sample pairs of the same or different categories. Experimental results over …

Large-Scale Data Analysis And Deep Learning Using Distributed Cyberinfrastructures And High Performance Computing, Richard Dodge Platania

LSU Doctoral Dissertations

Data in many research fields continues to grow in both size and complexity. For instance, recent technological advances have caused an increased throughput in data in various biological-related endeavors, such as DNA sequencing, molecular simulations, and medical imaging. In addition, the variance in the types of data (textual, signal, image, etc.) adds an additional complexity in analyzing the data. As such, there is a need for uniquely developed applications that cater towards the type of data. Several considerations must be made when attempting to create a tool for a particular dataset. First, we must consider the type of algorithm required …

Deep Autoencoder Neural Networks For Short-Term Traffic Congestion Prediction Of Transportation Networks, Sen Zhang, Yong Yao, Jie Hu, Yong Zhao, Shaobo Li, Jianjun Hu

Faculty Publications

Traffic congestion prediction is critical for implementing intelligent transportation systems for improving the efficiency and capacity of transportation networks. However, despite its importance, traffic congestion prediction is severely less investigated compared to traffic flow prediction, which is partially due to the severe lack of large-scale high-quality traffic congestion data and advanced algorithms. This paper proposes an accessible and general workflow to acquire large-scale traffic congestion data and to create traffic congestion datasets based on image analysis. With this workflow we create a dataset named Seattle Area Traffic Congestion Status (SATCS) based on traffic congestion map snapshots from a publicly available …

Classification Of The 4 Stages Of Diabetic Retinopathy Using A Low Complexity Convolutional Neural Network., Zeliha Ogur

Electronic Theses and Dissertations

Diabetic Retinopathy is an eye disease that affects the blood vessels of the retina tissue found in the back of the eye. The blood vessels in the retina discharge fluid or cause hemorrhage when affected by diabetic retinopathy. It leads to loss of eye vision with people with diabetics and also among working adults. The disease may advance in four stages which include Mild nonproliferative, moderate nonproliferative, severe nonproliferative and proliferative diabetic retinopathy. In the mild stage also known as background retinopathy, lumps occur in the blood vessel and distort a little amount of blood. At this stage, you are …

Unresolved Object Detection Using Synthetic Data Generation And Artificial Neural Networks, Yong U. Sinn

Theses and Dissertations

This research presents and solves constrained real-world problems of using synthetic data to train artificial neural networks (ANNs) to detect unresolved moving objects in wide field of view (WFOV) electro-optical/infrared (EO/IR) satellite motion imagery. Objectives include demonstrating the use of the Air Force Institute of Technology (AFIT) Sensor and Scene Emulation Tool (ASSET) as an effective tool for generating EO/IR motion imagery representative of real WFOV sensors and describing the ANN architectures, training, and testing results obtained. Deep learning using a 3-D convolutional neural network (3D ConvNet), long short term memory (LSTM) network, and U-Net are used to solve the …

Deep Learning Method For Hyperspectral Remote Sensing Images With Small Samples, Xiangbin Shi, Zhong Jian, Cuiwei Liu, Liu Fang, Deyuan Zhang

Journal of System Simulation

Abstract: In order to solve the problem of large information dimension and fewer labeled training samples of hyperspectral remote sensing images, this paper proposes a hyperspectral remote sensing image classification framework HSI-CNN, which reduces the number of model parameters while maintaining the depth of neural network. Image pattern invariance and spectral channel contribution rate are analyzed, and the spectral redundancy information is reduced by principal component analysis. A full convolution neural network structure suitable for small sample hyperspectral remote sensing images is designed and the amount of network parameters is effectively reduced. Three kinds of HSI-CNN structures are proposed …