Open Access. Powered by Scholars. Published by Universities.®

Physical Sciences and Mathematics Commons

Open Access. Powered by Scholars. Published by Universities.®

Deep learning

Discipline
Institution
Publication Year
Publication
Publication Type
File Type

Articles 961 - 990 of 1164

Full-Text Articles in Physical Sciences and Mathematics

Transformer Neural Networks For Automated Story Generation, Kemal Araz Jan 2020

Transformer Neural Networks For Automated Story Generation, Kemal Araz

Dissertations

Towards the last two-decade Artificial Intelligence (AI) proved its use on tasks such as image recognition, natural language processing, automated driving. As discussed in the Moore’s law the computational power increased rapidly over the few decades (Moore, 1965) and made it possible to use the techniques which were computationally expensive. These techniques include Deep Learning (DL) changed the field of AI and outperformed other models in a lot of fields some of which mentioned above. However, in natural language generation especially for creative tasks that needs the artificial intelligent models to have not only a precise understanding of the given …


Pretraining Deep Learning Models For Natural Language Understanding, Han Shao Jan 2020

Pretraining Deep Learning Models For Natural Language Understanding, Han Shao

Honors Papers

Since the first bidirectional deep learn- ing model for natural language understanding, BERT, emerged in 2018, researchers have started to study and use pretrained bidirectional autoencoding or autoregressive models to solve language problems. In this project, I conducted research to fully understand BERT and XLNet and applied their pretrained models to two language tasks: reading comprehension (RACE) and part-of-speech tagging (The Penn Treebank). After experimenting with those released models, I implemented my own version of ELECTRA, a pretrained text encoder as a discriminator instead of a generator to improve compute-efficiency, with BERT as its underlying architecture. To reduce the number …


Toward Multi-Label Sentiment Analysis: A Transfer Learning Based Approach, Jie Tao, Xing Fang Jan 2020

Toward Multi-Label Sentiment Analysis: A Transfer Learning Based Approach, Jie Tao, Xing Fang

Faculty Publications - Information Technology

Sentiment analysis is recognized as one of the most important sub-areas in Natural Language Processing (NLP) research, where understanding implicit or explicit sentiments expressed in social media contents is valuable to customers, business owners, and other stakeholders. Researchers have recognized that the generic sentiments extracted from the textual contents are inadequate, thus, Aspect Based Sentiment Analysis (ABSA) was coined to capture aspect sentiments expressed toward specific review aspects. Existing ABSA methods not only treat the analytical problem as single-label classification that requires a fairly large amount of labelled data for model training purposes, but also underestimate the entity aspects …


Deep Learning For Digitized Histology Image Analysis, Sudhir Sornapudi Jan 2020

Deep Learning For Digitized Histology Image Analysis, Sudhir Sornapudi

Doctoral Dissertations

“Cervical cancer is the fourth most frequent cancer that affects women worldwide. Assessment of cervical intraepithelial neoplasia (CIN) through histopathology remains as the standard for absolute determination of cancer. The examination of tissue samples under a microscope requires considerable time and effort from expert pathologists. There is a need to design an automated tool to assist pathologists for digitized histology slide analysis. Pre-cervical cancer is generally determined by examining the CIN which is the growth of atypical cells from the basement membrane (bottom) to the top of the epithelium. It has four grades, including: Normal, CIN1, CIN2, and CIN3. In …


Deep Learning For Overhead Imagery: Algorithms And Applications, Anthony Manuel Ortiz Cepeda Jan 2020

Deep Learning For Overhead Imagery: Algorithms And Applications, Anthony Manuel Ortiz Cepeda

Open Access Theses & Dissertations

Remote sensing using overhead imagery has critical impact to the way we understand our environment and offers crucial information for scene understanding, climate change research, disaster response, urban planning, forest management, and many other applications. At present, deep learning is increasingly used in remote sensing, but mostly borrowing algorithms developed for natural images in the computer vision community. Specific challenges arise while applying deep learning to remote sensing. These challenges include issues related to the high dimensionality and limited labeled data, security and robustness to adversarial attacks, and model generalization. In this Thesis we focus on tackling these key challenges. …


Brian Valdez - Dynamics And Control Of A 3-Dof Manipulator With Deep Learning Feedback, Brian Orlando Valdez Jan 2020

Brian Valdez - Dynamics And Control Of A 3-Dof Manipulator With Deep Learning Feedback, Brian Orlando Valdez

Open Access Theses & Dissertations

With the ever-increasing demands in the space domain and accessibility to low-cost small satellite platforms for educational and scientific projects, efforts are being made in various technology capacities including robotics and artificial intelligence in microgravity. The MIRO Center for Space Exploration and Technology Research (cSETR) prepares the development of their second nanosatellite to launch to space and it is with that opportunity that a 3-DOF robotic arm is in development to be one of the payloads in the nanosatellite. Analyses, hardware implementation, and testing demonstrate a potential positive outcome from including the payload in the nanosatellite and a deep learning …


Experiments On The Neural Network Approach To The Handwritten Digit Classification Problem, William Meissner Jan 2020

Experiments On The Neural Network Approach To The Handwritten Digit Classification Problem, William Meissner

College of Graduate Studies: Theses & Dissertations

When the MNIST dataset was introduced in 1998, training a network was a multiple week problem in order to receive results far less accurate than an average CPU can produce within a couple of hours today. While this indicates that training a network on such a dataset is not the complicated problem it may have been twenty years ago, the MNIST dataset makes a good tool for study and testing with beginner and medium complexity neural networks. This paper follows along with the work presented in the online textbook “Neural Networks and Deep Learning” by Michael Nielson and an updated …


Quantifying Seagrass Distribution In Coastal Water With Deep Learning Models, Daniel Perez, Kazi Islam, Victoria Hill, Richard Zimmerman, Blake Schaeffer, Yuzhong Shen, Jiang Li Jan 2020

Quantifying Seagrass Distribution In Coastal Water With Deep Learning Models, Daniel Perez, Kazi Islam, Victoria Hill, Richard Zimmerman, Blake Schaeffer, Yuzhong Shen, Jiang Li

OES Faculty Publications

Coastal ecosystems are critically affected by seagrass, both economically and ecologically. However, reliable seagrass distribution information is lacking in nearly all parts of the world because of the excessive costs associated with its assessment. In this paper, we develop two deep learning models for automatic seagrass distribution quantification based on 8-band satellite imagery. Specifically, we implemented a deep capsule network (DCN) and a deep convolutional neural network (CNN) to assess seagrass distribution through regression. The DCN model first determines whether seagrass is presented in the image through classification. Second, if seagrass is presented in the image, it quantifies the seagrass …


Wind Power Forecasting Methods Based On Deep Learning: A Survey, Xing Deng, Haijian Shao, Chunlong Hu, Dengbiao Jiang, Yingtao Jiang Jan 2020

Wind Power Forecasting Methods Based On Deep Learning: A Survey, Xing Deng, Haijian Shao, Chunlong Hu, Dengbiao Jiang, Yingtao Jiang

Electrical & Computer Engineering Faculty Research

Accurate wind power forecasting in wind farm can effectively reduce the enormous impact on grid operation safety when high permeability intermittent power supply is connected to the power grid. Aiming to provide reference strategies for relevant researchers as well as practical applications, this paper attempts to provide the literature investigation and methods analysis of deep learning, enforcement learning and transfer learning in wind speed and wind power forecasting modeling. Usually, wind speed and wind power forecasting around a wind farm requires the calculation of the next moment of the definite state, which is usually achieved based on the state of …


Image And Video-Based Autism Spectrum Disorder Detection Via Deep Learning, Mindi Ruan Jan 2020

Image And Video-Based Autism Spectrum Disorder Detection Via Deep Learning, Mindi Ruan

Graduate Theses, Dissertations, and Problem Reports (ETD)

People with Autism Spectrum Disorder (ASD) show atypical attention to social stimuli and aberrant gaze when viewing images of the physical world. However, it is unknown how they perceive the world from a first-person perspective. In this study, we used machine learning to classify photos taken in three different categories (people, indoors, and outdoors) as either having been taken by individuals with ASD or by peers without ASD. Our classifier effectively discriminated photos from all three categories but was particularly successful at classifying photos of people with >80% accuracy. Importantly, the visualization of our model revealed critical features that led …


Ai Techniques For Covid-19, Adedoyin Ahmed Hussain, Ouns Bouachir, Fadi Al-Turjman, Moayad Aloqaily Jan 2020

Ai Techniques For Covid-19, Adedoyin Ahmed Hussain, Ouns Bouachir, Fadi Al-Turjman, Moayad Aloqaily

All Works

© 2013 IEEE. Artificial Intelligence (AI) intent is to facilitate human limits. It is getting a standpoint on human administrations, filled by the growing availability of restorative clinical data and quick progression of insightful strategies. Motivated by the need to highlight the need for employing AI in battling the COVID-19 Crisis, this survey summarizes the current state of AI applications in clinical administrations while battling COVID-19. Furthermore, we highlight the application of Big Data while understanding this virus. We also overview various intelligence techniques and methods that can be applied to various types of medical information-based pandemic. We classify the …


Improving M-Learners' Performance Through Deep Learning Techniques By Leveraging Features Weights, Muhammad Adnan, Asad Habib, Jawad Ashraf, Babar Shah, Gohar Ali Jan 2020

Improving M-Learners' Performance Through Deep Learning Techniques By Leveraging Features Weights, Muhammad Adnan, Asad Habib, Jawad Ashraf, Babar Shah, Gohar Ali

All Works

© 2013 IEEE. Mobile learning (M-learning) has gained tremendous attention in the educational environment in the past decade. For effective M-learning, it is important to create an efficient M-learning model that can identify the exact requirements of mobile learners (M-learners). M-learning model is composed of features that are generated during M-learners' interaction with mobile devices. For an adaptive M-learning model, not only learning features are required, but it is also important to determine how they differ for various M-learners, their weights, and interrelationship. This study proposes a robust and adaptive M-learning model that is based on machine learning and deep …


Deepmag+ : Sniffing Mobile Apps In Magnetic Field Through Deep Learning, Rui Ning, Cong Wang, Chunsheng Xin, Jiang Li, Hongyi Wu Jan 2020

Deepmag+ : Sniffing Mobile Apps In Magnetic Field Through Deep Learning, Rui Ning, Cong Wang, Chunsheng Xin, Jiang Li, Hongyi Wu

Electrical & Computer Engineering Faculty Publications

This paper reports a new side-channel attack to smartphones using the unrestricted magnetic sensor data. We demonstrate that attackers can effectively infer the Apps being used on a smartphone with an accuracy of over 80%, through training a deep Convolutional Neural Networks (CNN). Various signal processing strategies have been studied for feature extractions, including a tempogram based scheme. Moreover, by further exploiting the unrestricted motion sensor to cluster magnetometer data, the sniffing accuracy can increase to as high as 98%. To mitigate such attacks, we propose a noise injection scheme that can effectively reduce the App sniffing accuracy to only …


Early Detection Of Fake News On Social Media, Yang Liu Dec 2019

Early Detection Of Fake News On Social Media, Yang Liu

Dissertations

The ever-increasing popularity and convenience of social media enable the rapid widespread of fake news, which can cause a series of negative impacts both on individuals and society. Early detection of fake news is essential to minimize its social harm. Existing machine learning approaches are incapable of detecting a fake news story soon after it starts to spread, because they require certain amounts of data to reach decent effectiveness which take time to accumulate. To solve this problem, this research first analyzes and finds that, on social media, the user characteristics of fake news spreaders distribute significantly differently from those …


Towards Interpretable Machine Learning With Applications To Clinical Decision Support, Zhicheng Cui Dec 2019

Towards Interpretable Machine Learning With Applications To Clinical Decision Support, Zhicheng Cui

McKelvey School of Engineering Graduate Student Theses & Dissertations

Machine learning models have achieved impressive predictive performance in various applications such as image classification and object recognition. However, understanding how machine learning models make decisions is essential when deploying those models in critical areas such as clinical prediction and market analysis, where prediction accuracy is not the only concern. For example, in the clinical prediction of ICU transfers, in addition to accurate predictions, doctors need to know the contributing factors that triggered the alert, which factors can be quickly altered to prevent the ICU transfer. While interpretable machine learning has been extensively studied for years, challenges remain as among …


Graph Deep Learning: Methods And Applications, Muhan Zhang Dec 2019

Graph Deep Learning: Methods And Applications, Muhan Zhang

McKelvey School of Engineering Graduate Student Theses & Dissertations

The past few years have seen the growing prevalence of deep neural networks on various application domains including image processing, computer vision, speech recognition, machine translation, self-driving cars, game playing, social networks, bioinformatics, and healthcare etc. Due to the broad applications and strong performance, deep learning, a subfield of machine learning and artificial intelligence, is changing everyone's life.Graph learning has been another hot field among the machine learning and data mining communities, which learns knowledge from graph-structured data. Examples of graph learning range from social network analysis such as community detection and link prediction, to relational machine learning such as …


Computational Screening Of New Perovskite Materials Using Transfer Learning And Deep Learning, Xiang Li, Yabo Dan, Rongzhi Dong, Zhuo Cao, Chengcheng Niu, Yuqi Song, Shaobo Li, Jianjun Hu Dec 2019

Computational Screening Of New Perovskite Materials Using Transfer Learning And Deep Learning, Xiang Li, Yabo Dan, Rongzhi Dong, Zhuo Cao, Chengcheng Niu, Yuqi Song, Shaobo Li, Jianjun Hu

Faculty Publications

As one of the most studied materials, perovskites exhibit a wealth of superior properties that lead to diverse applications. Computational prediction of novel stable perovskite structures has big potential in the discovery of new materials for solar panels, superconductors, thermal electric, and catalytic materials, etc. By addressing one of the key obstacles of machine learning based materials discovery, the lack of sufficient training data, this paper proposes a transfer learning based approach that exploits the high accuracy of the machine learning model trained with physics-informed structural and elemental descriptors. This gradient boosting regressor model (the transfer learning model) allows us …


Research And Implementation Of Driving Concern Area Detection Based On Deep Learning, Jihua Ye, Shuxia Shi, Hanxi Li, Shimin Wang, Siyu Yang Dec 2019

Research And Implementation Of Driving Concern Area Detection Based On Deep Learning, Jihua Ye, Shuxia Shi, Hanxi Li, Shimin Wang, Siyu Yang

Journal of System Simulation

Abstract: As a key technology of intelligent driving, driving concern area detection method has an important impact on the performance of intelligent driving or intelligent early warning system. In view of the shortcomings of the existing methods, this paper proposes an effective method for driving concern area detection based on the deep learning. We obtain the camera internal and external parameters by using camera self-calibration method based on camera model, use the Canny edge detection and Bisecting K-means clustering to realize the vanishing point estimation, and establish the road detection model based on the obtained estimates. We obtain the depth …


Comprehensive Study Of Generative Methods On Drug Discovery, Siyu Xiu Dec 2019

Comprehensive Study Of Generative Methods On Drug Discovery, Siyu Xiu

Computer Science and Engineering Theses - Archive

Observing the recent success of the deep learning (DL) technology in multiple life-changing application areas, e.g., autonomous driving, image/video search and discovery, natural language processing, etc., many new opportunities have presented themselves. One of the biggest ones lies in applying DL in accelerating the drug discovery, where millions of human lives could potentially be saved. However, applying DL into the drug discovery task turns out to be non-trivial. The most successful DL methods take fix-sized tensors/matrices, e.g., images, or sequences of tokens, e.g., sentences with variant numbers of words, as their inputs. However, none of these registers with the inputs …


Feature Extraction In Noise-Diverse Environments For Human Activities Recognition Using Wi-Fi, Sheheryar Arshad Dec 2019

Feature Extraction In Noise-Diverse Environments For Human Activities Recognition Using Wi-Fi, Sheheryar Arshad

Computer Science and Engineering Dissertations - Archive

With the rapid development of 802.11 standard and Internet of Things (IoT) applications, Wi-Fi (IEEE 802.11) has emerged as the most widely used wireless communication technology. Wi-Fi based sensing has found widespread use cases involving activity recognition, indoor localization, design of smart spaces and in healthcare applications. This dissertation presents the study of human activities’ sensing and recognition using channel state information (CSI) of Wi-Fi. We highlight the limitations of existing methods and consequently design the frameworks for collecting stable CSI and monitoring different indoor and outdoor environments for human activities. Specifically, this dissertation provide means to define and extract …


Deep Representation Learning For Clustering And Domain Adaptation, Mohsen Kheirandishfard Dec 2019

Deep Representation Learning For Clustering And Domain Adaptation, Mohsen Kheirandishfard

Computer Science and Engineering Dissertations - Archive

Representation learning is a fundamental task in the area of machine learning which can significantly influence the performance of the algorithms used in various applications. The main goal of this task is to capture the relationships between the input data and learn feature representations that contain the most useful information of the original data. Such representations can be further leveraged in many machine learning applications such as clustering, natural language analysis, recommender systems, etc. In this dissertation, we first present a theoretical framework for solving a broad class of non-convex optimization problems. The proposed method is applicable to various tasks …


Seer: An Explainable Deep Learning Midi-Based Hybrid Song Recommender System, Khalil Damak, Olfa Nasraoui Dec 2019

Seer: An Explainable Deep Learning Midi-Based Hybrid Song Recommender System, Khalil Damak, Olfa Nasraoui

Faculty and Staff Scholarship

State of the art music recommender systems mainly rely on either matrix factorization-based collaborative filtering approaches or deep learning architectures. Deep learning models usually use metadata for content-based filtering or predict the next user interaction by learning from temporal sequences of user actions. Despite advances in deep learning for song recommendation, none has taken advantage of the sequential nature of songs by learning sequence models that are based on content. Aside from the importance of prediction accuracy, other significant aspects are important, such as explainability and solving the cold start problem. In this work, we propose a hybrid deep learning …


Detecting Phone-Related Pedestrian Behavior Using A Two-Branch Convolutional Neural Network, Humberto Saenz Dec 2019

Detecting Phone-Related Pedestrian Behavior Using A Two-Branch Convolutional Neural Network, Humberto Saenz

Theses and Dissertations

With the wide use of smart phones, distraction has become a major safety concern to roadway users. The distracted phone-use behaviors among pedestrians, like Texting, Game Playing and Phone Calls, have caused increasing fatalities and serious injuries. With the increasing usage of driver monitor systems on intelligent vehicles, distracted driver behaviors can be efficiently detected and warned. However, the research of phone-related distracted behavior by pedestrians has not been systemically studied. It is desired to improve both the driving and pedestrian safety by automatically discovering the phone-related pedestrian distracted behaviors. In this thesis, we propose a new computer vision-based method …


Identifying Regional Trends In Avatar Customization, Peter Mawhorter, Sercan Sengun, Haewoon Kwak, D. Fox Harrell Dec 2019

Identifying Regional Trends In Avatar Customization, Peter Mawhorter, Sercan Sengun, Haewoon Kwak, D. Fox Harrell

Research Collection School Of Computing and Information Systems

Since virtual identities such as social media profiles and avatars have become a common venue for self-expression, it has become important to consider the ways in which existing systems embed the values of their designers. In order to design virtual identity systems that reflect the needs and preferences of diverse users, understanding how the virtual identity construction differs between groups is important. This paper presents a new methodology that leverages deep learning and differential clustering for comparative analysis of profile images, with a case study of almost 100 000 avatars from a large online community using a popular avatar creation …


Falcon: Framework For Anomaly Detection In Industrial Control Systems, Subin Sapkota Dec 2019

Falcon: Framework For Anomaly Detection In Industrial Control Systems, Subin Sapkota

Boise State University Theses and Dissertations

Industrial Control Systems (ICS) are used to control physical processes in the nation's critical infrastructures. They are composed of subsystems that control physical processes by analyzing the information received from the sensors. Based on the state of the process, the controller issues control commands to the actuators. These systems are utilized in a wide variety of operations such as water treatment plants, power, and manufacturing, etc. While the safety and security of these systems are of high concern, recent reports have shown an increase in targeted attacks that are aimed at manipulating the physical processes to cause catastrophic consequences. This …


Social Media Sentiment Analysis With A Deep Neural Network: An Enhanced Approach Using User Behavioral Information, Ahmed Sulaiman M. Alharbi Dec 2019

Social Media Sentiment Analysis With A Deep Neural Network: An Enhanced Approach Using User Behavioral Information, Ahmed Sulaiman M. Alharbi

Dissertations

Sentiment analysis on social media such as Twitter has become a very important and challenging task. Due to the characteristics of such data (including tweet length, spelling errors, abbreviations, and special characters), the sentiment analysis task in such an environment requires a non-traditional approach. Moreover, social media sentiment analysis constitutes a fundamental problem with many interesting applications, such as for Business Intelligence, Medical Monitoring, and National Security. Most current social media sentiment classification methods judge the sentiment polarity primarily according to textual content and neglect other information on these platforms. In this research, we propose deep learning based frameworks that …


Learning To Detect Pedestrians By Watching Videos, Andrew Y. Chen Dec 2019

Learning To Detect Pedestrians By Watching Videos, Andrew Y. Chen

Theses and Dissertations

The field of deep learning has experienced a resurgence in the recent years, particularly resulting with the advent of AlexNet. Supervised learning is currently the most common and practical machine learning method. The struggle with employing supervised learning to approach problems is that it requires training data. Sufficient training data is correlated with performance for deep learning models. The issue is that preparing the training data can be a tedious and labor intensive task, especially on a large scale. The purpose of this paper is to determine how efficient a machine can learn when trained on automatically annotated data. The …


Deep Learning (Partly) Demystified, Vladik Kreinovich, Olga Kosheleva Nov 2019

Deep Learning (Partly) Demystified, Vladik Kreinovich, Olga Kosheleva

Departmental Technical Reports (CS)

Successes of deep learning are partly due to appropriate selection of activation function, pooling functions, etc. Most of these choices have been made based on empirical comparison and heuristic ideas. In this paper, we show that many of these choices -- and the surprising success of deep learning in the first place -- can be explained by reasonably simple and natural mathematics.


Detecting Digitally Forged Faces In Online Videos, Neilesh Sambhu Oct 2019

Detecting Digitally Forged Faces In Online Videos, Neilesh Sambhu

USF Tampa Graduate Theses and Dissertations

We use Rossler’s FaceForensics dataset of 1004 online videos and their corresponding forged counterparts [1] to investigate the ability to distinguish digitally forged facial images from original images automatically with deep learning. The proposed convolutional neural network is much smaller than the current state-of-the-art solutions. Nevertheless, the network maintains a high level of accuracy (99.6%), all while using the entire FaceForensics dataset and not including any temporal information. We implement majority voting and show the impact on accuracy (99.67%), where only 1 video of 300 is misclassified. We examine why the model misclassified this one video. In terms of tuning …


Deep Neural Network Based Iterative Self-Taught Learning On Text Mining, Xiangwen Liu Oct 2019

Deep Neural Network Based Iterative Self-Taught Learning On Text Mining, Xiangwen Liu

Theses and Dissertations

[Motivation] Machine learning and deep learning models is the main methodology for discovering hidden knowledge of data. Data plays a significant role in the training process. However, lack of data especially labeled data is precious due to accessibility and high cost. How to use the abundant unlabeled data to enhance the downstream learning process on labeled data is an urgent task in machine learning and pattern recognition. [Methods] An STL (Self-taught learning) model is proposed in this dissertation, which can successfully learn features from downloaded unlabeled text and enhance the downstream tasks on labeled text. In addition, DLI-IT (Drug labeling …