Computer Engineering Commons^™

Video Action Recognition Based On Key-Frame, Mingxiao Li, Qichuan Geng, Mo Hong, Wu Wei, Zhou Zhong

Journal of System Simulation

Abstract: Video action recognition is an important part of intelligent video analysis. In recent years, deep learning methods, especially the two-stream convolutional neural network achieved the state-of-the-art performance. However, most methods simply use uniform sampling to get frames, which may cause the loss of information in sampling interval. We propose a segmentation method and a key-frame extraction method for video action recognition, and combine them with a multi-temporal-scale two-stream network. Our framework achieves a 94.2% accuracy at UCF101 split1, which is the same as the state-of-the-art method’s performance.

A Horizon Detection Method Based On Deep Learning And Random Forest, Jihua Ye, Shuxia Shi, Hanxi Li, Jiali Zuo, Shimin Wang

Journal of System Simulation

Abstract: The detection effect of existing horizon line detection methods is greatly affected by the environment, and the computational complexity is high. Aiming at the problem of horizon line detection in complex road scene in real-life, a horizon line detection method based on deep learning and random forest is proposed. The deep learning model is used to extract the depth features, then the obtained depth features are used for random forest training. The results of horizon line detection are obtained by random forest regression-voting. The simulation results show that this method has good detection effect. The detection results are not …

Traffic Flow Prediction Based On Deep Learning, Mingyu Liu, Jianping Wu, Yubo Wang, He Lei

Journal of System Simulation

Abstract: Traffic flow prediction is an important component of urban intelligent transportation system. With the development of machine learning and artificial intelligence, deep learning has been applied in traffic engineering area. Gated recurrent unit (GRU) neural network is selected to predict urban traffic flow. Cross-validation method is used to explore the optimal number of gated recurrent units. The GRU model is compared with other three predictors such as support vector regression and evaluated in different performance measurements. The results show that GRU model has better performance in traffic flow prediction than the other three models.

Research On Evaluation Framework Of Coa Based On Wargaming, Haiyang Liu, Yubo Tang, Xiaofeng Hu, Guangpeng Qiao

Journal of System Simulation

Abstract: Aiming at the evaluation problem of COA (course of action) level indicators in joint operation, an evaluation framework of COA based on wargaming was proposed. By multidimensional analysis of wargaming data, an evaluation feature space was constructed from basic features generated by data cube models and SoS (system of systems) features based on complex network. Wargaming experiments were used to generate small batch metrics results of COA level indicators, and the corresponding result labels of evaluation feature space data were generated by data fitting method. Two-phase correlation analysis was used for dimensionality reduction of high dimensional evaluation features. …

Visual Object Tracking Algorithm Based On Deep Denoising Autoencoder Over Rgb-D Data, Mingxin Jiang, Zhigeng Pan, Lanfang Wang, Taoxin Hu

Journal of System Simulation

Abstract: A visual object tracking algorithm based on cross-modality features deep learning over RGB-D data is proposed. A sparse denoising autoencoder deep learning network is constructed, which can extract cross-modal features of the samples in RGB-D video data. The cross-modal features of the samples are input to the logistic regression classifier, the observation likelihood model is established according to the confidence score of the classifier, and the reasonable state transition model is established. The object tracking results over RGB-D data are obtained using particle filtering algorithm. Experimental results show that the proposed method has strong robustness to abnormal changes. …

A Model For Battlefield Situation Change Rate Prediction Based On Deep Learning, Jiuyang Tao, Wu Lin, Wang Chi, Junda Chu, Liao Ying, Zhu Feng

Journal of System Simulation

Abstract: To measure and estimate the uncertainty of the battlefield situation is of great significance for the commanders to plan the reconnaissance mission and reduce the risk of decision-making. Based on Shannon's information theory, firstly, methods and a model on measurement of situation change rate are proposed. Secondly, a scene with two-dimensional grid elements maneuvering is established, based on deep learning, the prediction method for maneuvering trend is explored. It is proved that cross entropy is equivalent to situation change rate. Finally, with the increase of the objective uncertainty, situation change rate and the accuracy of the forecast is …

Multi-Sensory Deep Learning Architectures For Slam Dunk Scene Classification, Paul Minogue

Dissertations

Basketball teams at all levels of the game invest a considerable amount of time and effort into collecting, segmenting, and analysing footage from their upcoming opponents previous games. This analysis helps teams identify and exploit the potential weaknesses of their opponents and is commonly cited as one of the key elements required to achieve success in the modern game. The growing importance of this type of analysis has prompted research into the application of computer vision and audio classification techniques to help teams classify scoring sequences and key events using game footage. However, this research tends to focus on classifying …

Communications Using Deep Learning Techniques, Priti Gopal Pachpande

Legacy Theses & Dissertations (2009 - 2024)

Deep learning (DL) techniques have the potential of making communication systems

Novel Applications Of Machine Learning In Bioinformatics, Yi Zhang

Theses and Dissertations--Computer Science

Technological advances in next-generation sequencing and biomedical imaging have led to a rapid increase in biomedical data dimension and acquisition rate, which is challenging the conventional data analysis strategies. Modern machine learning techniques promise to leverage large data sets for finding hidden patterns within them, and for making accurate predictions. This dissertation aims to design novel machine learning-based models to transform biomedical big data into valuable biological insights. The research presented in this dissertation focuses on three bioinformatics domains: splice junction classification, gene regulatory network reconstruction, and lesion detection in mammograms.

A critical step in defining gene structures and mRNA …

An Explainable Autoencoder For Collaborative Filtering Recommendation, Pegah Sagheb Haghighi, Olurotimi Seton, Olfa Nasraoui

Faculty and Staff Scholarship

Autoencoders are a common building block of Deep Learning architectures, where they are mainly used for representation learning. They have also been successfully used in Collaborative Filtering (CF) recommender systems to predict missing ratings. Unfortunately, like all black box machine learning models, they are unable to explain their outputs. Hence, while predictions from an Autoencoderbased recommender system might be accurate, it might not be clear to the user why a recommendation was generated. In this work, we design an explainable recommendation system using an Autoencoder model whose predictions can be explained using the neighborhood based explanation style. Our preliminary work …

Multi-Pig Part Detection And Association With A Fully-Convolutional Network, Eric T. Psota, Mateusz Mittek, Lance C. Pérez, Ty Schmidt, Benny Mote

Department of Electrical and Computer Engineering: Faculty Publications

Computer vision systems have the potential to provide automated, non-invasive monitoring of livestock animals, however, the lack of public datasets with well-defined targets and evaluation metrics presents a significant challenge for researchers. Consequently, existing solutions often focus on achieving task-specific objectives using relatively small, private datasets. This work introduces a new dataset and method for instance-level detection of multiple pigs in group-housed environments. The method uses a single fully-convolutional neural network to detect the location and orientation of each animal, where both body part locations and pairwise associations are represented in the image space. Accompanying this method is a new …

Lung Segmentation In Chest Radiographs Using Fully Convolutional Networks, Rahul Hooda, Ajay Mittal, Sanjeev Sofat

Turkish Journal of Electrical Engineering and Computer Sciences

Automated segmentation of medical images that aims at extracting anatomical boundaries is a fundamental step in any computer-aided diagnosis (CAD) system. Chest radiographic CAD systems, which are used to detect pulmonary diseases, first segment the lung field to precisely define the region-of-interest from which radiographic patterns are sought. In this paper, a deep learning-based method for segmenting lung fields from chest radiographs has been proposed. Several modifications in the fully convolutional network, which is used for segmenting natural images to date, have been attempted and evaluated to finally evolve a network fine-tuned for segmenting lung fields. The testing accuracy and …

Elimination Of Useless Images From Raw Camera-Trap Data, Ulaş Tekeli̇, Yalin Baştanlar

Turkish Journal of Electrical Engineering and Computer Sciences

Camera-traps are motion triggered cameras that are used to observe animals in nature. The number of images collected from camera-traps has increased significantly with the widening use of camera-traps thanks to advances in digital technology. A great workload is required for wild-life researchers to group and label these images. We propose a system to decrease the amount of time spent by the researchers by eliminating useless images from raw camera-trap data. These images are too bright, too dark, blurred, or they contain no animals. To eliminate bright, dark, and blurred images we employ techniques based on image histograms and fast …

Enhancing Face Pose Normalization With Deep Learning, Anil Çeli̇k, Nafi̇z Arica

Turkish Journal of Electrical Engineering and Computer Sciences

In this study, we propose a hybrid method for face pose normalization, which combines the 3-D model-based method with stacked denoising autoencoder (SDAE) deep network. Instead of applying a mirroring operation for the invisible face parts of the posed image, SDAE learns how to fill in those regions by a large set of training samples. In the performance evaluation, we compare the proposed method to four different pose normalization methods and investigate their effects on facial emotion recognition and verification problems in addition to visual quality tests. Methods evaluated in the experiments include 2-D alignment, 3-D model-based method, pure SDAE-based …

Improving Word Embeddings Projection For Turkish Hypernym Extraction, Savaş Yildirim

Turkish Journal of Electrical Engineering and Computer Sciences

Corpus-driven approaches can automatically explore is-a relations between the word pairs from corpus. This problem is also called hypernym extraction. Formerly, lexico-syntactic patterns have been used to solve hypernym relations. The language-specific syntactic rules have been manually crafted to build the patterns. On the other hand, recent studies have applied distributional approaches to word semantics. They extracted the semantic relations relying on the idea that similar words share similar contexts. Former distributional approaches have applied one-hot bag-of-word (BOW) encoding. The dimensionality problem of BOW has been solved by various neural network approaches, which represent words in very short and dense …

Computational Intelligence In Steganography: Adaptive Image Watermarking, Xin Zhong

Dissertations

Digital image watermarking, as an extension of traditional steganography, refers to the process of hiding certain messages into cover images. The transport image, called marked-image or stego-image, conveys the hidden messages while appears visibly similar to the cover-image. Therefore, image watermarking enables various applications such as copyright protection and covert communication. In a watermarking scheme, fidelity, capacity and robustness are considered as crucial factors, where fidelity measures the similarity between the cover- and marked-images, capacity measures the maximum amount of watermark that can be embedded, and robustness concerns the watermark extraction under attacks on the marked-image. Watermarking techniques are often …

Sensor-Based Human Activity Recognition Using Bidirectional Lstm For Closely Related Activities, Arumugam Thendramil Pavai

Electronic Theses, Projects, and Dissertations

Recognizing human activities using deep learning methods has significance in many fields such as sports, motion tracking, surveillance, healthcare and robotics. Inertial sensors comprising of accelerometers and gyroscopes are commonly used for sensor based HAR. In this study, a Bidirectional Long Short-Term Memory (BLSTM) approach is explored for human activity recognition and classification for closely related activities on a body worn inertial sensor data that is provided by the UTD-MHAD dataset. The BLSTM model of this study could achieve an overall accuracy of 98.05% for 15 different activities and 90.87% for 27 different activities performed by 8 persons with 4 …

Datanet: Deep Learning Based Encrypted Network Traffic Classification In Sdn Home Gateway, Pan Wang, Feng Ye, Xuejiao Chen, Yi Qian

Department of Electrical and Computer Engineering: Faculty Publications

A smart home network will support various smart devices and applications, e.g., home automation devices, E-health devices, regular computing devices, and so on. Most devices in a smart home access the Internet through a home gateway (HGW). In this paper, we propose a software-defined network (SDN)-HGW framework to better manage distributed smart home networks and support the SDN controller of the core network. The SDN controller enables efficient network quality-of-service management based on real-time traffic monitoring and resource allocation of the core network. However, it cannot provide network management in distributed smart homes. Our proposed SDN-HGW extends the control to …

End-To-End Convolutional Neural Network Model For Gear Fault Diagnosis Based On Sound Signals, Yong Yao, Honglei Wang, Shaobo Li, Zhongnhao Liu, Gui Gui, Yabo Dan, Jianjun Hu

Faculty Publications

Currently gear fault diagnosis is mainly based on vibration signals with a few studies on acoustic signal analysis. However, vibration signal acquisition is limited by its contact measuring while traditional acoustic-based gear fault diagnosis relies heavily on prior knowledge of signal processing techniques and diagnostic expertise. In this paper, a novel deep learning-based gear fault diagnosis method is proposed based on sound signal analysis. By establishing an end-to-end convolutional neural network (CNN), the time and frequency domain signals can be fed into the model as raw signals without feature engineering. Moreover, multi-channel information from different microphones can also be fused …

Real-Time Non-Contact Road Defect Detection Using Inexpensive Sensors, Zhao Xing Lim, Mohammad Jahanshahi, Tarutal Ghosh Mondal, Da Cheng, Shutao Wang, Mohammad K. Sweidan, Aanis Ahmad, Omar Hesham Abouhussein, Xi Chen

The Summer Undergraduate Research Fellowship (SURF) Symposium

Road defects such as potholes, humps, and road cracks have become one of the main concerns for road and traffic safety worldwide. Pavement defect detection is crucial to ensure road safety. However, current solutions to this problem are either too time-consuming or too expensive to be employed large-scale. We propose a novel approach which has the ability to autonomously detect potholes in real-time using cost-effective sensors. Inexpensive sensors are mounted on a vehicle and a deep learning algorithm is used to identify road defects. The detection system is paired with a GPS and positional sensors to map the location of …

Apple Flower Detection Using Deep Convolutional Networks, Philipe A. Dias, Amy Tabb, Henry P. Medeiros

Electrical and Computer Engineering Faculty Research and Publications

To optimize fruit production, a portion of the flowers and fruitlets of apple trees must be removed early in the growing season. The proportion to be removed is determined by the bloom intensity, i.e., the number of flowers present in the orchard. Several automated computer vision systems have been proposed to estimate bloom intensity, but their overall performance is still far from satisfactory even in relatively controlled environments. With the goal of devising a technique for flower identification which is robust to clutter and to changes in illumination, this paper presents a method in which a pre-trained convolutional neural network …

End-To-End Learning Framework For Circular Rna Classification From Other Long Non-Coding Rnas Using Multi-Modal Deep Learning., Mohamed Chaabane

Electronic Theses and Dissertations

Over the past two decades, a circular form of RNA (circular RNA) produced from splicing mechanism has become the focus of scientific studies due to its major role as a microRNA (miR) ac tivity modulator and its association with various diseases including cancer. Therefore, the detection of circular RNAs is a vital operation for continued comprehension of their biogenesis and purpose. Prediction of circular RNA can be achieved by first distinguishing non-coding RNAs from protein coding gene transcripts, separating short and long non-coding RNAs (lncRNAs), and finally pre dicting circular RNAs from other lncRNAs. However, available tools to distinguish circular …

A Qualitative Research On Marketing And Sales In The Artificial Intelligence Age, Yin Yang, Keng Siau

Research Collection School Of Computing and Information Systems

The age of artificial intelligence is here! Artificial Intelligence, robotics, machine learning, and automation are impacting the field of marketing and sales in an unprecedented way. In this study, the qualitative research methodology will be used to better understand the revolution and evolution of marketing and sales field in the AI age. Multiple case studies will be performed in various marketing and sales units in different organizations. This research is of value to both academics and practitioners as it aims to provide a detailed analysis and documentation of the changes in marketing and sales functionalities and job markets as AI …

Comparative Study Of Deep Learning Models For Network Intrusion Detection, Brian Lee, Sandhya Amaresh, Clifford Green, Daniel Engels

SMU Data Science Review

In this paper, we present a comparative evaluation of deep learning approaches to network intrusion detection. A Network Intrusion Detection System (NIDS) is a critical component of every Internet connected system due to likely attacks from both external and internal sources. A NIDS is used to detect network born attacks such as Denial of Service (DoS) attacks, malware replication, and intruders that are operating within the system. Multiple deep learning approaches have been proposed for intrusion detection systems. We evaluate three models, a vanilla deep neural net (DNN), self-taught learning (STL) approach, and Recurrent Neural Network (RNN) based Long Short …

Patent Keyword Extraction Algorithm Based On Distributed Representation For Patent Classification, Jie Hu, Shaobo Li, Yong Yao, Liya Yu, Guanci Yang, Jianjun Hu

Faculty Publications

Many text mining tasks such as text retrieval, text summarization, and text comparisons depend on the extraction of representative keywords from the main text. Most existing keyword extraction algorithms are based on discrete bag-of-words type of word representation of the text. In this paper, we propose a patent keyword extraction algorithm (PKEA) based on the distributed Skip-gram model for patent classification. We also develop a set of quantitative performance measures for keyword extraction evaluation based on information gain and cross-validation, based on Support Vector Machine (SVM) classification, which are valuable when human-annotated keywords are not available. We used a standard …

Adapt At Semeval-2018 Task 9: Skip-Gram Word Embeddings For Unsupervised Hypernym Discovery In Specialised Corpora, Alfredo Maldonado, Filip Klubicka

Other resources

This paper describes a simple but competitive unsupervised system for hypernym discovery. The system uses skip-gram word embeddings with negative sampling, trained on specialised corpora. Candidate hypernyms for an input word are predicted based on cosine similar- ity scores. Two sets of word embedding mod- els were trained separately on two specialised corpora: a medical corpus and a music indus- try corpus. Our system scored highest in the medical domain among the competing unsu- pervised systems but performed poorly on the music industry domain. Our approach does not depend on any external data other than raw specialised corpora.

Deep Recurrent Learning For Efficient Image Recognition Using Small Data, Mahbubul Alam

Electrical & Computer Engineering Theses & Dissertations

Recognition is fundamental yet open and challenging problem in computer vision. Recognition involves the detection and interpretation of complex shapes of objects or persons from previous encounters or knowledge. Biological systems are considered as the most powerful, robust and generalized recognition models. The recent success of learning based mathematical models known as artificial neural networks, especially deep neural networks, have propelled researchers to utilize such architectures for developing bio-inspired computational recognition models. However, the computational complexity of these models increases proportionally to the challenges posed by the recognition problem, and more importantly, these models require a large amount of data …

Beef Cattle Instance Segmentation Using Mask R-Convolutional Neural Network, Mohammad Danish

Dissertations

Maintaining the cattle farm along with the wellbeing of every heifer has been the major concern in dairy farm. A robust system is required which can tackle the problem of continuous monitoring of cows. the computer vision techniques provide a new way to understand the challenges related to the identification and welfare of the cows. This paper presents a state-of-art instance segmentation mask RCNN algorithm to train and build a model on a very challenging cow dataset that is captured during the winter season. The dataset poses many challenges such as overlapping of cows, partial occlusion, similarity between cows and …

Review Of Deep Learning Methods In Robotic Grasp Detection, Shehan Caldera, Alexander Rassau, Douglas Chai

Research outputs 2014 to 2021

For robots to attain more general-purpose utility, grasping is a necessary skill to master. Such general-purpose robots may use their perception abilities to visually identify grasps for a given object. A grasp describes how a robotic end-effector can be arranged to securely grab an object and successfully lift it without slippage. Traditionally, grasp detection requires expert human knowledge to analytically form the task-specific algorithm, but this is an arduous and time-consuming approach. During the last five years, deep learning methods have enabled significant advancements in robotic vision, natural language processing, and automated driving applications. The successful results of these methods …

Estimating Left Ventricular Volume With Roi-Based Convolutional Neural Network, Feng Zhu

Turkish Journal of Electrical Engineering and Computer Sciences

The volume of the human left ventricular (LV) chamber is an important indicator for diagnosing heart disease. Although LV volume can be measured manually with cardiac magnetic resonance imaging (MRI), the process is difficult and time-consuming for experienced cardiologists. This paper presents an end-to-end segmentation-free method that estimates LV volume from MRI images directly. The method initially uses Fourier transform and a regression filter to calculate the region of interest that contains the LV chambers. Then convolutional neural networks are trained to estimate the end-diastolic volume (EDV) and end-systolic volume (ESV). The resulting models accurately estimate the EDV and ESV …