Digital Commons Network^™

Computer Vision Gesture Recognition For Rock Paper Scissors, Nicholas Hunter

Senior Independent Study Theses

This project implements a human versus computer game of rock-paper-scissors using machine learning and computer vision. Player’s hand gestures are detected using single images with the YOLOv3 object detection system. This provides a generalized detection method which can recognize player moves without the need for a special background or lighting setup. Additionally, past moves are examined in context to predict the most probable next move of the system’s opponent. In this way, the system achieves higher win rates against human opponents than by using a purely random strategy.

Invariance And Invertibility In Deep Neural Networks, Han Zhang

Theses and Dissertations

Machine learning is concerned with computer systems that learn from data instead of being explicitly programmed to solve a particular task. One of the main approaches behind recent advances in machine learning involves neural networks with a large number of layers, often referred to as deep learning. In this dissertation, we study how to equip deep neural networks with two useful properties: invariance and invertibility. The first part of our work is focused on constructing neural networks that are invariant to certain transformations in the input, that is, some outputs of the network stay the same even if the input …

Deep Learning For Digitized Histology Image Analysis, Sudhir Sornapudi

Doctoral Dissertations

“Cervical cancer is the fourth most frequent cancer that affects women worldwide. Assessment of cervical intraepithelial neoplasia (CIN) through histopathology remains as the standard for absolute determination of cancer. The examination of tissue samples under a microscope requires considerable time and effort from expert pathologists. There is a need to design an automated tool to assist pathologists for digitized histology slide analysis. Pre-cervical cancer is generally determined by examining the CIN which is the growth of atypical cells from the basement membrane (bottom) to the top of the epithelium. It has four grades, including: Normal, CIN1, CIN2, and CIN3. In …

Detecting Phone-Related Pedestrian Distracted Behaviours Via A Two-Branch Convolutional Neural Network, Humberto Saenz, Huiming Sun, Lingtao Wu, Xuesong Zhou, Hongkai Yu

Computer Science Faculty Publications

The distracted phone-use behaviours among pedestrians, like Texting, Game Playing and Phone Calls, have caused increasing fatalities and injuries. However, the research of phonerelated distracted behaviour by pedestrians has not been systemically studied. It is desired to improve both the driving and pedestrian safety by automatically discovering the phonerelated pedestrian distracted behaviours. Herein, a new computer vision-based method is proposed to detect the phone-related pedestrian distracted behaviours from a view of intelligent and autonomous driving. Specifically, the first end-to-end deep learning based Two-Branch Convolutional Neural Network (CNN) is designed for this task. Taking one synchronised image pair by two front …

An Intra-Severity Classification And Adaptation Technique To Improve Dysarthric Speech Recognition Accuracy, Al-Qatab Bassam Ali Qasem

Student Works (2020-2029)

Dysarthria is a motor speech impairment at the neurological and/or muscular levels that caused difficulty in pronouncing words clearly. Automatic speech recognition (ASR) system is increasingly applied as assistive technology to aid an individual with physical disability particularly the speech impaired community such as dysarthria speakers. However, the development of an effective ASR system is hindered by the data sparsity, either in the coverage of the language or the size of the existing speech databases. The speaker adaptation (SA) technique is one of the solutions to overcome the data sparsity issue of ASR for dysarthric speakers. Our proposed method introduces …

Landing Throttleable Hybrid Rockets With Hierarchical Reinforcement Learning In A Simulated Environment, Francesco Alessandro Stefano Mikulis-Borsoi

Honors Theses and Capstones

In this paper, I develop a hierarchical Markov Decision Process (MDP) structure for completing the task of vertical rocket landing. I start by covering the background of this problem, and formally defining its constraints. In order to reduce mistakes while formulating different MDPs, I define and develop the criteria for a standardized MDP definition format. I then decompose the problem into several sub-problems of vertical landing, namely velocity control and vertical stability control. By exploiting MDP coupling and symmetrical properties, I am able to significantly reduce the size of the state space compared to a unified MDP formulation. This paper …

Local Binary Pattern Based Algorithms For The Discrimination And Detection Of Crops And Weeds With Similar Morphologies, Vi Nguyen Thanh Le

Theses: Doctorates and Masters

In cultivated agricultural fields, weeds are unwanted species that compete with the crop plants for nutrients, water, sunlight and soil, thus constraining their growth. Applying new real-time weed detection and spraying technologies to agriculture would enhance current farming practices, leading to higher crop yields and lower production costs. Various weed detection methods have been developed for Site-Specific Weed Management (SSWM) aimed at maximising the crop yield through efficient control of weeds. Blanket application of herbicide chemicals is currently the most popular weed eradication practice in weed management and weed invasion. However, the excessive use of herbicides has a detrimental impact …

Feature Extraction And Description For Retinal Fundus Image Registration, Ramli Roziana

Student Works (2020-2029)

Retinal fundus image registration (RIR) is performed to align two or more fundus images. A general framework of a feature-based RIR technique comprises of preprocessing, feature extraction, feature descriptor, matching and estimating geometrical transformation. The RIR is mainly performed for super-resolution, image mosaicking and longitudinal study applications to assist diagnosis and monitoring retinal diseases. Registering image pair from these applications involve a combination of challenges such as overlapping area and rotation between images. The challenges of the overlapping area and rotation can be addressed at feature extraction and feature descriptor stages of the feature-based RIR technique, respectively. To address the …

The Evolving Fuzzy Clustering Approach For Discriminating Neutron And Gamma-Ray Pulses, Shirkhorshidi Ali Seyed

Student Works (2020-2029)

Having a significant amount of data is not useful unless the data can be processed for extracting knowledge and information. One of the elementary steps in crunching data is to break it down into groups. When the data is small and collected in a controlled manner, and when the training data is appropriately labelled, the trivial approach is to use supervised learning to perform the grouping. Supervised methods need training data and information about groups beforehand; however, in the current reality, with an avalanche of data, this information is not available. Nevertheless, the need for grouping data remains. Clustering, as …

Mutual Information Decay Curves And Hyper-Parameter Grid Search Design For Recurrent Neural Architectures, Abhijit Mahalunkar, John Kelleher

Conference papers

We present an approach to design the grid searches for hyper-parameter optimization for recurrent neural architectures. The basis for this approach is the use of mutual information to analyze long distance dependencies (LDDs) within a dataset. We also report a set of experiments that demonstrate how using this approach, we obtain state-of-the-art results for DilatedRNNs across a range of benchmark datasets.

Multimodal Fusion Strategies For Outcome Prediction In Stroke, Esra Zihni, John D. Kelleher, Vince I. Madai, Ahmed Khalil, Ivana Galinovic, Jochen Fiebach, Michelle Livne, Dietmar Frey

Conference papers

Data driven methods are increasingly being adopted in the medical domain for clinical predictive modeling. Prediction of stroke outcome using machine learning could provide a decision support system for physicians to assist them in patient-oriented diagnosis and treatment. While patient-specific clinical parameters play an important role in outcome prediction, a multimodal fusion approach that integrates neuroimaging with clinical data has the potential to improve accuracy. This paper addresses two research questions: (a) does multimodal fusion aid in the prediction of stroke outcome, and (b) what fusion strategy is more suitable for the task at hand. The baselines for our experimental …

Language Model Co-Occurrence Linking For Interleaved Activity Discovery, Eoin Rogers, Robert J. Ross, John D. Kelleher

Conference papers

As ubiquitous computer and sensor systems become abundant, the potential for automatic identification and tracking of human behaviours becomes all the more evident. Annotating complex human behaviour datasets to achieve ground truth for supervised training can however be extremely labour-intensive, and error prone. One possible solution to this problem is activity discovery: the identification of activities in an unlabelled dataset by means of an unsupervised algorithm. This paper presents a novel approach to activity discovery that utilises deep learning based language production models to construct a hierarchical, tree-like structure over a sequential vector of sensor events. Our approach differs from …

Modelling Interleaved Activities Using Language Models, Eoin Rogers, Robert J. Ross, John D. Kelleher

Conference papers

We propose a new approach to activity discovery, based on the neural language modelling of streaming sensor events. Our approach proceeds in multiple stages: we build binary links between activities using probability distributions generated by a neural language model trained on the dataset, and combine the binary links to produce complex activities. We then use the activities as sensor events, allowing us to build complex hierarchies of activities. We put an emphasis on dealing with interleaving, which represents a major challenge for many existing activity discovery systems. The system is tested on a realistic dataset, demonstrating it as a promising …

The Ai Author In Litigation, Yvette Joy Liebesman, Julie Cromer Young

All Faculty Scholarship

Many scholars have posited whether a computer possessing Artificial Intelligence (AI) could be considered an author as defined per the Copyright Act of 1976. What was once a thought experiment is now becoming reality. To date, scholarship has focused primarily been on whether an AI meets the requirements of authorship from a purely objective legal framework or whether an AI could be an author based on the doctrines of incentives, independent creation, and creativity.

However, a burden inherent in the rights and liabilities of authorship is the ability to be held liable if that author’s expressive work is infringing on …

Accessibility Of Deepfakes, Andrew L. Collings

Cybersecurity Undergraduate Research Showcase

The danger posed by falsified media, commonly referred to as deepfakes, has been well researched and documented. The software Faceswap to was used to swap the faces of two politician (Joe Biden and Donald Trump). The testing was performed using an affordable consumer GPU (an AMD Radeon RX 570) over 100,000 iterations. The process and results for the two attempts with the best results (and largest differences) were recorded. The result was ultimately unconvincing, while the software was able to recreate the facial structure the lighting and skin tone did not blend at all.

Opening Books And The National Corpus Of Graduate Research, William A. Ingram, Edward A. Fox, Jian Wu

Computer Science Faculty Publications

Virginia Tech University Libraries, in collaboration with Virginia Tech Department of Computer Science and Old Dominion University Department of Computer Science, request $505,214 in grant funding for a 3-year project, the goal of which is to bring computational access to book-length documents, demonstrating that with Electronic Theses and Dissertations (ETDs). The project is motivated by the following library and community needs. (1) Despite huge volumes of book-length documents in digital libraries, there is a lack of models offering effective and efficient computational access to these long documents. (2) Nationwide open access services for ETDs generally function at the metadata level. …

Exploring Strategies For Adapting Traditional Vehicle Design Frameworks To Autonomous Vehicle Design, Alex Munoz

Walden Dissertations and Doctoral Studies

Fully autonomous vehicles are expected to revolutionize transportation, reduce the cost of ownership, contribute to a cleaner environment, and prevent the majority of traffic accidents and related fatalities. Even though promising approaches for achieving full autonomy exist, developers and manufacturers have to overcome a multitude of challenged before these systems could find widespread adoption. This multiple case study explored the strategies some IT hardware and software developers of self-driving cars use to adapt traditional vehicle design frameworks to address consumer and regulatory requirements in autonomous vehicle designs. The population consisted of autonomous driving technology software and hardware developers who are …

Customer And Employee Social Media Comments/Feedback And Stock Purchasing Decisions Enhanced By Sentiment Analysis, Drew Mikel Hall

Walden Dissertations and Doctoral Studies

The U.S. Securities and Exchange Commission (SEC) warns professional investors that sentiment analysis tools may lead to impulsive investment decision-making. This warning comes despite evidence showing that aided social sentiment investment decision tools can increase accurate investment decision-making by 18%. Using Fama's theory of efficient market hypothesis, the purpose of this quantitative correlational study was to examine whether customer Twitter comments and employee Glassdoor feedback sentiment predicted successful investing decisions measured by business stock prices. Two thousand records from 3 archival U.S. public NASDAQ 100 datasets from March 28, 2016, to June 15, 2016 (79 days) of 53 companies with …

Interpreting Health Events In Big Data Using Qualitative Traditions, Roschelle L. Fritz, Gordana Dermody

Research outputs 2014 to 2021

© The Author(s) 2020. The training of artificial intelligence requires integrating real-world context and mathematical computations. To achieve efficacious smart health artificial intelligence, contextual clinical knowledge serving as ground truth is required. Qualitative methods are well-suited to lend consistent and valid ground truth. In this methods article, we illustrate the use of qualitative descriptive methods for providing ground truth when training an intelligent agent to detect Restless Leg Syndrome. We show how one interdisciplinary, inter-methodological research team used both sensor-based data and the participant’s description of their experience with an episode of Restless Leg Syndrome for training the intelligent agent. …

Special Section Guest Editorial: Machine Learning In Optics, Jonathan Howe, Travis Axtell, Khan Iftekharuddin

Electrical & Computer Engineering Faculty Publications

This guest editorial summarizes the Special Section on Machine Learning in Optics.

Generative Adversarial Networks For Visible To Infrared Video Conversion, Mohammad Shahab Uddin, Jiang Li, Chiman Kwan (Ed.)

Electrical & Computer Engineering Faculty Publications

Deep learning models are data driven. For example, the most popular convolutional neural network (CNN) model used for image classification or object detection requires large labeled databases for training to achieve competitive performances. This requirement is not difficult to be satisfied in the visible domain since there are lots of labeled video and image databases available nowadays. However, given the less popularity of infrared (IR) camera, the availability of labeled infrared videos or image databases is limited. Therefore, training deep learning models in infrared domain is still challenging. In this chapter, we applied the pix2pix generative adversarial network (Pix2Pix GAN) …

Shipbuilding Supply Chain Framework And Digital Transformation: A Project Portfolios Risk Evaluation, Rafael Diaz, Katherine Smith, Rafael Landaeta, Antonio Padovano

VMASC Publications

Program portfolio managers in digital transformation programs have a need for knowledge that can guide decisions related to the alignment of program investments with the sustainability and strategic objectives of the organization. The purpose of this research is to illustrate the utility of a framework capable of clarifying the cost-benefit tradeoffs stemming from assessing digitalization program investment risks in the military shipbuilding sector. Our approach uses Artificial Neural Network to quantify benefits and risks per project while employing scenario analysis to quantify the effects of operational constraints. A Monte Carlo model is used to generate data samples that support the …

Development Of A Modeling Algorithm To Predict Lean Implementation Success, Richard Charles Barclay

Doctoral Dissertations

”Lean has become a common term and goal in organizations throughout the world. The approach of eliminating waste and continuous improvement may seem simple on the surface but can be more complex when it comes to implementation. Some firms implement lean with great success, getting complete organizational buy-in and realizing the efficiencies foundational to lean. Other organizations struggle to implement lean. Never able to get the buy-in or traction needed to really institute the sort of cultural change that is often needed to implement change. It would be beneficial to have a tool that organizations could use to assess their …

Could A Robot Be Your Psychotherapist?, Benjamin Huston

Graduate School of Professional Psychology: Doctoral Papers and Masters Projects

As technology has advanced over the years, it has been integrated into psychotherapy and changed the way that people receive mental health care (Schopp, Demiris, & Glueckauf, 2006). Many of these advances, such as telehealth practices, were seen as unsustainable until the public Internet offered broader access to technology-based care in the 1990s (Schopp, Demiris, & Glueckauf, 2006). These technology-based practices have since grown in popularity and with a recent increase in telehealth practices, text-based therapies, and applications to aid in mental health practices, modern therapy looks very different than it did even ten years ago (Fiske, Henningsen, & Buyx, …

A Deep Learning Approach To Mapping Irrigation: U-Net Irrmapper, Thomas Henry Colligan Iv

Graduate Student Theses, Dissertations, & Professional Papers

Accurate maps of irrigation are essential for understanding and managing water resources in light of a warming climate. We present a new method for mapping irrigation and apply it to the state of Montana over the years 2000-2019. The method is based on an ensemble of convolutional neural networks that only rely on raw Landsat surface reflectance data. The ensemble of networks method learns to mask clouds and ignore Landsat 7 scan-line failures without supervision, reducing the need for preprocessing data or feature engineering. Unlike other approaches to mapping irrigation, the method doesn't use other mapping products like the Cropland …

Values Of Artificial Intelligence In Marketing, Yingrui Xi

Masters Theses

“Artificial Intelligence (AI) is causing radical changes in marketing and emerging as a competent assistant supporting all areas of the marketing field. The influences and impacts AI has created in various marketing segments have aroused much interest among marketing professionals and academic scholars. Comprehensive and systematic studies on the values of AI in marketing, however, are still lacking and the existing literature fragmented. This research provides a comprehensive review of the existing literature in the relevant fields as well as a series of systematic interviews using the Value-Focused Thinking approach to understand the values of AI in marketing. This research …

Observer-Based Event-Triggered And Set-Theoretic Neuro-Adaptive Controls For Constrained Uncertain Systems, Abdul Ghafoor

Doctoral Dissertations

"In this study, several new observer-based event-triggered and set-theoretic control schemes are presented to advance the state of the art in neuro-adaptive controls. In the first part, six new event-triggered neuro-adaptive control (ETNAC) schemes are presented for uncertain linear systems. These comprehensive designs offer flexibility to choose a design depending upon system performance requirements. Stability proofs for each scheme are presented and their performance is analyzed using benchmark examples. In the second part, the scope of the ETNAC is extended to uncertain nonlinear systems. It is applied to a case of precision formation flight of the microsatellites at the Sun-Earth/Moon …

Computational Model For Neural Architecture Search, Ram Deepak Gottapu

Doctoral Dissertations

"A long-standing goal in Deep Learning (DL) research is to design efficient architectures for a given dataset that are both accurate and computationally inexpensive. At present, designing deep learning architectures for a real-world application requires both human expertise and considerable effort as they are either handcrafted by careful experimentation or modified from a handful of existing models. This method is inefficient as the process of architecture design is highly time-consuming and computationally expensive.

The research presents an approach to automate the process of deep learning architecture design through a modeling procedure. In particular, it first introduces a framework that treats …

Studying The Effects Of Various Process Parameters On Early Age Hydration Of Single- And Multi-Phase Cementitious Systems, Rachel Cook

Doctoral Dissertations

”The hydration of multi-phase ordinary Portland cement (OPC) and its pure phase derivatives, such as tricalcium silicate (C₃S) and belite (ß-C₂S), are studied in the context varying process parameters -- for instance, variable water content, water activity, superplasticizer structure and dose, and mineral additive type and particle size. These parameters are studied by means of physical experiments and numerical/computational techniques, such as: thermodynamic estimations; numerical kinetic-based modelling; and artificial intelligence techniques like machine learning (ML) models. In the past decade, numerical kinetic modeling has greatly improved in terms of fitting experimental, isothermal calorimetry to kinetic-based modelling …

Health-Aware Food Planner: A Personalized Recipe Generation Approach Based On Gpt-2, Bushra Aljbawi

Theses and Dissertations (Comprehensive)

"What to eat today?" With the flourish of Internet, more and more people nowadays are inclined to find an answer to this most problematic question online. The recent explosion of food networks; however, produces large volumes of recipes, making it even harder to make an informed decision. This yields the need for advanced decision-making algorithms and efficient recommendation systems. Conventional recommender systems are not feasible anymore as food is a complicated feature that presents unique challenges and is less studied. For example, it can be one of the main reasons for obesity and many other chronic diseases. Food recommender system …