Computer Sciences Commons^™

Visual Homing For Robot Teams: Do You See What I See?, Damian Lyons, Noah Petzinger

Faculty Publications

Visual homing is a lightweight approach to visual navigation which does not require GPS. It is very attractive for robot platforms with a low computational capacity. However, a limitation is that the stored home location must be initially within the field of view of the robot. Motivated by the increasing ubiquity of camera information we propose to address this line-of-sight limitation by leveraging camera information from other robots and fixed cameras. To home to a location that is not initially within view, a robot must be able to identify a common visual landmark with another robot that can be used …

Unsupervised Automatic Speech Recognition: A Review, Hanan Aldarmaki, Asad Ullah, Sreepratha Ram, Nazar Zaki

Natural Language Processing Faculty Publications

Automatic Speech Recognition (ASR) systems can be trained to achieve remarkable performance given large amounts of manually transcribed speech, but large labeled data sets can be difficult or expensive to acquire for all languages of interest. In this paper, we review the research literature to identify models and ideas that could lead to fully unsupervised ASR, including unsupervised sub-word and word modeling, unsupervised segmentation of the speech signal, and unsupervised mapping from speech segments to text. The objective of the study is to identify the limitations of what can be learned from speech data alone and to understand the minimum …

Lattice Optics Optimization For Recirculatory Energy Recovery Linacs With Multi-Objective Optimization, Isurumali Neththikumara, Todd Satogata, Alex Bogacz, Ryan Bodenstein, Arthur Vandenhoeke

College of Sciences Posters

Beamline optics design for recirculatory linear accelerators requires special attention to suppress beam instabilities arising due to collective effects. The impact of these collective effects becomes more pronounced with the addition of energy recovery (ER) capability. Jefferson Lab’s multi-pass, multi-GeV ER proposal for the CEBAF accelerator, ER@CEBAF, is a 10- pass ER demonstration with low beam current. Tighter control of the beam parameters at lower energies is necessary to avoid beam break-up (BBU) instabilities, even with a small beam current. Optics optimizations require balancing both beta excursions at high-energy passes and overfocusing at low-energy passes. Here, we discuss an optics …

Physics-Informed Neural Networks (Pinns) For Dvcs Cross Sections, Manal Almaeen, Jake Grigsby, Joshua Hoskins, Brandon Kriesten, Yaohang Li, Huey-Wen Lin, Simonetta Liuti, Sorawich Maichum

College of Sciences Posters

We present a physics informed deep learning technique for Deeply Virtual Compton Scattering (DVCS) cross sections from an unpolarized proton target using both an unpolarized and polarized electron beam. Training a deep learning model typically requires a large size of data that might not always be available or possible to obtain. Alternatively, a deep learning model can be trained using additional knowledge gained by enforcing some physics constraints such as angular symmetries for better accuracy and generalization. By incorporating physics knowledge to our deep learning model, our framework shows precise predictions on the DVCS cross sections and better extrapolation on …

Reinforcement Learning With Deep Q-Networks, Caleb Cassady

Masters Theses & Specialist Projects

In the past decade, machine learning strategies centered on the use of Deep Neural Networks (DNNs) have caught the interest of researchers due to their success in complicated classification and prediction problems. More recently, these DNNs have been applied to reinforcement learning tasks with state of- the-art results using Deep Q-Networks (DQNs) based on the Q-Learning algorithm. However, the DQN training process is different from standard DNNs and poses significant challenges for certain reinforcement learning environments. This paper examines some of these challenges, compares proposed solutions, and offers novel solutions based on previous research. Experiment implementation available at https://github.com/caleb98/dqlearning.

A New Metaphor: How Artificial Intelligence Links Legal Reasoning And Mathematical Thinking, Melissa E. Love Koenig, Colleen Mandell

Marquette Law Review

Artificial intelligence’s (AI’s) impact on the legal community expands exponentially each year. As AI advances, lawyers have more powerful tools to enhance their ability to research and analyze the law, as well as to draft contracts and other legal documents. Lawyers are already using tools powered by AI and are learning to shift their methodologies to take advantage of these enhancements. To continue to grow into their shifting role, lawyers should understand the relationship between AI, mathematics, and legal reasoning.

Unsupervised Learning With Word Embeddings Captures Quiescent Knowledge From Covid-19 And Materials Science Literature, Tasnim H. Gharaibeh

Dissertations

Millions of scientific papers are produced each year and the scientific literature is continuing to grow at a head-spinning speed. Thus, massive scientific knowledge exists in solid text, but all these publications make it difficult, if not impossible, for researchers to keep in up to date with discoveries, even within a narrow scientific area. This massive amount of information also makes it difficult to find implicit and hidden connections, relationships, and dependencies within the information that may guide the direction of future research or lead to valuable new insights. So, there is a need for algorithms or models that can …

Management Of Data Brokers In Support Of Smart Community Applications, Shadha Tabatabai

Dissertations

The widespread use of smart devices has led to the Internet of Things (IoT) revolution. Big data generated by billions of devices must be analyzed to make better decisions. However, this introduces security, communication, and processing problems. To solve these problems, we develop algorithms to enhance the work of brokers. We focus our efforts on three problems.

In the first problem, brokers are used in the cloud along with Software Defined Network (SDN) switches. We formulate minimizing brokers’ load difference within a reconfiguration budget with the constraint of indivisible topics as an Integer Linear Programming (ILP) problem. We show that …

Understanding The Mechanism Of Deep Learning Frameworks In Lesion Detection For Pathological Images With Breast Cancer, Wei-Wen Hsu, Chung-Hao Chen, Chang Hao, Yu-Ling Hou, Xiang Gao, Yun Shao, Xueli Zhang, Jingjing Wang, Tao He, Yanhong Tai

Electrical & Computer Engineering Faculty Publications

With the advances of scanning sensors and deep learning algorithms, computational pathology has drawn much attention in recent years and started to play an important role in the clinical workflow. Computer-aided detection (CADe) systems have been developed to assist pathologists in slide assessment, increasing diagnosis efficiency and reducing misdetections. In this study, we conducted four experiments to demonstrate that the features learned by deep learning models are interpretable from a pathological perspective. In addition, classifiers such as the support vector machine (SVM) and random forests (RF) were used in experiments to replace the fully connected layers and decompose the end-to-end …

Convolutional Neural Network For Covid-19 Detection In Chest X-Rays, Joshua Elliot Henderson

Honors Thesis

The COVID-19 pandemic has had a large effect on almost every facet of life. As COVID-19 was a disease only discovered in recent history, there is comparatively little data on the disease, how we detect it, and how we cure it. Deep learning is a powerful tool that can be used to learn to classify information in ways that humans might not be able to. This allows computers to learn on relatively little data and provide exceptional results. In this paper, I propose a novel convolutional neural network (CNN) for the detection of COVID-19 from chest X-rays called basicConv. This …

Entity Based Sentiment Analysis For Textual Health Advice, Dae Lim Chung

Computer Science Senior Theses

This work explores entity based sentiment analysis for textual health advice through deep learning. We fine tuned a pretrained BERT model to analyze sentiments across five different predetermined categories which consist of food, medicine, disease, exercise, and vitality for three different sentiments: positive, negative, and neutral. Original set of annotated medical dataset from Dartmouth College’s Persist Lab was used to conduct the experiments. For the aim of tailoring the data for the purpose of entity based sentiment analysis, we explored data transformation techniques to generate optimum training examples. During the experiments, we were able to discover that the wide variety …

Improving Feature Generalizability With Multitask Learning In Class Incremental Learning, Dong Ma, Chi Ian Tang, Cecilia Mascolo

Research Collection School Of Computing and Information Systems

Many deep learning applications, like keyword spotting [1], [2], require the incorporation of new concepts (classes) over time, referred to as Class Incremental Learning (CIL). The major challenge in CIL is catastrophic forgetting, i.e., preserving as much of the old knowledge as possible while learning new tasks. Various techniques, such as regularization, knowledge distillation, and the use of exemplars, have been proposed to resolve this issue. However, prior works primarily focus on the incremental learning step, while ignoring the optimization during the base model training. We hypothesise that a more transferable and generalizable feature representation from the base model would …

Integrating Blockchains And Intelligent Agents In The Pursuit Of Artificial General Intelligence, Benjamin Fluharty

Senior Honors Theses

Artificial General Intelligence (AGI) is the next greatest technological milestone. AGI can be defined as a realized artificial intelligence (AI) with the ability to understand and solve problems of various scope within constantly changing environments. To take steps toward this goal, a baseline of information will be provided regarding surrounding topics and the current state of AGI, itself. Through the culmination of swarms of highly optimized narrow AI agents, a collaborative effort will be extended toward general intelligence. Blockchains have been selected to facilitate this connection. A software deliverable will accompany this thesis to illustrate how this idea might be …

Ai Insurance: How Liability Insurance Can Drive The Responsible Adoption Of Artificial Intelligence In Health Care, Ariel Dora Stern, Avi Goldfarb, Timo Minssen, W. Nicholson Price Ii

Articles

Despite enthusiasm about the potential to apply artificial intelligence (AI) to medicine and health care delivery, adoption remains tepid, even for the most compelling technologies. In this article, the authors focus on one set of challenges to AI adoption: those related to liability. Well-designed AI liability insurance can mitigate predictable liability risks and uncertainties in a way that is aligned with the interests of health care’s main stakeholders, including patients, physicians, and health care organization leadership. A market for AI insurance will encourage the use of high-quality AI, because insurers will be most keen to underwrite those products that are …

Algorithm Selection For The Team Orienteering Problem, Mustafa Misir, Aldy Gunawan, Pieter Vansteenwegen

Research Collection School Of Computing and Information Systems

This work utilizes Algorithm Selection for solving the Team Orienteering Problem (TOP). The TOP is an NP-hard combinatorial optimization problem in the routing domain. This problem has been modelled with various extensions to address different real-world problems like tourist trip planning. The complexity of the problem motivated to devise new algorithms. However, none of the existing algorithms came with the best performance across all the widely used benchmark instances. This fact suggests that there is a performance gap to fill. This gap can be targeted by developing more new algorithms as attempted by many researchers before. An alternative strategy is …

Comai: Enabling Lightweight, Collaborative Intelligence By Retrofitting Vision Dnns, Kasthuri Jayarajah, Dhanuja Wanniarachchige, Tarek Abdelzaher, Archan Misra

Research Collection School Of Computing and Information Systems

While Deep Neural Network (DNN) models have transformed machine vision capabilities, their extremely high computational complexity and model sizes present a formidable deployment roadblock for AIoT applications. We show that the complexity-vs-accuracy-vs-communication tradeoffs for such DNN models can be significantly addressed via a novel, lightweight form of “collaborative machine intelligence” that requires only runtime changes to the inference process. In our proposed approach, called ComAI, the DNN pipelines of different vision sensors share intermediate processing state with one another, effectively providing hints about objects located within their mutually-overlapping Field-of-Views (FoVs). CoMAI uses two novel techniques: (a) a secondary shallow ML …

Metaheuristics For Time-Dependent Vehicle Routing Problem With Time Windows, Yun-C Liang, Vanny Minanda, Aldy Gunawan, Hsiang-L. Chen

Research Collection School Of Computing and Information Systems

Vehicle routing problem (VRP), a combinatorial problem, deals with the vehicle’s capacity visiting a particular set of nodes while its variants attempt to fit real-world scenarios. Our study aims to minimise total travelling time, total distance, and the number of vehicles under time-dependent and time windows constraints (TDVRPTW). The harmony search algorithm (HSA) focuses on the harmony memory and pitch adjustment mechanism for new solution construction. Several local search operators and a roulette wheel for the performance improvement were verified via 56 Solomon’s VRP instances by adding a speed matrix. The performance comparison with a genetic algorithm (GA) was completed …

Sibnet: Food Instance Counting And Segmentation, Huu-Thanh. Nguyen, Chong-Wah Ngo, Wing-Kwong Chan

Research Collection School Of Computing and Information Systems

Food computing has recently attracted considerable research attention due to its significance for health risk analysis. In the literature, the majority of research efforts are dedicated to food recognition. Relatively few works are conducted for food counting and segmentation, which are essential for portion size estimation. This paper presents a deep neural network, named SibNet, for simultaneous counting and extraction of food instances from an image. The problem is challenging due to varying size and shape of food as well as arbitrary viewing angle of camera, not to mention that food instances often occlude each other. SibNet is novel for …

Asteroids: Exploring Swarms Of Mini-Telepresence Robots For Physical Skill Demonstration, Jiannan Li, Maurício Sousa, Chu Li, Jessie Liu, Yan Chen, Ravin Balakrishnan, Tovi Grossman

Research Collection School Of Computing and Information Systems

Online synchronous tutoring allows for immediate engagement between instructors and audiences over distance. However, tutoring physical skills remains challenging because current telepresence approaches may not allow for adequate spatial awareness, viewpoint control of the demonstration activities scattered across an entire work area, and the instructor’s sufficient awareness of the audience. We present Asteroids, a novel approach for tangible robotic telepresence, to enable workbench-scale physical embodiments of remote people and tangible interactions by the instructor. With Asteroids, the audience can actively control a swarm of mini-telepresence robots, change camera positions, and switch to other robots’ viewpoints. Demonstrators can perceive the audiences’ …

Volume Introduction, I. Glenn Cohen, Timo Minssen, W. Nicholson Price Ii, Christopher Robertson, Carmel Shachar

Other Publications

Medical devices have historically been less regulated than their drug and biologic counterparts. A benefit of this less demanding regulatory regime is facilitating innovation by making new devices available to consumers in a timely fashion. Nevertheless, there is increasing concern that this approach raises serious public health and safety concerns. The Institute of Medicine in 2011 published a critique of the American pathway allowing moderate-risk devices to be brought to the market through the less-rigorous 501(k) pathway,1 flagging a need for increased postmarket review and surveillance. High-profile recalls of medical devices, such as vaginal mesh products, along with reports globally …

Assessing Photogrammetry Artificial Intelligence In Monumental Buildings’ Crack Digital Detection, Said Maroun, Mostafa Khalifa, Nabil Mohareb

Architecture and Planning Journal (APJ)

Natural and human-made disasters have significant impacts on monumental buildings, threatening them from being deteriorated. If no rapid consolidations took into consideration traumatic accidents would endanger the existence of precious sites. In this context, Beirut's enormous 4th of August 2020 explosion damaged an estimated 640 historical monuments, many volunteers assess damages for more than a year to prevent the more crucial risk of demolitions. This research aims to assist the collaboration ability among photogrammetry science, Artificial Intelligence Model (AIM) and Architectural Coding to optimize the process for better coverage and scientific approach of data specific to the crack disorders to …

Improving Robustness Of Deep Learning Models And Privacy-Preserving Image Denoising, Hadi Zanddizari

USF Tampa Graduate Theses and Dissertations

Applications of deep learning models and convolutional neural networks have been rapidly increased. Although state-of-the-art CNNs provide high accuracy in many applications, recent investigations show that such networks are highly vulnerable to adversarial attacks. The black-box adversarial attack is one type of attack that the attacker does not have any knowledge about the model or the training dataset, but it has some input data set and theirlabels.

In this chapter, we propose a novel approach to generate a black-box attack in a sparse domain, whereas the most critical information of an image can be observed. Our investigation shows that large …

Novel Methodology For The Investigation Of Dmrt3a Interneurons In Larval Zebrafish, Alfred Amendolara

Annual Research Symposium

No abstract provided.

Energy-Based Latent Aligner For Incremental Learning, K.J. Joseph, Salman Khan, Fahad Shahbaz Khan, Rao Muhammad Anwer, Vineeth N. Balasubramanian

Computer Vision Faculty Publications

Deep learning models tend to forget their earlier knowledge while incrementally learning new tasks. This behavior emerges because the parameter updates optimized for the new tasks may not align well with the updates suitable for older tasks. The resulting latent representation mismatch causes forgetting. In this work, we propose ELI: Energy-based Latent Aligner for Incremental Learning, which first learns an energy manifold for the latent representations such that previous task latents will have low energy and the current task latents have high energy values. This learned manifold is used to counter the representational shift that happens during incremental learning. The …

The Global Rise Of Online Devices, Cyber Crime And Cyber Defense: Enhancing Ethical Actions, Counter Measures, Cyber Strategy, And Approaches, Naresh Kshetri

Dissertations

The rise of online devices, online users, online shopping, online gaming, and online teaching has ultimately given rise to online attacks and online crimes. As cases of COVID-19 seem to increase day by day, so do online crimes and attacks (as many sectors and organizations went 100% online). Technological advancements and cyber warfare already generated many ethical issues, as internet users increasingly need ethical cyber defense strategies.

Individual internet users have challenges on their end; and on the other end, nation states (some secretly, some openly), are investing in robot weapons and autonomous weapons systems (AWS). New technologies have combined …

Research On 3d Path Planning Algorithm Based On Fast Rrt Algorithm, Zhaoqiang Li, Shiyu Zhang

Journal of System Simulation

Abstract: RRT (rapidly exploring random tree) algorithm is a sampling-based path planning algorithm, which can search a path in high-dimensional environment. The traditional RRT algorithm has the problems of low node utilization and large amount of calculation. To solve these problems, the fast RRT* (Quick RRT*) algorithm is improved by optimizing the strategy of reselection of parent node and pruning range, improving the sampling method and introducing adaptive step size, which makes the algorithm time-consuming and path length shorter. At the same time, the node connection screening strategy is added to eliminate the excessive turning angle in the path. …

Research On Real-Time Motion Matching Of Shadow Play Based On Kinect, Chuanqian Tang, Zhiqiang Liu, Yijun Su, Xiaojing Liu

Journal of System Simulation

Abstract: In the inheritance of shadow play culture, due to the aging of the audience and the discontinuity of inheritance, the shadow play culture is gradually facing decline. Real-time matching of shadow play movements based on Kinect can inject new vitality into traditional shadow play culture. According to the characteristics of shadow play, a joint point shadow play model is constructed, and the static digitization of shadow play is realized. The human body depth image is obtained based on Kinect, and the human skeleton point coordinates are obtained through segmentation mask and machine learning to generate the human skeleton.Bone …

Effectiveness Evaluation Of Surface Ship Air Defense And Antimissile Combat In Complex Electromagnetic Environment, Gaofeng Zhang, Liang Wu

Journal of System Simulation

Abstract: In order to effectively evaluate the effectiveness of surface ship air defense and antimissile combat in complex electromagnetic environment, a surface ship air defense and antimissile combat effectiveness index system is established considering the influence of equipment, environment and human behavior, the evaluation process of surface ship air defense and antimissile combat effectiveness based on analytic hierarchy process(AHP) is proposed, and a hierarchical structure model of effectiveness evaluation is constructed including five levels of target layer, sub-efficiency layer, capability layer, constraint layer and plan layer. The application shows that the evaluation process and structure model can fully reflect the …

New Embedded Simulation Technology For Smart Internet Of Things, Bohu Li, Xudong Chai, Lin Zhang, Duzheng Qing, Guoqiang Shi, Tingyu Lin, Liqin Guo, Chen Yang, Mu Gu, Zhengxuan Jia, Hui Gong, Zhen Tang

Journal of System Simulation

Abstract: Human society in the new development era and journey is facing the new situation. The operation paradigm, technology and ecosystem of industries related to the national economy and people's livelihood、national security are changing significantly towards the digital, networked, cloud-based and intelligent "Smart Internet of Things". The new embedded simulation technology, with the capabilities of online and continuous analysis, cognition, learning, decision-making, operation and optimization,is urgently needed for the development of "Smart Internet of Things". "Smart Internet of Things" is briefly introduced and the connotation, characteristics and application mode of the new embedded simulation technology are proposed and its architecture, …

Open Cloud Architecture Design For Complex Product Modeling And Simulation System, Guoqiang Shi, Zewei Liu, Tingyu Lin, Zhao Xu, Xingyi Yang, Liqin Guo, Zhengxuan Jia

Journal of System Simulation

Abstract: Aiming at the problem that the complex product modeling and simulation system focuses on co-simulation of heterogeneous models and cannot realize the on-demand sharing and collaboration of simulation resources, this paper proposes an open cloud architecture for complex product modeling and simulation systems, realized on-demand sharing and collaboration of cross-organizational simulation software and hardware resources, thereby supporting complex product system-wide, full-lifecycle, anytime, anywhere, real-time, coherent, and transparently requesting accessing and obtaining simulation services. The object-process methodology (OPM) is used to model and deduce the simulation interoperability of the system and the on-demand sharing and collaborative process of simulation resources. …