Computer Engineering Commons^™

Mobile Robot Adhesion Methodology And Development Of An Automatous Robot Module, Lauren Baird, Zachariah Stone, Madison Lemons, Jonathon Moody

Williams Honors College, Honors Research Projects

Due to the increasing availability of space travel as not only a scientific exploration but a commercial exploration, there is a need for an onsite repair station that can be deployed in the event of aircraft maintenance, damage, or failure. We have been tasked with researching and creating a prototype of an automatous robot that can be attached to a spacecraft body, move along the surface while avoiding obstacles, scan for damage, 3D print a repair piece, and then make the repair, all without the need of direct human input. Our team, as will be discussed throughout, was tasked with …

A Memory Efficient Deep Recurrent Q-Learning Approach For Autonomous Wildfire Surveillance, Jeremy A. Cantor

UNF Graduate Theses and Dissertations

Previous literature demonstrates that autonomous UAVs (unmanned aerial vehicles) have the po- tential to be utilized for wildfire surveillance. This advanced technology empowers firefighters by providing them with critical information, thereby facilitating more informed decision-making processes. This thesis applies deep Q-learning techniques to the problem of control policy design under the objective that the UAVs collectively identify the maximum number of locations that are under fire, assuming the UAVs can share their observations. The prohibitively large state space underlying the control policy motivates a neural network approximation, but prior work used only convolutional layers to extract spatial fire information from …

Transformer-Enabled Deep Reinforcement Learning For Coverage Path Planning, Daniel B. Tiu

UNF Graduate Theses and Dissertations

Coverage path planning (CPP) is the problem of covering all points in an environment and is a well-researched topic in robotics due to its sheer practical relevance. This paper investigates such an offline CPP problem where the primary objective is to minimize the path length to achieve complete coverage. Furthermore, the literature suggests that taking turns leads to a higher energy use than going straight. To this end, we design a novel objective function that aims to minimize the number of turns as well. We have proposed a deep reinforcement learning (DRL)-based framework that uses a Transformer model. Unlike state-of-the-art …

Robotic Gas Source Localization And Distribution Mapping Via Deep Reinforcement Learning, Iliya Kulbaka

UNF Graduate Theses and Dissertations

This research aims to advance the fields of Gas Source Localization (GSL) and Gas Distribution Mapping (GDM) by developing deep reinforcement learning (DRL) methodologies suitable for complex, real-world environments. GSL and GDM are crucial for applications such as environmental monitoring, hazardous material detection, and search-and-rescue missions, where safe and efficient exploration is essential. Traditional methods often fall short in dynamic settings influenced by factors like wind and obstacles. To address these limitations, this study proposes novel neural network architectures and learning frameworks for adaptive exploration and mapping, integrating Convolutional Neural Networks (CNN), Long Short-Term Memory (LSTM) layers, and Deep Q-Networks …

Algorithms For Coordinating Multiple Autonomous Vehicles Under Various Constraints With Emphasis On Workload Balancing, Abhishek Patil

Dissertations, Master's Theses and Master's Reports

This dissertation focuses on developing algorithms to solve the problem of coordinating multiple autonomous vehicles under various constraints, aiming to produce practical solutions for real-world applications. Built upon three journal publications addressing two coordination-related problems in different domains, this research document tackles the challenges of heterogeneity constraints and cable entanglement issues encountered by autonomous vehicle systems.

The first problem tackles task allocation and path planning for heterogeneous ground mobile vehicles operating in a 2D environment with asymmetric travel costs. By enhancing previous Primal-Dual approximation heuristic methods, novel techniques are introduced to manipulate dual variables and achieve balanced workload distribution, ultimately …

Foraging Economies: A Market Based Methodology For Robotic Swarm Foraging, John A. Little

Graduate Theses, Dissertations, and Problem Reports (ETD)

Swarm robotics involves coordinating large groups of autonomous agents to accomplish complex tasks through decentralized, adaptive behaviors, providing a robust and scalable approach suited to dynamic and unpredictable environments. While traditional swarm models frequently draw inspiration from biological systems such as ant colonies or bee foraging, other approaches use techniques from physics, control theory, and economics to achieve effective coordination. This study distinguishes itself by applying economic principles—specifically, market-driven mechanisms like auctions, utility functions based on opportunity cost, and supply-demand dynamics based on fluctuating resource values at a central base—to improve task allocation within a swarm foraging context. This approach …

Autonomous Object Search Planning In Large-Scale Environments, Matthew A. Collins

Graduate Theses, Dissertations, and Problem Reports (ETD)

The advancement of autonomous search holds significant promise for applications ranging from emergency response to planetary exploration. This thesis investigates strategies to enhance autonomous search performance in large-scale environments. The main contribution of this work is its practical application in real-world scenarios, where efficient search methods are essential for managing vast amounts of data, particularly in large environments. Effective search planning requires navigating complexities such as limited prior information and managing large state spaces, necessitating advanced strategies to plan with this limited information. Additionally, balancing exploration and exploitation is crucial for optimizing the search process, as it ensures thorough coverage …

Control Of Fully-Actuated Aerial Manipulators And Omni-Directional Multirotors, Riley M. Mccarthy

Mechanical Engineering ETDs

This thesis details the system modeling, design, control, simulation, construction, and
testing of both a fully-actuated and omni-directional multirotor aerial system created
for the primary purpose of performing active tasks with their environment. This work
verifies the capabilities of both systems through empirical testing, and demonstrates
how through the use of new control methods and physical designs multirotors can
expand their purpose from passive inspection based tasks to active contact based
tasks. These systems take advantage of newly implemented control allocation features present in the PX4 flight control software, version 1.14. The use of which makes designing controllers for such …

Safety-Aware Autonomous Robot Navigation, Mapping And Control By Optimization Techniques, Tingjun Lei

Theses and Dissertations

The realm of autonomous robotics has seen impressive advancements in recent years, with robots taking on essential roles in various sectors, including disaster response, environmental monitoring, agriculture, and healthcare. As these highly intelligent machines continue to integrate into our daily lives, the pressing imperative is to elevate and refine their performance, enabling them to adeptly manage complex tasks with remarkable efficiency, adaptability, and keen decision-making abilities, all while prioritizing safety-aware navigation, mapping, and control systems. Ensuring the safety-awareness of these robotic systems is of paramount importance in their development and deployment. In this research, bio-inspired neural networks, nature-inspired intelligence, deep …

Brain-Inspired Spatio-Temporal Learning With Application To Robotics, Thiago André Ferreira Medeiros

USF Tampa Graduate Theses and Dissertations

The human brain still has many mysteries and one of them is how it encodes information. The following study intends to unravel at least one such mechanism. For this it will be demonstrated how a set of specialized neurons may use spatial and temporal information to encode information. These neurons, called Place Cells, become active when the animal enters a place in the environment, allowing it to build a cognitive map of the environment. In a recent paper by Scleidorovich et al. in 2022, it was demonstrated that it was possible to differentiate between two sequences of activations of a …

Implementation Of Adas And Autonomy On Unlv Campus, Zillur Rahman

UNLV Theses, Dissertations, Professional Papers, and Capstones

The integration of Advanced Driving Assistance Systems (ADAS) and autonomous driving functionalities into contemporary vehicles has notably surged, driven by the remarkable progress in artificial intelligence (AI). These AI systems, capable of learning from real-world data, now exhibit the capability to perceive their surroundings via a suite of sensors, create optimal routes from source to destination, and execute vehicle control akin to a human driver.

Within the context of this thesis, we undertake a comprehensive exploration of three distinct yet interrelated ADAS and Autonomy projects. Our central objective is the implementation of autonomous driving(AD) technology at UNLV campus, culminating in …

Accelerating Machine Learning Inference For Satellite Component Feature Extraction Using Fpgas., Andrew Ekblad

Theses and Dissertations

Running computer vision algorithms requires complex devices with lots of computing power, these types of devices are not well suited for space deployment. The harsh radiation environment and limited power budgets have hindered the ability of running advanced computer vision algorithms in space. This problem makes running an on-orbit servicing detection algorithm very difficult. This work proposes using a low powered FPGA to accelerate the computer vision algorithms that enable satellite component feature extraction. This work uses AMD/Xilinx’s Zynq SoC and DPU IP to run model inference. Experiments in this work centered around improving model post processing by creating implementations …

Trust-Based Variable Impedance Control And Passivity-Based Switched System Analysis For Human-Robot Cooperative Manipulation, Zhanrui Liao

All Dissertations

Human-robot cooperative manipulation (co-manipulation) is one of the most prominent human-robot collaboration (HRC) tasks, where humans and robots manipulate the same object. Trust in HRC is crucial in determining human acceptance of robots and, hence, robot utilization. A probabilistic dynamic Bayesian network (DBN) trust model that integrates a time-series trust model is presented in this thesis. The trust model is learned using a continuous and normalized Baum-Welch (BW) algorithm, devised to account for the continuous nature of trust evolution and the limitations of the classic parameter learning method. To ensure a good HRC in co-manipulation, a variable impedance control framework …

A Modular Framework For Surface-Embedded Actuation And Optical Sensing In Soft Robots., Paul Bupe Jr

Electronic Theses and Dissertations

This dissertation explores the development and integration of modular technologies in soft robotics, with a focus on the OptiGap sensor system. OptiGap serves as a simple, flexible, cost-effective solution for real-time sensing of bending and deformation, validated through simulation and experimentation. Working as part of an emerging category of soft robotics called Soft, Curved, Reconfigurable, Anisotropic Mechanisms, or SCRAMs, this research also introduces the Thermally-Activated SCRAM Limb (TASL) technology, which employs shape-memory alloy (SMA) wire embedded in curved sheets for surface actuation and served as the initial inspiration for OptiGap. In addition, the EneGate system is presented as a complementary …

An In-Depth Analysis Of Domain Adaptation In Computer And Robotic Vision, Muhammad Hassan Tanveer, Zainab Fatima, Shehnila Zardari, David A. Guerra-Zubiaga

Faculty Articles

This review article comprehensively delves into the rapidly evolving field of domain adaptation in computer and robotic vision. It offers a detailed technical analysis of the opportunities and challenges associated with this topic. Domain adaptation methods play a pivotal role in facilitating seamless knowledge transfer and enhancing the generalization capabilities of computer and robotic vision systems. Our methodology involves systematic data collection and preparation, followed by the application of diverse assessment metrics to evaluate the efficacy of domain adaptation strategies. This study assesses the effectiveness and versatility of conventional, deep learning-based, and hybrid domain adaptation techniques within the domains of …

Six-Degree-Of-Freedom Optimal Feedback Control Of Pinpoint Landing Using Deep Neural Networks, Omkar S. Mulekar, Hancheol Cho, Riccardo Bevilacqua

Student Works

Machine learning regression techniques have shown success at feedback control to perform near-optimal pinpoint landings for low fidelity formulations (e.g. 3 degree-of-freedom). Trajectories from these low-fidelity landing formulations have been used in imitation learning techniques to train deep neural network policies to replicate these optimal landings in closed loop. This study details the development of a near-optimal, neural network feedback controller for a 6 degree-of-freedom pinpoint landing system. To model disturbances, the problem is cast as either a multi-phase optimal control problem or a triple single-phase optimal control problem to generate examples of optimal control through the presence of disturbances. …

Examining The Externalities Of Highway Capacity Expansions In California: An Analysis Of Land Use And Land Cover (Lulc) Using Remote Sensing Technology, Serena E. Alexander, Bo Yang, Owen Hussey, Derek Hicks

Mineta Transportation Institute

There are over 590,000 bridges dispersed across the roadway network that stretches across the United States alone. Each bridge with a length of 20 feet or greater must be inspected at least once every 24 months, according to the Federal Highway Act (FHWA) of 1968. This research developed an artificial intelligence (AI)-based framework for bridge and road inspection using drones with multiple sensors collecting capabilities. It is not sufficient to conduct inspections of bridges and roads using cameras alone, so the research team utilized an infrared (IR) camera along with a high-resolution optical camera. In many instances, the IR camera …

Lrtransformer: Learn-Region Transformer For Object-Agnostic Point Cloud Segmentation, Dipesh Gyawali

LSU Master's Theses

3D point cloud segmentation segments the 3D point cloud data into different regions/instances depending on their features that have numerous applications in robotics, autonomous driving, digital twinning, augmented reality, etc. The majority of the existing point cloud segmentation methods depend on class labels to identify 3D objects in the surroundings. Our work focuses on segmenting point clouds into different regions/instances in an object-agnostic manner for any number of objects in the environment. Given the point cloud, our method can segment the entire scene into multiple instances without depending on object shape and size. We leverage the power of the self-attention …

Feasibility And Outcomes Of Supplemental Gait Training By Robotic And Conventional Means In Acute Stroke Rehabilitation, Mukul Talaty, Alberto Esquenazi

Moss-Magee Rehabilitation Papers

INTRODUCTION: Practicality of implementation and dosing of supplemental gait training in an acute stroke inpatient rehabilitation setting are not well studied but can have positive impact on outcomes.

OBJECTIVES: To determine the feasibility of early, intense supplemental gait training in inpatient stroke rehabilitation, compare functional outcomes and the specific mode of delivery.

DESIGN AND SETTING: Assessor blinded, randomized controlled trial in a tertiary Inpatient Rehabilitation Facility.

PARTICIPANTS: Thirty acute post-stroke patients with unilateral hemiparesis (≥ 18 years of age with a lower limb MAS ≤ 3).

INTERVENTION: Lokomat® or conventional gait training (CGT) in addition to standard mandated therapy time. …

Stability Of Deep Neural Networks For Feedback-Optimal Pinpoint Landings, Omkar S. Mulekar, Hancheol Cho, Riccardo Bevilacqua

Student Works

The ability to certify systems driven by neural networks is crucial for future rollouts of machine learning technologies in aerospace applications. In this study, the neural networks are used to represent a fuel-optimal feedback controller for two different 3-degree-of-freedom pinpoint landing problems. It is shown that the standard sum-ofsquares Lyapunov candidate is too restrictive to assess the stability of systems with fuel-optimal control profiles. Instead, a parametric Lyapunov candidate (i.e. a neural network) can be trained to sufficiently evaluate the closed-loop stability of fuel-optimal control profiles. Then, a stability-constrained imitation learning method is applied, which simultaneously trains a neural network …

Drones For Marine Science And Agriculture, David Caldera, Sai Murthy

College of Engineering Summer Undergraduate Research Program

Our research project was launched at Cal Poly in 2019 with the goal of assisting researchers at the CSULB Shark Lab in detecting sharks from aerial images. Under the guidance of Dr. Franz J. Kurfess, students trained an object detection algorithm using shark images and were able to achieve high rate of detection. Following this success, the team has constructed multiple drones and expanded their research to include applications in the fields of agriculture and ecology. This summer the goal is to use a iPhone 14 Pro in lieu of a traditional camera system for real-time object recognition. Object detection …

Exploring Cognition And Affect During Human-Cobot Interaction, Angelika T. Canete, Javier Gonzalez-Sanchez, Rafael Guerra Silva

College of Engineering Summer Undergraduate Research Program

Collaborative robots (Cobots) have recently gained popularity due to their capability to work collaboratively with human operators. This collaborative relationship has been named under the robotics discipline of Human-Robot Collaboration (HRC), in which humans and robots work together to accomplish a common task while also being in the same physical space. An important part of collaboration is the human's decision-making, which is largely affected by their affective and cognitive state. A cobot lacks this fundamental understanding of the human operator. In this research, we utilize a server-client program to communicate the affective states of a human user to a Raspberry …

Modeling And Compensating Of Noise In Time-Of-Flight Sensors, Bryan Rodriguez

Electrical Engineering Theses and Dissertations

Three-dimensional (3D) sensors provide the ability to perform contactless measurements of objects and distances that are within their field of view. Unlike traditional two-dimensional (2D) cameras, which only provide RGB data about objects within a scene, 3D sensors are able to directly provide depth information for objects within a scene. Of these 3D sensing technologies, Time-of-Flight (ToF) sensors are becoming more compact which allows them to be more easily integrated with other devices and to find use in more applications. ToF sensors also provide several benefits over other 3D sensing technologies that increase the types of applications where ToF sensors …

Objectfusion: Multi-Modal 3d Object Detection With Object-Centric Fusion, Q. Cai, Y. Pan, T. Yao, Chong-Wah Ngo, T. Mei

Research Collection School Of Computing and Information Systems

Recent progress on multi-modal 3D object detection has featured BEV (Bird-Eye-View) based fusion, which effectively unifies both LiDAR point clouds and camera images in a shared BEV space. Nevertheless, it is not trivial to perform camera-to-BEV transformation due to the inherently ambiguous depth estimation of each pixel, resulting in spatial misalignment between these two multi-modal features. Moreover, such transformation also inevitably leads to projection distortion of camera image features in BEV space. In this paper, we propose a novel Object-centric Fusion (ObjectFusion) paradigm, which completely gets rid of camera-to-BEV transformation during fusion to align object-centric features across different modalities for …

A Study On Rapidly Exploring Random Tree Algorithms For Robot Path Planning, Sahil Sharma

Master's Theses

Robot path planning is a critical feature of autonomous systems. Rapidly-exploring Random Trees (RRT) is a path planning technique that randomly samples the robot configuration space to find a path between the start and end point. This thesis studies and compares the performance of four important RRT algorithms, namely, the original RRT, the optimal RRT (also termed RRT*), RRT*-Smart, and Informed RRT* for six different environments. The performance measures include the final path length (which is also the shortest path length found by each algorithm), time to find the first path, run time (of 1000 iterations) for each algorithm, total …

Advanced Traffic Video Analytics For Robust Traffic Accident Detection, Hadi Ghahremannezhad

Dissertations

Automatic traffic accident detection is an important task in traffic video analysis due to its key applications in developing intelligent transportation systems. Reducing the time delay between the occurrence of an accident and the dispatch of the first responders to the scene may help lower the mortality rate and save lives. Since 1980, many approaches have been presented for the automatic detection of incidents in traffic videos. In this dissertation, some challenging problems for accident detection in traffic videos are discussed and a new framework is presented in order to automatically detect single-vehicle and intersection traffic accidents in real-time.

First, …

Multi-Agent Deep Reinforcement Learning For Radiation Localization, Benjamin Scott Totten

Dissertations and Theses

For the safety of both equipment and human life, it is important to identify the location of orphaned radioactive material as quickly and accurately as possible. There are many factors that make radiation localization a challenging task, such as low gamma radiation signal strength and the need to search in unknown environments without prior information. The inverse-square relationship between the intensity of radiation and the source location, the probabilistic nature of nuclear decay and gamma ray detection, and the pervasive presence of naturally occurring environmental radiation complicates localization tasks. The presence of obstructions in complex environments can further attenuate the …

Autonomous Shipwreck Detection & Mapping, William Ard

LSU Master's Theses

This thesis presents the development and testing of Bruce, a low-cost hybrid Remote Operated Vehicle (ROV) / Autonomous Underwater Vehicle (AUV) system for the optical survey of marine archaeological sites, as well as a novel sonar image augmentation strategy for semantic segmentation of shipwrecks. This approach takes side-scan sonar and bathymetry data collected using an EdgeTech 2205 AUV sensor integrated with an Harris Iver3, and generates augmented image data to be used for the semantic segmentation of shipwrecks. It is shown that, due to the feature enhancement capabilities of the proposed shipwreck detection strategy, correctly identified areas have a 15% …

Terrain And Adversary-Aware Autonomous Robot Navigation, Aniekan Ufot Inyang

Electronic Theses and Dissertations

In autonomous robot navigation, the robot is able to understand the environment around it for intelligent navigation. From its world model of this environment, it generates a global plan for navigation from a position to a goal based on different factors. This research aims to implement autonomous robot navigation by learning terrain affordances: traversability (moving quickly) and concealment (staying hidden from an adversary) using the Preference-based Inverse Reward Learning (PbIRL) methodology. The PbIRL methodology reduces the barrier of generating initial demonstration data to learn the terrain affordances by using a human expert’s preferences to learn individual weights over the terrain …

Robust Control Of Contact-Rich Robots Via Neural Bayesian Inference, Nardos Ayele Ashenafi

Boise State University Theses and Dissertations

We provide several data-driven control design frameworks for contact-rich robotic systems. These systems exhibit continuous state flows and discrete state transitions, which are governed by distinct equations of motion. Hence, it is difficult to design a single policy that can control the system in all modes. Typically, hybrid systems are controlled by multi-modal policies, each manually triggered based on observed states. However, as the number of potential contacts increase, the number of policies can grow exponentially and the control-switching scheme becomes too complicated to parameterize. To address this issue, we design contact-aware data-driven controllers given by deep-net mixture of experts. …