Computer Engineering Commons^™

Learned Modeling And Control Of Continuum Robots For Surgical Applications, Cameron Jack Wolfe

Dartmouth College Master’s Theses

To reduce morbidity and mortality during surgery, surgeons have increasingly turned to Minimally Invasive Surgery (MIS), which involves passing instruments through small incisions or natural orifices to minimize patient trauma. Although MIS has significantly improved patient outcomes, it hinders a surgeon's dexterity and impairs visual and tactile feedback. These deficiencies have prompted the adoption of Robot-Assisted Surgery (RAS), in which surgeons control robots instead of using handheld instruments. While RAS has improved patient outcomes, robots struggle to navigate constricted spaces due to their rigidity, spurring the development of Continuum Robots (CRs). These flexible infinite degree-of-freedom robots move by bending, allowing …

Mobile Robot Adhesion Methodology And Development Of An Automatous Robot Module, Lauren Baird, Zachariah Stone, Madison Lemons, Jonathon Moody

Williams Honors College, Honors Research Projects

Due to the increasing availability of space travel as not only a scientific exploration but a commercial exploration, there is a need for an onsite repair station that can be deployed in the event of aircraft maintenance, damage, or failure. We have been tasked with researching and creating a prototype of an automatous robot that can be attached to a spacecraft body, move along the surface while avoiding obstacles, scan for damage, 3D print a repair piece, and then make the repair, all without the need of direct human input. Our team, as will be discussed throughout, was tasked with …

Performance Characterization And Optimization Of A Point-Cloud-Based Path Planner In Off-Road Terrains, Casey D. Majhor

Dissertations, Master's Theses and Master's Reports

In this dissertation, I present a multifaceted study on the generation of artificial terrains using a multifractal method, and their use in autonomous ground vehicle (AGV) planning and navigation performance characterization in high-fidelity simulations, and automated parameter optimization.

My first contribution is a multifractal artificial terrain generation method leveraging the 3D Weierstrass-Mandelbrot function to control terrain roughness. We generate 60 unique off-road terrains while varying the fractal dimension and test the impact on vehicle traversal difficulty. Results show that increasing the fractal dimension decreases low-roughness areas, increases semi-rough and high-roughness areas, and decreases vehicle success rates while increasing vertical accelerations, …

An Approach For Robotic Pollination That Utilizes Imitation Learning, Ronald Michael Butts Ii

Graduate Theses, Dissertations, and Problem Reports (ETD)

The global decline in pollinator populations poses a significant threat to agriculture, motivating the development of robotic pollination systems. Previous works demonstrated successful robotic pollination of bramble flowers using visual servoing; however, pollination was limited to specific flower orientations. As such, the objective of this work is to develop a robotic pollination system that is capable of pollinating a wider range of orientations.

This research introduces an imitation learning-based framework for robotic pollination that positions the manipulator to view chosen flowers in specific orientations. The developed model leverages object detection (YOLOv8) to identify individual flowers and a convolutional neural network …

Autonomous Object Search Planning In Large-Scale Environments, Matthew A. Collins

Graduate Theses, Dissertations, and Problem Reports (ETD)

The advancement of autonomous search holds significant promise for applications ranging from emergency response to planetary exploration. This thesis investigates strategies to enhance autonomous search performance in large-scale environments. The main contribution of this work is its practical application in real-world scenarios, where efficient search methods are essential for managing vast amounts of data, particularly in large environments. Effective search planning requires navigating complexities such as limited prior information and managing large state spaces, necessitating advanced strategies to plan with this limited information. Additionally, balancing exploration and exploitation is crucial for optimizing the search process, as it ensures thorough coverage …

Enhancing Robotic Exploration Through Semantically-Guided Sampling Strategies, Christopher Alexander Arend Tatsch

Graduate Theses, Dissertations, and Problem Reports (ETD)

From space and deep-sea exploration to disaster response and environmental monitoring, autonomous robots are essential for advancing science, improving safety, and addressing critical challenges. This dissertation introduces a novel open-source strategy for autonomous robotic exploration: the Semantically-Guided Exploration (SGE) framework. Designed for ground vehicles, SGE integrates semantic understanding into the autonomous exploration process, improving decision-making in complex environments. Specifically, the proposed sampling-based approach uses the information from the semantic segmentation of RGB images and depth images to guide the robot's selection of exploration goals. This method enables the robot to steer away from potential dangers such as large rocks and …

Foraging Economies: A Market Based Methodology For Robotic Swarm Foraging, John A. Little

Graduate Theses, Dissertations, and Problem Reports (ETD)

Swarm robotics involves coordinating large groups of autonomous agents to accomplish complex tasks through decentralized, adaptive behaviors, providing a robust and scalable approach suited to dynamic and unpredictable environments. While traditional swarm models frequently draw inspiration from biological systems such as ant colonies or bee foraging, other approaches use techniques from physics, control theory, and economics to achieve effective coordination. This study distinguishes itself by applying economic principles—specifically, market-driven mechanisms like auctions, utility functions based on opportunity cost, and supply-demand dynamics based on fluctuating resource values at a central base—to improve task allocation within a swarm foraging context. This approach …

Observability-Aware Path Planning For Autonomous Navigation, Raymond Brink Neistat

Open Access Master's Theses

Terrain-Aided Navigation (TAN) is a popular method of localization for GPS-denied vehicles, particularly in the marine domain. There are many ways to perform TAN in a marine setting, such as Bathymetric SLAM (BSLAM) and Bayesian Filtering with the aid of an a priori map. These techniques have been studied extensively, but show an overall lack of rigorous observability analyses. Without nonlinear observability analyses, TAN practitioners do not have an analytical indicator to know which areas of terrain will provide opportunities for the best localization performance. This thesis reviews current developments in the endeavors of nonlinear observability analyses as well as …

Children's Hospital Animatronic, Erin Keller, Wesley Cunningham, Dylan Mueller, Carl Richter

Williams Honors College, Honors Research Projects

This senior project explores the development of a pediatric-oriented animatronic designed to enhance the hospital experience for children. Recognizing the importance of alleviating the anxiety and fear that often accompany hospital visits, the project focuses on creating an engaging and interactive companion to soothe children.

Key components of this project include:

1. Creative Design: The animatronic character's design prioritizes child-friendliness, employing research into child psychology and preferences to ensure an appealing and approachable aesthetic.

2. Electrical and Mechanical Engineering: A robust mechanical and electronic system was engineered to enable lifelike movements, gestures, and responses.

3. Interactive Features: A simple, user-friendly app will be …

   ---

   Go to article

Development Of A Solidworks Api, Andrew Magyar

Williams Honors College, Honors Research Projects

With the current advancements in CAD software, and precision of modern motors, we believe that a new way to communicate from hardware to software is possible. This report details the steps we have taken to attempt just that. The essential idea behind this is that modern controls for robotics are not as user friendly as they can be. The general action taken is to create an API for SolidWorks that connects it to the other necessary controller software and makes it so that a robot, and its exact current position, can be changed simply and intuitively from SolidWorks. Furthermore, the …

Autonomous Damage And Structure Scanning Drone, Natasha Ninan, Amber Long, Lee Nestor, Emmanuel Jensen

Williams Honors College, Honors Research Projects

Remote damage analysis plays a crucial role in lowering the risk associated with human presence at dangerous sites. This project focuses on developing a system for remote structural examination using photogrammetric techniques and analysis. The system utilizes a drone equipped with cameras for photogrammetry, and LiDARs for navigation. This setup can enable efficient structural model generation with the collection of images from multiple points. A novel structural analysis is performed to detect potential damage or points of failure in the structure.

Key components include a teleoperated drone, a software pipeline for photogrammetric analysis, collision protection mechanisms, and a user interface. …

Autonomous Basketball Court Creation Robot, Bryce Haldeman, Tyler Gray, Dalon Vura

Williams Honors College, Honors Research Projects

The Autonomous Basketball Court Outlining System presents a comprehensive solution for precision court marking. Powered by a 24V lithium-ion battery and driven by a single ST microcontroller, the system autonomously marks the outline of a half basketball court using predefined algorithms. User-friendly features include easy loading of marking material, actuated by gravity or a small servo motor depending on material of choice, ensuring intuitive operation. Safety is prioritized, with the servo motor eliminating high-pressure concerns, and the system maintains a controlled speed accounting for user well-being. Two step and direction servo motors enable accurate linear displacement, facilitating straight lines, and …

Efficient Connectivity Management And Path Planning For Iot And Uav Networks, Amirahmad Chapnevis

Theses and Dissertations

This dissertation explores how to better manage resources in mobile networks, especially for enhancing the performance of Unmanned Aerial Vehicles (UAV)-supported IoT networks. We explored ways to set up a flexible communication architecture that can handle large IoT deployments by making good use of mobile core network resources like bearers and data paths. We developed strategies that meet the needs of IoT networks and enhance network performance. We also developed and tested a system that combines traffic from several mobile devices that use the same user identity and network resources within the core mobile network. We used everyday smartphones, SIM …

Shape Inverse Prediction Of Magnetic Field-Actuated Soft Robots By Neural Network Machine Learning, Lineth J. Perez Monsalve

Theses and Dissertations

Soft robotics has drawn tremendous interest in recent years because the compliance and motion of soft robotics enable biocompatibility and versatility for many applications, such as human-machine interaction, wearable and assistive devices, and health monitoring. This study introduces a novel predictive modeling approach using neural networks for shape control of magnetic soft robots. The robots are made of silicone materials embedded with hard magnetic particles, which respond to the external magnetic field provided by a ring-type of permanent magnet. These robots, free from physical connections to external devices, i.e., non-tethered actuation, hold significant potential for applications in healthcare, such as …

Implementing Associative Learning Using Neuromorphic Robot, Vinay Kumar Pillalamarri

Dissertations, Master's Theses and Master's Reports

Associative learning, a key cognitive process seen across the animal kingdom, enables organisms to form connections between stimuli and adapt their behaviors based on past experiences. A particularly powerful example is fear conditioning, where animals learn to associate a neutral stimulus with an aversive one, allowing them to predict and avoid potential threats. Inspired by this mechanism, this project implements associative learning on an unmanned ground vehicle (UGV) to develop adaptive behavior through neuromorphic principles. Utilizing Nengo for neural modeling, the UGV learns to associate visual (red color) and tactile (vibration) stimuli through Hebbian learning, a biologically inspired synaptic adaptation …

The Integration Of Neuromorphic Computing In Autonomous Robotic Systems, Md Abu Bakr Siddique

Dissertations, Master's Theses and Master's Reports

Deep Neural Networks (DNNs) have come a long way in many cognitive tasks by training on large, labeled datasets. However, this method has problems in places with limited data and energy, like when planetary robots are used or when edge computing is used [1]. In contrast to this data-heavy approach, animals demonstrate an innate ability to learn by communicating with their environment and forming associative memories among events and entities, a process known as associative learning [2-4]. For instance, rats in a T-maze learn to associate different stimuli with outcomes through exploration without needing labeled data [5]. This learning paradigm …

Initial Solution Improvements To A Tethered Robotic Path Planner Using Random Geometric Graph Configurations And Biased Sampling, Austen J. Goddu

Dissertations, Master's Theses and Master's Reports

With NASA's ongoing efforts to establish a presence on the lunar surface to eventually move on to exploring mars, the development of intelligent robotic systems is more important than ever. The ability of robotics to explore hazardous and extreme terrain, coupled with long communication times from earth places an ever increasing need on more robust and efficient autonomy. Tethered robotics offer unique advantages to explore scientific targets both on the lunar and martian surfaces, capable of using their tether as a physical or metaphorical lifeline to allow the exploration of slopes, extreme dark regions, or areas in which wireless communication …

Self-Supervised Contrastive Learning Using Eeg Signals For Mental Stress Assessment, Ugochukwu Uraechu

College of Graduate Studies: Theses & Dissertations

A study is presented to investigate self-supervised contrastive learning (SSCL) models using physiological data obtained from non-invasive wearable sensors for mental stress assessment. The present work involved acquisition of electroencephalography (EEG) signals using wearable sensors, signal preprocessing, data augmentation, and investigation of self-supervised contrastive learning (SSCL) algorithms for multi-class mental stress assessment. Seven volunteers participated in this study executing various mental tasks while wearing an OpenBCI head cap to acquire EEG signals. The acquired EEG signals were preprocessed and utilized for data augmentation in time and frequency domains with different SSCL models. Optimal data augmentation combinations and SSCL models were …

Magnetometer-Less State-Estimation Of A Mobile Robot Using Cascaded Kalman Filters, Tommy Le

Graduate Research Theses & Dissertations

Localization, or state-estimation algorithms, are one of the most important aspects inthe development of autonomous mobile robots. Typical localization requires an IMU (Inertial Measurement Unit) along with an external reference, such as GPS (Global Positioning System) for outdoor applications. In indoor applications, the GPS data is not accessible so many mobile robot implementations turn to magnetometers to provide additional pose information. However, in the context of miniaturizing robotic systems, magnetometers are not always reliable due to their proximity to motors and other electronics, causing magnetic distortion and in turn, incorrect pose information. To address this issue, this thesis proposes a …

A One-Wheeled Robot For Exploring Rolling Disk Locomotion, David H. J. Schmidt

Graduate Research Theses & Dissertations

The work proposed in this thesis is motivated by observations of one-wheel vehicles called monocycles. Whereas the unicycle has the rider sitting on a seat above the wheel, the monocycle’s rider sits inside a large circular hoop that serves as the wheel. Due to the position of the rider inside the wheel, it lowers the overall center of mass of the vehicle below the center of the wheel. For this reason, the uncontrolled longitudinal (forward/backward, or drive axis) dynamics are stable. For modest speeds above a certain threshold, the lateral (side-to-side, or lean axis) dynamics of the monocycle are also …

Joint Learning Of Unknown Safety Constraints And Control Policies In Reinforcement Learning, Lunet Abiye Yifru

Graduate Theses, Dissertations, and Problem Reports (ETD)

Reinforcement learning (RL) has revolutionized decision-making across a wide range of domains over the past few decades. Yet, deploying RL policies in real-world scenarios presents the crucial challenge of ensuring safety. Traditional safe RL approaches have predominantly focused on incorporating predefined safety constraints into the policy learning process. However, this reliance on predefined safety constraints poses limitations in dynamic and unpredictable real-world settings where such constraints may not be available or sufficiently adaptable. Bridging this gap, we propose a novel approach that concurrently learns a safe RL control policy and identifies the unknown safety constraint parameters of a given environment. …

Modeling And Control For Precision Robotic Machining, Patrick Bazzoli

Doctoral Dissertations

"Robots are used in a wide variety of manufacturing applications, but machining applications in which robots can excel are limited by their lower accuracy and stiffness relative to traditional CNC machines. This work is composed of two parts: one to evaluate a robot’s accuracy and one to compensate for the vibrations of the robot due to its lower stiffness.

In order to evaluate whether a robot has the necessary accuracy to perform a given machining task, Paper 1 discusses a novel Model Invalidation method. This methodology provides a statistical framework as well as a measurement strategy for determining if a …

Robotic Gas Source Localization And Distribution Mapping Via Deep Reinforcement Learning, Iliya Kulbaka

UNF Graduate Theses and Dissertations

This research aims to advance the fields of Gas Source Localization (GSL) and Gas Distribution Mapping (GDM) by developing deep reinforcement learning (DRL) methodologies suitable for complex, real-world environments. GSL and GDM are crucial for applications such as environmental monitoring, hazardous material detection, and search-and-rescue missions, where safe and efficient exploration is essential. Traditional methods often fall short in dynamic settings influenced by factors like wind and obstacles. To address these limitations, this study proposes novel neural network architectures and learning frameworks for adaptive exploration and mapping, integrating Convolutional Neural Networks (CNN), Long Short-Term Memory (LSTM) layers, and Deep Q-Networks …

A Memory Efficient Deep Recurrent Q-Learning Approach For Autonomous Wildfire Surveillance, Jeremy A. Cantor

UNF Graduate Theses and Dissertations

Previous literature demonstrates that autonomous UAVs (unmanned aerial vehicles) have the po- tential to be utilized for wildfire surveillance. This advanced technology empowers firefighters by providing them with critical information, thereby facilitating more informed decision-making processes. This thesis applies deep Q-learning techniques to the problem of control policy design under the objective that the UAVs collectively identify the maximum number of locations that are under fire, assuming the UAVs can share their observations. The prohibitively large state space underlying the control policy motivates a neural network approximation, but prior work used only convolutional layers to extract spatial fire information from …

Transformer-Enabled Deep Reinforcement Learning For Coverage Path Planning, Daniel B. Tiu

UNF Graduate Theses and Dissertations

Coverage path planning (CPP) is the problem of covering all points in an environment and is a well-researched topic in robotics due to its sheer practical relevance. This paper investigates such an offline CPP problem where the primary objective is to minimize the path length to achieve complete coverage. Furthermore, the literature suggests that taking turns leads to a higher energy use than going straight. To this end, we design a novel objective function that aims to minimize the number of turns as well. We have proposed a deep reinforcement learning (DRL)-based framework that uses a Transformer model. Unlike state-of-the-art …

Exploring End-User Environments For The Control And Programming Of Collaborative Robots, Luiz Felipe Fronchetti Dias

Theses and Dissertations

To collaborate with the ongoing development of robotics, this thesis highlights three research contributions to collaborative robot programming. The first study evaluates block-based programming as an alternative for two-armed robots. A commercial solution is put in contrast with a block-based programming language. Both programming solutions are evaluated by 52 participants in an experiment involving a pick-and-place task. This study brings insights into human-robot collaboration, including robot positioning and interaction challenges. The second study discusses using mixed-reality devices as a potential workaround to the manual positioning of industrial and collaborative robots. Five different control interfaces implemented in mixed reality were used …

External Runtime Execution Monitoring Of A Cyber Physical System Via Trace Interfaces, Peter Vaughan Truslow

Theses and Dissertations

In the past two decades, Unmanned Aerial Systems have progressed from expensive military hardware or one-off custom builds, to include off-the-shelf drones that can be purchased for a rather affordable price and flown by nearly anyone. As the technology and performance have improved, the door is opened to applications that require operation in environments where the consequences for failure are high, such as operating in the navigable airspace or in urban environments, or with human passengers. This requires a great deal of trust in the reliability and integrity of the control systems of the aircraft. A method of monitoring the …

Control Of Fully-Actuated Aerial Manipulators And Omni-Directional Multirotors, Riley M. Mccarthy

Mechanical Engineering ETDs

This thesis details the system modeling, design, control, simulation, construction, and
testing of both a fully-actuated and omni-directional multirotor aerial system created
for the primary purpose of performing active tasks with their environment. This work
verifies the capabilities of both systems through empirical testing, and demonstrates
how through the use of new control methods and physical designs multirotors can
expand their purpose from passive inspection based tasks to active contact based
tasks. These systems take advantage of newly implemented control allocation features present in the PX4 flight control software, version 1.14. The use of which makes designing controllers for such …

Safety-Aware Autonomous Robot Navigation, Mapping And Control By Optimization Techniques, Tingjun Lei

Theses and Dissertations

The realm of autonomous robotics has seen impressive advancements in recent years, with robots taking on essential roles in various sectors, including disaster response, environmental monitoring, agriculture, and healthcare. As these highly intelligent machines continue to integrate into our daily lives, the pressing imperative is to elevate and refine their performance, enabling them to adeptly manage complex tasks with remarkable efficiency, adaptability, and keen decision-making abilities, all while prioritizing safety-aware navigation, mapping, and control systems. Ensuring the safety-awareness of these robotic systems is of paramount importance in their development and deployment. In this research, bio-inspired neural networks, nature-inspired intelligence, deep …

Brain-Inspired Spatio-Temporal Learning With Application To Robotics, Thiago André Ferreira Medeiros

USF Tampa Graduate Theses and Dissertations

The human brain still has many mysteries and one of them is how it encodes information. The following study intends to unravel at least one such mechanism. For this it will be demonstrated how a set of specialized neurons may use spatial and temporal information to encode information. These neurons, called Place Cells, become active when the animal enters a place in the environment, allowing it to build a cognitive map of the environment. In a recent paper by Scleidorovich et al. in 2022, it was demonstrated that it was possible to differentiate between two sequences of activations of a …