Robotics Commons^™

Development And Testing Of A Computer Vision Pose Estimation System For Planar Mobile Robots, Andrew Jones

Master's Theses

This thesis details the development and testing of a computer vision-based real-time pose estimation system for differential drive robots. A single camera with a fisheye lens is used to locate ArUco markers placed at fixed locations and attached to robots. Using the OpenCV library, the Perspective-n-Point (PnP) problem is solved to facilitate the transformation of 2-D robot positions in an image to world-frame coordinates. An analytical solution is presented to estimate robot poses based on a single PnP solution, rather than solving the PnP problem for each pose estimate. Pose information is relayed to individual robots using a multi-microcontroller architecture …

Evaluation Of General Voronoi Diagram Decomposition For Harmonic Fields In Navigation Of Dynamic Environments, Franco Abullarade

Master's Theses

Harmonic potential fields provide provably minimum-free navigation, but any change to the workspace geometry invalidates the field and forces a costly global recomputation, typically restricting them to static environments. This thesis extends the harmonic map framework of Vlantis et al., which maps the free workspace onto a unit disk and uses an atlas of per-region transformations, to dynamic indoor settings. First, we replace their manually annotated room partition with an automatic decomposition based on the Generalized Voronoi Diagram, allowing the atlas to be built from an arbitrary occupancy grid in an automated way. Second, we introduce a localized repair procedure …

Integration Of Robotic Arm And Conveyor With Programmable Logic Controller, Drake A. Small

Master's Theses

To meet new curriculum demands brought on by Cal Poly's upcoming switch to semesters, a new, cross-disciplinary lab module was developed for EE 435 (Industrial Power Control and Automation). The module emphasizes career-applicable skills, preparing students for the field of controls engineering within the manufacturing industry. These skills include robotic control, computer networking and configuration, and embedded systems. The work focused on integrating a collaborative robot arm to pick-and-place boxes on a conveyor. A myCobot 320 Pi and an Ultimation Powered Roller MDR Conveyor were integrated with the existing PLC system using Modbus RTU and EtherNet/IP communication protocols, respectively. A …

Design And Parametric Study Of A Mems-Based Reservoir Computer For Reinforcement Learning, Andrew P. Carr

Master's Theses

Single-node reservoir computing (RC) is a hardware-efficient approach to machine learning, leveraging the dynamics of physical systems. In this work, two reinforcement learning algorithms, Q-learning and Proximal Policy Optimization (PPO), are applied to a simulated micro-electro-mechanical system (MEMS)-based reservoir computer to solve both discrete and continuous control tasks. MEMS-based reservoirs are low-power, compact, and their natural frequencies (kHz to MHz) pair well with real-time control loops. To explore the relationship between reservoir dynamics and learning performance, a parametric study is conducted on two reservoir hyperparameters, reservoir size and neuron separation, using CartPole-v1 and MountainCar-v0. The RC successfully learns multiple tasks …

Hallucination Techniques For Self-Supervised Synthetic Datasets For Mobile Robots, Wyatt D. Colburn

Master's Theses

Classical techniques in autonomous navigation struggle in tightly constrained spaces. Machine learning has been shown to perform better in these difficult environments but most techniques require large amounts of navigation experience for training. Using a new machine learning paradigm learning from hallucination (LfH), training data can be collected in a safe environment and not require supervision. Data is collected in real time while an agent performs a random walk in free space, supervision is not required as there are no obstacles for the robot to run into. After a random walk a post processing pipeline will hallucinate a safety corridor …

Development Of A Control System For An 8-Dof Quadrupedal Robotic Research Platform, Jack Butler

Master's Theses

Quadrupedal robots offer a versatile locomotion option that can extend the operating space of a robot into uneven terrains. However, controlling these systems presents significant challenges due to nonlinearities introduced by various factors.

In this thesis, model-predictive control (MPC) is applied to an 8-DOF legged robot developed by Cal Poly’s Legged Robotics group. The MPC framework employs a lumped rigid-body model that treats the robot as a single rigid body with forces applied directly at the foot contact points. The controller is developed within the ROS2 environment, with integration of state estimation and gait-pattern generation, to provide maximum modularity and …

Design Principles For Robotic-Controlled 3d Printing Of Soft Tissue-Mimicking Materials, Karina Mealey

Master's Theses

Geometrically and physically accurate 3D models are emerging as essential tools for surgeons in pre-operative planning and training, but current methods of producing these models are not sufficient. Existing solutions have downsides such as high costs, long and tedious production times, high complexity resulting in a lack of scalability, or an inability to meet material requirements for accurately simulating human tissue.

The objective of this work is to develop principles for a low-cost, easy-to-use 3D printing system capable of prototyping with soft tissue-mimicking materials. To pursue this goal, a MyCobot280 robot arm was used as the mechanism to explore the …

Fault Tolerant Dynamic Task Allocation For Heterogeneous Multi-Robot Systems, Jack R. Cline

Master's Theses

This research presents a novel approach to dynamic task allocation in heterogeneous multi-robot systems with integrated fault detection capabilities. As multiple industries are becoming more reliant on multi-robot systems for tasks, maintaining operational efficiency despite robot failures becomes critical. We propose a framework that combines optimization-based task allocation with a Kalman filter that estimates task progress for anomaly detection to identify unreliable agents and dynamically redistribute tasks. Observing values such as the normalized innovation squared (NIS), covariance, and progress rate, the algorithm can designate a robot as faulty. Embedding information about which robots are faulty in the task algorithm allows …

Adversarial Deep Reinforcement Learning For Tank Duel Simulation Using Lidar-Based Observations, Braedan Kennedy

Master's Theses

Previous research has demonstrated that reinforcement learning agents can learn to steer differential-drive robots around obstacles using 2D lidar scans as observations. However, these studies typically treat all range returns as undifferentiated obstacles—objects to avoid—without distinguishing between different object types. This thesis builds upon previous research by introducing an adversarial task in which an agent must interpret raw range readings to both avoid static obstacles and identify, pursue, and engage a hostile target.

To investigate this problem, this thesis introduces TankGame, a novel, lightweight 2D tank duel simulator. Each agent receives a 360° lidar scan, controls its motion via tread …

Distributed Formation Control Of Nonholonomic Mobile Robots: Safety-Critical Leader-Follower Approach With Obstacle Avoidance And Dynamic Reconfiguration, Kelvin C. Villago

Master's Theses

Networked control systems for multi-agent robotics have emerged as a critical paradigm for executing complex coordinated tasks in diverse environments. While formation control serves as the backbone of such systems, real-world deployment introduces significant challenges including communication constraints, environmental obstacles, and the need for adaptive reconfiguration. This research addresses these challenges by developing a novel unified framework that seamlessly integrates obstacle avoidance algorithms with dynamic formation reconfiguration capabilities, specifically designed for communication-limited networked control architectures. The proposed framework represents a significant advancement over existing approaches by simultaneously handling both static and dynamic obstacles while maintaining system cohesion under communication constraints. …

Dynamic Maze Puzzle Navigation Using Deep Reinforcement Learning, Luisa Shu Yi Chiu

Master's Theses

The implementation of deep reinforcement learning in mobile robotics offers a great solution for the development of autonomous mobile robots to efficiently complete tasks and transport objects. Reinforcement learning continues to show impressive potential in robotics applications through self-learning and biological plausibility. Despite its advancements, challenges remain in applying these machine learning techniques in dynamic environments. This thesis explores the performance of Deep Q-Networks (DQN), using images as an input, for mobile robot navigation in dynamic maze puzzles and aims to contribute to advancements in deep reinforcement learning applications for simulated and real-life robotic systems. This project is a step …

Design And Implementation Of An Inverted Short Baseline Acoustic Positioning System, Jakob Frabosilio

Master's Theses

This document details the design, implementation, testing, and analysis of an inverted short baseline acoustic positioning system. The system presented here is an above-water, air-based prototype for an underwater acoustic positioning system; it is designed to determine the position of remotely-operated underwater vehicles (ROVs) and autonomous underwater vehicles (AUVs) in the global frame using a method that does not drift over time.

A ground-truth positioning system is constructed using a stacked hexapod platform actuator, which mimics the motion of an AUV and provides the true position of an ultrasonic microphone array. An ultrasonic transmitter sends a pulse of sound towards …

Robotic Odor Source Localization Using Vision And Olfaction Sensing, Sunzid Hassan

Master's Theses

Robotic Odor Source Localization (ROSL) technology allows autonomous agents like robots to find an odor source in unknown environments. A successful odor source location depends crucially on an effective navigation algorithm that directs the robot towards the odor source. This thesis is a combination of three projects. First, we detail development of a versatile multi-modal robotic platform for ROSL real-world ROSL experimentation and discussed real-world validation of a traditional olfactionbased ROSL algorithm. Secondly, we introduced vision in ROSL by proposing a fusion navigation algorithm that integrates deep-learning enabled vision and olfaction-based navigation. This hybrid approach tackles challenges such as turbulent …

Generalized Model To Enable Zero-Shot Imitation Learning For Versatile Robots, Yongshuai Wu

Master's Theses

The rapid advancement in Deep Learning (DL), especially in Reinforcement Learning (RL) and Imitation Learning (IL), has positioned it as a promising approach for a multitude of autonomous robotic systems. However, the current methodologies are predominantly constrained to singular setups, necessitating substantial data and extensive training periods. Moreover, these methods have exhibited suboptimal performance in tasks requiring long-horizontal maneuvers, such as Radio Frequency Identification (RFID) inventory, where a robot requires thousands of steps to complete.

In this thesis, we address the aforementioned challenges by presenting the Cross-modal Reasoning Model (CMRM), a novel zero-shot Imitation Learning policy, to tackle long-horizontal robotic …

Deep Learning Using Vision And Lidar For Global Robot Localization, Brett E. Gowling

Master's Theses

As the field of mobile robotics rapidly expands, precise understanding of a robot’s position and orientation becomes critical for autonomous navigation and efficient task performance. In this thesis, we present a snapshot-based global localization machine learning model for a mobile robot, the e-puck, in a simulated environment. Our model uses multimodal data to predict both position and orientation using the robot’s on-board cameras and LiDAR sensor. In an effort to minimize localization error, we explore different sensor configurations by varying the number of cameras and LiDAR layers used. Additionally, we investigate the performance benefits of different multimodal fusion strategies while …

A Study On Rapidly Exploring Random Tree Algorithms For Robot Path Planning, Sahil Sharma

Master's Theses

Robot path planning is a critical feature of autonomous systems. Rapidly-exploring Random Trees (RRT) is a path planning technique that randomly samples the robot configuration space to find a path between the start and end point. This thesis studies and compares the performance of four important RRT algorithms, namely, the original RRT, the optimal RRT (also termed RRT*), RRT*-Smart, and Informed RRT* for six different environments. The performance measures include the final path length (which is also the shortest path length found by each algorithm), time to find the first path, run time (of 1000 iterations) for each algorithm, total …

Panodepth – Panoramic Monocular Depth Perception Model And Framework, Adley K. Wong

Master's Theses

Depth perception has become a heavily researched area as companies and researchers are striving towards the development of self-driving cars. Self-driving cars rely on perceiving the surrounding area, which heavily depends on technology capable of providing the system with depth perception capabilities. In this paper, we explore developing a single camera (monocular) depth prediction model that is trained on panoramic depth images. Our model makes novel use of transfer learning efficient encoder models, pre-training on a larger dataset of flat depth images, and optimizing the model for use with a Jetson Nano. Additionally, we present a training and optimization framework …

Low-Cost Uav Swarm For Real-Time Object Detection Applications, Joel Valdovinos Miranda

Master's Theses

With unmanned aerial vehicles (UAVs), also known as drones, becoming readily available and affordable, applications for these devices have grown immensely. One type of application is the use of drones to fly over large areas and detect desired entities. For example, a swarm of drones could detect marine creatures near the surface of the ocean and provide users the location and type of animal found. However, even with the reduction in cost of drone technology, such applications result costly due to the use of custom hardware with built-in advanced capabilities. Therefore, the focus of this thesis is to compile an …

Snr: Software Library For Introductory Robotics, Spencer F. Shaw

Master's Theses

This thesis introduces "SNR," a Python library for programming robotic systems in the context of introductory robotics courses. Greater demand for roboticists has pressured educational institutions to expand robotics curricula. Students are now more likely to take robotics courses earlier and with less prior programming experience. Students may be attempting to simultaneously learn a systems programming language, a library API, and robotics concepts. SNR is written purely in Python to present familiar semantics, eliminating one of these learning curves. Industry standard robotics libraries such as ROS often require additional build tools and configuration languages. Students in introductory courses frequently lack …

Emergency Landing And Guidance System, Joseph Alarid

Master's Theses

Every year there are thousands of aviation accidents along with hundreds of human deaths that happen around the world. While the data is sparse, it is well documented that many of these happen from emergency landings gone awry. While pilots can generally make great landings in clear daytime conditions, they are significantly handicapped when it comes to landing at night or amongst poor visibility conditions.

Due to the nature of this problem and some of the large scale advances in software technology we propose a solution that provides a significant improvement from the status quo. Using transfer learning on neural …

Flexible Fault Tolerance For The Robot Operating System, Sukhman S. Marok

Master's Theses

The introduction of autonomous vehicles has the potential to reduce the number of accidents and save countless lives. These benefits can only be realized if autonomous vehicles can prove to be safer than human drivers. There is a large amount of active research around developing robust algorithms for all parts of the autonomous vehicle stack including sensing, localization, mapping, perception, prediction, planning, and control. Additionally, some of these research projects have involved the use of the Robot Operating System (ROS). However, another key aspect of realizing an autonomous vehicle is a fault-tolerant design that can ensure the safe operation of …

Decentralized, Noncooperative Multirobot Path Planning With Sample-Basedplanners, William Le

Master's Theses

In this thesis, the viability of decentralized, noncooperative multi-robot path planning algorithms is tested. Three algorithms based on the Batch Informed Trees (BIT*) algorithm are presented. The first of these algorithms combines Optimal Reciprocal Collision Avoidance (ORCA) with BIT*. The second of these algorithms uses BIT* to create a path which the robots then follow using an artificial potential field (APF) method. The final algorithm is a version of BIT* that supports replanning. While none of these algorithms take advantage of sharing information between the robots, the algorithms are able to guide the robots to their desired goals, with the …

Involuntary Signal-Based Grounding Of Civilian Unmanned Aerial Systems (Uas) In Civilian Airspace, Keith Conley

Master's Theses

This thesis investigates the involuntary signal-based grounding of civilian unmanned aerial systems (UAS) in unauthorized air spaces. The technique proposed here will forcibly land unauthorized UAS in a given area in such a way that the UAS will not be harmed, and the pilot cannot stop the landing. The technique will not involuntarily ground authorized drones which will be determined prior to the landing. Unauthorized airspaces include military bases, university campuses, areas affected by a natural disaster, and stadiums for public events. This thesis proposes an early prototype of a hardware-based signal based involuntary grounding technique to handle the problem …

An Application Of Sliding Mode Control To Model-Based Reinforcement Learning, Aaron Thomas Parisi

Master's Theses

The state-of-art model-free reinforcement learning algorithms can generate admissible controls for complicated systems with no prior knowledge of the system dynamics, so long as sufficient (oftentimes millions) of samples are available from the environ- ment. On the other hand, model-based reinforcement learning approaches seek to leverage known optimal or robust control to reinforcement learning tasks by mod- elling the system dynamics and applying well established control algorithms to the system model. Sliding-mode controllers are robust to system disturbance and modelling errors, and have been widely used for high-order nonlinear system control. This thesis studies the application of sliding mode control …

Utilizing Trajectory Optimization In The Training Of Neural Network Controllers, Nicholas Kimball

Master's Theses

Applying reinforcement learning to control systems enables the use of machine learning to develop elegant and efficient control laws. Coupled with the representational power of neural networks, reinforcement learning algorithms can learn complex policies that can be difficult to emulate using traditional control system design approaches. In this thesis, three different model-free reinforcement learning algorithms, including Monte Carlo Control, REINFORCE with baseline, and Guided Policy Search are compared in simulated, continuous action-space environments. The results show that the Guided Policy Search algorithm is able to learn a desired control policy much faster than the other algorithms. In the inverted pendulum …

Surveying Underwater Shipwrecks With Probabilistic Roadmaps, Amy Jeannette Lewis

Master's Theses

Almost two thirds of the Earth's surface is covered in ocean, and yet, only about 5% of it is mapped. There are an unknown amount of sunken ships, planes, and other artifacts hidden below the sea. Extensive search via boat and a sonar tow fish following a standard lawnmower pattern is used to identify sites of interest. Then, if a site has been determined to potentially be historically significant, the most common next step is a survey by either a human dive team or remotely operated vehicle. These are time consuming, error prone, and potentially dangerous options, but autonomous underwater …

Robot Navigation In Cluttered Environments With Deep Reinforcement Learning, Ryan Weideman

Master's Theses

The application of robotics in cluttered and dynamic environments provides a wealth of challenges. This thesis proposes a deep reinforcement learning based system that determines collision free navigation robot velocities directly from a sequence of depth images and a desired direction of travel. The system is designed such that a real robot could be placed in an unmapped, cluttered environment and be able to navigate in a desired direction with no prior knowledge. Deep Q-learning, coupled with the innovations of double Q-learning and dueling Q-networks, is applied. Two modifications of this architecture are presented to incorporate direction heading information that …

Comparison Of Lqr And Lqr-Mrac For Linear Tractor-Trailer Model, Kevin Richard Gasik

Master's Theses

The United States trucking industry is immense. Employing over three million drivers and traveling to every city in the country. Semi-Trucks travel millions of miles each week and encompass roads that civilians travel on. These vehicles should be safe and allow efficient travel for all. Autonomous vehicles have been discussed in controls for many decades. Now fleets of autonomous vehicles are beginning their integration into society. The ability to create an autonomous system requires domain and system specific knowledge. Approaches to implement a fully autonomous vehicle have been developed using different techniques in control systems such as Kalman Filters, Neural …

Towards Autonomous Localization Of An Underwater Drone, Nathan Sfard

Master's Theses

Autonomous vehicle navigation is a complex and challenging task. Land and aerial vehicles often use highly accurate GPS sensors to localize themselves in their environments. These sensors are ineffective in underwater environments due to signal attenuation. Autonomous underwater vehicles utilize one or more of the following approaches for successful localization and navigation: inertial/dead-reckoning, acoustic signals, and geophysical data. This thesis examines autonomous localization in a simulated environment for an OpenROV Underwater Drone using a Kalman Filter. This filter performs state estimation for a dead reckoning system exhibiting an additive error in location measurements. We evaluate the accuracy of this Kalman …

A Comparative Study Of Feature Detection Methods For Auv Localization, Andrew Y. Kim

Master's Theses

Underwater localization is a difficult task when it comes to making the system autonomous due to the unpredictable environment. The fact that radio signals such as GPS cannot be transmitted through water makes autonomous movement and localization underwater even more challenging. One specific method that is widely used for autonomous underwater navigation applications is Simultaneous Localization and Mapping (SLAM), a technique in which a map is created and updated while localizing the vehicle within the map. In SLAM, feature detection is used in landmark extraction and data association by examining each pixel and differentiating landmarks pixels from those of the …