Robotics Commons^™

Generalized Model To Enable Zero-Shot Imitation Learning For Versatile Robots, Yongshuai Wu

Master's Theses

The rapid advancement in Deep Learning (DL), especially in Reinforcement Learning (RL) and Imitation Learning (IL), has positioned it as a promising approach for a multitude of autonomous robotic systems. However, the current methodologies are predominantly constrained to singular setups, necessitating substantial data and extensive training periods. Moreover, these methods have exhibited suboptimal performance in tasks requiring long-horizontal maneuvers, such as Radio Frequency Identification (RFID) inventory, where a robot requires thousands of steps to complete.

In this thesis, we address the aforementioned challenges by presenting the Cross-modal Reasoning Model (CMRM), a novel zero-shot Imitation Learning policy, to tackle long-horizontal robotic …

Summonable Construction Delivery Robot, Kevin M. Lewis

Honors Capstones

In many different construction industries, there is a need for tools, parts, and other necessary items to be transported quickly and efficiently over various types of terrain. Human resources have often been used to address these needs, which can become very time and cost inefficient over long periods. The design proposal here is aimed at addressing this need by developing an autonomous outdoor mobile robot based on a quadrupedal robot design. This approach differs by incorporating a wheeled and quadrupedal hybrid actuation system that provides terrain negotiation and speed at the appropriate times. The team uses Robot Operating System (ROS) …

State Omniscience For Cooperative Local Catalog Maintenance Of Close Proximity Satellite Systems, Chris Hays

Doctoral Dissertations and Master's Theses

Resiliency in multi-agent system navigation is reliant on the inherent ability of the system to withstand, overcome, or recover from adverse conditions and disturbances. In large part, resiliency is achieved through reducing the impact of critical failure points to the success and/or performance of the system. In this view, decentralized multi-agent architectures have become an attractive solution for multi-agent navigation, but decentralized architectures place the burden of information acquisition directly on the agents themselves. In fact, the design of distributed estimators has been a growing interest to enable complex multi-sensor/multi-agent tasks. In such scenarios, it is important that each local …

The Integration Of Neuromorphic Computing In Autonomous Robotic Systems, Md Abu Bakr Siddique

Dissertations, Master's Theses and Master's Reports

Deep Neural Networks (DNNs) have come a long way in many cognitive tasks by training on large, labeled datasets. However, this method has problems in places with limited data and energy, like when planetary robots are used or when edge computing is used [1]. In contrast to this data-heavy approach, animals demonstrate an innate ability to learn by communicating with their environment and forming associative memories among events and entities, a process known as associative learning [2-4]. For instance, rats in a T-maze learn to associate different stimuli with outcomes through exploration without needing labeled data [5]. This learning paradigm …

Efficient Connectivity Management And Path Planning For Iot And Uav Networks, Amirahmad Chapnevis

Theses and Dissertations

This dissertation explores how to better manage resources in mobile networks, especially for enhancing the performance of Unmanned Aerial Vehicles (UAV)-supported IoT networks. We explored ways to set up a flexible communication architecture that can handle large IoT deployments by making good use of mobile core network resources like bearers and data paths. We developed strategies that meet the needs of IoT networks and enhance network performance. We also developed and tested a system that combines traffic from several mobile devices that use the same user identity and network resources within the core mobile network. We used everyday smartphones, SIM …

Control Of Fully-Actuated Aerial Manipulators And Omni-Directional Multirotors, Riley M. Mccarthy

Mechanical Engineering ETDs

This thesis details the system modeling, design, control, simulation, construction, and
testing of both a fully-actuated and omni-directional multirotor aerial system created
for the primary purpose of performing active tasks with their environment. This work
verifies the capabilities of both systems through empirical testing, and demonstrates
how through the use of new control methods and physical designs multirotors can
expand their purpose from passive inspection based tasks to active contact based
tasks. These systems take advantage of newly implemented control allocation features present in the PX4 flight control software, version 1.14. The use of which makes designing controllers for such …

A Modular Framework For Surface-Embedded Actuation And Optical Sensing In Soft Robots., Paul Bupe Jr

Electronic Theses and Dissertations

This dissertation explores the development and integration of modular technologies in soft robotics, with a focus on the OptiGap sensor system. OptiGap serves as a simple, flexible, cost-effective solution for real-time sensing of bending and deformation, validated through simulation and experimentation. Working as part of an emerging category of soft robotics called Soft, Curved, Reconfigurable, Anisotropic Mechanisms, or SCRAMs, this research also introduces the Thermally-Activated SCRAM Limb (TASL) technology, which employs shape-memory alloy (SMA) wire embedded in curved sheets for surface actuation and served as the initial inspiration for OptiGap. In addition, the EneGate system is presented as a complementary …

Accelerating Machine Learning Inference For Satellite Component Feature Extraction Using Fpgas., Andrew Ekblad

Theses and Dissertations

Running computer vision algorithms requires complex devices with lots of computing power, these types of devices are not well suited for space deployment. The harsh radiation environment and limited power budgets have hindered the ability of running advanced computer vision algorithms in space. This problem makes running an on-orbit servicing detection algorithm very difficult. This work proposes using a low powered FPGA to accelerate the computer vision algorithms that enable satellite component feature extraction. This work uses AMD/Xilinx’s Zynq SoC and DPU IP to run model inference. Experiments in this work centered around improving model post processing by creating implementations …

Modeling And Compensating Of Noise In Time-Of-Flight Sensors, Bryan Rodriguez

Electrical Engineering Theses and Dissertations

Three-dimensional (3D) sensors provide the ability to perform contactless measurements of objects and distances that are within their field of view. Unlike traditional two-dimensional (2D) cameras, which only provide RGB data about objects within a scene, 3D sensors are able to directly provide depth information for objects within a scene. Of these 3D sensing technologies, Time-of-Flight (ToF) sensors are becoming more compact which allows them to be more easily integrated with other devices and to find use in more applications. ToF sensors also provide several benefits over other 3D sensing technologies that increase the types of applications where ToF sensors …

Evaluating Eeg–Emg Fusion-Based Classification As A Method For Improving Control Of Wearable Robotic Devices For Upper-Limb Rehabilitation, Jacob G. Tryon

Electronic Thesis and Dissertation Repository

Musculoskeletal disorders are the biggest cause of disability worldwide, and wearable mechatronic rehabilitation devices have been proposed for treatment. However, before widespread adoption, improvements in user control and system adaptability are required. User intention should be detected intuitively, and user-induced changes in system dynamics should be unobtrusively identified and corrected. Developments often focus on model-dependent nonlinear control theory, which is challenging to implement for wearable devices.

One alternative is to incorporate bioelectrical signal-based machine learning into the system, allowing for simpler controller designs to be augmented by supplemental brain (electroencephalography/EEG) and muscle (electromyography/EMG) information. To extract user intention better, sensor …

Development Of A Soft Robotic Approach For An Intra-Abdominal Wireless Laparoscopic Camera, Hui Liu

Doctoral Dissertations

In Single-Incision Laparoscopic Surgery (SILS), the Magnetic Anchoring and Guidance System (MAGS) arises as a promising technique to provide larger workspaces and field of vision for the laparoscopes, relief space for other instruments, and require fewer incisions. Inspired by MAGS, many concept designs related to fully insertable magnetically driven laparoscopes are developed and tested on the transabdominal operation. However, ignoring the tissue interaction and insertion procedure, most of the designs adopt rigid structures, which not only damage the patients' tissue with excess stress concentration and sliding motion but also require complicated operation for the insertion. Meanwhile, lacking state tracking of …

Modeling, Simulation And Control Of Microrobots For The Microfactory., Zhong Yang

Electronic Theses and Dissertations

Future assembly technologies will involve higher levels of automation in order to satisfy increased microscale or nanoscale precision requirements. Traditionally, assembly using a top-down robotic approach has been well-studied and applied to the microelectronics and MEMS industries, but less so in nanotechnology. With the boom of nanotechnology since the 1990s, newly designed products with new materials, coatings, and nanoparticles are gradually entering everyone’s lives, while the industry has grown into a billion-dollar volume worldwide. Traditionally, nanotechnology products are assembled using bottom-up methods, such as self-assembly, rather than top-down robotic assembly. This is due to considerations of volume handling of large …

Implementation Of Static Rfid Landmarks In Slam For Planogram Compliance, Brennan L. Drake

Honors College Theses

Autonomous robotic systems are becoming increasingly prevalent in everyday life and exhibit robust solutions in a wide range of applications. They face many obstacles with the foremost of which being SLAM, or Simultaneous Localization and Mapping, that encompasses both creation of the map of an unknown environment and localization of the robot in said environment. In this experiment, researchers propose the use of RFID tags in a semi-dynamic commercial environment to provide concrete landmarks for localization and mapping in pursuit of increased locational certainty. With this obtained, the ultimate goal of the research is to construct a robotics platform for …

Process Automation And Robotics Engineering For Industrial Processing Systems, Drake Stimpson

USF Tampa Graduate Theses and Dissertations

Automation in industrial systems applications has emerged as the fundamental solution for improving quality, production rate, and efficiency of a process. Much of the recent popularity surrounding the transition of processes from manually operated tasks to automated systems can be attributed to the concept of Industry 4.0, which outlines the fundamental guidelines for integrating cyber-physical systems into industrial processes. Due to rapid advancement of technology in robotics and automation as well as the increase in accessibility of resources to this technology, the capability to develop automated systems has become feasible for small-scale enterprise. This work presents a two-part initiative to …

Parallel Real Time Rrt*: An Rrt* Based Path Planning Process, David Yackzan

Theses and Dissertations--Mechanical Engineering

This thesis presents a new parallelized real-time path planning process. This process is an extension of the Real-Time Rapidly Exploring Random Trees* (RT-RRT*) algorithm developed by Naderi et al in 2015 [1]. The RT-RRT* algorithm was demonstrated on a simulated two-dimensional dynamic environment while finding paths to a varying target state. We demonstrate that the original algorithm is incapable of running at a sufficient rate for control of a 7-degree-of-freedom (7-DoF) robotic arm while maintaining a path planning tree in 7 dimensions. This limitation is due to the complexity of maintaining a tree in a high-dimensional space and the network …

A Path Planning Framework For Multi-Agent Robotic Systems Based On Multivariate Skew-Normal Distributions, Peter Estephan

Theses, Dissertations and Capstones

This thesis presents a path planning framework for a very-large-scale robotic (VLSR) system in an known obstacle environment, where the time-varying distributions of agents are applied to represent the multi-agent robotic system (MARS). A novel family of the multivariate skew-normal (MVSN) distributions is proposed based on the Bernoulli random field (BRF) referred to as the Bernoulli-random-field based skew-normal (BRF-SN) distribution. The proposed distributions are applied to model the agents’ distributions in an obstacle-deployed environment, where the obstacle effect is represented by a skew function and separated from the no-obstacle agents’ distributions. First, the obstacle layout is represented by a Hilbert …

Artificial Emotional Intelligence In Socially Assistive Robots, Hojjat Abdollahi

Electronic Theses and Dissertations

Artificial Emotional Intelligence (AEI) bridges the gap between humans and machines by demonstrating empathy and affection towards each other. This is achieved by evaluating the emotional state of human users, adapting the machine’s behavior to them, and hence giving an appropriate response to those emotions. AEI is part of a larger field of studies called Affective Computing. Affective computing is the integration of artificial intelligence, psychology, robotics, biometrics, and many more fields of study. The main component in AEI and affective computing is emotion, and how we can utilize emotion to create a more natural and productive relationship between humans …

Evaluation Of Lidar Uncertainty And Applications Towards Slam In Off-Road Environments, Zachary D. Jeffries

Dissertations, Master's Theses and Master's Reports

Safe and robust operation of autonomous ground vehicles in all types of conditions and environment necessitates complex perception systems and unique, innovative solutions. This work addresses automotive lidar and maximizing the performance of a simultaneous localization and mapping stack. An exploratory experiment and an open benchmarking experiment are both presented. Additionally, a popular SLAM application is extended to use the type of information gained from lidar characterization, demonstrating the performance gains and necessity to tightly couple perception software and sensor hardware. The first exploratory experiment collects data from child-sized, low-reflectance targets over a range from 15 m to 35 m. …

Imitation Learning For Swarm Control Using Variational Inference, Hafeez Olafisayo Jimoh

Graduate Theses, Dissertations, and Problem Reports

Swarms are groups of robots that can coordinate, cooperate, and communicate to achieve tasks that may be impossible for a single robot. These systems exhibit complex dynamical behavior, similar to those observed in physics, neuroscience, finance, biology, social and communication networks, etc. For instance, in Biology, schools of fish, swarm of bacteria, colony of termites exhibit flocking behavior to achieve simple and complex tasks. Modeling the dynamics of flocking in animals is challenging as we usually do not have full knowledge of the dynamics of the system and how individual agent interact. The environment of swarms is also very noisy …

Improving The Flexibility And Robustness Of Machine Tending Mobile Robots, Richard Ethan Hollingsworth

Theses and Dissertations

While traditional manufacturing production cells consist of a fixed base robot repetitively performing tasks, the Industry 5.0 flexible manufacturing cell (FMC) aims to bring Autonomous Industrial Mobile Manipulators (AIMMs) to the factory floor. Composed of a wheeled base and a robot arm, these collaborative robots (cobots) operate alongside people while autonomously performing tasks at different workstations. AIMMs have been tested in real production systems, but the development of the control algorithms necessary for automating a robot that is a combination of two cobots remains an open challenge before the large scale adoption of this technology occurs in industry. Currently popular …

Neuromorphic Computing Applications In Robotics, Noah Zins

Dissertations, Master's Theses and Master's Reports

Deep learning achieves remarkable success through training using massively labeled datasets. However, the high demands on the datasets impede the feasibility of deep learning in edge computing scenarios and suffer from the data scarcity issue. Rather than relying on labeled data, animals learn by interacting with their surroundings and memorizing the relationships between events and objects. This learning paradigm is referred to as associative learning. The successful implementation of associative learning imitates self-learning schemes analogous to animals which resolve the challenges of deep learning. Current state-of-the-art implementations of associative memory are limited to simulations with small-scale and offline paradigms. Thus, …

Design And Fabrication Of A Force-Displacement Control Mechanism For Bone-Surgical Tool Testing, Kenneth Nwagu

Electronic Theses and Dissertations

This project focuses on the design and fabrication of an experimental setup for orthopedic-tool testing, tailored for a surgical instrumentation company. The multifaceted project encompasses a literature review, conceptual design, prototyping, and rigorous testing, resulting in a versatile control system capable of assessing various orthopedic tools, including bone drills, saws, burrs, and power handpieces.

Orthopedic surgical procedures (which include cutting and/or drilling into bone) often need to be performed on bones for faster recovery. The drilling and cutting process can cause an increase in temperature at the cutting site which can cause bone necrosis. The tools also need to be …

Modeling, Control And Estimation Of Reconfigurable Cable Driven Parallel Robots, Adhiti Raman Thothathri

All Dissertations

The motivation for this thesis was to develop a cable-driven parallel robot (CDPR) as part of a two-part robotic device for concrete 3D printing. This research addresses specific research questions in this domain, chiefly, to present advantages offered by the addition of kinematic redundancies to CDPRs. Due to the natural actuation redundancy present in a fully constrained CDPR, the addition of internal mobility offers complex challenges in modeling and control that are not often encountered in literature.

This work presents a systematic analysis of modeling such kinematic redundancies through the application of reciprocal screw theory (RST) and Lie algebra while …

Material Characterization And Comparison Of Sol-Gel Deposited And Rf Magnetron Deposited Lead Zirconate Titanate Thin Films, Katherine Lynne Miles

Mechanical Engineering ETDs

Lead zirconate titanate (PZT) has been a material of interest for sensor, actuator, and transducer applications in microelectromechanical systems (MEMS). This is due to their favorable piezoelectric, pyroelectric and ferroelectric properties. While various methods are available to deposit PZT thin films, radio frequency (RF) magnetron sputtering was selected to provide high quality PZT films with the added capability of batch processing. These sputter deposited PZT films were characterized to determine their internal film stress, Young’s modulus, composition, and structure. After characterization, the sputtered PZT samples were poled using corona poling and direct poling methods. As a means of comparison, commercially …

Multi-Robot Symbolic Task And Motion Planning Leveraging Human Trust Models: Theory And Applications, Huanfei Zheng

All Dissertations

Multi-robot systems (MRS) can accomplish more complex tasks with two or more robots and have produced a broad set of applications. The presence of a human operator in an MRS can guarantee the safety of the task performing, but the human operators can be subject to heavier stress and cognitive workload in collaboration with the MRS than the single robot. It is significant for the MRS to have the provable correct task and motion planning solution for a complex task. That can reduce the human workload during supervising the task and improve the reliability of human-MRS collaboration. This dissertation relies …

Device Free Indoor Localization Of Human Target Using Wifi Fingerprinting, Prasanga Neupane

LSU Master's Theses

Indoor localization of human objects has many important applications nowadays. Proposed here is a new device free approach where all the transceiver devices are fixed in an indoor environment so that the human target doesn't need to carry any transceiver device with them. This work proposes radio-frequency fingerprinting for the localization of human targets which makes this even more convenient as radio-frequency wireless signals can be easily acquired using an existing wireless network in an indoor environment. This work explores different avenues for optimal and effective placement of transmitter devices for better localization. In this work, an experimental environment is …

Reduced Fuel Emissions Through Connected Vehicles And Truck Platooning, Paul D. Brummitt

Electronic Theses and Dissertations

Vehicle-to-infrastructure (V2I) and vehicle-to-vehicle (V2V) communication enable the sharing, in real time, of vehicular locations and speeds with other vehicles, traffic signals, and traffic control centers. This shared information can help traffic to better traverse intersections, road segments, and congested neighborhoods, thereby reducing travel times, increasing driver safety, generating data for traffic planning, and reducing vehicular pollution. This study, which focuses on vehicular pollution, used an analysis of data from NREL, BTS, and the EPA to determine that the widespread use of V2V-based truck platooning—the convoying of trucks in close proximity to one another so as to reduce air drag …

Collaborative Robotics Strategies For Handling Non-Repetitive Micro-Drilling Tasks Characterized By Low Structural Mechanical Impedance, Xiangyu Wang

Mechanical & Aerospace Engineering Theses & Dissertations

Mechanical micro-drilling finds widespread use in diverse applications ranging from advanced manufacturing to medical surgery. This dissertation aims to develop techniques that allow programming of robots to perform effective micro-drilling tasks. Accomplishing this goal is faced with several challenges. Micro-drills suffer from frequent breakage caused from variations in drill process parameters. Micro-drilling tasks afford extremely low feed rates and almost zero tolerance for any feed rate variations. The accompanying robot programming task is made difficult as mathematical models that capture the micro-drilling process complexities and sensitive variations in micro-drill parameters are highly difficult to obtain. Therefore, an experimental approach is …

Dual-Axis Precision Imager, Gary Huarng

Computer Engineering

The Dual-Axis Precision Imager (DAPI) is a drawing robot that processes images and draws them on a whiteboard. The system has two modes: a Sobel filter mode that finds the edges of the input image with a Sobel filter, and a tri-tone grayscale mode that approximates the shading of the input image with the colors white, gray, and black. The DAPI consists of an Arduino-controlled XY gantry system with a pen mounted on the gantry head, and a Processing IDE program that processes the original image, converts the processed image into gantry instructions, and sends them to the Arduino for …

Developing A Miniature Smart Boat For Marine Research, Michael Isaac Eirinberg

Computer Engineering

This project examines the development of a smart boat which could serve as a possible marine research apparatus. The smart boat consists of a miniature vessel containing a low-cost microcontroller to live stream a camera feed, GPS telemetry, and compass data through its own WiFi access point. The smart boat also has the potential for autonomous navigation. My project captivated the interest of several members of California Polytechnic State University, San Luis Obispo’s (Cal Poly SLO) Marine Science Department faculty, who proposed a variety of fascinating and valuable smart boat applications.