Controls and Control Theory Commons^™

Training Uav Teams With Multi-Agent Reinforcement Learning Towards Fully 3d Autonomous Wildfire Response, Bryce Hopkins

All Theses

As climate-exacerbated wildfires increasingly threaten landscapes and communities, there is an urgent and pressing need for sophisticated fire management technologies. Coordinated teams of Unmanned Aerial Vehicles (UAVs) present a promising solution for detection, assessment, and even incipient-stage suppression – especially when integrated into a multi-layered approach with other recent wildfire management technologies such as geostationary/polar-orbiting satellites and CCTV detection networks. However, there remains significant challenges in developing the necessary sensing, navigation, coordination, and communication subsystems that enable intelligent UAV teams. Further, federal regulations governing UAV deployment and autonomy pose constraints on real-world aerial testing, creating a disconnect between theoretical research …

State Omniscience For Cooperative Local Catalog Maintenance Of Close Proximity Satellite Systems, Chris Hays

Doctoral Dissertations and Master's Theses

Resiliency in multi-agent system navigation is reliant on the inherent ability of the system to withstand, overcome, or recover from adverse conditions and disturbances. In large part, resiliency is achieved through reducing the impact of critical failure points to the success and/or performance of the system. In this view, decentralized multi-agent architectures have become an attractive solution for multi-agent navigation, but decentralized architectures place the burden of information acquisition directly on the agents themselves. In fact, the design of distributed estimators has been a growing interest to enable complex multi-sensor/multi-agent tasks. In such scenarios, it is important that each local …

Nonlinear Guidance And Control Of Unmanned Aerial Manipulators For Delivering A Payload On A Moving Platform, Ravi Gyawali

Mechanical and Aerospace Engineering Theses - Archive

Unmanned Aerial manipulators (UAMs) are a class of Unmanned Aerial Vehicles (UAVs) equipped with a manipulator. By combining the aerial mobility of a UAV with a manipulator's dexterity, these hybrid systems can perform a wide range of complex tasks while reducing risks and costs. As a result, they are increasingly being utilized for military, industrial, and agricultural applications.

The thesis presents a novel approach for a multi-UAM system to collaboratively deliver a payload on a stationary or maneuvering platform. A sliding-mode-based guidance law, sourced from existing literature, is integrated with a combined control technique for the UAVs and their respective …

On Uncertainty For Ill-Posed Robot Decision Problems, Jared Joseph Beard

Graduate Theses, Dissertations, and Problem Reports (ETD)

As robots adopt more real world responsibilities, they will be expected to solve more complicated problems. In some cases limited prior knowledge will result in unmodelled environmental conditions; in others, multiple users may have competing perspectives on how to frame a decision problem. Many existing frameworks, namely Markov decision processes (MDP) presuppose users have identified a specific problem with models sufficient to solve or learn a problem. If we wish to extend MDPs to novel problems or those heavily dependent on user feedback, autonomous decision makers must be able to identify limitations in how a given problem is framed and …

External Runtime Execution Monitoring Of A Cyber Physical System Via Trace Interfaces, Peter Vaughan Truslow

Theses and Dissertations

In the past two decades, Unmanned Aerial Systems have progressed from expensive military hardware or one-off custom builds, to include off-the-shelf drones that can be purchased for a rather affordable price and flown by nearly anyone. As the technology and performance have improved, the door is opened to applications that require operation in environments where the consequences for failure are high, such as operating in the navigable airspace or in urban environments, or with human passengers. This requires a great deal of trust in the reliability and integrity of the control systems of the aircraft. A method of monitoring the …

Implementing Associative Learning Using Neuromorphic Robot, Vinay Kumar Pillalamarri

Dissertations, Master's Theses and Master's Reports

Associative learning, a key cognitive process seen across the animal kingdom, enables organisms to form connections between stimuli and adapt their behaviors based on past experiences. A particularly powerful example is fear conditioning, where animals learn to associate a neutral stimulus with an aversive one, allowing them to predict and avoid potential threats. Inspired by this mechanism, this project implements associative learning on an unmanned ground vehicle (UGV) to develop adaptive behavior through neuromorphic principles. Utilizing Nengo for neural modeling, the UGV learns to associate visual (red color) and tactile (vibration) stimuli through Hebbian learning, a biologically inspired synaptic adaptation …

Autonomous Basketball Court Creation Robot, Bryce Haldeman, Tyler Gray, Dalon Vura

Williams Honors College, Honors Research Projects

The Autonomous Basketball Court Outlining System presents a comprehensive solution for precision court marking. Powered by a 24V lithium-ion battery and driven by a single ST microcontroller, the system autonomously marks the outline of a half basketball court using predefined algorithms. User-friendly features include easy loading of marking material, actuated by gravity or a small servo motor depending on material of choice, ensuring intuitive operation. Safety is prioritized, with the servo motor eliminating high-pressure concerns, and the system maintains a controlled speed accounting for user well-being. Two step and direction servo motors enable accurate linear displacement, facilitating straight lines, and …

Control Of Fully-Actuated Aerial Manipulators And Omni-Directional Multirotors, Riley M. Mccarthy

Mechanical Engineering ETDs

This thesis details the system modeling, design, control, simulation, construction, and
testing of both a fully-actuated and omni-directional multirotor aerial system created
for the primary purpose of performing active tasks with their environment. This work
verifies the capabilities of both systems through empirical testing, and demonstrates
how through the use of new control methods and physical designs multirotors can
expand their purpose from passive inspection based tasks to active contact based
tasks. These systems take advantage of newly implemented control allocation features present in the PX4 flight control software, version 1.14. The use of which makes designing controllers for such …

A Study On Rapidly Exploring Random Tree Algorithms For Robot Path Planning, Sahil Sharma

Master's Theses

Robot path planning is a critical feature of autonomous systems. Rapidly-exploring Random Trees (RRT) is a path planning technique that randomly samples the robot configuration space to find a path between the start and end point. This thesis studies and compares the performance of four important RRT algorithms, namely, the original RRT, the optimal RRT (also termed RRT*), RRT*-Smart, and Informed RRT* for six different environments. The performance measures include the final path length (which is also the shortest path length found by each algorithm), time to find the first path, run time (of 1000 iterations) for each algorithm, total …

Accurate Orientation Control Of Tendon Driven Continuum Robots That Exhibit Elasticity, Manu Srivastava

All Dissertations

This dissertation makes new contributions to the modeling and implementation of Tendon Driven Continuum Robots (TDCRs). Specifically, motivated by 3D printing of concrete using a continuum hose robot in construction applications, we focus on TDCRs featuring compliance in the robot backbone and actuating tendons, e.g. surgical robots/endoscopes/catheters with tendon actuation. We expand previous mechanics-based models to show how and why such compliance significantly restricts performance when traditional kinematics-based planning and control techniques are applied.

The main contribution of this work is a new Elasticity Compensation(EC) model that explains why the ad hoc approach of preloading/pretensioning the tendons compensates for compliance …

Using An Embedded System For A Quality Cup Of Coffee, Evan Powers, Joshua Stermer, Tsion Yohannes

2023 Symposium

Many coffee lovers spend up to $5 on a cup of coffee everyday. To save money one could make them at home, but a quality machine with PIDs start at $1000. Using an embedded system one could spend less than $50 and a few hours implement PIDs into an existing $400 machine that will last a lifetime. microcontroller. Learning C language combined with hardware implementation applied to cheap and simple everyday objects can improve everyday quality of life and save money.

This is challenging because we have to incorporate the additional circuitry into a pre established circuit with limited space, …

Modeling, Simulation And Control Of Microrobots For The Microfactory., Zhong Yang

Electronic Theses and Dissertations

Future assembly technologies will involve higher levels of automation in order to satisfy increased microscale or nanoscale precision requirements. Traditionally, assembly using a top-down robotic approach has been well-studied and applied to the microelectronics and MEMS industries, but less so in nanotechnology. With the boom of nanotechnology since the 1990s, newly designed products with new materials, coatings, and nanoparticles are gradually entering everyone’s lives, while the industry has grown into a billion-dollar volume worldwide. Traditionally, nanotechnology products are assembled using bottom-up methods, such as self-assembly, rather than top-down robotic assembly. This is due to considerations of volume handling of large …

Implementation Of Static Rfid Landmarks In Slam For Planogram Compliance, Brennan L. Drake

Honors College Theses

Autonomous robotic systems are becoming increasingly prevalent in everyday life and exhibit robust solutions in a wide range of applications. They face many obstacles with the foremost of which being SLAM, or Simultaneous Localization and Mapping, that encompasses both creation of the map of an unknown environment and localization of the robot in said environment. In this experiment, researchers propose the use of RFID tags in a semi-dynamic commercial environment to provide concrete landmarks for localization and mapping in pursuit of increased locational certainty. With this obtained, the ultimate goal of the research is to construct a robotics platform for …

Chatgpt As Metamorphosis Designer For The Future Of Artificial Intelligence (Ai): A Conceptual Investigation, Amarjit Kumar Singh (Library Assistant), Dr. Pankaj Mathur (Deputy Librarian)

Library Philosophy and Practice (e-journal)

Abstract

Purpose: The purpose of this research paper is to explore ChatGPT’s potential as an innovative designer tool for the future development of artificial intelligence. Specifically, this conceptual investigation aims to analyze ChatGPT’s capabilities as a tool for designing and developing near about human intelligent systems for futuristic used and developed in the field of Artificial Intelligence (AI). Also with the helps of this paper, researchers are analyzed the strengths and weaknesses of ChatGPT as a tool, and identify possible areas for improvement in its development and implementation. This investigation focused on the various features and functions of ChatGPT that …

Design And Fabrication Of A Force-Displacement Control Mechanism For Bone-Surgical Tool Testing, Kenneth Nwagu

College of Graduate Studies: Theses & Dissertations

This project focuses on the design and fabrication of an experimental setup for orthopedic-tool testing, tailored for a surgical instrumentation company. The multifaceted project encompasses a literature review, conceptual design, prototyping, and rigorous testing, resulting in a versatile control system capable of assessing various orthopedic tools, including bone drills, saws, burrs, and power handpieces.

Orthopedic surgical procedures (which include cutting and/or drilling into bone) often need to be performed on bones for faster recovery. The drilling and cutting process can cause an increase in temperature at the cutting site which can cause bone necrosis. The tools also need to be …

Improving The Flexibility And Robustness Of Machine Tending Mobile Robots, Richard Ethan Hollingsworth

Theses and Dissertations

While traditional manufacturing production cells consist of a fixed base robot repetitively performing tasks, the Industry 5.0 flexible manufacturing cell (FMC) aims to bring Autonomous Industrial Mobile Manipulators (AIMMs) to the factory floor. Composed of a wheeled base and a robot arm, these collaborative robots (cobots) operate alongside people while autonomously performing tasks at different workstations. AIMMs have been tested in real production systems, but the development of the control algorithms necessary for automating a robot that is a combination of two cobots remains an open challenge before the large scale adoption of this technology occurs in industry. Currently popular …

Real-Time Motion Controller For Human-Robot Teams Utilizing Artificial Potential Fields, Gabriella Graziani

Theses and Dissertations

This thesis presents a real-time robotic motion control system for human-robot teams. The framework utilizes artificial potential fields (APFs) to guide robotic agents towards a “goal” agent while navigating around “obstacle” agents; these goals and obstacles are also dynamic agents with their own set of tasks. This system is also developed for a live-programming environment, where a controlling agent updates the tasks of all agents within the system at any time during the system’s runtime. This motion controller was created and tested for a human-robot choreographic team. After the controller was fully integrated on a Trossen Robotic LoCobot Wx200 robotic …

Imitation Learning For Swarm Control Using Variational Inference, Hafeez Olafisayo Jimoh

Graduate Theses, Dissertations, and Problem Reports (ETD)

Swarms are groups of robots that can coordinate, cooperate, and communicate to achieve tasks that may be impossible for a single robot. These systems exhibit complex dynamical behavior, similar to those observed in physics, neuroscience, finance, biology, social and communication networks, etc. For instance, in Biology, schools of fish, swarm of bacteria, colony of termites exhibit flocking behavior to achieve simple and complex tasks. Modeling the dynamics of flocking in animals is challenging as we usually do not have full knowledge of the dynamics of the system and how individual agent interact. The environment of swarms is also very noisy …

Modeling, Control And Estimation Of Reconfigurable Cable Driven Parallel Robots, Adhiti Raman Thothathri

All Dissertations

The motivation for this thesis was to develop a cable-driven parallel robot (CDPR) as part of a two-part robotic device for concrete 3D printing. This research addresses specific research questions in this domain, chiefly, to present advantages offered by the addition of kinematic redundancies to CDPRs. Due to the natural actuation redundancy present in a fully constrained CDPR, the addition of internal mobility offers complex challenges in modeling and control that are not often encountered in literature.

This work presents a systematic analysis of modeling such kinematic redundancies through the application of reciprocal screw theory (RST) and Lie algebra while …

Multi-Robot Symbolic Task And Motion Planning Leveraging Human Trust Models: Theory And Applications, Huanfei Zheng

All Dissertations

Multi-robot systems (MRS) can accomplish more complex tasks with two or more robots and have produced a broad set of applications. The presence of a human operator in an MRS can guarantee the safety of the task performing, but the human operators can be subject to heavier stress and cognitive workload in collaboration with the MRS than the single robot. It is significant for the MRS to have the provable correct task and motion planning solution for a complex task. That can reduce the human workload during supervising the task and improve the reliability of human-MRS collaboration. This dissertation relies …

Event-Triggered Optimal Adaptive Control Of Partially Unknown Linear Continuous-Time Systems With State Delay, Rohollah Moghadam, Vignesh Narayanan, Sarangapani Jagannathan

Publications

This paper proposes an event-triggered optimal adaptive output feedback control design approach by utilizing integral reinforcement learning (IRL) for linear time-invariant systems with state delay and uncertain internal dynamics. In the proposed approach, the general optimal control problem is formulated into the game-theoretic framework by treating the event-triggering threshold and the optimal control policy as players. A cost function is defined and a value functional, which includes the delayed system output, is considered. First, by using the value functional and applying stationarity conditions using the Hamiltonian function, the output game delay algebraic Riccati equation (OGDARE) and optimal control policy are …

Developing A Miniature Smart Boat For Marine Research, Michael Isaac Eirinberg

Computer Engineering

This project examines the development of a smart boat which could serve as a possible marine research apparatus. The smart boat consists of a miniature vessel containing a low-cost microcontroller to live stream a camera feed, GPS telemetry, and compass data through its own WiFi access point. The smart boat also has the potential for autonomous navigation. My project captivated the interest of several members of California Polytechnic State University, San Luis Obispo’s (Cal Poly SLO) Marine Science Department faculty, who proposed a variety of fascinating and valuable smart boat applications.

Smartphone Control Of Rc Cars, Weston R. Fitzgerald

Electrical Engineering

The smartphone-controlled RC (remote-controlled) car is an inexpensive remote-controlled car designed to be fast and portable. Instead of manufacturing, packaging, and shipping a separate controller, the remote control is implemented in a phone application, which saves time and money in both the design process and the manufacturing process. Utilizing the user’s smartphone is more cost-effective since mobile devices are a common recurrence, and packaging fewer devices results in overall better portability of the product.

This smartphone-controlled car is speedy and intuitive to learn for typical smartphone users. The user can change the car’s speed and direction wirelessly using their phone; …

Control, Decision-Making, And Learning Approaches For Connected And Autonomous Driving Systems With Humans-In-The-Loop, Fangjian Li

All Dissertations

By virtue of vehicular connectivity and automation, the vehicle becomes increasingly intelligent and self-driving capable. However, no matter what automation level the vehicle can achieve, humans will still be in the loop despite their roles. First, considering the manual driving car as a disturbance to the connected and autonomous vehicles (CAVs), a novel string stability is proposed for mixed traffic platoons consisting of both autonomous and manual driving cars to guarantee acceptable motion fluctuation and platoon safety. Furthermore, humans are naturally considered as the rider in the passenger vehicle. A human-centered cooperative adaptive cruise control (CACC) is designed to improve …

Development Of A Compliant Gripper Driven By 3 Dof Soft Robot, Derek M. Price Ii, Ricardo Ramirez, Pt Angel Tran

Symposium of Student Scholars

Industrial robots are moving toward automation, which makes it increasingly necessary to replace the functions traditionally performed by humans with robotics. Pick and place operation is a prime example of such automation. Robots that pick up and place objects mimic the human action of picking an object up and placing it in a targeted location. It has led to the development of robotic end-effectors that have a human-like feel. Grippers can be articulated in various ways depending on their application area and well-defined desired tasks. As compliant and soft links deflect more under the same load than their rigid body …

Formation Control With Bounded Controls And Collision Avoidance: Theory And Application To Quadrotor Unmanned Air Vehicles, Zachary S. Lippay

Theses and Dissertations--Mechanical and Aerospace Engineering

This dissertation presents new results on multi-agent formation control and applies the new control algorithms to quadrotor unmanned air vehicles. First, this dissertation presents a formation control algorithm for double-integrator agents, where the formation is time varying and the agents’ controls satisfy a priori bounds (e.g., the controls accommodate actuator saturation). The main analytic results provide sufficient conditions such that all agents converge to the desired time-varying relative positions with one another and the leader, and have a priori bounded controls (if applicable). We also present results from rotorcraft experiments that demonstrate the algorithm with time-varying formations and bounded controls. …

Learning Robot Motion From Creative Human Demonstration, Charles C. Dietzel

Theses and Dissertations

This thesis presents a learning from demonstration framework that enables a robot to learn and perform creative motions from human demonstrations in real-time. In order to satisfy all of the functional requirements for the framework, the developed technique is comprised of two modular components, which integrate together to provide the desired functionality. The first component, called Dancing from Demonstration (DfD), is a kinesthetic learning from demonstration technique. This technique is capable of playing back newly learned motions in real-time, as well as combining multiple learned motions together in a configurable way, either to reduce trajectory error or to generate entirely …

Collaborative Human-Machine Interfaces For Mobile Manipulators., Shamsudeen Olawale Abubakar

Electronic Theses and Dissertations

The use of mobile manipulators in service industries as both agents in physical Human Robot Interaction (pHRI) and for social interactions has been on the increase in recent times due to necessities like compensating for workforce shortages and enabling safer and more efficient operations amongst other reasons. Collaborative robots, or co-bots, are robots that are developed for use with human interaction through direct contact or close proximity in a shared space with the human users. The work presented in this dissertation focuses on the design, implementation and analysis of components for the next-generation collaborative human machine interfaces (CHMI) needed for …

A Study Of Deep Reinforcement Learning In Autonomous Racing Using Deepracer Car, Mukesh Ghimire

Honors Theses

Reinforcement learning is thought to be a promising branch of machine learning that has the potential to help us develop an Artificial General Intelligence (AGI) machine. Among the machine learning algorithms, primarily, supervised, semi supervised, unsupervised and reinforcement learning, reinforcement learning is different in a sense that it explores the environment without prior knowledge, and determines the optimal action. This study attempts to understand the concept behind reinforcement learning, the mathematics behind it and see it in action by deploying the trained model in Amazon's DeepRacer car. DeepRacer, a 1/18^th scaled autonomous car, is the agent which is trained …

Path Planning With Deep Neural Networks, Paul Simmerling, Brendan Sayers, Paulo Alcantara Silva

Honors Scholar Theses

This report will cover the work and plans of the ECE 2107 Senior design team. The goal of the project is to design and build a fully autonomous self-driving car. This car will have a complete sensor suite including LIDAR, an IMU, a camera, and encoders. It will be based on a multi-level system where the highest level uses a neural network for advanced signal processing and analysis. The current state of the project is discussed as well as the final results. Project management and other constraints will be briefly investigated. This team is building a self driving car testbed …