Navigation, Guidance, Control and Dynamics Commons^™

High-Level Trajectory Learning For Non-Prehensile Object Manipulation With Hierarchical Reinforcement Learning, Gulsum Tuba Cibuk Girgin

Discovery Day - Daytona Beach

Site exploration requires in-situ resource utilization when the physical properties of resources are unknown. Therefore, a generalizable object manipulation method is crucial for extraterrestrial environments. Existing studies develop reinforcement learning policies that enable interaction with objects, in which quadruped robots learn to reach commanded goals with one foot while balancing with the remaining legs. However, in these studies, goal-oriented task execution relies on high-level trajectories provided by human experts, which limits autonomous robotic operations. In this study, we propose a hierarchical DRL in which a high-level pedipulation policy outputs commands for a low-level reach policy, enabling autonomous, smooth and affordable …

Lightweight Uav-To-Uav Detection And Tracking For Advanced Air Mobility Applications, Taylor Hostetter

Discovery Day - Daytona Beach

Lightweight UAV-to-UAV Detection and Tracking for Advanced Air Mobility Applications addresses the significant challenge of reliable UAV-to-UAV detection on resource-constrained platforms, particularly within Advanced Air Mobility (AAM) environments where dense, low-altitude airspace requires robust detect-and-avoid capabilities. This work presents the development and experimental evaluation of a lightweight detection and tracking framework for autonomous detect-and-avoid applications. The approach is designed to support real-time onboard operation in multi-vehicle environments characteristic of emerging AAM systems. The proposed framework integrates optical and LiDAR sensing with a low-complexity machine learning decision-support layer that reduces false detections without replacing the underlying control-oriented detection pipeline. This design …

Robust Real-Time Uav Target Tracking With Onboard Vision-Based Yaw Control, Rylan Malarchick, Jose Castelblanco, Enrique Amaya, Carmen Dimario, Graysen Brinkman, Chirag Kumar, Kiwon Yoon, Sajid Berhane

Beyond: Undergraduate Research Journal

Autonomous tracking of agile unmanned aerial vehicles (UAVs) presents significant challenges for real-time perception and control systems. This work presents AIRHOUND (Autonomous Intelligent Rotorcraft for Hostile Object Unified Navigation and Detection), a UAV platform implementing vision-based yaw tracking through a modular ROS2 software architecture. The system employs YOLOv8 object detection optimized with NVIDIA TensorRT for embedded deployment on an NVIDIA Jetson Orin companion computer. Detected targets are processed through a geometric tracking module that converts pixel coordinates to angular yaw errors using pinhole camera intrinsics, with a proportional controller generating rate-limited yaw commands. These commands are streamed to a PX4 …

Aircraft Fault Detection Via Weight And Bias Analysis Of A Custom First Neural Network Layer, George Harrison Chen

Theses and Dissertations

Fault detection in aircraft is traditionally handled through redundant hardware and comparison algorithms to detect failures. Alternatives like model-based residual generation and data-driven approaches such as supervised fault classification and unsupervised anomaly detection have been explored, but they suffer from practical limitations; model-based methods require accurate system models, and data-driven methods have large constraints on the data limiting scalability and adaptability. This work presents a purely data-driven neural network architecture featuring a custom first layer designed for real-time fault detection where the weights and biases of this layer are used to detect faults. The network requires zero supervision and complements …

Adaptive Artificial Potential Field Guidance And Control For Autonomous Docking With Uncooperative And Unknown Spacecraft, Steven Holmberg

Theses and Dissertations

The increasing demand for on-orbit servicing (OOS), active debris removal (ADR), and space domain awareness (SDA) missions has increased the need for autonomous spacecraft rendezvous and proximity operations (RPO) with uncooperative and unknown targets. Traditional guidance and control methods are typically designed for cooperative systems with known geometry and state information. This work builds on previous research to develop and evaluate an artificial potential field (APF)-based control framework capable of autonomous operation with minimal prior target knowledge and applicability to both relatively static and tumbling spacecraft.

The proposed APF formulation incorporates established safety constructs from cooperative docking systems, including an …

Application Of Reinforcement Learning To Precision Aerial Delivery System Control In Adverse Wind Conditions, Radman Zarbock

The Journal of Purdue Undergraduate Research

Precision aerial delivery systems (PADS) are a subset of airdropped parachute-leveraging package delivery systems that use autonomous guidance, navigation, and control (GNC) to reach targets with high degrees of accuracy. This technology emerged in the 1990s, and strides have been made since to improve the reliability of traditional physics-based controllers that guide PADS. However, these algorithms still struggle to deliver acceptable performance results when PADS are subjected to austere operating environments, such as those with unpredictable wind. Building on a foundational study in 2022 that used artificial intelligence (AI) and machine learning to improve PADS GNC performance, this study aims …

Amp: Single-Shot Ultra-Wide Fisheye-To-Cubemap Pnp Pose Estimation, Ryan M. Raettig, Richard R. Nyquist, Scott L. Nykl, Clark N. Taylor, Christine M. Schubert Kabban

Faculty Publications

Estimating the position and orientation of a rigid object from an image is critical for situational awareness in robotics and autonomous systems. This study explores relative pose estimation using an ultra-wide fisheye camera for unmanned aircraft inspection vehicles. Ultra-wide fisheye lenses introduce radial distortion and capture features beyond the rectilinear image plane, rendering rectilinear Perspective-n-Point (PnP) algorithms inadequate. Designing a bespoke ultra-wide fisheye localization algorithm requires consideration of both the feature detection method and the pose estimator itself. This study proposes a novel method that combines (1) a fisheye-to-cubemap reprojection, (2) a You Only Look Once (YOLO) convolutional neural network …

Parameter Informed Reinforcement Learning For Vehicle System Identification, Nathan Schaff

Doctoral Dissertations and Master's Theses

Accurate system identification is essential for modeling and controlling vehicle dynamics. This dissertation explores the application of Parameter Informed Reinforcement Learning (PIRL) as a novel approach to system identification (SYSID). PIRL integrates prior system knowledge, such as physical parameters, into reinforcement learning (RL) frameworks to improve estimation accuracy. The study begins with an overview of traditional SYSID methods and then introduces PIRL as a modification of standard RL. The research applies PIRL to short-period aircraft dynamics, demonstrating its effectiveness in both offline and online learning frameworks. The dissertation then further explores PIRL’s utility in an indirect model reference adaptive control …

Insights On Ai-Supported Uncrewed And Autonomous Systems Education, Brent A. Terwilliger Ph. D, John Faraca

Publications

Artificial Intelligence (AI) related technology is reshaping the educational experience in programs focused on uncrewed and autonomous systems, aviation, robotics, and aerospace, with growing implications for workforce readiness and cross-sector innovation. Early survey data, capturing student, educator, and employer perspectives, reveals that AI-supported tools are notably changing student engagement, communication, and skills development. Initial indications underscores the importance of AI proficiency and technological familiarity in hiring and workforce development, particularly in technical and operational roles. Key areas of focus include the use of AI to strengthen outreach and interactivity; enrich instruction through intelligent simulations; inform curricular improvements using data analytics; …

Satellite Reorientation Using Reinforcement Learning Under Unknown Attitude Failure, Matthew Willoughby

Doctoral Dissertations and Master's Theses

This study presents a reinforcement learning (RL) approach for reestablishing communication with deep-space satellites under unknown attitude determination and control system (ADCS) failures. When traditional fault-tolerant control methods cannot restore signal, the proposed RL controller acts as a last-resort measure by autonomously reorienting the satellite’s antenna toward Earth while charging the battery via solar panels. A generic reward function, designed for the RL-based method, enables the controller to adapt to diverse failure scenarios, including severe actuator noise, misalignment, and complete actuator failure. Simulations are conducted in the Basilisk environment and trained with the tonic framework and demonstrate ranging capabilities of …

Machine Learning Methods For Hypervelocity Fragment Flyout Characterization, Katharine Larsen

Doctoral Dissertations and Master's Theses

Resulting from breakup events, such as collisions and explosions, hypervelocity fragments create potential hazards for both terrestrial and on-orbit environments, such as terrestrial weapons explosions and satellite breakup events, respectively. To avoid unnecessary damage, an accurate understanding or characterization of hypervelocity fragmentation events is vital. Currently, publicly available two-line elements collected from on-orbit breakup events are limited, excluding pre-detonation parent body conditions, such as orientation, and information of smaller fragments. The uncertainty of these datasets varies between each collected set. Therefore, the overall goal of this work is to employ machine learning to estimate distribution characteristics of a space debris …

Robust Spacecraft Autonomy For Deep Space Exploration In Special Euclidean Group Se(3), Matthew Wittal

Doctoral Dissertations and Master's Theses

Over the past half-century, humanity has gained extensive experience conducting manned spaceflight near Earth. Arguably, "near Earth" could even include the Moon — the most distant destination humans have reached. However, "near" in this work primarily refers low Earth orbit (LEO). One could argue that we have not truly left Earth since the Apollo, as spacecraft in some LEOs remain subject to atmospheric drag thus emphasizing their continued connection to Earth's immediate environment. Reflecting on this, it becomes clear that humanity has largely remained bound to Earth’s immediate vicinity since the Apollo missions reached the Moon. However, that is set …

Choosing Robust Leadership: Encompassing The Best-Of-N Model And Swarm Intelligence Optimization For Heterogeneous Multiple Autonomous Unmanned Aerial Vehicle Systems, Kudamuhandiramlage Harith Kolitha Warnakulasooriya

Shelby Hall Graduate Research Forum Presentations

Presentation slides for a presentation given at the 1st annual Shelby Hall Graduate Research Forum at the University of South Alabama.

Mass-Adaptive Admittance Control For Robotic Manipulators, Hossein Gholampour, Jonathon E. Slightam, Logan E. Beaver

Mechanical & Aerospace Engineering Faculty Publications

Handling objects with unknown or changing masses is a common challenge in robotics, often leading to errors or instability if the control system cannot adapt in realtime. In this paper, we present a novel approach that enables a six-degrees-of-freedom robotic manipulator to reliably follow waypoints while automatically estimating and compensating for unknown payload weight. Our method integrates an admittance control framework with a mass estimator, allowing the robot to dynamically update an excitation force to compensate for the payload mass. This strategy mitigates end-effector sagging and preserves stability when handling objects of unknown weights. We experimentally validated our approach in …

Optimal Manipulation Motion Action Planner Enabled By Physics Informed Neural Networks, Jonathon E. Slightam, Logan E. Beaver

Mechanical & Aerospace Engineering Faculty Publications

Autonomous robotic manipulation in unstructured environments faces many challenges and is hindered by capabilities that bridge the gap between perception and acting on the world. Action plans that are centric to object motion rather than end-of-arm tooling behavior may aid this. This paper presents an autonomous action planner for a feedback linearizeable system comprised of three base motions that can be leveraged on their own or in combination to give custom motion plans. The optimization routine for the three different types of motion are presented, which are integrated into physics informed neural networks. A component of this is the autonomy …

Random Forests For Detecting Weak Signals And Extracting Physical Information: A Case Study Of Magnetic Navigation, Mohammadamin Moradi, Zheng-Meng Zhai, Aaron Nielsen, Ying-Cheng Lai, Aaron P. Nielsen

Faculty Publications

It has been recently demonstrated that two machine-learning architectures, reservoir computing and time-delayed feed-forward neural networks, can be exploited for detecting the Earth’s anomaly magnetic field immersed in overwhelming complex signals for magnetic navigation in a GPS-denied environment. The accuracy of the detected anomaly field corresponds to a positioning accuracy in the range of 10–40 m. To increase the accuracy and reduce the uncertainty of weak signal detection as well as to directly obtain the position information, we exploit the machine-learning model of random forests that combines the output of multiple decision trees to give optimal values of the physical …

Marss: Multi-Agent Reinforcement Learning For Satellite Swarms, Nicholas J. Yielding

Theses and Dissertations

Multi-agent systems and swarms in spacecraft formation flying are of ever-increasing importance in a contested space environment—use of multiple spacecraft to contribute to a cooperative mission potentially increases positive outcomes on orbit, while autonomy becomes an ever more important requirement to reduce reaction time in dynamic situations and lower the burden on space operators. This research explores difficult swarm Guidance Navigation and Control (GNC) scenarios using Deep Reinforcement Learning (DRL). DRL polices are trained to provide guidance inputs to agents in multi-agent swarm environments for completing complex, teamwork focused objectives in geosynchronous orbit. An example scenario is explored for a …

Online Aircraft System Identification Using A Novel Parameter Informed Reinforcement Learning Method, Nathan Schaff

Doctoral Dissertations and Master's Theses

This thesis presents the development and analysis of a novel method for training reinforcement learning neural networks for online aircraft system identification of multiple similar linear systems, such as all fixed wing aircraft. This approach, termed Parameter Informed Reinforcement Learning (PIRL), dictates that reinforcement learning neural networks should be trained using input and output trajectory/history data as is convention; however, the PIRL method also includes any known and relevant aircraft parameters, such as airspeed, altitude, center of gravity location and/or others. Through this, the PIRL Agent is better suited to identify novel/test-set aircraft.

First, the PIRL method is applied to …

Statistical Approach To Quantifying Interceptability Of Interaction Scenarios For Testing Autonomous Surface Vessels, Benjamin E. Hargis, Yiannis E. Papelis

Modeling, Simulation and Visualization Student Capstone Conference

This paper presents a probabilistic approach to quantifying interceptability of an interaction scenario designed to test collision avoidance of autonomous navigation algorithms. Interceptability is one of many measures to determine the complexity or difficulty of an interaction scenario. This approach uses a combined probability model of capability and intent to create a predicted position probability map for the system under test. Then, intercept-ability is quantified by determining the overlap between the system under test probability map and the intruder’s capability model. The approach is general; however, a demonstration is provided using kinematic capability models and an odometry-based intent model.

Artificial Intelligence-Enabled Exploratory Cyber-Physical Safety Analyzer Framework For Civilian Urban Air Mobility, Md. Shirajum Munir, Sumit Howlader Dipro, Kamrul Hasan, Tariqul Islam, Sachin Shetty

VMASC Publications

Urban air mobility (UAM) has become a potential candidate for civilization for serving smart citizens, such as through delivery, surveillance, and air taxis. However, safety concerns have grown since commercial UAM uses a publicly available communication infrastructure that enhances the risk of jamming and spoofing attacks to steal or crash crafts in UAM. To protect commercial UAM from cyberattacks and theft, this work proposes an artificial intelligence (AI)-enabled exploratory cyber-physical safety analyzer framework. The proposed framework devises supervised learning-based AI schemes such as decision tree, random forests, logistic regression, K-nearest neighbors (KNN), and long short-term memory (LSTM) for predicting and …

Assessing The Performance Of A Particle Swarm Optimization Mobility Algorithm In A Hybrid Wi-Fi/Lora Flying Ad Hoc Network, William David Paredes

UNF Graduate Theses and Dissertations

Research on Flying Ad-Hoc Networks (FANETs) has increased due to the availability of Unmanned Aerial Vehicles (UAVs) and the electronic components that control and connect them. Many applications, such as 3D mapping, construction inspection, or emergency response operations could benefit from an application and adaptation of swarm intelligence-based deployments of multiple UAVs. Such groups of cooperating UAVs, through the use of local rules, could be seen as network nodes establishing an ad-hoc network for communication purposes.

One FANET application is to provide communication coverage over an area where communication infrastructure is unavailable. A crucial part of a FANET implementation is …

Actively Guided Cansats For Assisting Localization And Mapping In Unstructured And Unknown Environments, Cary Chun, M. Hassan Tanveer

Symposium of Student Scholars

When navigating in unknown and unstructured environments, Unmanned Arial Vehicles (UAVs) can struggle when attempting to preform Simultaneous Localization and Mapping (SLAM) operations. Particularly challenging circumstance arise when an UAV may need to land or otherwise navigate through treacherous environments. As the primary UAV may be too large and unwieldly to safely investigate in these types of situations, this research effort proposes the use of actively guided CanSats for assisting in localization and mapping of unstructured environments. A complex UAV could carry multiple of these SLAM capable CanSats, and when additional mapping and localization capabilities where required, the CanSat would …

Scheduling, Complexity, And Solution Methods For Space Robot On-Orbit Servicing, Susan E. Sorenson

Graduate Theses and Dissertations

This research proposes problems, models, and solutions for the scheduling of space robot on-orbit servicing. We present the Multi-Orbit Routing and Scheduling of Refuellable On-Orbit Servicing Space Robots problem which considers on-orbit servicing across multiple orbits with moving tasks and moving refuelling depots. We formulate a mixed integer linear program model to optimize the routing and scheduling of robot servicers to accomplish on-orbit servicing tasks. We develop and demonstrate flexible algorithms for the creation of the model parameters and associated data sets. Our first algorithm creates the network arcs using orbital mechanics. We have also created a novel way to …

Artificial Intelligence, Controls, And Sensor Fusion For Optimization And Modeling Of Space Missions And Particle Accelerators, Reza Pirayeshshirazinezhad

Mechanical Engineering ETDs

This PhD dissertation is devoted to developing artificial intelligence (AI) applications for space missions and particle accelerators considering constraints on the computational resources. The space mission studied in this research, the Virtual Telescope for X-ray Observations (VTXO), is the mission exploiting 2 6U-CubeSats operating in a precision formation. The goal of the VTXO project is to develop a space-based, X-ray imaging telescope with high angular resolution precision. VTXO space mission is designed and the mission is optimized to increase the performance of the mission. Trajectory optimization with AI, hybrid control, control algorithms, and high performance computing are all used to …

Object Detection With Deep Learning To Accelerate Pose Estimation For Automated Aerial Refueling, Andrew T. Lee

Theses and Dissertations

Remotely piloted aircraft (RPAs) cannot currently refuel during flight because the latency between the pilot and the aircraft is too great to safely perform aerial refueling maneuvers. However, an AAR system removes this limitation by allowing the tanker to directly control the RP A. The tanker quickly finding the relative position and orientation (pose) of the approaching aircraft is the first step to create an AAR system. Previous work at AFIT demonstrates that stereo camera systems provide robust pose estimation capability. This thesis first extends that work by examining the effects of the cameras' resolution on the quality of pose …

Fast Decision-Making Under Time And Resource Constraints, Kyle Gabriel Lassak

Graduate Theses, Dissertations, and Problem Reports (ETD)

Practical decision makers are inherently limited by computational and memory resources as well as the time available in which to make decisions. To cope with these limitations, humans actively seek methods which limit their resource demands by exploiting structure within the environment and exploiting a coupling between their sensing and actuation to form heuristics for fast decision-making. To date, such behavior has not been replicated in artificial agents. This research explores how heuristics may be incorporated into the decision-making process to quickly make high-quality decisions through the analysis of a prominent case study: the outfielder problem. In the outfielder problem, …

A Co-Optimal Coverage Path Planning Method For Aerial Scanning Of Complex Structures, Zhexiong Shang, Justin Bradley, Zhigang Shen

Department of Construction Engineering and Management: Faculty Publications

The utilization of unmanned aerial vehicles (UAVs) in survey and inspection of civil infrastructure has been growing rapidly. However, computationally efficient solvers that find optimal flight paths while ensuring high-quality data acquisition of the complete 3D structure remains a difficult problem. Existing solvers typically prioritize efficient flight paths, or coverage, or reducing computational complexity of the algorithm – but these objectives are not co-optimized holistically. In this work we introduce a co-optimal coverage path planning (CCPP) method that simultaneously co-optimizes the UAV path, the quality of the captured images, and reducing computational complexity of the solver all while adhering to …

Autonomous Watercraft Simulation And Programming, Nicholas J. Savino

Undergraduate Theses and Capstone Projects

Automation of various modes of transportation is thought to make travel more safe and efficient. Over the past several decades advances to semi-autonomous and autonomous vehicles have led to advanced autopilot systems on planes and boats and an increasing popularity of self-driving cars. We simulated the motion of an autonomous vehicle using computational models. The simulation models the motion of a small-scale watercraft, which can then be built and programmed using an Arduino Microcontroller. We examined different control methods for a simulated rescue craft to reach a target. We also examined the effects of different factors, such as various biases …

Crop Height Estimation With Unmanned Aerial Vehicles, Carrick Detweiler, David Anthony, Sebastian Elbaum

School of Computing: Faculty Publications

An unmanned aerial vehicle (UAV) can be configured for crop height estimation. In some examples, the UAV includes an aerial propulsion system, a laser scanner configured to face downwards while the UAV is in flight, and a control system. The laser scanner is configured to scan through a two-dimensional scan angle and is characterized by a maxi mum range. The control system causes the UAV to fly over an agricultural field and maintain, using the aerial propulsion system and the laser scanner, a distance between the UAV and a top of crops in the agricultural field to within a programmed …

Cooperative 3-D Map Generation Using Multiple Uavs, Andrew Erik Lawson

University Scholar Projects

This report aims to demonstrate the feasibility of building a global 3-D map from multiple UAV robots in a GPS-denied, indoor environment. Presented are the design of each robot and the reasoning behind choosing its hardware and software components, the process in which a single robot obtains a individual 3-D map entirely onboard, and lastly how the mapping concept is extended to multiple robotic agents to form a global 3-D map using a centralized server. In the latter section, this report focuses on two algorithms, Online Mapping and Map Fusion, developed to facilitate the cooperative approach. A limited selection …