Navigation, Guidance, Control and Dynamics Commons^™

High-Level Trajectory Learning For Non-Prehensile Object Manipulation With Hierarchical Reinforcement Learning, Gulsum Tuba Cibuk Girgin

Discovery Day - Daytona Beach

Site exploration requires in-situ resource utilization when the physical properties of resources are unknown. Therefore, a generalizable object manipulation method is crucial for extraterrestrial environments. Existing studies develop reinforcement learning policies that enable interaction with objects, in which quadruped robots learn to reach commanded goals with one foot while balancing with the remaining legs. However, in these studies, goal-oriented task execution relies on high-level trajectories provided by human experts, which limits autonomous robotic operations. In this study, we propose a hierarchical DRL in which a high-level pedipulation policy outputs commands for a low-level reach policy, enabling autonomous, smooth and affordable …

Lightweight Uav-To-Uav Detection And Tracking For Advanced Air Mobility Applications, Taylor Hostetter

Discovery Day - Daytona Beach

Lightweight UAV-to-UAV Detection and Tracking for Advanced Air Mobility Applications addresses the significant challenge of reliable UAV-to-UAV detection on resource-constrained platforms, particularly within Advanced Air Mobility (AAM) environments where dense, low-altitude airspace requires robust detect-and-avoid capabilities. This work presents the development and experimental evaluation of a lightweight detection and tracking framework for autonomous detect-and-avoid applications. The approach is designed to support real-time onboard operation in multi-vehicle environments characteristic of emerging AAM systems. The proposed framework integrates optical and LiDAR sensing with a low-complexity machine learning decision-support layer that reduces false detections without replacing the underlying control-oriented detection pipeline. This design …

Machine Learning For Predictive Energy And Emissions Modeling Of Vehicles And Power Grids In The United States, S M Tanvir Faysal Alam Chowdhoury

Dissertations

The environmental benefits of electric vehicle (EV) adoption depend on more than replacing internal combustion engine vehicles with electric powertrains. EV adoption reshapes electricity demand, interacts with regional generation mixes, and influences travel behavior and congestion, creating a coupled transportation-energy system in which vehicle and power-plant emissions must be evaluated together. This dissertation develops machine-learning frameworks for predicting energy consumption and emissions from vehicles and power grids under rising EV adoption. The first component forecasts grid emissions from EV charging. Using simulation data from NREL's Cambium database, a Prophet-based time-series framework predicts carbon dioxide, nitrous oxide, and methane emission rates …

Robust Real-Time Uav Target Tracking With Onboard Vision-Based Yaw Control, Rylan Malarchick, Jose Castelblanco, Enrique Amaya, Carmen Dimario, Graysen Brinkman, Chirag Kumar, Kiwon Yoon, Sajid Berhane

Beyond: Undergraduate Research Journal

Autonomous tracking of agile unmanned aerial vehicles (UAVs) presents significant challenges for real-time perception and control systems. This work presents AIRHOUND (Autonomous Intelligent Rotorcraft for Hostile Object Unified Navigation and Detection), a UAV platform implementing vision-based yaw tracking through a modular ROS2 software architecture. The system employs YOLOv8 object detection optimized with NVIDIA TensorRT for embedded deployment on an NVIDIA Jetson Orin companion computer. Detected targets are processed through a geometric tracking module that converts pixel coordinates to angular yaw errors using pinhole camera intrinsics, with a proportional controller generating rate-limited yaw commands. These commands are streamed to a PX4 …

Aircraft Fault Detection Via Weight And Bias Analysis Of A Custom First Neural Network Layer, George Harrison Chen

Theses and Dissertations

Fault detection in aircraft is traditionally handled through redundant hardware and comparison algorithms to detect failures. Alternatives like model-based residual generation and data-driven approaches such as supervised fault classification and unsupervised anomaly detection have been explored, but they suffer from practical limitations; model-based methods require accurate system models, and data-driven methods have large constraints on the data limiting scalability and adaptability. This work presents a purely data-driven neural network architecture featuring a custom first layer designed for real-time fault detection where the weights and biases of this layer are used to detect faults. The network requires zero supervision and complements …

Adaptive Artificial Potential Field Guidance And Control For Autonomous Docking With Uncooperative And Unknown Spacecraft, Steven Holmberg

Theses and Dissertations

The increasing demand for on-orbit servicing (OOS), active debris removal (ADR), and space domain awareness (SDA) missions has increased the need for autonomous spacecraft rendezvous and proximity operations (RPO) with uncooperative and unknown targets. Traditional guidance and control methods are typically designed for cooperative systems with known geometry and state information. This work builds on previous research to develop and evaluate an artificial potential field (APF)-based control framework capable of autonomous operation with minimal prior target knowledge and applicability to both relatively static and tumbling spacecraft.

The proposed APF formulation incorporates established safety constructs from cooperative docking systems, including an …

Application Of Reinforcement Learning To Precision Aerial Delivery System Control In Adverse Wind Conditions, Radman Zarbock

The Journal of Purdue Undergraduate Research

Precision aerial delivery systems (PADS) are a subset of airdropped parachute-leveraging package delivery systems that use autonomous guidance, navigation, and control (GNC) to reach targets with high degrees of accuracy. This technology emerged in the 1990s, and strides have been made since to improve the reliability of traditional physics-based controllers that guide PADS. However, these algorithms still struggle to deliver acceptable performance results when PADS are subjected to austere operating environments, such as those with unpredictable wind. Building on a foundational study in 2022 that used artificial intelligence (AI) and machine learning to improve PADS GNC performance, this study aims …

Amp: Single-Shot Ultra-Wide Fisheye-To-Cubemap Pnp Pose Estimation, Ryan M. Raettig, Richard R. Nyquist, Scott L. Nykl, Clark N. Taylor, Christine M. Schubert Kabban

Faculty Publications

Estimating the position and orientation of a rigid object from an image is critical for situational awareness in robotics and autonomous systems. This study explores relative pose estimation using an ultra-wide fisheye camera for unmanned aircraft inspection vehicles. Ultra-wide fisheye lenses introduce radial distortion and capture features beyond the rectilinear image plane, rendering rectilinear Perspective-n-Point (PnP) algorithms inadequate. Designing a bespoke ultra-wide fisheye localization algorithm requires consideration of both the feature detection method and the pose estimator itself. This study proposes a novel method that combines (1) a fisheye-to-cubemap reprojection, (2) a You Only Look Once (YOLO) convolutional neural network …

Parameter Informed Reinforcement Learning For Vehicle System Identification, Nathan Schaff

Doctoral Dissertations and Master's Theses

Accurate system identification is essential for modeling and controlling vehicle dynamics. This dissertation explores the application of Parameter Informed Reinforcement Learning (PIRL) as a novel approach to system identification (SYSID). PIRL integrates prior system knowledge, such as physical parameters, into reinforcement learning (RL) frameworks to improve estimation accuracy. The study begins with an overview of traditional SYSID methods and then introduces PIRL as a modification of standard RL. The research applies PIRL to short-period aircraft dynamics, demonstrating its effectiveness in both offline and online learning frameworks. The dissertation then further explores PIRL’s utility in an indirect model reference adaptive control …

Insights On Ai-Supported Uncrewed And Autonomous Systems Education, Brent A. Terwilliger Ph. D, John Faraca

Publications

Artificial Intelligence (AI) related technology is reshaping the educational experience in programs focused on uncrewed and autonomous systems, aviation, robotics, and aerospace, with growing implications for workforce readiness and cross-sector innovation. Early survey data, capturing student, educator, and employer perspectives, reveals that AI-supported tools are notably changing student engagement, communication, and skills development. Initial indications underscores the importance of AI proficiency and technological familiarity in hiring and workforce development, particularly in technical and operational roles. Key areas of focus include the use of AI to strengthen outreach and interactivity; enrich instruction through intelligent simulations; inform curricular improvements using data analytics; …

Unresolved Image Simulation For Space Situational Awareness Applications, Fox Coniglario

Doctoral Dissertations and Master's Theses

The knowledge of what lies in orbit around Earth is at best a guess. Decades of spaceflight, debris buildup, and vehicle collisions have contributed to a large number of objects that are simply not able to be catalogued. Ongoing efforts to catalog debris in orbit have reached limits by conventional measures and as such, research is active in the field of in-orbit space situational awareness. This thesis intends to help fill a hole in the development of such orbital platforms by assisting the development of image processing software pipelines though the simulation of unresolved space imagery. The simulation uses accurate …

Experimental Analysis Of Satellite Operator Training Using Game-Based Virtual Reality Simulation, Lana Laskey

Doctoral Dissertations and Master's Theses

Satellite data plays a vital role in modern global infrastructure by enabling communications, navigation, and weather forecasting. As demand for satellite technology grows, so does the need for highly trained satellite ground operators. Traditional training regimens for satellite operators employ simulation using two-dimensional computer console displays paired with the varied ability of trainees to generate abstract mental imagery of the scenario. However, this development of mental imagery imposes a considerable learning curve and cognitive workload on the trainee, which may negatively impact the user experience and knowledge gained during the training scenario.

This experimental study investigated the effects of game-based …

Satellite Reorientation Using Reinforcement Learning Under Unknown Attitude Failure, Matthew Willoughby

Doctoral Dissertations and Master's Theses

This study presents a reinforcement learning (RL) approach for reestablishing communication with deep-space satellites under unknown attitude determination and control system (ADCS) failures. When traditional fault-tolerant control methods cannot restore signal, the proposed RL controller acts as a last-resort measure by autonomously reorienting the satellite’s antenna toward Earth while charging the battery via solar panels. A generic reward function, designed for the RL-based method, enables the controller to adapt to diverse failure scenarios, including severe actuator noise, misalignment, and complete actuator failure. Simulations are conducted in the Basilisk environment and trained with the tonic framework and demonstrate ranging capabilities of …

Reconfigurable Python Autopilot Software For Rc Aircraft, Kate Doiron

Honors Theses

No abstract provided.

Towards Visual Inertial Navigation With Fixed Tetrahedral Targets, Joao Leonardo Silva Cotta

Theses and Dissertations

This dissertation presents a robust method for 6DoF position estimation under impaired visual conditions utilizing a minimum 4-point Perspective-n-Point (P4P) solver designed for tetrahedral targets. Using SO(3) × R 3 instead of SE(3), the method uses a Lie group-based formulation to discriminate between rotation and translation, thereby enabling computationally efficient, resource-conscious op- optimization while preserving correct geometric behavior. Designed using the contemporary C++17 library ShomerTarget, the solver is analytically formulated and assessed under pragmatic robotic conditions. Particularly in low-light and high-dynamic environments, experiments on embedded systems, UAVs, and NASA’s Astrobee show that the proposed solver attains enhanced accuracy compared to …

Machine Learning Methods For Hypervelocity Fragment Flyout Characterization, Katharine Larsen

Doctoral Dissertations and Master's Theses

Resulting from breakup events, such as collisions and explosions, hypervelocity fragments create potential hazards for both terrestrial and on-orbit environments, such as terrestrial weapons explosions and satellite breakup events, respectively. To avoid unnecessary damage, an accurate understanding or characterization of hypervelocity fragmentation events is vital. Currently, publicly available two-line elements collected from on-orbit breakup events are limited, excluding pre-detonation parent body conditions, such as orientation, and information of smaller fragments. The uncertainty of these datasets varies between each collected set. Therefore, the overall goal of this work is to employ machine learning to estimate distribution characteristics of a space debris …

Robust Spacecraft Autonomy For Deep Space Exploration In Special Euclidean Group Se(3), Matthew Wittal

Doctoral Dissertations and Master's Theses

Over the past half-century, humanity has gained extensive experience conducting manned spaceflight near Earth. Arguably, "near Earth" could even include the Moon — the most distant destination humans have reached. However, "near" in this work primarily refers low Earth orbit (LEO). One could argue that we have not truly left Earth since the Apollo, as spacecraft in some LEOs remain subject to atmospheric drag thus emphasizing their continued connection to Earth's immediate environment. Reflecting on this, it becomes clear that humanity has largely remained bound to Earth’s immediate vicinity since the Apollo missions reached the Moon. However, that is set …

Graph Neural Network-Based Uav Coverage Planning For Robust And Efficient 3d Environments, Gal Tsfaty

Theses and Dissertations

This thesis addresses the challenge of generating optimized UAV waypoints for complete coverage of complex 3D environments, utilizing graph-based computational techniques. The proposed framework replaces computationally intensive steps—triangulation and three-coloring—within the Vantage Waypoint Set Generation Algorithm (VWSGA) pipeline with Graph Neural Networks (GNNs). By learning structural patterns, the GNN achieves scalable and robust triangulation and node classification, enabling enhanced coverage planning in irregular geometries. A novel penalty mechanism ensures alignment with graph structure during adjacency prediction. Experimental results demonstrate the effectiveness of GNNs in balancing accuracy, computational efficiency, and adaptability, advancing UAV coverage optimization.

Autonomous Vehicle Path Planning Under Uncertainty, Madison C. Gillan

Theses and Dissertations

Autonomous vehicles are increasingly being deployed for use in high-stakes and uncertain environments where safe and efficient navigation is critical. In these scenarios, traditional path planning approaches, which rely primarily on deterministic models and fixed assumptions, fall short due to the inherent uncertainty of dynamic threats, sensor inaccuracies, and incomplete information. This research addresses these challenges by developing a novel path-planning methodology that combines the Chance-Constrained Rapidly Exploring Random Tree* (CC-RRT*) algorithm with a probabilistic risk assessment heuristic. This method models uncertainty in sensor detection zones, obstacles in the environment, and the Autonomous Vehicle itself, which allows for uncertainty during …

Improving Smartphone Gnss Jammer Localization With Cloud-Based Environmental Occlusion Modeling, Glenn H. Jones

Theses and Dissertations

The advancement of Global Navigation Satellite System (GNSS) technology in modern smartphones has made these devices pervasive in both civilian and military applications. Although smartphone GNSS chipsets are more susceptible to jamming and spoofing than military grade hardware, smartphone networks offer an underutilized opportunity to detect and mitigate threats to position, navigation, and timing (PNT) services essential to the Department of Defense (DoD) and civilian first responders. Traditional methods for geolocating ground-based jamming sources using smartphone GNSS often fail in environments with dense vegetation or significant occlusions, resulting in substantial localization errors.

Choosing Robust Leadership: Encompassing The Best-Of-N Model And Swarm Intelligence Optimization For Heterogeneous Multiple Autonomous Unmanned Aerial Vehicle Systems, Kudamuhandiramlage Harith Kolitha Warnakulasooriya

Shelby Hall Graduate Research Forum Presentations

Presentation slides for a presentation given at the 1st annual Shelby Hall Graduate Research Forum at the University of South Alabama.

Mass-Adaptive Admittance Control For Robotic Manipulators, Hossein Gholampour, Jonathon E. Slightam, Logan E. Beaver

Mechanical & Aerospace Engineering Faculty Publications

Handling objects with unknown or changing masses is a common challenge in robotics, often leading to errors or instability if the control system cannot adapt in realtime. In this paper, we present a novel approach that enables a six-degrees-of-freedom robotic manipulator to reliably follow waypoints while automatically estimating and compensating for unknown payload weight. Our method integrates an admittance control framework with a mass estimator, allowing the robot to dynamically update an excitation force to compensate for the payload mass. This strategy mitigates end-effector sagging and preserves stability when handling objects of unknown weights. We experimentally validated our approach in …

Optimal Manipulation Motion Action Planner Enabled By Physics Informed Neural Networks, Jonathon E. Slightam, Logan E. Beaver

Mechanical & Aerospace Engineering Faculty Publications

Autonomous robotic manipulation in unstructured environments faces many challenges and is hindered by capabilities that bridge the gap between perception and acting on the world. Action plans that are centric to object motion rather than end-of-arm tooling behavior may aid this. This paper presents an autonomous action planner for a feedback linearizeable system comprised of three base motions that can be leveraged on their own or in combination to give custom motion plans. The optimization routine for the three different types of motion are presented, which are integrated into physics informed neural networks. A component of this is the autonomy …

The Interacting Roles Of Attention Allocation And Trust In Highly Automated Aam Environments, Yusuke Yamani

Psychology Faculty Publications

[First slide]

Mechanisms of attentive visual processing

• Attention control
• Visual search
• Eye movement
• Aging and individual differences

Limits of human performance in applied environment

• Complex displays
• Machine operation
• Surface transportation
• Advanced air mobility
• Nuclear operation

Methods to ameliorate human cognitive performance

• Human-machine interface
• Human autonomy/AI teaming
• Human-systems integration
• Training

Navigating Together: The Conav Testbed And Framework For Benchmarking Cooperative Localization, Rohith Boyinine, Jayanth Ammapalli, Anusna Chakraborty, Rajnikant Sharma, Kevin Brink, Clark N. Taylor

Faculty Publications

This paper presents CoNaV, a comprehensive framework for creating a multi-vehicle cooperative localization (CL) testbed designed to support the benchmarking, development, and deployment of cooperative navigation algorithms. Given the essential role of CL in improving localization accuracy for both defense and civilian applications, CoNaV provides a robust environment for rigorously validating algorithms under real-world conditions. By establishing a benchmark for CL algorithms, CoNaV lays a foundation for advancing research into more sophisticated and distributed CL solutions. This framework highlights the potential of cooperative navigation to enhance multi-vehicle operations and offers a scalable, practical approach for future developments in CL technology.

Machine Visual Perception From Sim-To-Real Transfer Learning For Autonomous Docking Maneuvers, Derek Worth, Jeffrey Choate, Ryan M. Raettig, Scott L. Nykl, Clark N. Taylor

Faculty Publications

This paper presents a comprehensive approach to enhancing autonomous docking maneuvers through machine visual perception and sim-to-real transfer learning. By leveraging relative vectoring techniques, we aim to replicate the human ability to execute precise docking operations. Our study focuses on autonomous aerial refueling as a use case, demonstrating significant advancements in relative navigation and object detection. We introduce a novel method for aligning digital twins using fiducial targets and motion capture data, which facilitates accurate pose estimation from real-world imagery. Additionally, we develop cost-efficient annotation automation techniques for generating high-quality You Only Look Once training data. Experimental results indicate that …

Relative Vectoring Using Dual Object Detection For Autonomous Aerial Refueling, Derek B. Worth, Jeffrey L. Choate, James Lynch, Scott L. Nykl, Clark N. Taylor

Faculty Publications

Once realized, autonomous aerial refueling will revolutionize unmanned aviation by removing current range and endurance limitations. Previous attempts at establishing vision-based solutions have come close but rely heavily on near perfect extrinsic camera calibrations that often change midflight. In this paper, we propose dual object detection, a technique that overcomes such requirement by transforming aerial refueling imagery directly into receiver aircraft reference frame probe-to-drogue vectors regardless of camera position and orientation. These vectors are precisely what autonomous agents need to successfully maneuver the tanker and receiver aircraft in synchronous flight during refueling operations. Our method follows a common 4-stage process …

Random Forests For Detecting Weak Signals And Extracting Physical Information: A Case Study Of Magnetic Navigation, Mohammadamin Moradi, Zheng-Meng Zhai, Aaron Nielsen, Ying-Cheng Lai, Aaron P. Nielsen

Faculty Publications

It has been recently demonstrated that two machine-learning architectures, reservoir computing and time-delayed feed-forward neural networks, can be exploited for detecting the Earth’s anomaly magnetic field immersed in overwhelming complex signals for magnetic navigation in a GPS-denied environment. The accuracy of the detected anomaly field corresponds to a positioning accuracy in the range of 10–40 m. To increase the accuracy and reduce the uncertainty of weak signal detection as well as to directly obtain the position information, we exploit the machine-learning model of random forests that combines the output of multiple decision trees to give optimal values of the physical …

Gnss Software Defined Radio: History, Current Developments, And Standardization Efforts, Thomas Pany, Dennis Akos, Javier Arribas, M. Zahidul H. Bhuiyan, Pau Closas, Fabio Dovis, Ignacio Fernandez-Hernandez, Carles Fernandez-Prades, Sanjeev Gunawardena, Todd Humphreys, Zaher M. Kassas, Jose A. Lopez Salcedo, Mario Nicola, Mario L. Psiaki, Alexander Rugamer, Yong-Jin Song, Jong-Hoon Won

Faculty Publications

Taking the work conducted by the global navigation satellite system (GNSS) software-defined radio (SDR) working group during the last decade as a seed, this contribution summarizes, for the first time, the history of GNSS SDR development. This report highlights selected SDR implementations and achievements that are available to the public or that influenced the general development of SDR. Aspects related to the standardization process of intermediate-frequency sample data and metadata are discussed, and an update of the Institute of Navigation SDR Standard is proposed. This work focuses on GNSS SDR implementations in general-purpose processors and leaves aside developments conducted on …

Marss: Multi-Agent Reinforcement Learning For Satellite Swarms, Nicholas J. Yielding

Theses and Dissertations

Multi-agent systems and swarms in spacecraft formation flying are of ever-increasing importance in a contested space environment—use of multiple spacecraft to contribute to a cooperative mission potentially increases positive outcomes on orbit, while autonomy becomes an ever more important requirement to reduce reaction time in dynamic situations and lower the burden on space operators. This research explores difficult swarm Guidance Navigation and Control (GNC) scenarios using Deep Reinforcement Learning (DRL). DRL polices are trained to provide guidance inputs to agents in multi-agent swarm environments for completing complex, teamwork focused objectives in geosynchronous orbit. An example scenario is explored for a …