Open Access. Powered by Scholars. Published by Universities.®
Navigation, Guidance, Control and Dynamics Commons™
Open Access. Powered by Scholars. Published by Universities.®
- Discipline
- Institution
- Publication Year
- Publication
- Publication Type
Articles 1 - 15 of 15
Full-Text Articles in Navigation, Guidance, Control and Dynamics
Robust Real-Time Uav Target Tracking With Onboard Vision-Based Yaw Control, Rylan Malarchick, Jose Castelblanco, Enrique Amaya, Carmen Dimario, Graysen Brinkman, Chirag Kumar, Kiwon Yoon, Sajid Berhane
Robust Real-Time Uav Target Tracking With Onboard Vision-Based Yaw Control, Rylan Malarchick, Jose Castelblanco, Enrique Amaya, Carmen Dimario, Graysen Brinkman, Chirag Kumar, Kiwon Yoon, Sajid Berhane
Beyond: Undergraduate Research Journal
Autonomous tracking of agile unmanned aerial vehicles (UAVs) presents significant challenges for real-time perception and control systems. This work presents AIRHOUND (Autonomous Intelligent Rotorcraft for Hostile Object Unified Navigation and Detection), a UAV platform implementing vision-based yaw tracking through a modular ROS2 software architecture. The system employs YOLOv8 object detection optimized with NVIDIA TensorRT for embedded deployment on an NVIDIA Jetson Orin companion computer. Detected targets are processed through a geometric tracking module that converts pixel coordinates to angular yaw errors using pinhole camera intrinsics, with a proportional controller generating rate-limited yaw commands. These commands are streamed to a PX4 …
Development Of A Computer Vision Based Rendezvous And Docking Test Platform, David T. Forbes
Development Of A Computer Vision Based Rendezvous And Docking Test Platform, David T. Forbes
Master's Theses
This thesis presents the work completed in the development and testing of a low-cost modular sensor package capable of rendezvous and docking by providing a vehicle with relative navigational commands. These navigational commands are created using relative localization data gathered and processed onboard the sensor package, with validation, in post-processing, against global localization data. This research aims to reduce the cost of smaller autonomous vehicles by removing the need for custom control units, as its modular nature will allow it to be adapted to many different systems and vehicles. Discussed within this thesis is the rapid prototyping, development, and testing …
Relative Vectoring Using Dual Object Detection For Autonomous Aerial Refueling, Derek B. Worth, Jeffrey L. Choate, James Lynch, Scott L. Nykl, Clark N. Taylor
Relative Vectoring Using Dual Object Detection For Autonomous Aerial Refueling, Derek B. Worth, Jeffrey L. Choate, James Lynch, Scott L. Nykl, Clark N. Taylor
Faculty Publications
Once realized, autonomous aerial refueling will revolutionize unmanned aviation by removing current range and endurance limitations. Previous attempts at establishing vision-based solutions have come close but rely heavily on near perfect extrinsic camera calibrations that often change midflight. In this paper, we propose dual object detection, a technique that overcomes such requirement by transforming aerial refueling imagery directly into receiver aircraft reference frame probe-to-drogue vectors regardless of camera position and orientation. These vectors are precisely what autonomous agents need to successfully maneuver the tanker and receiver aircraft in synchronous flight during refueling operations. Our method follows a common 4-stage process …
Object Detection With Deep Learning To Accelerate Pose Estimation For Automated Aerial Refueling, Andrew T. Lee
Object Detection With Deep Learning To Accelerate Pose Estimation For Automated Aerial Refueling, Andrew T. Lee
Theses and Dissertations
Remotely piloted aircraft (RPAs) cannot currently refuel during flight because the latency between the pilot and the aircraft is too great to safely perform aerial refueling maneuvers. However, an AAR system removes this limitation by allowing the tanker to directly control the RP A. The tanker quickly finding the relative position and orientation (pose) of the approaching aircraft is the first step to create an AAR system. Previous work at AFIT demonstrates that stereo camera systems provide robust pose estimation capability. This thesis first extends that work by examining the effects of the cameras' resolution on the quality of pose …
Integrity Monitoring For Automated Aerial Refueling: A Stereo Vision Approach, Thomas R. Stuart
Integrity Monitoring For Automated Aerial Refueling: A Stereo Vision Approach, Thomas R. Stuart
Theses and Dissertations
Unmanned aerial vehicles (UAVs) increasingly require the capability to y autonomously in close formation including to facilitate automated aerial refueling (AAR). The availability of relative navigation measurements and navigation integrity are essential to autonomous relative navigation. Due to the potential non-availability of the global positioning system (GPS) during military operations, it is highly desirable that relative navigation can be accomplished without the use of GPS. This paper develops two algorithms designed to provide relative navigation measurements solely from a stereo image pair. These algorithms were developed and analyzed in the context of AAR using a stereo camera system modeling that …
Improving Real-World Performance Of Vision Aided Navigation In A Flight Environment, Donald T. Venable
Improving Real-World Performance Of Vision Aided Navigation In A Flight Environment, Donald T. Venable
Theses and Dissertations
The motivation of this research is to fuse information from an airborne imaging sensor with information extracted from satellite imagery in order to provide accurate position when GPS is unavailable for an extended duration. A corpus of existing geo-referenced satellite imagery is used to create a key point database. A novel algorithm for recovering coarse pose using by comparing key points extracted from the airborne imagery to the reference database is developed. This coarse position is used to bootstrap a local-area geo-registration algorithm, which provides GPS-level position estimates. This research derives optimizations for existing local-area methods for operation in flight …
A Monocular Slam Method To Estimate Relative Pose During Satellite Proximity Operations, Scott J. Kelly
A Monocular Slam Method To Estimate Relative Pose During Satellite Proximity Operations, Scott J. Kelly
Theses and Dissertations
Automated satellite proximity operations is an increasingly relevant area of mission operations for the US Air Force with potential to significantly enhance space situational awareness (SSA). Simultaneous localization and mapping (SLAM) is a computer vision method of constructing and updating a 3D map while keeping track of the location and orientation of the imaging agent inside the map. The main objective of this research effort is to design a monocular SLAM method customized for the space environment. The method developed in this research will be implemented in an indoor proximity operations simulation laboratory. A run-time analysis is performed, showing near …
Terrain Referenced Navigation Using Sift Features In Lidar Range-Based Data, Matthew T. Leines
Terrain Referenced Navigation Using Sift Features In Lidar Range-Based Data, Matthew T. Leines
Theses and Dissertations
The use of GNSS in aiding navigation has become widespread in aircraft. The long term accuracy of INS are enhanced by frequent updates of the highly precise position estimations GNSS provide. Unfortunately, operational environments exist where constant signal or the requisite number of satellites are unavailable, significantly degraded, or intentionally denied. This thesis describes a novel algorithm that uses scanning LiDAR range data, computer vision features, and a reference database to generate aircraft position estimations to update drifting INS estimates. The algorithm uses a single calibrated scanning LiDAR to sample the range and angle to the ground as an aircraft …
Intelligent Sensing Based On Low Cost Unmanned Aerial Vehicles (Uav) For Bridge Condition Assessment, Theodore Teates, Austin Boyd, Chung-Hao Chen
Intelligent Sensing Based On Low Cost Unmanned Aerial Vehicles (Uav) For Bridge Condition Assessment, Theodore Teates, Austin Boyd, Chung-Hao Chen
Electrical & Computer Engineering Faculty Publications
The eventual completion of this project envisions the use of an Unmanned Aerial Vehicle (UAV) to inspect bridge infrastructure. This project may also be expanded to encompass general object detection and inspection in order to unburden this technology so that it may reach its fullest potential. The project requires research and development in three distinct areas of image processing, control structures, and integration of systems. Initial undergraduate research sets the base knowledge for the overall project, explores the areas of concentration that are desired to expand upon in the future project, and provides a base UAV model that new researchers …
Unmanned Autonomous Object Retrieval: Old Dominion University 2013 International Aerial Robotics Competition Entry, Johnathan Bailey, Austin Boyd, Chung-Hao Chen, Stephen Dailey, Lisa Henderson, Jeremy Stuart, Christina Williams
Unmanned Autonomous Object Retrieval: Old Dominion University 2013 International Aerial Robotics Competition Entry, Johnathan Bailey, Austin Boyd, Chung-Hao Chen, Stephen Dailey, Lisa Henderson, Jeremy Stuart, Christina Williams
Electrical & Computer Engineering Faculty Publications
This paper describes the design implementation of a Quadrotor Unmanned Aerial Vehicle (UAV) with the capability of exploring indoor locations without the assistance of external aids. For relative position, the use of a laser range sensor, an optical flow sensor, and sonar sensor combined allows for the vehicle to generate mapping information. With relative position in mind, the vehicle uses vision algorithms to recognize immediate obstacles, sign, and entry ways to allow for quick movement responses and object recognition. A proportional-integral-differentiator controller allows for flight stability and mitigation in the tight confines of the indoor spaces. A mapping algorithm allows …
Enhanced Image-Aided Navigation Algorithm With Automatic Calibration And Affine Distortion Prediction, Juan D. Jurado
Enhanced Image-Aided Navigation Algorithm With Automatic Calibration And Affine Distortion Prediction, Juan D. Jurado
Theses and Dissertations
This research aims at improving two key steps within the image aided navigation process: camera calibration and landmark tracking. The camera calibration step is improved by automating the point correspondence calculation within the standard camera calibration algorithm, thereby reducing the required time for calibration while maintaining the output model accuracy. The feature landmark tracking step is improved by digitally simulating affine distortions on input images in order to calculate more accurate feature descriptors for improved feature matching in high relative viewpoint change. These techniques are experimentally demonstrated in an outdoor environment with a consumer-grade inertial sensor and three imaging sensors, …
Object Retrieval From Secure Unknown Interior Spaces Using Autonomous Unmanned Aerial Vehicles, John Levous, Julie Hoven, Victor Habgood, Abdulrahman Alotaibi, Brandon Ordway, Garibe Mohammed-Jones, Haole Guo, Filip Cuckov, Chung-Hao Chen
Object Retrieval From Secure Unknown Interior Spaces Using Autonomous Unmanned Aerial Vehicles, John Levous, Julie Hoven, Victor Habgood, Abdulrahman Alotaibi, Brandon Ordway, Garibe Mohammed-Jones, Haole Guo, Filip Cuckov, Chung-Hao Chen
Electrical & Computer Engineering Faculty Publications
This paper describes an autonomous unmanned aerial vehicle (UAV) designed to participate in the 23rd annual International Aerial Robotics Competition. The UAV is equipped with onboard sensors and a Harvard architecture 8-bit RISC microcontroller to monitor and locally control its flight telemetry. Additional sensors (and an additional microcontroller) are used for detecting and mapping of structural and environmental objects while the UAV is in flight. The microcontrollers are interfaced with wireless communication modules for transmitting flight telemetry and structural/environmental data to a ground control station that sends the UAV command and control signals required for the mission objectives. The UAV …
Deeply-Integrated Feature Tracking For Embedded Navigation, Jeffery R. Gray
Deeply-Integrated Feature Tracking For Embedded Navigation, Jeffery R. Gray
Theses and Dissertations
The Air Force Institute of Technology (AFIT) is investigating techniques to improve aircraft navigation using low-cost imaging and inertial sensors. Stationary features tracked within the image are used to improve the inertial navigation estimate. These features are tracked using a correspondence search between frames. Previous research investigated aiding these correspondence searches using inertial measurements (i.e., stochastic projection). While this research demonstrated the benefits of further sensor integration, it still relied on robust feature descriptors (e.g., SIFT or SURF) to obtain a reliable correspondence match in the presence of rotation and scale changes. Unfortunately, these robust feature extraction algorithms are computationally …
Model-Based Control Using Model And Mechanization Fusion Techniques For Image-Aided Navigation, Constance D. Hendrix
Model-Based Control Using Model And Mechanization Fusion Techniques For Image-Aided Navigation, Constance D. Hendrix
Theses and Dissertations
Unmanned aerial vehicles are no longer used for just reconnaissance. Current requirements call for smaller autonomous vehicles that replace the human in high-risk activities. Many times these activities are performed in GPS-degraded environments. Without GPS providing today's most accurate navigation solution, autonomous navigation in tight areas is more difficult. Today, image-aided navigation is used and other methods are explored to more accurately navigate in such areas (e.g., indoors). This thesis explores the use of inertial measurements and navigation solution updates using cameras with a model-based Linear Quadratic Gaussian controller. To demonstrate the methods behind this research, the controller will provide …
Communication Free Robot Swarming, Zachary C. Gray
Communication Free Robot Swarming, Zachary C. Gray
Theses and Dissertations
As the military use of unmanned aerial vehicles increases, a growing need for novel strategies to control these systems exists. One such method for controlling many unmanned aerial vehicles simultaneously is the through the use of swarm algorithms. This research explores a swarm robotic algorithm developed by Kadrovach implemented on Pioneer Robots in a real-world environment. An adaptation of his visual sensor is implemented using stereo vision as the primary method of sensing the environment. The swarm members are prohibited from explicitly communicating other than passively through the environment. The resulting implementation produces a communication free swarming algorithm. The algorithm …