Controls and Control Theory Commons^™

Robust Real-Time Uav Target Tracking With Onboard Vision-Based Yaw Control, Rylan Malarchick, Jose Castelblanco, Enrique Amaya, Carmen Dimario, Graysen Brinkman, Chirag Kumar, Kiwon Yoon, Sajid Berhane

Beyond: Undergraduate Research Journal

Autonomous tracking of agile unmanned aerial vehicles (UAVs) presents significant challenges for real-time perception and control systems. This work presents AIRHOUND (Autonomous Intelligent Rotorcraft for Hostile Object Unified Navigation and Detection), a UAV platform implementing vision-based yaw tracking through a modular ROS2 software architecture. The system employs YOLOv8 object detection optimized with NVIDIA TensorRT for embedded deployment on an NVIDIA Jetson Orin companion computer. Detected targets are processed through a geometric tracking module that converts pixel coordinates to angular yaw errors using pinhole camera intrinsics, with a proportional controller generating rate-limited yaw commands. These commands are streamed to a PX4 …

A Comparative Study Of Model Predictive Control And The Stanley Method For Vehicle Path Tracking Applications, Noah S. Fitzgerald

Master's Theses

This thesis compares a model predictive controller (MPC) and a lateral Stanley controller for vehicle path-tracking applications under simulation-based and perception-driven operating conditions. Both controllers were evaluated in simulation using a nonlinear dynamic bicycle model executing single and double lane change maneuvers. Following simulation-based evaluation, both controllers were implemented on hardware within a perception-driven steering-control pipeline. This pipeline utilized recorded sensor data from the MXcarkit 1/8^th-scale autonomous vehicle platform, incorporating lane instance segmentation and homography-based roadway estimation.

Under idealized simulation conditions, the MPC demonstrated improved trajectory-tracking performance during aggressive maneuvers while requiring greater steering activity and computational effort …

Vision-Guided Motion Planning For Autonomous Catch With A Robotic Arm, Kayla Go-Oco, Ashik K. Islam, Raegan Gritzmacher

Electrical Engineering

Modern robotic systems are often evaluated using static and highly controlled tasks, such as pick-and-place demonstrations, which do not fully represent the uncertainty and adaptability required in real-world environments. A major challenge in robotics research is enabling robotic systems to perceive, track, and respond to dynamic objects in real time while maintaining accurate and reliable motion control. This project addresses these challenges by developing an autonomous robotic platform in which an OpenMANIPULATOR-Y robotic arm detects, tracks, and attempts to catch a moving tennis ball using a vision-guided control system. The system integrates YOLO-based object detection with an Intel RealSense D455 …

Automatic Testing Of Organic Strain Gauge Tactile Sensors., Brian P. Goulet

Electronic Theses and Dissertations

Human-Robot Interaction is a developing field of science, that is posed to augment everything we do in life. Skin sensors that can detect touch, temperature, distance, and other physical interaction parameters at the human-robot interface are very important to enhancing the collaboration between humans and machines. As such, these sensors must be efficiently tested and characterized to give accurate feedback from the sensor to the robot. The objective of this work is to create a diversified software testing suite that removes as much human intervention as possible. The tests and methodology discussed here provide multiple realistic scenarios that the sensors …

Magic: The Gathering Card Virtualizer, Vincent Garbonick, Jacen C. Conlan, Jaret A. Varn

Williams Honors College, Honors Research Projects

Any well-versed Magic: The Gathering (MTG) player or collector knows how difficult it can be to keep track of all cards in their collection. Some spend hours searching for that one specific card, and others are constantly scouring the internet for how much their collection costs. However, this issue does not only affect casual fans. Resale companies spend hours a day determining the costs of cards, and tournament judges painstakingly check players’ decks to ensure they are not cheating. To assist with these struggles, the design team proposed to create the MTG Card Virtualizer. This device scans MTG playing cards …

Using Motion Capture And Augmented Reality To Test Aar With Boom Occlusion, Vincent J. Bownes

Theses and Dissertations

The operational capability of drones is limited by their inability to perform aerial refueling. This can be overcome by automating the process with a computer vision solution. Previous work has demonstrated the feasibility of automated aerial refueling (AAR) in simulation. To progress this technique to the real world, this thesis conducts experiments using real images of a physical aircraft replica and a motion capture system for truth data. It also compares the error between the real and virtual experiments to validate the fidelity of the simulation. Results indicate that the current technique is effective on real images and that the …

From A Locally Competitive Algorithm To Sensory Relevance Models, Walter Woods

Electrical and Computer Engineering PhD Day

This poster addresses the development of a new Machine Learning (ML) mechanism, the Sensory Relevance Model (SRM), as a means of splitting information processing tasks into two sub-tasks with more intuitive properties. Specifically, SRMs are a front-end for other ML techniques, re-mapping the input data to a similar space with significantly more sparsity, achieved through the transformation and suppression of inputs irrelevant to the task. Prior work has attempted to reveal this information for Neural Networks (NNs) either as a post-processing step via saliency maps or through a simple masking of the input achieved with a dot product (so-called ``attention'' …

Control Of A Powered Ankle-Foot Prosthesis: From Perception To Impedance Modulation, Guilherme Aramizo Ribeiro

Dissertations, Master's Theses and Master's Reports

Active ankle prostheses controllers are demonstrating gaining smart features to improve the safety and comfort offor users. The perception of user intention to modulate the ankle dynamics is a well-known example of such feature. But not much work focused on the perception of the environment, nor how the environment should be included in the mechanical design and control of the prosthesisprostheses. The proposed work aims to improve the feasibility of integrate the environment perception integration intoto the prostheses controllersler, and to define the desired ankle dynamics, as mechanical impedance, duringof the human walk on different environmental settings. As a preliminary …

Machine Learning Through Mimicry And Association, Nickolas S. Holcomb

Honors College Theses

Adaptability is a key missing features that has impeded the growth of assistive robotics. In the traditional model, all actions must be explicitly coded by a skilled programmer familiar with the hardware. This project explores a method of teaching a webcam equipped arm type robot new primitive movement using visual demonstrations.

Model-Based Control Using Model And Mechanization Fusion Techniques For Image-Aided Navigation, Constance D. Hendrix

Theses and Dissertations

Unmanned aerial vehicles are no longer used for just reconnaissance. Current requirements call for smaller autonomous vehicles that replace the human in high-risk activities. Many times these activities are performed in GPS-degraded environments. Without GPS providing today's most accurate navigation solution, autonomous navigation in tight areas is more difficult. Today, image-aided navigation is used and other methods are explored to more accurately navigate in such areas (e.g., indoors). This thesis explores the use of inertial measurements and navigation solution updates using cameras with a model-based Linear Quadratic Gaussian controller. To demonstrate the methods behind this research, the controller will provide …