Navigation, Guidance, Control, and Dynamics Commons^™

Safe Control Design For Quadruped Locomotion In Unstructured Environments Using Linear Transfer Operators, Sriram Sundar Krishnamoorthy Shankara Narayanan

All Dissertations

Deploying quadruped robots in unstructured, obstacle-rich environments requires control and planning methods that remain safe and reliable despite complex terrain geometry, limited sensing, and inevitable modeling errors. This thesis develops operator-theoretic tools for safe control design of robotic systems using linear transfer operators, with a focus on quadruped locomotion in unstructured environments. The central goal is to develop a unified operator-theoretic framework for safe control design based on the Perron–Frobenius (P–F) and Koopman operators. In particular, the thesis leverages \emph{density functions} to develop safe navigation frameworks in the dual space of densities. In the operator-theoretic perspective, the P–F operator governs …

End-To-End Development And Experimental Validation Of A 1/10-Scale Autonomous Vehicle, Rikkin Pankaj Panchal

Electrical Engineering Theses

Autonomous vehicle development demands vast resources, making scaled down platforms a critical alternative for solving core algorithmic challenges. The primary contribution of this thesis is the end to end development and validation of a complete real time autonomous driving pipeline deployed on a one tenth scale vehicle. To streamline platform development, an AI assisted annotation framework automates dataset generation, significantly reducing manual labor while improving training data quality. The system perception stack features a reinforcement learning guided online multi camera calibration framework that enables adaptive surround view stitching without the need for offline recalibration. This is paired with robust lane …

Multi-Level Energy Optimization For Connected And Automated Vehicles: From Cooperative Multi-Vehicle Control To Individual Powertrain Management, Pruthwiraj Santhosh

Dissertations, Master's Theses and Master's Reports

The transportation sector currently accounts for nearly 30% of global energy consumption, necessitating urgent advancements in vehicle efficiency to meet Net Zero targets. Leveraging connectivity and automation, this dissertation proposes and validates methodologies to reduce the energy consumption of light-duty vehicles at both fleet and individual levels.

First, a validation framework is developed to bridge the “simulation-to-real world” gap in Cooperative Automated Vehicle (CAV) research. Moving beyond virtual simulations, the study establishes a methodology for physically validating centralized control architectures via a custom Cellular V2X network. By synchronizing vehicle-powertrain models with physical test vehicles, the framework successfully orchestrates complex arterial …

Algorithms & Design Behind Autonomous Uavs And Ugvs Coordinated System, Aashish Dhakal

Honors Theses

Unmanned Aerial Vehicles (UAVs) and Unmanned Ground Vehicles (UGVs), when coordinated effectively, offer substantial potential for automating large-scale tasks—from search and rescue operations to precision agriculture. However, synchronizing these autonomous systems remains challenging, especially in time-sensitive missions requiring precision. This thesis investigates the design and algorithmic coordination of autonomous UAVs and UGVs, examining both single-vehicle scenarios and multi-agent (swarming) approaches. Using the Robot Operating System (ROS) as a communication backbone, I integrate GPS positioning with computer vision techniques through OpenCV, enabling accurate localization and object detection. During the development phase, I validate my methods using ArduPilot Software-in-the-Loop (SITL) simulations within …

Navigating The Future Advancing Autonomous Vehicles Through Robust Target Recognition And Real-Time Avoidance, Mohammed Ahmed Mohammed Hussein

Theses and Dissertations

The problem being tackled by this thesis is a very important one and very relevant to our days and times: it is about making improved target recognition and enhanced real-time response skills in AVs under simulated conditions. Our plan is to put some enhanced sensory capabilities into these vehicles and see if that makes them safer and more reliable. We are using as our base a particular object recognition algorithm (YOLOv7) and a particular simulation environment (CARLA). We utilized the CARLA 0.9.14 simulator on Ubuntu 20.04 as a more stable option than the initially used CARLA 0.9.15 on Ubuntu 22.04, …

Model Reference Adaptive Control For Mobile Manipulators And Beyond, Srivatsan Srinivasan

All Dissertations

In recent years, robotics has expanded into various sectors, including manufacturing, transportation, and household services, making the integration of autonomy a critical area of research. This shift aims to ensure safety and enhance the utility of autonomous systems. Traditionally, robotic applications focused separately on mobility, like automated guided vehicles, and manipulation, such as serial-chain arms in manufacturing. Today, however, we see a merging of these capabilities in the growing field of mobile manipulator robots that combine movement with purposeful interactive functionalities.

A typical mobile manipulator is a robotic arm mounted on a wheeled base. This thesis focuses on advancing control …

Vision-Based Autonomy Stacks For Farm Tractors And Intelligent Spraying Systems In Orchards, Shengli Xu

All Dissertations

Autonomous tractors equipped with intelligent sprayers have become a pivotal aspect of smart farming (SF), marking a transformative shift in traditional agricultural practices and holding the potential to revolutionize the farming industry. With 2,453,620 fruit-bearing acres in the United States as of 2022, there is a pressing need for the implementation of autonomous systems for farm tractors and intelligent spraying systems in orchards. These advancements can significantly reduce labor costs, address labor shortages, and minimize spray loss. Furthermore, to enhance profitability and productivity, it is essential to develop low-cost yet effective vision-based autonomy systems that can operate efficiently across various …

Navigating The Rules: Integrating Td3 And Sensor Fusion For Traffic-Aware Autonomous Vehicle Path Planning, Mahmoud Ayman Mohamed Elsayed

Theses and Dissertations

This work presents a novel algorithm for local path planning for autonomous vehicles (AVs) which prioritizes both safety and adherence to traffic regulations, addressing critical functions for AV navigation, such as navigating complex environments, avoiding obstacles, and ensuring passenger and road users safety. The algorithm integrates the Twin Delayed Deep Deterministic Policy Gradient (TD3) with sensor fusion based on Nvidia Convolutional Neural Network (NCNN). The study utilizes the CARLA simulator, and real-world datasets, including KITTI and WAYMO, to train and evaluate the proposed algorithm. The proposed algorithm leverages the complementary strengths of Imitation Learning (IL) and Deep Reinforcement Learning (DRL) …

Autonomous Apple Harvester Robot, Jack Ryan Cline, Tyus Green, Devon Woolston

Electrical Engineering

As agricultural demands rise and manual labor costs increase, there has become a dire need to automate apple harvesting. However, the precision and speed necessary for cost-efficient apple harvesting pose a significant challenge for robotic automation. To maintain cost-effective production, a harvester must be able to operate fast enough and long enough to compete with human labor. It must also be able to navigate and traverse apple orchards autonomously and pick apples without damaging the fruit or tree. This project presents an apple harvesting robot that uses a Mask R-CNN vision system with an RGB-D camera to detect the location …

Development Of A Solidworks Api, Andrew Magyar

Williams Honors College, Honors Research Projects

With the current advancements in CAD software, and precision of modern motors, we believe that a new way to communicate from hardware to software is possible. This report details the steps we have taken to attempt just that. The essential idea behind this is that modern controls for robotics are not as user friendly as they can be. The general action taken is to create an API for SolidWorks that connects it to the other necessary controller software and makes it so that a robot, and its exact current position, can be changed simply and intuitively from SolidWorks. Furthermore, the …

Human Tracking Function For Robotic Dog, Andrew Sharkey

Williams Honors College, Honors Research Projects

With the increase the increase in automation and humans and robots working side by side, there is a need for a more organic way of controlling robots. The goal of this project is to create a control system for Boston dynamics robotic dog Spot that implements human tracking image software to follow humans using computer vision as well as using hand tracking image software to allow for control input through hand gestures.

Multi-Robot Symbolic Task And Motion Planning Leveraging Human Trust Models: Theory And Applications, Huanfei Zheng

All Dissertations

Multi-robot systems (MRS) can accomplish more complex tasks with two or more robots and have produced a broad set of applications. The presence of a human operator in an MRS can guarantee the safety of the task performing, but the human operators can be subject to heavier stress and cognitive workload in collaboration with the MRS than the single robot. It is significant for the MRS to have the provable correct task and motion planning solution for a complex task. That can reduce the human workload during supervising the task and improve the reliability of human-MRS collaboration. This dissertation relies …

Reduced Fuel Emissions Through Connected Vehicles And Truck Platooning, Paul D. Brummitt

Electronic Theses and Dissertations

Vehicle-to-infrastructure (V2I) and vehicle-to-vehicle (V2V) communication enable the sharing, in real time, of vehicular locations and speeds with other vehicles, traffic signals, and traffic control centers. This shared information can help traffic to better traverse intersections, road segments, and congested neighborhoods, thereby reducing travel times, increasing driver safety, generating data for traffic planning, and reducing vehicular pollution. This study, which focuses on vehicular pollution, used an analysis of data from NREL, BTS, and the EPA to determine that the widespread use of V2V-based truck platooning—the convoying of trucks in close proximity to one another so as to reduce air drag …

Automotive Sensor Fusion Systems For Traffic Aware Adaptive Cruise Control, Jonah T. Gandy

Theses and Dissertations

The autonomous driving (AD) industry is advancing at a rapid pace. New sensing technology for tracking vehicles, controlling vehicle behavior, and communicating with infrastructure are being added to commercial vehicles. These new automotive technologies reduce on road fatalities, improve ride quality, and improve vehicle fuel economy. This research explores two types of automotive sensor fusion systems: a novel radar/camera sensor fusion system using a long shortterm memory (LSTM) neural network (NN) to perform data fusion improving tracking capabilities in a simulated environment and a traditional radar/camera sensor fusion system that is deployed in Mississippi State’s entry in the EcoCAR Mobility …

Control, Decision-Making, And Learning Approaches For Connected And Autonomous Driving Systems With Humans-In-The-Loop, Fangjian Li

All Dissertations

By virtue of vehicular connectivity and automation, the vehicle becomes increasingly intelligent and self-driving capable. However, no matter what automation level the vehicle can achieve, humans will still be in the loop despite their roles. First, considering the manual driving car as a disturbance to the connected and autonomous vehicles (CAVs), a novel string stability is proposed for mixed traffic platoons consisting of both autonomous and manual driving cars to guarantee acceptable motion fluctuation and platoon safety. Furthermore, humans are naturally considered as the rider in the passenger vehicle. A human-centered cooperative adaptive cruise control (CACC) is designed to improve …

A Brief Literature Review For Machine Learning In Autonomous Robotic Navigation, Jake Biddy, Jeremy Evert

Student Research

Machine learning is becoming very popular in many technological aspects worldwide, including robotic applications. One of the unique aspects of using machine learning in robotics is that it no longer requires the user to program every situation. The robotic application will be able to learn and adapt from its mistakes. In most situations, robotics using machine learning is designed to fulfill a task better than a human could, and with the machine learning aspect, it can function at the highest level of efficiency and quality. However, creating a machine learning program requires extensive coding and programming knowledge that can be …

Deep Learning Assisted Intelligent Visual And Vehicle Tracking Systems, Liang Xu

Theses and Dissertations

Sensor fusion and tracking is the ability to bring together measurements from multiple sensors of the current and past time to estimate the current state of a system. The resulting state estimate is more accurate compared with the direct sensor measurement because it balances between the state prediction based on the assumed motion model and the noisy sensor measurement. Systems can then use the information provided by the sensor fusion and tracking process to support more-intelligent actions and achieve autonomy in a system like an autonomous vehicle. In the past, widely used sensor data are structured, which can be directly …

Planning Algorithms Under Uncertainty For A Team Of A Uav And A Ugv For Underground Exploration, Matteo De Petrillo

Graduate Theses, Dissertations, and Problem Reports (ETD)

Robots’ autonomy has been studied for decades in different environments, but only recently, thanks to the advance in technology and interests, robots for underground exploration gained more attention. Due to the many challenges that any robot must face in such harsh environments, this remains an challenging and complex problem to solve.

As technology became cheaper and more accessible, the use of robots for underground ex- ploration increased. One of the main challenges is concerned with robot localization, which is not easily provided by any Global Navigation Services System (GNSS). Many developments have been achieved for indoor mobile ground robots, making …

Efficient End-To-End Autonomous Driving, Hesham Eraqi

Theses and Dissertations

Steering a car through traffic is a complex task that is difficult to cast into algorithms. Therefore, researchers turn to train artificial neural networks from front-facing camera data stream along with the associated steering angles. Nevertheless, most existing solutions consider only the visual camera frames as input, thus ignoring the temporal relationship between frames. In this work, we propose a Convolution Long Short-Term Memory Recurrent Neural Network (C-LSTM), which is end-to-end trainable, to learn both visual and dynamic temporal dependencies of driving. Additionally, We introduce posing the steering angle regression problem as classification while imposing a spatial relationship between the …

Towards Sensorimotor Coupling Of A Spiking Neural Network And Deep Reinforcement Learning For Robotics Application, Kashu Yamazaki

Mechanical Engineering Undergraduate Honors Theses

Deep reinforcement learning augments the reinforcement learning framework and utilizes the powerful representation of deep neural networks. Recent works have demonstrated the great achievements of deep reinforcement learning in various domains including finance,medicine, healthcare, video games, robotics and computer vision.Deep neural network was started with multi-layer perceptron (1stgeneration) and developed to deep neural networks (2ndgeneration)and it is moving forward to spiking neural networks which are knownas3rdgeneration of neural networks. Spiking neural networks aim to bridge the gap between neuroscience and machine learning, using biologically-realistic models of neurons to carry out computation. In this thesis, we first provide a comprehensive review …

Techniques To Solve Decision-Making Problems, Dilnoz Tulkunovna Muhamediyeva, Bekmuratov Fayzievich Tulkun

Chemical Technology, Control and Management

Solving decision-making problems in poorly formalized systems only with the help of deterministic and probabilistic methods is insufficient. To do this, it is necessary to widely apply the methods of hybrid intelligent systems and, especially, the methods of “soft” calculations (SoftCalculation, SoftComputing) and the directions of ComputationalIntelligence — intelligent computing technologies that are emerging on this theoretical and methodological base. An immune - fuzzy algorithm for the synthesis of fuzzy inference systems (FIS) is proposed. A two-stage adaptive FIS synthesis algorithm is described. At the first stage, the initial fuzzy parameters are clustered in order to reduce the number of …

Quantitative Performance Assessment Of Lidar-Based Vehicle Contour Estimation Algorithms For Integrated Vehicle Safety Applications, David M. Mothershed

College of Graduate Studies: Theses & Dissertations

Many nations and organizations are committing to achieving the goal of `Vision Zero' and eliminate road traffic related deaths around the world. Industry continues to develop integrated safety systems to make vehicles safer, smarter and more capable in safety critical scenarios. Passive safety systems are now focusing on pre-crash deployment of restraint systems to better protect vehicle passengers. Current commonly used bounding box methods for shape estimation of crash partners lack the fidelity required for edge case collision detection and advanced crash modeling. This research presents a novel algorithm for robust and accurate contour estimation of opposing vehicles. The presented …

Route Planning For Long-Term Robotics Missions, Christopher Alexander Arend Tatsch

Graduate Theses, Dissertations, and Problem Reports (ETD)

Many future robotic applications such as the operation in large uncertain environment depend on a more autonomous robot. The robotics long term autonomy presents challenges on how to plan and schedule goal locations across multiple days of mission duration. This is an NP-hard problem that is infeasible to solve for an optimal solution due to the large number of vertices to visit. In some cases the robot hardware constraints also adds the requirement to return to a charging station multiple times in a long term mission. The uncertainties in the robot model and environment require the robot planner to account …

Self-Driving Toy Car Using Deep Learning, Fahim Ahmed, Suleyman Turac, Mubtasem Ali

Publications and Research

Our research focuses on building a student affordable platform for scale model self-driving cars. The goal of this project is to explore current developments of Open Source hardware and software to build a low-cost platform consisting of the car chassis/framework, sensors, and software for the autopilot. Our research will allow other students with low budget to enter into the world of Deep Learning, self-driving cars, and autonomous cars racing competitions.

Comparison Of Lqr And Lqr-Mrac For Linear Tractor-Trailer Model, Kevin Richard Gasik

Master's Theses

The United States trucking industry is immense. Employing over three million drivers and traveling to every city in the country. Semi-Trucks travel millions of miles each week and encompass roads that civilians travel on. These vehicles should be safe and allow efficient travel for all. Autonomous vehicles have been discussed in controls for many decades. Now fleets of autonomous vehicles are beginning their integration into society. The ability to create an autonomous system requires domain and system specific knowledge. Approaches to implement a fully autonomous vehicle have been developed using different techniques in control systems such as Kalman Filters, Neural …

Autonomous Watercraft Simulation And Programming, Nicholas J. Savino

Student Scholar Showcase

Automation of various modes of transportation is thought to make travel more safe and efficient. Over the past several decades, advances to semi-autonomous and autonomous vehicles have led to advanced autopilot systems on planes and boats, and an increasing popularity of self-driving cars. We predicted the motion of an autonomous vehicle using simulations in Python. The simulation models the motion of a small scale watercraft, which can then be built and programmed using an Arduino Microcontroller. We examined different control methods for a simulated rescue craft to reach a target. We also examined the effects of different factors, such as …

Unsupervised Feature Learning For Point Cloud By Contrasting And Clustering With Graph Convolutional Neural Network, Ling Zhang

Dissertations and Theses

Recently, deep graph neural networks (GNNs) have attracted significant attention for point cloud understanding tasks, including classification, segmentation, and detection. However, the training of such deep networks still requires a large amount of annotated data, which is both expensive and time-consuming. To alleviate the cost of collecting and annotating large-scale point cloud datasets, we propose an unsupervised learning approach to learn features from unlabeled point cloud ”3D object” dataset by using part contrasting and object clustering with GNNs. In the contrast learning step, all the samples in the 3D object dataset are cut into two parts and put into a …

Crop Height Estimation With Unmanned Aerial Vehicles, Carrick Detweiler, David Anthony, Sebastian Elbaum

School of Computing: Faculty Publications

An unmanned aerial vehicle (UAV) can be configured for crop height estimation. In some examples, the UAV includes an aerial propulsion system, a laser scanner configured to face downwards while the UAV is in flight, and a control system. The laser scanner is configured to scan through a two-dimensional scan angle and is characterized by a maxi mum range. The control system causes the UAV to fly over an agricultural field and maintain, using the aerial propulsion system and the laser scanner, a distance between the UAV and a top of crops in the agricultural field to within a programmed …