Robotics Commons^™

The Self-Aware Room: A Framework For Operational Self-Awareness In Evolvable Blended Environments, David B. Smith

Publications and Research

The Self-Aware Room (SAR) is a room-scale research environment developed within the larger Balanced Blended Space and Blended Reality Performance System research trajectory. Rather than treating the room as a conventional “smart” environment composed of fixed automation technologies, SAR approaches it as an evolvable blended environment made from physical, virtual, conceptual, sensory, computational, and performative relationships. Its defining feature is not any particular sensor, model, or output device, but the set of transformations through which physical activity becomes structured observation, bounded representation, interpreted state, governed decision, and mediated response.

This paper develops the conceptual and methodological foundations of SAR as …

Navigating Enhanced Exploration Assistance (Nexa), Azhari Abbas, Caleb Fakunle, Ryan Powell, Donovan Livingston

Discovery Day - Daytona Beach

NEXA is an artificial intelligence software platform developed to enhance residential security and property monitoring through seamless integration with autonomous drone systems. This research application of advanced AI in surveillance aims to create a standalone solution capable of real-time threat detection and intelligent alert management. By processing visual and sensory data, NEXA facilitates autonomous drone operation with minimal human intervention. Secure communication channels ensure that instant alerts are delivered to property owners and, potentially, law enforcement, improving response times in security incidents, search-and-rescue operations, and perimeter surveillance. Additionally, NEXA is capable of interfacing with commercially available drone platforms and presents …

Phaëthon System, Brady Roudabush, Lauren Gallo, Emelia Thompson, Jacob Woods

Discovery Day - Daytona Beach

Phaëthon System is the project name for the Search and Rescue Drone Initiative. This initiative will improve the current search and rescue drone industry by introducing new techniques to get through dense forest canopies and other places where an overhead view is not useful. The Phaëthon System uses a swarm of drones that can penetrate under the tree canopy to map and search with the utmost efficiency and safety for rescuers. A command drone is launched to survey the overall search area, and set up a communications and data link. The next component is then released, which is a swarm …

Rockin’ Rover On The Rainbow Road, Michael Kolta, Lawrence Burgee, Ying Yuan

Transformations

This paper presents a progressive series of age-appropriate lesson plans for grades K-12 that all use the same interdisciplinary activity to educate students about Science, Technology, Engineering, Art, and Mathematics (STEAM) simultaneously. Technology from Texas Instruments (TI) was employed including a TI Nspire graphing calculator that can run Python programs, a TI Innovator Hub, and a TI Rover. The TI Rover is a small, robotic car that has sensors and is controlled by the calculator via the Hub hardware interface. A Python program was developed that uses the color sensor in the Rover to detect the color on colored paper …

Evaluating Machine Learning Models On Classification Of Novel Cyber Attacks In The Healthcare Domain, Promise Ehimen

Dissertations, Theses, and Projects

The increasing adoption of the Internet of Medical Things (IoMT) has improved healthcare delivery through connected medical devices while simultaneously expanding the cybersecurity risks facing healthcare organizations. Although machine learning based intrusion detection systems have demonstrated high detection accuracy, their ability to respond reliably to previously unseen cyberattacks remains uncertain. This study investigated how a Neural Network model and a Logistic Regression model classified novel cyberattacks within the IoMT environment. The Neural Network and Logistic Regression models were both trained and tested using a subset of the CICIoMT2024 benchmark dataset. The Neural Network achieved 99.82% test accuracy and a 0.94 …

Robot Remote Control Utility, Jeremy Cantu, Paul Uhlig

Systems Manuals - 2026

The purpose of this document is to describe the Robot Control Management Utility developed in the course of this graduate project. Information included in this document will include the background of the developed product, as well as the functional requirements, data structures, software modules, interface design, installation guide, and sample and troubleshooting guides.

Robust Real-Time Uav Target Tracking With Onboard Vision-Based Yaw Control, Rylan Malarchick, Jose Castelblanco, Enrique Amaya, Carmen Dimario, Graysen Brinkman, Chirag Kumar, Kiwon Yoon, Sajid Berhane

Beyond: Undergraduate Research Journal

Autonomous tracking of agile unmanned aerial vehicles (UAVs) presents significant challenges for real-time perception and control systems. This work presents AIRHOUND (Autonomous Intelligent Rotorcraft for Hostile Object Unified Navigation and Detection), a UAV platform implementing vision-based yaw tracking through a modular ROS2 software architecture. The system employs YOLOv8 object detection optimized with NVIDIA TensorRT for embedded deployment on an NVIDIA Jetson Orin companion computer. Detected targets are processed through a geometric tracking module that converts pixel coordinates to angular yaw errors using pinhole camera intrinsics, with a proportional controller generating rate-limited yaw commands. These commands are streamed to a PX4 …

Adaptive Multimodal Smart Home Control On A Raspberry Pi 5 Using Hand Gestures, Voice Cues, And User Feedback, Vaibhav Bora

Theses

A real time multimodal smart home control system deployed on a Raspberry Pi 5 is presented. The system combines hand gestures, short voice cues, and proximity aware interaction to execute household commands such as light brightness control, fan speed adjustment, and stop or kill switch actions. Lightweight gesture and keyword spotting voice classifiers were trained offline and exported to TensorFlow Lite for efficient on device inference. For more natural spoken phrases, the system additionally integrates a locally deployed pretrained offline ASR component rather than a speech recognizer trained from scratch. Using a USB camera and microphone, the system operates fully …

Meeting The Moment With Ai-Employer Informed Education, Brent Terwilliger, John Faraca

Publications

As artificial intelligence transforms aviation, aerospace, and autonomy-related sectors, higher education must adapt to meet evolving workforce demands. This session shares emerging findings from a nationwide study led by Embry-Riddle Aeronautical University, focused on employer perceptions of AI adoption, responsible use, and workforce preparedness in domains including uncrewed systems, space systems, robotics, and advanced air mobility. Based on a structured survey and follow-up interviews, the presentation explores how organizations are using AI tools, from generative platforms to enterprise systems, and defining effective and inappropriate use in operational contexts. Participants will gain insight into critical concerns (e.g., data privacy, compliance, security, …

Autonomous Deficiency Detection And Vision-Language Summarization For Underground Infrastructure On Embedded Edge Systems, Johny Lopez

LSU New Orleans Theses and Dissertations

Aging underground infrastructure poses significant risks to public health and environmental safety, yet structural condition assessment remains bottlenecked by labor-intensive manual CCTV inspections. This thesis proposes a comprehensive algorithmic framework enabling fully autonomous, real-time deficiency detection, geometric assessment, and natural language reporting on resource- constrained edge computing platforms. Three core components address this challenge. First, RAPID-SCAN, a novel semantic segmentation architecture utilizing a Dynamic Feature Pyramid Network and Channel-Spatial Attention, achieves real-time, pixel-precise defect localization with dramatically reduced parameters. Second, an Edge-Optimized Vision-Language Model pipeline employing LoRA and 4-bit QLoRA quantization compresses Phi-3.5 for local deployment, en- abling autonomous technical …

The Excess Path Length Distribution: A Stochastic Model For Sample-Based Path Planners, Chaz B. Cornwall

Dissertations, Master's Theses and Master's Reports

Through random sampling, sample-based path planners enable autonomous agents to quickly find paths without human intervention. However, due to the paths' randomness, sample-based path planners currently require additional verification, partially nullifying agents' ability to act autonomously. I set out to characterize this uncertainty so humans know what to expect from these path planners and know how to alter the path planner to desired specifications. To ensure the results are theoretical as well as practical, I first create a stochastic model of path length uncertainty using the trade-off between sampling time and optimality. By leveraging this model, my proposed algorithm reduces …

Using Automotive Lidar To Reduce The Energy Consumption Of An Ego Autonomous Vehicle, Logan P. Schexnaydre

Dissertations, Master's Theses and Master's Reports

There is significant potential to reduce the energy consumption of the transportation sector through autonomous vehicles. Prior work on autonomous vehicle energy efficiency focuses on the whole system or the control subsystem. Yet, the sensing and processing components, which have direct and indirect effects on net energy use, are less explored. This dissertation fills this gap by modeling and evaluating these effects for lidar sensors, which provide high-resolution spatial data at the cost of high power and processing demands. I apply lidar to the energy-saving tasks of automated vehicle following and road surface profiling. For automated vehicle following, I model …

A Web-Based Wizard-Of-Oz Platform For Collaborative And Reproducible Human-Robot Interaction Research, Sean O'Connor

Honors Theses

The Wizard-of-Oz (WoZ) technique is widely used in Human-Robot Interaction (HRI) research, but two persistent problems limit its effectiveness: existing tools impose technical barriers that exclude non-engineering domain experts (the Accessibility Problem), and the fragmented landscape of robot-specific implementations makes interaction scripts difficult to port across platforms (the Reproducibility Problem- concerning execution consistency and portability, not third-party replication). Through a literature review, I identified three design principles to address both: a hierarchical specification model, an event-driven execution model, and a plugin architecture that decouples experiment logic from robot-specific implementations. I realized these principles in HRIStudio, an open-source, web-based platform providing …

Watch Your Step, Mind The Crowd: Socially Compliant Navigation In Unstructured Environments, Jack Vice

Graduate Studies Theses and Dissertations 2026

Autonomous mobile robots increasingly operate in complex real-world environments characterized by uneven terrain, dynamic obstacles, and human presence. This dissertation addresses the fundamental challenge of developing adaptive navigation strategies that enable robots to safely and effectively traverse unstructured outdoor environments including construction sites, agricultural fields, and disaster areas while maintaining social compliance around people. We advance this capability through five complementary contributions that collectively target dynamic, unstructured, human-occupied environments. First, we demonstrate evolutionary optimization of legged mobility for uneven terrain. Second, we propose using a spatiotemporal autoencoder to learn the temporal dynamics of moving people and objects. Third, we introduce …

Qualitative Stereo Vision Using Distributed Extended Waltz Filtering, Ben Mathew

Theses and Dissertations

Stereo vision is a fundamental problem in computer vision, aimed at reconstructing three-dimensional scene structure from two or more two-dimensional images. Traditional stereo algorithms rely on quantitative disparity estimation, often constrained by calibration precision, lighting variations, and surface texture. In contrast, our proposed Qualitative Stereo Vision seeks to understand depth relationships and spatial configurations from multiple planar views through symbolic reasoning and constraint satisfaction, offering a more flexible and cognitively plausible approach to scene interpretation.

This dissertation presents a novel framework called Distributed Extended Waltz Filtering, designed to provide qualitative stereo vision, particularly in the presence of occlusions—a persistent challenge …

Securing Connected And Autonomous Vehicles, Owana Marzia Moushi

Dissertations and Doctoral Documents, University of Nebraska-Lincoln, 2023–

A vehicular network is susceptible to various security flaws and attacks. Cryptographic techniques are used in vehicular networks but these alone cannot provide proper security to the network. Identifying various types of attacks is necessary to secure vehicular communication networks. In this dissertation, we focused on detecting various insider attacks in vehicular networks to enhance the security of the network.

Our first contribution in this dissertation is the detection of both binary and multi-class data replay and data replay Sybil attacks in vehicular networks. A publicly available dataset, VeReMi-Extension is used to detect these attacks. This dataset has been reformulated …

Learn To Fly: Enabling Deep Learning Based Perception And Control In Aerial Robotics, Krishna Muvva

School of Computing: Dissertations, Theses, and Student Research

Uncrewed Aerial Vehicles (UAVs) are increasingly deployed in dynamic, GPS degraded, and cluttered environments, yet their autonomy remains fundamentally constrained by limitations in onboard perception and real-time control. This dissertation addresses these challenges by proposing a unified framework that co-designs deep learning-based perception and model-based control, organized around three core thrusts: Learn to Track, Learn to Localize, and Learn to Evade.

Learn to Track develops dynamic and adaptive perception control mechanisms that optimize CNN inference for target tracking. A control-aware CNN framework dynamically adjusts inference frequency based on UAV motion, reducing latency while maintaining visual lock. An adaptive CNN with …

Csc36000 - Modern Distributed Computing Assignment, Saptarashmi Bandyopadhyay

Open Educational Resources

This assignment covers standard performance metrics for Distributed Systems and the basics of Multiprocessing for CSC36000 - Modern Distributed Computing at the City College of New York CUNY. It is an interactive coding assignment intended to be executed in a Python notebook.

Optimizing Hip And Knee Assistance For Walking And Sit-To-Stand Transitions: An Intrinsic Muscle Mechanics Based Predictive Approach, Neethan Ratnakumar

Dissertations

As the global population ages, the demand for wearable assistive technologies continues to rise, driven by their potential to enhance mobility and independence in older adults. Effectively designed controllers for lower-limb exoskeletons to assist sit-to-stand (STS) and walking are crucial for delivering efficient, safe, and comfortable assistance during daily activities. Traditionally, controller optimization involves biomechanical modeling and user-specific customization. Musculoskeletal simulations play a central role in this process by providing insights into human-exoskeleton interaction dynamics, thereby informing and refining control strategies.

This work presents a simulation-driven approach for developing exoskeleton controllers for walking and STS using two distinct methods: optimal …

Intelligent Motion Tracking: A Low-Cost Surveillance Framework Using Soc Devices And Sensor Fusion, Aung Myat Khaung, Nicholas Michael Stiffler

Research from the Berry Summer Thesis Institute, 2025

This thesis presents the design and implementation of a lightweight surveillance system capable of realtime motion detection, object tracking, and behavioral history reconstruction in controlled environments. The system uses System-on-Chip devices such as Raspberry Pi boards equipped with NOIR cameras, monocular cameras, and break-beam sensors that work together to detect and track single or multiple moving objects like colored balls. The prototype is validated in structured settings with the goal of eventual deployment in more dynamic environments, addressing the challenge of reliably tracking visually similar objects with minimal distinguishing features. The architecture integrates computer vision with sensor fusion by combining …

Low-Level Memory Attacks On Edge Assisted Robotic Applications, William Arnold

Master of Engineering Theses

This thesis investigates how low-level memory faults can undermine edge-assisted robotic systems that rely on memory optimization. As robots are utilized in real world applications, the ability to operate safely and successfully in mission critical deployment becomes important. To help achieve these goals, developers are increasingly starting to place computation nodes at network edges to meet latency and reliability requirements. Edge nodes, however, are resource-constrained and resources conservation techniques such as Kernel Same-page Merging (KSM) are enabled to deduplicate identical pages across processes or virtual machines. This thesis shows that this optimization technique quietly widens the attack surface and can …

Adversarial Deep Reinforcement Learning For Tank Duel Simulation Using Lidar-Based Observations, Braedan Kennedy

Master's Theses

Previous research has demonstrated that reinforcement learning agents can learn to steer differential-drive robots around obstacles using 2D lidar scans as observations. However, these studies typically treat all range returns as undifferentiated obstacles—objects to avoid—without distinguishing between different object types. This thesis builds upon previous research by introducing an adversarial task in which an agent must interpret raw range readings to both avoid static obstacles and identify, pursue, and engage a hostile target.

To investigate this problem, this thesis introduces TankGame, a novel, lightweight 2D tank duel simulator. Each agent receives a 360° lidar scan, controls its motion via tread …

Gamified Gait Rehabilitation Via Real-Time Biofeedback And Adaptive Hip-Exoskeleton Control, Mariya Huzaifa Tohfafarosh

Theses

Gait impairments arise from systemic diseases, age-related degeneration, musculoskeletal dysfunctions, or neurological conditions. While traditional rehabilitation can be effective, they often face challenges such as high costs, inaccessibility, and low patient engagement. To address these challenges, my work introduces a virtual reality-based rehabilitation (VRBR) system, integrating real-time motion and electromyographic (EMG) muscle activation feedback with a gamified virtual environment for enhanced adaptability and engagement. The system includes a custom-designed hip-exoskeleton that provides adaptive spring-like assistance or resistance, supporting both mobility-impaired users and strength training. Assistance levels can be tuned to match the user's progress. Additionally, a custom pressure insole was …

Soft Modular Robots: From Modular Tensegrity Structures To Bioinspired Sea Robots, Luyang Zhao

Dartmouth College Ph.D Dissertations

The rapid advancement of robotics necessitates systems capable of adapting to complex, unstructured environments. Soft robots, with their flexibility and compliance, excel in delicate interactions, making them ideal for medical applications and search-and-rescue missions. Modular robots, on the other hand, offer reconfigurability, enabling diverse task-specific adaptations in dynamic settings. Despite their individual advantages, the integration of soft and modular robotics remains underexplored. This proposal aims to develop soft modular robots that combine the adaptability of soft robotics with the versatility of modularity. These systems will be capable of autonomously transitioning between locomotion, manipulation, and infrastructure assembly across land, water, and …

Controlling A Mobile Inverted Pendulum And Optimizing Leaning Angle To Apply Force Using Reinforcement Learning, Aryan Mediratta

2025 Spring Honors Capstone Projects - Archive

Reinforcement Learning is a Machine Learning paradigm that involves simulating learning through rewards and penalties in intelligent systems. This technique is often employed in robotics when traditional control methods are insufficient or when human intuition does not provide a good solution on how to control robot systems, This project involves training a Segway-style Mobile Inverted Pendulum (MIP) robot to balance and push a box forward. The BeagleBone Blue board is used that includes a built-in Inertial Measurement Unit (IMU) and encoder ports. These sensors enable the system to measure its current state. The goal is to find the optimal leaning …

Robot-Integrated 4d Building Information Modeling (4d Bim): Framework For Planning Safe Autonomous Construction Operations In Dynamic Environments, Hafiz Oyedimeji Oyediran

Dissertations and Doctoral Documents, University of Nebraska-Lincoln, 2023–

In the construction industry, the use of autonomous robots is considered a solution to overcome the heavy reliance on human workers to perform repetitive, strenuous, and hazardous tasks. While these robots offer the advantage of autonomous operation, ensuring their safe and efficient integration within construction sites requires precise planning. Such planning must account for the varying project complexities such as scope, site layout, tasks, timelines, existence of human workers, and other spatiotemporal conditions of the construction site. Currently, there are no methods to safely plan autonomous robot operations considering these factors within the overarching construction planning process. Thus, autonomous robots …

Control Of Industrial Robots Based On Artificial Intelligence, Bryan Lara Medrano

Open Access Theses & Dissertations

Industrial robots are vital in developing smart factories, creating the need for more efficient and modern control systems. As a result, investigators and scholars are dedicating great effort to advancing this field et al. [27]. Literature showcases significant progress in various areas, including the control of articulated arms and advancements in human-robot interfaces, self-decision-making, object recognition, decision-making, and routing planning. This manuscript describes a novel technique for predicting the movement of a robotic arm based on artificial neural networks. We have implemented an artificial intelligence method based on artificial neural networks to analyze the possible routing of a robotic arm …

Testing Autonomy: Hybrid Scenario Synthesis, Benjamin E. Hargis

Electrical & Computer Engineering Theses & Dissertations

Hybrid Scenario Synthesis merges static and adaptive techniques to generate interactions that rigorously assess autonomous performance under multi-factor testing. Multifactor scenarios employ multiple individual stimuli to rigorously test system responses in complex settings. Static Scenario Testing involves scripted test cases that simulate specific conditions or events. These scenarios represent typical situations an autonomous system might encounter. The benefits of static testing include early defect detection, focused review by trained experts, and efficiency. In multi-factor scenarios, however, statically defined scenario factors are not able to guarantee meaningful interactions as the presence of other factors may invalidate underlying assumptions regarding the system …

Choosing Robust Leadership: Encompassing The Best-Of-N Model And Swarm Intelligence Optimization For Heterogeneous Multiple Autonomous Unmanned Aerial Vehicle Systems, Kudamuhandiramlage Harith Kolitha Warnakulasooriya

Shelby Hall Graduate Research Forum Presentations

Presentation slides for a presentation given at the 1st annual Shelby Hall Graduate Research Forum at the University of South Alabama.

Integrating Neural Networks For Predictive Torque Control And Obstacle Avoidance In Autonomous Robot, Viswanath Kodali, Harsha Vardhan Borra, Kiran P

Northeast Journal of Complex Systems (NEJCS)

In the field of robotics, precise motion control and accurate computation of joint forces are critical for ensuring optimal performance. Traditional methods, such as using the Jacobian matrix for joint angle determination and Euler-Lagrange equations for torque computation, are reliable but computationally intensive, making them less suitable for real-time applications. This paper presents an advanced approach to improving the productivity and efficiency of a 3-Degree of Freedom (DOF) robotic arm by utilizing Artificial Neural Network (ANN). The proposed system dynamically predicts joint angles and torque, enabling faster and more efficient motion control.

To address the challenge of obstacle avoidance in …