Artificial Intelligence and Robotics Commons^™

The Self-Aware Room: A Framework For Operational Self-Awareness In Evolvable Blended Environments, David B. Smith

Publications and Research

The Self-Aware Room (SAR) is a room-scale research environment developed within the larger Balanced Blended Space and Blended Reality Performance System research trajectory. Rather than treating the room as a conventional “smart” environment composed of fixed automation technologies, SAR approaches it as an evolvable blended environment made from physical, virtual, conceptual, sensory, computational, and performative relationships. Its defining feature is not any particular sensor, model, or output device, but the set of transformations through which physical activity becomes structured observation, bounded representation, interpreted state, governed decision, and mediated response.

This paper develops the conceptual and methodological foundations of SAR as …

Navigating Enhanced Exploration Assistance (Nexa), Azhari Abbas, Caleb Fakunle, Ryan Powell, Donovan Livingston

Discovery Day - Daytona Beach

NEXA is an artificial intelligence software platform developed to enhance residential security and property monitoring through seamless integration with autonomous drone systems. This research application of advanced AI in surveillance aims to create a standalone solution capable of real-time threat detection and intelligent alert management. By processing visual and sensory data, NEXA facilitates autonomous drone operation with minimal human intervention. Secure communication channels ensure that instant alerts are delivered to property owners and, potentially, law enforcement, improving response times in security incidents, search-and-rescue operations, and perimeter surveillance. Additionally, NEXA is capable of interfacing with commercially available drone platforms and presents …

Phaëthon System, Brady Roudabush, Lauren Gallo, Emelia Thompson, Jacob Woods

Discovery Day - Daytona Beach

Phaëthon System is the project name for the Search and Rescue Drone Initiative. This initiative will improve the current search and rescue drone industry by introducing new techniques to get through dense forest canopies and other places where an overhead view is not useful. The Phaëthon System uses a swarm of drones that can penetrate under the tree canopy to map and search with the utmost efficiency and safety for rescuers. A command drone is launched to survey the overall search area, and set up a communications and data link. The next component is then released, which is a swarm …

Evaluating Machine Learning Models On Classification Of Novel Cyber Attacks In The Healthcare Domain, Promise Ehimen

Dissertations, Theses, and Projects

The increasing adoption of the Internet of Medical Things (IoMT) has improved healthcare delivery through connected medical devices while simultaneously expanding the cybersecurity risks facing healthcare organizations. Although machine learning based intrusion detection systems have demonstrated high detection accuracy, their ability to respond reliably to previously unseen cyberattacks remains uncertain. This study investigated how a Neural Network model and a Logistic Regression model classified novel cyberattacks within the IoMT environment. The Neural Network and Logistic Regression models were both trained and tested using a subset of the CICIoMT2024 benchmark dataset. The Neural Network achieved 99.82% test accuracy and a 0.94 …

Robust Real-Time Uav Target Tracking With Onboard Vision-Based Yaw Control, Rylan Malarchick, Jose Castelblanco, Enrique Amaya, Carmen Dimario, Graysen Brinkman, Chirag Kumar, Kiwon Yoon, Sajid Berhane

Beyond: Undergraduate Research Journal

Autonomous tracking of agile unmanned aerial vehicles (UAVs) presents significant challenges for real-time perception and control systems. This work presents AIRHOUND (Autonomous Intelligent Rotorcraft for Hostile Object Unified Navigation and Detection), a UAV platform implementing vision-based yaw tracking through a modular ROS2 software architecture. The system employs YOLOv8 object detection optimized with NVIDIA TensorRT for embedded deployment on an NVIDIA Jetson Orin companion computer. Detected targets are processed through a geometric tracking module that converts pixel coordinates to angular yaw errors using pinhole camera intrinsics, with a proportional controller generating rate-limited yaw commands. These commands are streamed to a PX4 …

Adaptive Multimodal Smart Home Control On A Raspberry Pi 5 Using Hand Gestures, Voice Cues, And User Feedback, Vaibhav Bora

Theses

A real time multimodal smart home control system deployed on a Raspberry Pi 5 is presented. The system combines hand gestures, short voice cues, and proximity aware interaction to execute household commands such as light brightness control, fan speed adjustment, and stop or kill switch actions. Lightweight gesture and keyword spotting voice classifiers were trained offline and exported to TensorFlow Lite for efficient on device inference. For more natural spoken phrases, the system additionally integrates a locally deployed pretrained offline ASR component rather than a speech recognizer trained from scratch. Using a USB camera and microphone, the system operates fully …

Meeting The Moment With Ai-Employer Informed Education, Brent Terwilliger, John Faraca

Publications

As artificial intelligence transforms aviation, aerospace, and autonomy-related sectors, higher education must adapt to meet evolving workforce demands. This session shares emerging findings from a nationwide study led by Embry-Riddle Aeronautical University, focused on employer perceptions of AI adoption, responsible use, and workforce preparedness in domains including uncrewed systems, space systems, robotics, and advanced air mobility. Based on a structured survey and follow-up interviews, the presentation explores how organizations are using AI tools, from generative platforms to enterprise systems, and defining effective and inappropriate use in operational contexts. Participants will gain insight into critical concerns (e.g., data privacy, compliance, security, …

Autonomous Deficiency Detection And Vision-Language Summarization For Underground Infrastructure On Embedded Edge Systems, Johny Lopez

LSU New Orleans Theses and Dissertations

Aging underground infrastructure poses significant risks to public health and environmental safety, yet structural condition assessment remains bottlenecked by labor-intensive manual CCTV inspections. This thesis proposes a comprehensive algorithmic framework enabling fully autonomous, real-time deficiency detection, geometric assessment, and natural language reporting on resource- constrained edge computing platforms. Three core components address this challenge. First, RAPID-SCAN, a novel semantic segmentation architecture utilizing a Dynamic Feature Pyramid Network and Channel-Spatial Attention, achieves real-time, pixel-precise defect localization with dramatically reduced parameters. Second, an Edge-Optimized Vision-Language Model pipeline employing LoRA and 4-bit QLoRA quantization compresses Phi-3.5 for local deployment, en- abling autonomous technical …

A Web-Based Wizard-Of-Oz Platform For Collaborative And Reproducible Human-Robot Interaction Research, Sean O'Connor

Honors Theses

The Wizard-of-Oz (WoZ) technique is widely used in Human-Robot Interaction (HRI) research, but two persistent problems limit its effectiveness: existing tools impose technical barriers that exclude non-engineering domain experts (the Accessibility Problem), and the fragmented landscape of robot-specific implementations makes interaction scripts difficult to port across platforms (the Reproducibility Problem- concerning execution consistency and portability, not third-party replication). Through a literature review, I identified three design principles to address both: a hierarchical specification model, an event-driven execution model, and a plugin architecture that decouples experiment logic from robot-specific implementations. I realized these principles in HRIStudio, an open-source, web-based platform providing …

Learn To Fly: Enabling Deep Learning Based Perception And Control In Aerial Robotics, Krishna Muvva

School of Computing: Dissertations, Theses, and Student Research

Uncrewed Aerial Vehicles (UAVs) are increasingly deployed in dynamic, GPS degraded, and cluttered environments, yet their autonomy remains fundamentally constrained by limitations in onboard perception and real-time control. This dissertation addresses these challenges by proposing a unified framework that co-designs deep learning-based perception and model-based control, organized around three core thrusts: Learn to Track, Learn to Localize, and Learn to Evade.

Learn to Track develops dynamic and adaptive perception control mechanisms that optimize CNN inference for target tracking. A control-aware CNN framework dynamically adjusts inference frequency based on UAV motion, reducing latency while maintaining visual lock. An adaptive CNN with …

Csc36000 - Modern Distributed Computing Assignment, Saptarashmi Bandyopadhyay

Open Educational Resources

This assignment covers standard performance metrics for Distributed Systems and the basics of Multiprocessing for CSC36000 - Modern Distributed Computing at the City College of New York CUNY. It is an interactive coding assignment intended to be executed in a Python notebook.

Optimizing Hip And Knee Assistance For Walking And Sit-To-Stand Transitions: An Intrinsic Muscle Mechanics Based Predictive Approach, Neethan Ratnakumar

Dissertations

As the global population ages, the demand for wearable assistive technologies continues to rise, driven by their potential to enhance mobility and independence in older adults. Effectively designed controllers for lower-limb exoskeletons to assist sit-to-stand (STS) and walking are crucial for delivering efficient, safe, and comfortable assistance during daily activities. Traditionally, controller optimization involves biomechanical modeling and user-specific customization. Musculoskeletal simulations play a central role in this process by providing insights into human-exoskeleton interaction dynamics, thereby informing and refining control strategies.

This work presents a simulation-driven approach for developing exoskeleton controllers for walking and STS using two distinct methods: optimal …

Intelligent Motion Tracking: A Low-Cost Surveillance Framework Using Soc Devices And Sensor Fusion, Aung Myat Khaung, Nicholas Michael Stiffler

Research from the Berry Summer Thesis Institute, 2025

This thesis presents the design and implementation of a lightweight surveillance system capable of realtime motion detection, object tracking, and behavioral history reconstruction in controlled environments. The system uses System-on-Chip devices such as Raspberry Pi boards equipped with NOIR cameras, monocular cameras, and break-beam sensors that work together to detect and track single or multiple moving objects like colored balls. The prototype is validated in structured settings with the goal of eventual deployment in more dynamic environments, addressing the challenge of reliably tracking visually similar objects with minimal distinguishing features. The architecture integrates computer vision with sensor fusion by combining …

Adversarial Deep Reinforcement Learning For Tank Duel Simulation Using Lidar-Based Observations, Braedan Kennedy

Master's Theses

Previous research has demonstrated that reinforcement learning agents can learn to steer differential-drive robots around obstacles using 2D lidar scans as observations. However, these studies typically treat all range returns as undifferentiated obstacles—objects to avoid—without distinguishing between different object types. This thesis builds upon previous research by introducing an adversarial task in which an agent must interpret raw range readings to both avoid static obstacles and identify, pursue, and engage a hostile target.

To investigate this problem, this thesis introduces TankGame, a novel, lightweight 2D tank duel simulator. Each agent receives a 360° lidar scan, controls its motion via tread …

Gamified Gait Rehabilitation Via Real-Time Biofeedback And Adaptive Hip-Exoskeleton Control, Mariya Huzaifa Tohfafarosh

Theses

Gait impairments arise from systemic diseases, age-related degeneration, musculoskeletal dysfunctions, or neurological conditions. While traditional rehabilitation can be effective, they often face challenges such as high costs, inaccessibility, and low patient engagement. To address these challenges, my work introduces a virtual reality-based rehabilitation (VRBR) system, integrating real-time motion and electromyographic (EMG) muscle activation feedback with a gamified virtual environment for enhanced adaptability and engagement. The system includes a custom-designed hip-exoskeleton that provides adaptive spring-like assistance or resistance, supporting both mobility-impaired users and strength training. Assistance levels can be tuned to match the user's progress. Additionally, a custom pressure insole was …

Soft Modular Robots: From Modular Tensegrity Structures To Bioinspired Sea Robots, Luyang Zhao

Dartmouth College Ph.D Dissertations

The rapid advancement of robotics necessitates systems capable of adapting to complex, unstructured environments. Soft robots, with their flexibility and compliance, excel in delicate interactions, making them ideal for medical applications and search-and-rescue missions. Modular robots, on the other hand, offer reconfigurability, enabling diverse task-specific adaptations in dynamic settings. Despite their individual advantages, the integration of soft and modular robotics remains underexplored. This proposal aims to develop soft modular robots that combine the adaptability of soft robotics with the versatility of modularity. These systems will be capable of autonomously transitioning between locomotion, manipulation, and infrastructure assembly across land, water, and …

Controlling A Mobile Inverted Pendulum And Optimizing Leaning Angle To Apply Force Using Reinforcement Learning, Aryan Mediratta

2025 Spring Honors Capstone Projects - Archive

Reinforcement Learning is a Machine Learning paradigm that involves simulating learning through rewards and penalties in intelligent systems. This technique is often employed in robotics when traditional control methods are insufficient or when human intuition does not provide a good solution on how to control robot systems, This project involves training a Segway-style Mobile Inverted Pendulum (MIP) robot to balance and push a box forward. The BeagleBone Blue board is used that includes a built-in Inertial Measurement Unit (IMU) and encoder ports. These sensors enable the system to measure its current state. The goal is to find the optimal leaning …

Robot-Integrated 4d Building Information Modeling (4d Bim): Framework For Planning Safe Autonomous Construction Operations In Dynamic Environments, Hafiz Oyedimeji Oyediran

Dissertations and Doctoral Documents, University of Nebraska-Lincoln, 2023–

In the construction industry, the use of autonomous robots is considered a solution to overcome the heavy reliance on human workers to perform repetitive, strenuous, and hazardous tasks. While these robots offer the advantage of autonomous operation, ensuring their safe and efficient integration within construction sites requires precise planning. Such planning must account for the varying project complexities such as scope, site layout, tasks, timelines, existence of human workers, and other spatiotemporal conditions of the construction site. Currently, there are no methods to safely plan autonomous robot operations considering these factors within the overarching construction planning process. Thus, autonomous robots …

Control Of Industrial Robots Based On Artificial Intelligence, Bryan Lara Medrano

Open Access Theses & Dissertations

Industrial robots are vital in developing smart factories, creating the need for more efficient and modern control systems. As a result, investigators and scholars are dedicating great effort to advancing this field et al. [27]. Literature showcases significant progress in various areas, including the control of articulated arms and advancements in human-robot interfaces, self-decision-making, object recognition, decision-making, and routing planning. This manuscript describes a novel technique for predicting the movement of a robotic arm based on artificial neural networks. We have implemented an artificial intelligence method based on artificial neural networks to analyze the possible routing of a robotic arm …

Choosing Robust Leadership: Encompassing The Best-Of-N Model And Swarm Intelligence Optimization For Heterogeneous Multiple Autonomous Unmanned Aerial Vehicle Systems, Kudamuhandiramlage Harith Kolitha Warnakulasooriya

Shelby Hall Graduate Research Forum Presentations

Presentation slides for a presentation given at the 1st annual Shelby Hall Graduate Research Forum at the University of South Alabama.

Integrating Neural Networks For Predictive Torque Control And Obstacle Avoidance In Autonomous Robot, Viswanath Kodali, Harsha Vardhan Borra, Kiran P

Northeast Journal of Complex Systems (NEJCS)

In the field of robotics, precise motion control and accurate computation of joint forces are critical for ensuring optimal performance. Traditional methods, such as using the Jacobian matrix for joint angle determination and Euler-Lagrange equations for torque computation, are reliable but computationally intensive, making them less suitable for real-time applications. This paper presents an advanced approach to improving the productivity and efficiency of a 3-Degree of Freedom (DOF) robotic arm by utilizing Artificial Neural Network (ANN). The proposed system dynamically predicts joint angles and torque, enabling faster and more efficient motion control.

To address the challenge of obstacle avoidance in …

Environment And Intention Awareness For Navigation And Collaboration, Bhaskar Chandra Trivedi

Computer Science and Engineering Dissertations - Archive

Unmanned Aerial Systems (UAS) have become increasingly popular as versatile platforms for tasks such as surveillance, inspection, delivery, and maintenance. In many applications, UAS operate in environments frequented by people or containing sensitive infrastructure, which introduces physical risks in case of vehicle failure, as well as psychological and privacy concerns that may limit their acceptability. Ensuring safe and efficient operation thus requires that UAS consider these risks when planning navigation strategies. While prior information, such as city maps and building layouts, can partially inform risk assessment, such data is often incomplete, necessitating real-time augmentation of risk maps using sensor information. …

Heuristic Approaches For Coordination Of Heterogeneous Robotic Systems In Harvesting Automation With Size Constraints, Hyeseon Lee

Dissertations, Master's Theses and Master's Reports

This thesis presents the development of path planning algorithms for the coordination of heterogeneous robotic systems while considering size constraints. The objective is to generate practical and efficient solutions for real-world applications. The use of heterogeneous collaborative robots is beneficial in many applications, such as transportation operations in warehouses or manufacturing environments, surveillance, and monitoring, and task allocation and path planning are critical techniques that need to be addressed to deploy in real-world applications. This research focuses on automating lavender harvesting, where robots with varying capabilities must collaboratively navigate complex field layouts to efficiently complete harvesting tasks.

The problem considers …

Motion Planning For A Flexible Modular Raft Robot, Chun-Yi She

Dartmouth College Master’s Theses

This thesis presents a hierarchical motion planning framework for SoftRafts, a modular and deformable aquatic robot capable of performing locomotion and manipulation tasks on water surfaces. SoftRafts consist of soft and rigid components that enable structural reconfiguration, offering adaptability in unstructured aquatic environments.

To address the complexity of planning in high-dimensional, deformable systems, the proposed method uses a bounding-shape abstraction, specifically, enclosing circles and rectangular bounding boxes to simplify motion planning. These enclosures abstract the robot's overall shape, reducing the high-dimensional planning problem into a lower-dimensional problem. A global planner uses a probabilistic roadmap (PRM) to compute a collision-free path …

Cropsync: Ai-Powered Sustainable Crop Management, Ziad Doughan, Ibrahim Mneimneh, Zouheir Nakouzi, Noor Al Khaib, Samer Damaj, Jamal Chaaban, Hamza Mrad, Sari Itani

BAU Journal - Science and Technology

CropSync is a smart agriculture system that uses AI and IoT technologies to enable sustain- able crop management and precision farming. The system aims to address the challenges faced by the agriculture sector, such as increasing food production to meet global population demands while minimizing environmental impact. CropSync integrates sensors, cameras, and cloud-based analytics to provide farmers with real-time insights and recommendations for optimizing crop cul- tivation. The system upholds engineering professional and ethical standards, considering broader social, environmental, and economic implications. From a social perspective, CropSync improves food security and enhances farmers’ livelihoods through increased productivity and efficient re- …

Mechanically Cost-Effective Approach For Bipedal Walking In Robots Using Instantaneous Collision Angle, Smit R. Patel

UNLV Theses, Dissertations, Professional Papers, and Capstones

Humans, as bipedal locomotors, are effective at reducing the mechanical cost of transport (CoTmech) by adopting movement strategies and gaits that minimize energy expenditure for a given distance. By using different gaits at different speeds, leveraging their long spring-like tendons and muscle elasticity which store and release energy during movement, humans reduce the mechanical effort required for locomotion. Current locomotion solutions offered in bipedal robots, based on legacy walking and running gait models, are not great at energy efficiency unless walking at very low speeds. Additionally, the control system of robots, designed to ensure stability and adaptability, requires substantial resources, …

Robotic Multi-Object Grasping From A Pile: Techniques And Algorithms For Enhanced Dexterity, Tianze Chen

USF Tampa Graduate Theses and Dissertations

As robots become increasingly integrated into real-world applications such as warehousing, fulfillment centers, and manufacturing, the need for efficient and adaptable robotic systems grows. One of the key challenges is enabling robots to grasp multiple objects simultaneously, as this significantly boosts the efficiency of tasks like batch picking, sorting, and object transferring, reducing both time and energy consumption. This dissertation presents a comprehensive multi-object grasping (MOG) pipeline that includes pre-grasp selection, end-pose selection, grasping synergy calculation, and a data-driven model for estimating the number of objects being grasped. Central to this work is the development of the Experience Forest structure, …

Heterogeneous Multi-Robot Person-Following In Constrained Environments, Ori A. Miller

Electronic Theses and Dissertations

Maintaining visibility of a person requires effective systems. Security cameras or ground robots might be ideal, but they often fail in uncontrolled or unknown environments. A single ground robot struggles to navigate and track an agent at the same time. This work addresses the challenge by developing a multi-robot system with a slow ground robot and an agile aerial robot. Three methods are evaluated: FORWARD-PF, RL-Person Following (RL), and a baseline closed-loop method. FORWARD-PF proved the most reliable, completing all nine paths and reaching targets nearly twice as fast as RL. Despite completing seven paths, RL faltered on complex tasks. …

Robotic Odor Source Localization Using Vision And Olfaction Sensing, Sunzid Hassan

Master's Theses

Robotic Odor Source Localization (ROSL) technology allows autonomous agents like robots to find an odor source in unknown environments. A successful odor source location depends crucially on an effective navigation algorithm that directs the robot towards the odor source. This thesis is a combination of three projects. First, we detail development of a versatile multi-modal robotic platform for ROSL real-world ROSL experimentation and discussed real-world validation of a traditional olfactionbased ROSL algorithm. Secondly, we introduced vision in ROSL by proposing a fusion navigation algorithm that integrates deep-learning enabled vision and olfaction-based navigation. This hybrid approach tackles challenges such as turbulent …

Development Of A Rule-Based Monitoring System For Autonomous Heavy Equipment Safety, Amirpooya Shirazi

Department of Construction Engineering and Management: Dissertations, Theses, and Student Research

Roadway construction work zones are constantly exposed to interactions among construction equipment, workers, and vehicles. Furthermore, ensuring safety in these areas is considered a challenging task due to the complexity of the environment. As shown in the rising trend of fatal accidents in roadway work zones, current OSHA regulations in construction safety are insufficient in effectively detecting unsafe situations and mitigating the risks. Furthermore, best practices, such as internal traffic control planning (ITCP), exhibit critical limitations requiring continuous monitoring of active work zones as well as adjustments to the site coordination plans due to the dynamic nature of work zone …