Robotics Commons^™

Efficient And Test-Time Adaptive Visual Object Tracking In The Wild, Ram J. Zaveri

Graduate Theses, Dissertations, and Problem Reports (ETD)

Tracking a single object, given the location at the first frame, has been an ongoing challenge in the vision community for decades. Most recent approaches provide reasonably good performance, especially when benchmarked on in-distribution (ID) datasets, i.e., on the testing portion of the same datasets used for training. However, they incur high computational costs and hardware constraints, making their deployment in the wild for mobile, autonomous, and IoT applications still challenging. Efficient visual trackers address the efficiency aspect of such bottlenecks; however, they tend to overfit to their training distributions and lack generalization abilities, resulting in them performing well on …

Exploring The Benefits, Barriers, And Sustainability Of Community Stem Partnerships: A Qualitative Case Study On Stem Collaboration In Elementary Education, Katherine M. Blagden

Open Access Dissertations

In an era of increasing emphasis on science, technology, engineering, and mathematics (STEM) education, elementary schools often face significant challenges in implementing high-quality, integrated STEM instruction. These challenges include limited resources, inconsistent professional development, and a lack of access to real-world, community-based learning experiences (Dorph et al., 2018; National Science Board, 2024). This dissertation explores how collaborative partnerships among elementary schools, community organizations, and industry professionals can overcome these barriers and foster meaningful, sustainable STEM learning opportunities for young students. Drawing on the Asset-Based Community Development (ABCD) model (Kretzmann & McKnight, 1993) and informed by a constructivist theoretical framework (Vygotsky, …

Heuristic Approaches For Coordination Of Heterogeneous Robotic Systems In Harvesting Automation With Size Constraints, Hyeseon Lee

Dissertations, Master's Theses and Master's Reports

This thesis presents the development of path planning algorithms for the coordination of heterogeneous robotic systems while considering size constraints. The objective is to generate practical and efficient solutions for real-world applications. The use of heterogeneous collaborative robots is beneficial in many applications, such as transportation operations in warehouses or manufacturing environments, surveillance, and monitoring, and task allocation and path planning are critical techniques that need to be addressed to deploy in real-world applications. This research focuses on automating lavender harvesting, where robots with varying capabilities must collaboratively navigate complex field layouts to efficiently complete harvesting tasks.

The problem considers …

The Coral Carousel: A Device And Method For In-Situ Propagation Of Deep-Sea Corals, Gregory Bales

Open Access Master's Theses

The research described herein covers the development of a tool station for performing in-situ propagation of corals using a work class ROV. This includes a system for manipulating coral fragments and affixing them to a cement base plug. To validate this tool station, testing was performed both in the lab as well as at depth in the Gulf of Mexico. As restoration of shallow-water corals has grown in popularity, many techniques have been developed for propagation. However, it is difficult or inappropriate to directly apply these techniques to deep-sea corals. While some forms of diving are capable of approaching the …

Toward Precise Long-Range Underwater Acoustic Geo-Positioning: Utilizing Vehicle Data And Deepening The Gnss Analogy Through Uncertainty Modeling, Isaac B. Salazar

Open Access Master's Theses

Electromagnetic signals, such as those used by Global Navigation Satellite Systems (GNSS), attenuate dramatically underwater, but acoustic signals can travel hundreds of kilometers, and can be used for positioning in much the same way. Concepts from GNSS can be applied to the subsurface context, as at a basic level, the principles of geo-positioning are identical. Key challenges in translating satellite positioning models to the underwater acoustic domain include differences in signal type as well as instrumentation and propagation environment. Acoustic signals travel at much slower speeds and are subject to significant environmental variability due to complex ocean dynamics. Here, the …

Autonomous Landscape Exploration Rover Using Imaging Surface Navigation (Alexis), Noah Jones, Dominic Salupo

Williams Honors College, Honors Research Projects

The objective is to develop a small-form-factor rover prototype that can be used to prove out a novel traversal method for use on extraterrestrial surfaces. The novel traversal method being proposed is LIDAR/CV-enhanced navigation, provided by a detachable flight vehicle that can communicate with the rover. On planets with thin atmospheres, cold gas thrusters or similar may be needed, but for the scope of this project more traditional flight/propulsion methods will be used.

Llm-Driven Fmea For Safe Human-Robot Collaboration In Disassembly, Morteza Jalali Alenjareghi, Samira Keivanpour, Yuvin Adnarain Chinniah, Sabrina Jocelyn

Articles dans des actes de congrès

Disassembly operations often present unstructured and unpredictable scenarios, such as handling hazardous materials, addressing ergonomic strain, and managing dynamic robot interactions that pose safety risks. To tackle these challenges, we propose an innovative use of large language models (LLMs) to enhance failure mode and effect analysis (FMEA) in the context of human-robot collaboration (HRC) for disassembly tasks. We developed an LLM system leveraging retrieval-augmented generation (RAG) for real-time risk analysis and recommendation generation. RAG retrieves domain-specific information from the FMEA knowledge database, enabling accurate risk analysis, contextual understanding, and relevant recommendations based on user input and operational data. Evaluation of …

Virtual Environment Creation And Camera Calibration For Soft Target Identification And Assistance In Crowded Spaces With A Sensor Network And A Robotic Dog, Eltan Samoylov

Dissertations and Theses

Crowded places are increasingly targets of violence due to the increased accessibility and covertness of weapons, explosives, and other technology like drones. Addressing the challenges of protecting crowded places and assisting vulnerable individuals requires a multidisciplinary approach, taking inspiration from many different perspectives. Video surveillance of these crowded public facilities, such as train and bus stations, airports, shopping malls, and sports arenas, is very important to public safety, both for identifying threats/terrorist attacks and implementing evacuation plans.

The work of this thesis is part of a larger project aiming to explore the potential of using real-time computer vision and deep …

Motion Planning For A Flexible Modular Raft Robot, Chun-Yi She

Dartmouth College Master’s Theses

This thesis presents a hierarchical motion planning framework for SoftRafts, a modular and deformable aquatic robot capable of performing locomotion and manipulation tasks on water surfaces. SoftRafts consist of soft and rigid components that enable structural reconfiguration, offering adaptability in unstructured aquatic environments.

To address the complexity of planning in high-dimensional, deformable systems, the proposed method uses a bounding-shape abstraction, specifically, enclosing circles and rectangular bounding boxes to simplify motion planning. These enclosures abstract the robot's overall shape, reducing the high-dimensional planning problem into a lower-dimensional problem. A global planner uses a probabilistic roadmap (PRM) to compute a collision-free path …

Development And Prototyping Of A Modular Quadruped Towards Testing Standardization For Legged Robot Stability, Michael Conner Larsen

Graduate Research Theses & Dissertations

Legged robots are well-suited for navigating uneven and unmapped terrain, making them valuable in various robotics applications. Maintaining balance and stability in such environments relies on a combination of sensors, control strategies, and mechanical design. However, selecting the most effective sensing and control method for a given use case remains challenging. Previous studies have explored various approaches, integrating combinations of joint angle measurement, inertial measurement units (IMUs), torque-based control, leg force measurement, image processing, and machine learning, paired with numerous controller designs, which can contribute to stability. However, direct comparisons of these methods are often limited by the need for …

Human Swarm Interaction Using Non-Verbal Communication, Arunim Bhattacharya

Graduate Research Theses & Dissertations

This research presents experimentally validated strategies for human-swarm robotic interaction through nonverbal communication. Applications of this work are in large-scale coverage problems that include search and rescue operations and environmental monitoring missions. The non-verbal interaction becomes critical in situations where wireless communication methods may be limited by bandwidth constraints, privacy concerns, or environmental clutter. The research objective of this dissertation is to design and evaluate methods of nonverbal communication between a human teleoperator and robotic swarms towards a bidirectional human-swarm interaction framework. Towards this, we first establish a reliable measure of real-time cognitive load that can serve to close the …

Contextual Augmentation In Artificial Intelligence, Emmanuel Joshua Balogun

College of Graduate Studies: Theses & Dissertations

Contextual understanding is a significant challenge of Large Language Models (LLMs), which are typically trained on general-purpose datasets. Due to this, LLMs fail to capture nuanced or domain-specific information and may struggle to interpret user queries accurately. Consequently, prompt engineering can become complex in automating, and LLMs are prone to “hallucinating”—generating random or irrelevant texts—when they lack sufficient context. This undermines their ability to provide focused, accurate responses. Accordingly, this thesis seeks to enhance the contextual understanding capabilities of Artificial Intelligence systems to facilitate more precise and relevant answer generation. Study A looks into a new approach to combating misinformation …

Fast-Sparse-Spanner: A Practical Algorithm For Constructing Low-Stretch Sparse Geometric Graphs, Fnu Shariful

UNF Graduate Theses and Dissertations

When constructing geometric graphs (vertices are points and edges are line segments connecting point pairs) on pointsets, stretch-factor (worst-case detour between any point pair) is often considered a quality metric. A low stretch-factor (a quantity that is usually > 1) guarantees short paths between all vertex pairs. A geometric graph having a stretch-factor of t is known as a t-spanner. Creating low stretch-factor geometric graphs for large pointsets with a low number of edges is an open problem in computational geometry.

In this work, we have designed and engineered a new simple and practical (fast and memory-efficient) algorithm named Fast-Sparse-Spanner algorithm …

Flower Cluster Matching Utilizing The Unscented Transform For Robotic Pollination, Andy Chu

Graduate Theses, Dissertations, and Problem Reports (ETD)

The use of automated systems for agriculture is integral to keeping the food supply secure. Both industry and academia are exploring and applying methods to increase the yield of plants in environments ranging from outdoor fields to greenhouses. Specifically, many automated systems use continuous monitoring of plants to track plant health and yield. The use of computer vision is necessary when it comes to precision operations that use robotics. Today, robots are trained to weed, harvest, and pollinate. To accomplish these tasks autonomously, a lot of data is needed, which is where spatial-temporal observations of the plants are being recorded …

A Framework For Biomimetic Robot Design Applied To The Development Of A Robotic Model Of Drosophila Melanogaster, Clarissa A. Goldsmith

Graduate Theses, Dissertations, and Problem Reports (ETD)

For decades, the field of biologically inspired robotics has leveraged insights from animal locomotion to improve the walking ability of legged robots. Recently, “biomimetic” robots have been developed to model how specific animals walk. By prioritizing biological accuracy to the target organism rather than the application of general principles from biology, these robots can be used to develop detailed biological hypotheses for animal experiments, ultimately improving our understanding of the biological control of legs while improving technical solutions. Much of this work involves biologically inspired walking controllers informed by the morphology and dynamics of the insect nervous system, which necessitate …

Imitation Learning In Robotic Manipulation Using Diffusion Models, Marlon Domingues De Oliveira

Graduate Theses, Dissertations, and Problem Reports (ETD)

This work deals with the problem of teaching robots by demonstration, also known by imitation learning. The main objective of this area of research is to enable the autonomous execution of complex robotic tasks using neural networks trained on expert-generated data, thus allowing the transfer of human knowledge to machines. To this end, this thesis describes an experimental setup especially designed for the study of imitation learning in robotic manipulation tasks and the adaptation and evaluation of a previously published technique to this setup. The experimental setup developed in this work is based on the Franka Emika Research 3 manipulator, …

Cropsync: Ai-Powered Sustainable Crop Management, Ziad Doughan, Ibrahim Mneimneh, Zouheir Nakouzi, Noor Al Khaib, Samer Damaj, Jamal Chaaban, Hamza Mrad, Sari Itani

BAU Journal - Science and Technology

CropSync is a smart agriculture system that uses AI and IoT technologies to enable sustain- able crop management and precision farming. The system aims to address the challenges faced by the agriculture sector, such as increasing food production to meet global population demands while minimizing environmental impact. CropSync integrates sensors, cameras, and cloud-based analytics to provide farmers with real-time insights and recommendations for optimizing crop cul- tivation. The system upholds engineering professional and ethical standards, considering broader social, environmental, and economic implications. From a social perspective, CropSync improves food security and enhances farmers’ livelihoods through increased productivity and efficient re- …

End-To-End Autonomous Quadcopter Using Reinforcement Learning, Mohamed Marwan Chawa

Theses and Dissertations

This thesis investigates the potential of Reinforcement Learning (RL) for achieving robust and adaptable quadcopter control, focusing on trajectory and attitude stabilization. We compare state-of-the-art RL algorithms, specifically Proximal Policy Optimization (PPO), against traditional Proportional-Integral-Derivative (PID) controllers across three tasks: hovering, slow trajectory following, and fast trajectory following. To enhance realism, we employ a modified PyFlyt simulation environment with a high-fidelity Crazyflie 2.x model, accounting for motor dynamics, noise, wind disturbances, and aerodynamic drag.

The challenge of operating a quadcopter can be divided into two distinct parts: planning a flight path and actually following that path. Our focus is on …

Predicting Vegetation Override Force For Off-Road Autonomy, Marc Nicholas Moore

Theses and Dissertations

Vegetation override is an important aspect of off-road ground vehicle mobility. An autonomous ground vehicle’s (AGV) perception system must distinguish between vegetation that can be easily driven through from vegetation that cannot. Predicting the resistance of vegetation could allow path- planning systems to make this distinction. However, despite its importance, direct measurement of vegetation resistance is rare, as most studies use indirect proprioceptive data, such as inertial measurements, as proxies for override force. Notably, there is a lack of empirical data on the override resistance of small stems (< 2.5 cm) and clusters of vegetation on medium-sized (approx. 1000kg) vehicles. To address this gap, a comprehensive dataset of override measurements was collected for clumps of small vegetation relevant to intermediate-sized AGVs navigating off-road terrain. This dataset includes over 70 recordings using the Robot Operating System (ROS) during controlled driving experiments through small trees, grasses, and bushes. The collected data includes light detection and ranging (LiDAR) scans, imagery, force measurements from integrated load cells, and simultaneous localization and mapping (SLAM) information. A key contribution of this research is the development and calibration of a custom push bar system equipped with load cells to directly measure override forces. These measurements are compared to empirical models previously developed by the U.S. Army Corps of Engineers for larger single-stem vegetation. A preprocessing pipeline was developed to automatically extract and label LiDAR and camera data according to these force measurements. This self-labeled dataset was then used to train machine learning models that predict override resistance of vegetation from LiDAR and camera scans alone. This research characterizes the relationship between override forces and the observable features of vegetation as measured by LiDAR and camera sensors. Deep learning models were developed and trained to predict override forces based on different input modalities and features derived from point clouds and images. The performance of these models was compared across various input features to investigate how deep learning can create a generalizable and accurate force prediction system.

Utilizing Pupper, A Social Robot Dog, To Increase Happiness And Improve Mood In Pediatric Patients Of A Cardiac Step-Down Unit, Angela Feng Wu

Master's Projects and Capstones

Objective The usage of social robots in pediatrics is an emerging field of study. Preliminary research shows that they are effective at improving the psychosocial well-being of pediatric patients. This quality improvement project focuses on Pupper, a newly developed quadruped social robot dog, and its ability in improving mood and happiness in pediatric patients of a cardiac step-down unit. Aim The aim of this project is to increase average mood scores of pediatric cardiac patients aged 3-25 years by 50% from their baseline of 3.75 to 5.63 on a six-point scale within a one-month time frame. Methods Before intervention and …