Robotics Commons^™

Transformer And Recurrent Architectures For Dynamics Prediction And Policy Learning On Long-Horizon Tasks, Vinal Jitendrabhai Gadhiya

Computer Science and Engineering Theses - Archive

Model-based reinforcement learning promises improved sample efficiency by learning environment dynamics and using them for planning or policy improvement. However, the choice of neural architecture for dynamics prediction significantly impacts the model's ability to capture temporal dependencies and maintain long-term context, capabilities crucial for complex, open-world environments.

This thesis investigates three neural architectures for learning world models: Transformer-based, GRU-based, and a hybrid Transformer+GRU approach. We evaluate these architectures on Crafter, a 2D open-world survival environment that requires long-horizon planning and sequential task completion. In Crafter, agents must perform hierarchical sequences of actions, such as collecting wood, placing a table, and …

Multi-Modal Model-Based Optical Flow Estimation For Event-Based Vision, Pritam Karmokar

Computer Science and Engineering Dissertations - Archive

Event cameras offer a fundamentally different sensing paradigm by asynchronously capturing brightness changes at high temporal resolution, directly encoding motion in the scene. However, their sparse and non-traditional data format poses significant challenges for dense motion estimation, particularly in the context of optical flow. Contrast Maximization (CM) has emerged as a powerful model-based framework for estimating optical flow from event data by optimizing the sharpness of motion-compensated event representations. This dissertation builds upon and significantly advances the CM framework through two complementary contributions.

First, we propose Edge-Informed Contrast Maximization (EINCM), a hybrid approach that augments the traditional events-only CM framework …

3d Perception, Mapping, And Navigation For Mobile Cobot, Tuan T. Dang

Computer Science and Engineering Dissertations - Archive

Service robots are migrating from tightly controlled factory lines into offices, hospitals, and homes, where they must perceive, remember, and act amid people, clutter, and perpetual change. Humans solve this daily by forming compact, task-relevant “cognitive maps”: we sample just enough sensory detail to guide the moment, stitch those snapshots into a sparse topological scaffold, and continuously refine it as we move. Guided by that insight, this dissertation proposes a biologically inspired mapping framework that turns partial RGB-D observations into a hybrid temporal-spatial memory—locally metric for centimeter-scale navigation yet globally topological for room-to-building navigation. The system first distills raw depth …

Environment And Intention Awareness For Navigation And Collaboration, Bhaskar Chandra Trivedi

Computer Science and Engineering Dissertations - Archive

Unmanned Aerial Systems (UAS) have become increasingly popular as versatile platforms for tasks such as surveillance, inspection, delivery, and maintenance. In many applications, UAS operate in environments frequented by people or containing sensitive infrastructure, which introduces physical risks in case of vehicle failure, as well as psychological and privacy concerns that may limit their acceptability. Ensuring safe and efficient operation thus requires that UAS consider these risks when planning navigation strategies. While prior information, such as city maps and building layouts, can partially inform risk assessment, such data is often incomplete, necessitating real-time augmentation of risk maps using sensor information. …

A Comprehensive Review And Bibliometric Analysis On Collaborative Robotics For Industry: Safety Emerging As A Core Focus, Aida Haghighi, Morteza Cheraghi, Jérôme Pocachard, Valérie Botta-Genoulaz, Sabrina Jocelyn, Hamidreza Pourzarei

Revues de littérature, synthèses de connaissances

Research organizations and academics often seek to map the development of scientific fields, identify research gaps, and guide the direction of future research. In cobot-related research, the scientific literature consulted does not propose any comprehensive research agenda. Moreover, cobots, industrial robots inherently designed to collaborate with humans, bring with them emerging issues. To solve them, interdisciplinary research is often essential (e.g., combination of engineering, ergonomics and biomechanics expertise to handle safety challenges). This paper proposes an exhaustive study that employs a scoping review and bibliometric analysis to provide a structured macro perspective on the developments, key topics, and trends in …

Tracking Control Of A String Actuated Soft Trunk Robot Using State-Space Modeling, Jacob Trivisonno

Open Access Master's Theses

Soft robots, primarily composed of compliant materials, exhibit highly complex and nonlinear dynamics, making precise control a significant challenge. Traditional control methods often struggle with these complexities, requiring more advanced and data-driven methods. In our previous work, “Automatic Control of a Soft Trunk Robot Actuated by Strings” [1], a proportional controller was developed to drive the steady-state tracking error to zero. While this method was effective, it required time-consuming manual tuning and was not easily adaptable to physical modifications of the robot.

To address these limitations, this research implements gain-scheduled feedback control with state-space models calculated through a multiple linear …

Augmenting Machine Learning Technique Through Natural Language, Tasmia Tasrin

Theses and Dissertations--Computer Science

While artificial intelligence (AI) and machine learning (ML) have proven effective at addressing many of the challenges that we face in our everyday lives, there are many situations in which these methods struggle. Examples include environments where AI or ML systems must perform complex behaviors or those where rewards are difficult to calculate. To address this limitation, interactive machine learning (IML) techniques have been introduced, which incorporate machine-understandable human feedback into traditional ML approaches. This feedback is often given as a discrete, positive or negative numeric value. This feedback is typically provided as often as possible to convey a dense …

Integrated Compliant Structure For A Hand Exoskeleton, Tristan R. Koopman

Honors Undergraduate Theses

This thesis presents the design and prototyping of a wearable hand exoskeleton that integrates a flexible structural framework to assist with hand movement while maintaining comfort and anatomical conformity. The goal was to create a device that supports tendon-driven actuation through a compliant structure, combining elements of rigidity and flexibility to match the natural geometry and motion of the human hand. Traditional hand exoskeletons often trade off motion for structure or vice versa. This project aims to bridge that gap with a hybrid compliant design that balances flexibility and support. The design process followed an iterative approach involving rapid prototyping …

Exploring The Benefits, Barriers, And Sustainability Of Community Stem Partnerships: A Qualitative Case Study On Stem Collaboration In Elementary Education, Katherine M. Blagden

Open Access Dissertations

In an era of increasing emphasis on science, technology, engineering, and mathematics (STEM) education, elementary schools often face significant challenges in implementing high-quality, integrated STEM instruction. These challenges include limited resources, inconsistent professional development, and a lack of access to real-world, community-based learning experiences (Dorph et al., 2018; National Science Board, 2024). This dissertation explores how collaborative partnerships among elementary schools, community organizations, and industry professionals can overcome these barriers and foster meaningful, sustainable STEM learning opportunities for young students. Drawing on the Asset-Based Community Development (ABCD) model (Kretzmann & McKnight, 1993) and informed by a constructivist theoretical framework (Vygotsky, …

The Coral Carousel: A Device And Method For In-Situ Propagation Of Deep-Sea Corals, Gregory Bales

Open Access Master's Theses

The research described herein covers the development of a tool station for performing in-situ propagation of corals using a work class ROV. This includes a system for manipulating coral fragments and affixing them to a cement base plug. To validate this tool station, testing was performed both in the lab as well as at depth in the Gulf of Mexico. As restoration of shallow-water corals has grown in popularity, many techniques have been developed for propagation. However, it is difficult or inappropriate to directly apply these techniques to deep-sea corals. While some forms of diving are capable of approaching the …

Toward Precise Long-Range Underwater Acoustic Geo-Positioning: Utilizing Vehicle Data And Deepening The Gnss Analogy Through Uncertainty Modeling, Isaac B. Salazar

Open Access Master's Theses

Electromagnetic signals, such as those used by Global Navigation Satellite Systems (GNSS), attenuate dramatically underwater, but acoustic signals can travel hundreds of kilometers, and can be used for positioning in much the same way. Concepts from GNSS can be applied to the subsurface context, as at a basic level, the principles of geo-positioning are identical. Key challenges in translating satellite positioning models to the underwater acoustic domain include differences in signal type as well as instrumentation and propagation environment. Acoustic signals travel at much slower speeds and are subject to significant environmental variability due to complex ocean dynamics. Here, the …

Optical-Link-Aware Online Waypoint Planner For Asv-Auv Systems, Ansel R. Austin

Open Access Master's Theses

The growing demand for ocean mapping and survey missions has increased interest in reliable AUV-ASV platforms. In such systems, reliable communication between the AUV and ASV is critical for monitoring the AUV's status and offloading large data products such as multi-beam sonar point clouds. While the range of acoustic telemetry can span several kilometers, its bandwidth is inadequate for transmitting high-volume data streams (such as images and point clouds). Underwater optical communication modems, in contrast, provide a relatively high bandwidth but are hindered by rapid attenuation in turbid water and a narrow field of view. This thesis introduces an online, …

Heuristic Approaches For Coordination Of Heterogeneous Robotic Systems In Harvesting Automation With Size Constraints, Hyeseon Lee

Dissertations, Master's Theses and Master's Reports

This thesis presents the development of path planning algorithms for the coordination of heterogeneous robotic systems while considering size constraints. The objective is to generate practical and efficient solutions for real-world applications. The use of heterogeneous collaborative robots is beneficial in many applications, such as transportation operations in warehouses or manufacturing environments, surveillance, and monitoring, and task allocation and path planning are critical techniques that need to be addressed to deploy in real-world applications. This research focuses on automating lavender harvesting, where robots with varying capabilities must collaboratively navigate complex field layouts to efficiently complete harvesting tasks.

The problem considers …

Flower Cluster Matching Utilizing The Unscented Transform For Robotic Pollination, Andy Chu

Graduate Theses, Dissertations, and Problem Reports (ETD)

The use of automated systems for agriculture is integral to keeping the food supply secure. Both industry and academia are exploring and applying methods to increase the yield of plants in environments ranging from outdoor fields to greenhouses. Specifically, many automated systems use continuous monitoring of plants to track plant health and yield. The use of computer vision is necessary when it comes to precision operations that use robotics. Today, robots are trained to weed, harvest, and pollinate. To accomplish these tasks autonomously, a lot of data is needed, which is where spatial-temporal observations of the plants are being recorded …

A Framework For Biomimetic Robot Design Applied To The Development Of A Robotic Model Of Drosophila Melanogaster, Clarissa A. Goldsmith

Graduate Theses, Dissertations, and Problem Reports (ETD)

For decades, the field of biologically inspired robotics has leveraged insights from animal locomotion to improve the walking ability of legged robots. Recently, “biomimetic” robots have been developed to model how specific animals walk. By prioritizing biological accuracy to the target organism rather than the application of general principles from biology, these robots can be used to develop detailed biological hypotheses for animal experiments, ultimately improving our understanding of the biological control of legs while improving technical solutions. Much of this work involves biologically inspired walking controllers informed by the morphology and dynamics of the insect nervous system, which necessitate …

Llm-Driven Fmea For Safe Human-Robot Collaboration In Disassembly, Morteza Jalali Alenjareghi, Samira Keivanpour, Yuvin Adnarain Chinniah, Sabrina Jocelyn

Articles dans des actes de congrès

Disassembly operations often present unstructured and unpredictable scenarios, such as handling hazardous materials, addressing ergonomic strain, and managing dynamic robot interactions that pose safety risks. To tackle these challenges, we propose an innovative use of large language models (LLMs) to enhance failure mode and effect analysis (FMEA) in the context of human-robot collaboration (HRC) for disassembly tasks. We developed an LLM system leveraging retrieval-augmented generation (RAG) for real-time risk analysis and recommendation generation. RAG retrieves domain-specific information from the FMEA knowledge database, enabling accurate risk analysis, contextual understanding, and relevant recommendations based on user input and operational data. Evaluation of …

Efficient And Test-Time Adaptive Visual Object Tracking In The Wild, Ram J. Zaveri

Graduate Theses, Dissertations, and Problem Reports (ETD)

Tracking a single object, given the location at the first frame, has been an ongoing challenge in the vision community for decades. Most recent approaches provide reasonably good performance, especially when benchmarked on in-distribution (ID) datasets, i.e., on the testing portion of the same datasets used for training. However, they incur high computational costs and hardware constraints, making their deployment in the wild for mobile, autonomous, and IoT applications still challenging. Efficient visual trackers address the efficiency aspect of such bottlenecks; however, they tend to overfit to their training distributions and lack generalization abilities, resulting in them performing well on …

Imitation Learning In Robotic Manipulation Using Diffusion Models, Marlon Domingues De Oliveira

Graduate Theses, Dissertations, and Problem Reports (ETD)

This work deals with the problem of teaching robots by demonstration, also known by imitation learning. The main objective of this area of research is to enable the autonomous execution of complex robotic tasks using neural networks trained on expert-generated data, thus allowing the transfer of human knowledge to machines. To this end, this thesis describes an experimental setup especially designed for the study of imitation learning in robotic manipulation tasks and the adaptation and evaluation of a previously published technique to this setup. The experimental setup developed in this work is based on the Franka Emika Research 3 manipulator, …

Virtual Environment Creation And Camera Calibration For Soft Target Identification And Assistance In Crowded Spaces With A Sensor Network And A Robotic Dog, Eltan Samoylov

Dissertations and Theses

Crowded places are increasingly targets of violence due to the increased accessibility and covertness of weapons, explosives, and other technology like drones. Addressing the challenges of protecting crowded places and assisting vulnerable individuals requires a multidisciplinary approach, taking inspiration from many different perspectives. Video surveillance of these crowded public facilities, such as train and bus stations, airports, shopping malls, and sports arenas, is very important to public safety, both for identifying threats/terrorist attacks and implementing evacuation plans.

The work of this thesis is part of a larger project aiming to explore the potential of using real-time computer vision and deep …

Development And Prototyping Of A Modular Quadruped Towards Testing Standardization For Legged Robot Stability, Michael Conner Larsen

Graduate Research Theses & Dissertations

Legged robots are well-suited for navigating uneven and unmapped terrain, making them valuable in various robotics applications. Maintaining balance and stability in such environments relies on a combination of sensors, control strategies, and mechanical design. However, selecting the most effective sensing and control method for a given use case remains challenging. Previous studies have explored various approaches, integrating combinations of joint angle measurement, inertial measurement units (IMUs), torque-based control, leg force measurement, image processing, and machine learning, paired with numerous controller designs, which can contribute to stability. However, direct comparisons of these methods are often limited by the need for …