Computer Engineering Commons^™

Transformer And Recurrent Architectures For Dynamics Prediction And Policy Learning On Long-Horizon Tasks, Vinal Jitendrabhai Gadhiya

Computer Science and Engineering Theses - Archive

Model-based reinforcement learning promises improved sample efficiency by learning environment dynamics and using them for planning or policy improvement. However, the choice of neural architecture for dynamics prediction significantly impacts the model's ability to capture temporal dependencies and maintain long-term context, capabilities crucial for complex, open-world environments.

This thesis investigates three neural architectures for learning world models: Transformer-based, GRU-based, and a hybrid Transformer+GRU approach. We evaluate these architectures on Crafter, a 2D open-world survival environment that requires long-horizon planning and sequential task completion. In Crafter, agents must perform hierarchical sequences of actions, such as collecting wood, placing a table, and …

Multi-Modal Model-Based Optical Flow Estimation For Event-Based Vision, Pritam Karmokar

Computer Science and Engineering Dissertations - Archive

Event cameras offer a fundamentally different sensing paradigm by asynchronously capturing brightness changes at high temporal resolution, directly encoding motion in the scene. However, their sparse and non-traditional data format poses significant challenges for dense motion estimation, particularly in the context of optical flow. Contrast Maximization (CM) has emerged as a powerful model-based framework for estimating optical flow from event data by optimizing the sharpness of motion-compensated event representations. This dissertation builds upon and significantly advances the CM framework through two complementary contributions.

First, we propose Edge-Informed Contrast Maximization (EINCM), a hybrid approach that augments the traditional events-only CM framework …

3d Perception, Mapping, And Navigation For Mobile Cobot, Tuan T. Dang

Computer Science and Engineering Dissertations - Archive

Service robots are migrating from tightly controlled factory lines into offices, hospitals, and homes, where they must perceive, remember, and act amid people, clutter, and perpetual change. Humans solve this daily by forming compact, task-relevant “cognitive maps”: we sample just enough sensory detail to guide the moment, stitch those snapshots into a sparse topological scaffold, and continuously refine it as we move. Guided by that insight, this dissertation proposes a biologically inspired mapping framework that turns partial RGB-D observations into a hybrid temporal-spatial memory—locally metric for centimeter-scale navigation yet globally topological for room-to-building navigation. The system first distills raw depth …

Environment And Intention Awareness For Navigation And Collaboration, Bhaskar Chandra Trivedi

Computer Science and Engineering Dissertations - Archive

Unmanned Aerial Systems (UAS) have become increasingly popular as versatile platforms for tasks such as surveillance, inspection, delivery, and maintenance. In many applications, UAS operate in environments frequented by people or containing sensitive infrastructure, which introduces physical risks in case of vehicle failure, as well as psychological and privacy concerns that may limit their acceptability. Ensuring safe and efficient operation thus requires that UAS consider these risks when planning navigation strategies. While prior information, such as city maps and building layouts, can partially inform risk assessment, such data is often incomplete, necessitating real-time augmentation of risk maps using sensor information. …

Sharing The Stage With The Future: Humans And Robots Together At Last, Donna L. Clevinger

Honors in Practice Online Archive

This essay presents a co-curricular collaboration bringing ancient comedy to a modern audience. Students and faculty at a large, public R1 university combine art and engineering to create a STEAM-based approach to theatrical production. The author describes how integrating classical text, creative expression, and transformational technologies demonstrates that collaboration between disciplines can produce gains for each, fostering advancements and human understanding that would be unattainable independently. Script writing, casting, stage production, and outcomes are presented.

Motion Planning For A Flexible Modular Raft Robot, Chun-Yi She

Dartmouth College Master’s Theses

This thesis presents a hierarchical motion planning framework for SoftRafts, a modular and deformable aquatic robot capable of performing locomotion and manipulation tasks on water surfaces. SoftRafts consist of soft and rigid components that enable structural reconfiguration, offering adaptability in unstructured aquatic environments.

To address the complexity of planning in high-dimensional, deformable systems, the proposed method uses a bounding-shape abstraction, specifically, enclosing circles and rectangular bounding boxes to simplify motion planning. These enclosures abstract the robot's overall shape, reducing the high-dimensional planning problem into a lower-dimensional problem. A global planner uses a probabilistic roadmap (PRM) to compute a collision-free path …

A Comprehensive Review And Bibliometric Analysis On Collaborative Robotics For Industry: Safety Emerging As A Core Focus, Aida Haghighi, Morteza Cheraghi, Jérôme Pocachard, Valérie Botta-Genoulaz, Sabrina Jocelyn, Hamidreza Pourzarei

Revues de littérature, synthèses de connaissances

Research organizations and academics often seek to map the development of scientific fields, identify research gaps, and guide the direction of future research. In cobot-related research, the scientific literature consulted does not propose any comprehensive research agenda. Moreover, cobots, industrial robots inherently designed to collaborate with humans, bring with them emerging issues. To solve them, interdisciplinary research is often essential (e.g., combination of engineering, ergonomics and biomechanics expertise to handle safety challenges). This paper proposes an exhaustive study that employs a scoping review and bibliometric analysis to provide a structured macro perspective on the developments, key topics, and trends in …

Tracking Control Of A String Actuated Soft Trunk Robot Using State-Space Modeling, Jacob Trivisonno

Open Access Master's Theses

Soft robots, primarily composed of compliant materials, exhibit highly complex and nonlinear dynamics, making precise control a significant challenge. Traditional control methods often struggle with these complexities, requiring more advanced and data-driven methods. In our previous work, “Automatic Control of a Soft Trunk Robot Actuated by Strings” [1], a proportional controller was developed to drive the steady-state tracking error to zero. While this method was effective, it required time-consuming manual tuning and was not easily adaptable to physical modifications of the robot.

To address these limitations, this research implements gain-scheduled feedback control with state-space models calculated through a multiple linear …

Optical-Link-Aware Online Waypoint Planner For Asv-Auv Systems, Ansel R. Austin

Open Access Master's Theses

The growing demand for ocean mapping and survey missions has increased interest in reliable AUV-ASV platforms. In such systems, reliable communication between the AUV and ASV is critical for monitoring the AUV's status and offloading large data products such as multi-beam sonar point clouds. While the range of acoustic telemetry can span several kilometers, its bandwidth is inadequate for transmitting high-volume data streams (such as images and point clouds). Underwater optical communication modems, in contrast, provide a relatively high bandwidth but are hindered by rapid attenuation in turbid water and a narrow field of view. This thesis introduces an online, …

Augmenting Machine Learning Technique Through Natural Language, Tasmia Tasrin

Theses and Dissertations--Computer Science

While artificial intelligence (AI) and machine learning (ML) have proven effective at addressing many of the challenges that we face in our everyday lives, there are many situations in which these methods struggle. Examples include environments where AI or ML systems must perform complex behaviors or those where rewards are difficult to calculate. To address this limitation, interactive machine learning (IML) techniques have been introduced, which incorporate machine-understandable human feedback into traditional ML approaches. This feedback is often given as a discrete, positive or negative numeric value. This feedback is typically provided as often as possible to convey a dense …

Integrated Compliant Structure For A Hand Exoskeleton, Tristan R. Koopman

Honors Undergraduate Theses

This thesis presents the design and prototyping of a wearable hand exoskeleton that integrates a flexible structural framework to assist with hand movement while maintaining comfort and anatomical conformity. The goal was to create a device that supports tendon-driven actuation through a compliant structure, combining elements of rigidity and flexibility to match the natural geometry and motion of the human hand. Traditional hand exoskeletons often trade off motion for structure or vice versa. This project aims to bridge that gap with a hybrid compliant design that balances flexibility and support. The design process followed an iterative approach involving rapid prototyping …

Efficient And Test-Time Adaptive Visual Object Tracking In The Wild, Ram J. Zaveri

Graduate Theses, Dissertations, and Problem Reports (ETD)

Tracking a single object, given the location at the first frame, has been an ongoing challenge in the vision community for decades. Most recent approaches provide reasonably good performance, especially when benchmarked on in-distribution (ID) datasets, i.e., on the testing portion of the same datasets used for training. However, they incur high computational costs and hardware constraints, making their deployment in the wild for mobile, autonomous, and IoT applications still challenging. Efficient visual trackers address the efficiency aspect of such bottlenecks; however, they tend to overfit to their training distributions and lack generalization abilities, resulting in them performing well on …

Flower Cluster Matching Utilizing The Unscented Transform For Robotic Pollination, Andy Chu

Graduate Theses, Dissertations, and Problem Reports (ETD)

The use of automated systems for agriculture is integral to keeping the food supply secure. Both industry and academia are exploring and applying methods to increase the yield of plants in environments ranging from outdoor fields to greenhouses. Specifically, many automated systems use continuous monitoring of plants to track plant health and yield. The use of computer vision is necessary when it comes to precision operations that use robotics. Today, robots are trained to weed, harvest, and pollinate. To accomplish these tasks autonomously, a lot of data is needed, which is where spatial-temporal observations of the plants are being recorded …

Exploring The Benefits, Barriers, And Sustainability Of Community Stem Partnerships: A Qualitative Case Study On Stem Collaboration In Elementary Education, Katherine M. Blagden

Open Access Dissertations

In an era of increasing emphasis on science, technology, engineering, and mathematics (STEM) education, elementary schools often face significant challenges in implementing high-quality, integrated STEM instruction. These challenges include limited resources, inconsistent professional development, and a lack of access to real-world, community-based learning experiences (Dorph et al., 2018; National Science Board, 2024). This dissertation explores how collaborative partnerships among elementary schools, community organizations, and industry professionals can overcome these barriers and foster meaningful, sustainable STEM learning opportunities for young students. Drawing on the Asset-Based Community Development (ABCD) model (Kretzmann & McKnight, 1993) and informed by a constructivist theoretical framework (Vygotsky, …

Heuristic Approaches For Coordination Of Heterogeneous Robotic Systems In Harvesting Automation With Size Constraints, Hyeseon Lee

Dissertations, Master's Theses and Master's Reports

This thesis presents the development of path planning algorithms for the coordination of heterogeneous robotic systems while considering size constraints. The objective is to generate practical and efficient solutions for real-world applications. The use of heterogeneous collaborative robots is beneficial in many applications, such as transportation operations in warehouses or manufacturing environments, surveillance, and monitoring, and task allocation and path planning are critical techniques that need to be addressed to deploy in real-world applications. This research focuses on automating lavender harvesting, where robots with varying capabilities must collaboratively navigate complex field layouts to efficiently complete harvesting tasks.

The problem considers …

The Coral Carousel: A Device And Method For In-Situ Propagation Of Deep-Sea Corals, Gregory Bales

Open Access Master's Theses

The research described herein covers the development of a tool station for performing in-situ propagation of corals using a work class ROV. This includes a system for manipulating coral fragments and affixing them to a cement base plug. To validate this tool station, testing was performed both in the lab as well as at depth in the Gulf of Mexico. As restoration of shallow-water corals has grown in popularity, many techniques have been developed for propagation. However, it is difficult or inappropriate to directly apply these techniques to deep-sea corals. While some forms of diving are capable of approaching the …

Toward Precise Long-Range Underwater Acoustic Geo-Positioning: Utilizing Vehicle Data And Deepening The Gnss Analogy Through Uncertainty Modeling, Isaac B. Salazar

Open Access Master's Theses

Electromagnetic signals, such as those used by Global Navigation Satellite Systems (GNSS), attenuate dramatically underwater, but acoustic signals can travel hundreds of kilometers, and can be used for positioning in much the same way. Concepts from GNSS can be applied to the subsurface context, as at a basic level, the principles of geo-positioning are identical. Key challenges in translating satellite positioning models to the underwater acoustic domain include differences in signal type as well as instrumentation and propagation environment. Acoustic signals travel at much slower speeds and are subject to significant environmental variability due to complex ocean dynamics. Here, the …

Autonomous Landscape Exploration Rover Using Imaging Surface Navigation (Alexis), Noah Jones, Dominic Salupo

Williams Honors College, Honors Research Projects

The objective is to develop a small-form-factor rover prototype that can be used to prove out a novel traversal method for use on extraterrestrial surfaces. The novel traversal method being proposed is LIDAR/CV-enhanced navigation, provided by a detachable flight vehicle that can communicate with the rover. On planets with thin atmospheres, cold gas thrusters or similar may be needed, but for the scope of this project more traditional flight/propulsion methods will be used.

Llm-Driven Fmea For Safe Human-Robot Collaboration In Disassembly, Morteza Jalali Alenjareghi, Samira Keivanpour, Yuvin Adnarain Chinniah, Sabrina Jocelyn

Articles dans des actes de congrès

Disassembly operations often present unstructured and unpredictable scenarios, such as handling hazardous materials, addressing ergonomic strain, and managing dynamic robot interactions that pose safety risks. To tackle these challenges, we propose an innovative use of large language models (LLMs) to enhance failure mode and effect analysis (FMEA) in the context of human-robot collaboration (HRC) for disassembly tasks. We developed an LLM system leveraging retrieval-augmented generation (RAG) for real-time risk analysis and recommendation generation. RAG retrieves domain-specific information from the FMEA knowledge database, enabling accurate risk analysis, contextual understanding, and relevant recommendations based on user input and operational data. Evaluation of …

Virtual Environment Creation And Camera Calibration For Soft Target Identification And Assistance In Crowded Spaces With A Sensor Network And A Robotic Dog, Eltan Samoylov

Dissertations and Theses

Crowded places are increasingly targets of violence due to the increased accessibility and covertness of weapons, explosives, and other technology like drones. Addressing the challenges of protecting crowded places and assisting vulnerable individuals requires a multidisciplinary approach, taking inspiration from many different perspectives. Video surveillance of these crowded public facilities, such as train and bus stations, airports, shopping malls, and sports arenas, is very important to public safety, both for identifying threats/terrorist attacks and implementing evacuation plans.

The work of this thesis is part of a larger project aiming to explore the potential of using real-time computer vision and deep …

Imitation Learning In Robotic Manipulation Using Diffusion Models, Marlon Domingues De Oliveira

Graduate Theses, Dissertations, and Problem Reports (ETD)

This work deals with the problem of teaching robots by demonstration, also known by imitation learning. The main objective of this area of research is to enable the autonomous execution of complex robotic tasks using neural networks trained on expert-generated data, thus allowing the transfer of human knowledge to machines. To this end, this thesis describes an experimental setup especially designed for the study of imitation learning in robotic manipulation tasks and the adaptation and evaluation of a previously published technique to this setup. The experimental setup developed in this work is based on the Franka Emika Research 3 manipulator, …

Development And Prototyping Of A Modular Quadruped Towards Testing Standardization For Legged Robot Stability, Michael Conner Larsen

Graduate Research Theses & Dissertations

Legged robots are well-suited for navigating uneven and unmapped terrain, making them valuable in various robotics applications. Maintaining balance and stability in such environments relies on a combination of sensors, control strategies, and mechanical design. However, selecting the most effective sensing and control method for a given use case remains challenging. Previous studies have explored various approaches, integrating combinations of joint angle measurement, inertial measurement units (IMUs), torque-based control, leg force measurement, image processing, and machine learning, paired with numerous controller designs, which can contribute to stability. However, direct comparisons of these methods are often limited by the need for …

Human Swarm Interaction Using Non-Verbal Communication, Arunim Bhattacharya

Graduate Research Theses & Dissertations

This research presents experimentally validated strategies for human-swarm robotic interaction through nonverbal communication. Applications of this work are in large-scale coverage problems that include search and rescue operations and environmental monitoring missions. The non-verbal interaction becomes critical in situations where wireless communication methods may be limited by bandwidth constraints, privacy concerns, or environmental clutter. The research objective of this dissertation is to design and evaluate methods of nonverbal communication between a human teleoperator and robotic swarms towards a bidirectional human-swarm interaction framework. Towards this, we first establish a reliable measure of real-time cognitive load that can serve to close the …

A Framework For Biomimetic Robot Design Applied To The Development Of A Robotic Model Of Drosophila Melanogaster, Clarissa A. Goldsmith

Graduate Theses, Dissertations, and Problem Reports (ETD)

For decades, the field of biologically inspired robotics has leveraged insights from animal locomotion to improve the walking ability of legged robots. Recently, “biomimetic” robots have been developed to model how specific animals walk. By prioritizing biological accuracy to the target organism rather than the application of general principles from biology, these robots can be used to develop detailed biological hypotheses for animal experiments, ultimately improving our understanding of the biological control of legs while improving technical solutions. Much of this work involves biologically inspired walking controllers informed by the morphology and dynamics of the insect nervous system, which necessitate …

Contextual Augmentation In Artificial Intelligence, Emmanuel Joshua Balogun

College of Graduate Studies: Theses & Dissertations

Contextual understanding is a significant challenge of Large Language Models (LLMs), which are typically trained on general-purpose datasets. Due to this, LLMs fail to capture nuanced or domain-specific information and may struggle to interpret user queries accurately. Consequently, prompt engineering can become complex in automating, and LLMs are prone to “hallucinating”—generating random or irrelevant texts—when they lack sufficient context. This undermines their ability to provide focused, accurate responses. Accordingly, this thesis seeks to enhance the contextual understanding capabilities of Artificial Intelligence systems to facilitate more precise and relevant answer generation. Study A looks into a new approach to combating misinformation …

Fast-Sparse-Spanner: A Practical Algorithm For Constructing Low-Stretch Sparse Geometric Graphs, Fnu Shariful

UNF Graduate Theses and Dissertations

When constructing geometric graphs (vertices are points and edges are line segments connecting point pairs) on pointsets, stretch-factor (worst-case detour between any point pair) is often considered a quality metric. A low stretch-factor (a quantity that is usually > 1) guarantees short paths between all vertex pairs. A geometric graph having a stretch-factor of t is known as a t-spanner. Creating low stretch-factor geometric graphs for large pointsets with a low number of edges is an open problem in computational geometry.

In this work, we have designed and engineered a new simple and practical (fast and memory-efficient) algorithm named Fast-Sparse-Spanner algorithm …

Cropsync: Ai-Powered Sustainable Crop Management, Ziad Doughan, Ibrahim Mneimneh, Zouheir Nakouzi, Noor Al Khaib, Samer Damaj, Jamal Chaaban, Hamza Mrad, Sari Itani

BAU Journal - Science and Technology

CropSync is a smart agriculture system that uses AI and IoT technologies to enable sustain- able crop management and precision farming. The system aims to address the challenges faced by the agriculture sector, such as increasing food production to meet global population demands while minimizing environmental impact. CropSync integrates sensors, cameras, and cloud-based analytics to provide farmers with real-time insights and recommendations for optimizing crop cul- tivation. The system upholds engineering professional and ethical standards, considering broader social, environmental, and economic implications. From a social perspective, CropSync improves food security and enhances farmers’ livelihoods through increased productivity and efficient re- …

End-To-End Autonomous Quadcopter Using Reinforcement Learning, Mohamed Marwan Chawa

Theses and Dissertations

This thesis investigates the potential of Reinforcement Learning (RL) for achieving robust and adaptable quadcopter control, focusing on trajectory and attitude stabilization. We compare state-of-the-art RL algorithms, specifically Proximal Policy Optimization (PPO), against traditional Proportional-Integral-Derivative (PID) controllers across three tasks: hovering, slow trajectory following, and fast trajectory following. To enhance realism, we employ a modified PyFlyt simulation environment with a high-fidelity Crazyflie 2.x model, accounting for motor dynamics, noise, wind disturbances, and aerodynamic drag.

The challenge of operating a quadcopter can be divided into two distinct parts: planning a flight path and actually following that path. Our focus is on …

Predicting Vegetation Override Force For Off-Road Autonomy, Marc Nicholas Moore

Theses and Dissertations

Vegetation override is an important aspect of off-road ground vehicle mobility. An autonomous ground vehicle’s (AGV) perception system must distinguish between vegetation that can be easily driven through from vegetation that cannot. Predicting the resistance of vegetation could allow path- planning systems to make this distinction. However, despite its importance, direct measurement of vegetation resistance is rare, as most studies use indirect proprioceptive data, such as inertial measurements, as proxies for override force. Notably, there is a lack of empirical data on the override resistance of small stems (< 2.5 cm) and clusters of vegetation on medium-sized (approx. 1000kg) vehicles. To address this gap, a comprehensive dataset of override measurements was collected for clumps of small vegetation relevant to intermediate-sized AGVs navigating off-road terrain. This dataset includes over 70 recordings using the Robot Operating System (ROS) during controlled driving experiments through small trees, grasses, and bushes. The collected data includes light detection and ranging (LiDAR) scans, imagery, force measurements from integrated load cells, and simultaneous localization and mapping (SLAM) information. A key contribution of this research is the development and calibration of a custom push bar system equipped with load cells to directly measure override forces. These measurements are compared to empirical models previously developed by the U.S. Army Corps of Engineers for larger single-stem vegetation. A preprocessing pipeline was developed to automatically extract and label LiDAR and camera data according to these force measurements. This self-labeled dataset was then used to train machine learning models that predict override resistance of vegetation from LiDAR and camera scans alone. This research characterizes the relationship between override forces and the observable features of vegetation as measured by LiDAR and camera sensors. Deep learning models were developed and trained to predict override forces based on different input modalities and features derived from point clouds and images. The performance of these models was compared across various input features to investigate how deep learning can create a generalizable and accurate force prediction system.

Utilizing Pupper, A Social Robot Dog, To Increase Happiness And Improve Mood In Pediatric Patients Of A Cardiac Step-Down Unit, Angela Feng Wu

Master's Projects and Capstones

Objective The usage of social robots in pediatrics is an emerging field of study. Preliminary research shows that they are effective at improving the psychosocial well-being of pediatric patients. This quality improvement project focuses on Pupper, a newly developed quadruped social robot dog, and its ability in improving mood and happiness in pediatric patients of a cardiac step-down unit. Aim The aim of this project is to increase average mood scores of pediatric cardiac patients aged 3-25 years by 50% from their baseline of 3.75 to 5.63 on a six-point scale within a one-month time frame. Methods Before intervention and …