Robotics Commons^™

Augmenting Machine Learning Technique Through Natural Language, Tasmia Tasrin

Theses and Dissertations--Computer Science

While artificial intelligence (AI) and machine learning (ML) have proven effective at addressing many of the challenges that we face in our everyday lives, there are many situations in which these methods struggle. Examples include environments where AI or ML systems must perform complex behaviors or those where rewards are difficult to calculate. To address this limitation, interactive machine learning (IML) techniques have been introduced, which incorporate machine-understandable human feedback into traditional ML approaches. This feedback is often given as a discrete, positive or negative numeric value. This feedback is typically provided as often as possible to convey a dense …

Integrated Compliant Structure For A Hand Exoskeleton, Tristan R. Koopman

Honors Undergraduate Theses

This thesis presents the design and prototyping of a wearable hand exoskeleton that integrates a flexible structural framework to assist with hand movement while maintaining comfort and anatomical conformity. The goal was to create a device that supports tendon-driven actuation through a compliant structure, combining elements of rigidity and flexibility to match the natural geometry and motion of the human hand. Traditional hand exoskeletons often trade off motion for structure or vice versa. This project aims to bridge that gap with a hybrid compliant design that balances flexibility and support. The design process followed an iterative approach involving rapid prototyping …

Efficient And Test-Time Adaptive Visual Object Tracking In The Wild, Ram J. Zaveri

Graduate Theses, Dissertations, and Problem Reports (ETD)

Tracking a single object, given the location at the first frame, has been an ongoing challenge in the vision community for decades. Most recent approaches provide reasonably good performance, especially when benchmarked on in-distribution (ID) datasets, i.e., on the testing portion of the same datasets used for training. However, they incur high computational costs and hardware constraints, making their deployment in the wild for mobile, autonomous, and IoT applications still challenging. Efficient visual trackers address the efficiency aspect of such bottlenecks; however, they tend to overfit to their training distributions and lack generalization abilities, resulting in them performing well on …

Flower Cluster Matching Utilizing The Unscented Transform For Robotic Pollination, Andy Chu

Graduate Theses, Dissertations, and Problem Reports (ETD)

The use of automated systems for agriculture is integral to keeping the food supply secure. Both industry and academia are exploring and applying methods to increase the yield of plants in environments ranging from outdoor fields to greenhouses. Specifically, many automated systems use continuous monitoring of plants to track plant health and yield. The use of computer vision is necessary when it comes to precision operations that use robotics. Today, robots are trained to weed, harvest, and pollinate. To accomplish these tasks autonomously, a lot of data is needed, which is where spatial-temporal observations of the plants are being recorded …

A Framework For Biomimetic Robot Design Applied To The Development Of A Robotic Model Of Drosophila Melanogaster, Clarissa A. Goldsmith

Graduate Theses, Dissertations, and Problem Reports (ETD)

For decades, the field of biologically inspired robotics has leveraged insights from animal locomotion to improve the walking ability of legged robots. Recently, “biomimetic” robots have been developed to model how specific animals walk. By prioritizing biological accuracy to the target organism rather than the application of general principles from biology, these robots can be used to develop detailed biological hypotheses for animal experiments, ultimately improving our understanding of the biological control of legs while improving technical solutions. Much of this work involves biologically inspired walking controllers informed by the morphology and dynamics of the insect nervous system, which necessitate …

Exploring The Benefits, Barriers, And Sustainability Of Community Stem Partnerships: A Qualitative Case Study On Stem Collaboration In Elementary Education, Katherine M. Blagden

Open Access Dissertations

In an era of increasing emphasis on science, technology, engineering, and mathematics (STEM) education, elementary schools often face significant challenges in implementing high-quality, integrated STEM instruction. These challenges include limited resources, inconsistent professional development, and a lack of access to real-world, community-based learning experiences (Dorph et al., 2018; National Science Board, 2024). This dissertation explores how collaborative partnerships among elementary schools, community organizations, and industry professionals can overcome these barriers and foster meaningful, sustainable STEM learning opportunities for young students. Drawing on the Asset-Based Community Development (ABCD) model (Kretzmann & McKnight, 1993) and informed by a constructivist theoretical framework (Vygotsky, …

Heuristic Approaches For Coordination Of Heterogeneous Robotic Systems In Harvesting Automation With Size Constraints, Hyeseon Lee

Dissertations, Master's Theses and Master's Reports

This thesis presents the development of path planning algorithms for the coordination of heterogeneous robotic systems while considering size constraints. The objective is to generate practical and efficient solutions for real-world applications. The use of heterogeneous collaborative robots is beneficial in many applications, such as transportation operations in warehouses or manufacturing environments, surveillance, and monitoring, and task allocation and path planning are critical techniques that need to be addressed to deploy in real-world applications. This research focuses on automating lavender harvesting, where robots with varying capabilities must collaboratively navigate complex field layouts to efficiently complete harvesting tasks.

The problem considers …

Autonomous Landscape Exploration Rover Using Imaging Surface Navigation (Alexis), Noah Jones, Dominic Salupo

Williams Honors College, Honors Research Projects

The objective is to develop a small-form-factor rover prototype that can be used to prove out a novel traversal method for use on extraterrestrial surfaces. The novel traversal method being proposed is LIDAR/CV-enhanced navigation, provided by a detachable flight vehicle that can communicate with the rover. On planets with thin atmospheres, cold gas thrusters or similar may be needed, but for the scope of this project more traditional flight/propulsion methods will be used.

Llm-Driven Fmea For Safe Human-Robot Collaboration In Disassembly, Morteza Jalali Alenjareghi, Samira Keivanpour, Yuvin Adnarain Chinniah, Sabrina Jocelyn

Articles dans des actes de congrès

Disassembly operations often present unstructured and unpredictable scenarios, such as handling hazardous materials, addressing ergonomic strain, and managing dynamic robot interactions that pose safety risks. To tackle these challenges, we propose an innovative use of large language models (LLMs) to enhance failure mode and effect analysis (FMEA) in the context of human-robot collaboration (HRC) for disassembly tasks. We developed an LLM system leveraging retrieval-augmented generation (RAG) for real-time risk analysis and recommendation generation. RAG retrieves domain-specific information from the FMEA knowledge database, enabling accurate risk analysis, contextual understanding, and relevant recommendations based on user input and operational data. Evaluation of …

Contextual Augmentation In Artificial Intelligence, Emmanuel Joshua Balogun

College of Graduate Studies: Theses & Dissertations

Contextual understanding is a significant challenge of Large Language Models (LLMs), which are typically trained on general-purpose datasets. Due to this, LLMs fail to capture nuanced or domain-specific information and may struggle to interpret user queries accurately. Consequently, prompt engineering can become complex in automating, and LLMs are prone to “hallucinating”—generating random or irrelevant texts—when they lack sufficient context. This undermines their ability to provide focused, accurate responses. Accordingly, this thesis seeks to enhance the contextual understanding capabilities of Artificial Intelligence systems to facilitate more precise and relevant answer generation. Study A looks into a new approach to combating misinformation …

Imitation Learning In Robotic Manipulation Using Diffusion Models, Marlon Domingues De Oliveira

Graduate Theses, Dissertations, and Problem Reports (ETD)

This work deals with the problem of teaching robots by demonstration, also known by imitation learning. The main objective of this area of research is to enable the autonomous execution of complex robotic tasks using neural networks trained on expert-generated data, thus allowing the transfer of human knowledge to machines. To this end, this thesis describes an experimental setup especially designed for the study of imitation learning in robotic manipulation tasks and the adaptation and evaluation of a previously published technique to this setup. The experimental setup developed in this work is based on the Franka Emika Research 3 manipulator, …

Development And Prototyping Of A Modular Quadruped Towards Testing Standardization For Legged Robot Stability, Michael Conner Larsen

Graduate Research Theses & Dissertations

Legged robots are well-suited for navigating uneven and unmapped terrain, making them valuable in various robotics applications. Maintaining balance and stability in such environments relies on a combination of sensors, control strategies, and mechanical design. However, selecting the most effective sensing and control method for a given use case remains challenging. Previous studies have explored various approaches, integrating combinations of joint angle measurement, inertial measurement units (IMUs), torque-based control, leg force measurement, image processing, and machine learning, paired with numerous controller designs, which can contribute to stability. However, direct comparisons of these methods are often limited by the need for …

Human Swarm Interaction Using Non-Verbal Communication, Arunim Bhattacharya

Graduate Research Theses & Dissertations

This research presents experimentally validated strategies for human-swarm robotic interaction through nonverbal communication. Applications of this work are in large-scale coverage problems that include search and rescue operations and environmental monitoring missions. The non-verbal interaction becomes critical in situations where wireless communication methods may be limited by bandwidth constraints, privacy concerns, or environmental clutter. The research objective of this dissertation is to design and evaluate methods of nonverbal communication between a human teleoperator and robotic swarms towards a bidirectional human-swarm interaction framework. Towards this, we first establish a reliable measure of real-time cognitive load that can serve to close the …

Cropsync: Ai-Powered Sustainable Crop Management, Ziad Doughan, Ibrahim Mneimneh, Zouheir Nakouzi, Noor Al Khaib, Samer Damaj, Jamal Chaaban, Hamza Mrad, Sari Itani

BAU Journal - Science and Technology

CropSync is a smart agriculture system that uses AI and IoT technologies to enable sustain- able crop management and precision farming. The system aims to address the challenges faced by the agriculture sector, such as increasing food production to meet global population demands while minimizing environmental impact. CropSync integrates sensors, cameras, and cloud-based analytics to provide farmers with real-time insights and recommendations for optimizing crop cul- tivation. The system upholds engineering professional and ethical standards, considering broader social, environmental, and economic implications. From a social perspective, CropSync improves food security and enhances farmers’ livelihoods through increased productivity and efficient re- …

Predicting Vegetation Override Force For Off-Road Autonomy, Marc Nicholas Moore

Theses and Dissertations

Vegetation override is an important aspect of off-road ground vehicle mobility. An autonomous ground vehicle’s (AGV) perception system must distinguish between vegetation that can be easily driven through from vegetation that cannot. Predicting the resistance of vegetation could allow path- planning systems to make this distinction. However, despite its importance, direct measurement of vegetation resistance is rare, as most studies use indirect proprioceptive data, such as inertial measurements, as proxies for override force. Notably, there is a lack of empirical data on the override resistance of small stems (< 2.5 cm) and clusters of vegetation on medium-sized (approx. 1000kg) vehicles. To address this gap, a comprehensive dataset of override measurements was collected for clumps of small vegetation relevant to intermediate-sized AGVs navigating off-road terrain. This dataset includes over 70 recordings using the Robot Operating System (ROS) during controlled driving experiments through small trees, grasses, and bushes. The collected data includes light detection and ranging (LiDAR) scans, imagery, force measurements from integrated load cells, and simultaneous localization and mapping (SLAM) information. A key contribution of this research is the development and calibration of a custom push bar system equipped with load cells to directly measure override forces. These measurements are compared to empirical models previously developed by the U.S. Army Corps of Engineers for larger single-stem vegetation. A preprocessing pipeline was developed to automatically extract and label LiDAR and camera data according to these force measurements. This self-labeled dataset was then used to train machine learning models that predict override resistance of vegetation from LiDAR and camera scans alone. This research characterizes the relationship between override forces and the observable features of vegetation as measured by LiDAR and camera sensors. Deep learning models were developed and trained to predict override forces based on different input modalities and features derived from point clouds and images. The performance of these models was compared across various input features to investigate how deep learning can create a generalizable and accurate force prediction system.

Utilizing Pupper, A Social Robot Dog, To Increase Happiness And Improve Mood In Pediatric Patients Of A Cardiac Step-Down Unit, Angela Feng Wu

Master's Projects and Capstones

Objective The usage of social robots in pediatrics is an emerging field of study. Preliminary research shows that they are effective at improving the psychosocial well-being of pediatric patients. This quality improvement project focuses on Pupper, a newly developed quadruped social robot dog, and its ability in improving mood and happiness in pediatric patients of a cardiac step-down unit. Aim The aim of this project is to increase average mood scores of pediatric cardiac patients aged 3-25 years by 50% from their baseline of 3.75 to 5.63 on a six-point scale within a one-month time frame. Methods Before intervention and …

Exploring Smart Thermostat, Don P. Dang

2024 Fall Honors Capstone Projects - Archive

This study examines the security, privacy, and compatibility challenges associated with smart thermostats in smart home systems. Smart thermostats, as part of the growing Internet of Things (IoT) ecosystem, face vulnerabilities such as unauthorized access, data breaches, and inconsistent security protocols. Using a mixed-methods approach, this research evaluates encryption techniques, communication protocols (Zigbee, Z-Wave, Wi Fi), and user behaviors that impact system security and efficiency. Key findings indicate that 35% of users are concerned about hacking risks, while 25% express data privacy concerns. Many users lack awareness of security measures, such as firmware updates and password management, which increases vulnerabilities. …

Mechanically Cost-Effective Approach For Bipedal Walking In Robots Using Instantaneous Collision Angle, Smit R. Patel

UNLV Theses, Dissertations, Professional Papers, and Capstones

Humans, as bipedal locomotors, are effective at reducing the mechanical cost of transport (CoTmech) by adopting movement strategies and gaits that minimize energy expenditure for a given distance. By using different gaits at different speeds, leveraging their long spring-like tendons and muscle elasticity which store and release energy during movement, humans reduce the mechanical effort required for locomotion. Current locomotion solutions offered in bipedal robots, based on legacy walking and running gait models, are not great at energy efficiency unless walking at very low speeds. Additionally, the control system of robots, designed to ensure stability and adaptability, requires substantial resources, …

A Talking Cart, Abdullah Bin Naeem

LSU New Orleans Theses and Dissertations

This research investigates the development of a robust AI-powered detection and tracking engine aimed at revolutionizing the retail checkout experience. The foundation of this work is a comprehensive exploration of state-of-the-art Computer Vision methodologies, particularly focusing on object detection, segmentation, and tracking. The study employs a modular pipeline that integrates advanced visual recognition algorithms with a robust data processing framework.

Key to this work is the construction of a synthetic dataset using Unity3D, enabling the generation of high-quality annotated data that mirrors real-world retail scenarios. This approach addresses the challenge of insufficient labeled datasets by simulating diverse and cluttered shopping …

Pseudo Gps For Romi, Emmanuel Baez, Owen Guinane, Gabriel Coria, Conor Schott

Mechanical Engineering

The Pseudo-GPS system for Romi robots addresses the need for precise real-time location tracking in Cal Poly's Mechatronics lab. This project, developed by Emmanuel Baez, Gabriel Coria, Owen Guinane, and Conor Schott, under the guidance of instructor Charlie Refvem, provides a proof-of-concept system to enhance the Romi robots' geolocation capabilities for advanced robotic algorithms.

The proposed system uses a Raspberry Pi 4 equipped with a Pi camera module and ArUco markers to track the position and orientation of Romi robots within a lab environment. Custom 3D-printed stands secure markers on the robots, and a designated origin marker defines the coordinate …