Robotics Commons^™

Toward Precise Long-Range Underwater Acoustic Geo-Positioning: Utilizing Vehicle Data And Deepening The Gnss Analogy Through Uncertainty Modeling, Isaac B. Salazar

Open Access Master's Theses

Electromagnetic signals, such as those used by Global Navigation Satellite Systems (GNSS), attenuate dramatically underwater, but acoustic signals can travel hundreds of kilometers, and can be used for positioning in much the same way. Concepts from GNSS can be applied to the subsurface context, as at a basic level, the principles of geo-positioning are identical. Key challenges in translating satellite positioning models to the underwater acoustic domain include differences in signal type as well as instrumentation and propagation environment. Acoustic signals travel at much slower speeds and are subject to significant environmental variability due to complex ocean dynamics. Here, the …

Efficient And Test-Time Adaptive Visual Object Tracking In The Wild, Ram J. Zaveri

Graduate Theses, Dissertations, and Problem Reports (ETD)

Tracking a single object, given the location at the first frame, has been an ongoing challenge in the vision community for decades. Most recent approaches provide reasonably good performance, especially when benchmarked on in-distribution (ID) datasets, i.e., on the testing portion of the same datasets used for training. However, they incur high computational costs and hardware constraints, making their deployment in the wild for mobile, autonomous, and IoT applications still challenging. Efficient visual trackers address the efficiency aspect of such bottlenecks; however, they tend to overfit to their training distributions and lack generalization abilities, resulting in them performing well on …

Imitation Learning In Robotic Manipulation Using Diffusion Models, Marlon Domingues De Oliveira

Graduate Theses, Dissertations, and Problem Reports (ETD)

This work deals with the problem of teaching robots by demonstration, also known by imitation learning. The main objective of this area of research is to enable the autonomous execution of complex robotic tasks using neural networks trained on expert-generated data, thus allowing the transfer of human knowledge to machines. To this end, this thesis describes an experimental setup especially designed for the study of imitation learning in robotic manipulation tasks and the adaptation and evaluation of a previously published technique to this setup. The experimental setup developed in this work is based on the Franka Emika Research 3 manipulator, …

Flower Cluster Matching Utilizing The Unscented Transform For Robotic Pollination, Andy Chu

Graduate Theses, Dissertations, and Problem Reports (ETD)

The use of automated systems for agriculture is integral to keeping the food supply secure. Both industry and academia are exploring and applying methods to increase the yield of plants in environments ranging from outdoor fields to greenhouses. Specifically, many automated systems use continuous monitoring of plants to track plant health and yield. The use of computer vision is necessary when it comes to precision operations that use robotics. Today, robots are trained to weed, harvest, and pollinate. To accomplish these tasks autonomously, a lot of data is needed, which is where spatial-temporal observations of the plants are being recorded …

A Framework For Biomimetic Robot Design Applied To The Development Of A Robotic Model Of Drosophila Melanogaster, Clarissa A. Goldsmith

Graduate Theses, Dissertations, and Problem Reports (ETD)

For decades, the field of biologically inspired robotics has leveraged insights from animal locomotion to improve the walking ability of legged robots. Recently, “biomimetic” robots have been developed to model how specific animals walk. By prioritizing biological accuracy to the target organism rather than the application of general principles from biology, these robots can be used to develop detailed biological hypotheses for animal experiments, ultimately improving our understanding of the biological control of legs while improving technical solutions. Much of this work involves biologically inspired walking controllers informed by the morphology and dynamics of the insect nervous system, which necessitate …

Cropsync: Ai-Powered Sustainable Crop Management, Ziad Doughan, Ibrahim Mneimneh, Zouheir Nakouzi, Noor Al Khaib, Samer Damaj, Jamal Chaaban, Hamza Mrad, Sari Itani

BAU Journal - Science and Technology

CropSync is a smart agriculture system that uses AI and IoT technologies to enable sustain- able crop management and precision farming. The system aims to address the challenges faced by the agriculture sector, such as increasing food production to meet global population demands while minimizing environmental impact. CropSync integrates sensors, cameras, and cloud-based analytics to provide farmers with real-time insights and recommendations for optimizing crop cul- tivation. The system upholds engineering professional and ethical standards, considering broader social, environmental, and economic implications. From a social perspective, CropSync improves food security and enhances farmers’ livelihoods through increased productivity and efficient re- …

End-To-End Autonomous Quadcopter Using Reinforcement Learning, Mohamed Marwan Chawa

Theses and Dissertations

This thesis investigates the potential of Reinforcement Learning (RL) for achieving robust and adaptable quadcopter control, focusing on trajectory and attitude stabilization. We compare state-of-the-art RL algorithms, specifically Proximal Policy Optimization (PPO), against traditional Proportional-Integral-Derivative (PID) controllers across three tasks: hovering, slow trajectory following, and fast trajectory following. To enhance realism, we employ a modified PyFlyt simulation environment with a high-fidelity Crazyflie 2.x model, accounting for motor dynamics, noise, wind disturbances, and aerodynamic drag.

The challenge of operating a quadcopter can be divided into two distinct parts: planning a flight path and actually following that path. Our focus is on …

Utilizing Pupper, A Social Robot Dog, To Increase Happiness And Improve Mood In Pediatric Patients Of A Cardiac Step-Down Unit, Angela Feng Wu

Master's Projects and Capstones

Objective The usage of social robots in pediatrics is an emerging field of study. Preliminary research shows that they are effective at improving the psychosocial well-being of pediatric patients. This quality improvement project focuses on Pupper, a newly developed quadruped social robot dog, and its ability in improving mood and happiness in pediatric patients of a cardiac step-down unit. Aim The aim of this project is to increase average mood scores of pediatric cardiac patients aged 3-25 years by 50% from their baseline of 3.75 to 5.63 on a six-point scale within a one-month time frame. Methods Before intervention and …

Predicting Vegetation Override Force For Off-Road Autonomy, Marc Nicholas Moore

Theses and Dissertations

Vegetation override is an important aspect of off-road ground vehicle mobility. An autonomous ground vehicle’s (AGV) perception system must distinguish between vegetation that can be easily driven through from vegetation that cannot. Predicting the resistance of vegetation could allow path- planning systems to make this distinction. However, despite its importance, direct measurement of vegetation resistance is rare, as most studies use indirect proprioceptive data, such as inertial measurements, as proxies for override force. Notably, there is a lack of empirical data on the override resistance of small stems (< 2.5 cm) and clusters of vegetation on medium-sized (approx. 1000kg) vehicles. To address this gap, a comprehensive dataset of override measurements was collected for clumps of small vegetation relevant to intermediate-sized AGVs navigating off-road terrain. This dataset includes over 70 recordings using the Robot Operating System (ROS) during controlled driving experiments through small trees, grasses, and bushes. The collected data includes light detection and ranging (LiDAR) scans, imagery, force measurements from integrated load cells, and simultaneous localization and mapping (SLAM) information. A key contribution of this research is the development and calibration of a custom push bar system equipped with load cells to directly measure override forces. These measurements are compared to empirical models previously developed by the U.S. Army Corps of Engineers for larger single-stem vegetation. A preprocessing pipeline was developed to automatically extract and label LiDAR and camera data according to these force measurements. This self-labeled dataset was then used to train machine learning models that predict override resistance of vegetation from LiDAR and camera scans alone. This research characterizes the relationship between override forces and the observable features of vegetation as measured by LiDAR and camera sensors. Deep learning models were developed and trained to predict override forces based on different input modalities and features derived from point clouds and images. The performance of these models was compared across various input features to investigate how deep learning can create a generalizable and accurate force prediction system.

Model Reference Adaptive Control For Mobile Manipulators And Beyond, Srivatsan Srinivasan

All Dissertations

In recent years, robotics has expanded into various sectors, including manufacturing, transportation, and household services, making the integration of autonomy a critical area of research. This shift aims to ensure safety and enhance the utility of autonomous systems. Traditionally, robotic applications focused separately on mobility, like automated guided vehicles, and manipulation, such as serial-chain arms in manufacturing. Today, however, we see a merging of these capabilities in the growing field of mobile manipulator robots that combine movement with purposeful interactive functionalities.

A typical mobile manipulator is a robotic arm mounted on a wheeled base. This thesis focuses on advancing control …

Exploring Smart Thermostat, Don P. Dang

2024 Fall Honors Capstone Projects - Archive

This study examines the security, privacy, and compatibility challenges associated with smart thermostats in smart home systems. Smart thermostats, as part of the growing Internet of Things (IoT) ecosystem, face vulnerabilities such as unauthorized access, data breaches, and inconsistent security protocols. Using a mixed-methods approach, this research evaluates encryption techniques, communication protocols (Zigbee, Z-Wave, Wi Fi), and user behaviors that impact system security and efficiency. Key findings indicate that 35% of users are concerned about hacking risks, while 25% express data privacy concerns. Many users lack awareness of security measures, such as firmware updates and password management, which increases vulnerabilities. …

Co-Emulation Of Robotics And Software-Defined Radio Based 5g Wireless Communications., Bhaskara Venkata Raju Garuda

Electronic Theses and Dissertations

The convergence of robotics and 5G wireless communication technologies has opened new avenues for real-time, dynamic robotic applications. This dissertation introduces a novel framework that integrates the Robot Operating System (ROS), Software-Defined Radios (SDRs), and 5G wireless networks to achieve seamless coemulation of robotic systems. The research emphasizes the unique features of 5G, such as ultra-low latency and high throughput, which enable critical applications like remote surgery, industrial automation, and autonomous vehicles. The methodology combines ROS for robotic control, SDRs for programmable communication channels, and 5G testbeds for high-speed, reliable data transmission. The experimental evaluation focuses on both position-based and …

Mechanically Cost-Effective Approach For Bipedal Walking In Robots Using Instantaneous Collision Angle, Smit R. Patel

UNLV Theses, Dissertations, Professional Papers, and Capstones

Humans, as bipedal locomotors, are effective at reducing the mechanical cost of transport (CoTmech) by adopting movement strategies and gaits that minimize energy expenditure for a given distance. By using different gaits at different speeds, leveraging their long spring-like tendons and muscle elasticity which store and release energy during movement, humans reduce the mechanical effort required for locomotion. Current locomotion solutions offered in bipedal robots, based on legacy walking and running gait models, are not great at energy efficiency unless walking at very low speeds. Additionally, the control system of robots, designed to ensure stability and adaptability, requires substantial resources, …

Pseudo Gps For Romi, Emmanuel Baez, Owen Guinane, Gabriel Coria, Conor Schott

Mechanical Engineering

The Pseudo-GPS system for Romi robots addresses the need for precise real-time location tracking in Cal Poly's Mechatronics lab. This project, developed by Emmanuel Baez, Gabriel Coria, Owen Guinane, and Conor Schott, under the guidance of instructor Charlie Refvem, provides a proof-of-concept system to enhance the Romi robots' geolocation capabilities for advanced robotic algorithms.

The proposed system uses a Raspberry Pi 4 equipped with a Pi camera module and ArUco markers to track the position and orientation of Romi robots within a lab environment. Custom 3D-printed stands secure markers on the robots, and a designated origin marker defines the coordinate …

A Talking Cart, Abdullah Bin Naeem

LSU New Orleans Theses and Dissertations

This research investigates the development of a robust AI-powered detection and tracking engine aimed at revolutionizing the retail checkout experience. The foundation of this work is a comprehensive exploration of state-of-the-art Computer Vision methodologies, particularly focusing on object detection, segmentation, and tracking. The study employs a modular pipeline that integrates advanced visual recognition algorithms with a robust data processing framework.

Key to this work is the construction of a synthetic dataset using Unity3D, enabling the generation of high-quality annotated data that mirrors real-world retail scenarios. This approach addresses the challenge of insufficient labeled datasets by simulating diverse and cluttered shopping …

Advancing Visual Geometric Perception: Camera-Based Depth, Reconstruction, And Active Vision, Ziyue Feng

All Dissertations

The advancement of autonomous driving technology and intelligent robotic applications has emerged as a focal point in the realm of autonomy. One of the driving forces behind this trend is the profound understanding of the environment, and at the core of this endeavor lies the three-dimensional geometric perception. This dissertation embarks on a comprehensive exploration of this domain, emphasizing the advances of depth prediction, 3D scene reconstruction, and active vision to enhance geometric perception and scene understanding capabilities in autonomous driving, embodied AI, and robotics. In the domain of depth prediction, this research addresses the challenges of accurately inferring three-dimensional …

Heterogeneous Collaborative Robotics: Multi-Robot Navigation In Dynamic Environments, Tyler Nicholas Raettig

Theses and Dissertations

Abstract: The challenges of multi-robot navigation in dynamic environments, focusing on uncertainties in obstacle complexities, partial observation, and the transition of policies from simulations to the real world. The proposed approach utilizes a deep reinforcement learning (DRL) framework enabling a Light Detection and Ranging (LiDAR)-equipped robot to communicate with a camera-equipped robot to achieve optimal paths despite their different sensors. The key contributions include the development of a cooperative architecture for information exchange between robots, a DRL-based framework for learning navigation policies, and a training mechanism based on dynamic randomization for enhanced real-world adaptability. Experimental validation using Gazebo simulations demonstrates …

Improving Robustness Of Learning-Based Approaches In Autonomous Systems And Engineering Education, Godwyll Aikins

Theses and Dissertations

This dissertation advances the development of robust learning-based approaches across two complementary domains: engineering education and autonomous systems. Through four studies, this research addresses critical challenges in preparing data-proficient engineers and developing reliable autonomous systems that can operate under uncertainty and incomplete information. The engineering education study examines how mechanical and aerospace engineering undergraduates conceptualize and develop data proficiency skills essential for modern engineering practice. Through interviews with 27 students, the research employs the How People Learn framework to analyze student perspectives on information literacy, data interpretation, and computational thinking. The findings inform pedagogical strategies for developing data proficiency in …

End-To-End Learning For A Low-Cost Robotics Arm, Abhishek Chothani

Theses and Dissertations

Robotic manipulation is a cornerstone of automation, with the ultimate goal of developing versatile systems capable of executing a wide range of real-world tasks autonomously. Traditional robotics approaches, while reliable and widely adopted in industrial settings, often struggle with adaptability, perception, and dynamic task execution. This thesis explores the evolution from classical robotics techniques to modern learning-based approaches, leveraging advancements in artificial intelligence to overcome these limitations.

Initially, the thesis presents a pick-and-place pipeline built using the Drake robotics framework and the KUKA iiwa robotic arm. This system employs a pseudoinverse controller for inverse kinematics to perform structured tasks like …

Towards Human-Machine Collaboration In Autonomous Material Handling On Construction Sites, Jyrki Oraskari, Lukas Kirner, Marit Zöcklein, Sigrid Brell-Cokcan

Human-Machine Communication

In the contemporary construction industry, the shortage of skilled labor has prompted the exploration of automation as a remedy and machine autonomy as a potential solution to the environmental conditions at the site. This research explores the balance between human oversight and the independent decision-making capabilities of robots for material delivery on construction sites. Using a scenario-based approach, autonomy in construction robotics is evaluated across four human-machine interaction cases with spatial and temporal dimensions. The expected outcomes revolve around improved safety through better human-machine communication and establishing an interoperable data model to enhance robot autonomy. This aims to automate tasks …

Model-Based Navigation And Control Of Multirotor Uavs: A Machine Learning Approach, Serhat Sönmez

Electronic Theses and Dissertations

In recent decades, unmanned systems, particularly Unmanned Aerial Vehicles (UAVs), have seen significant advancement and unprecedented growth in military, civilian and public domain applications. Scientists have focused on enhancing UAV navigation and control through cutting-edge technologies and support tools. UAVs find applications in many fields, except military, such as agriculture, infrastructure inspection, wildlife monitoring, search and rescue, emergency response, border protection, to name but a few relevant civilian applications. Given the faster-than-exponential increase of available computational power, learning-based algorithms have emerged as a prominent tool for (real-time) multirotor UAV navigation and control. This dissertation centers around the fusion of conventional …

Robotic Multi-Object Grasping From A Pile: Techniques And Algorithms For Enhanced Dexterity, Tianze Chen

USF Tampa Graduate Theses and Dissertations

As robots become increasingly integrated into real-world applications such as warehousing, fulfillment centers, and manufacturing, the need for efficient and adaptable robotic systems grows. One of the key challenges is enabling robots to grasp multiple objects simultaneously, as this significantly boosts the efficiency of tasks like batch picking, sorting, and object transferring, reducing both time and energy consumption. This dissertation presents a comprehensive multi-object grasping (MOG) pipeline that includes pre-grasp selection, end-pose selection, grasping synergy calculation, and a data-driven model for estimating the number of objects being grasped. Central to this work is the development of the Experience Forest structure, …

If Androids Dream, Are They More Than Sheep?: Westworld, Robots And Legal Rights, Amanda J. Dipaolo

Dialogue: The Interdisciplinary Journal of Popular Culture and Pedagogy

The robot protagonists in HBO’s Westworld open the door to several philosophical and ethical questions, perhaps the most complex being: should androids be granted similar legal protections as people? Westworld offers its own exploration of what it means to be a person and places emphasis on one’s ability to feel and understand pain. With scientists and corporations actively working toward a future that includes robots that can display emotion in a way that can convincingly pass as that of a person’s, what happens when androids pass the Turing test, feel empathy, gain consciousness, are sentient, or develop free will? The …

Prototyping Interactive Tactile Digital Logic Simulations: A Hybrid Approach, Logan Bateman

MS in Computer Science Project Reports

Tactile exhibits are common in museums and on the walls of university halls. However, few (if any) tools exist for creating tactile exhibits for teaching digital logic or computing concepts. This project implemented a framework for creating tactile digital logic simulation exhibits, with a focus on rapid prototyping and distributed architecture. Prototyping allows for fast iteration, with the ability to simulate unlimited hardware components such as buttons, light emitting diodes (LEDs), and other input or output devices. Through the abstraction of implementations and a distributed communication protocol, switching to real hardware is seamless and works in tandem with simulated hardware. …

Three-Dimensional Outdoor Object Detection In Quadrupedal Robots For Surveillance Navigations, Muhammad Hassan Tanveer, Zainab Fatima, Hira Mariam, Tanazzah Rehman, Razvan Cristian Voicu

Faculty Articles

Quadrupedal robots are confronted with the intricate challenge of navigating dynamic environments fraught with diverse and unpredictable scenarios. Effectively identifying and responding to obstacles is paramount for ensuring safe and reliable navigation. This paper introduces a pioneering method for 3D object detection, termed viewpoint feature histograms, which leverages the established paradigm of 2D detection in projection. By translating 2D bounding boxes into 3D object proposals, this approach not only enables the reuse of existing 2D detectors but also significantly increases the performance with less computation required, allowing for real-time detection. Our method is versatile, targeting both bird’s eye view objects …

Advanced Grasping Sensor Technologies For Autonomous Robotic Apple Harvesting Using Tactile Data And Cnns, Chris Bae

College of Engineering Summer Undergraduate Research Program

This research investigates how to achieve an optimal grasp of an apple using a four-finger soft robotic grasper equipped with force-resistive sensors. Specifically, we sought to determine whether a convolutional neural network (CNN) could accurately classify the grasper's state and recommend adjustments ("in," "out," or "good" grasp) based on tactile data from the sensors. Spatiotemporal tactile images were developed from the sensors and fed into our CNN, achieving near 100% accuracy on unseen test data. This work suggests that CNN-based processing of tactile images can be a powerful tool for real-time control of soft robotic grippers.

Computer Vision In A Robotic Arm, Jack Maxwell

College of Engineering Summer Undergraduate Research Program

We used a machine learning-based object detection algorithm to give a robotic arm the ability to "see" with its camera.

Real-Time Robot Pose Estimation For Industry 4.0: Enhancing Motion Validation And Monitoring With A Vision-Based Framework, Jad Samaha

Theses and Dissertations

Amidst the era of Industry 4.0, robots became integral to automated production lines by performing complex tasks with high precision and adapting to changing production needs in real-time. Therefore, ensuring their precise and reliable operation is paramount for maintaining high-quality standards and operational efficiency. This invoked the need for an automated motion validation tool that guarantees accurate program task execution, by detecting deviations or anomalies that may indicate mechanical faults or software errors. Given the exponential advancements in AI, particularly in Computer Vision, a vision-based solution is ideal for ensuring the correct positioning of a robot in real-time. Operating independently …

An International Consensus Panel On The Potential Value Of Digital Surgery, Jamie Erskine, Payam Abrishami, Jean Christophe Bernhard, Richard Charter, Richard Culbertson, Jo Carol Hiatt, Ataru Igarashi, Gretchen Purcell Jackson, Matthew Lien, Guy Maddern, Joseph Soon Yau Ng, Anita Patel, Koon Ho Rha, Prasanna Sooriakumaran, Scott Tackett, Giuseppe Turchetti, Anastasia Chalkidou

School of Public Health Faculty Publications

OBJECTIVES: The use of digital technology in surgery is increasing rapidly, with a wide array of new applications from presurgical planning to postsurgical performance assessment. Understanding the clinical and economic value of these technologies is vital for making appropriate health policy and purchasing decisions. We explore the potential value of digital technologies in surgery and produce expert consensus on how to assess this value. DESIGN: A modified Delphi and consensus conference approach was adopted. Delphi rounds were used to generate priority topics and consensus statements for discussion. SETTING AND PARTICIPANTS: An international panel of 14 experts was assembled, representing relevant …

Dynamic Maze Puzzle Navigation Using Deep Reinforcement Learning, Luisa Shu Yi Chiu

Master's Theses

The implementation of deep reinforcement learning in mobile robotics offers a great solution for the development of autonomous mobile robots to efficiently complete tasks and transport objects. Reinforcement learning continues to show impressive potential in robotics applications through self-learning and biological plausibility. Despite its advancements, challenges remain in applying these machine learning techniques in dynamic environments. This thesis explores the performance of Deep Q-Networks (DQN), using images as an input, for mobile robot navigation in dynamic maze puzzles and aims to contribute to advancements in deep reinforcement learning applications for simulated and real-life robotic systems. This project is a step …