Robotics Commons^™

Implementation Of Static Rfid Landmarks In Slam For Planogram Compliance, Brennan L. Drake

Honors College Theses

Autonomous robotic systems are becoming increasingly prevalent in everyday life and exhibit robust solutions in a wide range of applications. They face many obstacles with the foremost of which being SLAM, or Simultaneous Localization and Mapping, that encompasses both creation of the map of an unknown environment and localization of the robot in said environment. In this experiment, researchers propose the use of RFID tags in a semi-dynamic commercial environment to provide concrete landmarks for localization and mapping in pursuit of increased locational certainty. With this obtained, the ultimate goal of the research is to construct a robotics platform for …

Claw Hand Activity, Admin Stem For Success, Natalie Wilson

STEM for Success Showcase

Activity plan where students practice coding principles by programming the actions of a claw hand

Reactive Particle Swarm Control Architecture And Application For Scalar Field Adaptive Navigation, Shae Taylor Hart

Engineering Ph.D. Theses

Adaptive navigation is a subcategory of navigation techniques that attempts to identify goal locations that satisfy specific criteria in an unknown area. In 2D scalar field adaptive navigation (SFAN), primitives navigate to or along features of interest in an unknown, possibly time-varying, planar scalar field. Features include extrema, contours, and fronts. This work solves the 2D SFAN problem using swarm robotic techniques. Robotic swarms are a subset of multi-robot systems that use decentralized control of simple interchangeable robots to perform collective actions. A subgroup of swarms is the Reactive Particle Swarm (RPS), characterized based on its simplicity, reactivity to its …

Assessing High Dynamic Range Imagery Performance For Object Detection In Maritime Environments, Erasmo Landaeta

Doctoral Dissertations and Master's Theses

The field of autonomous robotics has benefited from the implementation of convolutional neural networks in vision-based situational awareness. These strategies help identify surface obstacles and nearby vessels. This study proposes the introduction of high dynamic range cameras on autonomous surface vessels because these cameras capture images at different levels of exposure revealing more detail than fixed exposure cameras. To see if this introduction will be beneficial for autonomous vessels this research will create a dataset of labeled high dynamic range images and single exposure images, then train object detection networks with these datasets to compare the performance of these networks. …

Neural Network Fusion Of Multi-Modal Sensor Data For Autonomous Surface Vessels, David J. Thompson

Doctoral Dissertations and Master's Theses

Autonomous surface vessels (ASV) can potentially improve the safety of vessels traditionally operated by humans. Despite advancements in autonomous on-road vehicles, many of these advancements have yet to be realized for ASVs. This is primarily due to lacking ASV sensing platforms and public datasets for ASV-based perception research. To that end, this dissertation demonstrates the design of a synchronized multi-modal sensing platform for ASVs utilizing GPS/INS, LiDAR, LWIR cameras, HDR camera, and high-resolution cameras. The sensing platform is designed to maximize the overlap of sensors for multi-modal research and provides accurate intrinsic and extrinsic calibration between each sensor. Furthermore, the …

A Human-In-The-Loop Robot Grasping System With Grasp Quality Refinement, Tian Tan

USF Tampa Graduate Theses and Dissertations

The goal of this dissertation is to develop a grasping system for assistive robots that can help people with disabilities and the elderly to perform tasks of daily living. In developing this robot grasping system, we maximize its reliability, accuracy, and autonomy. High reliability and accuracy are required for robots to perform tasks around human users and to safely interact with objects that might be fragile or have contents that could spill. High autonomy is desired as users with disabilities are usually not dexterous enough to directly operate the robot. In this dissertation, a human-in-the-loop (HitL) robot grasping system is …

Accurate Indoor Navigation System Based On Imu/Lp-Mm Integrated Method Using Kalman Filter Algorithm, Abdullah Mohammed Bahasan

Hadhramout University Journal of Natural & Applied Sciences

Abstract

The demand for navigation systems is rapidly increasing, especially in indoor environments which the signal of GPS is not available. Therefore the Inertial Measurement Unit (IMU) system is a suitable navigation system in such indoor environments. It usually consists of three accelerometers and three gyroscopes to determine position, velocity and attitude information, respectively, without need of any external source. But this type of navigation systems has errors growth with time due to accelerometers and gyroscopes drifts. This paper introduces indoor navigation system based on integrated IMU navigation system with proposed system called Landmarks Points-Map Matching (LP-MM) system using Kalman …

Chatgpt As Metamorphosis Designer For The Future Of Artificial Intelligence (Ai): A Conceptual Investigation, Amarjit Kumar Singh (Library Assistant), Dr. Pankaj Mathur (Deputy Librarian)

Library Philosophy and Practice (e-journal)

Abstract

Purpose: The purpose of this research paper is to explore ChatGPT’s potential as an innovative designer tool for the future development of artificial intelligence. Specifically, this conceptual investigation aims to analyze ChatGPT’s capabilities as a tool for designing and developing near about human intelligent systems for futuristic used and developed in the field of Artificial Intelligence (AI). Also with the helps of this paper, researchers are analyzed the strengths and weaknesses of ChatGPT as a tool, and identify possible areas for improvement in its development and implementation. This investigation focused on the various features and functions of ChatGPT that …

Process Automation And Robotics Engineering For Industrial Processing Systems, Drake Stimpson

USF Tampa Graduate Theses and Dissertations

Automation in industrial systems applications has emerged as the fundamental solution for improving quality, production rate, and efficiency of a process. Much of the recent popularity surrounding the transition of processes from manually operated tasks to automated systems can be attributed to the concept of Industry 4.0, which outlines the fundamental guidelines for integrating cyber-physical systems into industrial processes. Due to rapid advancement of technology in robotics and automation as well as the increase in accessibility of resources to this technology, the capability to develop automated systems has become feasible for small-scale enterprise. This work presents a two-part initiative to …

Reference Frames In Human Sensory, Motor, And Cognitive Processing, Dongcheng He

Electronic Theses and Dissertations

Reference-frames, or coordinate systems, are used to express properties and relationships of objects in the environment. While the use of reference-frames is well understood in physical sciences, how the brain uses reference-frames remains a fundamental question. The goal of this dissertation is to reach a better understanding of reference-frames in human perceptual, motor, and cognitive processing. In the first project, we study reference-frames in perception and develop a model to explain the transition from egocentric (based on the observer) to exocentric (based outside the observer) reference-frames to account for the perception of relative motion. In a second project, we focus …

Drone Detection Using Yolov5, Burchan Aydin, Subroto Singha

Faculty Publications

The rapidly increasing number of drones in the national airspace, including those for recreational and commercial applications, has raised concerns regarding misuse. Autonomous drone detection systems offer a probable solution to overcoming the issue of potential drone misuse, such as drug smuggling, violating people’s privacy, etc. Detecting drones can be difficult, due to similar objects in the sky, such as airplanes and birds. In addition, automated drone detection systems need to be trained with ample amounts of data to provide high accuracy. Real-time detection is also necessary, but this requires highly configured devices such as a graphical processing unit (GPU). …

Skeleton-Based Hand Gesture Recognition Using Data-Level Fusion, Oluwaleke Yusuf

Theses and Dissertations

Hand Gesture Recognition (HGR) is a form of perceptual computing that allows artificial systems to capture and interpret human gestures. HGR has applications in human-machine interaction, virtual reality, augmented reality, and human behavior analysis. The human hand can assume a near-infinite number of poses and orientations to form myriad gestures, thus increasing the difficulty of the HGR task.

The hand skeleton of connected joints effectively describes the hand’s geometric shape and thus contains richer semantic gesture information while eliminating noise from individual differences in physical hand characteristics. The efficacy and computational efficiency of skeleton-based HGR frameworks can be significantly enhanced …

Gesture-Based American Sign Language (Asl) Translation System, Kayleigh Moore, Stefano Pecile, Mahdi Yazdanpour

Posters-at-the-Capitol

According to the World Health Organization (WHO), over 5% of the world's population experiences severe hearing loss. Approximately 9 million people in the U.S. are either functionally deaf or have mild-to-severe hearing loss. In this research, we designed and implemented a translation interface which turns American Sign Language (ASL) gestures captured from a pair of soft robotic gloves into text and speech instantaneously.

We used a combination of flex sensors, tactile sensors, and accelerometers to recognize hand gestures and to record hand and fingers positions, movements, and orientations. The digitized captured gestures were then sent to our proposed translation interface …

A Path Planning Framework For Multi-Agent Robotic Systems Based On Multivariate Skew-Normal Distributions, Peter Estephan

Theses, Dissertations and Capstones

This thesis presents a path planning framework for a very-large-scale robotic (VLSR) system in an known obstacle environment, where the time-varying distributions of agents are applied to represent the multi-agent robotic system (MARS). A novel family of the multivariate skew-normal (MVSN) distributions is proposed based on the Bernoulli random field (BRF) referred to as the Bernoulli-random-field based skew-normal (BRF-SN) distribution. The proposed distributions are applied to model the agents’ distributions in an obstacle-deployed environment, where the obstacle effect is represented by a skew function and separated from the no-obstacle agents’ distributions. First, the obstacle layout is represented by a Hilbert …

Artificial Emotional Intelligence In Socially Assistive Robots, Hojjat Abdollahi

Electronic Theses and Dissertations

Artificial Emotional Intelligence (AEI) bridges the gap between humans and machines by demonstrating empathy and affection towards each other. This is achieved by evaluating the emotional state of human users, adapting the machine’s behavior to them, and hence giving an appropriate response to those emotions. AEI is part of a larger field of studies called Affective Computing. Affective computing is the integration of artificial intelligence, psychology, robotics, biometrics, and many more fields of study. The main component in AEI and affective computing is emotion, and how we can utilize emotion to create a more natural and productive relationship between humans …

Understanding And Quantifying Human Factors In Programming From Demonstration: A User Study Proposal, Shakra Mehak, Aayush Jain, John D. Kelleher, Philip Long, Michael Guilfoyle, Maria Chiara Leva

Conference papers

Programming by demonstration (PbD) is a promising method for robots to learn from direct, non-expert human interaction. This approach enables the interactive transfer of human skills to the robot. As the non-expert user is at the center of PbD, the efficacy of the learned skill is largely dependent on the demonstrations provided. Although PbD methods have been extensively developed and validated in the field of robotics, there has been inadequate confirmation of their effectiveness from the perspective of human teachability. To address this gap, we propose to experimentally investigate the impact of communicating robot learning process on the efficacy of …

Parallel Real Time Rrt*: An Rrt* Based Path Planning Process, David Yackzan

Theses and Dissertations--Mechanical and Aerospace Engineering

This thesis presents a new parallelized real-time path planning process. This process is an extension of the Real-Time Rapidly Exploring Random Trees* (RT-RRT*) algorithm developed by Naderi et al in 2015 [1]. The RT-RRT* algorithm was demonstrated on a simulated two-dimensional dynamic environment while finding paths to a varying target state. We demonstrate that the original algorithm is incapable of running at a sufficient rate for control of a 7-degree-of-freedom (7-DoF) robotic arm while maintaining a path planning tree in 7 dimensions. This limitation is due to the complexity of maintaining a tree in a high-dimensional space and the network …

Benchmarking Model Predictive Control And Reinforcement Learning For Legged Robot Locomotion, Shivayogi Akki

Dissertations, Master's Theses and Master's Reports

This research delves into the realm of quadrupedal robotics, focusing on the comparative analysis of Model Predictive Control (MPC) and Reinforcement Learning (RL) as predominant control strategies. Through the comprehensive dataset compiled and the insights derived from this analysis, this research aims to serve as a valuable resource for the legged robotics community, guiding researchers and practitioners in the selection and implementation of control strategies. The ultimate goal is to contribute to the advancement of legged robot capabilities and facilitate their successful deployment in real-world applications.

In this study, we employ the Unitree Go1 quadrupedal robot as a testbed, subjecting …

Robotic Inspection And Data Analytics To Localize And Visualize The Structural Defects Of Civil Infrastructure, Jinglun Feng

Dissertations and Theses

Ground Penetrating Radar (GPR) serves as a significant nondestructive evaluation (NDE) technique to inspect and survey underground objects (e.g., rebars, utility pipes) in complex urban environments. In addition to GPR, visual-based surface defect detection plays a crucial role in assessing and maintaining civil infrastructure. To facilitate deployment on a robotic platform and enhance inspection capabilities, the integration of GPR and visual-based sensors, such as RGB-D cameras, is crucial to obtain accurate subsurface and surface information. This thesis presents a novel robotic-based inspection system for the efficient collection of NDE data and accurate 3D reconstruction of both subsurface and surface infrastructure …

Modelling And Mitigating Interlocutor Confusion In Situated Human-Avatar And Human-Robot Interaction, Na Li

Dissertations

Human-Robot Interaction (HRI) is an important but challenging field focused on improving the interaction between humans and robots, to make the interaction more intelligent and effective. However, building a natural conversational HRI is an interdisciplinary challenge for scholars, engineers, and designers. Achieving successful conversational interaction with a social robot necessitates not only observing a user’s active participation in the interaction but also being aware of their emotional and attitudinal states as the interaction progresses. On the topic of attitudinal states, one field that has received little attention to date is monitoring the user for possible confusion states. Confusion is a …

A Structured Narrative Prompt For Prompting Narratives From Large Language Models: Sentiment Assessment Of Chatgpt-Generated Narratives And Real Tweets, Christopher J. Lynch, Erik J. Jensen, Virginia Zamponi, Kevin O'Brien, Erika Frydenlund, Ross Gore

VMASC Publications

Large language models (LLMs) excel in providing natural language responses that sound authoritative, reflect knowledge of the context area, and can present from a range of varied perspectives. Agent-based models and simulations consist of simulated agents that interact within a simulated environment to explore societal, social, and ethical, among other, problems. Simulated agents generate large volumes of data and discerning useful and relevant content is an onerous task. LLMs can help in communicating agents' perspectives on key life events by providing natural language narratives. However, these narratives should be factual, transparent, and reproducible. Therefore, we present a structured narrative prompt …

Alternatives To Reducing Aviation Fuel-Burn With Technology: Fully Electric Autonomous Taxibot, Denzil Neo

Student Works

Aircraft taxiing operations in the aerodrome were identified to consume the most jet fuel apart from the cruise phase of the flight. This was also well supported by various research associating taxi operations at large, congested airports, with high jet fuel consumption, high carbon emissions, and noise pollution. Existing literature recognised the potential to address the environmental issues of aerodrome taxi operations by operating External or Onboard Aircraft Ground Propulsion Systems (AGPS). Designed to power aircraft with sources other than their main engines, external Aircraft Ground Power Systems (AGPS) have shown the potential to significantly cut jet fuel consumption and …

Evaluation Of Lidar Uncertainty And Applications Towards Slam In Off-Road Environments, Zachary D. Jeffries

Dissertations, Master's Theses and Master's Reports

Safe and robust operation of autonomous ground vehicles in all types of conditions and environment necessitates complex perception systems and unique, innovative solutions. This work addresses automotive lidar and maximizing the performance of a simultaneous localization and mapping stack. An exploratory experiment and an open benchmarking experiment are both presented. Additionally, a popular SLAM application is extended to use the type of information gained from lidar characterization, demonstrating the performance gains and necessity to tightly couple perception software and sensor hardware. The first exploratory experiment collects data from child-sized, low-reflectance targets over a range from 15 m to 35 m. …

Neuromorphic Computing Applications In Robotics, Noah Zins

Dissertations, Master's Theses and Master's Reports

Deep learning achieves remarkable success through training using massively labeled datasets. However, the high demands on the datasets impede the feasibility of deep learning in edge computing scenarios and suffer from the data scarcity issue. Rather than relying on labeled data, animals learn by interacting with their surroundings and memorizing the relationships between events and objects. This learning paradigm is referred to as associative learning. The successful implementation of associative learning imitates self-learning schemes analogous to animals which resolve the challenges of deep learning. Current state-of-the-art implementations of associative memory are limited to simulations with small-scale and offline paradigms. Thus, …

Human Tracking Function For Robotic Dog, Andrew Sharkey

Williams Honors College, Honors Research Projects

With the increase the increase in automation and humans and robots working side by side, there is a need for a more organic way of controlling robots. The goal of this project is to create a control system for Boston dynamics robotic dog Spot that implements human tracking image software to follow humans using computer vision as well as using hand tracking image software to allow for control input through hand gestures.

Initiating Change In Care: Socially Assistive Robots, Sooraj Sushama

Theses and Dissertations

Socially assistive robots (SAR) are autonomous machines equipped with sensors and software that allow them to interact socially with humans. SAR robots are commonly used in healthcare settings to provide patients with non-clinical support, such as conversation and emotional companionship. SARs can also deliver reminders, monitor vital signs, and provide educational information about health conditions or medications. Researchers have studied SAR applications in detail. Additionally, there has been prior research on SAR where users' sociodemographic factors and technology acceptance were studied. But even though the backbone of SAR is an advanced technology, no known research has been done on users' …

Space Force Design Project, Emily Greene, Ashton Orosa, Julia Patek, Nathan Doty

Williams Honors College, Honors Research Projects

The objective of our research project is to develop a lab testbed composed of a curved surface to represent a spacecraft hull, a mobile robot equipped with repair tools, and a robotic arm equipped with a laser 3D scanner. This project is part of a larger grant to the University of Akron from Space Force and Air Research Labs. The lab testbed developed in this project will be used to assist in creating and testing a software and algorithm to inspect and repair spacecraft while in orbit. The project will involve researching spacecraft hulls to create an accurate simulation bed, …

Portable Robotic Navigation Aid For The Visually Impaired, Lingqiu Jin

Theses and Dissertations

This dissertation aims to address the limitations of existing visual-inertial (VI) SLAM methods - lack of needed robustness and accuracy - for assistive navigation in a large indoor space. Several improvements are made to existing SLAM technology, and the improved methods are used to enable two robotic assistive devices, a robot cane, and a robotic object manipulation aid, for the visually impaired for assistive wayfinding and object detection/grasping. First, depth measurements are incorporated into the optimization process for device pose estimation to improve the success rate of VI SLAM's initialization and reduce scale drift. The improved method, called depth-enhanced visual-inertial …

Real-Time Motion Controller For Human-Robot Teams Utilizing Artificial Potential Fields, Gabriella Graziani

Theses and Dissertations

This thesis presents a real-time robotic motion control system for human-robot teams. The framework utilizes artificial potential fields (APFs) to guide robotic agents towards a “goal” agent while navigating around “obstacle” agents; these goals and obstacles are also dynamic agents with their own set of tasks. This system is also developed for a live-programming environment, where a controlling agent updates the tasks of all agents within the system at any time during the system’s runtime. This motion controller was created and tested for a human-robot choreographic team. After the controller was fully integrated on a Trossen Robotic LoCobot Wx200 robotic …

Design And Development Of A Smartphone App For Health Monitoring And Alerts For Farm Workers, Omer Oztoprak

Graduate Research Theses & Dissertations

This thesis presents the design and development of a novel smartphone applicationfor simultaneous health monitoring and alerts for agricultural workers using multiple wearable sensor devices via Bluetooth Low Energy (BLE). The application combines health data from a range of sensors such as an IMU that detects body movement, a pulse oximeter that captures oxygen saturation and heart rate, and a thermometer that measures body temperature. The software framework is built using Jetpack Compose in Android Studio, and it incorporates the MVVM (Model- View-ViewModel) model to provide optimized data flow and robust efficiency. By integrating the Dagger Hilt Dependency Injection framework, …