Computer Engineering Commons^™

Brain-Inspired Spatio-Temporal Learning With Application To Robotics, Thiago André Ferreira Medeiros

USF Tampa Graduate Theses and Dissertations

The human brain still has many mysteries and one of them is how it encodes information. The following study intends to unravel at least one such mechanism. For this it will be demonstrated how a set of specialized neurons may use spatial and temporal information to encode information. These neurons, called Place Cells, become active when the animal enters a place in the environment, allowing it to build a cognitive map of the environment. In a recent paper by Scleidorovich et al. in 2022, it was demonstrated that it was possible to differentiate between two sequences of activations of a …

A Human-In-The-Loop Robot Grasping System With Grasp Quality Refinement, Tian Tan

USF Tampa Graduate Theses and Dissertations

The goal of this dissertation is to develop a grasping system for assistive robots that can help people with disabilities and the elderly to perform tasks of daily living. In developing this robot grasping system, we maximize its reliability, accuracy, and autonomy. High reliability and accuracy are required for robots to perform tasks around human users and to safely interact with objects that might be fragile or have contents that could spill. High autonomy is desired as users with disabilities are usually not dexterous enough to directly operate the robot. In this dissertation, a human-in-the-loop (HitL) robot grasping system is …

Process Automation And Robotics Engineering For Industrial Processing Systems, Drake Stimpson

USF Tampa Graduate Theses and Dissertations

Automation in industrial systems applications has emerged as the fundamental solution for improving quality, production rate, and efficiency of a process. Much of the recent popularity surrounding the transition of processes from manually operated tasks to automated systems can be attributed to the concept of Industry 4.0, which outlines the fundamental guidelines for integrating cyber-physical systems into industrial processes. Due to rapid advancement of technology in robotics and automation as well as the increase in accessibility of resources to this technology, the capability to develop automated systems has become feasible for small-scale enterprise. This work presents a two-part initiative to …

Adaptive Multi-Scale Place Cell Representations And Replay For Spatial Navigation And Learning In Autonomous Robots, Pablo Scleidorovich

USF Tampa Graduate Theses and Dissertations

Place cells are one of the most widely studied neurons thought to play a vital role in spatial cognition. Extensive studies show that their activity in the rodent hippocampus is highly correlated with the animal’s spatial location, forming “place fields” of smaller sizes near the dorsal pole and larger sizes near the ventral pole. Despite advances, it is yet unclear how this multi-scale representation enables navigation in complex environments.

In this dissertation, we analyze the place cell representation from a computational point of view, evaluating how multi-scale place fields impact navigation in large and cluttered environments. The objectives are to …

Analyzing Decision-Making In Robot Soccer For Attacking Behaviors, Justin Rodney

USF Tampa Graduate Theses and Dissertations

In robotics soccer, decision-making is critical to the performance of a team’s SoftwareSystem. The University of South Florida’s (USF) RoboBulls team implements behavior for the robots by using traditional methods such as analytical geometry to path plan and determine whether an action should be taken. In recent works, Machine Learning (ML) and Reinforcement Learning (RL) techniques have been used to calculate the probability of success for a pass or goal, and even train models for performing low-level skills such as traveling towards a ball and shooting it towards the goal[1, 2]. Open-source frameworks have been created for training Reinforcement Learning …

Humanoid Robot Motion Control For Ramps And Stairs, Tommy Truong

USF Tampa Graduate Theses and Dissertations

Humanoid robot research and development have been an ongoing effort since the 1900sand can be broken down to two problems. A mechanical problem, getting a humanoid robot to move human-like or a software problem, getting a humanoid robot to behave human-like. These problems of moving and behaving human-like can be often solved using control theory as research advances. For the premise of this research, we explore how to balance and walk on non-flat terrain for the humanoid robot Darwin-Op. Since the focus was on the control theory, the vision control to detect the non-flat terrain was a side objective. The …

Learning State-Dependent Sensor Measurement Models To Improve Robot Localization Accuracy, Troi André Williams

USF Tampa Graduate Theses and Dissertations

This dissertation proposes a novel method called state-dependent sensor measurement models (SDSMMs). Such models dynamically predict the state-dependent bias and uncertainty of sensor measurements, ultimately improving fundamental robot tasks such as localization. In our first investigation, we introduced the state-dependent sensor measurement model framework, described their properties, stated the input and output of these models, and described how to train them. We also explained how to integrate such models with an Extended Kalman Filter and a Particle Filter, two popular robot state estimation algorithms. We validated the proposed framework through a series of localization tasks. The results showed that our …

Trilateration-Based Localization In Known Environments With Object Detection, Valeria M. Salas Pacheco

USF Tampa Graduate Theses and Dissertations

Many strategies for localization have been proposed, the majority of which rely on distance calculations and estimates. The proposed approach is a method that combines image-based single-camera localization techniques and the principle of trilateration to perform localization in a known indoor environment. By using a camera, the proposed system can detect custom objects using object detection in an indoor environment and calculate an approximation of the camera’s position. To recognize the location, previous information such as the size of the environment and the coordinates and sizes of the objects in the environment are given as input to the system together …

Design And Implementation Of Intuitive Human-Robot Teleoperation Interfaces, Lei Wu

USF Tampa Graduate Theses and Dissertations

We have designed and implemented a novel human-robot teleoperation interface based on an intuitive reference frame and hybrid inverse kinematics to perform activities of daily living(ADL) using multiple input devices.

Persons with disabilities often rely on caregivers or family members to assist in their daily living activities. Providing robotic assistants with easy and intuitive user interfaces to assist with ADL can improve their quality of life and lift some of the burdens on caregivers and family members. Current human-robot interface solutions, such as joysticks, Kinect based gesture recognition, and touchscreen-based solutions, including smartphones, are still far from being able to …

Roboat - Rescue Operations Bot Operating In All Terrains, Akshay Gulhane

USF Tampa Graduate Theses and Dissertations

Natural calamities are on a rise with each passing year. Disasters like floods and fire take many lives all around the world, especially in remote areas or less developed countries. One such incident was the Kerala Floods in India where rescue services had difficulty reaching to all the people on time since a huge landmass (more than 9 districts) was flooded and hence villagers or other people risked their lives to save others in danger without proper safety equipment. Amazon Rainforest Fires was another example for a major destruction of an ecosystem. The main reason for lack of facilities in …

Control Of A Human Arm Robotic Unit Using Augmented Reality And Optimized Kinematics, Carlo Canezo

USF Tampa Graduate Theses and Dissertations

There are more than 350000 amputees in the US who suffer loss of functionality in their daily living activities, and roughly 100000 of them are upper arm amputees. Many of these amputees use prostheses to compensate part of their lost arm function, including power prostheses. Research on 6-7 degree of freedom powered prostheses is still relatively new, and most commercially available powered prostheses are typically limited to 1 to 3 degrees of freedom. Due to the myriad of possible options for various powered protheses from different manufacturers, each configuration is governed by a distinct control scheme typically specific to the …

Action Recognition Using The Motion Taxonomy, Maxat Alibayev

USF Tampa Graduate Theses and Dissertations

In the last years, modern action recognition frameworks with deep architectures have achieved impressive results on the large-scale activity datasets. All state-of-the-art models share one common attribute: two-stream architectures. One deep model takes RGB frames, while the other model is fed with pre-computed optical flow vectors. The outputs of both models are combined to be used as a final probability distribution for the action classes. When comparing the results of individual models with the fused model, it is common to see that that latter method is more superior. Researchers explain that phenomena with the fact that optical flow vectors serve …

Functional Object-Oriented Network: A Knowledge Representation For Service Robotics, David Andrés Paulius Ramos

USF Tampa Graduate Theses and Dissertations

In this dissertation, we discuss our work behind the development of the functional object-oriented network (abbreviated as FOON), a graphical knowledge representation for robotic manipulation and understanding of its own actions and (potentially) the intentions of humans in the household. Based on the theory of affordance, this representation captures manipulations and their effects on actions through the coupling of object and motion nodes as fundamental learning units known as functional units. The activities currently represented in FOON are cooking related, but this representation can be extended to other activities that involve manipulation of objects which result in observable changes of …

Design Of Delro Autonomous Delivery Robot And Ai Based Localization, Tolga Karakurt

USF Tampa Graduate Theses and Dissertations

Autonomous robots are employed in numerous areas. In this thesis, it is proposed to design and build a self-controlled wheeled vehicle to deliver food.

As there are many applications of an autonomous agent for indoor and outdoor environments, this study is conducted on indoor settings whereas all the requirements and design processes are achieved for both operational boundaries.

The fundamental approach is to design and implement a Wheeled Mobile Robot (WMR), and to test skid-steering performance on proposed trajectories using a System Engineering approach. From this point of view, system requirements in mechanical, electrical, and software are evaluated, and overall …

The Design And Development Of A Wrist-Hand Orthosis, Amber Gatto

USF Tampa Graduate Theses and Dissertations

Individuals with an incomplete C5-C7 spinal cord injury (SCI) lose grasping abilities but wrist function is almost universally retained. Most rehabilitation techniques apply the tenodesis effect, however, current tenodesis wrist-hand orthoses (WHOs) engage only the thumb and index finger, meaning that only 20% of activities of daily living (ADLs) can be completed.

This study tested the feasibility of a student-designed powered WHO by testing the device on healthy subjects to see if they could complete a variety of ADLs. A simulation software was then used to analyze wrist, thumb, and index finger joint angles. Additionally, an Assistive Technology Survey was …

Distributed Spatiotemporal Control And Dynamic Information Fusion For Multiagent Systems, Dzung Minh Duc Tran

USF Tampa Graduate Theses and Dissertations

The first objective of this dissertation is to develop novel distributed control architectures allowing spatiotemporal control of multiagent systems as applied to formation control. In addition, its second objective is to introduce distributed estimation frameworks for dynamic information fusion for addressing the heterogeneity in sensor networks.

Changing the spatial and temporal properties of agent teams in a distributed manner and in real-time is an open problem in the control system literature as multiagent systems are often required to complete tasks with ever-increasing complexity in adverse conditions and dynamic environments. Motivated by this standpoint, this dissertation aims to address challenges related …

Robotic Motion Generation By Using Spatial-Temporal Patterns From Human Demonstrations, Yongqiang Huang

USF Tampa Graduate Theses and Dissertations

Robots excel in manufacturing facilities because the tasks are repetitive and do not change. However, when the tasks change, which happens in almost all tasks that humans perform daily, such as cutting, pouring, and grasping, etc., robots perform much worse. We aim at teaching robots to perform tasks that are subject to change using demonstrations collected from humans, a problem referred to as learning from demonstration (LfD).

LfD consists of two parts: the data of human demonstrations, and the algorithm that extracts knowledge from the data to perform the same motions. Similarly, this thesis is divided into two parts. The …

Force Feedback And Intelligent Workspace Selection For Legged Locomotion Over Uneven Terrain, John Rippetoe

USF Tampa Graduate Theses and Dissertations

Legged robots present an incredible opportunity for humanity to conduct dangerous operations such as search and rescue, disaster recovery, and planetary exploration without ever placing themselves in harms way. The ability of a leg to more freely dictate its shape, orientation, and length gives it tremendous mobility and adaptability demanded of a system intended for operation outside of a controlled environment. However, one only need look at the average cat, dog, or friendly neighborhood squirrel to understand the immense gap that exists between what is possible of legged systems and their current set of capabilities.

Areas of study relevant to …

Multi-Scale Spatial Cognition Models And Bio-Inspired Robot Navigation, Martin I. Llofriu Alonso

USF Tampa Graduate Theses and Dissertations

The rodent navigation system has been the focus of study for over a century. Discoveries made lately have provided insight on the inner workings of this system. Since then, computational approaches have been used to test hypothesis, as well as to improve robotics navigation and learning by taking inspiration on the rodent navigation system.

This dissertation focuses on the study of the multi-scale representation of the rat’s current location found in the rat hippocampus. It first introduces a model that uses these different scales in the Morris maze task to show their advantages. The generalization power of larger scales of …

Orthoplanar Spring Based Compliant Force/Torque Sensor For Robot Force Control, Jerry West

USF Tampa Graduate Theses and Dissertations

A compliant force/torque sensor for robot force control has been developed. This thesis presents methods of designing, testing, and implementing the sensor on a robotic system. The sensor uses an orthoplanar spring equipped with Hall-effect sensors to measure one component of force and two moment components. Its unique design allows for simple and cost effective manufacturing, high reliability, and compactness. The device may be used in applications where a robot must control contact forces with its environment, such as in surface cleaning tasks, manipulating doors, and removing threaded fasteners. The compliant design of the sensor improves force control performance and …

Impact Force Reduction Using Variable Stiffness With An Optimal Approach For Jumping Robots, Juan Manuel Calderon Chavez

USF Tampa Graduate Theses and Dissertations

Running, jumping and walking are physical activities that are performed by humans in a simple and efficient way. However, these types of movements are difficult to perform by humanoid robots. Humans perform these activities without difficulty thanks to their ability to absorb the ground impact force. The absorption of the impact force is based on the human ability to vary muscles stiffness.

The principal objective of this dissertation is to study vertical jumps in order to reduce the impact force in the landing phase of the jump motion of humanoid robots. Additionally, the impact force reduction is applied to an …

Kinematic Control Of Redundant Mobile Manipulators, Mustafa Mashali

USF Tampa Graduate Theses and Dissertations

A mobile manipulator is a robotic arm mounted on a robotic mobile platform. In such a system, the degrees of freedom of the mobile platform are combined with that of the manipulator. As a result, the workspace of the manipulator is substantially extended. A mobile manipulator has two trajectories: the end-effector trajectory and the mobile platform trajectory. Typically, the mobile platform trajectory is not defined and is determined through inverse kinematics. But in some applications it is important to follow a specified mobile platform trajectory. The main focus of this work is to determine the inverse kinematics of a mobile …

Dual 7-Degree-Of-Freedom Robotic Arm Remote Teleoperation Using Haptic Devices, Yu-Cheng Wang

USF Tampa Graduate Theses and Dissertations

A teleoperated system of dual redundant manipulator will be controlled in this thesis. The robot used with the dual redundant manipulator in this thesis is Baxter. Baxter’s redundant robot arms are 7-degree-of-freedom arms. The problem that will be solved in this thesis is optimization of the 7-degree-of-freedom robot arms. The control algorithm of the 7-degree-of-freedom robot arms will be discussed and built. A simulation program will be built to test the control algorithm. Based on the control algorithm, a teleoperation system will be created for Baxter. The controller used is Omni, which is a six-joint haptic device. Omni will also …

Reducing The Control Burden Of Legged Robotic Locomotion Through Biomimetic Consonance In Mechanical Design And Control, Caitrin Elizabeth Eaton

USF Tampa Graduate Theses and Dissertations

Terrestrial robots must be capable of negotiating rough terrain if they are to become autonomous outside of the lab. Although the control mechanism offered by wheels is attractive in its simplicity, any wheeled system is confined to relatively flat terrain. Wheels will also only ever be useful for rolling, while limbs observed in nature are highly multimodal. The robust locomotive utility of legs is evidenced by the many animals that walk, run, jump, swim, and climb in a world full of challenging terrain.

On the other hand, legs with multiple degrees of freedom (DoF) require much more complex control and …

Visual Slam And Surface Reconstruction For Abdominal Minimally Invasive Surgery, Bingxiong Lin

USF Tampa Graduate Theses and Dissertations

Depth information of tissue surfaces and laparoscope poses are crucial for accurate surgical guidance and navigation in Computer Assisted Surgeries (CAS). Intra-operative Three Dimensional (3D) reconstruction and laparoscope localization are therefore two fundamental tasks in CAS. This dissertation focuses on the abdominal Minimally Invasive Surgeries (MIS) and presents laparoscopic-video-based methods for these two tasks.

Different kinds of methods have been presented to recover 3D surface structures of surgical scenes in MIS. Those methods are mainly based on laser, structured light, time-of-flight cameras, and video cameras. Among them, laparoscopic-video-based surface reconstruction techniques have many significant advantages. Specifically, they are non-invasive, provide …

A Brain Robot Interface For Autonomous Activities Of Daily Living Tasks, Don Indika Upashantha Pathirage

USF Tampa Graduate Theses and Dissertations

There have been substantial improvements in the area of rehabilitation robotics in the recent past. However, these advances are inaccessible to a large number of people with disabilities who are in most need of such assistance. This group includes people who are in a severely paralyzed state, that they are completely "locked-in" in their own bodies. Such persons usually retain full cognitive abilities, but have no voluntary muscle control.

For these persons, a Brain Computer Interface (BCI) is often the only way to communicate with the outside world and/or control an assistive device. One major drawback to BCI devices is …

A Multi-Case Study Of Student Interactions With Educational Robots And Impact On Science, Technology, Engineering, And Math (Stem) Learning And Attitudes, Stephanie Holmquist

USF Tampa Graduate Theses and Dissertations

The demand for STEM trained workers continues to increase not only in the United States, but globally. Reports have indicated that the United States is not doing a good job encouraging students to pursue STEM oriented degrees. In particular, it has become increasingly important to emphasize STEM connections at an early level in order to encourage student career exploration as they continue their education. Educational robots represent a unique alternative to traditional methods, especially at the elementary level. Considering the use of educational robots have largely been ignored at this level, the purpose of this study was to describe the …

Scene-Dependent Human Intention Recognition For An Assistive Robotic System, Kester Duncan

USF Tampa Graduate Theses and Dissertations

In order for assistive robots to collaborate effectively with humans for completing everyday tasks, they must be endowed with the ability to effectively perceive scenes and more importantly, recognize human intentions. As a result, we present in this dissertation a novel scene-dependent human-robot collaborative system capable of recognizing and learning human intentions based on scene objects, the actions that can be performed on them, and human interaction history. The aim of this system is to reduce the amount of human interactions necessary for communicating tasks to a robot. Accordingly, the system is partitioned into scene understanding and intention recognition modules. …

Fpca Based Human-Like Trajectory Generating, Wei Dai

USF Tampa Graduate Theses and Dissertations

This thesis presents a new human-like upper limb and hand motion generating method. The work is based on Functional Principal Component Analysis and Quadratic Programming. The human-like motion generating problem is formulated in a framework of minimizing the difference of the dynamic profile of the optimal trajectory and the known types of trajectory. Statistical analysis is applied to the pre-captured human motion records to work in a low dimensional space. A novel PCA FPCA hybrid motion recognition method is proposed. This method is implemented on human grasping data to demonstrate its advantage in human motion recognition. One human grasping hierarchy …

A Distributed Local-Leg Feedback Algorithm For Robust Walking On Uneven Terrain, Mayur Ramakant Palankar

USF Tampa Graduate Theses and Dissertations

Legged animals can traverse significantly more of the Earth's land mass than man-made wheeled and tracked vehicles~\cite{Anonymous67}. Their impressive mobility is largely due to multiple dexterous legs and the robust algorithms that coordinate and control them. A legged animal such as a squirrel can exhibit multiple locomotion modes such as walking, running and jumping and also multiple gaits or leg phase timings within each mode. A robot that could mimic this level of robust locomotion would be highly useful for planetary exploration, military reconnaissance, and time-critical search and rescue in cluttered or collapsed buildings.

A number of biological studies on …