Engineering Commons^™

Human-Robot Interaction For Assistive Robotics, Jiawei Li

Dissertations

This dissertation presents an in-depth study of human-robot interaction (HRI) withapplication to assistive robotics. In various studies, dexterous in-hand manipulation is included, assistive robots for Sit-To-stand (STS) assistance along with the human intention estimation. In Chapter 1, the background and issues of HRI are explicitly discussed. In Chapter 2, the literature review introduces the recent state-of-the-art research on HRI, such as physical Human-Robot Interaction (HRI), robot STS assistance, dexterous in hand manipulation and human intention estimation. In Chapter 3, various models and control algorithms are described in detail. Chapter 4 introduces the research equipment. Chapter 5 presents innovative theories and …

Efficient End-To-End Autonomous Driving, Hesham Eraqi

Theses and Dissertations

Steering a car through traffic is a complex task that is difficult to cast into algorithms. Therefore, researchers turn to train artificial neural networks from front-facing camera data stream along with the associated steering angles. Nevertheless, most existing solutions consider only the visual camera frames as input, thus ignoring the temporal relationship between frames. In this work, we propose a Convolution Long Short-Term Memory Recurrent Neural Network (C-LSTM), which is end-to-end trainable, to learn both visual and dynamic temporal dependencies of driving. Additionally, We introduce posing the steering angle regression problem as classification while imposing a spatial relationship between the …

Reinforcement Learning Approach For Inspect/Correct Tasks, Hoda Nasereddin

LSU Doctoral Dissertations

In this research, we focus on the application of reinforcement learning (RL) in automated agent tasks involving considerable target variability (i.e., characterized by stochastic distributions); in particular, learning of inspect/correct tasks. Examples include automated identification & correction of rivet failures in airplane maintenance procedures, and automated cleaning of surgical instruments in a hospital sterilization processing department. The location of defects and the corrective action to be taken for each varies from task episode. What needs to be learned are optimal stochastic strategies rather than optimization of any one single defect type and location. RL has been widely applied in robotics …

Emergency Landing And Guidance System, Joseph Alarid

Master's Theses

Every year there are thousands of aviation accidents along with hundreds of human deaths that happen around the world. While the data is sparse, it is well documented that many of these happen from emergency landings gone awry. While pilots can generally make great landings in clear daytime conditions, they are significantly handicapped when it comes to landing at night or amongst poor visibility conditions.

Due to the nature of this problem and some of the large scale advances in software technology we propose a solution that provides a significant improvement from the status quo. Using transfer learning on neural …

Towards Sensorimotor Coupling Of A Spiking Neural Network And Deep Reinforcement Learning For Robotics Application, Kashu Yamazaki

Mechanical Engineering Undergraduate Honors Theses

Deep reinforcement learning augments the reinforcement learning framework and utilizes the powerful representation of deep neural networks. Recent works have demonstrated the great achievements of deep reinforcement learning in various domains including finance,medicine, healthcare, video games, robotics and computer vision.Deep neural network was started with multi-layer perceptron (1stgeneration) and developed to deep neural networks (2ndgeneration)and it is moving forward to spiking neural networks which are knownas3rdgeneration of neural networks. Spiking neural networks aim to bridge the gap between neuroscience and machine learning, using biologically-realistic models of neurons to carry out computation. In this thesis, we first provide a comprehensive review …

Design And Implementation Of Intuitive Human-Robot Teleoperation Interfaces, Lei Wu

USF Tampa Graduate Theses and Dissertations

We have designed and implemented a novel human-robot teleoperation interface based on an intuitive reference frame and hybrid inverse kinematics to perform activities of daily living(ADL) using multiple input devices.

Persons with disabilities often rely on caregivers or family members to assist in their daily living activities. Providing robotic assistants with easy and intuitive user interfaces to assist with ADL can improve their quality of life and lift some of the burdens on caregivers and family members. Current human-robot interface solutions, such as joysticks, Kinect based gesture recognition, and touchscreen-based solutions, including smartphones, are still far from being able to …

Roboat - Rescue Operations Bot Operating In All Terrains, Akshay Gulhane

USF Tampa Graduate Theses and Dissertations

Natural calamities are on a rise with each passing year. Disasters like floods and fire take many lives all around the world, especially in remote areas or less developed countries. One such incident was the Kerala Floods in India where rescue services had difficulty reaching to all the people on time since a huge landmass (more than 9 districts) was flooded and hence villagers or other people risked their lives to save others in danger without proper safety equipment. Amazon Rainforest Fires was another example for a major destruction of an ecosystem. The main reason for lack of facilities in …

Control Of A Human Arm Robotic Unit Using Augmented Reality And Optimized Kinematics, Carlo Canezo

USF Tampa Graduate Theses and Dissertations

There are more than 350000 amputees in the US who suffer loss of functionality in their daily living activities, and roughly 100000 of them are upper arm amputees. Many of these amputees use prostheses to compensate part of their lost arm function, including power prostheses. Research on 6-7 degree of freedom powered prostheses is still relatively new, and most commercially available powered prostheses are typically limited to 1 to 3 degrees of freedom. Due to the myriad of possible options for various powered protheses from different manufacturers, each configuration is governed by a distinct control scheme typically specific to the …

Synthesizing Expressive Behaviors For Humanoid Robots, Mathias Irwan Sunardi

Dissertations and Theses

Humanoid robots are expected to be able to communicate with expressive gestures at the same level of proficiency as humans. However, creating expressive gestures for humanoid robots is difficult and time consuming due to the high number of degrees of freedom (DOF) and the iterations needed to get the desired expressiveness.

Current robot motion editing software has varying levels of sophistication of motion editing tools ranging from basic ones that are text-only, to ones that provide graphical user interfaces (GUIs) which incorporate advanced features, such as curve editors and inverse kinematics. These tools enable users to create simple motions; but …

Action Recognition Using The Motion Taxonomy, Maxat Alibayev

USF Tampa Graduate Theses and Dissertations

In the last years, modern action recognition frameworks with deep architectures have achieved impressive results on the large-scale activity datasets. All state-of-the-art models share one common attribute: two-stream architectures. One deep model takes RGB frames, while the other model is fed with pre-computed optical flow vectors. The outputs of both models are combined to be used as a final probability distribution for the action classes. When comparing the results of individual models with the fused model, it is common to see that that latter method is more superior. Researchers explain that phenomena with the fact that optical flow vectors serve …

Short Run Box Maker, Jesus Valdez-Ruelas

General Engineering

Small businesses with short run product catalogs have trouble finding the right size box that will work for multiple products. In turn, this leads most businesses to use oversized boxes resulting in unnecessary shipping fees. The objective of this project was to develop and test a cost-effective prototype of a box making machine that could create a short run of custom sized boxes. A Co2 laser was found to be the best option for cutting cardboard and a vertically standing machine was designed to feed the cardboard via rollers. To control cardboard movement stepper motors were used and controlled using …

Reading Robot, Gillian Watts, Andrew Myers, Sabrinna Tan, Taylor Klein, Omeed Djassemi

General Engineering

Presently, there is an insufficient availability of human experts to assist students in reading competency and comprehension. Our team’s goal was to create an improved socially assistive robot for use by therapists, teachers, and parents to help children and adults develop reading skills while they do not have access to specialists. HAPI is a socially assistive robot that we created with the goal of helping students practice their reading comprehension skills. HAPI enables a student to improve their reading skills without an educator present, while enabling educators to review the student's performance remotely. Design constraints included: physical size, weight, duration …

Rchex: A Radio-Controlled Hexapod, Dominique Sayo

Computer Engineering

rcHex is a radio-controlled hexapod with 18 degrees of freedom, capable of positional and rotational body adjustment as well as omnidirectional travel at variable speeds using three common gaits. Its general-purpose design accessible to hobbyists makes rcHex an platform for further development, whether it be experimentation in advanced robotic movement or retrofitting sensors to utilize technologies such as computer vision and artificial intelligence. This report explores some of the design intricacies of hexapod movement, including gait sequencing and the application of inverse kinematics to multi-jointed limbs.

Autonomous Butter Robot, David Chau, Michael Hegglin

Computer Engineering

Don’t you wish your butter would come to you? Well now it can with the patented Michael and David butter robot! Based on an idea from a TV show, our team set out to see if a similar robot was possible to make in real life. The objective was simple. Can we make a small table sized robot that can bring a person butter using image detection software? With that question in mind we set out buying our components. We wanted to keep it small, so we looked up devices that could do simple image processing and from there we …

Surface Autonomous Vehicle For Emergency Rescue, Max Emerick, Ryan Shields, Christopher Feickert, Raymond Impara

Mechanical Engineering

The goal of this document is to clearly define the problem parameters and project objectives and to clearly describe the design process, planned final design, and manufacturing and testing procedures for the senior design project of Team 26: SAVER -- the Surface Autonomous Vehicle for Emergency Rescue. This is both for the purpose of project planning and for clear communication between all parties involved in the project.

The objective of the SAVER project is to develop a proof of concept for an autonomous maritime search and rescue vehicle for aiding in man-overboard missions. To accomplish this goal, a list of …

Flexible Fault Tolerance For The Robot Operating System, Sukhman S. Marok

Master's Theses

The introduction of autonomous vehicles has the potential to reduce the number of accidents and save countless lives. These benefits can only be realized if autonomous vehicles can prove to be safer than human drivers. There is a large amount of active research around developing robust algorithms for all parts of the autonomous vehicle stack including sensing, localization, mapping, perception, prediction, planning, and control. Additionally, some of these research projects have involved the use of the Robot Operating System (ROS). However, another key aspect of realizing an autonomous vehicle is a fault-tolerant design that can ensure the safe operation of …

Lawn Buddy, Jayson Johnston, Andrew Brown, Jacob Maljian

Electrical Engineering

Grass lawns are a common hallmark of the American home. In 2019, a survey from the National Association of Landscape Professionals found that 81% of all Americans owned a lawn [1]. Mowing is a time consuming and costly chore that is part of maintaining a grass lawn. The manual labor in mowing a lawn can exceed 40 hours per year [2]. People commonly incur weekly costs on mowing services to save time. Traditional gas powered mowers are physically demanding and use engines that need routine maintenance. They operate loudly enough that users should be wearing hearing protection and the noise …

Coordinated Autonomy Of Unmanned Aerial Vehicles (Uavs), Paribartan Dhakal

Honors Theses

Unmanned Aerial Vehicles (UAVs) are being extensively used in diverse sectors of the society for various tasks ranging from videography to an extremely sensitive situation such as first responders helping during a disaster. It has been seen that if a fleet of UAVs is deployed, they can perform a task quicker and more efficiently than a single UAV. With an increase in the number of UAVs, a problem arises of handling them with proper control structures. It has been studied that the Behavior Trees (BT) can be a better control architecture to handle the autonomous vehicles, as BTs are more …

Functional Object-Oriented Network: A Knowledge Representation For Service Robotics, David Andrés Paulius Ramos

USF Tampa Graduate Theses and Dissertations

In this dissertation, we discuss our work behind the development of the functional object-oriented network (abbreviated as FOON), a graphical knowledge representation for robotic manipulation and understanding of its own actions and (potentially) the intentions of humans in the household. Based on the theory of affordance, this representation captures manipulations and their effects on actions through the coupling of object and motion nodes as fundamental learning units known as functional units. The activities currently represented in FOON are cooking related, but this representation can be extended to other activities that involve manipulation of objects which result in observable changes of …

Design Of Delro Autonomous Delivery Robot And Ai Based Localization, Tolga Karakurt

USF Tampa Graduate Theses and Dissertations

Autonomous robots are employed in numerous areas. In this thesis, it is proposed to design and build a self-controlled wheeled vehicle to deliver food.

As there are many applications of an autonomous agent for indoor and outdoor environments, this study is conducted on indoor settings whereas all the requirements and design processes are achieved for both operational boundaries.

The fundamental approach is to design and implement a Wheeled Mobile Robot (WMR), and to test skid-steering performance on proposed trajectories using a System Engineering approach. From this point of view, system requirements in mechanical, electrical, and software are evaluated, and overall …

The Design And Development Of A Wrist-Hand Orthosis, Amber Gatto

USF Tampa Graduate Theses and Dissertations

Individuals with an incomplete C5-C7 spinal cord injury (SCI) lose grasping abilities but wrist function is almost universally retained. Most rehabilitation techniques apply the tenodesis effect, however, current tenodesis wrist-hand orthoses (WHOs) engage only the thumb and index finger, meaning that only 20% of activities of daily living (ADLs) can be completed.

This study tested the feasibility of a student-designed powered WHO by testing the device on healthy subjects to see if they could complete a variety of ADLs. A simulation software was then used to analyze wrist, thumb, and index finger joint angles. Additionally, an Assistive Technology Survey was …

Decentralized, Noncooperative Multirobot Path Planning With Sample-Basedplanners, William Le

Master's Theses

In this thesis, the viability of decentralized, noncooperative multi-robot path planning algorithms is tested. Three algorithms based on the Batch Informed Trees (BIT*) algorithm are presented. The first of these algorithms combines Optimal Reciprocal Collision Avoidance (ORCA) with BIT*. The second of these algorithms uses BIT* to create a path which the robots then follow using an artificial potential field (APF) method. The final algorithm is a version of BIT* that supports replanning. While none of these algorithms take advantage of sharing information between the robots, the algorithms are able to guide the robots to their desired goals, with the …

Geometric State Observers For Autonomous Navigation Systems, Miaomiao Wang

Electronic Thesis and Dissertation Repository

The development of reliable state estimation algorithms for autonomous navigation systems is of great interest in the control and robotics communities. This thesis studies the state estimation problem for autonomous navigation systems. The first part of this thesis is devoted to the pose estimation on the Special Euclidean group $\SE(3)$. A generic globally exponentially stable hybrid estimation scheme for pose (orientation and position) and velocity-bias estimation on $\SE(3)\times \mathbb{R}^6$ is proposed. Moreover, an explicit hybrid observer, using inertial and landmark position measurements, is provided.

The second part of this thesis is devoted to the problem of simultaneous estimation of the …

Development Of Iot Based Hybrid Autonomous Network Robots (Anr), Chimsom Isidore Chukwuemeka

Theses and Dissertations

The integration of wireless sensor networks (WSNs) and multirobot systems (MRS) represents an active research area supporting a wide range of applications. This is because it enables ubiquitous applications due to the robots' mobility and detection capabilities associated with its deployment. These systems have many benefits, such as perception with extended coverage that facilitate wider exploration and surveillance, efficiency in data routing, effective and reliable task environment management, etc. However, integrating two fields of research means dealing with a range of challenges such as using effective architecture for WSNs and MRS, efficient communication protocols within a network of sensors nodes …

Robótica Aplicada: Robot De Asistencia Para Personas Con Deficiencia Motriz, Juan David Guzmán Arias

Ingeniería en Automatización

Este documento quiere dar un enfoque amplio de la aplicabilidad que tiene la inteligencia artificial en la mayoría (por no decir todos) de sistemas automatizados y no automatizados, y de la eficacia de esta misma sobre los sistemas robóticos. Cuando se está implementando un tipo de programación a un robot, por sencilla que sea, en realidad ya se puede decir que se le está otorgando inteligencia artificial, y en cuanto mas completa y robusta es esta programación se puede decir que mas inteligente es el robot. Precisamente este es el perfil que se quiere mostrar en el documento, como implementando …

Herramienta Computacional Para La Simulación Y Programación De Un Manipulador Robótico Usando Fusión Sensorial Entre Un Sensor Inercial Y Un Kinect, Marco Hernan Castellanos Caicedo, Manuel Esteban Moreno Cardona

Ingeniería en Automatización

Debido al crecimiento tecnológico surge la necesidad de crear herramientas que faciliten el uso de nuevos paradigmas de programación para robots industriales, integrando sensórica especializada y ambientes virtuales de desarrollo; con el objetivo de dar continuación a la línea de investigación del grupo AVARC de programación por imitación de robots industriales, se construyó una plataforma virtual que permite la simulación de trayectorias en el espacio para el robot Yaskawa Motoman HP20D, esta utiliza un sensor inercial para captar la orientación y un Kinect para tomar la posición de la mano derecha de un usuario. En Unity 3D se construyó la …

Dual-Axis Solar Tracker, Bryan Kennedy

All Undergraduate Projects

Renewable energies, and fuels that are not fossil fuel-based, are one of the prolific topics of debate in modern society. With climate change now becoming a primary focus for scientists and innovators of today, one of the areas for the largest amount of potential and growth is that of the capturing and utilization of Solar Energy. This method involves using a mechanical system to track the progression of the sun as it traverses the sky throughout the day. A dual-axis solar tracker such as the one designed and built for this project, can follow the sun both azimuthally and in …

A Multi-Constraint Predictive Control System With Auxiliary Emergency Controllerfor Autonomous Vehicles, Farhad Partovi Ebrahimpour

Graduate Research Theses & Dissertations

In the last few years, several research groups and companies have worked on developing autonomous vehicles. Among the first automation layers, the safety layer plays a significant role in this field. However, considering safety should not diminish the importance of the efficiency of the vehicle in terms of path tracking with the desired speed. This thesis introduces a multi-constraint predictive control algorithm along with a safety layer to guarantee object avoidance in emergency situations. First, there is a quick review of autonomous cars and their functionalities. In the following, a controller switching mechanism is proposed and designed. It switches the …

Xylo-Bot: A Therapeutic Robot-Based Music Platform For Children With Autism, Huanghao Feng

Electronic Theses and Dissertations

Children with Autism Spectrum Disorder (ASD) experience deficits in verbal and nonverbal communication skills, including motor control, emotional facial expressions, and eye gaze / joint attention. This Ph.D. dissertation focuses on studying the feasibility and effectiveness of using a social robot, called NAO, and a toy music instrument, xylophone, at modeling and improving the social responses and behaviors of children with ASD. In our investigation, we designed an autonomous social interactive music teaching system to fulfill this mission.

A novel modular robot-music teaching system consisting of three modules is presented. Module 1 provides an autonomous self-awareness positioning system for the …

Facial Action Unit Detection With Deep Convolutional Neural Networks, Siddhesh Padwal

Electronic Theses and Dissertations

The facial features are the most important tool to understand an individual's state of mind. Automated recognition of facial expressions and particularly Facial Action Units defined by Facial Action Coding System (FACS) is challenging research problem in the field of computer vision and machine learning. Researchers are working on deep learning algorithms to improve state of the art in the area. Automated recognition of facial action units has man applications ranging from developmental psychology to human robot interface design where companies are using this technology to improve their consumer devices (like unlocking phone) and for entertainment like FaceApp. Recent studies …