Robotics Commons^™

A Study Of Deep Reinforcement Learning In Autonomous Racing Using Deepracer Car, Mukesh Ghimire

Honors Theses

Reinforcement learning is thought to be a promising branch of machine learning that has the potential to help us develop an Artificial General Intelligence (AGI) machine. Among the machine learning algorithms, primarily, supervised, semi supervised, unsupervised and reinforcement learning, reinforcement learning is different in a sense that it explores the environment without prior knowledge, and determines the optimal action. This study attempts to understand the concept behind reinforcement learning, the mathematics behind it and see it in action by deploying the trained model in Amazon's DeepRacer car. DeepRacer, a 1/18^th scaled autonomous car, is the agent which is trained …

Path Planning With Deep Neural Networks, Paul Simmerling, Brendan Sayers, Paulo Alcantara Silva

Honors Scholar Theses

This report will cover the work and plans of the ECE 2107 Senior design team. The goal of the project is to design and build a fully autonomous self-driving car. This car will have a complete sensor suite including LIDAR, an IMU, a camera, and encoders. It will be based on a multi-level system where the highest level uses a neural network for advanced signal processing and analysis. The current state of the project is discussed as well as the final results. Project management and other constraints will be briefly investigated. This team is building a self driving car testbed …

Demo Abstract: Porting And Execution Of Anomalies Detection Models On Embedded Systems In Iot, Bharath Sudharsan, Pankesh Patel, Abdul Wahid, Muhammad Yahya, John G. Breslin, Muhammad Intizar Ali

Publications

In the Industry 4.0 era, Microcontrollers (MCUs) based tiny embedded sensor systems have become the sensing paradigm to interact with the physical world. In 2020, 25.6 billion MCUs were shipped, and over 250 billion MCUs are already operating in the wild. Such low-power, low-cost MCUs are being used as the brain to control diverse applications and soon will become the global digital nervous system. In an Industrial IoT setup, such tiny MCU-based embedded systems are equipped with anomaly detection models and mounted on production plant machines for monitoring the machine’s health/condition. These models process the machine’s health data (from temperature, …

Automated Bottling Station - Packaging System, Lauren Nicole Zinzilieta

Honors College Theses

This report focuses on the packaging system used at the end of the FESTO bottling station that is located in EP 2355. The system will be made up of an x-y 300 mm x 300 mm gantry system, an Arduino, two micro-stepping stepper drivers, and two 152.4 mm (6 in) single acting cylinders with a 3D printed bracket attached to both. The gantry system will be located at the end of the conveyor belt and will be programmed to pick up three bottles at a time and then will move a specified number of steps in both the x and …

Bibliometric Analysis On Hand Gesture Controlled Robot, Karthik Bankapur, Himmat Singh, Akshit Gupta, Hritik Mathur, Harikrishnan R, Shivali Amit Wagle

Library Philosophy and Practice (e-journal)

This paper discusses about the survey and bibliometric analysis of hand gesture-controlled robot using Scopus database in analyzing the research by area, influential authors, countries, institutions, and funding agencies. The 293 documents are extracted from the year 2016 till 6^th March 2021 from the database. Bibliometric analysis is the statistical analysis of the research published as articles, conference papers, and reviews, which helps in understanding the impact of publication in the research domain globally. The visualization analysis is done with open-source tools namely GPS Visualizer, Gephi, VOS viewer, and ScienceScape. The visualization aids in a quick and clear understanding …

Project Blipper, Peter Jacobs, Preston Delaware, Ryan Foster

Senior Design Project For Engineers

This project was sponsored by Clorox to design and create an automatic bottle-unscrambling system for possible implementation at their bottling plant in Chile. The objective was to use a robotic arm to unscramble bottles from an incoming conveyor belt and place them upright on an outbound conveyor belt. Throughout the research, design, and testing of solutions for this project, several design alternatives were found for each discipline, and will be presented to Clorox so that they can make an informed decision for how and if they want to move forward with implementation of this project.

The project was split into …

Owsnet: Towards Real-Time Offensive Words Spotting Network For Consumer Iot Devices, Bharath Sudharsan, Sweta Malik, Peter Corcoran, Pankesh Patel, John G. Breslin, Muhammad Intizar Ali

Publications

Every modern household owns at least a dozen of IoT devices like smart speakers, video doorbells, smartwatches, where most of them are equipped with a Keyword spotting(KWS) system-based digital voice assistant like Alexa. The state-of-the-art KWS systems require a large number of operations, higher computation, memory resources to show top performance. In this paper, in contrast to existing resource-demanding KWS systems, we propose a light-weight temporal convolution based KWS system named OWSNet, that can comfortably execute on a variety of IoT devices around us and can accurately spot multiple keywords in real-time without disturbing the device's routine functionalities.

When OWSNet …

Cognitive Digital Twins For Smart Manufacturing, Muhammad Intizar Ali, Pankesh Patel, John G. Breslin, Ramy Harik, Amit Sheth

Publications

Smart manufacturing or Industry 4.0, a trend initiated a decade ago, aims to revolutionize traditional manufacturing using technology-driven approaches. Modern digital technologies such as the Industrial Internet of Things (IIoT), Big Data Analytics, Augmented/Virtual Reality, and Artificial Intelligence (AI) are the key enablers of new smart manufacturing approaches. The digital twin is an emerging concept whereby a digital replica can be built of any physical object. Digital twins are becoming mainstream; many organizations have started to rely on digital twins to monitor, analyze, and simulate physical assets and processes. The current use of digital twins for smart manufacturing is largely …

Distance-Based Formation Control Using Decentralized Sensing With Infrared Photodiodes, Steven Williams

LSU Master's Theses

This study presents an onboard sensor system for determining the relative positions of mobile robots, which is used in decentralized distance-based formation controllers for multi-agent systems. This sensor system uses infrared photodiodes and LEDs; its effective use requires coordination between the emitting and detecting robots. A technique is introduced for calculating the relative positions based on photodiode readings, and an automated calibration system is designed for future maintenance. By measuring the relative positions of their neighbors, each robot is capable of running an onboard formation controller, which is independent of both a centralized controller and a global positioning-like system (e.g., …

On The Impact Of Gravity Compensation On Reinforcement Learning In Goal-Reaching Tasks For Robotic Manipulators, Jonathan Fugal, Hasan A. Poonawala, Jihye Bae

Electrical and Computer Engineering Faculty Publications

Advances in machine learning technologies in recent years have facilitated developments in autonomous robotic systems. Designing these autonomous systems typically requires manually specified models of the robotic system and world when using classical control-based strategies, or time consuming and computationally expensive data-driven training when using learning-based strategies. Combination of classical control and learning-based strategies may mitigate both requirements. However, the performance of the combined control system is not obvious given that there are two separate controllers. This paper focuses on one such combination, which uses gravity-compensation together with reinforcement learning (RL). We present a study of the effects of gravity …

Design, Manufacture, And Test Of A Hybrid Aerial-Ground Robotic Platform, William Garrett Willmon

Electronic Theses and Dissertations

A hybrid aerial-ground robotic platform allows for enhanced functionality combining most of the operational profiles of an aerial and ground vehicle with applications to intelligence, surveillance, reconnaissance (ISR), infrastructure inspection, emergency response, photography, etc. Motivated by this challenge, we designed, developed, and tested a prototype hybrid aerial-ground robotic vehicle capable of guidance, navigation, and control in the air and on the ground. The thesis focus is on the system design. As such, at first, we designed and analyzed the mechanical component to ensure durability. We then designed the electrical component to reduce overall weight and maximize battery life. We developed …

Integration Of Robotic And Electro-Pneumatic Systems Using Advanced Control And Communication Schemes, Chinmay Kondekar

Dissertations, Master's Theses and Master's Reports

Modern industrial automation systems are designed by interconnecting various subsystems which work together to perform a process. The thesis project aims to integrate fragmented subsystems into a flexible and reconfigurable system through advanced communication protocols and perform a process to demonstrate the effectiveness of interconnected systems.

The system consists of three six-axis robots, one electro-pneumatic robot, and two conveyors connected using EthernetIP communication and hardwired connections. The interconnected system works together to perform machining of a workpiece using advanced control methods of CAD to robot path generation, central control through a PLC, and process control through HMI.

Standardized programming blocks …

Open-Source Tig-Based Metal 3d-Printing, Shane Oberloier

Dissertations, Master's Theses and Master's Reports

Metal 3-D printing has been relegated to high-cost proprietary high-resolution systems and low-resolution low-cost metal inert gas (MIG) systems. In order to provide a path to high-resolution, low-cost, metal 3-D printing, this manuscript proposes a new open source metal 3-D printer design based around a low-cost tungsten inert gas (TIG) welder coupled to a commercial open source self replicating rapid prototyper. Optimal printing parameters for the machine are acquired using a novel computational intelligence software. TIG has many advantages over MIG, such as having a low heat input, clean beads, and the potential for both high-resolution prints as well as …

Light Loaded Automated Guided Vehicle, Marcus Radtka, Nazar Paramashchuk, Lawrence Shevock

Williams Honors College, Honors Research Projects

The objective of the locomotion system was to design and implement the mechanical, electrical, and software related functions to ensure the LLAGV had the capability of maneuvering its surroundings. The LLAGV’s motors were represented in an open loop transfer function to utilize RPM feedback and a compensator when needed. The modeled compensator helped control the LLAGV’s speed and acceleration, enabling further control of the LLAGV. The internal circuitry has the means to properly distributed power to all components and allowed the user to control the LLAGV to their desire. The application software within the LLAGV locomotion system (LLAGV-LS) had consideration …

Toward Intelligent Welding By Building Its Digital Twin, Qiyue Wang

Theses and Dissertations--Electrical and Computer Engineering

To meet the increasing requirements for production on individualization, efficiency and quality, traditional manufacturing processes are evolving to smart manufacturing with the support from the information technology advancements including cyber-physical systems (CPS), Internet of Things (IoT), big industrial data, and artificial intelligence (AI). The pre-requirement for integrating with these advanced information technologies is to digitalize manufacturing processes such that they can be analyzed, controlled, and interacted with other digitalized components. Digital twin is developed as a general framework to do that by building the digital replicas for the physical entities. This work takes welding manufacturing as the case study to …

Deep Learning Assisted Intelligent Visual And Vehicle Tracking Systems, Liang Xu

Theses and Dissertations

Sensor fusion and tracking is the ability to bring together measurements from multiple sensors of the current and past time to estimate the current state of a system. The resulting state estimate is more accurate compared with the direct sensor measurement because it balances between the state prediction based on the assumed motion model and the noisy sensor measurement. Systems can then use the information provided by the sensor fusion and tracking process to support more-intelligent actions and achieve autonomy in a system like an autonomous vehicle. In the past, widely used sensor data are structured, which can be directly …

Artificial Intelligence And Game Theory Controlled Autonomous Uav Swarms, Janusz Kusyk, M. Umit Uyar, Kelvin Ma, Eltan Samoylov, Ricardo Valdez, Joseph Plishka, Sagor E. Hoque, Giorgio Bertoli, Jefrey Boksiner

Publications and Research

Autonomous unmanned aerial vehicles (UAVs) operating as a swarm can be deployed in austere environments, where cyber electromagnetic activities often require speedy and dynamic adjustments to swarm operations. Use of central controllers, UAV synchronization mechanisms or pre-planned set of actions to control a swarm in such deployments would hinder its ability to deliver expected services. We introduce artificial intelligence and game theory based flight control algorithms to be run by each autonomous UAV to determine its actions in near real-time, while relying only on local spatial, temporal and electromagnetic (EM) information. Each UAV using our flight control algorithms positions itself …

Artificial Intelligence Towards Future Industrial Opportunities And Challenges, Gizealew Dagnaw

African Conference on Information Systems and Technology

The industry 4.0 will bring reflective changes to our society, including an important digital shift in the manufacturing sector. At present, several manufacturing firms are trying to adopt the practices of industry 4.0 throughout their supply chain. The Fourth Industrial Revolution and the artificial intelligence at its core are fundamentally changing the way we live, work and interact as citizens. The complexity of this transformation may look overwhelming and to many threatening. Recently, the dramatic growth of new generation information technologies has prompted several countries to seek new strategies for industrial revolution. The globalization and the competitiveness are forcing companies …

Lawn Buddy, Jayson Johnston, Andrew Brown, Jacob Maljian

Electrical Engineering

Grass lawns are a common hallmark of the American home. In 2019, a survey from the National Association of Landscape Professionals found that 81% of all Americans owned a lawn [1]. Mowing is a time consuming and costly chore that is part of maintaining a grass lawn. The manual labor in mowing a lawn can exceed 40 hours per year [2]. People commonly incur weekly costs on mowing services to save time. Traditional gas powered mowers are physically demanding and use engines that need routine maintenance. They operate loudly enough that users should be wearing hearing protection and the noise …

Reading Robot, Gillian Watts, Andrew Myers, Sabrinna Tan, Taylor Klein, Omeed Djassemi

General Engineering

Presently, there is an insufficient availability of human experts to assist students in reading competency and comprehension. Our team’s goal was to create an improved socially assistive robot for use by therapists, teachers, and parents to help children and adults develop reading skills while they do not have access to specialists. HAPI is a socially assistive robot that we created with the goal of helping students practice their reading comprehension skills. HAPI enables a student to improve their reading skills without an educator present, while enabling educators to review the student's performance remotely. Design constraints included: physical size, weight, duration …

Tech Comm Eagle Eye-Tracking Control System, Gabiella Lail, Robert Shaw, Hunter Smatla, Matthew Gary

Discovery Day - Prescott

Mobile eye-tracking systems provide usability research support as well as access to a wide range of robotics and technical communication research opportunities. Optical tracking systems are often prohibitively expensive and do not provide the mobility or flexibility needed for a variety of research application possibilities. Our team proposes building a simple mobile eye-tracking system to be used in-house at ERAU for heat-mapping, robotics, control systems, and various technical communication applications in a structured research environment. The mobile eyetracking system will become part of a larger research and hands-on technical communication usability lab and research center. The research team intends to …

Design Of Delro Autonomous Delivery Robot And Ai Based Localization, Tolga Karakurt

USF Tampa Graduate Theses and Dissertations

Autonomous robots are employed in numerous areas. In this thesis, it is proposed to design and build a self-controlled wheeled vehicle to deliver food.

As there are many applications of an autonomous agent for indoor and outdoor environments, this study is conducted on indoor settings whereas all the requirements and design processes are achieved for both operational boundaries.

The fundamental approach is to design and implement a Wheeled Mobile Robot (WMR), and to test skid-steering performance on proposed trajectories using a System Engineering approach. From this point of view, system requirements in mechanical, electrical, and software are evaluated, and overall …

Decentralized, Noncooperative Multirobot Path Planning With Sample-Basedplanners, William Le

Master's Theses

In this thesis, the viability of decentralized, noncooperative multi-robot path planning algorithms is tested. Three algorithms based on the Batch Informed Trees (BIT*) algorithm are presented. The first of these algorithms combines Optimal Reciprocal Collision Avoidance (ORCA) with BIT*. The second of these algorithms uses BIT* to create a path which the robots then follow using an artificial potential field (APF) method. The final algorithm is a version of BIT* that supports replanning. While none of these algorithms take advantage of sharing information between the robots, the algorithms are able to guide the robots to their desired goals, with the …

Techniques To Solve Decision-Making Problems, Dilnoz Tulkunovna Muhamediyeva, Bekmuratov Fayzievich Tulkun

Chemical Technology, Control and Management

Solving decision-making problems in poorly formalized systems only with the help of deterministic and probabilistic methods is insufficient. To do this, it is necessary to widely apply the methods of hybrid intelligent systems and, especially, the methods of “soft” calculations (SoftCalculation, SoftComputing) and the directions of ComputationalIntelligence — intelligent computing technologies that are emerging on this theoretical and methodological base. An immune - fuzzy algorithm for the synthesis of fuzzy inference systems (FIS) is proposed. A two-stage adaptive FIS synthesis algorithm is described. At the first stage, the initial fuzzy parameters are clustered in order to reduce the number of …

Dual-Axis Solar Tracker, Bryan Kennedy

All Undergraduate Projects

Renewable energies, and fuels that are not fossil fuel-based, are one of the prolific topics of debate in modern society. With climate change now becoming a primary focus for scientists and innovators of today, one of the areas for the largest amount of potential and growth is that of the capturing and utilization of Solar Energy. This method involves using a mechanical system to track the progression of the sun as it traverses the sky throughout the day. A dual-axis solar tracker such as the one designed and built for this project, can follow the sun both azimuthally and in …

Nyku: A Social Robot For Children With Autism Spectrum Disorders, Dan Stephan Stoianovici

Electronic Theses and Dissertations

The continued growth of Autism Spectrum Disorders (ASD) around the world has spurred a growth in new therapeutic methods to increase the positive outcomes of an ASD diagnosis. It has been agreed that the early detection and intervention of ASD disorders leads to greatly increased positive outcomes for individuals living with the disorders. Among these new therapeutic methods, Robot-Assisted Therapy (RAT) has become a hot area of study. Recent works have shown that high functioning ASD children have an affinity for interacting with robots versus humans. It is proposed that this is due to a less complex set of communication …

Adaptive Object Detection For Autonomous Vehicles, Christopher Wolfe

Graduate Research Theses & Dissertations

Autonomous vehicles are gradually entering our daily lives. The goal of fully autonomous commercially available vehicles is becoming closer to reality each day as the contributions from researchers and various institutions are being added to the overall body of knowledge. Object detection is a critical component of an autonomous or semi-autonomous vehicle and draws extensively on results from many fields such as image processing and statistics. In this thesis, we consider ideas from the study of real-time computing and control systems to present a novel method of real-time adaptive object detection. We present a conceptual framework of the method as …

A Multi-Constraint Predictive Control System With Auxiliary Emergency Controllerfor Autonomous Vehicles, Farhad Partovi Ebrahimpour

Graduate Research Theses & Dissertations

In the last few years, several research groups and companies have worked on developing autonomous vehicles. Among the first automation layers, the safety layer plays a significant role in this field. However, considering safety should not diminish the importance of the efficiency of the vehicle in terms of path tracking with the desired speed. This thesis introduces a multi-constraint predictive control algorithm along with a safety layer to guarantee object avoidance in emergency situations. First, there is a quick review of autonomous cars and their functionalities. In the following, a controller switching mechanism is proposed and designed. It switches the …

Tram System Automation For Environmental Spectroscopy And Vegetation Monitoring, Enrique Anguiano Chavez

Open Access Theses & Dissertations

Spectroscopy is the science of studying the interactions of matter and electromagnetic radiation (EMR). In particular, field spectroscopy takes place in a natural environment with a natural source of EMR. The paper presents progress towards the development and automation of a tram cart system. The new system in development collects high resolution, hyperspectral images and data from a spectrometer. Alternatives for a sensor cover mechanism to provide cover for the sensors mounted while the system is not operating are discussed, analyzing and comparing the benefits and disadvantages. An implementation for a charging station in an environment isolated from the electric …

Route Planning For Long-Term Robotics Missions, Christopher Alexander Arend Tatsch

Graduate Theses, Dissertations, and Problem Reports (ETD)

Many future robotic applications such as the operation in large uncertain environment depend on a more autonomous robot. The robotics long term autonomy presents challenges on how to plan and schedule goal locations across multiple days of mission duration. This is an NP-hard problem that is infeasible to solve for an optimal solution due to the large number of vertices to visit. In some cases the robot hardware constraints also adds the requirement to return to a charging station multiple times in a long term mission. The uncertainties in the robot model and environment require the robot planner to account …