Engineering Commons^™

Hand Motion Tracking System Using Inertial Measurement Units And Infrared Cameras, Nonnarit O-Larnnithipong

FIU Electronic Theses and Dissertations

This dissertation presents a novel approach to develop a system for real-time tracking of the position and orientation of the human hand in three-dimensional space, using MEMS inertial measurement units (IMUs) and infrared cameras. This research focuses on the study and implementation of an algorithm to correct the gyroscope drift, which is a major problem in orientation tracking using commercial-grade IMUs. An algorithm to improve the orientation estimation is proposed. It consists of: 1.) Prediction of the bias offset error while the sensor is static, 2.) Estimation of a quaternion orientation from the unbiased angular velocity, 3.) Correction of the …

Multi-Robot Coordination And Scheduling For Deactivation & Decommissioning, Sebastian A. Zanlongo

FIU Electronic Theses and Dissertations

Large quantities of high-level radioactive waste were generated during WWII. This waste is being stored in facilities such as double-shell tanks in Washington, and the Waste Isolation Pilot Plant in New Mexico. Due to the dangerous nature of radioactive waste, these facilities must undergo periodic inspections to ensure that leaks are detected quickly. In this work, we provide a set of methodologies to aid in the monitoring and inspection of these hazardous facilities. This allows inspection of dangerous regions without a human operator, and for the inspection of locations where a person would not be physically able to enter.

First, …

A Dexterous, Glove-Based Teleoperable Low-Power Soft Robotic Arm For Delicate Deep-Sea Biological Exploration, Brennan T. Phillips, Kaitlyn P. Becker, Shunichi Kurumaya, Kevin C. Galloway, Griffin Whittredge, Daniel M. Vogt, Clark B. Teeple, Michelle H. Rosen, Vincent A. Pieribone, David F. Gruber, Robert J. Wood

Publications and Research

Modern marine biologists seeking to study or interact with deep-sea organisms are confronted with few options beyond industrial robotic arms, claws, and suction samplers. This limits biological interactions to a subset of “rugged” and mostly immotile fauna. As the deep sea is one of the most biologically diverse and least studied ecosystems on the planet, there is much room for innovation in facilitating delicate interactions with a multitude of organisms. The biodiversity and physiology of shallow marine systems, such as coral reefs, are common study targets due to the easier nature of access; SCUBA diving allows for in situ delicate …

Exploring The Effect Of Different Numbers Of Convolutional Filters And Training Loops On The Performance Of Alphazero, Jared Prince

Masters Theses & Specialist Projects

In this work, the algorithm used by AlphaZero is adapted for dots and boxes, a two-player game. This algorithm is explored using different numbers of convolutional filters and training loops, in order to better understand the effect these parameters have on the learning of the player. Different board sizes are also tested to compare these parameters in relation to game complexity. AlphaZero originated as a Go player using an algorithm which combines Monte Carlo tree search and convolutional neural networks. This novel approach, integrating a reinforcement learning method previously applied to Go (MCTS) with a supervised learning method (neural networks) …

Deep Rc: Enabling Remote Control Through Deep Learning, Jaron Ellingson, Gary Ellingson, Tim Mclain

Student Works

Human remote-control (RC) pilots have the ability to perceive the position and orientation of an aircraft using only third-person-perspective visual sensing. While novice pilots often struggle when learning to control RC aircraft, they can sense the orientation of the aircraft with relative ease. In this paper, we hypothesize and demonstrate that deep learning methods can be used to mimic the human ability to perceive the orientation of an aircraft from monocular imagery.

This work uses a neural network to directly sense the aircraft attitude. The network is combined with more conventional image processing methods for visual tracking of the aircraft. …

A Hands-On Robotics Concentration Curricula In Engineering Technology Programs, Andy S. Zhang, Angran Xiao, Yu Wang, Farrukh Zia, Muhammad Ummy

Publications and Research

This paper discusses the creation of a robotic concentration with four courses to meet the industry demands for qualified graduates in product design and services. Advances in computer technology and electronics have created a new field called mechatronics. Nowadays almost all high tech products are mechatronics in nature. Products such as automotive subsystems (such as anti-lock braking systems and automatic steering systems), medical devices, environmental monitoring systems, service and surgical robots are all mechatronic products. The robotic concentration focus on one of the most popular and visible area of mechatronics: robotics. The creation of the four courses: Embedded Systems Fundamentals, …

Prototype Of A Fish Inspired Swimming Silk Robot, Cassandra M. Donatelli, Sarah A. Bradner, Juanita Mathews, Erin Sanders, Casey R. Culligan, David Kaplan, Eric D. Tytell

Engineering Faculty Articles and Research

Elongate fishes have evolved hundreds of times throughout the tree of life. They occupy many aquatic environments, from streams and ponds to the deepest parts of the ocean. Due to their long body and numerous vertebrae, they are also highly flexible animals, which makes them useful as bioinspiration for designs in the field of soft robotics. We present a biodegradable soft robot prototype, inspired by elongate fishes. The robot's body is primarily composed of a silk hydrogel with embedded fibers to mimic the structure of natural fish skin. When actuated at the front, the flexible gel prototype mimics the undulatory …

Surgical And Medical Applications Of Drones: A Comprehensive Review, Brent Terwilliger, James C. Rosser Jr., Vudatha Vignesh, Brett C. Parker

Publications

Drones have the ability to gather real time data cost effectively, to deliver payloads and have initiated the rapid evolution of many industrial, commercial, and recreational applications. Unfortunately, there has been a slower expansion in the field of medicine. This article provides a comprehensive review of current and future drone applications in medicine, in hopes of empowering and inspiring more aggressive investigation.

A Neuromorphic Quadratic, Integrate, And Fire Silicon Neuron With Adaptive Gain, David Parent, Eric Basham

Faculty Publications

An integrated circuit implementation of a silicon neuron was designed, manufactured, and tested. The circuit was designed using the Quadratic, Integrate, and Fire (QIF) neuron model in 0.5 µm silicon technology. The neuron implementation was optimized for low current consumption, drawing only 1.56 mA per QIF circuit and utilized hysteretic reset, non-inverting integrator, and voltage-squarer circuits. The final area of each circuit in silicon was 268 µm height × 400 µm width. This design is the first IC of its kind for this neuron model and is successfully able to output true spiking that follows the behaviors of bistability, monotonic, …

An Exploration Of Software Defined Radio And Gnu Radio Companion For Use In Drone-To-Drone Communication, Amanda K. H. Voegtlin

Undergraduate Research & Mentoring Program

In a world that increasingly relies on automation and intelligent robotics, there is a need for drones to expand their independence and adaptability in navigating their environments. One approach to this problem is the use of wireless communication between units in order to coordinate their sensor data and build real-time maps of the environments they are navigating. However, especially indoors, relying on a fixed transmission tower to provide data to the units faces connectivity challenges.

The purpose of this research was to determine the fitness of an on-drone assembly that uses the the NI B200mini software-defined radio board and Gnu …

Real-Time Object Detection And Tracking On Drones, Tu Le

Undergraduate Research & Mentoring Program

Unmanned aerial vehicles, also known as drones, have been more and more widely used in recent decades because of their mobility. They appear in many applications such as farming, search and rescue, entertainment, military, and so on. Such high demands for drones lead to the need of developments in drone technologies. Next generations of commercial and military drones are expected to be aware of surrounding objects while flying autonomously in different terrains and conditions. One of the biggest challenges to drone automation is the ability to detect and track objects of interest in real-time. While there are many robust machine …

Optimizing The Use Of A Liquid Handling Robot To Conduct A High Throughput Forward Chemical Genetics Screen Of Arabidopsis Thaliana, B. Kirtley Amos, Victoria G. Pook, Seth Debolt

Horticulture Faculty Publications

Chemical genetics is increasingly being employed to decode traits in plants that may be recalcitrant to traditional genetics due to gene redundancy or lethality. However, the probability of a synthetic small molecule being bioactive is low; therefore, thousands of molecules must be tested in order to find those of interest. Liquid handling robotics systems are designed to handle large numbers of samples, increasing the speed with which a chemical library can be screened in addition to minimizing/standardizing error. To achieve a high-throughput forward chemical genetics screen of a library of 50,000 small molecules on Arabidopsis thaliana (Arabidopsis), protocols using a …

A Dynamical System Approach For Resource-Constrained Mobile Robotics, Tauhidul Alam

FIU Electronic Theses and Dissertations

The revolution of autonomous vehicles has led to the development of robots with abundant sensors, actuators with many degrees of freedom, high-performance computing capabilities, and high-speed communication devices. These robots use a large volume of information from sensors to solve diverse problems. However, this usually leads to a significant modeling burden as well as excessive cost and computational requirements. Furthermore, in some scenarios, sophisticated sensors may not work precisely, the real-time processing power of a robot may be inadequate, the communication among robots may be impeded by natural or adversarial conditions, or the actuation control in a robot may be …

Magic Triangle – Human, Exoskeleton, And Collaborative Robot Scenario, R. A. Goehlich, M. H. Rutsch, I. Krohne

Publications

The incidence of musculoskeletal disorders in workplaces with difficult ergonomic conditions is increasing. Today, there is a growing market for technical support systems that avoid repetitive strain on the musculoskeletal system. We have been observing two (parallel) lines of development: on the one hand, the development of exoskeletons supporting shop floor operators and, on the other hand, the development of collaborative robots for the creation of hybrid teams. The focus of our research is the combined application of exoskeletons AND collaborative robots for shop floor operators in the aerospace industry. Our approach is to analyze various scenarios to understand which …

A Pilot Study On Facial Expression Recognition Ability Of Autistic Children Using Ryan, A Rear-Projected Humanoid Robot, Farzaneh Askari, Huanghao Feng, Timothy D. Sweeny, Mohammad H. Mahoor

Electrical and Computer Engineering: Graduate Student Scholarship

Rear-projected robots use computer graphics technology to create facial animations and project them on a mask to show the robot’s facial cues and expressions. These types of robots are becoming commercially available, though more research is required to understand how they can be effectively used as a socially assistive robotic agent. This paper presents the results of a pilot study on comparing the facial expression recognition abilities of children with Autism Spectrum Disorder (ASD) with typically developing (TD) children using a rear-projected humanoid robot called Ryan. Six children with ASD and six TD children participated in this research, where Ryan …

How Children With Autism Spectrum Disorder Recognize Facial Expressions Displayed By A Rear-Projection Humanoid Robot, Farzaneh Askari, Huanghao Feng, Anibal Gutierrez, Timothy Sweeny, Mohammad H. Mahoor

Electrical and Computer Engineering: Graduate Student Scholarship

Background: Children with Autism Spectrum Disorder (ASD) experience reduced ability to perceive crucial nonverbal communication cues such as eye gaze, gestures, and facial expressions. Recent studies suggest that social robots can be used as effective tools to improve communication and social skills in children with ASD. One explanation has been put forward by several studies that children with ASD feel more contented and motivated in systemized and predictable environment, like interacting with robots.

Objectives: There have been few research studies evaluating how children with ASD perceive facial expression in humanoid robots but no research evaluating facial expression perception …

Review Of Deep Learning Methods In Robotic Grasp Detection, Shehan Caldera, Alexander Rassau, Douglas Chai

Research outputs 2014 to 2021

For robots to attain more general-purpose utility, grasping is a necessary skill to master. Such general-purpose robots may use their perception abilities to visually identify grasps for a given object. A grasp describes how a robotic end-effector can be arranged to securely grab an object and successfully lift it without slippage. Traditionally, grasp detection requires expert human knowledge to analytically form the task-specific algorithm, but this is an arduous and time-consuming approach. During the last five years, deep learning methods have enabled significant advancements in robotic vision, natural language processing, and automated driving applications. The successful results of these methods …

The Rhetoric Of Science Education And Technology, Iwasan D. Kejawa

School of Computing: Faculty Publications

Nearly thousands of science experiments are performed both on humans and animals every year in the United States (Gregory, 1999). Does Science enormously play a role in the well-beings of individual in the society? Research has found that science education is through motivation and satisfying the needs of humans. The scientific world is part of an elongated human development. This can be substantiated with the use and evolution of TECHNOLOGY and SCIENCE (Minton, 2004). Education of the entities that comprise the need to achieve the goal of TECHNOLOGY and SCIENCE which are important issues of today. Research has shown that …

Internet Of Underground Things In Precision Agriculture: Architecture And Technology Aspects, Mehmet C. Vuran, Abdul Salam, Rigoberto Wong, Suat Irmak

School of Computing: Faculty Publications

The projected increases in World population and need for food have recently motivated adoption of information technology solutions in crop fields within precision agriculture approaches. Internet Of Underground Things (IOUT), which consists of sensors and communication devices, partly or completely buried underground for real-time soil sensing and monitoring, emerge from this need. This new paradigm facilitates seamless integration of underground sensors, machinery, and irrigation systems with the complex social network of growers, agronomists, crop consultants, and advisors. In this paper, state-of-the-art communication architectures are reviewed, and underlying sensing technology and communication mechanisms for IOUT are presented. Moreover, recent advances in …

Regulating Robo Advice Across The Financial Services Industry, Tom Baker, Benedict G. C. Dellaert

All Faculty Scholarship

Automated financial product advisors – “robo advisors” – are emerging across the financial services industry, helping consumers choose investments, banking products, and insurance policies. Robo advisors have the potential to lower the cost and increase the quality and transparency of financial advice for consumers. But they also pose significant new challenges for regulators who are accustomed to assessing human intermediaries. A well-designed robo advisor will be honest and competent, and it will recommend only suitable products. Because humans design and implement robo advisors, however, honesty, competence, and suitability cannot simply be assumed. Moreover, robo advisors pose new scale risks that …

Crop Height Estimation With Unmanned Aerial Vehicles, Carrick Detweiler, David Anthony, Sebastian Elbaum

School of Computing: Faculty Publications

An unmanned aerial vehicle (UAV) can be configured for crop height estimation. In some examples, the UAV includes an aerial propulsion system, a laser scanner configured to face downwards while the UAV is in flight, and a control system. The laser scanner is configured to scan through a two-dimensional scan angle and is characterized by a maxi mum range. The control system causes the UAV to fly over an agricultural field and maintain, using the aerial propulsion system and the laser scanner, a distance between the UAV and a top of crops in the agricultural field to within a programmed …

Application For Position And Load Reference Generation Of A Simulated Mechatronic Chain, Florentin Smarandache, V. Vladareanu, S.B. Cononovici, M. Migdalovici, H. Wang, Y. Feng

Branch Mathematics and Statistics Faculty and Staff Publications

The paper presents the position and load reference generation for a motor stand simulating a mechatronic chain, in this case a three degree of freedom robot leg. The task is accomplished using three PLC controlled motors in position as the robot joint actuators coupled with three controlled in torque, simulating the load at each simulation time-step. The paper briefly discusses the mathematical model and presents the visual interface used in the simulation, which is then to be further integrated into a virtual environment robot control application.

Humanoid Robots Supporting Children’S Learning In An Early Childhood Setting, Helen Crompton, Kristen Gregory, Diane Burke

Teaching & Learning Faculty Publications

This qualitative study explored the affordances provided by the integration of the NAO humanoid robot in three preschool classrooms. Using the Head Start Early Learning Outcomes Framework as a lens, the researchers qualitatively analyzed data from focus groups, observations, field notes and student artifacts, using grounded coding to uncover language and communication, physical, cognitive and social–emotional learning experiences for children. The researchers also examined interactions between the robot, children and teachers to identify successes and challenges experienced during the integration. Findings indicate the robot provided opportunities for student development in all learning domains. Students were intellectually curious about the robot; …