Robotics Commons^™

Selection And Recognition Of Landmarks Using Terrain Spatiograms, Damian M. Lyons

Faculty Publications

A team of robots working to explore and map an area may need to share information about landmarks so as to register their local maps and to plan effective exploration strategies. In previous papers we have introduced a combined image and spatial representation for landmarks: terrain spatiograms. We have shown that for manually selected views, terrain spatiograms provide an effective, shared representation that allows for occlusion filtering and a combination of multiple views.

In this paper, we present a landmark saliency architecture (LSA) for automatically selecting candidate landmarks. Using a dataset of 21 outdoor stereo images generated by LSA, we …

Nonlinear Control Strategy For A Cost Effective Myoelectric Prosthetic Hand, Cristian Federico Pasluosta

Doctoral Dissertations

The loss of a limb tremendously impacts the life of the affected individual. In the past decades, researchers have been developing artificial limbs that may return some of the missing functions and cosmetics. However, the development of dexterous mechanisms capable of mimicking the function of the human hand is a complex venture. Even though myoelectric prostheses have advanced, several issues remain to be solved before an artificial limb may be comparable to its human counterpart. Moreover, the high cost of advanced limbs prevents their widespread use among the low-income population.

This dissertation presents a strategy for the low-level of control …

Design Of A Transtibial Prosthesis Utilizing Active And Passive Components In Conjunction With A Four-Bar Mechanism, Bryan Bergelin

Master's Theses (2009 -)

This thesis outlines the design and testing of a powered ankle prosthesis which utilizes a four-bar mechanism in conjunction with a spiral torsion spring and a servo motor that mimics non-amputee (normal) ankle moments during the stance phase of gait. Previous research has shown that this novel approach is feasible, but the proof-of-concept prototype was not designed to be able to be worn by an amputee due to size, strength and mobility limitations. The goal of this research was to redesign the transtibial prosthesis to fit the requirements of the targeted amputee population. A preliminary virtual prosthesis was designed using …

Reconode: Towards An Autonomous Multi-Robot Team Agent For Usar, Kang Li

Electronic Theses and Dissertations

Urban search and rescue (USAR) robots can benefit from small size as it facilitates movement in cramped quarters. Yet, small size limits actuator power, sensor payloads, computational capacity and battery life. We are alleviating these issues by developing the hardware and software infrastructure for high performance, heterogeneous, dynamically-reconfigurable miniature USAR robots, as well as a host of other relevant applications. In this thesis, a generic modular embedded system architecture based on the RecoNode multiprocessor is proposed, which consists of a set of hardware and software modules that can be configured to construct various types of robot systems for dynamic and …

Ultrasonic Shark-Tag Locator System For Iver2 Auv, Nathaniel Garcia

Computer Engineering

The purpose of this project is to develop a system for tracking an ultrasonic underwater transmitter that can be integrated into an IVER2 AUV to allow it to follow and monitor tagged sharks in the ocean for scientific research.

The system consists of a four main components including a shark-tag, two hydrophones, a filter/amplifier & threshold detector circuit, and a microcontroller.

This project, while not completing field testing and integration with the IVER2, is a proof of concept of a system that utilizes passive sonar to determine a bearing from the system to a shark-tag transmitter. Additionally, it devised several …

Multiple Robot Boundary Tracking With Phase And Workload Balancing, Michael Jay Boardman

Master's Theses

This thesis discusses the use of a cooperative multiple robot system as applied to distributed tracking and sampling of a boundary edge. Within this system the boundary edge is partitioned into subsegments, each allocated to a particular robot such that workload is balanced across the robots. Also, to minimize the time between sampling local areas of the boundary edge, it is desirable to minimize the difference between each robot’s progression (i.e. phase) along its allocated sub segment of the edge. The paper introduces a new distributed controller that handles both workload and phase balancing. Simulation results are used to illustrate …

Monocular Vision And Image Correlation To Accomplish Autonomous Localization, Matthew Paul Schlachtman

Master's Theses

For autonomous navigation, robots and vehicles must have accurate estimates of their current state (i.e. location and orientation) within an inertial coordinate frame. If a map is given a priori, the process of determining this state is known as localization. When operating in the outdoors, localization is often assumed to be a solved problem when GPS measurements are available. However, in urban canyons and other areas where GPS accuracy is decreased, additional techniques with other sensors and filtering are required.

This thesis aims to provide one such technique based on monocular vision. First, the system requires a map be generated, …

Application Of Structured Light Imaging For High Resolution Mapping Of Underwater Archaeological Sites, Chris Roman, Gabrielle Inglis, James Rutter

Graduate School of Oceanography Faculty Publications

This paper presents results from recent work using structured light laser profile imaging to create high resolution bathymetric maps of underwater archaeological sites. Documenting the texture and structure of submerged sites is a difficult task and many applicable acoustic and photographic mapping techniques have recently emerged. This effort was completed to evaluate laser profile imaging in comparison to stereo imaging and high frequency multibeam mapping. A ROV mounted camera and inclined 532 nm sheet laser were used to create profiles of the bottom that were then merged into maps using platform navigation data. These initial results show very promising resolution …

Detection And Filtering Of Landmark Occlusions Using Terrain Spatiograms, Damian M. Lyons

Faculty Publications

A team of robots cooperating to quickly produce a map needs to share landmark information between members so that the local maps can be accurately merged. However, the appearance of landmarks as seen by members of the team can change dramatically due to the phenomenon of occlusion.

We have previously presented an approach to landmark representation using Terrain Spatiograms – an extension to image spatiograms in which the spatial information relates to the scene rather than the image. Because this representation preserves depth structure, it is possible to identify and filter potential occlusions.

We present an approach to identifying and …

A Visual Imagination Approach To Cognitive Robotics, Damian M. Lyons, Sirhan Chaudhry, D. Paul Benjamin

Faculty Publications

No abstract provided.

Cooperative Remote Sensing And Actuation Using Networked Unmanned Vehicles, Haiyang Chao

All Graduate Theses and Dissertations, Spring 1920 to Summer 2023

This dissertation focuses on how to design and employ networked unmanned vehicles for remote sensing and distributed control purposes in the current information-rich world. The target scenarios are environmental or agricultural applications such as river/reservoir surveillance, wind profiling measurement, and monitoring/control of chemical leaks, etc. AggieAir, a small and low-cost unmanned aircraft system, is designed based on the remote sensing requirements from environmental monitoring missions. The state estimation problem and the advanced lateral flight controller design problem are further attacked focusing on the small unmanned aerial vehicle (UAV) platform. Then the UAV-based remote sensing problem is focused with further flight …

Decentralized Coordination Of Multiple Autonomous Vehicles, Yongcan Cao

All Graduate Theses and Dissertations, Spring 1920 to Summer 2023

This dissertation focuses on the study of decentralized coordination algorithms of multiple autonomous vehicles. Here, the term decentralized coordination is used to refer to the behavior that a group of vehicles reaches the desired group behavior via local interaction. Research is conducted towards designing and analyzing distributed coordination algorithms to achieve desired group behavior in the presence of none, one, and multiple group reference states.

Decentralized coordination in the absence of any group reference state is a very active research topic in the systems and controls society. We first focus on studying decentralized coordination problems for both single-integrator kinematics and …

A Computer Vision Application To Accurately Estimate Object Distance, Kayton B. Parekh

Mathematics, Statistics, and Computer Science Honors Projects

Scientists have been working to create robots that perform manual work for years. However, creating machines that can navigate themselves and respond to their environment has proven to be difficult. One integral task to such research is to estimate the position of objects in the robot's visual field.

In this project we examine an implementation of computer vision depth perception. Our application uses color-based object tracking combined with model-based pose estimation to estimate the depth of specific objects in the view of our Pioneer 2 and Power Wheels robots. We use the Camshift algorithm for color-based object tracking, which uses …

Integrating Perception And Problem Solving To Predict Complex Object Behaviors, Damian M. Lyons, Sirhan Chaudhry, Marius Agica, John Vincent Monaco

Faculty Publications

One of the objectives of Cognitive Robotics is to construct robot systems that can be directed to achieve realworld goals by high-level directions rather than complex, low-level robot programming. Such a system must have the ability to represent, problem-solve and learn about its environment as well as communicate with other agents. In previous work, we have proposed ADAPT, a Cognitive Architecture that views perception as top-down and goaloriented and part of the problem solving process.

Our approach is linked to a SOAR-based problem-solving and learning framework. In this paper, we present an architecture for the perceptive and world modelling components …

Developing An Effective And Efficient Real Time Strategy Agent For Use As A Computer Generated Force, Kurt Weissgerber

Theses and Dissertations

Computer Generated Forces (CGF) are used to represent units or individuals in military training and constructive simulation. The use of CGF significantly reduces the time and money required for effective training. For CGF to be effective, they must behave as a human would in the same environment. Real Time Strategy (RTS) games place players in control of a large force whose goal is to defeat the opponent. The military setting of RTS games makes them an excellent platform for the development and testing of CGF. While there has been significant research in RTS agent development, most of the developed agents …

Thermal Robotic Arm Controlled Spraying Via Robotic Arm And Vision System, Dermot Breen

Doctoral

The Tribology Surface Engineering industry is a worldwide multi billion euro industry with significant health and safety risks. The thermal spraying sector of this industry employs the technique of applying molten surface coating material to a substrate via a thermal spray process which is implemented either by manual spraying or pre-programmed robotic systems. The development of autonomous robotic systems for thermal spraying surface coating would significantly improve production and profitability over pre-programmed systems and improve health and safety over manual spraying. The aim of this research was to investigate and develop through software simulation, physical modelling and testing the development …

Detection And Filtering Of Landmark Occlusions Using Terrain Spatiograms, Damian M. Lyons

Posters

A team of robots cooperating to quickly produce a map needs to share landmark information between team members so that the local maps can be accurately merged. However, a landmark visible to one robot may be partially occluded to another! Terrain Spatiograms are a landmark representation in which the image spatial information relates to the scene rather than the image. This makes it possible to identify and filter potential landmark occlusions. We present an approach to identifying and filtering occlusions using Terrain Spatiograms, and we report experimental results on 20 landmark datasets for varying states of occlusion. We show that …

Synchronizing Real And Predicted Synthetic Video Imagery For Localization Of A Robot To A 3d Environment, Damian M. Lyons, Sirhan Chaudhry, D. Paul Benjamin

Faculty Publications

A mobile robot moving in an environment in which there are other moving objects and active agents, some of which may represent threats and some of which may represent collaborators, needs to be able to reason about the potential future behaviors of those objects and agents. In previous work, we presented an approach to tracking targets with complex behavior, leveraging a 3D simulation engine to generate predicted imagery and comparing that against real imagery. We introduced an approach to compare real and simulated imagery using an affine image transformation that maps the real scene to the synthetic scene in a …

Wired For War: The Robotics Revolution And Conflict In The Twenty-First Century, Frank Rosenblatt

Journal Articles

Pity the librarian who receives a copy of P.W. Singer's Wired for War and must decide where to put it. Since the book wrestles with the changing nature of warfare, it could fit in with other books on war and military affairs. It may also belong in the science fiction section, since it is largely a tribute to the vision of science fiction writers such as Isaac Asimov. Perhaps Wired for War should go alongside works by other futurist thinkers such as George Orwell and Freeman Dyson. Is it really an ethics book? A science text? Strong arguments could be …

E-Quality: Using Dimensional Index Values Towards Improving Classification Accuracy, Prashanth Devaram

Open Access Theses & Dissertations

E-quality is a process through which inspection of the process and quality of the part produced is done online resulting in the improvement of the process and reduction in the amount of time consumed for the overall process. Automated quality control involves using a methodology to classify the parts based on the dimensions of the features on a part. However, achieving 100% classification accuracy is not an easy task, especially in area of quality control where small differences in dimensions result in part fall into a different category. In this study, a novel approach for modifying the data before being …

Robotic Goal-Based Semi-Autonomous Algorithms Improve Remote Operator Performance, Shawn Hunt

Wayne State University Dissertations

The focus of this research was to determine if reliable goal-based semi-autonomous algorithms are able to improve remote operator performance or not. Two semi-autonomous algorithms were examined: visual servoing and visual dead reckoning. Visual servoing uses computer vision techniques to generate movement commands while using internal properties of the camera combined with sensor data that tell the robot its current position based on its previous position. This research shows that the semi-autonomous algorithms developed increased performance in a measurable way. An analysis of tracking algorithms for visual servoing was conducted and tracking algorithms were enhanced to make them as robust …

Augmented Reality Navigation Interfaces Improve Human Performance In End-Effector Controlled Telerobotics, Keshav Chintamani

Wayne State University Dissertations

On the International Space Station (ISS) and space shuttles, the National Aeronautics and Space Administration (NASA) has used robotic manipulators extensively to perform payload handling and maintenance tasks. Teleoperating robots require expert skills and optimal performance is crucial to mission completion and crew safety. Degradation in performance is observed when manual control is mediated through remote camera views, resulting in poor end-effector navigation quality and extended task completion times. This thesis explores the application of three-dimensional augmented reality (AR) interfaces specifically designed to improve human performance during end-effector controlled teleoperations. A modular telerobotic test bed was developed for this purpose …

Sharing Landmark Information Using Mixture Of Gaussian Terrain Spatiograms, Damian M. Lyons

Faculty Publications

In this paper we evaluate the use of a novel spatial histogram called the terrain spatiogram as a common representation for exchanging landmark information between robots working as a team to map an area. Individual robots use range sensors to provide the spatial dimension of the spatiogram and video for the image dimension. We have previously shown that terrain spatiograms can be shared between robots in a heterogeneous team to recognize landmarks and to fuse observations from multiple sensors or multiple platforms. A terrain spatiogram using a mixture of Gaussians (MOG) model is introduced and a corresponding normalized spatiogram similarity …

Combining Multiple Scoring Systems For Target Tracking Using Rank-Score Characteristics, Damian M. Lyons, D. Frank Hsu

Faculty Publications

Video target tracking is the process of estimating the current state, and predicting the future state of a target from a sequence of video sensor measurements. Multitarget video tracking is complicated by the fact that targets can occlude one another, affecting video feature measurements in a highly non-linear and difficult to model fashion. In this paper, we apply a multisensory fusion approach to the problem of multitarget video tracking with occlusion. The approach is based on a data-driven method (CFA) to selecting the features and fusion operations that improve a performance criterion. Each sensory cue is treated as a scoring …

Towards Supervised Autonomous Task Completion Using An In Vivo Surgical Robot, Jason J. Dumpert

Department of Mechanical and Materials Engineering: Dissertations, Theses, and Student Research

Laparoscopy is a minimally invasive alternative to traditional abdominal surgery. Unlike traditional surgery, a laparoscopic procedure can be completed using small incisions. The use of these small incision results in reduced pain to the patient, shorter recovery times, and less trauma to skin, muscle and other tissues. However, these benefits to the patient are offset by the increased difficulty to the surgeon performing the procedure. These difficulties include reduced dexterity, reduced perception, and longer procedure times. The use of small in vivo robotic devices in minimally invasive surgery is one possible solution to these problems. The movement of these devices …

Electronic Image Stabilization For Mobile Robotic Vision Systems, Michael John Smith

Theses and Dissertations

When a camera is affixed on a dynamic mobile robot, image stabilization is the first step towards more complex analysis on the video feed. This thesis presents a novel electronic image stabilization (EIS) algorithm for small inexpensive highly dynamic mobile robotic platforms with onboard camera systems. The algorithm combines optical flow motion parameter estimation with angular rate data provided by a strapdown inertial measurement unit (IMU). A discrete Kalman filter in feedforward configuration is used for optimal fusion of the two data sources. Performance evaluations are conducted by a simulated video truth model (capturing the effects of image translation, rotation, …

Lyapunov-Based Coordinated Control Of An Underactuated Unmanned Aerial Vehicle And Robot Manipulator, Dongbin Lee

All Dissertations

This Ph.D. dissertation describes nonlinear tracking control results for a quadrotor helicopter unmanned aerial vehicle (UAV) towards the ultimate goal of controlling a combined UAV plus robot manipulator system (UAVRM). The quadrotor UAV is a helicopter that has four independent rotors that provide vertical lift: these four independent forces are managed in order to directly provide lift, pitch, roll, and yaw of the vehicle. Horizontal translations result from pitch and roll actions, the system is underactuated in the sense that there are only four control inputs to move the six degree-of-freedom aircraft. There are exising dynamic models of the quadrotor …

Design, Construction, And Testing Of A New Class Of Mobile Robots, Ivan Siles

All Theses

This thesis introduces a novel mobile robot design concept aimed at exploration of subterranean spaces. The key innovation is the combination of highly maneuverable body elements with wheel/leg elements (Whegs). This combination offers performance not possible with conventional 'monolithic' wheeled or tracked mobile robots, or with current robot snakes. The thesis covers four design iterations of the concept, concentrating on describing the overall design process and results from field tests. Additionally a kinematic analysis of the fourth prototype and implications for future designs is presented.

Implementation Of Robot Arm Networks And Experimental Analysis Of Consensus-Based Collective Motion, Daniel Scott Stuart

All Graduate Theses and Dissertations, Spring 1920 to Summer 2023

Within the field of multi-robot control, there is a large focus in research involving consensus. In this thesis two parts will be studied. The first development of this thesis is a consensus-based robot arm platform. To implement, two robotic arms are developed and studied. The most effective robot arm is then utilized to create a robot arm network testbed. Consensus is used to coordinate several robot arms and decentralize system computation. The research explores a platform to facilitate consensus on a group of robotic arms.

The second development is in Cartesian coordinate collective motion. This collective motion control combines consensus …

Development Of A New Lagrangian Float For Studying Coastal Marine Ecosystems, Alex Schwithal, Chris Roman

Graduate School of Oceanography Faculty Publications

This paper presents an overview and initial testing results for a shallow water Lagrangian float designed to operate in coastal settings. The presented effort addresses the two main characteristics of the shallow coastal environment that preclude the direct of use of many successfully deep water floats, namely the higher variation of water densities near the coast compared with the open ocean and the highly varied bathymetry. Our idea is to develop a high capacity dynamic auto-ballasting system that is able to compensate for the expected seawater density variation over a broad range of water temperatures and salinities while using measurements …