Computer Engineering Commons^™

A Visual Imagination Approach To Cognitive Robotics, Damian M. Lyons, Sirhan Chaudhry, D. Paul Benjamin

Faculty Publications

No abstract provided.

Cooperative Remote Sensing And Actuation Using Networked Unmanned Vehicles, Haiyang Chao

All Graduate Theses and Dissertations, Spring 1920 to Summer 2023

This dissertation focuses on how to design and employ networked unmanned vehicles for remote sensing and distributed control purposes in the current information-rich world. The target scenarios are environmental or agricultural applications such as river/reservoir surveillance, wind profiling measurement, and monitoring/control of chemical leaks, etc. AggieAir, a small and low-cost unmanned aircraft system, is designed based on the remote sensing requirements from environmental monitoring missions. The state estimation problem and the advanced lateral flight controller design problem are further attacked focusing on the small unmanned aerial vehicle (UAV) platform. Then the UAV-based remote sensing problem is focused with further flight …

Decentralized Coordination Of Multiple Autonomous Vehicles, Yongcan Cao

All Graduate Theses and Dissertations, Spring 1920 to Summer 2023

This dissertation focuses on the study of decentralized coordination algorithms of multiple autonomous vehicles. Here, the term decentralized coordination is used to refer to the behavior that a group of vehicles reaches the desired group behavior via local interaction. Research is conducted towards designing and analyzing distributed coordination algorithms to achieve desired group behavior in the presence of none, one, and multiple group reference states.

Decentralized coordination in the absence of any group reference state is a very active research topic in the systems and controls society. We first focus on studying decentralized coordination problems for both single-integrator kinematics and …

A Computer Vision Application To Accurately Estimate Object Distance, Kayton B. Parekh

Mathematics, Statistics, and Computer Science Honors Projects

Scientists have been working to create robots that perform manual work for years. However, creating machines that can navigate themselves and respond to their environment has proven to be difficult. One integral task to such research is to estimate the position of objects in the robot's visual field.

In this project we examine an implementation of computer vision depth perception. Our application uses color-based object tracking combined with model-based pose estimation to estimate the depth of specific objects in the view of our Pioneer 2 and Power Wheels robots. We use the Camshift algorithm for color-based object tracking, which uses …

Integrating Perception And Problem Solving To Predict Complex Object Behaviors, Damian M. Lyons, Sirhan Chaudhry, Marius Agica, John Vincent Monaco

Faculty Publications

One of the objectives of Cognitive Robotics is to construct robot systems that can be directed to achieve realworld goals by high-level directions rather than complex, low-level robot programming. Such a system must have the ability to represent, problem-solve and learn about its environment as well as communicate with other agents. In previous work, we have proposed ADAPT, a Cognitive Architecture that views perception as top-down and goaloriented and part of the problem solving process.

Our approach is linked to a SOAR-based problem-solving and learning framework. In this paper, we present an architecture for the perceptive and world modelling components …

Developing An Effective And Efficient Real Time Strategy Agent For Use As A Computer Generated Force, Kurt Weissgerber

Theses and Dissertations

Computer Generated Forces (CGF) are used to represent units or individuals in military training and constructive simulation. The use of CGF significantly reduces the time and money required for effective training. For CGF to be effective, they must behave as a human would in the same environment. Real Time Strategy (RTS) games place players in control of a large force whose goal is to defeat the opponent. The military setting of RTS games makes them an excellent platform for the development and testing of CGF. While there has been significant research in RTS agent development, most of the developed agents …

Thermal Robotic Arm Controlled Spraying Via Robotic Arm And Vision System, Dermot Breen

Doctoral

The Tribology Surface Engineering industry is a worldwide multi billion euro industry with significant health and safety risks. The thermal spraying sector of this industry employs the technique of applying molten surface coating material to a substrate via a thermal spray process which is implemented either by manual spraying or pre-programmed robotic systems. The development of autonomous robotic systems for thermal spraying surface coating would significantly improve production and profitability over pre-programmed systems and improve health and safety over manual spraying. The aim of this research was to investigate and develop through software simulation, physical modelling and testing the development …

Detection And Filtering Of Landmark Occlusions Using Terrain Spatiograms, Damian M. Lyons

Posters

A team of robots cooperating to quickly produce a map needs to share landmark information between team members so that the local maps can be accurately merged. However, a landmark visible to one robot may be partially occluded to another! Terrain Spatiograms are a landmark representation in which the image spatial information relates to the scene rather than the image. This makes it possible to identify and filter potential landmark occlusions. We present an approach to identifying and filtering occlusions using Terrain Spatiograms, and we report experimental results on 20 landmark datasets for varying states of occlusion. We show that …

Synchronizing Real And Predicted Synthetic Video Imagery For Localization Of A Robot To A 3d Environment, Damian M. Lyons, Sirhan Chaudhry, D. Paul Benjamin

Faculty Publications

A mobile robot moving in an environment in which there are other moving objects and active agents, some of which may represent threats and some of which may represent collaborators, needs to be able to reason about the potential future behaviors of those objects and agents. In previous work, we presented an approach to tracking targets with complex behavior, leveraging a 3D simulation engine to generate predicted imagery and comparing that against real imagery. We introduced an approach to compare real and simulated imagery using an affine image transformation that maps the real scene to the synthetic scene in a …

Wired For War: The Robotics Revolution And Conflict In The Twenty-First Century, Frank Rosenblatt

Journal Articles

Pity the librarian who receives a copy of P.W. Singer's Wired for War and must decide where to put it. Since the book wrestles with the changing nature of warfare, it could fit in with other books on war and military affairs. It may also belong in the science fiction section, since it is largely a tribute to the vision of science fiction writers such as Isaac Asimov. Perhaps Wired for War should go alongside works by other futurist thinkers such as George Orwell and Freeman Dyson. Is it really an ethics book? A science text? Strong arguments could be …

E-Quality: Using Dimensional Index Values Towards Improving Classification Accuracy, Prashanth Devaram

Open Access Theses & Dissertations

E-quality is a process through which inspection of the process and quality of the part produced is done online resulting in the improvement of the process and reduction in the amount of time consumed for the overall process. Automated quality control involves using a methodology to classify the parts based on the dimensions of the features on a part. However, achieving 100% classification accuracy is not an easy task, especially in area of quality control where small differences in dimensions result in part fall into a different category. In this study, a novel approach for modifying the data before being …

Robotic Goal-Based Semi-Autonomous Algorithms Improve Remote Operator Performance, Shawn Hunt

Wayne State University Dissertations

The focus of this research was to determine if reliable goal-based semi-autonomous algorithms are able to improve remote operator performance or not. Two semi-autonomous algorithms were examined: visual servoing and visual dead reckoning. Visual servoing uses computer vision techniques to generate movement commands while using internal properties of the camera combined with sensor data that tell the robot its current position based on its previous position. This research shows that the semi-autonomous algorithms developed increased performance in a measurable way. An analysis of tracking algorithms for visual servoing was conducted and tracking algorithms were enhanced to make them as robust …

Augmented Reality Navigation Interfaces Improve Human Performance In End-Effector Controlled Telerobotics, Keshav Chintamani

Wayne State University Dissertations

On the International Space Station (ISS) and space shuttles, the National Aeronautics and Space Administration (NASA) has used robotic manipulators extensively to perform payload handling and maintenance tasks. Teleoperating robots require expert skills and optimal performance is crucial to mission completion and crew safety. Degradation in performance is observed when manual control is mediated through remote camera views, resulting in poor end-effector navigation quality and extended task completion times. This thesis explores the application of three-dimensional augmented reality (AR) interfaces specifically designed to improve human performance during end-effector controlled teleoperations. A modular telerobotic test bed was developed for this purpose …

Sharing Landmark Information Using Mixture Of Gaussian Terrain Spatiograms, Damian M. Lyons

Faculty Publications

In this paper we evaluate the use of a novel spatial histogram called the terrain spatiogram as a common representation for exchanging landmark information between robots working as a team to map an area. Individual robots use range sensors to provide the spatial dimension of the spatiogram and video for the image dimension. We have previously shown that terrain spatiograms can be shared between robots in a heterogeneous team to recognize landmarks and to fuse observations from multiple sensors or multiple platforms. A terrain spatiogram using a mixture of Gaussians (MOG) model is introduced and a corresponding normalized spatiogram similarity …

Combining Multiple Scoring Systems For Target Tracking Using Rank-Score Characteristics, Damian M. Lyons, D. Frank Hsu

Faculty Publications

Video target tracking is the process of estimating the current state, and predicting the future state of a target from a sequence of video sensor measurements. Multitarget video tracking is complicated by the fact that targets can occlude one another, affecting video feature measurements in a highly non-linear and difficult to model fashion. In this paper, we apply a multisensory fusion approach to the problem of multitarget video tracking with occlusion. The approach is based on a data-driven method (CFA) to selecting the features and fusion operations that improve a performance criterion. Each sensory cue is treated as a scoring …

Towards Supervised Autonomous Task Completion Using An In Vivo Surgical Robot, Jason J. Dumpert

Department of Mechanical and Materials Engineering: Dissertations, Theses, and Student Research

Laparoscopy is a minimally invasive alternative to traditional abdominal surgery. Unlike traditional surgery, a laparoscopic procedure can be completed using small incisions. The use of these small incision results in reduced pain to the patient, shorter recovery times, and less trauma to skin, muscle and other tissues. However, these benefits to the patient are offset by the increased difficulty to the surgeon performing the procedure. These difficulties include reduced dexterity, reduced perception, and longer procedure times. The use of small in vivo robotic devices in minimally invasive surgery is one possible solution to these problems. The movement of these devices …

Electronic Image Stabilization For Mobile Robotic Vision Systems, Michael John Smith

Theses and Dissertations

When a camera is affixed on a dynamic mobile robot, image stabilization is the first step towards more complex analysis on the video feed. This thesis presents a novel electronic image stabilization (EIS) algorithm for small inexpensive highly dynamic mobile robotic platforms with onboard camera systems. The algorithm combines optical flow motion parameter estimation with angular rate data provided by a strapdown inertial measurement unit (IMU). A discrete Kalman filter in feedforward configuration is used for optimal fusion of the two data sources. Performance evaluations are conducted by a simulated video truth model (capturing the effects of image translation, rotation, …

Lyapunov-Based Coordinated Control Of An Underactuated Unmanned Aerial Vehicle And Robot Manipulator, Dongbin Lee

All Dissertations

This Ph.D. dissertation describes nonlinear tracking control results for a quadrotor helicopter unmanned aerial vehicle (UAV) towards the ultimate goal of controlling a combined UAV plus robot manipulator system (UAVRM). The quadrotor UAV is a helicopter that has four independent rotors that provide vertical lift: these four independent forces are managed in order to directly provide lift, pitch, roll, and yaw of the vehicle. Horizontal translations result from pitch and roll actions, the system is underactuated in the sense that there are only four control inputs to move the six degree-of-freedom aircraft. There are exising dynamic models of the quadrotor …

Design, Construction, And Testing Of A New Class Of Mobile Robots, Ivan Siles

All Theses

This thesis introduces a novel mobile robot design concept aimed at exploration of subterranean spaces. The key innovation is the combination of highly maneuverable body elements with wheel/leg elements (Whegs). This combination offers performance not possible with conventional 'monolithic' wheeled or tracked mobile robots, or with current robot snakes. The thesis covers four design iterations of the concept, concentrating on describing the overall design process and results from field tests. Additionally a kinematic analysis of the fourth prototype and implications for future designs is presented.

Development Of A New Lagrangian Float For Studying Coastal Marine Ecosystems, Alex Schwithal, Chris Roman

Graduate School of Oceanography Faculty Publications

This paper presents an overview and initial testing results for a shallow water Lagrangian float designed to operate in coastal settings. The presented effort addresses the two main characteristics of the shallow coastal environment that preclude the direct of use of many successfully deep water floats, namely the higher variation of water densities near the coast compared with the open ocean and the highly varied bathymetry. Our idea is to develop a high capacity dynamic auto-ballasting system that is able to compensate for the expected seawater density variation over a broad range of water temperatures and salinities while using measurements …

Implementation Of Robot Arm Networks And Experimental Analysis Of Consensus-Based Collective Motion, Daniel Scott Stuart

All Graduate Theses and Dissertations, Spring 1920 to Summer 2023

Within the field of multi-robot control, there is a large focus in research involving consensus. In this thesis two parts will be studied. The first development of this thesis is a consensus-based robot arm platform. To implement, two robotic arms are developed and studied. The most effective robot arm is then utilized to create a robot arm network testbed. Consensus is used to coordinate several robot arms and decentralize system computation. The research explores a platform to facilitate consensus on a group of robotic arms.

The second development is in Cartesian coordinate collective motion. This collective motion control combines consensus …

The 2005 Chios Ancient Shipwreck Survey: New Methods For Underwater Archaeology, Brendan P. Foley, Katerina Dellaporta, Dimitris Sakellariou, Brian S. Bingham, Richard Camilli, Ryan M. Eustice, Dionysis Evagelistis, Vicki Lynn Ferrini, Kostas Katsaros, Dimitris Kourkoumelis, Aggelos Mallios, Paraskevi Micha, David A. Mindell, Christopher Roman, Hanumant Singh, David S. Switzer, Theotokis Theodoulou

Graduate School of Oceanography Faculty Publications

In 2005 a Greek and American interdisciplinary team investigated two ship wrecks off the coast of Chios dating to the 4th-century B.C. and the 2nd/lst century. The project pioneered archaeological methods of precision acoustic, digital image, and chemical survey using an autonomous underwater vehicle (AUV) and in-situ sensors, increasing the speed of data acquisition while decreasing costs. The AUV recorded data revealing the physical dimensions, age, cargo, and preservation of the wrecks. The earlier wreck contained more than 350 amphoras, predominantly of Chian type, while the Hellenistic wreck contained about 40 Dressel 1C amphoras. Molecular biological analysis of two amphoras …

Unified Behavior Framework In An Embedded Robot Controller, Stephen S. Lin

Theses and Dissertations

Robots of varying autonomy have been used to take the place of humans in dangerous tasks. While robots are considered more expendable than human beings, they are complex to develop and expensive to replace if lost. Recent technological advances produce small, inexpensive hardware platforms that are powerful enough to match robots from just a few years ago. There are many types of autonomous control architecture that can be used to control these hardware platforms. One in particular, the Unified Behavior Framework, is a flexible, responsive control architecture that is designed to simplify the control system’s design process through behavior module …

Sharing And Fusing Landmark Information In A Team Of Autonomous Robots, Damian M. Lyons

Faculty Publications

A team of robots working to explore and map a space may need to share information about landmarks so as register local maps and to plan effective exploration strategies. In this paper we investigate the use of spatial histograms (spatiograms) as a common representation for exchanging landmark information between robots. Each robot can use sonar, stereo, laser and image information to identify potential landmarks. The sonar, laser and stereo information provide the spatial dimension of the spatiogram in a landmark-centered coordinate frame while video provides the image information. We call the result a terrain spatiogram. This representation can be shared …

Locating And Tracking Objects By Efficient Comparison Of Real And Predicted Synthetic Video Imagery, Damian M. Lyons, D. Paul Benjamin

Faculty Publications

A mobile robot moving in an environment in which there are other moving objects and active agents, some of which may represent threats and some of which may represent collaborators, needs to be able to reason about the potential future behaviors of those objects and agents. In this paper we present an approach to tracking targets with complex behavior, leveraging a 3D simulation engine to generate predicted imagery and comparing that against real imagery. We introduce an approach to compare real and simulated imagery and present results using this approach to locate and track objects with complex behaviors. In this …

Heterogeneous Drive Mechanisms For Novel Locomotion In Rough Terrain, Roy Godzdanker

Electronic Theses and Dissertations

The smaller the robot the easier it is for it to access voids in a collapsed structure, however small size brings a host of other problems related to constrained resources. One of the primary constraints on small robots is limited motive power to surmount obstacles and navigate rough terrain. This thesis examines the addition of bulk motive force actuators to existing locomotion platforms and the impact of these heterogeneous actuators on conventional steering methods. The steering methods examined are those associated with skid steered vehicles and differential drive vehicles. In developing the Crabinator, a robot composed of a limbed crawler …

The Development Of A Prototype Robotic Platform On Which Awareness Strategies Can Be Implemented, Sean Kinsella

Theses

This thesis describes the design and development of the hardware and software for a prototype robotic platform on which awareness strategies can be developed. The mobile prototype platform designed over the course of work is capable of operating as a distributed or centralised system.

There is no singular definition of awareness for a robotic system and the development of awareness strategies is complex and requires expertise in many scientific disciplines. This paper describes the different types of awareness associated with robotic systems and the technology required to implement this awareness. A review of sensors critical to the development of awareness …

Health Prognisis Of Electronics Via Power Profiling, Jonathan Amilcar Cervantes

Open Access Theses & Dissertations

The objective of this research is to investigate a new approach for the early detection of latent defects in electronic devices in the field. Reliability is assessed through the non-traditional approach of recording and evaluating the power profile of electronic devices within a deterministic state of operation. Traditionally, measuring the quiescent current (Iddq) of a device has been employed in manufacturing tests to detect defective parts prior to deployment to the field. However, the monitoring of the deterministic power signature (i.e. boot up or during a self-test routine) has never been exploited to monitor the health of a device in …

Agent Based Modeling In Computer Graphics And Games, Brian Macnamee

Books/Book Chapters

As graphics technology has improved in recent years, more and more importance has been placed on the behavior of virtual characters in applications set in virtual worlds in areas such as games, movies and simulations. The behavior of virtual characters should be believable in order to create the illusion that these virtual worlds are populated with living characters. This has led to the application of agent-based modeling to the control of these virtual characters. There are a number of advantages of using agent-based modeling techniques which include the fact that they remove the requirement for hand controlling all agents in …

Gathering Cows Using Virtual Fencing Methodologies, Dean M. Anderson, Marek Doniec, Carrick Detweiler, Iuliu Vesilescu, Daniela Rus, Barbara Nolen, Roy Libeau

School of Computing: Conference and Workshop Papers

Free-ranging livestock are classically controlled by herders. Holding, moving, or gathering free-ranging cattle requires flexible husbandry practices for efficient and effective lowstress animal management. Behavioral theory and practical experience indicates cattle can be taught to respond to auditory cues. Preliminary research has demonstrated that cows can be gathered autonomously using recorded audio cues associated with manual gathering. However, efficient gathering requires movement in the proper direction. Therefore, we believe using audio cues administered from directional virtual fencing (DVF™) equipment can facilitate proper animal orientation and facilitate the gathering of animals with minimal human intervention. Results from applying directional audio cues …