Robotics Commons^™

Reasoning Across Language And Vision In Machines And Humans, Andrei Barbu

Open Access Dissertations

Humans not only outperform AI and computer-vision systems, but use an unknown computational mechanism to perform tasks for which no suitable approaches exist. I present work investigating both novel tasks and how humans approach them in the context of computer vision and linguistics. I demonstrate a system which, like children, acquires high-level linguistic knowledge about the world. Robots learn to play physically-instantiated board games and use that knowledge to engage in physical play. To further integrate language and vision I develop an approach which produces rich sentential descriptions of events depicted in videos. I then show how to simultaneously detect …

Modeling A Sensor To Improve Its Efficacy, Nabin K. Malakar, Daniil Gladkov, Kevin H. Knuth

Physics Faculty Scholarship

Robots rely on sensors to provide them with information about their surroundings. However, high-quality sensors can be extremely expensive and cost-prohibitive. Thus many robotic systems must make due with lower-quality sensors. Here we demonstrate via a case study how modeling a sensor can improve its efficacy when employed within a Bayesian inferential framework. As a test bed we employ a robotic arm that is designed to autonomously take its own measurements using an inexpensive LEGO light sensor to estimate the position and radius of a white circle on a black field. The light sensor integrates the light arriving from a …

Reducing Communication Delay Variability For A Group Of Robots, Goncalo Martins

Electronic Theses and Dissertations

A novel architecture is presented for reducing communication delay variability for a group of robots. This architecture relies on using three components: a microprocessor architecture that allows deterministic real-time tasks; an event-based communication protocol in which nodes transmit in a TDMA fashion, without the need of global clock synchronization techniques; and a novel communication scheme that enables deterministic communications by allowing senders to transmit without regard for the state of the medium or coordination with other senders, and receivers can tease apart messages sent simultaneously with a high probability of success. This approach compared to others, allows simultaneous communications without …

Robotic Swarming Without Inter-Agent Communication, Daniel Jonathan Standish

USF Tampa Graduate Theses and Dissertations

Many physical and algorithmic swarms utilize inter-agent communication to achieve advanced swarming behaviors. These swarms are inspired by biological swarms that can be seen throughout nature and include bee swarms, ant colonies, fish schools, and bird flocks. These biological swarms do not utilize inter-agent communication like their physical and algorithmic counterparts. Instead, organisms in nature rely on a local awareness of other swarm members that facilitates proper swarm motion and behavior. This research aims to pursue an effective swarm algorithm using only line-of-sight proximity information and no inter-agent communication. It is expected that the swarm performance will be lower than …

Fpca Based Human-Like Trajectory Generating, Wei Dai

USF Tampa Graduate Theses and Dissertations

This thesis presents a new human-like upper limb and hand motion generating method. The work is based on Functional Principal Component Analysis and Quadratic Programming. The human-like motion generating problem is formulated in a framework of minimizing the difference of the dynamic profile of the optimal trajectory and the known types of trajectory. Statistical analysis is applied to the pre-captured human motion records to work in a low dimensional space. A novel PCA FPCA hybrid motion recognition method is proposed. This method is implemented on human grasping data to demonstrate its advantage in human motion recognition. One human grasping hierarchy …

A Robust Rgb-D Slam System For 3d Environment With Planar Surfaces, Po-Chang Su

Theses and Dissertations--Electrical and Computer Engineering

Simultaneous localization and mapping is the technique to construct a 3D map of unknown environment. With the increasing popularity of RGB-depth (RGB-D) sensors such as the Microsoft Kinect, there have been much research on capturing and reconstructing 3D environments using a movable RGB-D sensor. The key process behind these kinds of simultaneous location and mapping (SLAM) systems is the iterative closest point or ICP algorithm, which is an iterative algorithm that can estimate the rigid movement of the camera based on the captured 3D point clouds. While ICP is a well-studied algorithm, it is problematic when it is used in …

Nonlinear Control For Dual Quaternion Systems, William D. Price

Doctoral Dissertations and Master's Theses

The motion of rigid bodies includes three degrees of freedom (DOF) for rotation, generally referred to as roll, pitch and yaw, and 3 DOF for translation, generally described as motion along the x, y and z axis, for a total of 6 DOF. Many complex mechanical systems exhibit this type of motion, with constraints, such as complex humanoid robotic systems, multiple ground vehicles, unmanned aerial vehicles (UAVs), multiple spacecraft vehicles, and even quantum mechanical systems. These motions historically have been analyzed independently, with separate control algorithms being developed for rotation and translation. The goal of this research is to study …

Human Intention Recognition Based Assisted Telerobotic Grasping Of Objects In An Unstructured Environment, Karan Hariharan Khokar

USF Tampa Graduate Theses and Dissertations

In this dissertation work, a methodology is proposed to enable a robot to identify an object to be grasped and its intended grasp configuration while a human is teleoperating a robot towards the desired object. Based on the detected object and grasp configuration, the human is assisted in the teleoperation task. The environment is unstructured and consists of a number of objects, each with various possible grasp configurations. The identification of the object and the grasp configuration is carried out in real time, by recognizing the intention of the human motion. Simultaneously, the human user is assisted to preshape over …

Techniques For Sensor-Integrated Robotic Systems: Raman Spectra Analysis, Image Guidance, And Kinematic Calibration, Luke Anthony Reisner

Wayne State University Dissertations

Robotics and sensor technology have made impressive advancements over the years. There are now robotic systems that help perform surgeries or explore the surface of Mars, and there are sensors that detect trace amounts of explosives or identify diseased human tissue. The most powerful systems integrate robots and sensors, which are natural complements to each other. Sensors can provide information that might otherwise be unavailable due to indirect robotic manipulation (e.g., images of the target environment), and robots can provide suitably precise positioning of an analytical sensor.

To have an effective sensor-integrated robotic system, multiple capabilities are needed in the …

Detection Of Diffuse Sea Floor Venting Using Structured Light Imaging, Gabrielle Inglis, Clara Smart, Christopher Roman, Steven Carey

Graduate School of Oceanography Faculty Publications

Efficiently identifying and localizing diffuse sea floor venting at hydrothermal and cold seep sites is often difficult. Actively venting fluids are usually identified by a temperature induced optical shimmering seen during direct visual inspections or in video data collected by vehicles working close to the sea floor. Relying on such direct methods complicates establishing spatial relations between areas within a survey covering a broad area. Our recent work with a structured light laser system has shown that venting can also be detected in the image data in an automated fashion. A structured light laser system consists of a camera and …

Remote Analysis Of Grain Size Characteristic In Submarine Pyroclastic Deposits From Kolumbo Volcano, Greece, Clara Smart, D. P. Whitesell, Christopher N. Roman, Steven Carey

Graduate School of Oceanography Faculty Publications

Grain size characteristics of pyroclastic deposits provide valuable information about source eruption energetics and depositional processes. Maximum size and sorting are often used to discriminate between fallout and sediment gravity flow processes during explosive eruptions. In the submarine environment the collection of such data in thick pyroclastic sequences is extremely challenging and potentially time consuming. A method has been developed to extract grain size information from stereo images collected by a remotely operated vehicle (ROV). In the summer of 2010 the ROV Hercules collected a suite of stereo images from a thick pumice sequence in the caldera walls of Kolumbo …

Concept Tests For A New Wire Flying Vehicle Designed To Achieve High Horizontal Resolution Profiling In Deep Water, Chris Roman, Dave Hebert

Graduate School of Oceanography Faculty Publications

Efficiently profiling the water column to achieve both high vertical and horizontal resolution from a moving vessel in deep water is difficult. Current solutions, such as CTD tow-yos, moving vessel profilers, and undulating tow bodies, are limited by ship speed or water depth. As a consequence, it is difficult to obtain oceanographic sections with sufficient resolution to identify many relevant scales over the deeper sections of the water column. This paper presents a new concept for a profiling vehicle that slides up and down a towed wire in a controlled manner using the lift created by wing foils. The wings …

Development Of High Resolution Sea Floor Mapping Tools And Techniques, Gabrielle Inglis, J. Ian Vaughn, Clara Smart, Christopher N. Roman

Graduate School of Oceanography Faculty Publications

There is a persistent need for high resolution photographic and bathymetric maps of the sea floor for many research areas in marine geology, biology and archaeology. This poster will present recent work using high frequency multibeam sonars, stereo vision and structured light laser imaging techniques to create maps with centimeter resolution for these applications. This research involves the development of new image and sonar processing techniques that combat the typical difficulties of imperfect navigation information, limited sensor ranges and adverse environmental conditions associated with using marine robotic vehicles in the ocean. Data for this work has been collected with the …

Design And Demonstration Of A Miniature Lidar System For Rover Applications, Benjamin Robinson

Electrical & Computer Engineering Theses & Dissertations

Public awareness of harmful human environmental effects such as global warming has increased greatly in recent years and researchers have increased their efforts in gaining more knowledge about the Earth's atmosphere. Natural and man-made processes pose threats lo the environment and human life, so knowledge of all atmospheric processes is necessary. Ozone and aerosols are important factors in many atmospheric processes and active remote sensing techniques provide a way lo analyze their quantity and distribution.

A compact ground-based lidar system for a robotic platform meant for atmospheric aerosol measurements was designed, tested, and evaluated. The system will eventually be deployed …

Kernelized Locality-Sensitive Hashing For Fast Image Landmark Association, Mark A. Weems

Theses and Dissertations

As the concept of war has evolved, navigation in urban environments where GPS may be degraded is increasingly becoming more important. Two existing solutions are vision-aided navigation and vision-based Simultaneous Localization and Mapping (SLAM). The problem, however, is that vision-based navigation techniques can require excessive amounts of memory and increased computational complexity resulting in a decrease in speed. This research focuses on techniques to improve such issues by speeding up and optimizing the data association process in vision-based SLAM. Specifically, this work studies the current methods that algorithms use to associate a current robot pose to that of one previously …

Evidence Supporting Measure Of Similarity For Reducing The Complexity In Information Fusion, Florentin Smarandache, Jean Dezert, Xinde Li, Xinhan Huang

Branch Mathematics and Statistics Faculty and Staff Publications

This paper presents a new method for reducing the number of sources of evidence to combine in order to reduce the complexity of the fusion processing. Such a complexity reduction is often required in many applications where the real-time constraint and limited computing resources are of prime importance. The basic idea consists in selecting, among all sources available, only a subset of sources of evidence to combine. The selection is based on an evidence supporting measure of similarity (ESMS) criterion which is an efficient generic tool for outlier sources identification and rejection. The ESMS between two sources of evidence can …

Robotic Hand Evaluation Based On Task Specific Kinematic Requirements, Carlos Rafael Neninger

USF Tampa Graduate Theses and Dissertations

With the rise autonomous and robotic systems in field applications, the need for dexterous, highly adaptable end effectors has become a major research topic. Control mechanisms of robotics hands with a high number independent actuators is recognized as a complex, high dimensional problem, with exponentially complex algorithms. However, recent studies have shown that human hand motion possesses very high joint correlation which translates into a set of predefined postures, or synergies. The hand produces a motion using a complementing contribution of multiple joints, called synergies. The similarities place variables onto a common dimensional space, effectively reducing the number of independent …

Autonomous Underwater Vehicles As Tools For Deep-Submergence Archaeology, Christopher N. Roman, Ian Roderick Mather

Graduate School of Oceanography Faculty Publications

Marine archaeology beyond the capabilities of scuba divers is a technologically enabled field. The tool suite includes ship-based systems such as towed side-scan sonars and remotely operated vehicles, and more recently free-swimming autonomous underwater vehicles (AUVs). Each of these platforms has various imaging and mapping capabilities appropriate for specific scales and tasks. Broadly speaking, AUVs are becoming effective tools for locating, identifying, and surveying archaeological sites. This paper discusses the role of AUVs in this suite of tools, outlines some specific design criteria necessary to maximize their utility in the field, and presents directions for future developments. Results are presented …

Application Of Structured Light Imaging For High Resolution Mapping Of Underwater Archaeological Sites, Chris Roman, Gabrielle Inglis, James Rutter

Graduate School of Oceanography Faculty Publications

This paper presents results from recent work using structured light laser profile imaging to create high resolution bathymetric maps of underwater archaeological sites. Documenting the texture and structure of submerged sites is a difficult task and many applicable acoustic and photographic mapping techniques have recently emerged. This effort was completed to evaluate laser profile imaging in comparison to stereo imaging and high frequency multibeam mapping. A ROV mounted camera and inclined 532 nm sheet laser were used to create profiles of the bottom that were then merged into maps using platform navigation data. These initial results show very promising resolution …

Developing An Effective And Efficient Real Time Strategy Agent For Use As A Computer Generated Force, Kurt Weissgerber

Theses and Dissertations

Computer Generated Forces (CGF) are used to represent units or individuals in military training and constructive simulation. The use of CGF significantly reduces the time and money required for effective training. For CGF to be effective, they must behave as a human would in the same environment. Real Time Strategy (RTS) games place players in control of a large force whose goal is to defeat the opponent. The military setting of RTS games makes them an excellent platform for the development and testing of CGF. While there has been significant research in RTS agent development, most of the developed agents …

Augmented Reality Navigation Interfaces Improve Human Performance In End-Effector Controlled Telerobotics, Keshav Chintamani

Wayne State University Dissertations

On the International Space Station (ISS) and space shuttles, the National Aeronautics and Space Administration (NASA) has used robotic manipulators extensively to perform payload handling and maintenance tasks. Teleoperating robots require expert skills and optimal performance is crucial to mission completion and crew safety. Degradation in performance is observed when manual control is mediated through remote camera views, resulting in poor end-effector navigation quality and extended task completion times. This thesis explores the application of three-dimensional augmented reality (AR) interfaces specifically designed to improve human performance during end-effector controlled teleoperations. A modular telerobotic test bed was developed for this purpose …

Development Of A New Lagrangian Float For Studying Coastal Marine Ecosystems, Alex Schwithal, Chris Roman

Graduate School of Oceanography Faculty Publications

This paper presents an overview and initial testing results for a shallow water Lagrangian float designed to operate in coastal settings. The presented effort addresses the two main characteristics of the shallow coastal environment that preclude the direct of use of many successfully deep water floats, namely the higher variation of water densities near the coast compared with the open ocean and the highly varied bathymetry. Our idea is to develop a high capacity dynamic auto-ballasting system that is able to compensate for the expected seawater density variation over a broad range of water temperatures and salinities while using measurements …

Deep Sea Underwater Robotic Exploration In The Ice-Covered Arctic Ocean With Auvs, Clayton Kunz, Chris Murphy, Richard Camilli, Hanumant Singh, John Bailey, Ryan M. Eustice, Chris Roman, Michael Jakuba, Claire Willis, Taichi Sato, Ko-Ichi Nakamura, Robert A. Sohn

Graduate School of Oceanography Faculty Publications

The Arctic seafloor remains one of the last unexplored areas on Earth. Exploration of this unique environment using standard remotely operated oceanographic tools has been obstructed by the dense Arctic ice cover. In the summer of 2007 the Arctic Gakkel Vents Expedition (AGAVE) was conducted with the express intention of understanding aspects of the marine biology, chemistry and geology associated with hydrothermal venting on the section of the mid-ocean ridge known as the Gakkel Ridge. Unlike previous research expeditions to the Arctic the focus was on high resolution imaging and sampling of the deep seafloor. To accomplish our goals we …

Design Concepts And Process Analysis For Transmuter Fuel Manufacturing, Georg F. Mauer

Fuels Campaign (TRP)

The safe and effective manufacturing of actinide-bearing fuels for any transmutation strategy requires that the entire manufacturing process be contained within a shielded hot cell environment. To ensure that the fabrication process is feasible, the entire process must be designed for remote operation. The equipment must be reliable enough to perform over several decades, and also easy to maintain or repair remotely. The facility must also be designed to facilitate its own decontamination and decommissioning. In addition to these design factors, the potential viability of any fuel fabrication process will also be impacted by a number of variables, such as …

Byzantium Beneath The Black Sea, Bridget Buxton, Robert Ballard, Michael Brennan, Dwight Coleman, Katy Croff, Christopher Roman, Dan Davis, Dennis Piechota, Sergiy Voronov

Graduate School of Oceanography Faculty Publications

This poster reports on the August 2007 Black Sea Expedition of the Institute for Archaeological Oceanography at the University of Rhode Island (IAO) and the Institute for Exploration (IFE), in collaboration with the Department of the Underwater Heritage of Ukraine. This year’s work marks a new phase in a multi-year (2000–2012) archaeological and oceanographic survey of the Black Sea. 2007 fieldwork focuses on two Byzantine shipwrecks. The 10th century C.E. shipwreck Chersonesos A (discovered in 2006) lies at 140 m depth in the suboxic zone off the Crimean peninsula. The ship carried a cargo of one-handled jars of a widely …

Evaluation Of Robocode As A Teaching Tool For Computer Programming, Arnold Hensman

Conference Papers

Robocode began as an educational tool to aid in learning Java programming. It has since evolved into something of a phenomenon, as the prospect of creating simple to complex virtual tanks appears to pose an attractive challenge to both novice and expert programmers alike. What started out as a teaching tool has grown into a worldwide network of competitors, all keen to prove that their ‘bot’ stands out from the crowd. Competitions are well organised and many Robocode events are a PR dream for the computing companies that sponsor them. Without a doubt, this easy to use application has sparked …

Design Concepts And Process Analysis For Transmuter Fuel Manufacturing, Georg F. Mauer

Fuels Campaign (TRP)

The safe and effective manufacturing of actinide-bearing fuels for any transmutation strategy requires that the entire manufacturing process be contained within a shielded hot cell environment. To ensure that the fabrication process is feasible, the entire process must be designed for remote operation. The equipment must be reliable enough to perform over several decades, and also easy to maintain or repair remotely. The facility must also be designed to facilitate its own decontamination and decommissioning. In addition to these design factors, the potential viability of any fuel fabrication process will also be impacted by a number of variables, such as …

A Cognitive Robotics Approach To Comprehending Human Language And Behaviors, Deryle W. Lonsdale, D. Paul Benjamin, Damian Lyons

Faculty Publications

The ADAPT project is a collaboration of researchers in linguistics, robotics and artificial intelligence at three universities. We are building a complete robotic cognitive architecture for a mobile robot designed to interact with humans in a range of environments, and which uses natural language and models human behavior. This paper concentrates on the HRI aspects of ADAPT, and especially on how ADAPT models and interacts with humans.

A Fuzzy Logic Controller For Autonomous Wheeled Vehicles, Mohamed Trabia, Linda Z. Shi, Neil Eugene Hodge

Mechanical Engineering Faculty Research

Autonomous vehicles have potential applications in many fields, such as replacing humans in hazardous environments, conducting military missions, and performing routine tasks for industry. Driving ground vehicles is an area where human performance has proven to be reliable. Drivers typically respond quickly to sudden changes in their environment. While other control techniques may be used to control a vehicle, fuzzy logic has certain advantages in this area; one of them is its ability to incorporate human knowledge and experience, via language, into relationships among the given quantities. Fuzzy logic controllers for autonomous vehicles have been successfully applied to address various …

Design Concepts And Process Analysis For Transmuter Fuel Manufacturing: Quarterly Progress Report #6, Kamalakar Alluri, Georg F. Mauer

Fuels Campaign (TRP)

Project Milestones

• Completed a systematic study seeking to arrive at an optimized plant configuration, using value engineering techniques in January 2006.

• Vision-based robot serving and automated plant safety monitoring is currently in progress.