Exploring Cognition And Affect During Human-Cobot Interaction, Angelika T. Canete, Javier Gonzalez-Sanchez, Rafael Guerra Silva

College of Engineering Summer Undergraduate Research Program

Collaborative robots (Cobots) have recently gained popularity due to their capability to work collaboratively with human operators. This collaborative relationship has been named under the robotics discipline of Human-Robot Collaboration (HRC), in which humans and robots work together to accomplish a common task while also being in the same physical space. An important part of collaboration is the human's decision-making, which is largely affected by their affective and cognitive state. A cobot lacks this fundamental understanding of the human operator. In this research, we utilize a server-client program to communicate the affective states of a human user to a Raspberry …

Chatgpt As Metamorphosis Designer For The Future Of Artificial Intelligence (Ai): A Conceptual Investigation, Amarjit Kumar Singh (Library Assistant), Dr. Pankaj Mathur (Deputy Librarian)

Library Philosophy and Practice (e-journal)

Abstract

Purpose: The purpose of this research paper is to explore ChatGPT’s potential as an innovative designer tool for the future development of artificial intelligence. Specifically, this conceptual investigation aims to analyze ChatGPT’s capabilities as a tool for designing and developing near about human intelligent systems for futuristic used and developed in the field of Artificial Intelligence (AI). Also with the helps of this paper, researchers are analyzed the strengths and weaknesses of ChatGPT as a tool, and identify possible areas for improvement in its development and implementation. This investigation focused on the various features and functions of ChatGPT that …

Understanding And Quantifying Human Factors In Programming From Demonstration: A User Study Proposal, Shakra Mehak, Aayush Jain, John D. Kelleher, Philip Long, Michael Guilfoyle, Maria Chiara Leva

Conference papers

Programming by demonstration (PbD) is a promising method for robots to learn from direct, non-expert human interaction. This approach enables the interactive transfer of human skills to the robot. As the non-expert user is at the center of PbD, the efficacy of the learned skill is largely dependent on the demonstrations provided. Although PbD methods have been extensively developed and validated in the field of robotics, there has been inadequate confirmation of their effectiveness from the perspective of human teachability. To address this gap, we propose to experimentally investigate the impact of communicating robot learning process on the efficacy of …

Cloudbots: Autonomous Atmospheric Explorers, Akash Binoj

Honors Scholar Theses

The CloudBot is an autonomous weather balloon that operates on the principle of variable buoyancy to ascend and descend in the atmosphere. This project aims to develop a device that will collect atmospheric measurements and communicate them mid-flight. The apparatus consists of a helium-filled balloon, the robotic payload, and an air cell. The fixed-volume helium balloon at the top provides an upwards buoyancy force, while the air cell at the bottom can hold a variable amount of pressure to adjust the weight of the CloudBot. By doing so, it is able to travel in storm conditions and collect valuable atmospheric …

Characterizing And Predicting Human Visual Perception Of Unmanned Aerial Vehicle Gestures, Paul Fletcher

Department of Computer Science and Engineering: Dissertations, Theses, and Student Research

Unmanned Aerial Vehicles (UAVs) are being used in public domains and hazardous environments where effective communication strategies are critical. UAV gesture techniques have been shown to communicate meaning to human observers and may be ideal in contexts that require lightweight systems such as unmanned aerial flight, however, this work may be limited to an idealized range of viewer perspectives. As gesture is a visual communication technique it is necessary to consider how the perception of a robot gesture may suffer from obfuscation or self-occlusion from some viewpoints. This thesis presents the results of three online user-studies that examine participants’ ability …

A Low-Cost And Low-Tech Solution To Test For Variations Between Multiple Offline Programming Software Packages., Steffen Wendell Bolz

Masters Theses & Specialist Projects

This research paper chronicles the attempt to bring forth a low-cost and low-tech testing methodology whereby multiple offline programming (OLP) software packages’ generated programs may be compared when run on industrial robots. This research was initiated by the discovery that no real research exists to test between iterations of OLP software packages and that most research for positional accuracy and/or repeatability on industrial robots is expensive and technologically intensive. Despite this, many countries’ leaders are pushing for intensive digitalization of manufacturing and Small and Mediumsized Enterprises (SMEs) are noted to be lagging in adoption of such technologies. The research consisted …

Can We Make Our Robot Play Soccer? Influence Of Collaborating With Preservice Teachers And Fifth Graders On Undergraduate Engineering Students' Learning During A Robotic Design Process (Work In Progress), Krishnanand Kaipa, Jennifer Kidd, Julia Noginova, Francisco Cima, Stacie Ringleb, Orlando Ayala, Pilar Pazos, Kristie Gutierrez, Min Jung Lee

Mechanical & Aerospace Engineering Faculty Publications

This work-in-progress paper describes engineering students’ experiences in an NSF-funded project that partnered undergraduate engineering students with pre-service teachers to plan and deliver robotics lessons to fifth graders at a local school. This project aims to address an apparent gap between what is taught in academia and industry’s expectations of engineers to integrate perspectives from outside their field to solve modern societal problems requiring a multidisciplinary approach. Working in small teams over Zoom, participating engineering, education, and fifth grade students designed, built, and coded bio-inspired COVID companion robots. The goal for the engineering students was to build new interprofessional skills, …

Aerial Flight Paths For Communication, Alisha Bevins

Department of Computer Science and Engineering: Dissertations, Theses, and Student Research

This body of work presents an iterative process of refinement to understand naive perception of communication using the motion of an unmanned aerial vehicle (UAV). This includes what people believe the UAV is trying to communicate, and how they expect to respond through physical action or emotional response. Previous work in this area sought to communicate without clear definitions of the states attempting to be conveyed. In an attempt to present more concrete states and better understand specific motion perception, this work goes through multiple iterations of state elicitation and label assignment. The lessons learned in this work will be …

Connecting Islamic Technology And The History Of Robotics In Wikidata Via Wikidatabot, Anchalee Panigabutra-Roberts

UT Libraries Faculty: Other Publications and Presentations

My current study is on the connection between the history of robotics and Islamic technology. I focused on early Muslim inventors, such as al-Jazari, from Artuqid Dynasty of Jazira in Mesopotamia (modern day Iraq, Syria and Turkey) who is considered to be the father of robotics. He wrote the Book of Knowledge of Ingenious Mechanical Devices, the manuscript treaty published after his passing in 1206, translated by Donald R. Hill, a British engineer and scholar on Islamic technology, in 1974. The manuscript in Arabic (MS. Greaves 27) is archived at the Bodleian Library, University of Oxford, United Kingdom. In …

A Bibliometric Perspective Survey Of Iot Controlled Ai Based Swarm Robots, Rhea Sawant, Ariz Shaikh, Chetna Singh, Aman Aggarwal, Shivali Amit Wagle, Harikrishnan R, Priti Shahane

Library Philosophy and Practice (e-journal)

Robotics is the ­new-age domain of technology that deals with bringing a collaboration of all disciplines of sciences and engineering to create a mechanical machine that may or may not work entirely independently but definitely focuses on making human lives much easier. It has repeatedly shown its ability to change lives at home and in the industry. As the field of robotics research grows and reaches new worlds, the military is one area where advances can have a significant impact, and the government is aware of this. Military technology has come a long way from the days where soldiers had …

On The Impact Of Gravity Compensation On Reinforcement Learning In Goal-Reaching Tasks For Robotic Manipulators, Jonathan Fugal, Hasan A. Poonawala, Jihye Bae

Electrical and Computer Engineering Faculty Publications

Advances in machine learning technologies in recent years have facilitated developments in autonomous robotic systems. Designing these autonomous systems typically requires manually specified models of the robotic system and world when using classical control-based strategies, or time consuming and computationally expensive data-driven training when using learning-based strategies. Combination of classical control and learning-based strategies may mitigate both requirements. However, the performance of the combined control system is not obvious given that there are two separate controllers. This paper focuses on one such combination, which uses gravity-compensation together with reinforcement learning (RL). We present a study of the effects of gravity …

3d-Printed Leg Design And Modification For Improved Support On A Quadruped Robot, Jasmin S. Collins

Undergraduate Research & Mentoring Program

The Agile and Adaptive Robotics Lab aims to uncover the biological and physiological complexities in animal agility and adaptive control, which can be replicated through robotics and provide further applications in biology and medicine. One project within the lab focuses on understanding structure, actuation, and control through the modeling of a canine quadruped robot.

The AARL has developed a full-body quadruped robot with artificial muscles that control limb movement and a body that is built from 3D-printed parts. This specific project involved modification of these existing parts to (a) minimize deflections in the front legs, causing unwanted lateral and abduction/adduction …

Non-Obstetrical Robotic-Assisted Laparoscopic Surgery In Pregnancy: A Systematic Literature Review., Courtney Capella, Joseph Godovchik, Thenappan Chandrasekar, Huda B. Al-Kouatly

Department of Urology Faculty Papers

Urologic and gynecologic surgeons are the top utilizers of robotic surgery; however, non-obstetrical robotic-assisted laparoscopic surgery (RALS) in pregnant patients is infrequent. A systematic literature review was performed to ascertain the frequency, indication and complications of RALS in pregnancy. Results showed thirty-eight pregnancies from eleven publications between 2008-2020. Five cases were for urologic indication and thirty-three for gynecologic indication. Minimal surgical alterations were required. Although no adverse maternal-fetal outcomes were reported, there are not enough cases published to determine safety. This review demonstrates the feasibility of RALS for the pregnant population in the hands of competent robotic surgeons.

Using Taint Analysis And Reinforcement Learning (Tarl) To Repair Autonomous Robot Software, Damian Lyons, Saba Zahra

Faculty Publications

It is important to be able to establish formal performance bounds for autonomous systems. However, formal verification techniques require a model of the environment in which the system operates; a challenge for autonomous systems, especially those expected to operate over longer timescales. This paper describes work in progress to automate the monitor and repair of ROS-based autonomous robot software written for an a-priori partially known and possibly incorrect environment model. A taint analysis method is used to automatically extract the data-flow sequence from input topic to publish topic, and instrument that code. A unique reinforcement learning approximation of MDP utility …

Using Robotics And Engineering Design Inquiries To Optimize Learning For Middle Level Teachers: A Case Study, Iman Chafik Chahine, Norman Robinson Iii, Kimbeni Mansion

Publications & Research

This exploratory case study reports findings on 20 middle-level science and mathematics teachers’ perceptions of the effectiveness of a one-year project in which teachers engaged in using robotics and engineering design inquiries in their classrooms. Principled by Bandura’s Social Learning Theory (SLT) and using mixed methods approaches, the study measured teachers' efficacy through the Mathematics Teaching Efficacy Belief Instrument (MTEBI) and observation logs before and after the program. The results of this study showed statistically significant differences between PRE MTEBI and POST MTEBI scores. Furthermore, five themes emerged that illuminated potential affordances and constraints that teachers perceive as opportunities and …

Drone Proximity Detection Via Air Disturbance Analysis, Qian Zhao, Jason Hughes

Faculty Publications

The use of unmanned aerial vehicles (drones) is expanding to commercial, scientific, and agriculture applications, including surveillance, product deliveries and aerial photography. One challenge for applications of drones is detecting obstacles and avoiding collisions. A typical solution to this issue is the use of camera sensors or ultrasonic sensors for obstacle detection or sometimes just manual control (teleoperation). However, these solutions have costs in battery lifetime, payload, operator skill. We note that there will be an air disturbance in the vicinity of the drone when it’s moving close to obstacles or other drones. Our objective is to detect obstacles from …

An Approach To Fast Multi-Robot Exploration In Buildings With Inaccessible Spaces, Matt Mcneill, Damian Lyons

Faculty Publications

The rapid exploration of unknown environments is a common application of autonomous multi-robot teams. For some types of exploration missions, a mission designer may possess some rudimentary knowledge about the area to be explored. For example, the dimensions of a building may be known, but not its floor layout or the location of furniture and equipment inside. For this type of mission, the Space- Based Potential Field (SBPF) method is an approach to multirobot exploration which leverages a priori knowledge of area bounds to determine robot motion. Explored areas and obstacles exert a repulsive force, and unexplored areas exert an …

Domain Adaptation In Unmanned Aerial Vehicles Landing Using Reinforcement Learning, Pedro Lucas Franca Albuquerque

Department of Computer Science and Engineering: Dissertations, Theses, and Student Research

Landing an unmanned aerial vehicle (UAV) on a moving platform is a challenging task that often requires exact models of the UAV dynamics, platform characteristics, and environmental conditions. In this thesis, we present and investigate three different machine learning approaches with varying levels of domain knowledge: dynamics randomization, universal policy with system identification, and reinforcement learning with no parameter variation. We first train the policies in simulation, then perform experiments both in simulation, making variations of the system dynamics with wind and friction coefficient, then perform experiments in a real robot system with wind variation. We initially expected that providing …

Robot Simulation Analysis, Jacob Miller, Jeremy Evert

Student Research

• Simulate virtual robot for test and analysis

• Analyze SLAM solutions using ROS

• Assemble a functional Turtlebot

• Emphasize projects related to current research trajectories for NASA, and general robotics applications

A Comparison Of Contextual Bandit Approaches To Human-In-The-Loop Robot Task Completion With Infrequent Feedback, Matt Mcneill, Damian Lyons

Faculty Publications

Artificially intelligent assistive agents are playing an increased role in our work and homes. In contrast with currently predominant conversational agents, whose intelligence derives from dialogue trees and external modules, a fully autonomous domestic or workplace robot must carry out more complex reasoning. Such a robot must make good decisions as soon as possible, learn from experience, respond to feedback, and rely on feedback only as much as necessary. In this research, we narrow the focus of a hypothetical robot assistant to a room tidying task in a simulated domestic environment. Given an item, the robot chooses where to put …

Exercises Integrating High School Mathematics With Robot Motion Planning, Ronald I. Greenberg, George K. Thiruvathukal

Computer Science: Faculty Publications and Other Works

This paper presents progress in developing exercises for high school students incorporating level-appropriate mathematics into robotics activities. We assume mathematical foundations ranging from algebra to precalculus, whereas most prior work on integrating mathematics into robotics uses only very elementary mathematical reasoning or, at the other extreme, is comprised of technical papers or books using calculus and other advanced mathematics. The exercises suggested are relevant to any differerential-drive robot, which is an appropriate model for many different varieties of educational robots. They guide students towards comparing a variety of natural navigational strategies making use of typical movement primitives. The exercises align …

Evaluation Of Field Of View Width In Stereo-Vision-Based Visual Homing, Damian Lyons, Benjamin Barriage, Luca Del Signore

Faculty Publications

Visual homing is a local navigation technique used to direct a robot to a previously seen location by comparing the image of the original location with the current visual image. Prior work has shown that exploiting depth cues such as image scale or stereo-depth in homing leads to improved homing performance. While it is not unusual to use a panoramic field of view (FOV) camera in visual homing, it is unusual to have a panoramic FOV stereo-camera. So, while the availability of stereo-depth information may improve performance, the concomitant-restricted FOV may be a detriment to performance, unless specialized stereo hardware …

Improving 3d Printed Prosthetics With Sensors And Motors, Rachel Zarin

Honors Projects

A 3D printed hand and arm prosthetic was created from the idea of adding bionic elements while keeping the cost low. It was designed based on existing models, desired functions, and materials available. A tilt sensor keeps the hand level, two motors move the wrist in two different directions, a limit switch signals the fingers to open and close, and another motor helps open and close the fingers. All sensors and motors were built on a circuit board, programmed using an Arduino, and powered by a battery. Other supporting materials include metal brackets, screws, guitar strings, elastic bands, small clamps, …

Integrating Mathematics And Educational Robotics: Simple Motion Planning, Ronald I. Greenberg, George K. Thiruvathukal, Sara T. Greenberg

Computer Science: Faculty Publications and Other Works

This paper shows how students can be guided to integrate elementary mathematical analyses with motion planning for typical educational robots. Rather than using calculus as in comprehensive works on motion planning, we show students can achieve interesting results using just simple linear regression tools and trigonometric analyses. Experiments with one robotics platform show that use of these tools can lead to passable navigation through dead reckoning even if students have limited experience with use of sensors, programming, and mathematics.

Multi-Robot Coordination And Scheduling For Deactivation & Decommissioning, Sebastian A. Zanlongo

FIU Electronic Theses and Dissertations

Large quantities of high-level radioactive waste were generated during WWII. This waste is being stored in facilities such as double-shell tanks in Washington, and the Waste Isolation Pilot Plant in New Mexico. Due to the dangerous nature of radioactive waste, these facilities must undergo periodic inspections to ensure that leaks are detected quickly. In this work, we provide a set of methodologies to aid in the monitoring and inspection of these hazardous facilities. This allows inspection of dangerous regions without a human operator, and for the inspection of locations where a person would not be physically able to enter.

First, …

Formal Performance Guarantees For An Approach To Human In The Loop Robot Missions, Damian Lyons, Ron Arkin, Shu Jiang, Matt O'Brien, Feng Tang, Peng Tang

Faculty Publications

Abstract— A key challenge in the automatic verification of robot mission software, especially critical mission software, is to be able to effectively model the performance of a human operator and factor that into the formal performance guarantees for the mission. We present a novel approach to modelling the skill level of the operator and integrating it into automatic verification using a linear Gaussians model parameterized by experimental calibration. Our approach allows us to model different skill levels directly in terms of the behavior of the lumped, robot plus operator, system.

Using MissionLab and VIPARS (a behavior-based robot mission verification …

Developing Grounded Goals Through Instant Replay Learning, Lisa Meeden, Douglas S. Blank

Computer Science Faculty Research and Scholarship

This paper describes and tests a developmental architecture that enables a robot to explore its world, to find and remember interesting states, to associate these states with grounded goal representations, and to generate action sequences so that it can re-visit these states of interest. The model is composed of feed-forward neural networks that learn to make predictions at two levels through a dual mechanism of motor babbling for discovering the interesting goal states and instant replay learning for developing the grounded goal representations. We compare the performance of the model with grounded goal representations versus random goal representations, and find …

A Robotics Framework For Simulation And Control Of A Robotic Arm For Use In Higher Education, Craig Christensen

MS in Computer Science Project Reports

Robotic arms have been in common use for a several decades now in many areas from manufacturing and industrial uses to hobby projects and amusement park rides. However, there have been very few attempts to make an inexpensive robot arm with a software stack for use in higher education. This paper will outline a control and interfacing software stack built on the Robot Operating System (ROS) and a simulation of the 5 degree of freedom (DoF) robotic arm.

An Approach To Robust Homing With Stereovision, Fuqiang Fu, Damian Lyons

Faculty Publications

Visual Homing is a bioinspired approach to robot navigation which can be fast and uses few assumptions. However, visual homing in a cluttered and unstructured outdoor environment offers several challenges to homing methods that have been developed for primarily indoor environments. One issue is that any current image during homing may be tilted with respect to the home image. The second is that moving through a cluttered scene during homing may cause obstacles to interfere between the home scene and location and the current scene and location. In this paper, we introduce a robust method to improve a previous developed …

Pythagorean Approximations For Lego: Merging Educational Robot Construction With Programming And Data Analysis, Ronald I. Greenberg

Computer Science: Faculty Publications and Other Works

Abstract. This paper can be used in two ways. It can provide reference information for incorporating diagonal elements (for bracing or gear meshing) in educational robots built from standard LEGO kits. Alternatively, it can be used as the basis for an assignment for high school or college students to recreate this information; in the process, students will exercise skills in both computer programming and data analysis. Using the paper in the second way can be an excellent integrative experience to add to an existing course; for example, the Exploring Computer Science high school curriculum concludes with the units “Introduction to …