Open Access. Powered by Scholars. Published by Universities.®
- Discipline
- Publication
- Publication Type
Articles 1 - 3 of 3
Full-Text Articles in Robotics
Learning In Vision And Robotics, Daniel P. Barrett
Learning In Vision And Robotics, Daniel P. Barrett
Open Access Dissertations
I present my work on learning from video and robotic input. This is an important problem, with numerous potential applications. The use of machine learning makes it possible to obtain models which can handle noise and variation without explicitly programming them. It also raises the possibility of robots which can interact more seamlessly with humans rather than only exhibiting hard-coded behaviors. I will present my work in two areas: video action recognition, and robot navigation. First, I present a video action recognition method which represents actions in video by sequences of retinotopic appearance and motion detectors, learns such models automatically …
Dynamic Surgical Tool Tracking And Delivery System Using Baxter Robot, Sthitapragyan Parida, Juan Pablo Wachs, Maria Eugenia Cabrera
Dynamic Surgical Tool Tracking And Delivery System Using Baxter Robot, Sthitapragyan Parida, Juan Pablo Wachs, Maria Eugenia Cabrera
The Summer Undergraduate Research Fellowship (SURF) Symposium
Several hospitals face nurse staffing shortages for surgeries. This research focuses on building a system with Baxter robot capable of identifying surgical tools using computer vision and delivering them to the surgeon on demand. This would deal with the issue of nurse unavailability during simple surgical procedures. The key aspects of the project were: testing the accuracies of various Artificial Neural Networks (ANNs) in classifying surgical instruments, and programming Baxter to implement a surgical tool delivery system using magnets at the tip of its 7-DOF robotic arms. The methodology consisted of, first, implementing algorithms to enable Baxter to do pick …
Reasoning Across Language And Vision In Machines And Humans, Andrei Barbu
Reasoning Across Language And Vision In Machines And Humans, Andrei Barbu
Open Access Dissertations
Humans not only outperform AI and computer-vision systems, but use an unknown computational mechanism to perform tasks for which no suitable approaches exist. I present work investigating both novel tasks and how humans approach them in the context of computer vision and linguistics. I demonstrate a system which, like children, acquires high-level linguistic knowledge about the world. Robots learn to play physically-instantiated board games and use that knowledge to engage in physical play. To further integrate language and vision I develop an approach which produces rich sentential descriptions of events depicted in videos. I then show how to simultaneously detect …