Robotics Commons^™

Sam-1: An Assistive Robot For Remote Patient Monitoring, Aana Farhana Ahsan

USF Tampa Graduate Theses and Dissertations

The global aging population has increased the demand for caregiving, while the availability of caregivers has not grown at the same pace. These trends have contributed to disparities in consistent and accessible care for older adults and increased caregiver burden. Geriatric care robots have emerged as a promising solution to support older adults and reduce caregiver burden. Existing systems have been developed for a wide range of applications, including rehabilitation, social support, assistance with activities of daily living, therapy, and caregiver telepresence. This thesis presents the development of SAM-1, an assistive robot designed to support remote monitoring of older adults …

Autonomous Vision-Based Litter Collection Rover, Dante Michael Benedetti, Benjamin Scott Tavares, Nathan Heil

Electrical Engineering

This report documents the design, implementation, and testing of an autonomous litter-collection rover developed as a Senior Project Design Lab (EE 460/463/464) at California Polytechnic State University. The rover integrates autonomy, computer vision, embedded real-time control, mecanum-wheel omnidirectional mobility, and a two-degree-of-freedom robotic arm to detect, approach, and collect small ground-level litter such as bottles, wrappers, and paper fragments.

The system uses a two-layer compute architecture: an NVIDIA Jetson Orin Nano running ROS 2 for perception, SLAM, and path planning, paired with an STM32L4A6ZG microcontroller for real-time motor control and odometry. The robot is built on a multi-level aluminum frame …

Investigation Of Automated 3d Scanning Strategies For Large-Scale Polishing Applications, Casey Egan

Open Access Master's Theses

In automated scanning for industrial refinishing applications, large workpieces often exceed the reach of a single robot base position, and may require the environment to be scanned from multiple locations and stitched to a common reference frame. This thesis compares two robotic scanning workflows for such an object: a full scan that reconstructs the object from a single robot base position, and a segmented scan occurring across multiple simulated robot base positions that are stitched together through fiducial-based localization. The results from both workflows are compared for measurement accuracy of the object's bounding box against known dimensions, position of the …

Augmenting Machine Learning Technique Through Natural Language, Tasmia Tasrin

Theses and Dissertations--Computer Science

While artificial intelligence (AI) and machine learning (ML) have proven effective at addressing many of the challenges that we face in our everyday lives, there are many situations in which these methods struggle. Examples include environments where AI or ML systems must perform complex behaviors or those where rewards are difficult to calculate. To address this limitation, interactive machine learning (IML) techniques have been introduced, which incorporate machine-understandable human feedback into traditional ML approaches. This feedback is often given as a discrete, positive or negative numeric value. This feedback is typically provided as often as possible to convey a dense …

Cropsync: Ai-Powered Sustainable Crop Management, Ziad Doughan, Ibrahim Mneimneh, Zouheir Nakouzi, Noor Al Khaib, Samer Damaj, Jamal Chaaban, Hamza Mrad, Sari Itani

BAU Journal - Science and Technology

CropSync is a smart agriculture system that uses AI and IoT technologies to enable sustain- able crop management and precision farming. The system aims to address the challenges faced by the agriculture sector, such as increasing food production to meet global population demands while minimizing environmental impact. CropSync integrates sensors, cameras, and cloud-based analytics to provide farmers with real-time insights and recommendations for optimizing crop cul- tivation. The system upholds engineering professional and ethical standards, considering broader social, environmental, and economic implications. From a social perspective, CropSync improves food security and enhances farmers’ livelihoods through increased productivity and efficient re- …

Computer Vision In A Robotic Arm, Jack Maxwell

College of Engineering Summer Undergraduate Research Program

We used a machine learning-based object detection algorithm to give a robotic arm the ability to "see" with its camera.

Real-Time Robot Pose Estimation For Industry 4.0: Enhancing Motion Validation And Monitoring With A Vision-Based Framework, Jad Samaha

Theses and Dissertations

Amidst the era of Industry 4.0, robots became integral to automated production lines by performing complex tasks with high precision and adapting to changing production needs in real-time. Therefore, ensuring their precise and reliable operation is paramount for maintaining high-quality standards and operational efficiency. This invoked the need for an automated motion validation tool that guarantees accurate program task execution, by detecting deviations or anomalies that may indicate mechanical faults or software errors. Given the exponential advancements in AI, particularly in Computer Vision, a vision-based solution is ideal for ensuring the correct positioning of a robot in real-time. Operating independently …

Uav-Based Tracking And Following Of Railroad Lines, Keith Michael Lewandowski

Theses and Dissertations

Given the pivotal role of the railroad industry in modern transportation and the potential risks associated with track malfunctions, the inspection and maintenance of railroad tracks emerges as a critical concern. While existing solutions excel in performing accurate measurements and detection, they often rely on large, expensive, and time-consuming platforms for inspections. This project, however, seeks to solve the same problem with the use of an unmanned aerial vehicle (UAV), significantly reducing time and cost while maintaining detection capabilities. In particular, this solution is ideal for large-scale, high-level inspections following major events such as floods [6], hurricanes [7] or earthquakes …

Advanced Traffic Video Analytics For Robust Traffic Accident Detection, Hadi Ghahremannezhad

Dissertations

Automatic traffic accident detection is an important task in traffic video analysis due to its key applications in developing intelligent transportation systems. Reducing the time delay between the occurrence of an accident and the dispatch of the first responders to the scene may help lower the mortality rate and save lives. Since 1980, many approaches have been presented for the automatic detection of incidents in traffic videos. In this dissertation, some challenging problems for accident detection in traffic videos are discussed and a new framework is presented in order to automatically detect single-vehicle and intersection traffic accidents in real-time.

First, …

Biologically Inspired Multi-Robot System Based On Wolf Hunting Behavior, Zachary Hinnen, Chance Hamilton, Alfredo Weitzenfeld

Florida Conference on Recent Advances in Robotics

Studies involving the group predator behavior of wolves have inspired multiple robotic architectures to mimic these biological behaviors in their designs and research. In this work, we aim to use robotic systems to mimic wolf packs' single and group behavior. This work aims to extend the original research by Weitzenfeld et al [7] and evaluate under a new multi-robot robot system architecture. The multiple robot architecture includes a 'Prey' pursued by a wolf pack consisting of an 'Alpha' and 'Beta' robotic group. The Alpha Wolf' will be the group leader, searching and tracking the 'Prey.' At the same time, the …

A Human-In-The-Loop Robot Grasping System With Grasp Quality Refinement, Tian Tan

USF Tampa Graduate Theses and Dissertations

The goal of this dissertation is to develop a grasping system for assistive robots that can help people with disabilities and the elderly to perform tasks of daily living. In developing this robot grasping system, we maximize its reliability, accuracy, and autonomy. High reliability and accuracy are required for robots to perform tasks around human users and to safely interact with objects that might be fragile or have contents that could spill. High autonomy is desired as users with disabilities are usually not dexterous enough to directly operate the robot. In this dissertation, a human-in-the-loop (HitL) robot grasping system is …

Humanoid Robot Motion Control For Ramps And Stairs, Tommy Truong

USF Tampa Graduate Theses and Dissertations

Humanoid robot research and development have been an ongoing effort since the 1900sand can be broken down to two problems. A mechanical problem, getting a humanoid robot to move human-like or a software problem, getting a humanoid robot to behave human-like. These problems of moving and behaving human-like can be often solved using control theory as research advances. For the premise of this research, we explore how to balance and walk on non-flat terrain for the humanoid robot Darwin-Op. Since the focus was on the control theory, the vision control to detect the non-flat terrain was a side objective. The …

Ping Pong Ball Collecting Robot, Gina Lanese, Jason Colonna, Sarah Kuchcinski, Johndavid Rogers

Williams Honors College, Honors Research Projects

The ping pong ball collecting robot will collect ping pong balls in a ping pong arena, such as after a game or practice session. Ball collection is now typically done by a human, collecting the balls either by hand or with a net. A robot, autonomously collecting the ping pong balls from the floor, would allow for the time spent playing or practicing to be maximized. The team will design the software and hardware for the robot, including the mechanical system, the software, and circuit boards. This robot will serve as a capstone project for the senior design team consisting …

A New Ectotherm 3d Tracking And Behavior Analytics System Using A Depth-Based Approach With Color Validation, With Preliminary Data On Kihansi Spray Toad (Nectophrynoides Asperginis) Activity, Philip Bal, Damian Lyons, Avishai Shuter

Faculty Publications

The Kihansi spray toad (Nectophrynoides asperginis), classified as Extinct in the Wild by the IUCN, is being bred at the Wildlife Conservation Society’s (WCS) Bronx Zoo as part of an effort to successfully reintroduce the species into the wild. Thousands of toads live at the Bronx Zoo presenting an opportunity to learn more about their behaviors for the first time, at scale. It is impractical to perform manual observations for long periods of time. This paper reports on the development of a RGB-D tracking and analytics approach that allows researchers to accurately and efficiently gather information about the toads’ behavior. …

Evaluation Of Field Of View Width In Stereo-Vision-Based Visual Homing, Damian Lyons, Benjamin Barriage, Luca Del Signore

Faculty Publications

Visual homing is a local navigation technique used to direct a robot to a previously seen location by comparing the image of the original location with the current visual image. Prior work has shown that exploiting depth cues such as image scale or stereo-depth in homing leads to improved homing performance. While it is not unusual to use a panoramic field of view (FOV) camera in visual homing, it is unusual to have a panoramic FOV stereo-camera. So, while the availability of stereo-depth information may improve performance, the concomitant-restricted FOV may be a detriment to performance, unless specialized stereo hardware …

Estimation And Prediction Of The Human Gait Dynamics For The Control Of An Ankle-Foot Prosthesis, Guilherme Aramizo Ribeiro

Dissertations, Master's Theses and Master's Reports

With the growing population of amputees, powered prostheses can be a solution to improve the quality of life for many people. Powered ankle-foot prostheses can be made to behave similar to the lost limb via controllers that emulate the mechanical impedance of the human ankle. Therefore, the understanding of human ankle dynamics is of major significance. First, this work reports the modulation of the mechanical impedance via two mechanisms: the co-contraction of the calf muscles and a change of mean ankle torque and angle. Then, the mechanical impedance of the ankle was determined, for the first time, as a multivariable …

Exploring Cyber-Physical Systems, Misbah Uddin Mohammed

Graduate Research Theses & Dissertations

The advances in IOT, Computer Vision, AI and Machine Learning have made these technologies ubiquitous to our daily lives. From Smart Phones to Connected Vehicles, Cyber Physical systems have been interspersed into everything we interact in today’s world. The aim or this thesis was to explore these advances in Cyber Physical Systems and analyze the different sectors they were affecting. We then hand-picked certain domains and explored further by carrying out practical projects using some of the latest software and hardware resources available. Technologies like Amazon Alexa services, NVIDIA Jetson boards, TensorFlow, OpenCV, NodeJS were heavily employed in our various …

Localization Using Convolutional Neural Networks, Shannon D. Fong

Computer Engineering

With the increased accessibility to powerful GPUs, ability to develop machine learning algorithms has increased significantly. Coupled with open source deep learning frameworks, average users are now able to experiment with convolutional neural networks (CNNs) to solve novel problems. This project sought to train a CNN capable of classifying between various locations within a building. A single continuous video was taken while standing at each desired location so that every class in the neural network was represented by a single video. Each location was given a number to be used for classification and the video was subsequently titled locX. These …

Corridor Navigation For Monocular Vision Mobile Robots, Matthew James Ng

Master's Theses

Monocular vision robots use a single camera to process information about its environment. By analyzing this scene, the robot can determine the best navigation direction. Many modern approaches to robot hallway navigation involve using a plethora of sensors to detect certain features in the environment. This can be laser range finders, inertial measurement units, motor encoders, and cameras.

By combining all these sensors, there is unused data which could be useful for navigation. To draw back and develop a baseline approach, this thesis explores the reliability and capability of solely using a camera for navigation. The basic navigation structure begins …

Automated Pruning Of Greenhouse Indeterminate Tomato Plants, Joey M. Angeja

Master's Theses

Pruning of indeterminate tomato plants is vital for a profitable yield and it still remains a manual process. There has been research in automated pruning of grapevines, trees, and other plants, but tomato plants have yet to be explored. Wage increases are contributing to the depleting profits of greenhouse tomato farmers. Rises in population are the driving force behind the need for efficient growing techniques. The major contribution of this thesis is a computer vision algorithm for detecting greenhouse tomato pruning points without the use of depth sensors. Given an up-close 2-D image of a tomato stem with the background …

Collaborative Appearance-Based Place Recognition And Improving Place Recognition Using Detection Of Dynamic Objects, Juan Pablo Munoz

Dissertations, Theses, and Capstone Projects

This dissertation makes contributions to the problem of Long-Term Appearance-Based Place Recognition. We present a framework for place recognition in a collaborative scheme and a method to reduce the impact of dynamic objects on place representations. We demonstrate our findings using a state-of-the-art place recognition approach.

We begin in Part I by describing the general problem of place recognition and its importance in applications where accurate localization is crucial. We discuss feature detection and description and also explain the functioning of several place recognition frameworks.

In Part II, we present a novel framework for collaboration between agents from a pure …

Software Updates To A Multiple Autonomous Quadcopter Search System (Maqss), Jared Speck, Toby Chan

Computer Engineering

A series of performance-based and feature implementation software updates to an existing multiple vehicle autonomous target search system is outlined in this paper. The search system, MAQSS, is designed to address a computational power constraint found on modern autonomous aerial platforms by separating real-time and computationally expensive tasks through delegation to multiple multirotor vehicles. A Ground Control Station (GCS) is also described as part of the MAQSS system to perform the delegation and provide a low workload user interface. Ultimately, the changes to MAQSS noted in this paper helped to improve the performance of the autonomous search mission, the accuracy …

An Approach To Robust Homing With Stereovision, Fuqiang Fu, Damian Lyons

Faculty Publications

Visual Homing is a bioinspired approach to robot navigation which can be fast and uses few assumptions. However, visual homing in a cluttered and unstructured outdoor environment offers several challenges to homing methods that have been developed for primarily indoor environments. One issue is that any current image during homing may be tilted with respect to the home image. The second is that moving through a cluttered scene during homing may cause obstacles to interfere between the home scene and location and the current scene and location. In this paper, we introduce a robust method to improve a previous developed …

California Polytechnic State University Senior Project Winter-Spring 2012, Roborodentia Xvii, Stack-E, Alejandro Ignacio, Austin Hobbs

Computer Engineering

The main goal for our project is to design and build a functional autonomous robot that is capable of navigating an open arena while avoiding obstacles, as well as identify other objects or cans on the field. It must also be capable of stacking and containing these cans. Deliverables will include the fully assembled robot chassis containing the essential hardware components needed to accomplish the navigation and movement, as well as capabilities like identification of objects and stacking of cans. Alongside the hardware, there will also be software developed to showcase these capabilities of the robot design, including the vision …

A Computer Vision Application To Accurately Estimate Object Distance, Kayton B. Parekh

Mathematics, Statistics, and Computer Science Honors Projects

Scientists have been working to create robots that perform manual work for years. However, creating machines that can navigate themselves and respond to their environment has proven to be difficult. One integral task to such research is to estimate the position of objects in the robot's visual field.

In this project we examine an implementation of computer vision depth perception. Our application uses color-based object tracking combined with model-based pose estimation to estimate the depth of specific objects in the view of our Pioneer 2 and Power Wheels robots. We use the Camshift algorithm for color-based object tracking, which uses …