Robotics Commons^™

Vision-Guided Motion Planning For Autonomous Catch With A Robotic Arm, Kayla Go-Oco, Ashik K. Islam, Raegan Gritzmacher

Electrical Engineering

Modern robotic systems are often evaluated using static and highly controlled tasks, such as pick-and-place demonstrations, which do not fully represent the uncertainty and adaptability required in real-world environments. A major challenge in robotics research is enabling robotic systems to perceive, track, and respond to dynamic objects in real time while maintaining accurate and reliable motion control. This project addresses these challenges by developing an autonomous robotic platform in which an OpenMANIPULATOR-Y robotic arm detects, tracks, and attempts to catch a moving tennis ball using a vision-guided control system. The system integrates YOLO-based object detection with an Intel RealSense D455 …

Autonomous Vision-Based Litter Collection Rover, Dante Michael Benedetti, Benjamin Scott Tavares, Nathan Heil

Electrical Engineering

This report documents the design, implementation, and testing of an autonomous litter-collection rover developed as a Senior Project Design Lab (EE 460/463/464) at California Polytechnic State University. The rover integrates autonomy, computer vision, embedded real-time control, mecanum-wheel omnidirectional mobility, and a two-degree-of-freedom robotic arm to detect, approach, and collect small ground-level litter such as bottles, wrappers, and paper fragments.

The system uses a two-layer compute architecture: an NVIDIA Jetson Orin Nano running ROS 2 for perception, SLAM, and path planning, paired with an STM32L4A6ZG microcontroller for real-time motor control and odometry. The robot is built on a multi-level aluminum frame …

A Turtlebot3 Hardware Testbed For Distributed Kalman Filter Localization, Dmitri Dobrynin, Indigo T. Garcia

Electrical Engineering

This report presents the preliminary design for a distributed localization framework for a multi-robot system. Many robotics research papers provide simulations of proposed algorithms in regards to formation control and task allocation. However, it is often that these proposals are without hardware experiments, being limited only to simulation. The objective of this framework is to provide a hardware implementation of a distributed Kalman filtering algorithm for multi-agent localization, as well as provide grounds for future multi-agent experiments. The framework is implemented on a swarm of three Turtlebot3 mobile robots. The robots can accurately localize themselves with respect to other agents …

Framework For Multi-Agent Coordination And Distributed Localization In Micro-Uavs, Minwoo Park, Nikolas Tambornini

Electrical Engineering

Micro-UAVs (unmanned aerial vehicles) due to their inexpensive nature and compact form factor have shown an increase in prevalence throughout a multitude of applications including, but not limited to: search and rescue, military reconnaissance, and agriculture monitoring. However, for a majority of these high impact applications, a swarm of micro-UAVs are required and furthermore mandate that they are able to cooperatively and autonomously coordinate with each other. For long, controlling and communicating between a user and a singular micro-UAV has been a well known and solved problem, however the same can't be said for swarms of micro-UAVs. This project seeks …

Autonomous Mapping Rover, Garrett Jones, Timothy Kyle Chu, Eugenio Caruso Pasos

Electrical Engineering

This report details the design, implementation, and evaluation of "Rovero," an autonomous mapping rover developed as a senior project. Rovero integrates state-of-the-art technologies, including ROS2 for communication, SLAM algorithms for mapping, and sensor fusion for accurate navigation. The project aimed to achieve robust autonomous operation in indoor environments, leveraging a combination of LiDAR, IMU, and encoder data for real-time decision-making. Key challenges addressed include path planning, obstacle avoidance, and integration of multiple sensor inputs. Results demonstrate successful mapping capabilities and efficient navigation performance.

Drone Swarm Search And Rescue, Rushabh Shah, Christopher Short, Anderson Macmillan, Wyatt Colburn

Electrical Engineering

Drone swarms offer the potential to drastically reduce search times and improve the effectiveness of search and rescue operations. This senior project explores the development of a drone swarm system for search and rescue missions, focusing on two key challenges: (1) precise localization of each drone within the swarm relative to one another and (2) accurate localization of a target beacon relative to the drones. The project utilizes Real Time Kinematic (RTK) processing to enhance the accuracy of drone localization, achieving centimeter-level precision. Target localization is achieved through a triangulation-based approach using Received Signal Strength Indication (RSSI) data from a …

Autonomous Apple Harvester Robot, Jack Ryan Cline, Tyus Green, Devon Woolston

Electrical Engineering

As agricultural demands rise and manual labor costs increase, there has become a dire need to automate apple harvesting. However, the precision and speed necessary for cost-efficient apple harvesting pose a significant challenge for robotic automation. To maintain cost-effective production, a harvester must be able to operate fast enough and long enough to compete with human labor. It must also be able to navigate and traverse apple orchards autonomously and pick apples without damaging the fruit or tree. This project presents an apple harvesting robot that uses a Mask R-CNN vision system with an RGB-D camera to detect the location …

Smartphone Control Of Rc Cars, Weston R. Fitzgerald

Electrical Engineering

The smartphone-controlled RC (remote-controlled) car is an inexpensive remote-controlled car designed to be fast and portable. Instead of manufacturing, packaging, and shipping a separate controller, the remote control is implemented in a phone application, which saves time and money in both the design process and the manufacturing process. Utilizing the user’s smartphone is more cost-effective since mobile devices are a common recurrence, and packaging fewer devices results in overall better portability of the product.

This smartphone-controlled car is speedy and intuitive to learn for typical smartphone users. The user can change the car’s speed and direction wirelessly using their phone; …

Lawn Buddy, Jayson Johnston, Andrew Brown, Jacob Maljian

Electrical Engineering

Grass lawns are a common hallmark of the American home. In 2019, a survey from the National Association of Landscape Professionals found that 81% of all Americans owned a lawn [1]. Mowing is a time consuming and costly chore that is part of maintaining a grass lawn. The manual labor in mowing a lawn can exceed 40 hours per year [2]. People commonly incur weekly costs on mowing services to save time. Traditional gas powered mowers are physically demanding and use engines that need routine maintenance. They operate loudly enough that users should be wearing hearing protection and the noise …

Mobile Robot Platform, Sukhman S. Marok

Electrical Engineering

The Mobile Robot Platform is a research and development tool designed for researchers working in the field of robotics. The cost of existing mobile robot platforms can easily be in the thousands of dollars, leading many researchers to choose between spending the time to create their own platform or buying an expensive pre-existing solution. The Mobile Robot Platform proposed combines pre-existing open source software and hardware solutions, along with a strong mechanical base that is capable of navigating on flat surfaces. The robot is designed to have many of the necessary components needed for teleoperation as well as autonomous navigation. …

Remote Cable Gantry, Allen L. Bailey

Electrical Engineering

The Remote Cable Gantry is a robotic system that was initially intended to aid in the art of aerial videography. It was designed to enable novice and expert users alike to capture both video footage and audio from perspectives unachievable by current methods. This system uses a series of cables to control the position of a camera gimbal in a defined 3D space and, as a self-contained unit, is portable and easy to use. The Remote Cable Gantry offers a quiet, intuitive, and safe alternative to existing technology, which has been limiting the market and potential of aerial photography and …

Light Sensing Automated Blinds, Andrew B. Hodges, Ryan C. Flick

Electrical Engineering

This project is solving the problem of wasted energy within buildings and homes, because currently the lights turned on inside building do not utilize natural, ambient light from the sun. Rather than having unnecessary light from a light source, the automated light sensing smart blinds can sense the amount of light outside the window and in the room, and then adjust the angle of the blinds to save energy by utilizing the available outdoor light. This way, the light source will not be running at maximum power output while there is excess light coming through the window. This project aims …

A Stroke Therapy Brace Design, Evan Kirkbride

Electrical Engineering

Victims of stroke often have difficulty with rehabilitation. With limited movement on their affected arm, patients often do not want to move much for physical therapy. In this project, we design a robotic brace that helps stroke patients move their arm more effectively in a reaching or pulling motion. By giving patients more movement in their affected arm than they would have otherwise, patients gain more from rehabilitation. The brace also adapts to the patient’s needs, providing more inclination or resistance as needed for their physical therapy. This kind of therapy engages patients rather than relying on their likely dwindled …

Innovative Connectivity Ensuring Education (I.-C.E.E.), Luke Cole, Andrew Ma, Nicholas Ross, Daniel Williams

Electrical Engineering

This is the critical design review for the Telepresence/Telerobotic Technology for Children with Disabilities Project by team I.- C.E.E. (Innovative Connectivity Ensuring Education). This report details our telepresence system design for our client (Nathan Stilts) including design choices/justification, testing verification and procedures, and chosen components for implementation. There are seven chapters in total starting with introductory/background information followed by hardware and software design, verification, and testing and concludes with the current status of the project and what future work may need to be included.

Remote/Autonomous Sentry Gun Platform, Angelo Gagliardi, Dante Gagliardi

Electrical Engineering

This senior project involves the complete system design and construction of a "Nerf" sentry gun to replace an armed guard. We aimed to develop a compact and highly mobile defense system that allows operational flexibility. The sentry gun can autonomously track and shoot at moving targets, while also allowing a user to remotely access and control the gun via computer. The mobility, hardiness, and functionality of this system allows a reliable replacement for human beings in harsh and hostile environments; ultimately sparing a life.

Autonomous Golf Cart Vision Using Hsv Image Processing And Commercial Webcam, John D. Fulton

Electrical Engineering

Using openCV I was able to use a store bought webcam and my laptop to build code that could detect the lane lines and the curb on the road and use them to calculate a trajectory for an autonomous vehicle to follow. The code does have some flaws, as discovered in testing, and definitely room for improvement but it still functions as a useful basis for development. Developed primarily for the Autonomous Golf Car Project at Cal Poly the principles of how it functions could be applied to other projects that want to use computer vision.