Hardware Systems Commons^™

Autonomous Vision-Based Litter Collection Rover, Dante Michael Benedetti, Benjamin Scott Tavares, Nathan Heil

Electrical Engineering

This report documents the design, implementation, and testing of an autonomous litter-collection rover developed as a Senior Project Design Lab (EE 460/463/464) at California Polytechnic State University. The rover integrates autonomy, computer vision, embedded real-time control, mecanum-wheel omnidirectional mobility, and a two-degree-of-freedom robotic arm to detect, approach, and collect small ground-level litter such as bottles, wrappers, and paper fragments.

The system uses a two-layer compute architecture: an NVIDIA Jetson Orin Nano running ROS 2 for perception, SLAM, and path planning, paired with an STM32L4A6ZG microcontroller for real-time motor control and odometry. The robot is built on a multi-level aluminum frame …

Design And Parametric Study Of A Mems-Based Reservoir Computer For Reinforcement Learning, Andrew P. Carr

Master's Theses

Single-node reservoir computing (RC) is a hardware-efficient approach to machine learning, leveraging the dynamics of physical systems. In this work, two reinforcement learning algorithms, Q-learning and Proximal Policy Optimization (PPO), are applied to a simulated micro-electro-mechanical system (MEMS)-based reservoir computer to solve both discrete and continuous control tasks. MEMS-based reservoirs are low-power, compact, and their natural frequencies (kHz to MHz) pair well with real-time control loops. To explore the relationship between reservoir dynamics and learning performance, a parametric study is conducted on two reservoir hyperparameters, reservoir size and neuron separation, using CartPole-v1 and MountainCar-v0. The RC successfully learns multiple tasks …

Optimizing Auv Perception For Competitive Underwater Robotics: Analyzing Performance And Simplicity Of Machine Vision Hardware, Joseph King

Honors Theses

Underwater robotics is a growing field with many practical applications, such as pipeline and offshore structure monitoring, deep sea mining, mine reconnaissance/removal, and marine environmental monitoring. USM’s Robotics Club will participate in the international RoboSub competition, where student-led teams build autonomous underwater vehicles (AUVs) that perform a variety of tasks within a pool requiring camera-based object detection. This project analyzes affordable hardware and software options for providing machine vision to USM’s future RoboSub AUV. The performance of an ESP32-CAM microcontroller, Raspberry Pi 5, and Jetson Orin Nano single-board computers running FOMO and YOLO object detection models was compared. These models …

3d Printed Portable Automatic Pill Dispenser​, Amber M. Ocasio

Publications and Research

Medication adherence is a major public health concern, particularly among patients with chronic illnesses. Reports from the National Institutes of Health indicate that adherence rates are significantly lower for chronic conditions, with patients taking only ~50% of medications prescribed. Unintentional non-adherence—such as forgetting doses—is more prevalent (62.9%, 47.1%, 46.9%) than intentional non-adherence, and the consequences include medication waste, disease progression, reduced functional abilities, lower quality of life, and increased reliance on medical resources. Because existing automatic pill dispensers cost over $100 on average, they remain inaccessible for many lower-income patients who could benefit from such technology. This project addresses this …

Rapid Prototyping Of Low-Cost Sensor Systems Towards A Platform For Upper Limb Posture Estimation, Russell Rathbun

Electrical Engineering and Computer Science Undergraduate Honors Theses

Physical therapy requires patients to perform repeated actions to achieve meaningful results in rehabilitation. This thesis explores production methods and various sensor systems by utilizing rapid prototyping, inertial measurement units (IMUs), and capacitive sensor arrays (CSAs). CSAs can be made from a wide ar- ray of materials and techniques including 3d printing and laser ablation–to rapidly create CSAs that can be custom fit to enable proximity, force, and touch detection. IMU and CSA systems individually are able to track upper limb movements, ges- tures, and positions. This combination of sensors enables accurate upper limb pos- ture estimation of patients. This …

Sistemas De Información Geográfica En La Era De La Digitalización, Jairo Eduardo Márquez Díaz, Luis Gonzalo Benavides Ramírez, Arles Prieto Moreno, Martha Andrea Manrique Castro

Ingeniería

En la era digital, la información geográfica es esencial para la toma de decisiones en áreas como la planificación urbana, la gestión de recursos naturales y la seguridad. Los Sistemas de Información Geográfica (SIG) se han establecido como herramientas indispensables para gestionar, analizar y visualizar datos georreferenciados que permite la creación de mapas digitales y la toma de decisiones basada en evidencia. Este libro aborda los fundamentos, las tecnologías y las aplicaciones de los SIG, explorando su evolución y su potencial en un entorno digital en constante transformación. A lo largo de sus cinco capítulos, el libro aborda temas esenciales …

Low-Level Memory Attacks On Edge Assisted Robotic Applications, William Arnold

Master of Engineering Theses

This thesis investigates how low-level memory faults can undermine edge-assisted robotic systems that rely on memory optimization. As robots are utilized in real world applications, the ability to operate safely and successfully in mission critical deployment becomes important. To help achieve these goals, developers are increasingly starting to place computation nodes at network edges to meet latency and reliability requirements. Edge nodes, however, are resource-constrained and resources conservation techniques such as Kernel Same-page Merging (KSM) are enabled to deduplicate identical pages across processes or virtual machines. This thesis shows that this optimization technique quietly widens the attack surface and can …

Ecodrone: Autonomous Environmental Monitoring, Belsen Lee

Student Scholar Symposium Abstracts and Posters

This project presents EcoDrone, an autonomous aerial drone designed for continuous and automated environmental monitoring. Current environmental monitoring methods rely on stationary sensors or manual data collection, limiting real-time response capabilities. This reliance leads to delayed, incomplete, and spatially limited data and restricts the ability to capture real-time changes. Another challenge includes the difficulty of environmental monitoring in challenging terrain, whether it be wildfire areas, dense forestry, or mountainous terrain. EcoDrone overcomes these challenges by autonomously navigating difficult terrain to collect real-time data, offering more flexible and timely monitoring than stationary or manual methods. The central research question investigates integrating …

Swvl: A Custom Ai-Powered Face Tracking Camera Gimbal, Alexander J. Anderson-Mcleod, Jakub Jerzmanowski, Michael Laitarovsky, Trevor Allison, Jagger Tanner

Senior Theses

In response to the growing demand for smarter, more responsive face tracking cameras in the post-pandemic world, our team designed SWVL, a custom AI-powered face tracking gimbal meant to address the limitations commonly encountered by the commercial models currently on the market. These commercially available gimbals come with several issues, such as frequently losing track of the person in the frame and requiring manual resets, which we sought to fix with our implementation. We designed a system with fully custom hardware and software including a 3D printed dual-axis camera gimbal driven by stepper motors, a control PCB based around an …

Exploring Smart Thermostat, Don P. Dang

2024 Fall Honors Capstone Projects - Archive

This study examines the security, privacy, and compatibility challenges associated with smart thermostats in smart home systems. Smart thermostats, as part of the growing Internet of Things (IoT) ecosystem, face vulnerabilities such as unauthorized access, data breaches, and inconsistent security protocols. Using a mixed-methods approach, this research evaluates encryption techniques, communication protocols (Zigbee, Z-Wave, Wi Fi), and user behaviors that impact system security and efficiency. Key findings indicate that 35% of users are concerned about hacking risks, while 25% express data privacy concerns. Many users lack awareness of security measures, such as firmware updates and password management, which increases vulnerabilities. …

Summonable Construction Delivery Robot, Kevin M. Lewis

Honors Capstones

In many different construction industries, there is a need for tools, parts, and other necessary items to be transported quickly and efficiently over various types of terrain. Human resources have often been used to address these needs, which can become very time and cost inefficient over long periods. The design proposal here is aimed at addressing this need by developing an autonomous outdoor mobile robot based on a quadrupedal robot design. This approach differs by incorporating a wheeled and quadrupedal hybrid actuation system that provides terrain negotiation and speed at the appropriate times. The team uses Robot Operating System (ROS) …

Securing Edge Computing: A Hierarchical Iot Service Framework, Sajan Poudel, Nishar Miya, Rasib Khan

Posters-at-the-Capitol

Title: Securing Edge Computing: A Hierarchical IoT Service Framework

Authors: Nishar Miya, Sajan Poudel, Faculty Advisor: Rasib Khan, Ph.D.

Department: School of Computing and Analytics, College of Informatics, Northern Kentucky University

Abstract:

Edge computing, a paradigm shift in data processing, faces a critical challenge: ensuring security in a landscape marked by decentralization, distributed nodes, and a myriad of devices. These factors make traditional security measures inadequate, as they cannot effectively address the unique vulnerabilities of edge environments. Our research introduces a hierarchical framework that excels in securing IoT-based edge services against these inherent risks.

Our secure by design approach prioritizes …

Mobile Robot Adhesion Methodology And Development Of An Automatous Robot Module, Lauren Baird, Zachariah Stone, Madison Lemons, Jonathon Moody

Williams Honors College, Honors Research Projects

Due to the increasing availability of space travel as not only a scientific exploration but a commercial exploration, there is a need for an onsite repair station that can be deployed in the event of aircraft maintenance, damage, or failure. We have been tasked with researching and creating a prototype of an automatous robot that can be attached to a spacecraft body, move along the surface while avoiding obstacles, scan for damage, 3D print a repair piece, and then make the repair, all without the need of direct human input. Our team, as will be discussed throughout, was tasked with …

Autonomous Basketball Court Creation Robot, Bryce Haldeman, Tyler Gray, Dalon Vura

Williams Honors College, Honors Research Projects

The Autonomous Basketball Court Outlining System presents a comprehensive solution for precision court marking. Powered by a 24V lithium-ion battery and driven by a single ST microcontroller, the system autonomously marks the outline of a half basketball court using predefined algorithms. User-friendly features include easy loading of marking material, actuated by gravity or a small servo motor depending on material of choice, ensuring intuitive operation. Safety is prioritized, with the servo motor eliminating high-pressure concerns, and the system maintains a controlled speed accounting for user well-being. Two step and direction servo motors enable accurate linear displacement, facilitating straight lines, and …

The Integration Of Neuromorphic Computing In Autonomous Robotic Systems, Md Abu Bakr Siddique

Dissertations, Master's Theses and Master's Reports

Deep Neural Networks (DNNs) have come a long way in many cognitive tasks by training on large, labeled datasets. However, this method has problems in places with limited data and energy, like when planetary robots are used or when edge computing is used [1]. In contrast to this data-heavy approach, animals demonstrate an innate ability to learn by communicating with their environment and forming associative memories among events and entities, a process known as associative learning [2-4]. For instance, rats in a T-maze learn to associate different stimuli with outcomes through exploration without needing labeled data [5]. This learning paradigm …

Implementing Associative Learning Using Neuromorphic Robot, Vinay Kumar Pillalamarri

Dissertations, Master's Theses and Master's Reports

Associative learning, a key cognitive process seen across the animal kingdom, enables organisms to form connections between stimuli and adapt their behaviors based on past experiences. A particularly powerful example is fear conditioning, where animals learn to associate a neutral stimulus with an aversive one, allowing them to predict and avoid potential threats. Inspired by this mechanism, this project implements associative learning on an unmanned ground vehicle (UGV) to develop adaptive behavior through neuromorphic principles. Utilizing Nengo for neural modeling, the UGV learns to associate visual (red color) and tactile (vibration) stimuli through Hebbian learning, a biologically inspired synaptic adaptation …

Drones For Marine Science And Agriculture, David Caldera, Sai Murthy

College of Engineering Summer Undergraduate Research Program

Our research project was launched at Cal Poly in 2019 with the goal of assisting researchers at the CSULB Shark Lab in detecting sharks from aerial images. Under the guidance of Dr. Franz J. Kurfess, students trained an object detection algorithm using shark images and were able to achieve high rate of detection. Following this success, the team has constructed multiple drones and expanded their research to include applications in the fields of agriculture and ecology. This summer the goal is to use a iPhone 14 Pro in lieu of a traditional camera system for real-time object recognition. Object detection …

Accurate Indoor Navigation System Based On Imu/Lp-Mm Integrated Method Using Kalman Filter Algorithm, Abdullah Mohammed Bahasan

Hadhramout University Journal of Natural & Applied Sciences

Abstract

The demand for navigation systems is rapidly increasing, especially in indoor environments which the signal of GPS is not available. Therefore the Inertial Measurement Unit (IMU) system is a suitable navigation system in such indoor environments. It usually consists of three accelerometers and three gyroscopes to determine position, velocity and attitude information, respectively, without need of any external source. But this type of navigation systems has errors growth with time due to accelerometers and gyroscopes drifts. This paper introduces indoor navigation system based on integrated IMU navigation system with proposed system called Landmarks Points-Map Matching (LP-MM) system using Kalman …

Chatgpt As Metamorphosis Designer For The Future Of Artificial Intelligence (Ai): A Conceptual Investigation, Amarjit Kumar Singh (Library Assistant), Dr. Pankaj Mathur (Deputy Librarian)

Library Philosophy and Practice (e-journal)

Abstract

Purpose: The purpose of this research paper is to explore ChatGPT’s potential as an innovative designer tool for the future development of artificial intelligence. Specifically, this conceptual investigation aims to analyze ChatGPT’s capabilities as a tool for designing and developing near about human intelligent systems for futuristic used and developed in the field of Artificial Intelligence (AI). Also with the helps of this paper, researchers are analyzed the strengths and weaknesses of ChatGPT as a tool, and identify possible areas for improvement in its development and implementation. This investigation focused on the various features and functions of ChatGPT that …

A Camera-Only Based Approach To Traffic Parameter Estimation Using Mobile Observer Methods, Temitope D. Jegede

College of Graduate Studies: Theses & Dissertations

As vehicles become more modern, a large majority of vehicles on the road will have the required sensors to smoothly interact with other vehicles and infrastructure on the road. There will be many benefits of this new connectivity between vehicles on the road but one of the most profound improvements will be in the area of road accident prevention. Vehicles will be able to share information vital to road safety to oncoming vehicles and vehicles that are occluded so they do not have a direct line of sight to see a pedestrian or another vehicle on the road.

Another advantage …

Imitation Learning For Swarm Control Using Variational Inference, Hafeez Olafisayo Jimoh

Graduate Theses, Dissertations, and Problem Reports (ETD)

Swarms are groups of robots that can coordinate, cooperate, and communicate to achieve tasks that may be impossible for a single robot. These systems exhibit complex dynamical behavior, similar to those observed in physics, neuroscience, finance, biology, social and communication networks, etc. For instance, in Biology, schools of fish, swarm of bacteria, colony of termites exhibit flocking behavior to achieve simple and complex tasks. Modeling the dynamics of flocking in animals is challenging as we usually do not have full knowledge of the dynamics of the system and how individual agent interact. The environment of swarms is also very noisy …

Therapeutic Mechanical Horse, Cade M. Liberty, Aleya Dolorfino, Peter Philips, Zuzanna Dominik, Luke Watts

Mechanical Engineering

Jack's Helping Hand and its hippotherapy participants required a device to serve as an alternative to a live horseback riding experience that could also increase the range of riders. This would provide more clients with equine-assisted therapy that has proven to better the lives of people with both physical and mental disabilities. Horses can be unpredictable, tall, and sometimes anxiety-inducing, especially for new riders. Our group’s aim was to develop a mechanical horse that will be able to reduce these issues for equine therapy centers and the riders they help. When a rider gets to practice sitting on the horse …

Smartphone Control Of Rc Cars, Weston R. Fitzgerald

Electrical Engineering

The smartphone-controlled RC (remote-controlled) car is an inexpensive remote-controlled car designed to be fast and portable. Instead of manufacturing, packaging, and shipping a separate controller, the remote control is implemented in a phone application, which saves time and money in both the design process and the manufacturing process. Utilizing the user’s smartphone is more cost-effective since mobile devices are a common recurrence, and packaging fewer devices results in overall better portability of the product.

This smartphone-controlled car is speedy and intuitive to learn for typical smartphone users. The user can change the car’s speed and direction wirelessly using their phone; …

Cloudbots: Autonomous Atmospheric Explorers, Akash Binoj

Honors Scholar Theses

The CloudBot is an autonomous weather balloon that operates on the principle of variable buoyancy to ascend and descend in the atmosphere. This project aims to develop a device that will collect atmospheric measurements and communicate them mid-flight. The apparatus consists of a helium-filled balloon, the robotic payload, and an air cell. The fixed-volume helium balloon at the top provides an upwards buoyancy force, while the air cell at the bottom can hold a variable amount of pressure to adjust the weight of the CloudBot. By doing so, it is able to travel in storm conditions and collect valuable atmospheric …

Autonomous Navigator Mobile Robot Upgrade, David Sansoucy

Thinking Matters Symposium

The mobile robot platform has been developed over the course of 10 years at USM. In Spring 2020, Belle-Isle and Werner updated the previous framework by rewriting the software to use the ROS framework running on an on-board Raspberry Pi 3. They also implemented navigation using an A* motion planning algorithm and image processing. In Summer 2021, Ames incorporated Lidar and Kinect sensors onto the robot to improve its real-time navigation capabilities. He also made improvements to the power distribution systems. This project aimed to build on the ROS frameworks developed by the previous 2 teams with the main goal …

Garden Bot: Autonomous Home Garden Weed Removal Robot, Brendon Lovejoy, Robert Connolly, Isaac Lucas, Stevan Veselinov

Williams Honors College, Honors Research Projects

With frequent weeding being a tedious chore and an essential task for a successful garden, there is need for an automated method of handling this routine. Existing technologies utilize computer vision, GPS, multiple units and other tools to remove weeds from garden plots. However, these solutions are often complex and expensive, suited for large agricultural plots in contrast to small-scale home gardens. In addition, many of these technologies, along with manual tillers and cultivators suited for home use, are unable to perform weeding within rows of crops in a process known as intra-row weeding. The Garden Bot is an autonomous, …

Demo Abstract: Porting And Execution Of Anomalies Detection Models On Embedded Systems In Iot, Bharath Sudharsan, Pankesh Patel, Abdul Wahid, Muhammad Yahya, John G. Breslin, Muhammad Intizar Ali

Publications

In the Industry 4.0 era, Microcontrollers (MCUs) based tiny embedded sensor systems have become the sensing paradigm to interact with the physical world. In 2020, 25.6 billion MCUs were shipped, and over 250 billion MCUs are already operating in the wild. Such low-power, low-cost MCUs are being used as the brain to control diverse applications and soon will become the global digital nervous system. In an Industrial IoT setup, such tiny MCU-based embedded systems are equipped with anomaly detection models and mounted on production plant machines for monitoring the machine’s health/condition. These models process the machine’s health data (from temperature, …

Cognitive Digital Twins For Smart Manufacturing, Muhammad Intizar Ali, Pankesh Patel, John G. Breslin, Ramy Harik, Amit Sheth

Publications

Smart manufacturing or Industry 4.0, a trend initiated a decade ago, aims to revolutionize traditional manufacturing using technology-driven approaches. Modern digital technologies such as the Industrial Internet of Things (IIoT), Big Data Analytics, Augmented/Virtual Reality, and Artificial Intelligence (AI) are the key enablers of new smart manufacturing approaches. The digital twin is an emerging concept whereby a digital replica can be built of any physical object. Digital twins are becoming mainstream; many organizations have started to rely on digital twins to monitor, analyze, and simulate physical assets and processes. The current use of digital twins for smart manufacturing is largely …

Light Loaded Automated Guided Vehicle, Marcus Radtka, Nazar Paramashchuk, Lawrence Shevock

Williams Honors College, Honors Research Projects

The objective of the locomotion system was to design and implement the mechanical, electrical, and software related functions to ensure the LLAGV had the capability of maneuvering its surroundings. The LLAGV’s motors were represented in an open loop transfer function to utilize RPM feedback and a compensator when needed. The modeled compensator helped control the LLAGV’s speed and acceleration, enabling further control of the LLAGV. The internal circuitry has the means to properly distributed power to all components and allowed the user to control the LLAGV to their desire. The application software within the LLAGV locomotion system (LLAGV-LS) had consideration …

Integration Of Robotic And Electro-Pneumatic Systems Using Advanced Control And Communication Schemes, Chinmay Kondekar

Dissertations, Master's Theses and Master's Reports

Modern industrial automation systems are designed by interconnecting various subsystems which work together to perform a process. The thesis project aims to integrate fragmented subsystems into a flexible and reconfigurable system through advanced communication protocols and perform a process to demonstrate the effectiveness of interconnected systems.

The system consists of three six-axis robots, one electro-pneumatic robot, and two conveyors connected using EthernetIP communication and hardwired connections. The interconnected system works together to perform machining of a workpiece using advanced control methods of CAD to robot path generation, central control through a PLC, and process control through HMI.

Standardized programming blocks …