Other Electrical and Computer Engineering Commons^™

Autonomous Vision-Based Litter Collection Rover, Dante Michael Benedetti, Benjamin Scott Tavares, Nathan Heil

Electrical Engineering

This report documents the design, implementation, and testing of an autonomous litter-collection rover developed as a Senior Project Design Lab (EE 460/463/464) at California Polytechnic State University. The rover integrates autonomy, computer vision, embedded real-time control, mecanum-wheel omnidirectional mobility, and a two-degree-of-freedom robotic arm to detect, approach, and collect small ground-level litter such as bottles, wrappers, and paper fragments.

The system uses a two-layer compute architecture: an NVIDIA Jetson Orin Nano running ROS 2 for perception, SLAM, and path planning, paired with an STM32L4A6ZG microcontroller for real-time motor control and odometry. The robot is built on a multi-level aluminum frame …

Design And Parametric Study Of A Mems-Based Reservoir Computer For Reinforcement Learning, Andrew P. Carr

Master's Theses

Single-node reservoir computing (RC) is a hardware-efficient approach to machine learning, leveraging the dynamics of physical systems. In this work, two reinforcement learning algorithms, Q-learning and Proximal Policy Optimization (PPO), are applied to a simulated micro-electro-mechanical system (MEMS)-based reservoir computer to solve both discrete and continuous control tasks. MEMS-based reservoirs are low-power, compact, and their natural frequencies (kHz to MHz) pair well with real-time control loops. To explore the relationship between reservoir dynamics and learning performance, a parametric study is conducted on two reservoir hyperparameters, reservoir size and neuron separation, using CartPole-v1 and MountainCar-v0. The RC successfully learns multiple tasks …

Temporal Logic Planning In Semantic Maps Of Unknown Environments Using Tl-Rrt, Dongrui Yang

McKelvey School of Engineering Graduate Student Theses & Dissertations

Autonomous mobile robots are increasingly expected to perform complex missions in unstructured environments. Traditional path planning approaches handle simple point-to-point navigation, but struggle with complex tasks that involve temporal and logical orderings of objectives. Linear Temporal Logic (LTL) provides a method for complex missions (e.g., sequential visits to multiple targets or surveillance tasks) in a strict way. This thesis presents an integrated planning framework that enables a robot to satisfy LTL-based task specifications in an unknown environment by combining a Temporal Logic RRT* (TL-RRT*) planner with semantic mapping. The robot builds a semantic map of its environment online using simultaneous …

A Low-Cost Motion Classification System For A Stuffed Animal Using An Imu And Machine Learning, Rachel N. Guynes

Honors Theses

One of the many fields that has seen the integration of robots is therapy. Zoomorphic robots (ZR) are designed to look and behave like animals to assist in Animal Assisted Therapy (AAT) practices. Studies show that ZRs can provide benefits similar to working with an actual animal; however, their high cost limits their accessibility. This thesis documents the process of building a real-time, low-cost motion classification system that can be attached to a stuffed animal to make it more interactive. Using a Random Forest (RF) classifier, the system identifies movements with approximately 81.67% accuracy.

Behavioral-Centric Team Evaluation Via Consistent Rewards, Clement Kudakwashe Nyanhongo

Dartmouth College Ph.D Dissertations

Across human domains ranging from sports to business and organizational settings, complex tasks are often solved by teams rather than individuals, leveraging benefits such as interaction, mutual support, complementary skills, cohesion, and task allocation. Evaluating team effectiveness, however, is inherently challenging due to the subjectivity of many existing techniques and the limitations of outcome-driven metrics that primarily focus on performance scores while overlooking the team processes that generated the scores. To address these challenges, this dissertation proposes a behavioral-centric, end-to-end framework for team evaluation grounded in reward functions that model sequential team behavior. Reward functions offer compact and interpretable representations …

Autonomous Mapping Rover, Garrett Jones, Timothy Kyle Chu, Eugenio Caruso Pasos

Electrical Engineering

This report details the design, implementation, and evaluation of "Rovero," an autonomous mapping rover developed as a senior project. Rovero integrates state-of-the-art technologies, including ROS2 for communication, SLAM algorithms for mapping, and sensor fusion for accurate navigation. The project aimed to achieve robust autonomous operation in indoor environments, leveraging a combination of LiDAR, IMU, and encoder data for real-time decision-making. Key challenges addressed include path planning, obstacle avoidance, and integration of multiple sensor inputs. Results demonstrate successful mapping capabilities and efficient navigation performance.

Exploring Smart Thermostat, Don P. Dang

2024 Fall Honors Capstone Projects - Archive

This study examines the security, privacy, and compatibility challenges associated with smart thermostats in smart home systems. Smart thermostats, as part of the growing Internet of Things (IoT) ecosystem, face vulnerabilities such as unauthorized access, data breaches, and inconsistent security protocols. Using a mixed-methods approach, this research evaluates encryption techniques, communication protocols (Zigbee, Z-Wave, Wi Fi), and user behaviors that impact system security and efficiency. Key findings indicate that 35% of users are concerned about hacking risks, while 25% express data privacy concerns. Many users lack awareness of security measures, such as firmware updates and password management, which increases vulnerabilities. …

Convex Approach To Data-Driven Optimal Control With Safety Constraints Using Linear Transfer Operator, Joseph Raphel Moyalan

All Dissertations

This thesis is concerned with the data-driven solution to the optimal control problem with safety constraints for a class of control-affine nonlinear systems. Designing optimal control satisfying safety constraints is a problem of interest in various applications, including robotics, power systems, transportation networks, and manufacturing. This problem is known to be non-convex. One of this thesis's main contributions is providing a convex formulation to this non-convex problem. The second main contribution is providing a data-driven framework for solving the control problem with safety constraints. The linear operator theoretic framework involving Perron-Frobenius and Koopman operators provides the convex formulation and associated …

Autonomous Apple Harvester Robot, Jack Ryan Cline, Tyus Green, Devon Woolston

Electrical Engineering

As agricultural demands rise and manual labor costs increase, there has become a dire need to automate apple harvesting. However, the precision and speed necessary for cost-efficient apple harvesting pose a significant challenge for robotic automation. To maintain cost-effective production, a harvester must be able to operate fast enough and long enough to compete with human labor. It must also be able to navigate and traverse apple orchards autonomously and pick apples without damaging the fruit or tree. This project presents an apple harvesting robot that uses a Mask R-CNN vision system with an RGB-D camera to detect the location …

Modeling And Compensating Of Noise In Time-Of-Flight Sensors, Bryan Rodriguez

Electrical Engineering Theses and Dissertations

Three-dimensional (3D) sensors provide the ability to perform contactless measurements of objects and distances that are within their field of view. Unlike traditional two-dimensional (2D) cameras, which only provide RGB data about objects within a scene, 3D sensors are able to directly provide depth information for objects within a scene. Of these 3D sensing technologies, Time-of-Flight (ToF) sensors are becoming more compact which allows them to be more easily integrated with other devices and to find use in more applications. ToF sensors also provide several benefits over other 3D sensing technologies that increase the types of applications where ToF sensors …

A Study On Rapidly Exploring Random Tree Algorithms For Robot Path Planning, Sahil Sharma

Master's Theses

Robot path planning is a critical feature of autonomous systems. Rapidly-exploring Random Trees (RRT) is a path planning technique that randomly samples the robot configuration space to find a path between the start and end point. This thesis studies and compares the performance of four important RRT algorithms, namely, the original RRT, the optimal RRT (also termed RRT*), RRT*-Smart, and Informed RRT* for six different environments. The performance measures include the final path length (which is also the shortest path length found by each algorithm), time to find the first path, run time (of 1000 iterations) for each algorithm, total …

Faults Segmentation In Levee Systems Using Deep Learning Approaches, Manisha Panta

LSU New Orleans Theses and Dissertations

Levees are earthen structures constructed to mitigate flooding in low-lying areas. Although levee systems can reduce flood risks, they cannot completely eliminate them. Failures within flood control systems due to inadequate maintenance or strong water currents can lead to significant property damage and catastrophic loss of life, as was seen during Hurricane Katrina. Consequently, regular inspections are essential to identify and address any issues with the levees promptly. However, current inspection methods rely on manual techniques that are time-consuming, labor-intensive, and prone to human error. Therefore, this study proposes using deep learning models for more efficient and frequent assessment of …

Chatgpt As Metamorphosis Designer For The Future Of Artificial Intelligence (Ai): A Conceptual Investigation, Amarjit Kumar Singh (Library Assistant), Dr. Pankaj Mathur (Deputy Librarian)

Library Philosophy and Practice (e-journal)

Abstract

Purpose: The purpose of this research paper is to explore ChatGPT’s potential as an innovative designer tool for the future development of artificial intelligence. Specifically, this conceptual investigation aims to analyze ChatGPT’s capabilities as a tool for designing and developing near about human intelligent systems for futuristic used and developed in the field of Artificial Intelligence (AI). Also with the helps of this paper, researchers are analyzed the strengths and weaknesses of ChatGPT as a tool, and identify possible areas for improvement in its development and implementation. This investigation focused on the various features and functions of ChatGPT that …

Evaluation Of Lidar Uncertainty And Applications Towards Slam In Off-Road Environments, Zachary D. Jeffries

Dissertations, Master's Theses and Master's Reports

Safe and robust operation of autonomous ground vehicles in all types of conditions and environment necessitates complex perception systems and unique, innovative solutions. This work addresses automotive lidar and maximizing the performance of a simultaneous localization and mapping stack. An exploratory experiment and an open benchmarking experiment are both presented. Additionally, a popular SLAM application is extended to use the type of information gained from lidar characterization, demonstrating the performance gains and necessity to tightly couple perception software and sensor hardware. The first exploratory experiment collects data from child-sized, low-reflectance targets over a range from 15 m to 35 m. …

Smartphone Control Of Rc Cars, Weston R. Fitzgerald

Electrical Engineering

The smartphone-controlled RC (remote-controlled) car is an inexpensive remote-controlled car designed to be fast and portable. Instead of manufacturing, packaging, and shipping a separate controller, the remote control is implemented in a phone application, which saves time and money in both the design process and the manufacturing process. Utilizing the user’s smartphone is more cost-effective since mobile devices are a common recurrence, and packaging fewer devices results in overall better portability of the product.

This smartphone-controlled car is speedy and intuitive to learn for typical smartphone users. The user can change the car’s speed and direction wirelessly using their phone; …

Combat Robot, Wayne Lambert, Elijah Harris, Brian Eiseman, Jordan Meyer

ONU Student Research Colloquium

The senior capstone project that was tasked to the team was the decision of choosing a challenge within a national robotics competition. The group decided to compete at the National Robotics Challenge in Marion, Ohio. The idea was to participate in the combat robot competition at this NRC event. Once this decision had been made the next steps were to get an idea of what the rules and requirements of the competition were and to try and to sketch a very rough drawing of what the ideal robot should look like. From there it was decided to start a timeline …

Multimodal Adversarial Learning, Uche Osahor

Graduate Theses, Dissertations, and Problem Reports (ETD)

Deep Convolutional Neural Networks (DCNN) have proven to be an exceptional tool for object recognition, generative modelling, and multi-modal learning in various computer vision applications. However, recent findings have shown that such state-of-the-art models can be easily deceived by inserting slight imperceptible perturbations to key pixels in the input. A good target detection systems can accurately identify targets by localizing their coordinates on the input image of interest. This is ideally achieved by labeling each pixel in an image as a background or a potential target pixel. However, prior research still confirms that such state of the art targets models …

Owsnet: Towards Real-Time Offensive Words Spotting Network For Consumer Iot Devices, Bharath Sudharsan, Sweta Malik, Peter Corcoran, Pankesh Patel, John G. Breslin, Muhammad Intizar Ali

Publications

Every modern household owns at least a dozen of IoT devices like smart speakers, video doorbells, smartwatches, where most of them are equipped with a Keyword spotting(KWS) system-based digital voice assistant like Alexa. The state-of-the-art KWS systems require a large number of operations, higher computation, memory resources to show top performance. In this paper, in contrast to existing resource-demanding KWS systems, we propose a light-weight temporal convolution based KWS system named OWSNet, that can comfortably execute on a variety of IoT devices around us and can accurately spot multiple keywords in real-time without disturbing the device's routine functionalities.

When OWSNet …

Cognitive Digital Twins For Smart Manufacturing, Muhammad Intizar Ali, Pankesh Patel, John G. Breslin, Ramy Harik, Amit Sheth

Publications

Smart manufacturing or Industry 4.0, a trend initiated a decade ago, aims to revolutionize traditional manufacturing using technology-driven approaches. Modern digital technologies such as the Industrial Internet of Things (IIoT), Big Data Analytics, Augmented/Virtual Reality, and Artificial Intelligence (AI) are the key enablers of new smart manufacturing approaches. The digital twin is an emerging concept whereby a digital replica can be built of any physical object. Digital twins are becoming mainstream; many organizations have started to rely on digital twins to monitor, analyze, and simulate physical assets and processes. The current use of digital twins for smart manufacturing is largely …

Integration Of Robotic And Electro-Pneumatic Systems Using Advanced Control And Communication Schemes, Chinmay Kondekar

Dissertations, Master's Theses and Master's Reports

Modern industrial automation systems are designed by interconnecting various subsystems which work together to perform a process. The thesis project aims to integrate fragmented subsystems into a flexible and reconfigurable system through advanced communication protocols and perform a process to demonstrate the effectiveness of interconnected systems.

The system consists of three six-axis robots, one electro-pneumatic robot, and two conveyors connected using EthernetIP communication and hardwired connections. The interconnected system works together to perform machining of a workpiece using advanced control methods of CAD to robot path generation, central control through a PLC, and process control through HMI.

Standardized programming blocks …

Artificial Intelligence Towards Future Industrial Opportunities And Challenges, Gizealew Dagnaw

African Conference on Information Systems and Technology

The industry 4.0 will bring reflective changes to our society, including an important digital shift in the manufacturing sector. At present, several manufacturing firms are trying to adopt the practices of industry 4.0 throughout their supply chain. The Fourth Industrial Revolution and the artificial intelligence at its core are fundamentally changing the way we live, work and interact as citizens. The complexity of this transformation may look overwhelming and to many threatening. Recently, the dramatic growth of new generation information technologies has prompted several countries to seek new strategies for industrial revolution. The globalization and the competitiveness are forcing companies …

Dual-Axis Solar Tracker, Bryan Kennedy

All Undergraduate Projects

Renewable energies, and fuels that are not fossil fuel-based, are one of the prolific topics of debate in modern society. With climate change now becoming a primary focus for scientists and innovators of today, one of the areas for the largest amount of potential and growth is that of the capturing and utilization of Solar Energy. This method involves using a mechanical system to track the progression of the sun as it traverses the sky throughout the day. A dual-axis solar tracker such as the one designed and built for this project, can follow the sun both azimuthally and in …

Utilizing Trajectory Optimization In The Training Of Neural Network Controllers, Nicholas Kimball

Master's Theses

Applying reinforcement learning to control systems enables the use of machine learning to develop elegant and efficient control laws. Coupled with the representational power of neural networks, reinforcement learning algorithms can learn complex policies that can be difficult to emulate using traditional control system design approaches. In this thesis, three different model-free reinforcement learning algorithms, including Monte Carlo Control, REINFORCE with baseline, and Guided Policy Search are compared in simulated, continuous action-space environments. The results show that the Guided Policy Search algorithm is able to learn a desired control policy much faster than the other algorithms. In the inverted pendulum …

Real Time And High Fidelity Quadcopter Tracking System, Tyler Mckay Hall

Computer Engineering

This project was conceived as a desired to have an affordable, flexible and physically compact tracking system for high accuracy spatial and orientation tracking. Specifically, this implementation is focused on providing a low cost motion capture system for future research. It is a tool to enable the further creation of systems that would require the use of accurate placement of landing pads, payload acquires and delivery. This system will provide the quadcopter platform a coordinate system that can be used in addition to GPS.

Field research with quadcopter manufacturers, photographers, agriculture and research organizations were contact and interviewed for information …

Optimized Trajectory Generation For Car-Like Robots On A Closed Loop Track, Tyler Friedl

Electronic Theses and Dissertations

This thesis presents a method for generating an optimized path through a given track. The path is generated by choosing waypoints throughout the track then iteratively optimizing the position of these waypoints. The waypoints are then connected by optimized paths represented by curvature polynomials. The end result is a path through the track represented as a spline of curvature polynomials. This method is applied to multiple simulated tracks and the results are presented. By generating and representing the paths in the continuous domain, the method has improved computational efficiency from many of the discrete methods used to generate an optimal …

Omni-Directional Infrared 3d Reconstruction And Tracking Of Human Targets, Emrah Benli

Theses and Dissertations

Omni-directional (O-D) infrared (IR) vision is an effective capability for mobile systems in robotics, due to its advantages: illumination invariance, wide field-of-view, ease of identifying heat-emitting objects, and long term tracking without interruption. Unfortunately, O-D IR sensors have low resolution, low frame rates, high cost, sensor noise, and an increase in tracking time. In order to overcome these disadvantages, we propose an autonomous system application in indoor scenarios including 1) Dynamic 3D Reconstruction (D3DR) of the target view in real time images, 2) Human Behavior-based Target Tracking from O-D thermal images, 3) Thermal Multisensor Fusion (TMF), and 4) Visual Perception …

Electronic Deer Warning System, David Zhuo, Anlang Lu

Computer Engineering

Deer-vehicle collisions (DVCs) are extremely dangerous, often injuring or even killing drivers. Unfortunately, this form of automotive accident is commonplace in the United States. According to the NHTSA, DVCs result in 200 human deaths a year.2

Despite these deadly incidents, there currently are no deployed federal or state systems for preventing DVCs. There are many consumer electronic deer deterrent products, but their long-term effectiveness is questionable.3 In fact, there does not appear to be much research into electronic deer deterrent systems. Aside from constant audio output and electric shock, no other means of electronic deterrent exist. Even if fixed deterrents …

Modeling A Sensor To Improve Its Efficacy, Nabin K. Malakar, Daniil Gladkov, Kevin H. Knuth

Physics Faculty Scholarship

Robots rely on sensors to provide them with information about their surroundings. However, high-quality sensors can be extremely expensive and cost-prohibitive. Thus many robotic systems must make due with lower-quality sensors. Here we demonstrate via a case study how modeling a sensor can improve its efficacy when employed within a Bayesian inferential framework. As a test bed we employ a robotic arm that is designed to autonomously take its own measurements using an inexpensive LEGO light sensor to estimate the position and radius of a white circle on a black field. The light sensor integrates the light arriving from a …

A Midsummer Night’S Dream (With Flying Robots), Robin Murphy, Dylan Shell, Amy Guerin, Brittany Duncan, Benjamin Fine, Kevin Pratt, Takis Zourntos

School of Computing: Faculty Publications

Seven flying robot “fairies” joined human actors in the Texas A&M production of William Shakespeare’s A Midsummer Night’s Dream. The production was a collaboration between the departments of Computer Science and Engineering, Electrical and Computer Engineering, and Theater Arts. The collaboration was motivated by two assertions. First, that the performing arts have principles for creating believable agents that will transfer to robots. Second, the theater is a natural testbed for evaluating the response of untrained human groups (both actors and the audience) to robots interacting with humans in shared spaces, i.e., were believable agents created? The production used two types …

Ultrasonic Shark-Tag Locator System For Iver2 Auv, Nathaniel Garcia

Computer Engineering

The purpose of this project is to develop a system for tracking an ultrasonic underwater transmitter that can be integrated into an IVER2 AUV to allow it to follow and monitor tagged sharks in the ocean for scientific research.

The system consists of a four main components including a shark-tag, two hydrophones, a filter/amplifier & threshold detector circuit, and a microcontroller.

This project, while not completing field testing and integration with the IVER2, is a proof of concept of a system that utilizes passive sonar to determine a bearing from the system to a shark-tag transmitter. Additionally, it devised several …