Other Computer Engineering Commons^™

Algorithms & Design Behind Autonomous Uavs And Ugvs Coordinated System, Aashish Dhakal

Honors Theses

Unmanned Aerial Vehicles (UAVs) and Unmanned Ground Vehicles (UGVs), when coordinated effectively, offer substantial potential for automating large-scale tasks—from search and rescue operations to precision agriculture. However, synchronizing these autonomous systems remains challenging, especially in time-sensitive missions requiring precision. This thesis investigates the design and algorithmic coordination of autonomous UAVs and UGVs, examining both single-vehicle scenarios and multi-agent (swarming) approaches. Using the Robot Operating System (ROS) as a communication backbone, I integrate GPS positioning with computer vision techniques through OpenCV, enabling accurate localization and object detection. During the development phase, I validate my methods using ArduPilot Software-in-the-Loop (SITL) simulations within …

Cca Analysis Using Computer Vision Techniques, Rahul Thakur

Master's Projects

Coral reefs are an essential part of the marine ecosystem. They perform a wide variety of tasks, some directly and others indirectly. They can produce oxygen, absorb carbon dioxide, along with supporting ocean habitat. Crustose Coralline Algae (“CCA”) plays an important role in helping provide structural support to Coral Reef ecosystems. However, global warming is causing ocean water to become more acidic resulting in coral bleaching. This is leading to changes in coral environments and causing coral deaths at alarming rates. Object detection using computer vision techniques, specifically deep learning, can help to monitor coral reef health and identify CCA …

Effects Of Data Augmentation On Sponge Identification Using Computer Vision Models, George Ku

Master's Projects

Coral reefs can be primarily found in tropical and sub-tropical regions of our oceans, providing a thriving habitat for millions of species. Marine sponges, which can be frequently found in coral reefs, play a critical role that contributes to the maintenance of these ecosystems, including the recycling of nutrients through water filtration. However, rising ocean temperatures and acidification due to climate change have resulted in the bleaching and death of coral reefs worldwide. In order to preserve these reefs and the sponges that depend on them, scientists have been performing studies on their biodiversity. This includes collecting numerous images of …

Identifying Red Sponges On Arms Plates By Preprocessing Images Using Histogram Equalization, Barry Ng

Master's Projects

Sponges play a vital role in marine ecosystems, being the only organisms capable of converting dissolved organic matter (DOM) into particulate organic matter (POM). They provide nutrients for coral reefs to thrive in oligotrophic waters. Autonomous reef monitoring structures (ARMS) are used to measure the biodiversity of coral reefs by simulating the complex cavities inside reef structures. Organisms settle on them and scientists can retrieve them after a period of time for analysis. Images are taken of ARMS plates after they are retrieved. Human analysis is unsuitable for the analysis of ARMS plates due to the huge number of images. …

Coral Vision – Crustose Coralline Algae Detection With Computer Vision, Ryan Tseng

Master's Projects

Crustose coralline algae (CCA) are a group of red algae that are vital contributors to the health of coral reef ecosystems. Monitoring CCA abundance can serve as an indicator for coral reef health and improve reef conservation efforts. Autonomous Reef Monitoring Structures (ARMS) are artificial structures that can be deployed into coral reef ecosystems and retrieved to gather ecological data without harming reef structures. Traditional methods of calculating CCA abundance require manual analysis and are labor-intensive. Recent developments in computer vision and deep learning technology have provided an avenue to fully automate this task. This research aims to train a …

Wall-E: An Autonomous Ai Rover For Precision Agriculture, Simar Ghumman

Master's Projects

Unmanned Ground Vehicles (UGVs) are emerging as a crucial tool in the world of precision agriculture. By working with UGVs equipped with machine learning, we can find solutions to a range of complex agricultural problems. My project, titled “Wall-E: Artificial Intelligence Robot for Precision Agriculture,” focuses on developing a UGV capable of navigating through agriculture fields autonomously while capturing data. Using machine learning, computer vision, and other sensor technologies, Wall-E is capable of estimating the total yield of crops, self-localization, mapping its environment in real time, and avoiding obstacles along its route. The purpose of this project is to automate …

Enhancing Driver Distraction Detection Through The Synergy Of Deep And Traditional Machine Learning, Gowtham Chandrasekaran

Master's Projects

Distracted driving is a major contributor to motor vehicle accidents, causing injury and loss of life. It is one of the major factors that affect the overall driving behavior of a person. Insurance companies take into consideration factors like gender, age, etc. to set insurance premiums for their customers. Today, machine learning and artificial intelligence can eradicate this bias. A machine learning model can analyze driving behavior, such as the frequency and severity of accidents, the speed at which they drive, and their habits such as distracted driving. Based on this information, the model can then determine the risk of …

Analyzing The Benthic Cover Of Crustose Coralline Algae Using Mask-R Cnn, Rachana Ravindra

Master's Projects

Coral reefs, supporting 25% of marine biodiversity, confront challenges from local and global impacts like overfishing, runoff, acidification, and warming. Crustose Coralline Algae (CCA), pivotal for reef structure and coral settlement, are underrepresented in research. Current methods like Coral Point Count with Excel Extensions (CPCe) have limitations, relying on image quality and being time-consuming. This paper proposes computer vision and Mask R-CNN, a supervised machine learning model, for CCA analysis in reef images, considering color, texture, and shape. Results indicate promise in clustering and classifying organisms. The innovative technology reduces manual labor, enhancing image analysis, simplifying the understanding of CCA’s …

Automated Identification Of Astronauts On Board The International Space Station: A Case Study In Space Archaeology, Rao Hamza Ali, Amir Kanan Kashefi, Alice C. Gorman, Justin St. P. Walsh, Erik J. Linstead

Art Faculty Articles and Research

We develop and apply a deep learning-based computer vision pipeline to automatically identify crew members in archival photographic imagery taken on-board the International Space Station. Our approach is able to quickly tag thousands of images from public and private photo repositories without human supervision with high degrees of accuracy, including photographs where crew faces are partially obscured. Using the results of our pipeline, we carry out a large-scale network analysis of the crew, using the imagery data to provide novel insights into the social interactions among crew during their missions.

A Quantitative Validation Of Multi-Modal Image Fusion And Segmentation For Object Detection And Tracking, Nicholas Lahaye, Michael J. Garay, Brian D. Bue, Hesham El-Askary, Erik Linstead

Mathematics, Physics, and Computer Science Faculty Articles and Research

In previous works, we have shown the efficacy of using Deep Belief Networks, paired with clustering, to identify distinct classes of objects within remotely sensed data via cluster analysis and qualitative analysis of the output data in comparison with reference data. In this paper, we quantitatively validate the methodology against datasets currently being generated and used within the remote sensing community, as well as show the capabilities and benefits of the data fusion methodologies used. The experiments run take the output of our unsupervised fusion and segmentation methodology and map them to various labeled datasets at different levels of global …

Machine Learning-Based Recognition On Crowdsourced Food Images, Aditya Kulkarni

Honors Scholar Theses

With nearly a third of the world’s population suffering from food-induced chronic diseases such as obesity, the role of food in community health is required now more than ever. While current research underscores food proximity and density, there is a dearth in regard to its nutrition and quality. However, recent research in geospatial data collection and analysis as well as intelligent deep learning will help us study this further.

Employing the efficiency and interconnection of computer vision and geospatial technology, we want to study whether healthy food in the community is attainable. Specifically, with the help of deep learning in …

Accelerating Point Set Registration For Automated Aerial Refueling, Ryan M. Raettig

Theses and Dissertations

The goal of AAR is to control the tanker boom to safely refuel a receiving aircraft with no input or aid from the boom operator. To achieve this, the pose of the receiver relative to the tanker must be known. Point set registration is a fundamental issue used to estimate the relative pose of an object in an environment. However, it's likely a computational bottleneck of a vision processing pipeline. In addition, the matching of each sensed point with a closest truth point, nearest neighbor matching, is the most costly portion of the point set registration process. For this reason, …

Analysis Of Recent Trends In Continuous Sign Language Recognition Using Nlp, Vijayshri Nitin Khedkar, Sonali Kothari Dr, Aarohi Prasad, Arunima Mishra, Varun Saha, Vinay Kumar

Library Philosophy and Practice (e-journal)

Oralism is an ideology and practice that advocates communication that is based solely on speech. This practice is encouraged from a pretty early age in our country. As a consequence, the hard of hearing are constantly forced to negotiate with schools, colleges, organisations, workspaces, and families that don’t acknowledge the need and preference for sign language over oral languages. This results in inconsideration of an entire community for admissions, jobs and general social position. We aim to close that communication gap a little and take a step towards fighting the stigma associated with Sign Language. The aim is to provide …

Survey On Deep Neural Networks In Speech And Vision Systems, M. Alam, Manar D. Samad, Lasitha Vidyaratne, ‪Alexander Glandon, Khan M. Iftekharuddin

Computer Science Faculty Research

This survey presents a review of state-of-the-art deep neural network architectures, algorithms, and systems in speech and vision applications. Recent advances in deep artificial neural network algorithms and architectures have spurred rapid innovation and development of intelligent speech and vision systems. With availability of vast amounts of sensor data and cloud computing for processing and training of deep neural networks, and with increased sophistication in mobile and embedded technology, the next-generation intelligent systems are poised to revolutionize personal and commercial computing. This survey begins by providing background and evolution of some of the most successful deep learning models for intelligent …

Collision Avoidance Smartphone, Matt Columbres, Aaron Parisi, Joey Schnecker, Luis Wong

Electrical Engineering

There are many instances in day-to-day life where people cannot or would rather not pay full attention to their surroundings. Walking while preoccupied with a smartphone or walking while blind are excellent examples where technology could be used to make the task of avoiding 2collisions reactive, instead of proactive. A device which monitors a user’s surroundings and notifies the user when a potential collision is detected (and, additionally, notifying them as to where the obstacle is with respect to them) could be used to make walking distracted less of a hazard for the user and those around the user and …

Comparison Of Google Image Search And Resnet Image Classification Using Image Similarity Metrics, David Smith

Computer Science and Computer Engineering Undergraduate Honors Theses

In this paper, we compare the results of ResNet image classification with the results of Google Image search. We created a collection of 1,000 images by performing ten Google Image searches with a variety of search terms. We classified each of these images using ResNet and inspected the results. The ResNet classifier predicted the category that matched the search term of the image 77.5% of the time. In our best case, with the search term “forklift”, the classifier categorized 92 of the 100 images as forklifts. In the worst case, for the category “hammer”, the classifier matched the search term …

Senior Project: Control System For An Underwater Remotely Operated Vehicle, Tyler Mau, Joseph Mahoney

Computer Engineering

No abstract provided.

Team Omnimouse, Derek J. Halman, Josh B. Porter, Steven A. Silver, Ian S. Stemper

Computer Engineering

INFORMATION, DATA, FIGURES AND DRAWINGS EMBODIED IN THIS DOCUMENT ARE STRICTLY CONFIDENTIAL AND ARE SUPPLIED ON THE UNDERSTANDING THAT THEY WILL NOT BE DISCLOSED TO THIRD PARTIES WITHOUT THE PRIOR WRITTEN CONSENT OF QUALITY OF LIFE PLUS.