Computer Engineering Commons^™

Development And Testing Of A Computer Vision Pose Estimation System For Planar Mobile Robots, Andrew Jones

Master's Theses

This thesis details the development and testing of a computer vision-based real-time pose estimation system for differential drive robots. A single camera with a fisheye lens is used to locate ArUco markers placed at fixed locations and attached to robots. Using the OpenCV library, the Perspective-n-Point (PnP) problem is solved to facilitate the transformation of 2-D robot positions in an image to world-frame coordinates. An analytical solution is presented to estimate robot poses based on a single PnP solution, rather than solving the PnP problem for each pose estimate. Pose information is relayed to individual robots using a multi-microcontroller architecture …

Eyolov8-Msaff: An Enhanced Object Detection Algorithm With Multi-Scale Attention And Feature Fusion For Small And Dense Object Detection In Uav Applications, Mohammed Hasan Mutar, Morteza Valizadeh, Alaa Hussein Abdulaal, Mehdi Chehel Amirani

Iraqi Journal for Computer Science and Mathematics

The proliferation of unmanned aerial vehicles (UAVs) has necessitated the development of sophisticated object detection algorithms capable of handling the unique challenges posed by aerial imagery. Traditional detection methods often struggle with small object sizes, dense distributions, and complex backgrounds characteristic of UAV-captured scenes. This research presents EYOLOv8-MSAFF (Enhanced YOLOv8 with Multi-Scale Attention and Feature Fusion), a novel deep learning architecture specifically engineered for superior performance in UAV-based object detection tasks. The proposed methodology integrates four innovative components: a Hybrid Spatial-Channel Attention Mechanism (HSCAM) that processes attention information in parallel rather than sequentially, an Adaptive Multi-Scale Feature Fusion Module (AMSFFM) …

A Novel Hierarchical Multi-Scale Attention Mechanism For Enhanced Yolov8 Performance In Unmanned Aerial Vehicle-Based Small Object Detection, Mohammed Hasan Mutar, Morteza Valizadeh, Alaa Hussein Abdulaal, Mehdi Chehel Amirani

Iraqi Journal for Computer Science and Mathematics

Object detection in Unmanned Aerial Vehicle (UAV) images presents significant challenges due to the prevalence of small and densely packed objects, as well as variations in scale, orientation, and lighting conditions. This paper introduces a novel object detection algorithm, Hierarchical Multi-Scale Attention YOLO (HMSA-YOLO), which is an improved version of YOLOv8 designed to address these challenges. The proposed method incorporates a novel Hierarchical Multi-Scale Attention (HMSA) module, a Bidirectional Feature Pyramid Network (BiFPN) for enhanced feature fusion, a modified loss function, and an adaptive anchor optimization technique. The HMSA module effectively captures both channel and spatial dependencies at multiple scales, …

Scalefusion: Hierarchical Feature Aggregation For Unified Multiscale Object Detection, Ayşenur Yaylaci, Berru Kaya, Mehmet Kiliçarslan

Turkish Journal of Electrical Engineering and Computer Sciences

Detecting objects across a wide range of scales, particularly small ones, remains a significant challenge in computer vision. Existing methods often improve small object detection at the cost of performance on larger objects or introduce significant computational overhead through external techniques like image slicing. This paper introduces ScaleFusion, a novel, unified, end-to-end object detection architecture designed to provide robust performance across all scales within a single model. The core of our approach is a hierarchical feature aggregation strategy structured like a tree. ScaleFusion processes an image by running a shared backbone network only on fine-grained patches at the lowest level …

Robust Real-Time Uav Target Tracking With Onboard Vision-Based Yaw Control, Rylan Malarchick, Jose Castelblanco, Enrique Amaya, Carmen Dimario, Graysen Brinkman, Chirag Kumar, Kiwon Yoon, Sajid Berhane

Beyond: Undergraduate Research Journal

Autonomous tracking of agile unmanned aerial vehicles (UAVs) presents significant challenges for real-time perception and control systems. This work presents AIRHOUND (Autonomous Intelligent Rotorcraft for Hostile Object Unified Navigation and Detection), a UAV platform implementing vision-based yaw tracking through a modular ROS2 software architecture. The system employs YOLOv8 object detection optimized with NVIDIA TensorRT for embedded deployment on an NVIDIA Jetson Orin companion computer. Detected targets are processed through a geometric tracking module that converts pixel coordinates to angular yaw errors using pinhole camera intrinsics, with a proportional controller generating rate-limited yaw commands. These commands are streamed to a PX4 …

Vision-Guided Motion Planning For Autonomous Catch With A Robotic Arm, Kayla Go-Oco, Ashik K. Islam, Raegan Gritzmacher

Electrical Engineering

Modern robotic systems are often evaluated using static and highly controlled tasks, such as pick-and-place demonstrations, which do not fully represent the uncertainty and adaptability required in real-world environments. A major challenge in robotics research is enabling robotic systems to perceive, track, and respond to dynamic objects in real time while maintaining accurate and reliable motion control. This project addresses these challenges by developing an autonomous robotic platform in which an OpenMANIPULATOR-Y robotic arm detects, tracks, and attempts to catch a moving tennis ball using a vision-guided control system. The system integrates YOLO-based object detection with an Intel RealSense D455 …

Deep Learning Approaches For Ctenophore Identification And Tracking, Anagha Bharadwaj

Theses

Ctenophores are translucent marine organisms with nearly invisible tentacles and pose significant challenges due to their transparent morphology and ambiguous structural features. This research addresses the classification and tracking of these organisms and evaluates the performance of current computer vision models under sparse-data environments.

A dataset from the NJIT Life History Lab consisting of microscopic laboratory videos and photographs of different growth stages is used to train and assess a number of convolutional neural network designs, including VGG16, ResNet, BioCLIP2, YOLO, and DeepLabCut. Additionally, a web-based interface is developed to evaluate expert-labeled ground truth with the model's performance.

The findings …

Ai-Assisted Frame Selection For Sports Photography Using Computer Vision And Multi-Modal Image Metrics, Sahana Ganesh

Honors Scholar Theses

This project focuses on the design and development of an AI-assisted frame selection system that automatically analyzes sequences of sports images and ranks frames based on overall photographic and contextual value. Additionally, we will focus on providing insights into the Computer Vision and Artificial Intelligence techniques used to build it.

The application utilizes computer vision and machine learning techniques to evaluate multiple dimensions of image quality and content. These include technical image quality metrics such as sharpness, motion blur, and exposure; compositional metrics such as subject placement and visual balance; and semantic understanding through detection of players, ball location, pose, …

Computer Vision And Deep Learning-Based Decision Support System Using Eye Motion Tracking For Nystagmus Detection, Kowshik Balasubramanian

Electronic Theses and Dissertations

This thesis presents the design, implementation, and experimental validation of an artificial intelligence (AI)-driven system for detecting and quantifying nystagmus an involuntary, rhythmic oscillation of the eyes intended as a portable, low-cost complement to conventional Videonystagmography (VNG). The complete pipeline integrates six algorithmic stages: face landmark detection, contrast enhancement, background-aware pixel thresholding, grid-based vertical column filtering, connected-component cluster analysis, and centroid computation, operating in real time on standard smartphone video to extract a sub-pixel normalized iris position time-series without any specialized eye-tracking hardware or infrared illumination. The system supports diagnostic decision-making, highlighting its promise for incorporation into telemedicine settings. The …

Enhancing Lane Detection In Autonomous Vehicles Using Data Augmentation For Adverse Environmental Conditions, Rutvikkumar Dave

Electronic Theses and Dissertations

To make sure that self-driving and connected automobile technologies are safe and work well, it’s really important that they can correctly identify lanes. But lane detection Algorithms typically have a hard time working well when the weather is bad, such when it rains, fogs, or goes too fast. The circumstances cause visual distortions that make existing computer vision systems less reliable, which makes it harder requires autonomous navigation systems to work well. This paper introduces a comprehensive lane detection system that integrates synthetic Weather-informed data augmentation combined with a Weather-aware Temporal Lane Detection Network (WTLDNet) to make it easier for …

Using Ai To Predict Energy Expenditure In Lower Limb Prosthesis Users, Nelly Diaz, Siem Hadish

Posters - 2026

• Computer vision has evolved from simple image classification and object detection to analyzing human motion and biomechanics (1). • CNN’s are usually focused on image classification, but, in this case, we are not asking the model if a person is walking. • Many real-world problems require regression: Predicting a continuous number like energy expenditure of walking is a complex task. • It is essential for Prosthetists to understand energy expenditure of their prosthetic patients (2). • An amputee may use 20-30% more energy to walk. • In this project, we developed an AI model to analyze human motion and …

Pl-Mamba: A 3d Point Cloud Semantic Segmentation Network Based On Bimodal Fusion, He Zhu, Feng Zhou, Mengxiao Zhu, Ju Dai

Journal of System Simulation

Abstract: To enhance the semantic discrimination capability in point cloud semantic segmentation, a 3D point cloud semantic segmentation network named PL-Mamba is proposed, which is centered on the fusion of point cloud (P) and language (L) dual modalities. This method takes PointMamba as the backbone network, leveraging its excellent long-sequence modeling and global perception capabilities. It introduces a language prompt mechanism and uses a pretrained language model BERT to encode the context of category labels, obtaining semantically rich text features. The text information serves as a language guided token and is deeply integrated with point cloud features through cross modal …

Application Of Adversarial Volumetric Cnns To 3d Face Generation Using Latent Space Gaussian Embeddings, Ali Raad Abdulkareem, Marwa Jabberi, Islem Jarraya, Tarek M. Hamdani, Khmaies Ouahada, Adel M. Alimi

Iraqi Journal for Computer Science and Mathematics

Although 3D face generation is extensively studied in computer vision, most existing methods prioritize reconstructing 3D geometry from available 2D or 3D inputs rather than generating novel faces directly from latent representations. To bridge this gap, we present the application of Adversarial Volumetric Convolutional Neural Networks (AVCNN), a tailored adaptation of the vanilla 3D Generative Adversarial Network (3D-GAN), to 3D face generation using latent space Gaussian embeddings. We first assemble a custom 3D facial dataset to provide the requisite facial characteristics and to ensure sufficient coverage of geometric variation across identities. The generator, implemented as a decoder, maps latent space …

Seeing What Matters: Safety-Critical Semantic Segmentation Via Transfer Learning On Construction Sites, Obiora J. Odugu

LSU Master's Theses

Autonomous robots are increasingly deployed on construction sites for tasks such as progress monitoring, inspection, and safety assessment. For these robots to operate effectively, they must perceive and interpret complex, dynamic environments populated by workers, machinery, and unstructured terrain. Achieving reliable perception depends on high performing semantic segmentation models trained on large volumes of annotated data—an expensive and logistically challenging requirement in construction due to privacy restrictions, variable site access, and slow digitalization. This research addresses the challenge of limited labeled data by investigating transfer learning as a label-efficient approach for construction-site segmentation. Specifically, it explores whether road construction imagery—abundant …

Intelligent Motion Tracking: A Low-Cost Surveillance Framework Using Soc Devices And Sensor Fusion, Aung Myat Khaung, Nicholas Michael Stiffler

Research from the Berry Summer Thesis Institute, 2025

This thesis presents the design and implementation of a lightweight surveillance system capable of realtime motion detection, object tracking, and behavioral history reconstruction in controlled environments. The system uses System-on-Chip devices such as Raspberry Pi boards equipped with NOIR cameras, monocular cameras, and break-beam sensors that work together to detect and track single or multiple moving objects like colored balls. The prototype is validated in structured settings with the goal of eventual deployment in more dynamic environments, addressing the challenge of reliably tracking visually similar objects with minimal distinguishing features. The architecture integrates computer vision with sensor fusion by combining …

Analysis Of Vision Transformers And Domain Adaptation In Long-Range Facial Recognition, Zachary Michael Swanson

Department of Electrical and Computer Engineering: Dissertations, Theses, and Student Research

Atmospheric turbulence presents a significant barrier to long-range facial recognition, introducing severe geometric distortions and blur that degrade image quality. This thesis investigates deep learning approaches for mitigating these effects, with a focus on transformer based architectures and domain adaptation strategies.

An in-depth benchmarking study was performed using convolutional neural networks (CNNs) and vision transformers (ViTs) on the Husker BRIAR Research Collection from up to 500m (HBRC-500) face dataset. The results demonstrated that vision transformers, particularly hierarchical vision transformers like the shifted-window (Swin) transformer, outperform CNN-based models at long distances due to their ability to model global spatial relationships and …

Algorithms & Design Behind Autonomous Uavs And Ugvs Coordinated System, Aashish Dhakal

Honors Theses

Unmanned Aerial Vehicles (UAVs) and Unmanned Ground Vehicles (UGVs), when coordinated effectively, offer substantial potential for automating large-scale tasks—from search and rescue operations to precision agriculture. However, synchronizing these autonomous systems remains challenging, especially in time-sensitive missions requiring precision. This thesis investigates the design and algorithmic coordination of autonomous UAVs and UGVs, examining both single-vehicle scenarios and multi-agent (swarming) approaches. Using the Robot Operating System (ROS) as a communication backbone, I integrate GPS positioning with computer vision techniques through OpenCV, enabling accurate localization and object detection. During the development phase, I validate my methods using ArduPilot Software-in-the-Loop (SITL) simulations within …

Liberated Arabic Handwritten Text Recognition Using Convolutional Recurrent Neural Networks, Ahmad Abdulqadir Alrababah, Mohammed Khalid Aljahdali, Abdulrahim Abdulhamid Al Jahdali, Mohammed Saleh Alghanmi, Israa Ibraheem Al_Barazanchi

Iraqi Journal for Computer Science and Mathematics

Arabic script is exhibited in a cursive style, which is a departure from the norm in many common languages, and the shapes of letters are contingent on their positions within words. The form of the first letter is influenced by the subsequent letter, middle letters are shaped by both preceding and succeeding letters, and the shape of the final letter is determined by the preceding letter. Additionally, certain letters are found to have strikingly similar shapes, making Arabic text recognition a formidable challenge in computer vision. The challenge of detecting and recognizing Arabic handwritten text is addressed in this paper …

From Image Enhancement To Model Protection Integrating Generative Ai And Secure Learning In Computer Vision, Mohammad Shahab Uddin

Electrical & Computer Engineering Theses & Dissertations

This dissertation aims to address critical challenges in the field of computer vision and machine learning, focusing on three key areas: image translation, denoising, and model security. The research encompasses novel methodologies and models that significantly advance existing techniques. This dissertation will not only provide valuable contributions to the academic community but also hold significant potential for practical applications in domains ranging from surveillance to autonomous systems.

Consequently, this dissertation proposes three goals. First, we present new approaches for converting optical videos to infrared videos using deep learning. To apply powerful deep learning based algorithms for object detection and classification …

Identifying Red Sponges On Arms Plates By Preprocessing Images Using Histogram Equalization, Barry Ng

Master's Projects

Sponges play a vital role in marine ecosystems, being the only organisms capable of converting dissolved organic matter (DOM) into particulate organic matter (POM). They provide nutrients for coral reefs to thrive in oligotrophic waters. Autonomous reef monitoring structures (ARMS) are used to measure the biodiversity of coral reefs by simulating the complex cavities inside reef structures. Organisms settle on them and scientists can retrieve them after a period of time for analysis. Images are taken of ARMS plates after they are retrieved. Human analysis is unsuitable for the analysis of ARMS plates due to the huge number of images. …

Cca Analysis Using Computer Vision Techniques, Rahul Thakur

Master's Projects

Coral reefs are an essential part of the marine ecosystem. They perform a wide variety of tasks, some directly and others indirectly. They can produce oxygen, absorb carbon dioxide, along with supporting ocean habitat. Crustose Coralline Algae (“CCA”) plays an important role in helping provide structural support to Coral Reef ecosystems. However, global warming is causing ocean water to become more acidic resulting in coral bleaching. This is leading to changes in coral environments and causing coral deaths at alarming rates. Object detection using computer vision techniques, specifically deep learning, can help to monitor coral reef health and identify CCA …

Effects Of Data Augmentation On Sponge Identification Using Computer Vision Models, George Ku

Master's Projects

Coral reefs can be primarily found in tropical and sub-tropical regions of our oceans, providing a thriving habitat for millions of species. Marine sponges, which can be frequently found in coral reefs, play a critical role that contributes to the maintenance of these ecosystems, including the recycling of nutrients through water filtration. However, rising ocean temperatures and acidification due to climate change have resulted in the bleaching and death of coral reefs worldwide. In order to preserve these reefs and the sponges that depend on them, scientists have been performing studies on their biodiversity. This includes collecting numerous images of …

Deep Learning For Computer Vision Applications In Medical Diagnostics And Wildlife Monitoring, Mostapha Al Saidi

Electronic Theses and Dissertations

This dissertation explores innovative applications of deep learning and computer vision techniques across three distinct domains: medical imaging, dermatological diagnostics, and wildlife monitoring. The research addresses critical challenges in each field through the development and optimization of convolutional neural networks and other deep learning architectures.

The first study examines COVID-19 classification from X-ray images, comparing one-shot versus two-stage classification approaches using transfer learning with pre-trained models such as VGG16 and VGG19. The initial hypothesis was that breaking down the classification task into two optimized tasks would yield better results than one-shot classification. Results demonstrated that the single-stage approach achieved superior …

Coral Vision – Crustose Coralline Algae Detection With Computer Vision, Ryan Tseng

Master's Projects

Crustose coralline algae (CCA) are a group of red algae that are vital contributors to the health of coral reef ecosystems. Monitoring CCA abundance can serve as an indicator for coral reef health and improve reef conservation efforts. Autonomous Reef Monitoring Structures (ARMS) are artificial structures that can be deployed into coral reef ecosystems and retrieved to gather ecological data without harming reef structures. Traditional methods of calculating CCA abundance require manual analysis and are labor-intensive. Recent developments in computer vision and deep learning technology have provided an avenue to fully automate this task. This research aims to train a …

Facial Chick Sexing: An Automated Chick Sexing System From Chick Facial Image, Marta Veganzones Rodriguez, Thinh Phan, Arthur F.A. Fernandes, Vivian Breen, Jesus Arango, Michael T. Kidd, Ngan Le

Computer Science and Computer Engineering Faculty Publications and Presentations

Chick sexing, the process of determining the gender of day-old chicks, is a critical task in the poultry industry due to the distinct roles that each gender plays in production. While effective traditional methods achieve high accuracy, color, and wing feather sexing is exclusive to specific breeds, and vent sexing is invasive and requires trained experts. To address these challenges, we propose a novel approach inspired by facial gender classification techniques in humans: facial chick sexing. This new method does not require expert knowledge and aims to reduce training time while enhancing animal welfare by minimizing chick manipulation. We develop …

Computer Vision-Based Framework For Data Extraction From Heterogeneous Financial Tables: A Comprehensive Approach To Unlocking Financial Insights, Iftakhar Ali Khandokar, Priya Deshpande

Electrical and Computer Engineering Faculty Research and Publications

Information extraction from financial document images is crucial in computer vision and NLP, as financial data often exists in image or PDF format, enabling organizations to analyze and make informed business decisions using OCR advancements. The table contents of financial document images are one of the prominent structures to confine important portions of data of the document and many Deep learning-based methods have been proposed to detect Table regions inside document images. The shortcomings of the current approach are that it is bounded within the detection of the table region and struggles in cases such as handling different layouts and …

Pseudo Gps For Romi, Emmanuel Baez, Owen Guinane, Gabriel Coria, Conor Schott

Mechanical Engineering

The Pseudo-GPS system for Romi robots addresses the need for precise real-time location tracking in Cal Poly's Mechatronics lab. This project, developed by Emmanuel Baez, Gabriel Coria, Owen Guinane, and Conor Schott, under the guidance of instructor Charlie Refvem, provides a proof-of-concept system to enhance the Romi robots' geolocation capabilities for advanced robotic algorithms.

The proposed system uses a Raspberry Pi 4 equipped with a Pi camera module and ArUco markers to track the position and orientation of Romi robots within a lab environment. Custom 3D-printed stands secure markers on the robots, and a designated origin marker defines the coordinate …

Etdsuite: A Toolkit To Mine Electronic Theses And Dissertations To Enrich Scholarly Big Data Using Natural Language Processing And Computer Vision, Muntabir Hasan Choudhury

Computer Science Theses & Dissertations

In the past decades, there has been a growing interest in mining scientific documents to obtain domain knowledge automatically. One of the understudied types of scientific documents is Electronic Theses and Dissertations (ETDs), as ETDs have distinct features compared with conference proceedings and journal articles. ETDs usually serve as partial requirements of academic degrees for students pursuing higher education. They are book-length documents (i.e., 100 – 400 pages long), and the topics may shift across chapters, exhibit the significant contribution of a student’s research over the entire degree pursuing period, and have unique metadata schema and page layouts. However, the …

Robotic Odor Source Localization Using Vision And Olfaction Sensing, Sunzid Hassan

Master's Theses

Robotic Odor Source Localization (ROSL) technology allows autonomous agents like robots to find an odor source in unknown environments. A successful odor source location depends crucially on an effective navigation algorithm that directs the robot towards the odor source. This thesis is a combination of three projects. First, we detail development of a versatile multi-modal robotic platform for ROSL real-world ROSL experimentation and discussed real-world validation of a traditional olfactionbased ROSL algorithm. Secondly, we introduced vision in ROSL by proposing a fusion navigation algorithm that integrates deep-learning enabled vision and olfaction-based navigation. This hybrid approach tackles challenges such as turbulent …

Development Of Feature Extraction Models To Improve Image Analysis Applications In Cancer, Yu Shi

Dissertations and Doctoral Documents, University of Nebraska-Lincoln, 2023–

Cancer poses a significant global health challenge. With an estimated 20 million new cases diagnosed worldwide in 2022 and 9.7 million fatalities attributable to the disease, the economic burden of cancer is immense. It impacts healthcare systems and imposes substantial costs for its care on patients and their families. Despite advancements in early detection, prevention, and treatment that have reduced overall cancer mortality rates, the growing prevalence of cancer, particularly among younger individuals, remains a pressing issue.

Recent advancements in medical imaging technology have progressed significantly with the help of emerging computer vision and artificial intelligence (AI) technology. Despite these …