Engineering Commons^™

Gps-Denied Localization Of Landing Evtol Aircraft, Aaron C. Brown

Theses and Dissertations

This thesis presents a dedicated GPS-denied landing system designed for electric vertical takeoff and landing (eVTOL) aircraft. The system employs active fiducial light pattern localization (AFLPL), which provides highly accurate and reliable navigation during critical landing phases. AFLPL utilizes images of a constellation comprised of modulating infrared lights strategically positioned on the landing site, to determine the aircraft pose through the use of a perspective-n-point (PnP) solver. The AFLPL system underwent thorough development, enhancement, and implementation to address and demonstrate its potential in navigation and its inherent limitations. A proposed method addresses the limitations of AFLPL by using an extended …

Uncovering And Mitigating Spurious Features In Domain Generalization, Saeed Karimi, Hamdi̇ Di̇bekli̇oğlu

Turkish Journal of Electrical Engineering and Computer Sciences

Domain generalization (DG) techniques strive to attain the ability to generalize to an unfamiliar target domain solely based on training data originating from the source domains. Despite the increasing attention given to learning from multiple training domains through the application of various forms of invariance across those domains, the enhancements observed in comparison to ERM are nearly insignificant under specified evaluation rules. In this paper, we demonstrate that the disentanglement of spurious and invariant features is a challenging task in conventional training since ERM simply minimizes the loss and does not exploit invariance among domains. To address this issue, we …

Relative Vectoring Using Dual Object Detection For Autonomous Aerial Refueling, Derek B. Worth, Jeffrey L. Choate, James Lynch, Scott L. Nykl, Clark N. Taylor

Faculty Publications

Once realized, autonomous aerial refueling will revolutionize unmanned aviation by removing current range and endurance limitations. Previous attempts at establishing vision-based solutions have come close but rely heavily on near perfect extrinsic camera calibrations that often change midflight. In this paper, we propose dual object detection, a technique that overcomes such requirement by transforming aerial refueling imagery directly into receiver aircraft reference frame probe-to-drogue vectors regardless of camera position and orientation. These vectors are precisely what autonomous agents need to successfully maneuver the tanker and receiver aircraft in synchronous flight during refueling operations. Our method follows a common 4-stage process …

Motion Magnification-Inspired Feature Manipulation For Deepfake Detection, Aydamir Mirzayev, Hamdi Di̇bekli̇oğlu

Turkish Journal of Electrical Engineering and Computer Sciences

Recent advances in deep learning, increased availability of large-scale datasets, and improvement of accelerated graphics processing units facilitated creation of an unprecedented amount of synthetically generated media content with impressive visual quality. Although such technology is used predominantly for entertainment, there is widespread practice of using deepfake technology for malevolent ends. This potential for malicious use necessitates the creation of detection methods capable of reliably distinguishing manipulated video content. In this work we aim to create a learning-based detection method for synthetically generated videos. To this end, we attempt to detect spatiotemporal inconsistencies by leveraging a learning-based magnification-inspired feature manipulation …

Ai And 6g Into The Metaverse: Fundamentals, Challenges And Future Research Trends, Muhammad Zawish, Fayaz Ali Dharejo, Sunder Ali Khowaja, Saleem Raza, Steven Davy, Kapal Dev, Paolo Bellavista

Articles

Since Facebook was renamed Meta, a lot of attention, debate, and exploration have intensified about what the Metaverse is, how it works, and the possible ways to exploit it. It is anticipated that Metaverse will be a continuum of rapidly emerging technologies, usecases, capabilities, and experiences that will make it up for the next evolution of the Internet. Several researchers have already surveyed the literature on artificial intelligence (AI) and wireless communications in realizing the Metaverse. However, due to the rapid emergence and continuous evolution of technologies, there is a need for a comprehensive and in-depth survey of the role …

A Survey On Few-Shot Class-Incremental Learning, Songsong Tian, Lusi Li, Weijun Li, Hang Ran, Xin Ning, Prayag Tiwari

Computer Science Faculty Publications

Large deep learning models are impressive, but they struggle when real-time data is not available. Few-shot class-incremental learning (FSCIL) poses a significant challenge for deep neural networks to learn new tasks from just a few labeled samples without forgetting the previously learned ones. This setup can easily leads to catastrophic forgetting and overfitting problems, severely affecting model performance. Studying FSCIL helps overcome deep learning model limitations on data volume and acquisition time, while improving practicality and adaptability of machine learning models. This paper provides a comprehensive survey on FSCIL. Unlike previous surveys, we aim to synthesize few-shot learning and incremental …

Mhair: A Dataset Of Audio-Image Representations For Multimodal Human Actions, Muhammad Bilal Shaikh, Douglas Chai, Syed M. S. Islam, Naveed Akhtar

Research outputs 2022 to 2026

Audio-image representations for a multimodal human action (MHAiR) dataset contains six different image representations of the audio signals that capture the temporal dynamics of the actions in a very compact and informative way. The dataset was extracted from the audio recordings which were captured from an existing video dataset, i.e., UCF101. Each data sample captured a duration of approximately 10 s long, and the overall dataset was split into 4893 training samples and 1944 testing samples. The resulting feature sequences were then converted into images, which can be used for human action recognition and other related tasks. These images can …

Advancing Winter Weather Adas: Tire Track Identification And Road Snow Coverage Estimation Using Deep Learning And Sensor Integration, Parth Kadav

Masters Theses

No abstract provided.

Sc-Fuse: A Feature Fusion Approach For Unpaved Road Detection From Remotely Sensed Images, Aniruddh Saxena

Department of Computer Science and Engineering: Dissertations, Theses, and Student Research

Road network extraction from remote sensing imagery is crucial for numerous applications, ranging from autonomous navigation to urban and rural planning. A particularly challenging aspect is the detection of unpaved roads, often underrepresented in research and data. These roads display variability in texture, width, shape, and surroundings, making their detection quite complex. This thesis addresses these challenges by creating a specialized dataset and introducing the SC-Fuse model.

Our custom dataset comprises high resolution remote sensing imagery which primarily targets unpaved roads of the American Midwest. To capture the diverse seasonal variation and their impact, the dataset includes images from different …

Enhanced Privacy-Enabled Face Recognition Using Κ-Identity Optimization, Ryan Karl

Department of Electrical and Computer Engineering: Dissertations, Theses, and Student Research

Facial recognition is becoming more and more prevalent in the daily lives of the common person. Law enforcement utilizes facial recognition to find and track suspects. The newest smartphones have the ability to unlock using the user's face. Some door locks utilize facial recognition to allow correct users to enter restricted spaces. The list of applications that use facial recognition will only increase as hardware becomes more cost-effective and more computationally powerful. As this technology becomes more prevalent in our lives, it is important to understand and protect the data provided to these companies. Any data transmitted should be encrypted …

Aicropcam: Deploying Classification, Segmentation, Detection, And Counting Deep-Learning Models For Crop Monitoring On The Edge, Nipuna Chamara, Geng (Frank) Bai, Yufeng Ge

Biological Systems Engineering: Papers and Publications

Precision Agriculture (PA) promises to meet the future demands for food, feed, fiber, and fuel while keeping their production sustainable and environmentally friendly. PA relies heavily on sensing technologies to inform site-specific decision supports for planting, irrigation, fertilization, spraying, and harvesting. Traditional point-based sensors enjoy small data sizes but are limited in their capacity to measure plant and canopy parameters. On the other hand, imaging sensors can be powerful in measuring a wide range of these parameters, especially when coupled with Artificial Intelligence. The challenge, however, is the lack of computing, electric power, and connectivity infrastructure in agricultural fields, preventing …

An In-Depth Analysis Of Domain Adaptation In Computer And Robotic Vision, Muhammad Hassan Tanveer, Zainab Fatima, Shehnila Zardari, David A. Guerra-Zubiaga

Faculty and Research Publications

This review article comprehensively delves into the rapidly evolving field of domain adaptation in computer and robotic vision. It offers a detailed technical analysis of the opportunities and challenges associated with this topic. Domain adaptation methods play a pivotal role in facilitating seamless knowledge transfer and enhancing the generalization capabilities of computer and robotic vision systems. Our methodology involves systematic data collection and preparation, followed by the application of diverse assessment metrics to evaluate the efficacy of domain adaptation strategies. This study assesses the effectiveness and versatility of conventional, deep learning-based, and hybrid domain adaptation techniques within the domains of …

Precision Spraying Using Variable Time Delays And Vision-Based Velocity Estimation, Paolo Rommel Sanchez, Hong Zhang

Henry M. Rowan College of Engineering Faculty Scholarship

Traditionally, precision farm equipment often relies on real-time kinematics and global positioning systems (RTK-GPS) for accurate position and velocity estimates. This approach proved effective and widely adopted in developed regions where RTK-GPS satellite and base station availability and visibility are not limited. However, RTK-GPS signal can be limited in farm areas due to topographic and economic constraints. Thus, this study developed a precision sprayer that estimated the travel velocity locally by tracking the relative motion of plants using a deep-learning-based machine vision system. Sprayer valves were then controlled by variable time delay (VTD) queuing and dynamic filtering. The proposed velocity …

Automatic Cardiac Mri Image Segmentation And Mesh Generation, Ziyuan Li

McKelvey School of Engineering Theses & Dissertations

Segmenting and reconstructing cardiac anatomical structures from magnetic resonance (MR) images is essential for the quantitative measurement and automatic diagnosis of cardiovascular diseases [1]. However, manual evaluation of the time-series cardiac MRI (CMRI) obtained during routine clinical care are laborious, inefficient, and tends to produce biased and non-reproducible results [2]. This thesis proposes an end-to-end pipeline for automatically segmenting short-axis (SAX) CMRI images and generating high-quality 2D and 3D meshes suitable for finite element analysis. The main advantage of our approach is that it can not only work as a stand-alone pipeline for the automatic CMR image segmentation and mesh …

Pymaivar: An Open-Source Python Suit For Audio-Image Representation In Human Action Recognition, Muhammad B. Shaikh, Douglas Chai, Syed M. S. Islam, Naveed Akhtar

Research outputs 2022 to 2026

We present PyMAiVAR, a versatile toolbox that encompasses the generation of image representations for audio data including Wave plots, Spectral Centroids, Spectral Roll Offs, Mel Frequency Cepstral Coefficients (MFCC), MFCC Feature Scaling, and Chromagrams. This wide-ranging toolkit generates rich audio-image representations, playing a pivotal role in reshaping human action recognition. By fully exploiting audio data's latent potential, PyMAiVAR stands as a significant advancement in the field. The package is implemented in Python and can be used across different operating systems.

Autonomous Shipwreck Detection & Mapping, William Ard

LSU Master's Theses

This thesis presents the development and testing of Bruce, a low-cost hybrid Remote Operated Vehicle (ROV) / Autonomous Underwater Vehicle (AUV) system for the optical survey of marine archaeological sites, as well as a novel sonar image augmentation strategy for semantic segmentation of shipwrecks. This approach takes side-scan sonar and bathymetry data collected using an EdgeTech 2205 AUV sensor integrated with an Harris Iver3, and generates augmented image data to be used for the semantic segmentation of shipwrecks. It is shown that, due to the feature enhancement capabilities of the proposed shipwreck detection strategy, correctly identified areas have a 15% …

Learning To Rig Characters, Zhan Xu

Doctoral Dissertations

With the emergence of 3D virtual worlds, 3D social media, and massive online games, the need for diverse, high-quality, animation-ready characters and avatars is greater than ever. To animate characters, artists hand-craft articulation structures, such as animation skeletons and part deformers, which require significant amount of manual and laborious interaction with 2D/3D modeling interfaces. This thesis presents deep learning methods that are able to significantly automate the process of character rigging. First, the thesis introduces RigNet, a method capable of predicting an animation skeleton for an input static 3D shape in the form of a polygon mesh. The predicted skeletons …

Developing A Vision-Based Framework For Measuring And Monitoring Water Resource Systems Using Computer Vision And Deep Learning Techniques, Seyed Mohammad Hassan Erfani

Theses and Dissertations

Increased vulnerability of water systems to extreme events and climate change is among the profound challenges facing the management of water resource systems around the world. Extreme events, including droughts, floods, and natural hazards have become more frequent and intensive, particularly in coastal regions. Floods, for instance, caused tens of billions of US dollars losses and put the lives of thousands in danger, globally. To cope with the adverse consequences of floods, a wide range of structural, non-structural, and emergency measures are studied and deployed by flood management sectors. Various flood simulation, mapping, and forecast systems have been developed to …

Novel Approach For Non-Invasive Prediction Of Body Shape And Habitus, Emma Young

Electronic Theses and Dissertations

While marker-based motion capture remains the gold standard in measuring human movement, accuracy is influenced by soft-tissue artifacts, particularly for subjects with high body mass index (BMI) where markers are not placed close to the underlying bone. Obesity influences joint loads and motion patterns, and BMI may not be sufficient to capture the distribution of a subject’s weight or to differentiate differences between subjects. Subjects in need of a joint replacement are more likely to have mobility issues or pain, which prevents exercise. Obesity also increases the likelihood of needing a total joint replacement. Accurate movement data for subjects with …

Unmanned Aerial Vehicle-Based Computer Vision For Structural Vibration Measurement And Condition Assessment: A Concise Survey, Kai Zhou, Zequn Wang, Yi Qing Ni, Yang Zhang, Jiong Tang

Michigan Tech Publications, Part 2

With the rapid advance in camera sensor technology, the acquisition of high-resolution images or videos has become extremely convenient and cost-effective. Computer vision that extracts semantic knowledge directly from digital images or videos, offers a promising solution for non-contact and full-field structural vibration measurement and condition assessment. Unmanned aerial vehicles (UAVs), also known as flying robots or drones, are being actively developed to suit a wide range of applications. Taking advantage of its excellent mobility and flexibility, camera-equipped UAV systems can facilitate the use of computer vision, thus enhancing the capacity of the structural condition assessment. The current article aims …

Computer Vision Aided Hotspot Creation In Virtual Environments, Lama A. Affara, Bilal E. Nakhal

Architecture and Planning Journal (APJ)

Hotspot creation is one of the most important modules within virtual environments which helps show the navigators of these environments some information about semantic elements within it and facilitate the navigation between the virtual spaces. In this paper, a system for automatic hotspot proposals and creation in virtual environments is proposed. The system uses computer vision modules to automatically propose hotspot locations in addition to identifying and creating these hotspots with candidate labels. Two main modules used in the system are object detection and scene segmentation. The scene segmentation helps give candidate hotspot areas and provides an overall understanding of …

Efficient Scopeformer: Towards Scalable And Rich Feature Extraction For Intracranial Hemorrhage Detection Using Hybrid Convolution And Vision Transformer Networks, Yassine Barhoumi

Theses and Dissertations

The field of medical imaging has seen significant advancements through the use of artificial intelligence (AI) techniques. The success of deep learning models in this area has led to the need for further research. This study aims to explore the use of various deep learning algorithms and emerging modeling techniques to improve training paradigms in medical imaging. Convolutional neural networks (CNNs) are the go-to architecture for computer vision problems, but they have limitations in mapping long-term dependencies within images. To address these limitations, the study explores the use of techniques such as global average pooling and self-attention mechanisms. Additionally, the …

Deeptype: A Deep Neural Network Approach To Keyboard-Free Typing, Joshua V. Broekhuijsen

Theses and Dissertations

Textual data entry is an increasingly-important part of Human-Computer Interaction (HCI), but there is room for improvement in this domain. First, the keyboard -- a foundational text-entry device -- presents ergonomic challenges in terms of comfort and accuracy for even well-trained typists. Second, touch-screen smartphones -- some of the most ubiquitous mobile devices -- lack the physical space required to implement a full-size physical keyboard, and settle for a reduced input that can be slow and inaccurate. This thesis proposes and examines "DeepType" to begin addressing both of these problems in the form of a fully-virtual keyboard, realized through a …

Detecting Road Intersections From Satellite Images Using Convolutional Neural Networks, Fatmaelzahraa Eltaher, Luis Miralles-Pechuán, Jane Courtney, Susan Mckeever

Conference papers

Automatic detection of road intersections is an important task in various domains such as navigation, route planning, traffic prediction, and road network extraction. Road intersections range from simple three-way T-junctions to complex large-scale junctions with many branches. The location of intersections is an important consideration for vulnerable road users such as People with Blindness or Visually Impairment (PBVI) or children. Route planning applications, however, do not give information about the location of intersections as this information is not available at scale. As a first step to solving this problem, a mechanism for automatically mapping road intersection locations is required, ideally …

Analyzing The Benthic Cover Of Crustose Coralline Algae Using Mask-R Cnn, Rachana Ravindra

Master's Projects

Coral reefs, supporting 25% of marine biodiversity, confront challenges from local and global impacts like overfishing, runoff, acidification, and warming. Crustose Coralline Algae (CCA), pivotal for reef structure and coral settlement, are underrepresented in research. Current methods like Coral Point Count with Excel Extensions (CPCe) have limitations, relying on image quality and being time-consuming. This paper proposes computer vision and Mask R-CNN, a supervised machine learning model, for CCA analysis in reef images, considering color, texture, and shape. Results indicate promise in clustering and classifying organisms. The innovative technology reduces manual labor, enhancing image analysis, simplifying the understanding of CCA’s …

Sensor Equipped Uas For Non-Contact Bridge Inspections: Field Application, Roya Nasimi, Fernando Moreu, G. Matthew Fricke

Department of Civil and Environmental Engineering: Faculty Publications

In the future, sensors mounted on uncrewed aerial systems (UASs) will play a critical role in increasing both the speed and safety of structural inspections. Environmental and safety concerns make structural inspections and maintenance challenging when conducted using traditional methods, especially for large structures. The methods developed and tested in the laboratory need to be tested in the field on real-size structures to identify their potential for full implementation. This paper presents results from a full-scale field implementation of a novel sensor equipped with UAS to measure non-contact transverse displacement from a pedestrian bridge. To this end, the authors modified …

A Computer Vision-Based Method For Tack Coat Coverage Inspection Using Drone-Collected Images, Aida Da Silva

Graduate Theses, Dissertations, and Problem Reports

Tack coat is a thin asphalt applied between the existing surface and asphalt overlay during road rehabilitation. The uniformity of tack coat coverage plays a vital role in providing adhesive bonding between the two layers in the pavement structures. To ensure tack coat uniformity, the current practice primarily relies on manual inspection during construction by field experts. This process is time-consuming and tedious, and the results can be subjective and error-prone. Drones have emerged as a non-destructive sensing technology in the construction industry for many inspection practices. Unlike other non-destructive inspection technologies, drones offer benefits ranging from accelerating data collection …

Machine Learning Assisted Framework For Advanced Subsurface Fracture Mapping And Well Interference Quantification, Mohammad Faiq Adenan

Graduate Theses, Dissertations, and Problem Reports

The oil and gas industry has historically spent significant amount of capital to acquire large volumes of analog and digital data often left unused due to lack of digital awareness. It has instead relied on individual expertise and numerical modelling for reservoir development, characterization, and simulation, which is extremely time consuming and expensive and inevitably invites significant human bias and error into the equation. One of the major questions that has significant impact in unconventional reservoir development (e.g., completion design, production, and well spacing optimization), CO2 sequestration in geological formations (e.g., well and reservoir integrity), and engineered geothermal systems (e.g., …

An Augmented Reality Maintenance Assistant With Real-Time Quality Inspection On Handheld Mobile Devices, James Thomas Frandsen

Theses and Dissertations

With the advances of industry 4.0, augmented reality (AR) devices are being deployed across the manufacturing sector to enhance worker perception and efficiency. AR is often used to deliver spatially relevant work instructions on mobile devices for maintenance procedures on the factory floor. In these situations, workers use their mobile devices to view instructions in the form of 3D animations and annotations that directly overlay the equipment being maintained. Workers then follow the AR instructions and must ultimately rely on their own judgement and knowledge of the procedure as they progress from step to step. An AR assistant that could …

Development Of A 3d-Printed Microfluidic Droplet-On-Demand System For The Deterministic Encapsulation And Processing Of Biological Materials, Chandler A. Warr

Theses and Dissertations

The growing threat of antimicrobial resistance is among the largest concerns in the world today. One method under development to combat this issue is the encapsulation of microbes in microfluidic droplets for single-cell testing. This method may be able to circumvent the need for a traditional positive cell culture which consumes the majority of the testing time using current diagnostic methods. This dissertation presents a method by which to deterministically encapsulate microbes using an artificial intelligence object detection algorithm and a Droplet-On-Demand microfluidic device. To accomplish this, the Droplet-On-Demand microfluidic device was first developed using a unique 3D-printing manufacturing method. …