Computer Engineering Commons^™

Star-Based Reachability Analysis Of Binary Neural Networks On Continuous Input, Mykhailo Ivashchenko

School of Computing: Dissertations, Theses, and Student Research

Deep Neural Networks (DNNs) have become a popular instrument for solving various real-world problems. DNNs’ sophisticated structure allows them to learn complex representations and features. However, architecture specifics and floating-point number usage result in increased computational operations complexity. For this reason, a more lightweight type of neural networks is widely used when it comes to edge devices, such as microcomputers or microcontrollers – Binary Neural Networks (BNNs). Like other DNNs, BNNs are vulnerable to adversarial attacks; even a small perturbation to the input set may lead to an errant output. Unfortunately, only a few approaches have been proposed for verifying …

Uncovering And Mitigating Spurious Features In Domain Generalization, Saeed Karimi, Hamdi̇ Di̇bekli̇oğlu

Turkish Journal of Electrical Engineering and Computer Sciences

Domain generalization (DG) techniques strive to attain the ability to generalize to an unfamiliar target domain solely based on training data originating from the source domains. Despite the increasing attention given to learning from multiple training domains through the application of various forms of invariance across those domains, the enhancements observed in comparison to ERM are nearly insignificant under specified evaluation rules. In this paper, we demonstrate that the disentanglement of spurious and invariant features is a challenging task in conventional training since ERM simply minimizes the loss and does not exploit invariance among domains. To address this issue, we …

Weakly Supervised Attention-Based Recognition Under Spectral, Turbulence, And Resource Variations, Kshitij Naresh Nikhal

Dissertations and Doctoral Documents, University of Nebraska-Lincoln, 2023–

While supervised optimization paradigms are ubiquitous across diverse recognition systems, the risk of over-fitting and increasing bias have limited their applicability.

This dissertation focuses on unsupervised learning—learning without precisely curated data—and argues that unsupervised learning methods can enable both discriminability and generalizability. Through the use of attention-based machine learning and advanced clustering, unsupervised methods are able to focus on fine-grained information in images without any explicit supervision. The dissertation introduces a domain-bridging framework for tasks like cross-spectrum matching and long-range recognition, utilizing intra-domain clustering and inter-domain matching to generate pseudo-labels. Additionally, a hash-based network is proposed to accelerate the search …

Motion Magnification-Inspired Feature Manipulation For Deepfake Detection, Aydamir Mirzayev, Hamdi Di̇bekli̇oğlu

Turkish Journal of Electrical Engineering and Computer Sciences

Recent advances in deep learning, increased availability of large-scale datasets, and improvement of accelerated graphics processing units facilitated creation of an unprecedented amount of synthetically generated media content with impressive visual quality. Although such technology is used predominantly for entertainment, there is widespread practice of using deepfake technology for malevolent ends. This potential for malicious use necessitates the creation of detection methods capable of reliably distinguishing manipulated video content. In this work we aim to create a learning-based detection method for synthetically generated videos. To this end, we attempt to detect spatiotemporal inconsistencies by leveraging a learning-based magnification-inspired feature manipulation …

Ai And 6g Into The Metaverse: Fundamentals, Challenges And Future Research Trends, Muhammad Zawish, Fayaz Ali Dharejo, Sunder Ali Khowaja, Saleem Raza, Steven Davy, Kapal Dev, Paolo Bellavista

Articles

Since Facebook was renamed Meta, a lot of attention, debate, and exploration have intensified about what the Metaverse is, how it works, and the possible ways to exploit it. It is anticipated that Metaverse will be a continuum of rapidly emerging technologies, usecases, capabilities, and experiences that will make it up for the next evolution of the Internet. Several researchers have already surveyed the literature on artificial intelligence (AI) and wireless communications in realizing the Metaverse. However, due to the rapid emergence and continuous evolution of technologies, there is a need for a comprehensive and in-depth survey of the role …

A Few-Shot Multi-Modality Traversability Segmentation Framework For Indoor Robotic Navigation, Qiyuan An

Computer Science and Engineering Dissertations - Archive

Traversability in autonomous robotic navigation refers to the ability of an autonomous agent to safely navigate over a given terrain. It plays a critical role in enabling robots to navigate over unseen or unknown terrains. Traversability segmentation aims to find an arbitrary-shaped mask covering the traversable regions (termed free-space). Current research for traversability segmentation can be divided into two scenarios: outdoor and indoor environments. Compared to the outdoor environments mainly consists of paved roads, indoor environments present unique challenges for traversability segmentation, because of diverse lighting conditions, glass doors, various floor colors and textures, arbitrary shaped appliances and furniture, presence …

Outdoor Navigation Support Using Machine Learning For People With Visual Impairment, Fatmaelzahraa Eltaher

Doctoral

Navigating urban environments is challenging for People with Visual Impairments (PVI). Many PVI opt to use navigation systems, such as Google Maps. However, current navigation systems often lack information crucial for PVI, such as the presence of traffic lights or roadworks. Knowing these features would enable PVI to understand their surroundings better and choose routes that suit their preferences. For instance, 79.6\% of PVI surveyed in this thesis prefer road junctions (termed intersections) controlled by traffic lights.

This research contributes to advancing navigation support for PVI in urban environments by focusing on annotating maps with useful environmental information. It proposes …

Pneumonia Detection With Limited And Imbalanced Data Using Energy-Based Out-Of-Distribution Technique, Jasbin Karki

Browse all Theses and Dissertations

The automated detection of pneumonia through chest X-ray presents a critical challenge in medical diagnostics, particularly due to the restrictions of limited and imbalanced chest X-ray data for training AI models. Traditional methods that depend on softmax confidence scores can be overconfident even when generating erroneous outputs especially when they are processing completely new inputs, leading to unreliable diagnostic results. This research addresses challenges in AI models which aim to develop a robust pneumonia detection system using an Energy-Based Out-of-Distribution (OOD) technique that can work effectively even with limited and imbalanced data. The study focused on creating a more reliable …

Classification Of Sow Postures Using Convolutional Neural Network And Depth Images, Md Towfiqur Rahman, Tami M. Brown-Brandl, Gary A. Rohrer, Sudhendu R. Sharma, Yeyin Shi

Department of Agricultural and Biological Systems Engineering: Faculty Publications

The United States swine industry reports an average preweaning mortality of approximately 16% where approximately 6% of them are attributed to piglets overlayed by sows. Detecting postural transitions and estimating sows’ time budgets for different postures are valuable information for breeders and engineering design of farrowing facilities to eventually reduce piglet death. Computer vision tools can help monitor changes in animal posture accurately and efficiently. To create a more robust system and eliminate varying lighting issues within a day including daytime/ nighttime differences, there is an advantage to using depth cameras over digital cameras. In this study, a computer vision …

Wall-E: An Autonomous Ai Rover For Precision Agriculture, Simar Ghumman

Master's Projects

Unmanned Ground Vehicles (UGVs) are emerging as a crucial tool in the world of precision agriculture. By working with UGVs equipped with machine learning, we can find solutions to a range of complex agricultural problems. My project, titled “Wall-E: Artificial Intelligence Robot for Precision Agriculture,” focuses on developing a UGV capable of navigating through agriculture fields autonomously while capturing data. Using machine learning, computer vision, and other sensor technologies, Wall-E is capable of estimating the total yield of crops, self-localization, mapping its environment in real time, and avoiding obstacles along its route. The purpose of this project is to automate …

Sc-Fuse: A Feature Fusion Approach For Unpaved Road Detection From Remotely Sensed Images, Aniruddh Saxena

School of Computing: Dissertations, Theses, and Student Research

Road network extraction from remote sensing imagery is crucial for numerous applications, ranging from autonomous navigation to urban and rural planning. A particularly challenging aspect is the detection of unpaved roads, often underrepresented in research and data. These roads display variability in texture, width, shape, and surroundings, making their detection quite complex. This thesis addresses these challenges by creating a specialized dataset and introducing the SC-Fuse model.

Our custom dataset comprises high resolution remote sensing imagery which primarily targets unpaved roads of the American Midwest. To capture the diverse seasonal variation and their impact, the dataset includes images from different …

Implementation Of Adas And Autonomy On Unlv Campus, Zillur Rahman

UNLV Theses, Dissertations, Professional Papers, and Capstones

The integration of Advanced Driving Assistance Systems (ADAS) and autonomous driving functionalities into contemporary vehicles has notably surged, driven by the remarkable progress in artificial intelligence (AI). These AI systems, capable of learning from real-world data, now exhibit the capability to perceive their surroundings via a suite of sensors, create optimal routes from source to destination, and execute vehicle control akin to a human driver.

Within the context of this thesis, we undertake a comprehensive exploration of three distinct yet interrelated ADAS and Autonomy projects. Our central objective is the implementation of autonomous driving(AD) technology at UNLV campus, culminating in …

An In-Depth Analysis Of Domain Adaptation In Computer And Robotic Vision, Muhammad Hassan Tanveer, Zainab Fatima, Shehnila Zardari, David A. Guerra-Zubiaga

Faculty Articles

This review article comprehensively delves into the rapidly evolving field of domain adaptation in computer and robotic vision. It offers a detailed technical analysis of the opportunities and challenges associated with this topic. Domain adaptation methods play a pivotal role in facilitating seamless knowledge transfer and enhancing the generalization capabilities of computer and robotic vision systems. Our methodology involves systematic data collection and preparation, followed by the application of diverse assessment metrics to evaluate the efficacy of domain adaptation strategies. This study assesses the effectiveness and versatility of conventional, deep learning-based, and hybrid domain adaptation techniques within the domains of …

Autonomous Shipwreck Detection & Mapping, William Ard

LSU Master's Theses

This thesis presents the development and testing of Bruce, a low-cost hybrid Remote Operated Vehicle (ROV) / Autonomous Underwater Vehicle (AUV) system for the optical survey of marine archaeological sites, as well as a novel sonar image augmentation strategy for semantic segmentation of shipwrecks. This approach takes side-scan sonar and bathymetry data collected using an EdgeTech 2205 AUV sensor integrated with an Harris Iver3, and generates augmented image data to be used for the semantic segmentation of shipwrecks. It is shown that, due to the feature enhancement capabilities of the proposed shipwreck detection strategy, correctly identified areas have a 15% …

Enhancing Driver Distraction Detection Through The Synergy Of Deep And Traditional Machine Learning, Gowtham Chandrasekaran

Master's Projects

Distracted driving is a major contributor to motor vehicle accidents, causing injury and loss of life. It is one of the major factors that affect the overall driving behavior of a person. Insurance companies take into consideration factors like gender, age, etc. to set insurance premiums for their customers. Today, machine learning and artificial intelligence can eradicate this bias. A machine learning model can analyze driving behavior, such as the frequency and severity of accidents, the speed at which they drive, and their habits such as distracted driving. Based on this information, the model can then determine the risk of …

Analyzing The Benthic Cover Of Crustose Coralline Algae Using Mask-R Cnn, Rachana Ravindra

Master's Projects

Coral reefs, supporting 25% of marine biodiversity, confront challenges from local and global impacts like overfishing, runoff, acidification, and warming. Crustose Coralline Algae (CCA), pivotal for reef structure and coral settlement, are underrepresented in research. Current methods like Coral Point Count with Excel Extensions (CPCe) have limitations, relying on image quality and being time-consuming. This paper proposes computer vision and Mask R-CNN, a supervised machine learning model, for CCA analysis in reef images, considering color, texture, and shape. Results indicate promise in clustering and classifying organisms. The innovative technology reduces manual labor, enhancing image analysis, simplifying the understanding of CCA’s …

Accelerating Precision Station Keeping For Automated Aircraft, James D. Anderson

Browse all Theses and Dissertations

Automated vehicles pose challenges in various research domains, including robotics, machine learning, computer vision, public safety, system certification, and beyond. These vehicles autonomously handle navigation and locomotion, often requiring minimal user interaction, and can operate on land, in water, or in the air. In the context of aircraft, one specific application is Automated Aerial Refueling (AAR). Traditional aerial refueling involves a "tanker" aircraft using a mechanism, such as a rigid boom arm or a flexible hose, to transfer fuel to another aircraft designated as the "receiver". For AAR, the boom arm may be maneuvered automatically, or in certain instances the …

Detecting Road Intersections From Satellite Images Using Convolutional Neural Networks, Fatmaelzahraa Eltaher, Luis Miralles-Pechuán, Jane Courtney, Susan Mckeever

Conference papers

Automatic detection of road intersections is an important task in various domains such as navigation, route planning, traffic prediction, and road network extraction. Road intersections range from simple three-way T-junctions to complex large-scale junctions with many branches. The location of intersections is an important consideration for vulnerable road users such as People with Blindness or Visually Impairment (PBVI) or children. Route planning applications, however, do not give information about the location of intersections as this information is not available at scale. As a first step to solving this problem, a mechanism for automatically mapping road intersection locations is required, ideally …

Sequential Frame-Interpolation And Dct-Based Video Compression Framework, Yeganeh Jalalpour, Wu-Chi Feng, Feng Liu

Computer Science Faculty Publications and Presentations

Video data is ubiquitous; capturing, transferring, and storing even compressed video data is challenging because it requires substantial resources. With the large amount of video traffic being transmitted on the internet, any improvement in compressing such data, even small, can drastically impact resource consumption. In this paper, we present a hybrid video compression framework that unites the advantages of both DCT-based and interpolation-based video compression methods in a single framework. We show that our work can deliver the same visual quality or, in some cases, improve visual quality while reducing the bandwidth by 10--20%.

Automated Identification Of Astronauts On Board The International Space Station: A Case Study In Space Archaeology, Rao Hamza Ali, Amir Kanan Kashefi, Alice C. Gorman, Justin St. P. Walsh, Erik J. Linstead

Art Faculty Articles and Research

We develop and apply a deep learning-based computer vision pipeline to automatically identify crew members in archival photographic imagery taken on-board the International Space Station. Our approach is able to quickly tag thousands of images from public and private photo repositories without human supervision with high degrees of accuracy, including photographs where crew faces are partially obscured. Using the results of our pipeline, we carry out a large-scale network analysis of the crew, using the imagery data to provide novel insights into the social interactions among crew during their missions.

Computer Aided Diagnosis System For Breast Cancer Using Deep Learning., Asma Baccouche

Electronic Theses and Dissertations

The recent rise of big data technology surrounding the electronic systems and developed toolkits gave birth to new promises for Artificial Intelligence (AI). With the continuous use of data-centric systems and machines in our lives, such as social media, surveys, emails, reports, etc., there is no doubt that data has gained the center of attention by scientists and motivated them to provide more decision-making and operational support systems across multiple domains. With the recent breakthroughs in artificial intelligence, the use of machine learning and deep learning models have achieved remarkable advances in computer vision, ecommerce, cybersecurity, and healthcare. Particularly, numerous …

Applied Deep Learning: Case Studies In Computer Vision And Natural Language Processing, Md Reshad Ul Hoque

Electrical & Computer Engineering Theses & Dissertations

Deep learning has proved to be successful for many computer vision and natural language processing applications. In this dissertation, three studies have been conducted to show the efficacy of deep learning models for computer vision and natural language processing. In the first study, an efficient deep learning model was proposed for seagrass scar detection in multispectral images which produced robust, accurate scars mappings. In the second study, an arithmetic deep learning model was developed to fuse multi-spectral images collected at different times with different resolutions to generate high-resolution images for downstream tasks including change detection, object detection, and land cover …

Considerations Using Iterative Closest Point In Presence Of Occlusions In Automated Aerial Refueling, Joel M. Miller

Theses and Dissertations

The United States Air Force is researching vision-based AAR and different methods for this actualization. Previous work has established a computer vision based pipeline with ICP. This work focuses on how ICP can become resilient to boom occlusion by minimizing errors and discusses the limitations of ICP in the face of occlusions. Specifically, we look at various filtering techniques to remove non-salient points. To register point clouds while maintaining real time interactivity, this work also presents a method for downsampling high resolution camera calibrations to preserve real-time processing and significantly decrease the vision pipeline latency.

Survey Of Ship Detection In Video Surveillance Based On Shallow Machine Learning, Zhenbo Bi, Shiyou Zhang, Yang Hua, Yuanhong Wu

Journal of System Simulation

Abstract: At present, detection of ship targets in video surveillance based on shallow machine learning methods is still attracting attention in the fields of underwater cultural heritage protection, marine aquaculture, maritime traffic, and port management. This paper provides a review and discussion for this kind of ship detection methods. The ship target detection based on video surveillance is divided into five parts according to the key technologies involved: preprocessing, region of interest extraction, target segmentation, ship feature extraction and ship type recognition. According to different functional modules, the core problems involved in them are pointed out, and the core ideas, …

Lpvit: A Transformer Based Model For Pcb Image Classification And Defect Detection, Kang An, Yanping Zhang

Computer Science Faculty Scholarship

PCB (printed circuit board) is an extremely important component of all electronic products, which has greatly facilitated human life. Meanwhile, tons of PCBs in the waste streams become a waste of resources, which puts the recycling and reuse of PCBs in urgent need. In the manufacturing and recycling of electronic products, the classification of PCBs, recognition of sub-components, and defect detection have been the key technology. Traditional manual detection and classification are subjective and rely on individuals’ experience. With the development of artificial intelligence, lots of research efforts have been dedicated to the automated detection and recognition of PCBs. In …

Kg-Cnn: Augmenting Convolutional Neural Networks With Knowledge Graphs For Multi-Class Image Classification, Aidan O'Neill

Dissertations

Computer vision is slowly becoming more and more prevalent in daily life. Tesla has recently announced that it plans to scale up the manufacturing of their Robotaxis by 2024, with this increase in self-driving vehicles being just one example, the importance of computer vision is growing year by year. Vision can be easy to take for granted, as most humans grow up using vision as their primary way of absorbing environmental information. The way humans process and classify visual information differs significantly from how current computer vision systems process and organise visual information. The human brain can use its past …

Magic: The Gathering Card Virtualizer, Vincent Garbonick, Jacen C. Conlan, Jaret A. Varn

Williams Honors College, Honors Research Projects

Any well-versed Magic: The Gathering (MTG) player or collector knows how difficult it can be to keep track of all cards in their collection. Some spend hours searching for that one specific card, and others are constantly scouring the internet for how much their collection costs. However, this issue does not only affect casual fans. Resale companies spend hours a day determining the costs of cards, and tournament judges painstakingly check players’ decks to ensure they are not cheating. To assist with these struggles, the design team proposed to create the MTG Card Virtualizer. This device scans MTG playing cards …

Lapnitor: A Web Service That Protects Your Laptop From Theft., Michael Ameteku

Williams Honors College, Honors Research Projects

Laptop theft is an issue worldwide. According to an article from 2018, Security Boulevard stated that a laptop is stolen every 53 seconds. Using a laptop's camera, we can monitor the surroundings of the laptop and reduce a laptop's probability of being stolen. According to the University of Pittsburgh, a laptop has a 1-in- 10 chance of being stolen and nearly half of these thefts occur in offices or classrooms. These thefts mostly occur when a laptop owner leaves their device unattended for a certain period of time to maybe go visit the restroom or attend to a call when …

Building An Understanding Of Human Activities In First Person Video Using Fuzzy Inference, Bradley A. Schneider

Browse all Theses and Dissertations

Activities of Daily Living (ADL’s) are the activities that people perform every day in their home as part of their typical routine. The in-home, automated monitoring of ADL’s has broad utility for intelligent systems that enable independent living for the elderly and mentally or physically disabled individuals. With rising interest in electronic health (e-Health) and mobile health (m-Health) technology, opportunities abound for the integration of activity monitoring systems into these newer forms of healthcare. In this dissertation we propose a novel system for describing ’s based on video collected from a wearable camera. Most in-home activities are naturally defined by …

Passive Method For 3d Reconstruction Of Human Jaw: Theory And Application., Mohamad Ghanoum

Electronic Theses and Dissertations

Oral dental applications based on visual data pose various challenges. There are problems with lighting (effect of saliva, tooth dis-colorization, gum texture, and other sources of specularity) and motion (even inevitable slight motions of the upper/ lower jaw may lead to errors far beyond the desired tolerance of sub-millimeter accuracy). Nowadays, the dental CAM systems have become more compromised and accurate to obtain the geometric data of the jaw from the active sensor (laser scanner). However, they have not met the expectations and the needs of dental professionals in many ways. The probes in these systems are bulky { even …