Open Access. Powered by Scholars. Published by Universities.®

Signal Processing Commons

Open Access. Powered by Scholars. Published by Universities.®

Articles 1 - 7 of 7

Full-Text Articles in Signal Processing

Composite Style Pixel And Point Convolution-Based Deep Fusion Neural Network Architecture For The Semantic Segmentation Of Hyperspectral And Lidar Data, Kevin T. Decker, Brett J. Borghetti Apr 2022

Composite Style Pixel And Point Convolution-Based Deep Fusion Neural Network Architecture For The Semantic Segmentation Of Hyperspectral And Lidar Data, Kevin T. Decker, Brett J. Borghetti

Faculty Publications

Multimodal hyperspectral and lidar data sets provide complementary spectral and structural data. Joint processing and exploitation to produce semantically labeled pixel maps through semantic segmentation has proven useful for a variety of decision tasks. In this work, we identify two areas of improvement over previous approaches and present a proof of concept network implementing these improvements. First, rather than using a late fusion style architecture as in prior work, our approach implements a composite style fusion architecture to allow for the simultaneous generation of multimodal features and the learning of fused features during encoding. Second, our approach processes the higher …


Machine Learning Land Cover And Land Use Classification Of 4-Band Satellite Imagery, Lorelei Turner [*], Torrey J. Wagner, Paul Auclair, Brent T. Langhals Jan 2022

Machine Learning Land Cover And Land Use Classification Of 4-Band Satellite Imagery, Lorelei Turner [*], Torrey J. Wagner, Paul Auclair, Brent T. Langhals

Faculty Publications

Land-cover and land-use classification generates categories of terrestrial features, such as water or trees, which can be used to track how land is used. This work applies classical, ensemble and neural network machine learning algorithms to a multispectral remote sensing dataset containing 405,000 28x28 pixel image patches in 4 electromagnetic frequency bands. For each algorithm, model metrics and prediction execution time were evaluated, resulting in two families of models; fast and precise. The prediction time for an 81,000-patch group of predictions wasmodels, and >5s for the precise models, and there was not a significant change in prediction time when a …


Learning Set Representations For Lwir In-Scene Atmospheric Compensation, Nicholas M. Westing [*], Kevin C. Gross, Brett J. Borghetti, Jacob A. Martin, Joseph Meola Apr 2020

Learning Set Representations For Lwir In-Scene Atmospheric Compensation, Nicholas M. Westing [*], Kevin C. Gross, Brett J. Borghetti, Jacob A. Martin, Joseph Meola

Faculty Publications

Atmospheric compensation of long-wave infrared (LWIR) hyperspectral imagery is investigated in this article using set representations learned by a neural network. This approach relies on synthetic at-sensor radiance data derived from collected radiosondes and a diverse database of measured emissivity spectra sampled at a range of surface temperatures. The network loss function relies on LWIR radiative transfer equations to update model parameters. Atmospheric predictions are made on a set of diverse pixels extracted from the scene, without knowledge of blackbody pixels or pixel temperatures. The network architecture utilizes permutation-invariant layers to predict a set representation, similar to the work performed …


Multi-Sensor Data Fusion Between Radio Tomographic Imaging And Noise Radar, Christopher Vergara Mar 2019

Multi-Sensor Data Fusion Between Radio Tomographic Imaging And Noise Radar, Christopher Vergara

Theses and Dissertations

The lack of situational awareness within an operational environment is a problem that carries high risk and expensive consequences. Radio Tomographic Imaging (RTI) and noise radar are two proven technologies capable of through-wall imaging and foliage penetration. The intent of this thesis is to provide a proof of concept for the fusion of data from RTI and noise radar. The output of this thesis will consist of a performance comparison between the two technologies followed by the derivation of a fusion technique to produce a single image. Proposals have been made for the integration of multiple-input multiple-output (MIMO) radar with …


Non-Gnss Smartphone Pedestrian Navigation Using Barometric Elevation And Digital Map-Matching, Daniel Broyles, Kyle J. Kauffman, John F. Raquet, Piotr Smagowski Jul 2018

Non-Gnss Smartphone Pedestrian Navigation Using Barometric Elevation And Digital Map-Matching, Daniel Broyles, Kyle J. Kauffman, John F. Raquet, Piotr Smagowski

Faculty Publications

Pedestrian navigation in outdoor environments where global navigation satellite systems (GNSS) are unavailable is a challenging problem. Existing technologies that have attempted to address this problemoften require external reference signals or specialized hardware, the extra size,weight, power, and cost of which are unsuitable for many applications. This article presents a real-time, self-contained outdoor navigation application that uses only the existing sensors on a smartphone in conjunction with a preloaded digital elevation map. The core algorithm implements a particle filter, which fuses sensor data with a stochastic pedestrian motion model to predict the user’s position. The smartphone’s barometric elevation is then …


Design Of A Monocular Multi-Spectral Skin Detection, Melanin Estimation, And False-Alarm Suppression System, Keith R. Peskosky Mar 2010

Design Of A Monocular Multi-Spectral Skin Detection, Melanin Estimation, And False-Alarm Suppression System, Keith R. Peskosky

Theses and Dissertations

A real-time skin detection, false-alarm reduction, and melanin estimation system is designed targeting search and rescue (SAR) with application to special operations for manhunting and human measurement and signatures intelligence. A mathematical model of the system is developed and used to determine how the physical system performs under illumination, target-to-sensor distance, and target-type scenarios. This aspect is important to the SAR community to gain an understanding of the deployability in different operating environments. A multi-spectral approach is developed and consists of two short-wave infrared cameras and two visible cameras. Through an optical chain of lenses, custom designed and fabricated dichroic …


Abstracting Gis Layers From Hyperspectral Imagery, Torsten E. Howard Mar 2009

Abstracting Gis Layers From Hyperspectral Imagery, Torsten E. Howard

Theses and Dissertations

Modern warfare methods in the urban environment necessitates the use of multiple layers of sensors to manage the battle space. Hyperspectral imagers are one possible sensor modality to provide remotely sensed images that can be converted into Geographic Information Systems (GIS) layers. GIS layers abstract knowledge of roads, buildings, and scene content and contain shape files that outline and highlight scene features. Creating shape files is a labor-intensive and time-consuming process. The availability of shape files that reflect the current configuration of an area of interest significantly enhances Intelligence Preparation of the Battlespace (IPB). The solution presented in this thesis …