Engineering Commons^™

Composite Style Pixel And Point Convolution-Based Deep Fusion Neural Network Architecture For The Semantic Segmentation Of Hyperspectral And Lidar Data, Kevin T. Decker, Brett J. Borghetti

Faculty Publications

Multimodal hyperspectral and lidar data sets provide complementary spectral and structural data. Joint processing and exploitation to produce semantically labeled pixel maps through semantic segmentation has proven useful for a variety of decision tasks. In this work, we identify two areas of improvement over previous approaches and present a proof of concept network implementing these improvements. First, rather than using a late fusion style architecture as in prior work, our approach implements a composite style fusion architecture to allow for the simultaneous generation of multimodal features and the learning of fused features during encoding. Second, our approach processes the higher …