Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 1 of 1
Full-Text Articles in Engineering
Integrating Deep Learning And Augmented Reality To Enhance Situational Awareness In Firefighting Environments, Manish Bhattarai
Integrating Deep Learning And Augmented Reality To Enhance Situational Awareness In Firefighting Environments, Manish Bhattarai
Electrical and Computer Engineering ETDs
We present a new four-pronged approach to build firefighter's situational awareness for the first time in the literature. We construct a series of deep learning frameworks built on top of one another to enhance the safety, efficiency, and successful completion of rescue missions conducted by firefighters in emergency first response settings. First, we used a deep Convolutional Neural Network (CNN) system to classify and identify objects of interest from thermal imagery in real-time. Next, we extended this CNN framework for object detection, tracking, segmentation with a Mask RCNN framework, and scene description with a multimodal natural language processing(NLP) framework. Third, …