Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 1 of 1
Full-Text Articles in Engineering
Towards Machine Self-Awareness - A Bayesian Framework For Uncertainty Propagation In Deep Neural Networks, Dimah Dera
Towards Machine Self-Awareness - A Bayesian Framework For Uncertainty Propagation In Deep Neural Networks, Dimah Dera
Theses and Dissertations
Deep neural networks (DNNs) have surpassed human-level accuracy in various fields, including object recognition and classification. However, DNNs being inherently deterministic, are unable to evaluate their confidence in the decisions. Bayesian inference provides a principled approach to reason about model confidence or uncertainty by estimating the posterior distribution of the unknown parameters. The challenge in DNNs is the multi-layer stages of non-linearities, which makes propagation of high-dimensional distributions mathematically intractable. This dissertation establishes the theoretical and algorithmic foundations of uncertainty or belief propagation by developing new deep learning models that can quantify their uncertainty in the decision and self-assess their …