Engineering Commons^™

Direct Error Driven Learning For Deep Neural Networks With Applications To Bigdata, R. Krishnan, Jagannathan Sarangapani, V. A. Samaranayake

Electrical and Computer Engineering Faculty Research & Creative Works

In this paper, generalization error for traditional learning regimes-based classification is demonstrated to increase in the presence of bigdata challenges such as noise and heterogeneity. To reduce this error while mitigating vanishing gradients, a deep neural network (NN)-based framework with a direct error-driven learning scheme is proposed. To reduce the impact of heterogeneity, an overall cost comprised of the learning error and approximate generalization error is defined where two NNs are utilized to estimate the costs respectively. To mitigate the issue of vanishing gradients, a direct error-driven learning regime is proposed where the error is directly utilized for learning. It …