Physical Sciences and Mathematics Commons^™

An Evolutionary Approximation To Contrastive Divergence In Convolutional Restricted Boltzmann Machines, Ryan R. Mccoppin

Browse all Theses and Dissertations

Deep learning is an emerging area in machine learning that exploits multi-layered neural networks to extract invariant relationships from large data sets. Deep learning uses layers of non-linear transformations to represent data in abstract and discrete forms. Several different architectures have been developed over the past few years specifically to process images including the Convolutional Restricted Boltzmann Machine. The Boltzmann Machine is trained using contrastive divergence, a depth-first gradient based training algorithm. Gradient based training methods have no guarantee of reaching an optimal solution and tend to search a limited region of the solution space. In this thesis, we present …