Digital Commons Network^™

When Is Deep Learning Better And When Is Shallow Learning Better: Qualitative Analysis, Salvador Robles Herrera, Martine Ceberio, Vladik Kreinovich

Departmental Technical Reports (CS)

In many practical situations, deep neural networks work better than the traditional "shallow" ones, however, in some cases, the shallow neural networks lead to better results. At present, deciding which type of neural networks will work better is mostly done by trial and error. It is therefore desirable to come up with some criterion of when deep learning is better and when shallow is better. In this paper, we argue that this depends on whether the corresponding situation has natural symmetries: if it does, we expect deep learning to work better, otherwise we expect shallow learning to be more effective. …