The energy landscape of a simple neural network

06/21/2017

∙

by   Anthony Collins Gamst, et al.

∙

0

∙

share

We explore the energy landscape of a simple neural network. In particular, we expand upon previous work demonstrating that the empirical complexity of fitted neural networks is vastly less than a naive parameter count would suggest and that this implicit regularization is actually beneficial for generalization from fitted models.