research
∙
08/29/2022
Neural Tangent Kernel: A Survey
A seminal work [Jacot et al., 2018] demonstrated that training a neural ...
share
research
∙
05/31/2022
Feature Learning in L_2-regularized DNNs: Attraction/Repulsion and Sparsity
We study the loss surface of DNNs with L_2 regularization. We show that ...
research
∙
05/17/2019
An Essay on Optimization Mystery of Deep Learning
Despite the huge empirical success of deep learning, theoretical underst...
research
∙
12/06/2018