research
∙
08/09/2023
How to induce regularization in generalized linear models: A guide to reparametrizing gradient flow
In this work, we analyze the relation between reparametrizations of grad...
share
research
∙
05/25/2023
Neural (Tangent Kernel) Collapse
This work bridges two important concepts: the Neural Tangent Kernel (NTK...
research
∙
05/09/2023
Robust Implicit Regularization via Weight Normalization
Overparameterized models may have many interpolating solutions; implicit...
research
∙
07/18/2022
Non-negative Least Squares via Overparametrization
In many applications, solutions of numerical problems are required to be...
research
∙
12/21/2021
More is Less: Inducing Sparsity via Overparameterization
In deep learning it is common to overparameterize the neural networks, t...
research
∙
11/27/2020
Gradient Descent for Deep Matrix Factorization: Dynamics and Implicit Bias towards Low Rank
We provide an explicit analysis of the dynamics of vanilla gradient desc...
research
∙
06/15/2020