research
∙
05/29/2023
Learning Two-Layer Neural Networks, One (Giant) Step at a Time
We study the training dynamics of shallow neural networks, investigating...
share
research
∙
05/29/2023
Escaping mediocrity: how two-layer networks learn hard single-index models with SGD
This study explores the sample complexity for two-layer neural networks ...
research
∙
04/04/2023
A non-backtracking method for long matrix completion
We consider the problem of rectangular matrix completion in the regime w...
research
∙
02/17/2023
Universality laws for Gaussian mixtures in generalized linear models
Let (x_i, y_i)_i=1,…,n denote independent samples from a general mixture...
research
∙
02/17/2023
Are Gaussian data all you need? Extents and limits of universality in high-dimensional generalized linear estimation
In this manuscript we consider the problem of generalized linear estimat...
research
∙
02/12/2023
From high-dimensional mean-field dynamics to dimensionless ODEs: A unifying approach to SGD in two-layers networks
This manuscript investigates the one-pass stochastic gradient descent (S...
research
∙
05/26/2022
Gaussian Universality of Linear Classifiers with Random Labels in High-Dimension
While classical in many theoretical settings, the assumption of Gaussian...
research
∙
03/14/2022
Sparse random hypergraphs: Non-backtracking spectra and community detection
We consider the community detection problem in a sparse q-uniform hyperg...
research
∙
02/01/2022
Phase diagram of Stochastic Gradient Descent in high-dimensional two-layer neural networks
Despite the non-convex optimization landscape, over-parametrized shallow...
research
∙
02/05/2021
A simpler spectral approach for clustering in directed networks
We study the task of clustering in directed networks. We show that using...
research
∙
11/14/2018