research
∙
07/04/2023
Deconstructing Data Reconstruction: Multiclass, Weight Decay and General Losses
Memorization of training data is an active research area, yet our unders...
share
research
∙
05/24/2023
From Tempered to Benign Overfitting in ReLU Neural Networks
Overparameterized neural networks (NNs) are observed to generalize well ...
research
∙
05/05/2023
Reconstructing Training Data from Multiclass Neural Networks
Reconstructing samples from the training set of trained neural networks ...
research
∙
03/01/2023
Adversarial Examples Exist in Two-Layer ReLU Networks for Low Dimensional Data Manifolds
Despite a great deal of research, it is still not well-understood why tr...
research
∙
06/15/2022
Reconstructing Training Data from Trained Neural Networks
Understanding to what extent neural networks memorize training data is a...
research
∙
02/09/2022
Gradient Methods Provably Converge to Non-Robust Networks
Despite a great deal of research, it is still unclear why neural network...
research
∙
02/08/2022
Width is Less Important than Depth in ReLU Neural Networks
We solve an open question from Lu et al. (2017), by showing that any tar...
research
∙
10/07/2021
On the Optimal Memorization Power of ReLU Neural Networks
We study the memorization power of feedforward ReLU neural networks. We ...
research
∙
06/02/2021
Learning a Single Neuron with Bias Using Gradient Descent
We theoretically study the fundamental problem of learning a single neur...
research
∙
01/31/2021
The Connection Between Approximation, Depth Separation and Learnability in Neural Networks
Several recent works have shown separation results between deep neural n...
research
∙
10/17/2020
On Size Generalization in Graph Neural Networks
Graph neural networks (GNNs) can process graphs of different sizes but t...
research
∙
06/01/2020
The Effects of Mild Over-parameterization on the Optimization Landscape of Shallow ReLU Neural Networks
We study the effects of mild over-parameterization on the optimization l...
research
∙
02/03/2020
Proving the Lottery Ticket Hypothesis: Pruning is All You Need
The lottery ticket hypothesis (Frankle and Carbin, 2018), states that a ...
research
∙
01/15/2020
Learning a Single Neuron with Gradient Methods
We consider the fundamental problem of learning a single neuron x σ(w^ x...
research
∙
04/01/2019