research
∙
06/05/2023
Representational Strengths and Limitations of Transformers
Attention layers, as commonly used in transformers, form the backbone of...
share
research
∙
10/27/2022
Learning Single-Index Models with Shallow Neural Networks
Single-index models are a class of functions given by an unknown univari...
research
∙
10/11/2022
On Scrambling Phenomena for Randomly Initialized Recurrent Networks
Recurrent Neural Networks (RNNs) frequently exhibit complicated dynamics...
research
∙
06/10/2022
Intrinsic dimensionality and generalization properties of the ℛ-norm inductive bias
We study the structural and statistical properties of ℛ-norm minimizing ...
research
∙
02/10/2022
Near-Optimal Statistical Query Lower Bounds for Agnostically Learning Intersections of Halfspaces with Gaussian Marginals
We consider the well-studied problem of learning intersections of halfsp...
research
∙
10/19/2021
Expressivity of Neural Networks via Chaotic Itineraries beyond Sharkovsky's Theorem
Given a target function f, how large must a neural network be in order t...
research
∙
05/28/2021
Support vector machines and linear regression coincide with very high-dimensional features
The support vector machine (SVM) and minimum Euclidean norm least square...
research
∙
02/03/2021
On the Approximation Power of Two-Layer Networks of Random ReLUs
This paper considers the following question: how well can depth-two ReLU...
research
∙
12/18/2018
