research
∙
03/06/2023
Globally Optimal Training of Neural Networks with Threshold Activation Functions
Threshold activation functions are highly preferable in neural networks ...
share
research
∙
07/15/2021
Newton-LESS: Sparsification without Trade-offs for the Sketched Newton Update
In second-order optimization, a potential bottleneck can be computing th...
research
∙
05/15/2021
Adaptive Newton Sketch: Linear-time Optimization with Quadratic Convergence and Effective Hessian Dimensionality
We propose a randomized algorithm with quadratic convergence rate for co...
research
∙
04/29/2021
Fast Convex Quadratic Optimization Solvers with Adaptive Sketching-based Preconditioners
We consider least-squares problems with quadratic regularization and pro...
research
∙
12/13/2020
Adaptive and Oblivious Randomized Subspace Methods for High-Dimensional Optimization: Sharp Analysis and Lower Bounds
We propose novel randomized optimization methods for high-dimensional co...
research
∙
06/10/2020
All Local Minima are Global for Two-Layer ReLU Neural Networks: The Hidden Convex Optimization Landscape
We are interested in two-layer ReLU neural networks from an optimization...
research
∙
06/10/2020
Effective Dimension Adaptive Sketching Methods for Faster Regularized Least-Squares Optimization
We propose a new randomized algorithm for solving L2-regularized least-s...
research
∙
02/21/2020
Optimal Randomized First-Order Methods for Least-Squares Problems
We provide an exact analysis of a class of randomized algorithms for sol...
research
∙
02/03/2020
Limiting Spectrum of Randomized Hadamard Transform and Optimal Iterative Sketching Methods
We provide an exact analysis of the limiting spectrum of matrices random...
research
∙
11/06/2019
Faster Least Squares Optimization
We investigate randomized methods for solving overdetermined linear leas...
research
∙
06/27/2019
High-Dimensional Optimization in Adaptive Random Subspaces
We propose a new randomized optimization method for high-dimensional pro...
research
∙
08/13/2018
Risk-Sensitive Generative Adversarial Imitation Learning
We study risk-sensitive imitation learning where the agent's goal is to ...
research
∙
11/28/2017