research
∙
06/02/2023
Convex and Non-Convex Optimization under Generalized Smoothness
Classical analysis of convex and non-convex optimization methods often r...
share
research
∙
04/27/2023
Convergence of Adam Under Relaxed Assumptions
In this paper, we provide a rigorous proof of convergence of the Adaptiv...
research
∙
03/02/2023
Variance-reduced Clipping for Non-convex Optimization
Gradient clipping is a standard training technique used in deep learning...
research
∙
10/17/2022
Tight Analysis of Extra-gradient and Optimistic Gradient Methods For Nonconvex Minimax Problems
Despite the established convergence theory of Optimistic Gradient Descen...
research
∙
04/03/2022
Byzantine-Robust Federated Linear Bandits
In this paper, we study a linear bandit optimization problem in a federa...
research
∙
10/12/2021
On Convergence of Training Loss Without Reaching Stationary Points
It is a well-known fact that nonconvex optimization is computationally i...
research
∙
04/18/2021
Complexity Lower Bounds for Nonconvex-Strongly-Concave Min-Max Optimization
We provide a first-order oracle complexity lower bound for finding stati...
research
∙
06/19/2019
Convergence of Adversarial Training in Overparametrized Networks
Neural networks are vulnerable to adversarial examples, i.e. inputs that...
research
∙
11/09/2018