research
∙
05/25/2023
DoWG Unleashed: An Efficient Universal Parameter-Free Gradient Descent Method
This paper proposes a new easy-to-implement parameter-free gradient-base...
share
research
∙
09/06/2022
Faster federated optimization under second-order similarity
Federated learning (FL) is a subfield of machine learning where multiple...
research
∙
11/22/2021
FLIX: A Simple and Communication-Efficient Alternative to Local Methods in Federated Learning
Federated Learning (FL) is an increasingly popular machine learning para...
research
∙
02/12/2021
Proximal and Federated Random Reshuffling
Random Reshuffling (RR), also known as Stochastic Gradient Descent (SGD)...
research
∙
06/20/2020
Unified Analysis of Stochastic Gradient Methods for Composite Convex and Smooth Optimization
We present a unified theorem for the convergence analysis of stochastic ...
research
∙
06/10/2020
Random Reshuffling: Simple Analysis with Vast Improvements
Random Reshuffling (RR) is an algorithm for minimizing finite-sum functi...
research
∙
02/09/2020
Better Theory for SGD in the Nonconvex World
Large-scale nonconvex optimization problems are ubiquitous in modern mac...
research
∙
12/20/2019
Distributed Fixed Point Methods with Compressed Iterates
We propose basic and natural assumptions under which iterative optimizat...
research
∙
09/10/2019
Better Communication Complexity for Local SGD
We revisit the local Stochastic Gradient Descent (local SGD) method and ...
research
∙
09/10/2019
Gradient Descent with Compressed Iterates
We propose and analyze a new type of stochastic first order method: grad...
research
∙
09/10/2019