research
∙
05/24/2023
Momentum Provably Improves Error Feedback!
Due to the high communication overhead when training machine learning mo...
share
research
∙
09/30/2022
EF21-P and Friends: Improved Theoretical Communication Complexity for Distributed Optimization with Bidirectional Compression
The starting point of this paper is the discovery of a novel and simple ...
research
∙
05/31/2022
A Computation and Communication Efficient Method for Distributed Nonconvex Problems in the Partial Participation Setting
We present a new method that includes three key components of distribute...
research
∙
02/02/2022
DASHA: Distributed Nonconvex Optimization with Communication Compression, Optimal Oracle Complexity, and No Client Synchronization
We develop and analyze DASHA: a new family of methods for nonconvex dist...
research
∙
10/07/2021