research
∙
05/25/2023
A Guide Through the Zoo of Biased SGD
Stochastic Gradient Descent (SGD) is arguably the most important single ...
share
research
∙
02/02/2022
3PC: Three Point Compressors for Communication-Efficient Distributed Training and a Better Theory for Lazy Aggregation
We propose and study a new class of gradient communication mechanisms fo...
research
∙
10/07/2021
EF21 with Bells Whistles: Practical Algorithmic Extensions of Modern Error Feedback
First proposed by Seide (2014) as a heuristic, error feedback (EF) is a ...
research
∙
06/09/2021