research
∙
01/05/2023
Beyond spectral gap (extended): The role of the topology in decentralized learning
In data-parallel optimization of machine learning models, workers collab...
share
research
∙
11/12/2022
Modular Clinical Decision Support Networks (MoDN) – Updatable, Interpretable, and Portable Predictions for Evolving Clinical Environments
Data-driven Clinical Decision Support Systems (CDSS) have the potential ...
research
∙
06/07/2022
Beyond spectral gap: The role of the topology in decentralized learning
In data-parallel optimization of machine learning models, workers collab...
research
∙
10/08/2021
RelaySum for Decentralized Deep Learning on Heterogeneous Data
In decentralized machine learning, workers compute model updates on thei...
research
∙
08/04/2020
PowerGossip: Practical Low-Rank Communication Compression in Decentralized Deep Learning
Lossy gradient compression has become a practical tool to overcome the c...
research
∙
10/25/2019
On the Tunability of Optimizers in Deep Learning
There is no consensus yet on the question whether adaptive gradient meth...
research
∙
05/31/2019
PowerSGD: Practical Low-Rank Gradient Compression for Distributed Optimization
We study gradient compression methods to alleviate the communication bot...
research
∙
01/08/2018