research
∙
03/11/2023
OCCL: a Deadlock-free Library for GPU Collective Communication
Various distributed deep neural network (DNN) training technologies lead...
share
research
∙
02/13/2023
SWIFT: Expedited Failure Recovery for Large-scale DNN Training
As the size of deep learning models gets larger and larger, training tak...
research
∙
01/17/2023
AutoDDL: Automatic Distributed Deep Learning with Asymptotically Optimal Communication
Recent advances in deep learning base on growing model sizes and the nec...
research
∙
10/28/2021
OneFlow: Redesign the Distributed Deep Learning Framework from Scratch
Deep learning frameworks such as TensorFlow and PyTorch provide a produc...
research
∙
05/27/2021
Learning Structures for Deep Neural Networks
In this paper, we focus on the unsupervised setting for structure learni...
research
∙
12/04/2014