research
∙
10/07/2022
Automatic Discovery of Composite SPMD Partitioning Strategies in PartIR
Large neural network models are commonly trained through a combination o...
share
research
∙
12/06/2021
Automap: Towards Ergonomic Automated Parallelism for ML Models
The rapid rise in demand for training large neural network architectures...
research
∙
10/20/2021
Synthesizing Optimal Parallelism Placement and Reduction Strategies on Hierarchical Systems for Deep Learning
We present a novel characterization of the mapping of multiple paralleli...
research
∙
06/01/2020