research
∙
05/23/2023
Chakra: Advancing Performance Benchmarking and Co-design using Standardized Execution Traces
Benchmarking and co-design are essential for driving optimizations and i...
share
research
∙
03/24/2023
ASTRA-sim2.0: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale
As deep learning models and input data are scaling at an unprecedented r...
research
∙
12/16/2022
Mystique: Accurate and Scalable Production AI Benchmarks Generation
Building and maintaining large AI fleets to efficiently support the fast...
research
∙
07/22/2022
Impact of RoCE Congestion Control Policies on Distributed Training of DNNs
RDMA over Converged Ethernet (RoCE) has gained significant attraction fo...
research
∙
10/09/2021
Themis: A Network Bandwidth-Aware Collective Scheduling Policy for Distributed Training of DL Models
The continuous growth in both size and training data for modern Deep Neu...
research
∙
04/12/2021
Software-Hardware Co-design for Fast and Scalable Training of Deep Learning Recommendation Models
Deep learning recommendation models (DLRMs) are used across many busines...
research
∙
06/30/2020
Efficient Communication Acceleration for Next-Gen Scale-up Deep Learning Training Platforms
Deep Learning (DL) training platforms are built by interconnecting multi...
research
∙
06/30/2020
Efficient Communication Acceleration for Next-GenScale-up Deep Learning Training Platforms
Deep Learning (DL) training platforms are built by interconnecting multi...
research
∙
03/20/2020
Deep Learning Training in Facebook Data Centers: Design of Scale-up and Scale-out Systems
Large-scale training is important to ensure high performance and accurac...
research
∙
06/11/2019
Automatic Model Parallelism for Deep Neural Networks with Compiler and Hardware Support
The deep neural networks (DNNs) have been enormously successful in tasks...
research
∙
02/03/2018
Mixed Precision Training of Convolutional Neural Networks using Integer Operations
The state-of-the-art (SOTA) for mixed precision training is dominated by...
research
∙
01/24/2018
On Scale-out Deep Learning Training for Cloud and HPC
The exponential growth in use of large deep neural networks has accelera...
research
∙
08/17/2017
